{"id":4094,"date":"2023-06-28T19:22:03","date_gmt":"2023-06-28T13:52:03","guid":{"rendered":"https:\/\/bscrackers.com\/?p=4094"},"modified":"2023-06-28T19:22:03","modified_gmt":"2023-06-28T13:52:03","slug":"nvidia-tops-benchmark-tests-speed-of-systems-training-chatgpt-like-chatbots","status":"publish","type":"post","link":"https:\/\/bscrackers.com\/?p=4094","title":{"rendered":"Nvidia Tops Benchmark Tests Speed of Systems Training ChatGPT-Like Chatbots"},"content":{"rendered":"<p> [ad_1]<br \/>\n<br \/><img decoding=\"async\" src=\"https:\/\/i.gadgets360cdn.com\/large\/nvidia_reuters_1682491698706.jpg\" \/><\/p>\n<div>\n<p>MLCommons, a group that develops benchmark tests for artificial intelligence (<a href=\"https:\/\/www.gadgets360.com\/tags\/ai\" target=\"_blank\" rel=\"noopener\">AI<\/a>) technology, on Tuesday unveiled results for a new test that determines system speeds when training algorithms used for chatbots like\u00a0<a href=\"https:\/\/www.gadgets360.com\/tags\/chatgpt\" target=\"_blank\" rel=\"noopener\">ChatGPT<\/a>\u00a0&#8212; and <a href=\"https:\/\/www.gadgets360.com\/tags\/nvidia\" target=\"_blank\" rel=\"noopener\">Nvidia<\/a> came out on top.<\/p>\n<p>The MLPerf benchmark is based on <a href=\"https:\/\/www.gadgets360.com\/tags\/gpt-3\" target=\"_blank\" rel=\"noopener\">GPT-3<\/a>, an AI model used to train\u00a0ChatGPT, the viral chatbot developed by <a href=\"https:\/\/www.gadgets360.com\/tags\/openai\" target=\"_blank\" rel=\"noopener\">OpenAI<\/a> and backed by <a href=\"https:\/\/www.gadgets360.com\/microsoft\" target=\"_blank\" rel=\"noopener\">Microsoft<\/a>. However, because the model is huge, the benchmark only uses a representative portion.<\/p>\n<p>&#8220;This was our most expensive benchmark so far,&#8221; MLCommons Executive Director David Kanter told Reuters. &#8220;We spent over 600K hours of accelerator compute time to develop it, plus some fantastically talented engineers.&#8221;<\/p>\n<p>Kanter declined to disclose the cost of development, only saying it was in the millions of dollars.<\/p>\n<p>Only two chip firms &#8212; Nvidia and Intel&#8217;s Habana Labs &#8212; submitted results for the benchmark, with the fastest time coming from systems using the latest H100 chip from Nvidia, the uncontested leader in hardware for training AI.<\/p>\n<p>Nvidia&#8217;s largest system submitted in partnership with AI cloud startup CoreWeave used 3,584 H100 chips, resulting in a training time of 10.94 minutes. Habana Labs, an AI chip company acquired by Intel, ran the benchmark in 311.945 minutes with a much smaller system equipped with 384 Gaudi2 chips.<\/p>\n<p>Generally, more chips and a bigger system mean faster training.<\/p>\n<p>Intel&#8217;s Jordan Plawner, senior director of AI Products, said the results demonstrated the potential of Gaudi2, which will have a software update in September to boost speed.<\/p>\n<p>&#8220;You will get a 1.5X to 2X speed up on the Habana results. So that&#8217;s when we see Habana Gaudi2 being really competitive and lower priced than H100,&#8221; Plawner told Reuters.<\/p>\n<p>Plawner declined to say how much a Gaudi2 chip costs, but said the industry needs a second supplier of chips for AI training, and the MLPerf results show Intel can fill that need.<\/p>\n<p><em>\u00a9 Thomson Reuters 2023<\/em><\/p>\n<hr\/>\n<div><em>Apple unveiled its first mixed reality headset, the Apple Vision Pro, at its annual developer conference, along with new Mac models and upcoming software updates. We discuss all the most important announcements made by the company at WWDC 2023 on <a href=\"https:\/\/www.gadgets360.com\/tags\/orbital\" target=\"_blank\" rel=\"noopener\">Orbital<\/a>, the Gadgets 360 podcast. Orbital is available on <a href=\"https:\/\/open.spotify.com\/show\/1TQIHsTESxrsHleJVhUKcr\" rel=\"nofollow noopener\" target=\"_blank\">Spotify<\/a>, <a href=\"https:\/\/pricee.com\/api\/redirect\/t.php?from=gadgets360&amp;redirect=https%3A%2F%2Fgaana.com%2Fpodcast%2Forbital-season-1\" rel=\"nofollow noopener\" target=\"_blank\">Gaana<\/a>, <a href=\"https:\/\/pricee.com\/api\/redirect\/t.php?from=gadgets360&amp;redirect=https%3A%2F%2Fwww.jiosaavn.com%2Fshows%2Forbital%2F1%2Fr9VmNAJ211U\" rel=\"nofollow noopener\" target=\"_blank\">JioSaavn<\/a>, <a href=\"https:\/\/pricee.com\/api\/redirect\/t.php?from=gadgets360&amp;redirect=https%3A%2F%2Fpodcasts.google.com%2Ffeed%2FaHR0cHM6Ly9jZG4uZ2FkZ2V0czM2MC5jb20vY29udGVudC9kYXRhL3htbC9vcmJpdGFsLnhtbA\" rel=\"nofollow noopener\" target=\"_blank\">Google Podcasts<\/a>, <a href=\"https:\/\/itunes.apple.com\/in\/podcast\/orbital-gadgets-360-podcast\/id1121036073\" rel=\"nofollow noopener\" target=\"_blank\">Apple Podcasts<\/a>, <a href=\"https:\/\/pricee.com\/api\/redirect\/t.php?from=gadgets360&amp;redirect=https%3A%2F%2Fmusic.amazon.in%2Fpodcasts%2Fe3a8ca64-3005-4427-a89e-b3e8ec828c3b%2FOrbital\" rel=\"nofollow noopener\" target=\"_blank\">Amazon Music<\/a> and wherever you get your podcasts.<\/em><br \/><iframe allow=\"autoplay; clipboard-write; encrypted-media; fullscreen; picture-in-picture\" allowfullscreen=\"\" frameborder=\"0\" height=\"152\" loading=\"lazy\" data-src=\"https:\/\/open.spotify.com\/embed\/episode\/6feQs1t9LhpU9s6YN5ba5I?utm_source=generator&amp;theme=0\" style=\"border-radius:12px\" width=\"100%\"><\/iframe><\/div>\n<div class=\"downloadtxt\"><i>Affiliate links may be automatically generated &#8211; see our <a href=\"https:\/\/www.gadgets360.com\/ethics\" target=\"_blank\" rel=\"noopener\">ethics statement<\/a> for details.<\/i><\/div>\n<\/div>\n<p>[ad_2]<br \/>\n<br \/><a href=\"https:\/\/www.gadgets360.com\/internet\/news\/nvidia-benchmark-test-speed-systems-training-chatgpt-like-chatbots-4160160\" target=\"_blank\" rel=\"noopener\">Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>[ad_1] MLCommons, a group that develops benchmark tests for artificial intelligence (AI) technology, on Tuesday unveiled results for a new test that determines system speeds when training algorithms used for chatbots like\u00a0ChatGPT\u00a0&#8212; and Nvidia came out on top. The MLPerf benchmark is based on GPT-3, an AI model used to train\u00a0ChatGPT, the viral chatbot developed &#8230; <a title=\"Nvidia Tops Benchmark Tests Speed of Systems Training ChatGPT-Like Chatbots\" class=\"read-more\" href=\"https:\/\/bscrackers.com\/?p=4094\" aria-label=\"Read more about Nvidia Tops Benchmark Tests Speed of Systems Training ChatGPT-Like Chatbots\">Read more<\/a><\/p>\n","protected":false},"author":1,"featured_media":4095,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[107],"tags":[],"class_list":["post-4094","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-tech"],"_links":{"self":[{"href":"https:\/\/bscrackers.com\/index.php?rest_route=\/wp\/v2\/posts\/4094","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/bscrackers.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/bscrackers.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/bscrackers.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/bscrackers.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=4094"}],"version-history":[{"count":0,"href":"https:\/\/bscrackers.com\/index.php?rest_route=\/wp\/v2\/posts\/4094\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/bscrackers.com\/index.php?rest_route=\/wp\/v2\/media\/4095"}],"wp:attachment":[{"href":"https:\/\/bscrackers.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=4094"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/bscrackers.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=4094"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/bscrackers.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=4094"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}