{"id":5539,"date":"2023-07-06T08:24:39","date_gmt":"2023-07-06T02:54:39","guid":{"rendered":"https:\/\/bscrackers.com\/?p=5539"},"modified":"2023-07-06T08:24:39","modified_gmt":"2023-07-06T02:54:39","slug":"chatgpt-maker-openai-says-it-is-doubling-down-on-preventing-ai-from-going-rogue","status":"publish","type":"post","link":"https:\/\/bscrackers.com\/?p=5539","title":{"rendered":"ChatGPT-Maker OpenAI Says It Is Doubling Down On Preventing AI From ‘Going Rogue’"},"content":{"rendered":"

[ad_1]
\n<\/p>\n

\n
\n
\"The<\/figure>\n

The potential dangers of AI have been top of mind for both AI researchers.<\/p>\n<\/div>\n

\n

ChatGPT’s creator OpenAI plans to invest significant resources and create a new research team that will seek to ensure its artificial intelligence remains safe for humans eventually using AI to supervise itself, it said on Wednesday.<\/h2>\n<\/div>\n<\/div>\n
\n
\n

ChatGPT\u2019s creator OpenAI plans to invest significant resources and create a new research team that will seek to ensure its artificial intelligence remains safe for humans \u2013 eventually using AI to supervise itself, it said on Wednesday.<\/p>\n

\u201dThe vast power of superintelligence could \u2026 lead to the disempowerment of humanity or even human extinction,\u201d OpenAI co-founder Ilya Sutskever and head of alignment Jan Leike wrote in a blog post. \u201dCurrently, we don\u2019t have a solution for steering or controlling a potentially superintelligent AI, and preventing it from going rogue.\u201d<\/p>\n

Superintelligent AI \u2013 systems more intelligent than humans \u2013 could arrive this decade, the blog post\u2019s authors predicted. Humans will need better techniques than currently available to be able to control the superintelligent AI, hence the need for breakthroughs in so-called \u201dalignment research,\u201d which focuses on ensuring AI remains beneficial to humans, according to the authors.<\/p>\n

OpenAI, backed by Microsoft, is dedicating 20% of the compute power it has secured over the next four years to solving this problem, they wrote. In addition, the company is forming a new team that will organize around this effort, called the Superalignment team.<\/p>\n

<\/p>\n

The team\u2019s goal is to create a \u201dhuman-level\u201d AI alignment researcher, and then scale it through vast amounts of compute power. OpenAI says that means they will train AI systems using human feedback, train AI systems to assistant human evaluation, and then finally train AI systems to actually do the alignment research.<\/p>\n

AI\u00a0safety advocate Connor Leahy said the plan was fundamentally flawed because the initial human-level AI could run amok and wreak havoc before it could be compelled to solve AI\u00a0safety problems.<\/p>\n

\u201dYou have to solve alignment before you build human-level intelligence, otherwise by default you won\u2019t control it,\u201d he said in an interview. \u201dI personally do not think this is a particularly good or safe plan.\u201d<\/p>\n

<\/p>\n

The potential dangers of AI have\u00a0been top of mind for both AI researchers and the general public. In April, a group of AI industry leaders and experts signed an open letter calling for a six-month pause in developing systems more powerful than OpenAI\u2019s GPT-4, citing potential risks to society. A May Reuters\/Ipsos poll found that more than two-thirds of Americans are concerned about the possible negative effects of AI and 61% believe it could threaten civilization.<\/p>\n

(This story has not been edited by News18 staff and is published from a syndicated news agency feed – Reuters<\/a>)<\/i> <\/div>\n

\n
\n
\n
\"\"\/<\/div>\n
Bharat Upadhyay<\/span><\/a><\/p>\n
Bharat Upadhyay, Senior Sub-Editor at News18 Tech, writes about technology and consumer gadgets. He has been covering the technology beat for over six…Read More<\/a><\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n

[ad_2]
\n
Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

[ad_1] The potential dangers of AI have been top of mind for both AI researchers. ChatGPT’s creator OpenAI plans to invest significant resources and create a new research team that will seek to ensure its artificial intelligence remains safe for humans eventually using AI to supervise itself, it said on Wednesday. ChatGPT\u2019s creator OpenAI plans … Read more<\/a><\/p>\n","protected":false},"author":1,"featured_media":3150,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[107],"tags":[],"class_list":["post-5539","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-tech"],"_links":{"self":[{"href":"https:\/\/bscrackers.com\/index.php?rest_route=\/wp\/v2\/posts\/5539","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/bscrackers.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/bscrackers.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/bscrackers.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/bscrackers.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=5539"}],"version-history":[{"count":0,"href":"https:\/\/bscrackers.com\/index.php?rest_route=\/wp\/v2\/posts\/5539\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/bscrackers.com\/index.php?rest_route=\/wp\/v2\/media\/3150"}],"wp:attachment":[{"href":"https:\/\/bscrackers.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=5539"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/bscrackers.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=5539"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/bscrackers.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=5539"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}