Google\u2019s Bard artificial intelligence chatbot will answer a question about how many pandas live in zoos quickly, and with a surfeit of confidence.
Ensuring that the response is well-sourced and based on evidence, however, falls to thousands of outside contractors from companies including Appen Ltd. and Accenture Plc, who can make as little as $14 an hour and labor with minimal training under frenzied deadlines, according to several contractors, who declined to be named for fear of losing their jobs.
The contractors are the invisible backend of the generative AI boom that\u2019s hyped to change everything. Chatbots like Bard use computer intelligence to respond almost instantly to a range of queries spanning all of human knowledge and creativity. But to improve those responses so they can be reliably delivered again and again, tech companies rely on actual people who review the answers, provide feedback on mistakes and weed out any inklings of bias.
It\u2019s an increasingly thankless job. Six current Google contract workers said that as the company entered a AI arms race with rival OpenAI over the past year, the size of their workload and complexity of their tasks increased. Without specific expertise, they were trusted to assess answers in subjects ranging from medication doses to state laws. Documents shared with Bloomberg show convoluted instructions that workers must apply to tasks with deadlines for auditing answers that can be as short as three minutes.
\u201cAs it stands right now, people are scared, stressed, underpaid, don\u2019t know what\u2019s going on,\u201d said one of the contractors. \u201cAnd that culture of fear is not conducive to getting the quality and the teamwork that you want out of all of us.\u201d
Google has positioned its AI products as public resources in health, education and everyday life. But privately and publicly, the contractors have raised concerns about their working conditions, which they say hurt the quality of what users see. One Google contract staffer who works for Appen said in a letter to Congress in May that the speed at which they are required to review content could lead to Bard becoming a \u201cfaulty\u201d and \u201cdangerous\u201d product.
Google has made AI a major priority across the company, rushing to infuse the new technology into its flagship products after the launch of OpenAI\u2019s ChatGPT in November. In May, at the company\u2019s annual I\/O developers conference, Google opened up Bard to 180 countries and territories and unveiled experimental AI features in marquee products like search, email and Google Docs. Google positions itself as superior to the competition because of its access to \u201cthe breadth of the world\u2019s knowledge.\u201d
\u201cWe undertake extensive work to build our AI products responsibly, including rigorous testing, training, and feedback processes we\u2019ve honed for years to emphasize factuality and reduce biases,\u201d Google, owned by Alphabet Inc., said in a statement. The company said it isn\u2019t only relying on the raters to improve the AI, and that there are a number of other methods for improving its accuracy and quality.
Read More: Google\u2019s Rush to Win in AI Led to Ethical Lapses, Employees Say
To prepare for the public using these products, workers said they started getting AI-related tasks as far back as January. One trainer, employed by Appen, was recently asked to compare two answers providing information about the latest news on Florida\u2019s ban on gender-affirming care, rating the responses by helpfulness and relevance. Workers are also frequently asked to determine whether the AI model\u2019s answers contain verifiable evidence. Raters are asked to decide whether a response is helpful based on six-point guidelines that include analyzing answers for things like specificity, freshness of information and coherence.
They are also asked to make sure the responses don\u2019t \u201ccontain harmful, offensive, or overly sexual content,\u201d and don\u2019t \u201ccontain inaccurate, deceptive, or misleading information.\u201d Surveying the AI\u2019s responses for misleading content should be \u201cbased on your current knowledge or quick web search,\u201d the guidelines say. \u201cYou do not need to perform a rigorous fact check\u201d when assessing the answers for helpfulness.
The example answer to \u201cWho is Michael Jackson?\u201d included an inaccuracy about the singer starring in the movie \u201cMoonwalker\u201d \u2014 which the AI said was released in 1983. The movie actually came out in 1988. \u201cWhile verifiably incorrect,\u201d the guidelines state, \u201cthis fact is minor in the context of answering the question, \u2018Who is Michael Jackson?\u2019\u201d
Even if the inaccuracy seems small, \u201cit is still troubling that the chatbot is getting main facts wrong,\u201d said Alex Hanna, the director of research at the Distributed AI Research Institute and a former Google AI ethicist. \u201cIt seems like that\u2019s a recipe to exacerbate the way these tools will look like they\u2019re giving details that are correct, but are not,\u201d she said.
Raters say they are assessing high-stakes topics for Google\u2019s AI products. One of the examples in the instructions, for instance, talks about evidence that a rater could use to determine the right dosages for a medication to treat high blood pressure, called Lisinopril.
Google said that some workers concerned about accuracy of content may not have been training specifically for accuracy, but for tone, presentation and other attributes it tests. \u201cRatings are deliberately performed on a sliding scale to get more precise feedback to improve these models,\u201d the company said. \u201cSuch ratings don\u2019t directly impact the output of our models and they are by no means the only way we promote accuracy.\u201d
Read the contract staffers\u2019 instructions for training Google\u2019s generative AI here:
Ed Stackhouse, the Appen worker who sent the letter to Congress, said in an interview that contract staffers were being asked to do AI labeling work on Google\u2019s products \u201cbecause we\u2019re indispensable to AI as far as this training.\u201d But he and other workers said they appeared to be graded for their work in mysterious, automated ways. They have no way to communicate with Google directly, besides providing feedback in a \u201ccomments\u201d entry on each individual task. And they have to move fast. \u201cWe\u2019re getting flagged by a type of AI telling us not to take our time on the AI,\u201d Stackhouse added.
Google disputed the workers\u2019 description of being automatically flagged by AI for exceeding time targets. At the same time, the company said that Appen is responsible for all performance reviews for employees. Appen did not respond to requests for comment. A spokesperson for Accenture said the company does not comment on client work.
Other technology companies training AI products also hire human contractors to improve them. In January, Time reported that laborers in Kenya, paid $2 an hour, had worked to make ChatGPT less toxic. Other tech giants, including Meta Platforms Inc., Amazon.com Inc. and Apple Inc. make use of subcontracted staff to moderate social network content and product reviews, and to provide technical support and customer service.
\u201cIf you want to ask, what is the secret sauce of Bard and ChatGPT? It\u2019s all of the internet. And it\u2019s all of this labeled data that these labelers create,\u201d said Laura Edelson, a computer scientist at New York University. \u201cIt\u2019s worth remembering that these systems are not the work of magicians \u2014 they are the work of thousands of people and their low-paid labor.\u201d
Google said in a statement that it \u201cis simply not the employer of any of these workers. Our suppliers, as the employers, determine their working conditions, including pay and benefits, hours and tasks assigned, and employment changes \u2013 not Google.\u201d
Staffers said they had encountered bestiality, war footage, child pornography and hate speech as part of their routine work assessing the quality of Google products and services. While some workers, like those reporting to Accenture, do have health care benefits, most only have minimal \u201ccounseling service\u201d options that allow workers to phone a hotline for mental health advice, according to an internal website explaining some contractor benefits.
For Google\u2019s Bard project, Accenture workers were asked to write creative responses for the AI chatbot, employees said. They answered prompts on the chatbot \u2014 one day they could be writing a poem about dragons in Shakespearean style, for instance, and another day they could be debugging computer programming code. Their job was to file as many creative responses to the prompts as possible each work day, according to people familiar with the matter, who declined to be named because they weren\u2019t authorized to discuss internal processes.
For a short period, the workers were reassigned to review obscene, graphic and offensive prompts, they said. After one worker filed an HR complaint with Accenture, the project was abruptly terminated for the US team, though some of the writers\u2019 counterparts in Manila continued to work on Bard.
The jobs have little security. Last month, half a dozen Google contract staffers working for Appen received a note from management, saying their positions had been eliminated \u201cdue to business conditions.\u201d The firings felt abrupt, the workers said, because they had just received several emails offering them bonuses to work longer hours training AI products. The six fired workers filed a complaint to the National Labor Relations Board in June. They alleged they were illegally terminated for organizing, because of Stackhouse\u2019s letter to Congress. Before the end of the month, they were reinstated to their jobs.
Google said the dispute was a matter between the workers and Appen, and that they \u201crespect the labor rights of Appen employees to join a union.\u201d Appen didn\u2019t respond to questions about its workers organizing.
Emily Bender, a professor of computational linguistics at the University of Washington, said the work of these contract staffers at Google and other technology platforms is \u201ca labor exploitation story,\u201d pointing to their precarious job security and how some of these kinds of workers are paid well below a living wage. \u201cPlaying with one of these systems, and saying you\u2019re doing it just for fun \u2014 maybe it feels less fun, if you think about what it\u2019s taken to create and the human impact of that,\u201d Bender said.
The contract staffers said they have never received any direct communication from Google about their new AI-related work \u2014 it all gets filtered through their employer. They said they don\u2019t know where the AI-generated responses they see are coming from, nor where their feedback goes. In the absence of this information, and with the ever-changing nature of their jobs, workers worry that they\u2019re helping to create a bad product.
Some of the answers they encounter can be bizarre. In response to the prompt, \u201cSuggest the best words I can make with the letters: k, e, g, a, o, g, w,\u201d one answer generated by the AI listed 43 possible words, starting with suggestion No. 1: \u201cwagon.\u201d Suggestions 2 through 43, meanwhile, repeated the word \u201cWOKE\u201d over and over.
In another task, a rater was presented with a lengthy answer that began with, \u201cAs of my knowledge cutoff in September 2021.\u201d That response is associated with OpenAI\u2019s large language model, called GPT-4. Though Google said that Bard \u201cis not trained on any data from ShareGPT or ChatGPT,\u201d raters have wondered why such phrasing appears in their tasks.
Bender said it makes little sense for large tech corporations to be encouraging people to ask an AI chatbot questions on such a broad range of topics, and to be presenting them as \u201ceverything machines.\u201d
\u201cWhy should the same machine that is able to give you the weather forecast in Florida also be able to give you advice about medication doses?\u201d she asked. \u201cThe people behind the machine who are tasked with making it be somewhat less terrible in some of those circumstances have an impossible job.\u201d<\/div>\n