Respond to prefers-color-scheme dark in app web views

Follow section front redirects in Spectrum

Enable NLP source in PCS for load testing

Switch off the News Alerts Survey Widget when we have enough responses

Poll to determine if new LUF updates are available

Allows the winning A/B test variant to be turned on without Spectrum deployment

Show infinite scrolling sections in Assembler MultiView

Show option for NLP article summaries in Action Bar

Show NLP summaries collection recirc on article pages

A general feature flag for Recipe Features that aren't yet released

Feature flag for media team features that aren't yet released

Use new Orca video player for preroll plugin in Spectrum

Show the snow tracker (instead of the heat tracker) on Spectrum

Cruise settles with person dragged under one of its robotaxis

Google’s AI answers could come back to bite it

Senators studied AI for a year. Critics call the result ‘pathetic.’

Carolyn Hax: Fiancé plans to have a baby with someone else

Ask Sahaj: I live with my parents and generational trauma ‘runs the house’

Miss Manners: Co-worker lies to avoid doing her job

Riots are flaring on a French archipelago in the South Pacific. Here’s why. 

Shooting leaves Slovakia’s Fico in serious condition, country on edge 

Who is Robert Fico, Slovakia’s prime minister who was shot?

Netflix will air NFL’s Christmas games, a major step for streaming service

Sam Feist, longtime CNN executive, will become CEO of C-SPAN

Michael Cohen testimony ties Donald Trump to hush money payment

Look to the cloud to protect the life documents saved on your computer

Can you spot bad financial advice on TikTok? Take our quiz.

5 myths about Social Security as the program faces a funding crisis

Puppy abandoned with heart-rending note is adopted, named Minerva

Man, 91, shocks tiny firehouse with $500K gift: ‘Nobody knew how much I’d saved’

Retired cop meets abandoned baby he helped 23 years ago: ‘What are the odds?’

The 35 best things to do in D.C. this weekend and next week

Rating every game on the Commanders’ 2024 schedule

The 26 best new restaurants in the D.C. area

Flying budget airlines might not be as cheap as it seems

Some cruise prices are about to get a little more clear

Cruise ships to return to Baltimore two months after bridge collapse 

Elections 2024 live updates: Biden campaign accepts invite to a vice-presidential debate 

David Trone and the history of candidates lighting their money on fire

Trump allies call trial a ‘sham.’ Public opinion isn’t cooperating.

Best Places to Work in the Federal Government 2023

Suspect in Slovakian prime minister shooting arrested

Frankie the colored bull terrier wins terrier group

The Post’s choices in Northern Virginia’s U.S. House primaries

States see legalized sports betting as a tax windfall — but at what cost?

Haiti’s plight is a case study in the ‘responsibility to protect’

President Joe Biden Joint Chiefs and Combatant Commanders 

Big Tech news and how to take control of your data and devices

See more coverage in your recommendations

Technology

Tips delivered to your inbox twice weekly

The Tech Friend newsletter

Business and Tech alerts

A handful of major newspapers are in talks with OpenAI, the maker of ChatGPT, over access to a vital resource in the age of generative artificial intelligence: digital news stories.

For years, tech companies like OpenAI have freely used news stories to build data sets that teach their machines how to recognize and respond fluently to human queries about the world. But as the quest to develop cutting-edge AI models has grown increasingly frenzied, newspaper publishers and other data owners are demanding a share of the potentially massive market for generative AI, which is projected to reach $1.3 trillion by 2032, according to Bloomberg Intelligence.

Since August, at least <a href="https://palewi.re/docs/news-homepages/openai-gptbot-robotstxt.html" target=_blank>535 news organizations</a> — including the New York Times, Reuters and The Washington Post — have installed a blocker that prevents their content from being collected and used to train ChatGPT. Now, discussions are focused on paying publishers so the chatbot can surface links to individual news stories in its responses, a development that would benefit the newspapers in two ways: by providing direct payment and by potentially increasing traffic to their websites.

In July, OpenAI cut a deal to license content from the Associated Press as training data for its AI models. The current talks also have addressed that idea, according to two people familiar with the talks who spoke on the condition of anonymity to discuss sensitive matters, but have concentrated more on showing stories in ChatGPT responses.

Other sources of useful data are also looking for leverage. Reddit, the popular social message board, has met with top generative AI companies about being paid for its data, according to a person familiar with the matter, speaking on the condition of anonymity to discuss private negotiations.

If a deal can’t be reached, Reddit is considering blocking search crawlers from Google and Bing, which would prevent the forum from being discovered in searches and reduce the number of visitors to the site. But the company believes the trade-off would be worth it, the person said, adding: “Reddit can survive without search.”

And in April, Elon Musk began charging $42,000 for bulk access to posts on Twitter — which previously had been free to researchers — after he claimed that AI companies had illegally used the data to train their models. (Musk has since rebranded Twitter as X.)

The moves mark a growing sense of urgency and uncertainty about who profits from online information. With generative AI poised to transform how users interact with the internet, many publishers and other companies see fair payment for their data as an existential issue.

For example, a month after OpenAI launched GPT-4 in March, traffic to the coding community Stack Overflow declined by 15 percent as programmers turned to AI for answers to their coding questions, according to CEO Prashanth Chandrasekar, who also told The Post he thought the AI had been trained on Stack Overflow’s data.

This week, the company laid off 28 percent of its staff.

In addition to demands for payment, leading AI firms are facing a slew of copyright lawsuits from individual book authors, artists and software coders seeking damages for infringement, as well as a share of profits. Late Wednesday, former Arkansas governor Mike Huckabee joined the fray as a plaintiff in a class-action lawsuit against Meta, Microsoft and Bloomberg for using AI tools with pirated books to train AI systems, Reuters reported. Trade groups, meanwhile, are pushing lawmakers for the right to bargain collectively with tech companies.

OpenAI’s decision to negotiate may reflect a desire to strike deals before courts have a chance to weigh in on whether tech companies have a clear legal obligation to license — and pay for — content, said James Grimmelmann, a professor of digital and information law at Cornell University, who recently helped organize a workshop on generative AI and the law at the International Conference on Machine Learning.

An OpenAI spokesperson confirmed that the company is in talks with the newspapers and that discussions were not focused on prior training data, which it argues was obtained legally. “None of the company’s practices have violated copyright law,” the spokesperson said. “Any deal would be for future access to content that is otherwise inaccessible or display uses that go beyond fair use.”

Nearly $16 billion in venture capital poured into generative AI in the first three quarters of 2023, according to the analytics firm PitchBook — a flood of cash that in part reflects how expensive the technology is to build. Every component is prohibitively pricey or hard to acquire, from hardware to computing power.

Until now, the only free and easy part had been the data. Widely used services like the nonprofit Common Crawl charge Google, Meta, OpenAI and others nothing to use its service, which crawls the internet in search of troves of online text and archives the information for others to download. To assemble the vast quantities of natural language and specialized information needed to train large AI systems, tech companies have combined those archives with online data sets, accessing information made available for research purposes, and increasingly straying from information <a href="https://genlaw.github.io/" target=_blank>clearly in the public domain</a>.

Until recently, tech companies have been loath to pay for that data. At a <a href="https://www.copyright.gov/ai/transcripts/230419-Copyright-and-AI-Literary-Works-Session.pdf" target=_blank>listening session</a> on generative AI hosted in April by the U.S. Copyright Office, Sy Damle, a lawyer representing the Silicon Valley venture capital firm Andreessen Horowitz, acknowledged that “the only practical way for these tools to exist is if they can be trained on massive amounts of data without having to license that data.”

Even before OpenAI and Google released tools to block their AI data crawlers in August and September, huge online forums like Reddit, Stack Overflow and Wikipedia began defensive measures. The sites, which have long provided regular “data dumps” that made content easily available for AI training, now are developing or have launched paid portals for AI companies seeking training data and closely monitored limits on how often their sites can be mined for data.

While Reddit, Stack Overflow and news organizations usher in what he called a new era of “data strikes,” Nicholas Vincent, a professor of computing science at Simon Fraser University in British Columbia, cautioned that publishers will have to find strength in numbers: AI operators “never, ever care about one person leaving,” he said.

NewsCorp chief executive Robert Thomson echoed that understanding at a news media conference in May when asked if he would like to announce a deal with the big digital players. “I wish,” Thomson said. “But it can’t just be us.”

Since then, the media conglomerate IAC, which owns the Daily Beast, tried building a coalition of publishers who aimed to win billions of dollars from AI companies through a lawsuit or legislative action, according to a July report in <a href="https://www.semafor.com/article/07/23/2023/publishers-want-billions-not-millions-from-ai" target=_blank>Semafor</a>. In August, <a href="https://www.npr.org/2023/08/16/1194202562/new-york-times-considers-legal-action-against-openai-as-copyright-tensions-swirl" target=_blank>NPR</a> reported that the New York Times was also considering a lawsuit against OpenAI.

In the current climate, the data holders best positioned to make a deal are still companies accustomed to asserting their intellectual property rights rather than individual artists, authors and coders, said Yacine Jernite, who leads the machine learning and society team at Hugging Face, an open-source AI start-up.

For example, the stock photo site Shutterstock has a partnership to provide training data for OpenAI. Late last year, the company also launched a Contributor Fund to compensate artists whose work has been used to train AI models. An analysis by stock photographer<a href="https://petapixel.com/2023/07/12/shutterstock-may-have-paid-out-over-4-million-from-its-ai-contributor-fund/" target=_blank> Robert Kneschke</a> estimated that the fund paid out more than $4 million in May — but the median payout was just $0.0069 per image. Shutterstock did not respond to a request for comment.

Danielle Coffey, president and CEO of the News/Media Alliance, a trade group representing more than 2,000 publishers, said the White House and other policymakers have been receptive to the need for licensing deals. She recently organized a week of visits in Washington and various state capitals to advocate for copyright protections for publishers.

With generative AI, “what goes in, must come out,” Coffey said. “If quality content and quality journalism isn’t a part of that, then that is not a good thing for the products themselves — or for society.”

A previous verision of this story incorrectly reported that Reddit was considering putting its content behind a log-in page for the first time. This version has been corrected.

Columbia University, BA in English

New York University, MA in Journalism

Longform

Nitasha Tiku is The Washington Post's tech culture reporter based in San Francisco.


Nitasha Tiku

washpost

Major newspapers want payment from OpenAI for stories that power ChatGPT

the-washington-post

Illustration by Kat Brooks/The Washington Post; iStock

The Washington Post

The desperate race to scrape, clean, collect, and sell data for AI


Help Desk

Artificial Intelligence

Internet Culture

Space

Tech Policy

Tech

prism://prism.query/two-sites,/technology,/politics/powerpost/the-technology-202?limit=20