AI

Top White House advisor says DeepSeek may have used OpenAI's models for training

David Sacks
David Sacks, the White House's AI and crypto czar, highlighted an AI training technique called distillation. ANDREW CABALLERO-REYNOLDS/Getty Images
Read in app

DeepSeek may have used OpenAI to create its Silicon Valley-shaking model, a top White House advisor said on Tuesday.

David Sacks, the White House's artificial intelligence and crypto czar, told Fox News "it's possible" that the Chinese AI startup engaged in intellectual property theft from OpenAI.

Sacks highlighted an AI training technique called distillation, in which a company uses information from an existing AI model to create a new model. Here, the bigger, more complex model — which is considered to be the "teacher model" — transfers much of its learnings to the smaller "student model."

"They can essentially mimic the reasoning process that they learn from the parent model and they can suck the knowledge out of the parent model," Sacks said.

DeepSeek's R1 model appears to match many of the capabilities of rival models but with much less compute — the expensive component powering AI. That sparked a stock market panic earlier this week, wiping hundreds of billions of dollars in value from companies selling AI chips, such as Nvidia.

"There's substantial evidence that what DeepSeek did here is they distilled the knowledge out of OpenAI's models. I don't think OpenAI is very happy about this," Sacks said, without citing specific evidence.

He said companies would take steps to prevent distillation.

"That would definitely slow down some of these copycat models," said the former venture capital investor and tech executive.

OpenAI has also faced scrutiny for its training practices. The company is facing several lawsuits over copyright infringement, including from media organizations like The New York Times.

OpenAI has its own model distillation offering. This allows smaller models to create their own datasets for distillation using OpenAI's API.

However, the company's terms of service prohibit users from "copying" any of its services or using its models to build rival ones.

Microsoft and OpenAI did not respond to requests for comment. DeepSeek did not respond to a request for comment, made on the Lunar New Year.

Read next

Meghan Morris's face on a gray background
Meghan Morris
Meghan is the bureau chief in Singapore. She oversees business, lifestyle, and news coverage and leads the company's local hiring and editorial strategy.Singapore's bureau works on global news during Asia's daytime. They also collect tales from around the region about entrepreneurs, Big Tech work culture, FIRE, relocation, consumer trends, and AI, focused on people-centric storytelling.Before moving to Singapore in 2024, Meghan worked in NYC and SF as a senior correspondent, writing deeply-reported business investigations. If you have sensitive information, please email her from a nonwork email or reach out on secure messaging app Signal at @MeghanEMorris.1 (PR pitches only by email.)She enjoys speaking about tech, finance, and news on television, at conferences, and on podcasts. Please email for booking.These are some of her favorite features she has written over the years:She spent the 2022-23 academic year doing Columbia University's Knight-Bagehot Fellowship, where she took courses in statistics, advanced corporate finance, family office management, and other classes at Columbia Business School. During her fellowship, she also led MBA seminars on due diligence and brought Pulitzer-winning authors to the business school.Before she joined Business Insider in 2018, she wrote about private equity real estate for three years at the industry's trade magazine, PERE. Meghan holds bachelor's and master's journalism degrees from Northwestern University.
Riddhi
Riddhi Kanetkar
Riddhi was a senior startups and VC reporter at Business Insider's London office, where she covered VC, and AI and climate startups. She has reported on everything from funding rounds to layoffs and investigated company culture at tech startups. She also writes about the intersection of Big Tech and VC, and global industry trends in the AI and VC ecosystem.She received her Bachelor's from UCL, where she studied Comparative Literature. Have a tip? Contact her at rkanetkar@jkmperu.com, or reach out using a non-work device at riddhikanetkar@proton.me, or on Signal at riddhikanetkar.64Sample of stories:GoStudent, the $3 billion edtech darling, scaled fast and partied hard. The result was a mess.AI Forge promised to help founders build their dream startups. Some say the incubator was a chaotic disappointment.Fast-fashion behemoth Shein is preparing for an IPO. Here's an inside look at the challenges it could face.DeepMind's secret mafia: Meet the stealth startups emerging from Google's AI labThe wildest deal in tech right now is about to turn 6-month-old LLM startup Mistral into a $2 billion unicorn, sources sayPeter Thiel-backed TMRW wants to revolutionize the egg-freezing industry. We visited the startup's new London HQ to experience its tech first hand.I was laid off from events startup Pollen after it suddenly imploded. I'm furious when I think about missed paychecks and not making rent.Shock, anger, and confusion: Inside Snap's decision to shut down Zenly, a social app with 40 million users