Inside the Creation of DBRX, the World’s Most Powerful Open Source AI Model

Inside the Creation of DBRX, the World’s Most Powerful Open Source AI Model

This past Monday, about a dozen engineers and executives at data science and AI company Databricks gathered in conference rooms connected via Zoom to learn if they had succeeded in building a top artificial intelligence language model. The team had spent months, and about $10 million, training DBRX, a large language model similar in design … Read more

Large Language Models’ Emergent Abilities Are a Mirage

Large Language Models’ Emergent Abilities Are a Mirage

The original version of this story appeared in Quanta Magazine. Two years ago, in a project called the Beyond the Imitation Game benchmark, or BIG-bench, 450 researchers compiled a list of 204 tasks designed to test the capabilities of large language models, which power chatbots like ChatGPT. On most tasks, performance improved predictably and smoothly … Read more

Perplexity’s Founder Was Inspired by Sundar Pichai. Now They’re Competing to Reinvent Search

Perplexity’s Founder Was Inspired by Sundar Pichai. Now They’re Competing to Reinvent Search

Aravind Srinivas credits Google CEO Sundar Pichai for giving him the freedom to eat eggs. Srinivas remembers the moment seven years ago when an interview with Pichai popped up in his YouTube feed. His vegetarian upbringing in India had excluded eggs, as it had for many in the country, but now, in his early twenties, … Read more

Here’s Proof You Can Train an AI Model Without Slurping Copyrighted Content

Here’s Proof You Can Train an AI Model Without Slurping Copyrighted Content

In 2023, OpenAI told the UK parliament that it was “impossible” to train leading AI models without using copyrighted materials. It’s a popular stance in the AI world, where OpenAI and other leading players have used materials slurped up online to train the models powering chatbots and image generators, triggering a wave of lawsuits alleging … Read more

Forget Chatbots. AI Agents Are the Future

Forget Chatbots. AI Agents Are the Future

This week a startup called Cognition AI caused a bit of a stir by releasing a demo showing an artificial intelligence program called Devin performing work usually done by well-paid software engineers. Chatbots like ChatGPT and Gemini can generate code, but Devin went further, planning how to solve a problem, writing the code, and then … Read more

Google DeepMind’s Latest AI Agent Learned to Play ‘Goat Simulator 3’

Google DeepMind’s Latest AI Agent Learned to Play ‘Goat Simulator 3’

“SIMA takes one step further and shows stronger generalization to new games,” he says. “The number of environments is still very small, but I think SIMA is on the right track. A New Way to Play SIMA shows DeepMind putting a new twist on game playing agents, an AI technology the company has pioneered in … Read more

Elon Musk Gave Himself No Choice but to Open Source His Chatbot Grok

Elon Musk Gave Himself No Choice but to Open Source His Chatbot Grok

After suing OpenAI this month, alleging the company has become too closed, Elon Musk says he will release his “truth-seeking” answer to ChatGPT, the chatbot Grok, for anyone to download and use. “This week, @xAI will open source Grok,” Musk wrote on his social media platform X today. That suggests his AI company, xAI, will … Read more

The Quest to Give AI Chatbots a Hand—and an Arm

The Quest to Give AI Chatbots a Hand—and an Arm

Peter Chen, CEO of the robot software company Covariant, sits in front of a chatbot interface resembling the one used to communicate with ChatGPT. “Show me the tote in front of you,” he types. In reply, a video feed appears, revealing a robot arm over a bin containing various items—a pair of socks, a tube … Read more

The Fear That Inspired Elon Musk and Sam Altman to Create OpenAI

The Fear That Inspired Elon Musk and Sam Altman to Create OpenAI

Elon Musk last week sued two of his OpenAI cofounders, Sam Altman and Greg Brockman, accusing them of “flagrant breaches” of the trio’s original agreement that the company would develop artificial intelligence openly and without chasing profits. Late on Tuesday, OpenAI released partially redacted emails between Musk, Altman, Brockman, and others that provide a counternarrative. … Read more

The Dark Side of Open Source AI Image Generators

The Dark Side of Open Source AI Image Generators

Whether through the frowning high-definition face of a chimpanzee or a psychedelic, pink-and-red-hued doppelganger of himself, Reuven Cohen uses AI-generated images to catch people’s attention. “I’ve always been interested in art and design and video and enjoy pushing boundaries,” he says—but the Toronto-based consultant, who helps companies develop AI tools, also hopes to raise awareness … Read more