neural networks

AI Is a Black Box. Anthropic Figured Out a Way to Look Inside

by
AI Is a Black Box. Anthropic Figured Out a Way to Look Inside

Last year, the team began experimenting with a tiny model that uses only a single layer of neurons. (Sophisticated LLMs have dozens of layers.) The hope was that in the simplest possible setting they could discover patterns that designate features. They ran countless experiments with no success. “We tried a whole bunch of stuff, and … Read more

Inside the Creation of DBRX, the World’s Most Powerful Open Source AI Model

by
Inside the Creation of DBRX, the World’s Most Powerful Open Source AI Model

This past Monday, about a dozen engineers and executives at data science and AI company Databricks gathered in conference rooms connected via Zoom to learn if they had succeeded in building a top artificial intelligence language model. The team had spent months, and about $10 million, training DBRX, a large language model similar in design … Read more