AI's brain is getting bloated with AI content

AI is consuming more and more AI-written content to formulate its answers—a feedback loop that could make its answers narrower, blander, and easier to manipulate. In simulations of AI search, models that relied on AI-generated reference material became increasingly likely to produce the same recommendations, according to new research from Graphite. Graphite's paper argues that AI search tools can experience "AI search collapse" when they retrieve AI-generated pages derived from earlier AI answers. Graphite borrows the phrase from "model collapse," a risk described in a 2024 Nature paper showing that generative models can degrade when repeatedly trained on outputs from earlier models.