7 posts carrying this tag.
We measured how coding agents search with grep on Home Assistant and Saleor: about 150 model runs and 13 million tokens. Grep finds the files, then buries them in noise, and it can't follow inheritance or code that never says the name. A bigger model doesn't fix it.
At a conservative 1,000 tokens per source file, 10 million files is roughly 10 billion tokens. A 1 million token window holds 0.01% of that, and a 10 million token window holds 0.1%. Closing that by scaling needs something like a 10,000x increase rather than a 10x one, and quality per token moves against you while you try.
Vector search and GraphRAG look like opposites, but they share the same final move. Parse the code, retrieve some of it, rerank it, and stuff it into the context window. That last step is where both of them rot, because a model that is handed a pile of chunks degrades the same way no matter how the pile was chosen. Here is why the retrieval layer is not the cure for context rot, and what is.
Anthropic just throttled Claude Opus and Sonnet during peak hours. Developers are canceling subscriptions and looking for alternatives. Here's the argument: a good open-source model with great context beats a frontier model that won't let you use it.
