Perspectives and architecture notes relating to LLM Architecture.
Showing 3 post(s) filed under this topic.
Earlier I commented about how LLMs and AI agents face constraints of context windows; the other big one is attention. Here's a great breakdown of attention mechanisms in...
More often than not, AI agents end up failing because they’re drowning in their own context windows. One of the most interesting ideas I’ve seen lately is the shift from “bigger...
The real bottleneck in AI agents today isn't raw reasoning capability; it's access to structured business context. Google recently introduced the Open Knowledge Format (OKF), an...