#Long Context

Quick take: bigger context windows are not always better

Models now accept huge inputs, but stuffing everything into the prompt can reduce accuracy and raise costs. When long context helps, and when retrieval works better.

AI Desk·Oct 18·3 min read