How to Think About Context as a Budget
A 128K context window doesn't mean you should use 128K tokens. Context is a budget with diminishing returns and escalating costs.
1 post tagged with "prompts"
A 128K context window doesn't mean you should use 128K tokens. Context is a budget with diminishing returns and escalating costs.