Files
kong-platform-llm/dev
Stéphane Tailland 2d4debd12a fix(llm): double the per-client token budget to 100k/min
A tool-calling agent re-sends the whole tool result on every iteration of its
loop, so a single question against a tool returning a full collection burns the
old budget in three turns and answers 429 in the middle of reasoning. Pagination
on those tools is the real fix; this buys room until then and stays well inside
the 500k global ceiling.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-08-29 07:57:53 +02:00
..
2026-08-20 17:28:05 +02:00
2026-08-20 17:28:05 +02:00
2026-08-20 17:28:05 +02:00