Topic
Performance
2 guides on Performance.
Rate Limiting LLM Calls in .NET: Tokens, Not Requests
Provider quotas are measured in tokens per minute, but almost every .NET rate limiter counts requests. That mismatch is why your agent still gets 429s under a limiter that says it is doing its job.
Caching LLM Responses in .NET
LLM calls are slow and cost money. Add caching to your .NET AI app — response caching and prompt caching — to cut latency and spend without losing quality.