Why retries alone are not enough
Retrying the same provider during an outage just waits longer before failing, and during rate limiting it can make things worse. A circuit breaker notices the pattern and switches to another provider until the first one recovers.
Recommended client settings
- Timeout of 15 to 30 seconds for generation endpoints.
- Retry 429 responses after the Retry-After delay.
- Retry network errors once or twice with exponential backoff and jitter.