Respan spent two years building on LiteLLM. One upgrade made it start over.
After two years building wrapper code around LiteLLM, Respan launched a new gateway with a minimal core and pluggable architecture following a breaking LiteLLM upgrade in January 2026 that caused persistent connection failures. The redesign, inspired by Nginx principles, moves routing, model provider integrations, and security features into modular plugins. This allows developers to build custom integrations without modifying core gateway code.
Key points
- LiteLLM upgrade in January 2026 triggered connection failures, spurring redesign
- New gateway uses minimal core with pluggable architecture for flexibility
- Respan's Mistral provider integration reduced to just 22 lines of code
Summary and key points written by AI from the headline and a short excerpt, so they can be incomplete or wrong. The New Stack did the reporting; read the original for the full story.
Read the full story at The New Stack
