Model layer
One interface, seven LLM providers
Built a model-agnostic LLM layer across OpenAI, Azure OpenAI, Anthropic, Gemini, DeepSeek, GLM and LG EXAONE, with retries, rate-limit failover and load balancing, so features could switch models through configuration. On top of it, built the platform's multi-model chat: SSE streaming, file attachments checked against each model's capabilities, web-search citations and per-message credit accounting. It later became the foundation for the agent experience.
Python · FastAPI · SSE · Multi-provider LLMs