Welcome to AIBrix blogs

AIBrix is a open source cost-efficient, scalable and pluggable Infrastructure for GenAI applications.

PrisKV: A Colocated Tiered KVCache Store for LLM Serving

AIBrix v0.5.0 Release: Batch API, KVCache v1 Connector, and Enhanced P/D orchestration

AIBrix v0.4.0 Release: P/D Disaggregation and Expert Parallelism Support, KVCache v1 Connector, KV Event Synchronization & Multi‑Engine Support

AIBrix v0.3.0 Release: KVCache Offloading, Prefix Cache, Fairness Routing, and Benchmarking Tools

DeepSeek-R1 671B multi-host Deployment in AIBrix