Posts | AIBrix Blogs

Should You Self-Host Batch Inference? An Honest Cost Breakdown

AIBrix KVCache: Optimizing Single-Node P/D Disaggregation

AIBrix v0.7.0 Release: Management Console, Self-Hosted Batch, KV-Centric Disaggregation, and a Highly-Available Gateway

AIBrix v0.6.0 Release: Envoy Sidecar, Mixed LLM Workloads Routing, Routing Profiles, LoRA Delivery & New APIs

PrisKV: A Colocated Tiered KVCache Store for LLM Serving