Blog
Articles about LLM observability, cost tracking, and AI infrastructure.
llm experiments a/b-testing model-evaluation cost-optimization
Running a Live Model A/B Test with Majordomo Experiments
Replay tells you how a cheaper model performs on historical traffic. Experiments tell you how it performs on the traffic you're getting right now. Here's how to run one.
Vivek Vaidya · Read →
llm replay model-evaluation cost-optimization
How to Test a Model Switch Without Breaking Production
A new model drops and it's cheaper or faster than what you're running. But you don't switch — because you don't know what you'd be giving up. Here's how to find out before you commit.
Vivek Vaidya ·
llm cost-tracking observability metadata
How to Track LLM Costs by Team and Feature
Your AI bill is growing fast, but your provider's dashboard won't tell you which team or feature is responsible. Here's how to get attribution at the request level.
Vivek Vaidya ·
llm observability cost-tracking open-source
Your AI Stack Needs a Control Plane
You trace every database query and monitor every microservice — but your LLM calls run in total darkness. Here's how to fix that with Majordomo.
Vivek Vaidya ·