A/B Test AI Prompts with Automatic Traffic Splitting
Route production AI requests between prompt versions, track conversion metrics, and auto-promote winning variants — without touching your codebase.
Proxy API
Drop-in endpoint intercepts your AI calls and splits traffic by weight.
Live Analytics
Track impressions, conversions, and statistical significance in real time.
Auto-Promote
Winning variants are promoted automatically when significance is reached.
Simple Pricing
Pro
$29/mo
Everything you need to optimize AI prompts
- ✓Unlimited experiments
- ✓Weighted traffic splitting
- ✓Conversion tracking & analytics
- ✓Auto-promote winning variants
- ✓Dashboard & API access
- ✓Email support
FAQ
How does the traffic splitting work?
You define prompt variants and assign weights (e.g. 50/50 or 80/20). Our proxy API routes each incoming request to a variant based on those weights, logs the result, and tracks downstream conversion events you send back.
Do I need to change my AI provider?
No. PromptSplit sits in front of any OpenAI-compatible API. Point your requests at our proxy endpoint and we handle the rest — your provider, model, and keys stay the same.
When does auto-promotion trigger?
When a variant reaches statistical significance (p < 0.05) with at least 100 conversions tracked, it is automatically promoted to 100% traffic and the experiment is marked complete.