§ Testing · A/B Testing Framework
A/B Testing
Test model versions with automatic traffic splitting and winner detection
0
Running
0
Completed
0
Paused
No tests created yet
Start by creating your first A/B test
💡 How A/B testing works:
• Create a test with two model versions and set traffic split percentage
• Traffic is automatically routed: if random(0-100) < weight_a, route to model_a, else model_b
• Track feedback (positive/negative) and latency for each request
• The system automatically calculates chi-square test for statistical significance
• When winner is detected at 95% confidence with 100+ samples per model, test auto-concludes