A/B tests

menu_booknotificationsadd
Campaigns/A/B experimentation engine

A/B split testing

Optimize subject lines and content with multi-armed bandit traffic allocation.

ComposerLive resultsWriting assistantText messages
Experiments (1)Bayesian active
Spring Feature Drop: AI Workflows v2running
2 variants • Metric: open rate

Spring Feature Drop: AI Workflows v2

Sample: 20% of total audience • 4h duration window • Mode: Auto-shift to winner (multi-armed bandit)
99.8% statistical significance
Variant A (Descriptive Control)
“Introducing Flomaila AI Workflow Automations v2”
Open rate
34.2%
288 / 842
Click rate
9.9%
84 clicks
Variant B (Curiosity & FOMO)
Winner
“⚡ Automate your customer replies in <520ms (Live Demo)”
Open rate
49.6%
418 / 842
Click rate
16.8%
142 clicks