A few notes about A/B testing from Jared Spool

View the original post

A few notes from Jared Spool’s twitter thread on A/B testing.

A/B testing is an effective approach to use science to design and deliver deeply-frustrating user experiences.

A/B testing without upfront research is just random monkeys testing random designs to see which of those designs do “best” against random criteria.

If drug testing was actually implemented like most A/B tests, you’d give 2 drugs to 2 groups of people and pick the “winner” by whichever group had fewer deaths.

A big issue is the A/B test zealots confuse conversion rate optimization with delivering