Shopify A/B Testing: Priorities, Sample Size, and Stop Rules

Run Shopify CRO through experiment hard rules before A/B testing: low sample is not a formal conclusion, no-peeking means no early stop, MDE / power / baseline CVR must be explainable, and traffic, discount, inventory, payment, speed, and tracking counter-evidence must be cleared before choosing formal A/B, directional validation, qualitative validation, or direct repair.