Login to manage your account

Please enter a valid email address.
Forgot Password?
Please enter a valid password.
OR

Don't have an account yet? Sign up

Why should an A/B test not be stopped at the first significant result?

  1. A Peeking inflates the false positive rate well above the stated threshold
  2. B It costs more to continue
  3. C The platform prevents it
  4. D Results are deleted
Answer

Peeking inflates the false positive rate well above the stated threshold

Sample size should be calculated in advance and the test run for whole business cycles to avoid day-of-week bias.

All Product Management MCQs

Login to manage your account

Please enter a valid email address.
Forgot Password?
Please enter a valid password.
OR

Don't have an account yet? Sign up as