Login to manage your account

Your email Please enter a valid email address.

Password Forgot Password?

Please enter a valid password.

OR

Don't have an account yet? Sign up

Why does peeking at an A/B test and stopping early inflate false positives?

A Repeated testing raises the chance of crossing the threshold by chance alone
B The data becomes corrupted
C The sample becomes biased
D Variance increases over time

Answer

Repeated testing raises the chance of crossing the threshold by chance alone

Sample size should be determined in advance, or sequential testing methods used that correct for repeated looks.

All Data Science MCQs

Login to manage your account

Your email id Please enter a valid email address.

Password Forgot Password?

Please enter a valid password.

OR

Don't have an account yet? Sign up as

Jobseeker

Employer