Super learner
This user is a Super Learner. To become a Super Learner, you need to reach Level 8.
Posted on:

07 Mar 2024

1

Sample size and number of days

In the previous section we established that the sample size should be around 8797 users in each group and that for a difference of 1% the test should run for 2 days to achieve statistical significance. Here, the sample size is different, around 30000 users in each group and it has been done troughout a entire month. My question is if we are just simulating that a company is handing over those datasets to perform an A/B testing with those and forgetting about previous results, and those calculated sample sizes and the duration of the test were merely to show what the process would be to calculate both metrics.

Thanks in advance.

0 answers ( 0 marked as helpful)

Submit an answer