Notes in hypothesis-testing

To Subscribe, use this Key

Status	Last Update	Fields
Published	04/30/2024	What is A/B testing, statistically speaking?How do you do it, at a very high level?
Published	04/30/2024	Significance test for binary (binomial) outcomes (e.g., conversions out of visitors)
Published	04/30/2024	Significance test for a continuous (normal-ish) variable(e.g., spend per user)
Published	04/30/2024	Significance test for multiple count (multinomial) data(e.g., number of each product purchased)
Published	04/30/2024	What are the assumptions for (unpaired) generic t-tests?
Published	04/30/2024	One-sample t-test statistic formula
Published	04/30/2024	Welch's t-test statistic formula(two-sample (independent), unpaired, unequal sizes, unequal variance)
Published	04/30/2024	What is the danger of repeated significance testing (the multiple comparisons problem)?How do you handle it?
Published	04/30/2024	What is the problem with stopping an A/B test as soon as you see a significant result?How do you avoid it?
Published	04/30/2024	What is statistical power?What factors influence power?
Published	04/30/2024	How do you determine the sample size needed to measure a given difference with a certain confidence?
Published	04/30/2024	What is the \(\chi^2\) test, and how is it computed?
Status	Last Update	Fields