Intro: p-values

• p<0.001 – from Pearson correlation, KS test, etc. what can you infer:
• You have absolutely disproved the null hypothesis (e.g. "no correlation" is ruled out, the data are not sampled from this model, there is no difference between the samples).
• You have found the probability of the null hypothesis being true.
• You have absolutely proved your experimental hypothesis (e.g. that there is a correlation, there is a difference between two samples, the data are sampled from this model).
• You can deduce the probability of the experimental hypothesis being true.
• You know, if you decide to reject the null hypothesis, the probability that you are making the wrong decision.
• You have a reliable experimental finding in the sense that if, hypothetically, the experiment were repeated a great number of times, you would obtain a significant result on 99.9% of occasions.
• Choose the right answer A - F

From: “The Null Ritual: What You Always Wanted to Know About Significance Testing but Were Afraid to Ask”