Statistical Significance Gone Wrong

We had a recent project where the team confidently reported a p-value of 0.049 as ‘significant’ at a conference — the laughter that erupted when I casually mentioned we had run only 8 subjects was priceless. Makes you wonder how often people misinterpret data when they get too enamored with the stats.

‌⁠‍⁠​‍​‍‌⁠‌​​‍​‍​⁠‍‍​‍​‍‌‍‌⁠‌‍​⁠‌⁠​‍‌‍‍‍​‍​‍​‍⁠​​‍​‍‌‍‍⁠​‍​‍​⁠‍‍​‍​‍‌‍⁠‍‌‍‌‌‌⁠‌⁠‌‌⁠⁠‌⁠‌​‌‍⁠⁠‌⁠​​‌‍‍‌‌‍​⁠​‍​‍​‍⁠​​‍​‍‌‍‍‌‌‍‌​​‍​‍​⁠‍‍​‍​‍‌‍⁠‍‌‍‌‌‌⁠‌⁠​‍​‍​‍⁠​​‍​‍‌‍‌​​‍​‍​⁠‍‍​‍​‍​⁠​‍​⁠​​​⁠​‍​⁠‌‍​⁠​​​⁠‌⁠​⁠​‌​⁠​‍​‍​‍​‍⁠​​‍​‍‌‍‍​​‍​‍​⁠‍‍​‍​‍‌⁠​‍‌​‍‌‌‌​​​⁠‌⁠‌‌‍‌‌⁠​​‌‍⁠​‌‌‌‌‌​​‌‌​​‍‌​‍‌​⁠‌‌‌‍‍‌‌‍‍‍​⁠​⁠​⁠‍‌​‍​‍‌⁠⁠‌​