To motivate the discussion for hypothesis testing, we did a taste test similar to the one that was done by "The Lady Tasting Tea" in Cambridge in the late 1920s. (The idea belongs to late Professor R. Fisher, the father of modern statistics.)
A student in each class volunteered to be the subject of the test. The students claimed that they can tell the difference between Coke and Pepsi. Similar to the "Tea" test, I brought 8 cups to the class and filled 4 with Coke and 4 with Pepsi. The null hypothesis H0 is that the student can't tell the difference, and that he/she is just guessing. (The students were Melissa, Sean and Bryan in EC01, C01 and C02, resp.)
If the subject is just guessing, there is a 1/70 chance (1.4% probability) that all 8 cups will be identified correctly. So, I would reject H0 if that happens. (This is the p-value.)
Melissa got all 8 correct in the second attempt, Sean got all 8 correct, and Bryan made 1 mistake. So, I rejected my H0 in Melissa's ands Sean's cases by stating that I believed they could tell the difference between Coke and Pepsi. But I couldn't reject H0 in the last case because there is a 16/70 probability (28%) that a person guessing will make 1 mistake. (These probabilities are the result of using hypergeometric distribution.)
Here are some still pictures of the experiment in Section C02 with Bryan doing the tasting:













