Section 10.1: The Language of Hypothesis Testing

Objective 1: Determine the Null and Alternative Hypotheses

Hypothesis testing is a fundamental procedure in inferential statistics, allowing us to make decisions about population parameters based on sample data. The process involves formulating two competing hypotheses and using sample evidence to decide which is more plausible.

• Hypothesis: A statement about a population parameter, such as the population mean or proportion.

• Hypothesis Testing: The process of using sample data to decide whether to reject a stated hypothesis about a population parameter.

• Null Hypothesis (H0): The hypothesis that there is no effect or no difference; it is the statement being tested.

• Alternative Hypothesis (H1 or Ha): The hypothesis that there is an effect, a difference, or a relationship; it is what the researcher aims to support.

• Three Ways to Set Up Hypotheses:

  • Two-tailed test: Tests for any difference (e.g., vs. )

  • Left-tailed test: Tests for a decrease (e.g., vs. )

  • Right-tailed test: Tests for an increase (e.g., vs. )

• One-tailed Test: A test where the alternative hypothesis is directional (either left-tailed or right-tailed).

• Structure of the Alternative Hypothesis: Determined by the research question and whether the interest is in any difference or a specific direction.

Example: A pharmaceutical company tests whether a new antibiotic changes the percentage of children taking antibiotics who experience headaches. The null hypothesis states the percentage is the same as before; the alternative states it is different (two-tailed), less (left-tailed), or more (right-tailed).

Objective 2: Explain Type I and Type II Errors

When conducting hypothesis tests, two types of errors can occur. Understanding these errors is crucial for interpreting statistical results and for designing studies with appropriate error rates.

• Type I Error (α): Rejecting the null hypothesis when it is actually true. The probability of making a Type I error is denoted by (the significance level).

• Type II Error (β): Failing to reject the null hypothesis when the alternative hypothesis is true. The probability of making a Type II error is denoted by .

• Jury Trial Analogy:

  • Null hypothesis: Defendant is innocent.

  • Alternative hypothesis: Defendant is guilty.

  • Type I error: Convicting an innocent person (rejecting a true null hypothesis).

  • Type II error: Acquitting a guilty person (failing to reject a false null hypothesis).

• Four Outcomes in Hypothesis Testing:

  • Correctly reject (when is true)

  • Correctly fail to reject (when is true)

  • Type I error (reject when is true)

  • Type II error (fail to reject when is true)

• Symbols:

  • (alpha): Probability of Type I error

  • (beta): Probability of Type II error

• Level of Significance: The threshold probability for making a Type I error, commonly set at , but may vary depending on the context and consequences of errors.

Example: If a new antibiotic is tested and the null hypothesis is that the side effect rate is unchanged, a Type I error would be concluding the rate has changed when it has not, and a Type II error would be failing to detect a real change.

Objective 3: State Conclusions to Hypothesis Tests

After performing a hypothesis test, conclusions are drawn based on the sample evidence. It is important to note that we never "accept" the null hypothesis; we either reject it or fail to reject it based on the evidence.

• Rejecting the Null Hypothesis: If the sample evidence is strong enough (p-value ≤ ), we reject and conclude there is sufficient evidence for .

• Failing to Reject the Null Hypothesis: If the sample evidence is not strong enough (p-value > ), we do not reject and conclude there is not sufficient evidence for .

• Stating Conclusions: Always relate the conclusion to the context of the problem, specifying what the evidence does or does not support.

Example: If sample evidence indicates the null hypothesis is not rejected, we conclude there is not enough evidence to support a difference in side effect rates for the new antibiotic.

Summary Table: Types of Errors in Hypothesis Testing

Additional info: The notes are structured as guided questions and examples, typical for a worksheet or homework assignment in a statistics course. Academic context and definitions have been expanded for clarity and completeness.