Basic Probability

Fundamental Concepts of Probability

Probability quantifies the likelihood of events occurring and is foundational in statistics. Understanding probability enables students to analyze random phenomena and make informed predictions.

• Probability Range: The probability of any event must be between 0 and 1, inclusive.

• Empirical vs. Theoretical Probability: Empirical probability is based on observed data, while theoretical probability is derived from known principles or models.

• Relative Frequency: Empirical probabilities are often calculated as relative frequencies from data or experiments.

• Probability Tables: Probabilities can be computed using tables that list all possible outcomes.

• Complement Rule: The probability that an event does not occur is , where is the complement of event.

Example: If the probability of rain tomorrow is 0.3, then the probability it does not rain is .

Standard Normal Distribution

Properties and Applications of the Standard Normal Curve

The standard normal distribution is a continuous probability distribution with a mean of 0 and a standard deviation of 1. It is widely used in statistical inference and hypothesis testing.

• Mean and Standard Deviation: The mean () is 0, and the standard deviation () is 1.

• Standard Normal Table: Used to find the area under the curve (probabilities) for given -scores.

• Finding Probabilities: To find the probability that a value falls within a certain range, use the standard normal table to look up the corresponding -score.

Example: The probability that is less than 1.5 can be found by looking up in the standard normal table.

Non-standard (General) Normal Distributions

Using Z-scores for General Normal Distributions

Many real-world data sets follow a normal distribution with arbitrary mean and standard deviation. Z-scores standardize values for comparison and probability calculations.

• Z-score Definition: A z-score indicates how many standard deviations a value is from the mean.

• Formula: , where is the value, is the mean, and is the standard deviation.

• Application: Z-scores allow us to use the standard normal table for any normal distribution.

Example: If , , and , then .

Sampling Distributions (Sample Proportion & Central Limit Theorem)

Sampling Distributions and the Central Limit Theorem

Sampling distributions describe the distribution of sample statistics (such as the sample mean or proportion) from repeated samples. The Central Limit Theorem (CLT) is a key result in statistics.

• Sample Proportion (): The proportion of successes in a sample.

• Sampling Distribution of : For large samples, the distribution of is approximately normal.

• Mean and Standard Deviation:

  • Mean:

  • Standard deviation:

• Central Limit Theorem: As sample size increases, the sampling distribution of the sample mean (or proportion) approaches a normal distribution, regardless of the population's distribution.

Example: If and , then .

Estimation

Point and Interval Estimation of Parameters

Estimation involves using sample data to infer population parameters. Point estimates provide single-value estimates, while interval estimates (confidence intervals) provide a range of plausible values.

• Point Estimate: A single value used to estimate a population parameter (e.g., sample mean or sample proportion ).

• Margin of Error: The range within which the true parameter is expected to lie, given a specified confidence level.

• Confidence Interval for Proportion: , where is the critical value for the desired confidence level.

• Factors Affecting Margin of Error: Sample size () and confidence level.

Example: For , , and (for 95% confidence), the margin of error is .

Hypothesis Testing

Formulating and Interpreting Hypothesis Tests

Hypothesis testing is a formal procedure for comparing observed data to a hypothesis about a population parameter.

• Null Hypothesis (): The default assumption (e.g., no effect or no difference).

• Alternative Hypothesis (): The competing claim (e.g., there is an effect or difference).

• Types of Tests: Left-tailed, right-tailed, and two-tailed tests, depending on the direction of the alternative hypothesis.

• Decision Making: Based on the test statistic and p-value, state the correct conclusion (reject or fail to reject ).

Example: Testing whether a coin is fair (, ) using sample data.