Probability Distributions and the Normal Model

Probability Distributions

Probability distributions describe how the probabilities are distributed over the values of a random variable. They are fundamental in modeling random events and making statistical inferences.

• Probability Distribution: A function that assigns probabilities to each possible value of a random variable.

• Empirical Rule: For a normal distribution, approximately 68% of data falls within one standard deviation, 95% within two, and 99.7% within three standard deviations of the mean.

• Normal Distribution: A continuous, symmetric, bell-shaped distribution characterized by its mean () and standard deviation ().

• Standard Normal Distribution: A normal distribution with mean 0 and standard deviation 1. Any normal variable can be standardized using .

Example: If heights of adult males are normally distributed with mean 70 inches and standard deviation 3 inches, the probability that a randomly selected male is taller than 73 inches can be found using the standard normal distribution.

Binomial and Bernoulli Distributions

The binomial distribution models the number of successes in a fixed number of independent trials, each with the same probability of success.

• Bernoulli Trial: An experiment with exactly two possible outcomes: "success" or "failure".

• Binomial Distribution: The probability of observing successes in independent Bernoulli trials with probability of success is given by:

• Mean (Expected Value):

• Standard Deviation:

Example: Flipping a fair coin 10 times, the probability of getting exactly 6 heads is calculated using the binomial formula with , , .

Sampling, Populations, and Statistics

Populations, Samples, Parameters, and Statistics

Understanding the distinction between populations and samples is crucial in statistics.

• Population: The entire group of individuals or items of interest.

• Sample: A subset of the population selected for analysis.

• Parameter: A numerical summary describing a characteristic of the population (e.g., population mean , population proportion ).

• Statistic: A numerical summary describing a characteristic of a sample (e.g., sample mean , sample proportion ).

Example: If you survey 100 students (sample) from a university (population) and find that 60% prefer online classes, 60% is the sample statistic, while the true proportion for all students is the population parameter.

Surveys, Sampling, and Bias

Proper sampling methods are essential to obtain representative data and valid inferences.

• Measurement Bias: Systematic error due to faulty measurement instruments or procedures.

• Nonresponse Bias: Bias introduced when a significant portion of the sampled individuals do not respond.

• Bias in Surveys: Any systematic error that results in an incorrect estimate of the population parameter.

Example: If a survey about exercise habits is conducted at a gym, the results may be biased toward more active individuals.

Sampling Distributions and the Central Limit Theorem

Sampling Distributions

The sampling distribution describes the distribution of a statistic (like the sample mean or proportion) over many samples drawn from the same population.

• Standard Error (SE): The standard deviation of a sampling distribution. For sample proportion :

• Central Limit Theorem (CLT): For large sample sizes, the sampling distribution of the sample mean or proportion is approximately normal, regardless of the population's distribution.

Example: If the population proportion is and , then .

Confidence Intervals and Margin of Error

Confidence Intervals for Proportions and Means

Confidence intervals provide a range of plausible values for a population parameter, based on sample data.

• Confidence Interval for a Proportion:

• Confidence Interval for a Mean (when is known):

• Margin of Error (ME): The maximum expected difference between the true population parameter and a sample estimate, given by the product of the critical value and the standard error.

Example: For a sample proportion , , and (for 95% confidence), the margin of error is .

Hypothesis Testing for Population Proportions

Hypothesis Testing Concepts

Hypothesis testing is a formal procedure for comparing observed data with a claim (hypothesis) about a population parameter.

• Null Hypothesis (): The default assumption or claim to be tested (e.g., ).

• Alternative Hypothesis (): The competing claim (e.g., , , or ).

• Test Statistic: A standardized value used to decide whether to reject .

• p-value: The probability, under , of obtaining a result as extreme or more extreme than the observed result.

• Significance Level (): The threshold for rejecting (commonly 0.05).

Example: Testing if the proportion of defective items is greater than 5% (, ).

One-Proportion z-Test

The one-proportion z-test is used to test hypotheses about a single population proportion.

• Test Statistic Formula:

• Compare the p-value to to decide whether to reject .

Example: If , , , then .

Two-Sample Proportion Test

This test compares the proportions from two independent samples to determine if there is a significant difference between them.

• Test Statistic Formula:

where is the pooled sample proportion.

Central Limit Theorem for Sample Means

The CLT states that the sampling distribution of the sample mean approaches a normal distribution as the sample size increases, regardless of the population's distribution, provided the samples are independent and identically distributed.

• Standard Error for Sample Mean:

Example: For a population with and , .

Summary Table: Key Concepts and Formulas

Additional info: Some formulas and explanations have been expanded for clarity and completeness, based on standard introductory statistics curriculum.