Introduction to Statistics

Levels of Measurement

Understanding the different levels of measurement is fundamental in statistics, as it determines the types of analyses that are appropriate for a given dataset.

• Nominal: Data are categorized without a natural order or ranking (e.g., gender, colors).

• Ordinal: Data are categorized with a meaningful order, but intervals between values are not equal (e.g., rankings).

• Interval: Ordered data with equal intervals, but no true zero point (e.g., temperature in Celsius).

• Ratio: Ordered data with equal intervals and a true zero point (e.g., height, weight).

Example: Classifying survey responses as 'agree', 'neutral', 'disagree' is ordinal; measuring income is ratio.

Exploring Data with Tables and Graphs

Scatterplots and Histograms

Visualizing data helps identify patterns, trends, and outliers. Scatterplots show relationships between two quantitative variables, while histograms display the distribution of a single variable.

• Scatterplot: Each point represents a pair of values. Patterns may indicate correlation.

• Histogram: Bars represent frequency of data within intervals (bins).

Example: A scatterplot with points rising from left to right suggests a positive correlation.

Describing, Exploring, and Comparing Data

Measures of Central Tendency and Spread

Descriptive statistics summarize data using measures such as mean, median, mode, range, variance, and standard deviation.

• Mean: The arithmetic average.

• Median: The middle value when data are ordered.

• Mode: The most frequent value.

• Range: Difference between maximum and minimum values.

• Variance (): Average squared deviation from the mean.

• Standard Deviation (): Square root of variance.

Formula for Sample Mean:

Formula for Sample Variance:

Probability

Basic Probability Concepts

Probability quantifies the likelihood of events occurring. It ranges from 0 (impossible) to 1 (certain).

• Classical Probability: Based on equally likely outcomes.

• Empirical Probability: Based on observed data.

• Law of Large Numbers: As the number of trials increases, empirical probability approaches theoretical probability.

Formula:

Discrete Probability Distributions

Binomial and Poisson Distributions

Discrete probability distributions describe the probabilities of outcomes for discrete random variables.

• Binomial Distribution: Probability of successes in independent Bernoulli trials with probability of success.

• Poisson Distribution: Probability of a given number of events occurring in a fixed interval of time or space.

Binomial Formula:

Poisson Formula:

Example: Calculating the probability of 3 successes in 5 trials with using the binomial formula.

Normal Probability Distributions

Standard Normal Distribution and Z-Scores

The normal distribution is a continuous, symmetric, bell-shaped distribution characterized by its mean () and standard deviation ().

• Z-Score: Measures how many standard deviations a value is from the mean.

Formula:

Application: Z-scores are used to find probabilities and percentiles in a normal distribution.

Estimating Parameters and Determining Sample Sizes

Confidence Intervals

Confidence intervals estimate population parameters based on sample statistics, providing a range of plausible values.

• Confidence Level: The probability that the interval contains the true parameter.

• Margin of Error: The maximum expected difference between the true parameter and the estimate.

Formula for Confidence Interval for Mean (Known ):

Hypothesis Testing

Steps in Hypothesis Testing

Hypothesis testing is a method for making inferences about population parameters based on sample data.

1. State the null hypothesis () and alternative hypothesis ().

2. Choose a significance level ().

3. Calculate the test statistic.

4. Determine the p-value or critical value.

5. Make a decision: reject or fail to reject .

Example: Testing if the mean weight of a population differs from 150 lbs at .

Inferences from Two Samples

Comparing Means and Proportions

Statistical inference can compare two population means or proportions using independent or paired samples.

• Independent Samples: Samples are unrelated.

• Paired Samples: Each observation in one sample is paired with an observation in the other.

Formula for Two-Sample t-Test:

Correlation and Regression

Correlation Coefficient and Regression Line

Correlation measures the strength and direction of a linear relationship between two variables. Regression predicts the value of one variable based on another.

• Pearson Correlation Coefficient (): Ranges from -1 to 1.

• Coefficient of Determination (): Proportion of variance explained by the model.

• Regression Equation:

Formula for Slope ():

Formula for Intercept ():

Goodness-of-Fit and Contingency Tables

Chi-Square Tests

Chi-square tests assess whether observed frequencies differ from expected frequencies.

• Goodness-of-Fit Test: Tests if a sample matches a population distribution.

• Test of Independence: Tests if two categorical variables are independent.

Chi-Square Statistic:

Where is the observed frequency and is the expected frequency.

Analysis of Variance (ANOVA)

Comparing More Than Two Means

ANOVA tests whether there are significant differences among group means.

• F-Statistic: Ratio of variance between groups to variance within groups.

ANOVA Table Example:

Where , , and .

Probability Tables and Contingency Tables

Interpreting Tabular Data

Tables are used to summarize data, compare groups, and calculate probabilities.

Example: Probability that a randomly selected person is a smoker:

Summary

• Statistics involves collecting, organizing, analyzing, and interpreting data.

• Key concepts include types of data, probability, distributions, hypothesis testing, regression, and ANOVA.

• Understanding formulas and when to apply them is crucial for solving statistical problems.

Additional info: These notes are based on a comprehensive set of exam review questions covering all major introductory statistics topics.