Chapter 4: Introduction to Probability

Section 4.1: Basic Concepts and Probability

Probability is a fundamental concept in statistics, used to quantify the likelihood of events occurring. Probabilities are always expressed as values between 0 and 1, where 0 means an event is impossible and 1 means it is certain.

• Event: Any collection of results or outcomes of a procedure.

• Simple Event: An outcome that cannot be broken down into simpler components.

• Sample Space (S): The set of all possible simple events or outcomes of a probability experiment.

Examples of Sample Spaces:

• Tossing a coin: S = {Head, Tail}

• Rolling a die: S = {1, 2, 3, 4, 5, 6}

• Answering a true/false question: S = {True, False}

• Selecting a card from a deck: S = {A, 2, 3, ..., J, Q, K} (52 cards)

Probability Notation

• P(A): Probability of event A occurring.

• Probabilities are always between 0 and 1:

Three Common Approaches to Finding Probability

1. Relative Frequency Approximation: Probability is estimated by conducting (or observing) a procedure and counting the number of times event A occurs.

2. Classical Approach (Equally Likely Outcomes): If a procedure has n equally likely simple events and event A can occur in s ways:

   Caution: Only use this approach if all outcomes are equally likely.

3. Subjective Probability: Probability is estimated using knowledge of relevant circumstances (e.g., expert opinion).

Simulations

When classical or frequency approaches are not feasible, simulations can be used. A simulation is a process that mimics the real procedure to estimate probabilities.

Rounding Probabilities

• Express probabilities as exact fractions or decimals, or round to three significant digits for clarity.

Law of Large Numbers

As a procedure is repeated many times, the relative frequency probability of an event approaches the actual probability.

• This law applies to large numbers of trials, not individual outcomes.

• Do not assume outcomes are equally likely without justification.

Odds

Odds are another way to express the likelihood of an event, commonly used in gambling and lotteries.

• Odds in favor of event A:

• Odds against event A:

Significant Results and the Rare Event Rule

The rare event rule is used in inferential statistics to determine if an observed result is significant:

• If the probability of an observed event is very small (commonly ≤ 0.05), the assumption under which it was calculated is likely incorrect.

• Significantly high:

• Significantly low:

Addition and Multiplication Rules

Addition Rule

The addition rule is used to find the probability that at least one of two events occurs.

• General Addition Rule:

• If events A and B are disjoint (mutually exclusive):

Disjoint (Mutually Exclusive) Events

• Events that cannot occur at the same time (no overlap).

• Example: Selecting a person who is male and selecting a person who is female are disjoint events.

Multiplication Rule

The multiplication rule is used to find the probability that two events both occur.

• For independent events:

• For dependent events:

Independent vs. Dependent Events

• Independent: The occurrence of one event does not affect the probability of the other (e.g., rolling two dice).

• Dependent: The occurrence of one event affects the probability of the other (e.g., drawing cards without replacement).

Conditional Probability

Conditional probability is the probability of an event occurring given that another event has already occurred.

• Notation: is the probability of B given A.

• Formula:

Counting Principles

Basic Principle of Counting (Multiplication Rule)

If a procedure can be broken into a sequence of steps, and each step can be performed in a certain number of ways, the total number of outcomes is the product of the number of ways each step can be performed.

• Example: If there are 4 ways to go up a mountain and 3 ways to go down, there are ways to go up and down.

Factorial Notation

• n! (n factorial): The product of all positive integers up to n.

• Example:

Permutations

Permutations are arrangements of objects where order matters.

• Number of permutations of n objects taken r at a time:

Combinations

Combinations are selections of objects where order does not matter.

• Number of combinations of n objects taken r at a time:

Applications and Examples

• Probability of Getting 4 Aces in 5 Cards: Use combinations to count the number of ways to choose 4 aces and 1 other card, divided by the total number of ways to choose 5 cards from 52.

• Probability of Defective Items: Use combinations to count the number of ways to select defective and non-defective items.

• Probability of a Full House in Poker: Use combinations to count the number of ways to get 3 cards of one denomination and 2 of another.

Summary Table: Key Probability Rules

Additional info: These notes include expanded academic context, definitions, and examples to ensure completeness and clarity for exam preparation.