Probability Fundamentals

Randomness, Simulation, and Probability

Probability is the mathematical study of random phenomena and chance behavior. It provides a framework for quantifying uncertainty and predicting the long-term behavior of random processes.

• Random Process: A scenario where the outcome of any particular trial is unknown, but the proportion of a particular outcome approaches a specific value as the number of trials increases.

• Simulation: A technique used to re-create a random event, either physically (e.g., flipping a coin) or virtually (e.g., computer simulation).

• Probability: The measure of the likelihood that a random phenomenon or chance behavior occurs. It is always a value between 0 and 1, inclusive.

• Probability of 0: The event is impossible.

• Probability of 1: The event is certain.

• Subjective Probability: Probability based on personal judgment rather than formal calculation.

Key Properties:

• Probabilities are always between 0 and 1:

• The sum of the probabilities of all possible outcomes in a sample space is 1.

Probability Models and Methods

There are several approaches to determining probabilities:

• Empirical Method: Probability is estimated by conducting experiments and observing the relative frequency of outcomes. Results may vary between experiments.

• Classical Method: Probability is calculated using counting techniques, assuming all outcomes are equally likely. No experiment is required.

Law of Large Numbers: As the number of repetitions of a probability experiment increases, the observed proportion of an outcome approaches its theoretical probability.

Basic Definitions

• Experiment: Any process with uncertain results that can be repeated.

• Trial: One repetition or instance of an experiment.

• Outcome: Any possible result of an experiment.

• Sample Space (S): The set of all possible outcomes.

• Event (E): Any collection (subset) of outcomes from the sample space.

Examples:

• A fair die has 6 sides: 1, 2, 3, 4, 5, 6.

• A fair coin has 2 sides: heads, tails.

• A standard deck of cards has 52 cards.

Probability Formula

The probability of an event is calculated as follows (classical method):

Interpretation of Probability Values

• P(A) = 0: Event A cannot happen or is extremely unlikely (e.g., winning the lottery).

• P(A) = 1: Event A always happens or is almost certain (e.g., the sun rising tomorrow).

• P(A) = 0.5: Event A is equally likely to occur or not occur (e.g., flipping a fair coin).

• Unusual Event: An event with probability 0.05 (5%) or less is considered unusual.

Probability Rules

Addition Rule for Disjoint and General Events

Probability rules help us calculate the likelihood of combined events.

• Disjoint (Mutually Exclusive) Events: Two events are disjoint if they have no outcomes in common.

• Addition Rule for Disjoint Events: If E and F are disjoint, then:

• This rule can be extended to more than two disjoint events.

• General Addition Rule: For any two events E and F:

Complements

The complement of an event E, denoted E', consists of all outcomes in the sample space S that are not in E.

• Complement Rule:

Summary Table: Key Probability Terms

Additional info: The notes above expand on the definitions and rules, providing context and examples for each key concept in probability. The Law of Large Numbers and the distinction between empirical and classical probability methods are emphasized for foundational understanding.