Probability: Rules, Methods, and Applications

Introduction to Probability

Probability is a fundamental concept in statistics that quantifies the likelihood of random phenomena or chance behavior. It allows us to make informed predictions about uncertain outcomes by analyzing long-term patterns and frequencies.

Random Processes and the Law of Large Numbers

Understanding Random Processes

• Random process: A scenario where the outcome of any particular trial is unpredictable, but the proportion of a specific outcome stabilizes as the number of trials increases.

• Simulation: A technique used to recreate random events to measure how often a goal is observed.

• Example: Rolling a die many times and recording the frequency of a particular outcome, such as rolling a four.

The Law of Large Numbers

• As the number of repetitions of a probability experiment increases, the observed proportion of a particular outcome approaches the theoretical probability of that outcome.

• Example: Tracking the proportion of red lights encountered during a daily commute over many days.

The Nonexistent Law of Averages

• The Law of Large Numbers is often misinterpreted as the 'Law of Averages,' which falsely suggests that outcomes will 'even out' in the short run.

• Probability experiments are memoryless: previous outcomes do not affect future probabilities.

• Example: Simulating families with four children and examining the probability of the fifth child being a boy or girl, regardless of previous outcomes.

Basic Probability Concepts

Experiments, Sample Spaces, and Events

• Experiment: Any process that can be repeated with uncertain results.

• Sample space (S): The set of all possible outcomes of an experiment.

• Event: Any collection of outcomes from a probability experiment. Simple events consist of a single outcome.

Rules of Probability

Probability Rules

• For any event E, .

• The sum of the probabilities of all outcomes in the sample space is 1: .

• Probability model: A table or list showing all possible outcomes and their probabilities, which must satisfy the above rules.

• Unusual event: An event with a probability less than 0.05 is typically considered unusual.

Methods for Computing Probability

Empirical (Experimental) Method

• Probability is approximated by the relative frequency of an event after many trials:

Classical Method

• Used when all outcomes are equally likely.

Subjective Probability

• Probability based on personal judgment or experience, not on formal calculations or experiments.

Addition Rule and Complements

Addition Rule for Disjoint (Mutually Exclusive) Events

• If E and F are disjoint,

General Addition Rule

• For any two events E and F:

Complement Rule

• The complement of event E, denoted , consists of all outcomes not in E.

Independence and the Multiplication Rule

Independent and Dependent Events

• Events E and F are independent if the occurrence of one does not affect the probability of the other.

• Events are dependent if the occurrence of one affects the probability of the other.

• Disjoint events are not independent.

Multiplication Rule for Independent Events

• If E and F are independent,

• For n independent events:

At-Least Probabilities

• To find the probability that at least one event occurs, use the complement rule:

Conditional Probability and the General Multiplication Rule

Conditional Probability

• The probability of event E given that event F has occurred is:

General Multiplication Rule

• The probability that both E and F occur is:

Counting Techniques

Multiplication Rule of Counting

• If a task consists of a sequence of choices, the total number of ways to complete the task is the product of the number of choices at each stage.

Number of ways =

Permutations

• An ordered arrangement of r objects chosen from n distinct objects (no repetition).

• Number of permutations:

Combinations

• An unordered selection of r objects from n distinct objects (no repetition).

• Number of combinations:

Permutations with Nondistinct Items

• Number of arrangements of n objects, where there are groups of indistinguishable objects:

Number of arrangements =

Simulation in Probability

Using Simulation to Obtain Probabilities

• Simulation is used to model random processes and estimate probabilities by generating outcomes repeatedly using random mechanisms (e.g., dice, coins, computer applets).

• Simulations are valuable for understanding sampling variability and for approximating probabilities when theoretical calculation is complex.

Choosing the Appropriate Probability Rule or Counting Technique

Probability Rule Selection

• Use the classical approach if outcomes are equally likely.

• Use the empirical approach if you have experimental data.

• Use subjective probability if neither applies.

• For 'or' events, use the addition rule (general or for disjoint events as appropriate).

• For 'and' events, use the multiplication rule (for independent or dependent events as appropriate).

• For 'at least' probabilities, use the complement rule.

Counting Technique Selection

• Use the multiplication rule for sequences of independent choices.

• Use permutations when order matters and no repetition is allowed.

• Use combinations when order does not matter and no repetition is allowed.

• Use permutations with nondistinct items when some objects are indistinguishable.

Tables and Data Interpretation

Example: Travel Time Frequency Table

The following table shows the frequency of commute times for residents of Hartford County, CT. Such tables are used to compute empirical probabilities and to identify unusual events.

Summary of Probability Rules

• Probabilities are always between 0 and 1.

• The sum of probabilities in the sample space is 1.

• Addition rule for disjoint events:

• General addition rule:

• Complement rule:

• Multiplication rule for independent events: