Probability Theory

Probability is the logic of uncertainty. It allows us to quantify how likely an event is to occur. From predicting election results to calculating insurance premiums, probability theory underpins modern science and decision-making.

Whether you are learning the basics of sample spaces or diving into complex Bayesian inference, understanding these concepts is crucial for statistical analysis.

If you need help solving probability problems or applying them to your research, our statistical consulting services are available.

Basic Concepts

• Experiment: A process that leads to one of several possible outcomes (e.g., rolling a die).
• Sample Space (S): The set of all possible outcomes (e.g., {1, 2, 3, 4, 5, 6}).
• Event (E): A subset of the sample space (e.g., rolling an even number {2, 4, 6}).
• Probability P(E): A number between 0 (impossible) and 1 (certain) representing the likelihood of E.

Fundamental Rules of Probability

1. The Addition Rule (OR)

Used to calculate the probability that Event A or Event B occurs.

If events are mutually exclusive (cannot happen at same time):

P(A or B) = P(A) + P(B)

If events are not mutually exclusive:

P(A or B) = P(A) + P(B) – P(A and B)

2. The Multiplication Rule (AND)

Used to calculate the probability that Event A and Event B both occur.

If events are independent:

P(A and B) = P(A) * P(B)

If events are dependent:

P(A and B) = P(A) * P(B|A)

Conditional Probability

Conditional probability is the likelihood of an event occurring given that another event has already occurred. We write this as P(A|B) (“Probability of A given B”).

This concept is fundamental to machine learning and medical testing (e.g., the probability you have a disease given a positive test result).

For intuitive examples, Khan Academy’s probability unit is an excellent resource.

Independence vs. Dependence

Two events are independent if the outcome of one does not affect the outcome of the other (e.g., rolling two dice). They are dependent if the outcome of one affects the other (e.g., drawing cards from a deck without replacement).

Confusing these two is a common source of error, such as the “Gambler’s Fallacy” (believing a coin is “due” to land on heads after a string of tails).

Bayes’ Theorem

Bayes’ Theorem provides a way to update probabilities based on new evidence. It relates current probability to prior probability.

It is the foundation of Bayesian Statistics, a powerful branch of analysis used in modern AI and decision making.

For rigorous academic treatment, see MIT OpenCourseWare’s Probability course.

Probability Distributions

Probability theory leads directly to probability distributions (patterns of outcomes). Learn more about the Normal, Binomial, and Poisson distributions in our guide to statistical distributions.

Solve Your Probability Problems

Whether you are calculating risk or solving a complex homework problem, probability can be tricky. Our experts can help you work through the logic and find the correct answer.