Probability Measure Spaces

"A random variable is not random because the function changes; it is random because the measure on its domain does."

Overview

Probability measure spaces turn randomness into measure, random variables into measurable maps, and distributions into pushforward measures.

Measure theory is the grammar behind rigorous probability. Earlier probability chapters taught how to compute with random variables and distributions. This chapter explains what those objects are when sample spaces are infinite, events are generated by observations, and densities depend on a base measure.

This section uses LaTeX Markdown throughout. Inline mathematics uses $...$, and display mathematics uses `

`. The focus is the foundation needed for ML: expected loss, pushforward distributions, convergence of estimators, likelihood ratios, importance sampling, KL divergence, and support mismatch.

Prerequisites

• Lebesgue Integration
• Introduction to Probability and Random Variables
• Joint Distributions
• PAC Learning

Companion Notebooks

Learning Objectives

After completing this section, you will be able to:

• Define probability spaces as measure spaces with total mass one
• Explain random variables as measurable maps
• Compute pushforward distributions in finite examples
• Express independence using product measures
• Write expectation as a Lebesgue integral with respect to $P$
• Distinguish almost sure events from sure events
• Compare convergence almost surely, in probability, in $L^p$, and in distribution
• Connect i.i.d. samples to product probability spaces
• Interpret population and empirical risk as integrals under different measures
• Prepare for Radon-Nikodym density and change-of-measure arguments

Study Flow

1. Read the pages in order and pause after each page to restate the main definition or theorem.
2. Run theory.ipynb when you want to check the formulas numerically.
3. Use exercises.ipynb after the reading path, not before it.
4. Return to this overview page when you need the chapter-level navigation.

Runnable Companions

• Theory notebook
• Exercises notebook