Manifolds

"A manifold is a space that looks flat when you stand close enough."

Overview

Manifolds give the language for curved state spaces, latent spaces, symmetry spaces, and locally linear representations in AI.

Differential geometry is the part of mathematics that makes calculus work on curved spaces. Earlier chapters treated vectors, matrices, probabilities, optimization, and measures mostly in flat coordinate systems. This chapter explains what changes when the object being modeled is a sphere, a space of subspaces, a positive-definite covariance matrix, a statistical model, or a learned latent manifold.

This section uses LaTeX Markdown throughout. Inline mathematics uses $...$, and display mathematics uses `

`. The AI focus is practical: local coordinates, tangent spaces, metrics, geodesics, retractions, natural gradients, and matrix-manifold constraints.

Prerequisites

• Functions and Mappings
• Vector Spaces and Subspaces
• Jacobian and Hessian
• Radon-Nikodym Theorem

Companion Notebooks

Learning Objectives

After completing this section, you will be able to:

• Define charts, atlases, smooth compatibility, and smooth manifolds
• Explain why local coordinates are needed for curved spaces
• Distinguish local Euclidean structure from global topology
• Compute tangent spaces for embedded examples such as spheres
• Interpret tangent vectors as velocities of curves
• Use differentials to push tangent vectors through smooth maps
• Identify embedded and immersed submanifolds
• Connect the manifold hypothesis to representation learning
• Recognize common ML manifolds: spheres, Stiefel, Grassmann, and SPD matrices
• Prepare for Riemannian metrics by separating topology, smoothness, and geometry

Study Flow

1. Read the pages in order and pause after each page to restate the main definition or theorem.
2. Run theory.ipynb when you want to check the formulas numerically.
3. Use exercises.ipynb after the reading path, not before it.
4. Return to this overview page when you need the chapter-level navigation.

Runnable Companions

• Theory notebook
• Exercises notebook