Skip to content

Information Theory and Coding

Track position

Entropy, capacity, rate-distortion, and modern error-correcting codes for both limits and constructions.

Suggested order

  1. Information Theory

Courses

Course Institution Role Tier Practice coverage
Information Theory Stanford University Mainline A Complete
Information Theory MIT Supplement B Partial

How to choose

  • For a first systematic pass, start with audit-passed mainline courses; read the limitation before using a record marked “Audit review,” and rarely take parallel alternatives.
  • Tiers measure public-resource completeness and self-study executability, not institutional or instructor prestige.
  • Use supplements only to close a specific topic, tool, or practice gap.

Track completion

  • Explain the core concepts, models, and methods of Information Theory and Coding
  • Produce reproducible exercises, experiments, or designs with explicit checks