Course Chapters
Table of Contents
Explore each chapter of information theory in a structured learning sequence.
1 chapters available
Information Theory
Explore comprehensive resources and materials for this computer science field.
Core Concepts
Key Topics
Essential concepts and areas you should master in information theory.
Shannon Entropy
Mutual Information
Divergence Properties
Kraft-McMillan Theorem
Asymptotic Equipartition
Fano's Inequalities
Entropy Rates
Shannon Codes
Huffman Codes
Charnnel Coding Theorem
Source Channel Theorem
Polar Codes
Differential Entropy
Gaussian Channels
Elias' Code
Arithetic Codes
Tunstall's Code
Channel Capacity
Shannon's Theorems
Block Linear Codes
Wonham Filter
Viterbi Algorithm
Rate Distortion Theory
Differential Entropy
Hamming Code
Quantization
Rate Distortion Function
Sanov's Theorem
Chernoff-Stein Lemma
Chernoff Information
Fisher Information
Cramer Rao Inequality
Burg's Mazimum Entropy Theorem
Lempel-Ziv Coding
Occam's Razor
Kolomogorov's Complexity
Slepian-Wolf Encoding
Kuhn Tucker
Shannon-McMillan-Breiman Theorem
Brunn-Minkowski Inequality
Practice Problems
Featured Problem
Test your knowledge with this information theory problem
Problem 1
Test your knowledge with this information theory problem
Start problem
Problem 2
Test your knowledge with this information theory problem
Start problem
Problem 3
Test your knowledge with this information theory problem
Start problem
Continue Learning
Ready to dive deeper into information theory? Explore more resources and connect with the community.