Calendar

LEC# TOPICS KEY DATES
1 Introduction, Review of Random Variables, Entropy, Mutual Information, Chain Rules
2 Jensen's Inequality, Data Processing Theorem, Fanos's Inequality PS 1 issued
3 Markov Chain, Entropy Rate of Random Processes
4 Different Types of Convergence, Asymptotic Equipartition Property (AEP), Typical Set, Joint Typicality PS 1 due
PS 2 issued
5 Data Compression, Kraft Inequality, Optimal Codes PS 2 due
6 Huffman Codes, Sensitivity of Distribution, Elias Code
7 Gambling PS 3 issued
8 Channel Capacity, Symmetric and Erasure Channels PS 3 due
PS 4 issued
9 Coding Theorem
10 Strong Coding Theorem
11 Strong Coding Theorem (cont.) PS 4 due
PS 5 issued
12 Feedback Capacity PS 5 due
13 Joint Source Channel Coding
14 Differential Entropy PS 6 issued
15 Gaussian Channel 
16 Gaussian Channels: Parallel, Colored Noise, Inter-symbol Interference PS 6 due
PS 7 issued
17 Maximizing Entropy
18 Gaussian Channels with Feedback PS 7 due
PS 8 issued
19 Fading Channels PS 8 due
PS 9 issued
20 Types, Universal Source Coding, Sanov's Theorem

PS 9 due
PS 10 issued

21 Multiple Access Channels
22 Slepian-Wolf Coding PS 10 due
23 Broadcast Channels
24 Channel Side Information, Wide-band Channels