Graduate Catalog 2021-2022

ELE 652 Information Theory

3 hours; 3 credits.  Information measures, Law of large numbers and asymptotic equipartition property. Lossless data compression: Huffman codes, Kraft's inequality, bounds on optimal code length. Channel capacity: joint typicality, channel coding theorem.  Fano's inequality and the converse to the channel coding theorem.  Differential entropy.  Gaussian channels. Introduction to rate distortion theory.  Prerequisite: Admission to the program.