Graduate Catalog 2018-2019

ELE 652 Information Theory

3 Credits; 3 Hours. Information measures, Law of large numbers and the asymptotic equipartition property. Lossless data compression: Huffman codes, Krafts inequality, bounds on optimal code length. Channel capacity: joint typicality, channel coding theorem, Fano’s inequality and the converse to the channel coding theorem. Differential entropy. Gaussian channels. Introduction to rate distortion theory.PREREQUISITE: Admission to the ME program