Informationstheorie I: Grundlagen

This lecture course introduces the fundamentals of information theory, network information theory and coding theory. Outline: information, uncertainty, entropy, mutual information, capacity, differential entropy, typical sequences, Gaussian channels, basics of source and channel coding, linear block codes, Shannon’s source coding theorem, Shannon’s channel coding theorem, capacity of Gaussian channels, capacity of bandlimited channels, Shannon’s bound, bandwidth efficiency, capacity of multiple parallel channels and waterfilling, Gaussian vector channel, Multiple Access Channel, Broadcast Channel, rate region.