ELEMENTS OF INFORMATION THEORY

Second Edition

THOMAS M. COVER
JOY A. THOMAS

and

solution

1 Introduction 
2 Entropy, Relative Entropy and Mutual Information 
3 The Asymptotic Equipartition Property 
4 Entropy Rates of a Stochastic Process 
5 Data Compression 
6 Gambling and Data Compression 
7 Channel Capacity 
8 Dierential Entropy 
9 Gaussian channel 
10 Rate Distortion Theory 
11 Information Theory and Statistics 
12 Maximum Entropy 
13 Universal Source Coding 
14 Kolmogorov Complexity 
15 Network Information Theory 
16 Information Theory and Portfolio Theory 
17 Inequalities in Information Theory