Elements of Information Theory, T.M. Cover and J.A. Thomas, Wiley.
Definition of a measure of information and study of its properties; introduction to entropy, mutual information, channel capacity, and rate-distortion theory.
- Homework: 8-10 assignments.
- Exams: 2 midterm exams, 1 comprehensive final exam
- Typical grading policy: 10% homework, 30% exam 1, 30% exam 2, 30% final exam