CSC310F Fall 2006  Textbook and Other Readings
Textbook
The textbook for the class will be David Mackay's book,
Information Theory, Inference and Learning Algorithms.
The book is freely available online at
this
website.
Readings (tentative list, watch for updates)
 We will be covering material from Parts I, II, III of the book.
 Read chapter 1 for Lectures 1,2 and first tutorial.
The material in chapter 2 may be a helpful review but is not directly
part of the course content.
 Read Chapters 4, 5,6 in Mackay's book. (Lectures 311b).
 Read Chapters 8 and 9 in Mackay's book (starting with Lecture 12).
 Read Chapters 10,11,47,50 in Mackay's book.
Additional Material
 Mike Luby's original paper on Digital
Fountain codes.
 A nice review paper on Digital
Fountain codes.
 Here's a link to the
Dasher Project homepage. This is the demo I showed in class.
 Moffat's 1990 paper Implementing PPM, with details
about tries, etc.
 The famous
LZ77,
and
LZ78
papers.
 The 1988 paper Arithmetic Coding Revisited
by Moffat, Neal , Witten is
here.
 The 1987 paper Arithmetic Coding for Data Compression
by Witten, Neal, Cleary is
here.
 Shannon's classic paper, A Mathematical Theory of
Communication is available
here.
 Huffman's famous 1952 paper, A Method for the Construction of
Minimum Redundancy Codes is available
here.
 The notes from a
short course given by David Mackay in 1995, out of which his book
eventually grew.
[
Home 
Course Information 
Lecture Schedule/Notes 
Textbook/Readings 
Assignments/Tests 
Computing 
]
CSC310F  Information Theory  www.cs.toronto.edu/~roweis/csc310/
