Course:Information Theory

From BenningtonWiki

Notes for developing a course on Information Theory.

For an intro to lossy compression, simply code a compression algorithm that drops every nth letter from a source text (skipping spaces). For lossless compression, play with various character encodings -- start with ASCII, and then invent more compact encodings. Move on to encoding letter pairs and entire words. Consider frequencies. A programming challenge: see whose algorithm compresses a text file best. Use size and speed as metrics.