David MacKay

Information Theory, Inference, and Learning Algorithms

Search :

  1Introduction to Information Theory
2Probability, Entropy, and Inference
3More about Inference
Part IData Compression
4The Source Coding Theorem
5Symbol Codes
6Stream Codes
7Codes for Integers
Part IINoisy-Channel Coding
8Dependent Random Variables
9Communication over a Noisy Channel
10The Noisy-Channel Coding Theorem
11Error-Correcting Codes and Real Channels
Part III Further Topics in Information Theory
12Hash Codes: Codes for Efficient Information Retrieval
13Binary Codes
14Very Good Linear Codes Exist
15Further Exercises on Information Theory
16Message Passing
17Communication over Constrained Noiseless Channels
18Crosswords and Codebreaking
19Why have Sex? Information Acquisition and Evolution
Part IV Probabilities and Inference
20An Example Inference Task: Clustering
21Exact Inference by Complete Enumeration
22Maximum Likelihood and Clustering
23Useful Probability Distributions
24Exact Marginalization
25Exact Marginalization in Trellises
26Exact Marginalization in Graphs
27Laplace's Method
28Model Comparison and Occam's Razor
29Monte Carlo Methods
30Efficient Monte Carlo Methods
31Ising Models
32Exact Monte Carlo Sampling
33Variational Methods
34Independent Component Analysis and Latent Variable Modelling
35Random Inference Topics
36Decision Theory
37Bayesian Inference and Sampling Theory
Part V Neural networks
38Introduction to Neural Networks
39The Single Neuron as a Classifier
40Capacity of a Single Neuron
41Learning as Inference
42Hopfield Networks
43Boltzmann Machines
44Supervised Learning in Multilayer Networks
45Gaussian Processes
Part VI Sparse Graph Codes
47Low-Density Parity-Check Codes
48Convolutional Codes and Turbo Codes
49Repeat-Accumulate Codes
50Digital Fountain Codes
Part VII Appendices
Notation; Some Physics; Some Mathematics

Library of Congress

  • Dewey number: 003/.54
  • Dewey version: 21
  • LC Classification: Q360 .M23 2003
  • LC Subject headings:
    • Information theory

Library of Congress Record

DOI: 10.2277/0521642981

(ISBN-13: 9780521642989 | ISBN-10: 0521642981)

Available in South Asia Edition in Paperback: ISBN 0521670519 (South Asia only)

Available in Chinese translation from Higher Education Press ISBN={7-04-019641-7}

Site last modified Sun Aug 31 18:51:08 BST 2014