00..
-----------------------------------------------------------------------------
Corrections for
Information Theory, Inference, and Learning Algorithms
http://www.inference.phy.cam.ac.uk/mackay/itila/
[You can find out which printing your book is by looking at page xi,
where a section `About this edition' was added in the second printing.]
-----------------------------------------------------------------------------
Please email further corrections to mackay@mrao.cam.ac.uk Thanks!
-----------------------------------------------------------------------------
This document has seven sections. Please identify which printing you have,
and visit the relevant sections.
S1. FIRST PRINTING
S2. FIRST AND SECOND PRINTING
S3. SECOND PRINTING
S4. FIRST, SECOND, AND THIRD PRINTINGS
S5. THIRD PRINTING
S6. SECOND AND THIRD PRINTINGS
S7. FIRST, SECOND, THIRD, and FOURTH PRINTINGS
X1. Suggested corrections that are NOT correct (for the record)
X2. Additional references
-----------------------------------------------------------------------------
S1. FIRST PRINTING
-----------------------------------------------------------------------------
Corrections for the first printing of
Information Theory, Inference, and Learning Algorithms
http://www.inference.phy.cam.ac.uk/mackay/itila/
-----------------------------------------------------------------------------
p.ii Copyright notice: "(c) Cambrdige" should read "(c) Cambridge".
p.3 Replace mmm by mm in section heading 1.1.
p.29 probablities -> probabilities
p.34 line 11 regretably -> regrettably
p.46 occuring -> occurring
p.48 contructing -> constructing
p.49 Add labels $x$ and $\lambda$ respectively to the first two figures'
horizontal axes.
p.50 reproduceable -> reproducible
p.61, and numerous other pages: occured -> occurred; occuring -> occurring
p.66 pp.37-36 should read pp. 36-37
p.86 Curiousities -> curiosities
p.92 line 5 punctutation -> punctuation
p.97 end of sec 5.2 inquality -> inequality
p.117 left hand side of eqs 6.11 and 6.12, $a$ should read $\tt a$;
subscript P_L in 6.12 should be P_D
p.125 last line probabilties -> probabilities
p.129 center of page: probablity -> probability
p.168 add label $R$ to x-axis.
p.174 Fig 10.9 overhangs the right margin. The label $p_1$ is missing.
p.188 Downgrade the rating of ex 11.7 from [5] to [4].
p.226 line 2. coresponding -> corresponding
p.245 sec 16.3 Delete "." after algorithm
p.248 orientiation -> orientation
p.260 Crossword A line 3: BORB should read SORB. Line 12, YEA should read TEA.
p.260 Delete "the" in the phrase:
in the `word
p.261 `previous page' should read `table 18.2'
p.269 octupuses -> octopuses
p.276 para 2. mutuation -> mutation
p.278 line 7-8 parthonegens -> parthenogens
p.280 line 11, replace "." by "?"
p.335 The square boxes in the figure 26.1 have come out broken.
p.337 The square boxes in the figure 26.4 have come out broken.
p.343 artifical -> artificial
p.383 Ex 29.16, line 12. Replace refeq.assignII by 22.22; and responsiblities -> responsibilities
p.412 partitition -> partition
p.418 Top paragraph. Replace 32.3b by 32.3a; 32.3(c,d) by 32.3(b,c);
(c) by (b); and (d) by (c).
p.430 line 2. denotes-> denote
p.430 Equation (33.43) could be improved.
Replace Q_sigma(sigma) by Q_sigma(beta) (twice in eq 33.43),
and add to the text: "We represent Q_sigma(sigma)
using the density over beta=1/sigma^2,
Q_sigma(beta) \equiv Q_sigma(sigma) |d sigma/d beta|."
p.436 Equation (33.61): add parentheses around the second two fractions on the
right hand side.
p.453 line 2 descision -> decision
p.453 Add {$\sigma_n$} label to vertical axis fig 36.1.
Add words "Contour plot of " to figure caption.
p.463 Cut the word "probability" before two-tailed
p.486 penultimate line: exisiting -> existing
p.493 after eq 41.11 probabillity -> probability
p.500 fig 41.9 caption evalutations -> evaluations
p.518 fig 42.11 caption line 2 continous -> continuous
p.548 comparision -> comparison
p.554 Replace (Ratliff and L.A., 1950) by (Ratliff and Riggs, 1950)
p.583 sec 49.3: multipled -> multiplied
p.584 last line: diagramatic -> diagrammatic
p.614 Childs et al reference: Add volume 63: 036113
p.615 Harvey and Neal reference: remove spurious "/"
p.618 Ratliff reference details incorrect - should read:
Ratliff, F. and Riggs, L. A.
p.618 Ratzer, E. A., and MacKay, D. J. C. (missing initial)
p.618 Rasmussen refs: (2000) eds: S.A. Solla and T.K. Leen and K.-R. M\"uller
(2003) editor={Suzanna Becker and Sebastian Thrun and Klaus Obermayer}
Thanks to
---------
Atsushi Shimotani
Iain Murray
Ed Ratzer
Chris Ball
Aesthetic changes or improvements I would make if I edited the book again
(All done, second printing, Mon 22/12/03)
-------------------------------------------------------------------------
p.v machine-learning -> machine learning
p.38 line 6 Change "results" to "is obtained".
p.261 line 12. Cut the word "these"
p.335 Too much space between x_n and '
p.iii, p. 435, p.572 Have tiny left margin problems.
p.123 "the next few chapters" -> "Part II"
p.171 Fig 10.8 caption missing "."
p.182 Fig 11.5 axis is dotty.
p.214 Realign figures with right margin.
p.221 Realign fig 13.17 vertically.
p.408 Fig 31.12 - grey fuzziness has appeared around the black dots.
p.566 Line 3 overhangs right margin.
Additions to the text
---------------------------------
Chapter 19: Add a citation of
@book{MarkRidley,
title={Mendel's Demon: gene justice and the complexity of life},
publisher={Phoenix},
address={London},
year={2000},
author={Mark Ridley},
isbn={0753814102}
}
- another book that explains Kondrashov's theory of sex; it has as its theme
`Who said that life forms had to be complex?'. In its second half, this
super book addresses the question `why have sexes?' (i.e., why do most
sexual organisms have males and females?)
Additions to the index
----------------------
{correlated sources} p.236
\index{Slepian-Wolf|see{correlated sources}}
Add "communication" to the index?!
====================================================================
S2. FIRST AND SECOND PRINTING
====================================================================
Corrections to the Second Printing (version 6.6, Mon 22/12/03)
that also apply to the First Printing
--------------------------------------------------------------------
Throughout: replace "c.f." by "cf."
Five exercises have solutions, but the solution pointer (eg "p. 45")
is lacking. The solutions in question are on p.45, 45, 46, 86, and 280.
The exercises that should point to these destinations are
exs 2.28 (p38), 2.29 (p38), 2.39 (p40), 4.2 (p68) and 19.1 (p275).
p.33 eq 2.36: replace 1/|X| by 1/|A_X|
p.37 ex 2.25: replace |X| by |A_X| three times
p.42 After (2.67) replace (2.63-2.63) by (2.63-2.65).
p.52 Middle of page Replace "that next toss is a" by "that the next toss is an".
p.103 Ex 5.27. Line 1. Delete the word "binary".
p.117 after eq (6.10) replace "and" by "and define"
p.138 Chapter 8, "Correlated Random Variables", should have been
called "Dependent Random Variables", and the word "correlated"
should be "dependent" throughout that chapter.
p.152 In theorem (part one): insert space between `,' and `there'.
p.159 Eq 9.51: log should be ln (twice).
p.166 After eq 10.17: P_ERR should be P_TOT.
p.168 hypthenate " rate-R' " after Asymptotically.
p.174 eq 10.28: insert "partial" operator before each p_i on left hand side.
p.190 Add rating "2" to ex. 11.10.
p.206 I used the word "minimum" when I should have used "maximum" in
six bizarre and embarrassing places in this chapter!
p.206 Example 13.1 line 2. minimum -> maximum
p.206 Sec 13.2 line 1. minimum -> maximum
p.212 Second Definition, line 1. minimum -> maximum
p.212 fig 13.9 Caption: Three times! minimum -> maximum
p.210 Sec 13.4 line 6: typically by -> typically be
p.215 Sec 13.8, last paragraph, line 2:
must at least than -> must be at least
p.218 7 lines from bottom: insert "the" before "overlap".
p.237 Fig 15.2 Caption, "correlated sources" -> "dependent sources"
p.245, 4th line from the last, "edge H-K" should be "edge I-K".
p.257 line 13: change kT to -kT
p.257 line 16: replace "trellis section" by "connection matrix".
p.257 line 2 from bottom: insert "be" before "encoded".
p.261 Before eqn 18.4, insert "approximately"
p.261 eqns 18.5,6 Replace subscripts l by 1 in f_l, twice.
p.261 eqns 18.6,7 Replace H_w by H_W
p.261 eqn 18.5 Delete \log \beta^{f_w S} |T| at end of r.h.s.
p.261 I might add the following cautionary comment to this calculation:
The calculation of the number of valid Wenglish crosswords on page
261 underestimates this number by counting only `typical' crosswords.
It is likely that atypical fillings-in of the crossword dominate the
true count.
p.261 Second to last paragraph: replace "previous page" by "table 18.2".
p.278 Fig 19.5 caption: final sentence should read:
"Vertical axes show the fitnesses of the two
sub-populations, and the percentage of the population
that is parthenogenetic."
(I should replot the top left figure to make the parthen fitness clearer.)
p.279 line 12. Insert "a" before "highly".
p.286 Line 8: r_nk should be r_k^{(n)}.
p 301, line 5. Replace comma by full stop.
p.301 Fig 22.1 Caption. Add, at end of (c):
"(shown as a density over $\ln \sigma$)"
p 303, 7th line of sec 22.3: cut "figure 20.8 and"
p.303 Line after the data figure, delete the symbol "L"
p.311 Chapter 23: all occurrences of log should be changed to ln (natural log)
p 317, Figure 23.8 caption: should say $p_3 = 1 - (p_1+p_2)$.
[$p_1+p_2+p_3=1$]
p.318. Entropic distribution (23.35) is wrong, it's missing the measure. Replace eq (23.35) by:
P(\bp | \a,\bm) = \frac{1}{Z(\a,\bm)}
\exp [ - \a D_{\rm KL}(\p||\bm) ]
\delta \! \left( \sum_i p_i - 1 \right) ,
where $\bm$, the measure, is a positive vector, and $D_{\rm KL}(\bp||\bm) = \sum_i p_i \log p_i/m_i$.
p.321 Fig 24.1 Caption. Add, at end of (c):
"(shown as a density over $\ln \sigma$)"
p 321, fig 24.1 last two lines of caption:
Delete ", sigma".
And add:
(Both probabilities are shows as densities over $\ln \sigma$.)
p.326 eq 25.9 Replace =1 by =0
p.330 First Line after Ex 25.5: replace alpha_i by alpha_I.
Last line of Ex 25.7: delete the symbol $n$ after "subsequent".
p.335 Fig 26.1 caption - Replace g(x) by P^*(x)
p.337 Fig 26.4 caption - Replace g(x) by P^*(x)
p.340 line 2. and replaced by -> are replaced by
p.360 line 3 replace "can can" by "can"
p.375 In steps 3d and 3e replace u by u'
p.377 End of middle line: (top line of para 4)
add "the" after "help of"
p.378 Top algorithm, line "7:"
replace P*(X) by P*(X')
p.378 Second algorithm, line "2f:"
replace P*(X) by P*(X')
p.378 Ex 29.11, 5th line:
replace P*(X) by P*(X')
p.418 Algorithm 32.4. Line 3. Insert factor of 2 before a_i.
p.419 line 1. Insert "of" after "idea".
p.421 The second sentence of section 32.5 is easy to misread.
Better: "We can prove this using the example of..."
p.449 before eq 35.9: unbiased estimator should read
$\hat{a} = (\bar{n}/N) / \log N$.
p 454. Ex 36.4 Clarify that the phrases "other non-winner" and "another non-winner"
do not imply that the current door is either a winner or a non-winner.
p 454. Ex 36.5. Remove "p.715/729" solution reference. Change "A to B and D to C" to "A to B, and, at the same time, D to C".
p.455 Delete word `made' in `having not chosen the most desirable'.
p.484 Definition 40.1 (General position)
The definition given is insufficient. An extra constraint is needed,
namely -
and no $K+1$ of them lie in a $(K-1)$-dimensional plane.
The text around Definition 40.1 contains an ugly repetition.
There is also an unnecessary reference to p484.
p.522 Before eq 43.3: Replace subscripts "n" by "i". Add a reference to equation (42.3)
for the definition of the activation.
Eq 43.3: add subscript "i" to "a".
p.528 Last para of sec 44.1, line 1 -
44.3 should read 44.4
p.529 line 11: delete "reading aloud".
Add entry to index: "reading aloud, p.529".
p.576 Middle of page, after (48.1)
replace "whereas is" by "whereas in"
p.583, bottom paragraph. Where it says "Figure 49.3", it should be
"Figure 49.2".
p.595 Upgrade difficulty of ex 50.12 from 3C to 4C.
Aesthetic corrections:
p.538-9 Figures 44.2 and 44.3 occur in the wrong order.
Index additions:
p 627, add index entry for "softmax" on p 316 (first occurrence, before p 339).
Additional entries for {law of large numbers}.
Add
union bound: page 166.
====================================================================
S3. SECOND PRINTING
====================================================================
Corrections to the Second Printing (version 6.6, Mon 22/12/03)
that do not apply to the First.
--------------------------------------------------------------------
p.430 Subsection "Optimization of Q_sigma(sigma)":
I messed up the correction to the first printing!
The first line should read
"We represent Q_sigma(sigma)
using the density over beta,
Q_sigma(beta) \equiv Q_sigma(sigma) |d sigma/d beta|."
[Delete
\propto 1/\beta
at end of first line.]
Add marginal note:
The prior P(\sigma) \propto 1/\sigma transforms to P(\beta)
\propto 1/\beta.
--------------------------------------------------------------------
Corrections to the Online copy of the second printing
--------------------------------------------------------------------
Page numbers may be off by 2 compared to the printed book.
--------------------------------------------------------------------
Aesthetic changes
--------------------------------------------------------------------
page 429 a small protrusion
Consistency: p 289 has "soft-min", index p 627 has "softmin",
p.454 Replace `people' by `anyone'
p.454 Insert `large' before queue
p.61 "There is a general rule which helps immensely in confusing
probability problems"
is poor and confusing English!
As a quick fix, add a comma thus:
"There is a general rule which helps immensely, in confusing
probability problems"
====================================================================
S4. FIRST, SECOND, THIRD PRINTINGS
====================================================================
Corrections to the Third Printing (version 7.0, Mon 30/8/04)
that also apply to the First and Second.
--------------------------------------------------------------------
p.30 before Ex 2.8 replace < by \leq so it reads:
$P(v) \leq 1$ for any interval $(a,b)$.
p.36 Ex 2.17: "what is b as a function of p?" should be
"what is p as a function of b?"
p.42: soln to ex 2.17 (eq 2.68)
Replace "a" by "b".
p.53: Five lines from bottom of page:
It depends what $p_{0}$ is.
should read
It depends what $p_{a}$ is.
p.80 eq 4.28. Second "approx equal" should be "equal"
p.82 Before eq 4.36: Replace 'that T_Nb contains' by 'contained by T_Nb'.
p.116: line 7: corresponds -> correspond
p.159 Cut the final two sentences of the Z-channel answer, from
"Thus starting from..."
to
"...-1/2)."
[They are incorrect.]
p.160 Eq 9.54: A^q should be A^S in denominator.
p.170 Lines 3 and 8: I(X,Y) should be I(X;Y)
p.244 sec 16.2 line 3 of point "2." the the -> the
p.246, end of sec 16.4.
large subset variables -> large subset of variables
p.297 Figure 21.5 caption: Replace S^2 by S.
p.301 Insert minus sign thus after eq 22.7:
which is $-1/\sigma^2_{\mu}$,
p.301 Figure 22.1 caption: Replace S^2 by S.
p.315 Eq 23.25. Insert (1/Z) into right hand side.
p.316 Eq 23.27: sigma should be sigma^2.
p.319 Line 7 from bottom. \sigma_{\mu} should be \sigma_{\mu}^2.
p.321 Figure 24.1 caption: Replace S^2 by S.
p.385 End of soln of ex 29.2. other mode -> other modes
p.447 Sec 35.3 Line 6. of the others -> of the other
p.454 "Allias paradox" should be "Allais paradox" (also in the index)
p.512 After ex 42.6. Lyapunov functions -> Lyapunov function
p.574, 6th line from the bottom: indicate -> indicates
p.581, end of section 48.4, final sentence: add
"as long as their number of weight-2 columns is not too large (cf.
exercise 47.3, p.572)."
p.598-9 bottom of page, all "log" should be "ln". (Eq A.3, A.4)
p.592 Ex 50.2. Add parentheses around "K-t" in line 7.
I should have included a bibliographic reference to the original
paper of Huffman:
http://compression.graphicon.ru/download/articles/huff/huffman_1952_minimum-redundancy-codes.pdf
D. Huffman, "A Method for Construction of Minimum-Redundancy Codes", Proc. of IRE, September 1952.
Add marginal note:
The 'pentagonful code's graph is called the Petersen Graph.
====================================================================
S5. THIRD PRINTING
====================================================================
Corrections to the Third Printing (version 7.0, Mon 30/8/04)
that do not apply to the First or Second.
--------------------------------------------------------------------
p.(Music Hash) pointer to www.name-this-tune.com changed to
http://musipedia.org/
====================================================================
S6. SECOND + THIRD PRINTINGS
====================================================================
p.3 VERY EMBARRASSING: The word "communication" got cut from
the first line of the book. Shannon's quote should read:
The fundamental problem of communication is that of ...
====================================================================
S7. FIRST, SECOND, THIRD, and FOURTH PRINTINGS
====================================================================
Corrections to the Fourth Printing
that also apply to the First, Second, and Third.
--------------------------------------------------------------------
p.26 The presentation of the Cox axioms on page 26
is not entirely correct. Axiom 1 postulates that degrees of
belief can be ordered; I state that this implies that beliefs
can be mapped onto real numbers. Unfortunately this is not entirely
valid, as all linear orderings cannot be mapped onto real numbers.
(credit: Kerkko Luosto and Antti Honkela)
For further reading about the Cox axioms I highly recommend:
http://citeseer.ist.psu.edu/horn03constructing.html
Constructing a Logic of Plausible Inference: a Guide To Cox's Theorem (2003)
by
Kevin S. Van Horn
@misc{ horn-constructing,
author = "Kevin S. Van Horn",
title = "Constructing a Logic of Plausible Inference: a Guide To {C}ox's Theorem",
url = "citeseer.ist.psu.edu/horn03constructing.html" }
p.49 The 3 graphs in Figure 3.1 are incorrect. The correct figure (which doesn't look
very different qualitatively) can be found here:
http://www.inference.phy.cam.ac.uk/mackay/itila/errata/decay.like.1C.ps
http://www.inference.phy.cam.ac.uk/mackay/itila/errata/decay.like.1C.png
p.56 To be more precise,
"But does the fact that type O blood was detected at the scene favour
the hypothesis that Oliver was present?"
could be tweaked to
"But do the data (type O and type AB blood detected at the scene) favour
the hypothesis that Oliver was present?"
p. 69 Figure 4.2, on the right hand side after you weigh
1/7, the boxes containing "8-" and "*" should be swapped
so that "*" is the middle outcome. And after you weigh
7/1, the boxes containing "8+" and "*" should be swapped
so that "*" is the middle outcome.
p.87 Fig 4.14 Caption "1, 2, 100" should read "1, 2, 1000".
p.159 Line 1, the exercise reference "p.153" should say "p.154"
p.161 Line 2, the exercise reference "p.153" should say "p.154" [Note to DJCM - Latex bug?]
p.178 End of 2nd paragraph: separated by LESS THAN the Nyquist interval
p.182 eq (11.33) replace M by S.
p.189 eq (11.40):
the -1/2 on the RHS of eq (11.40) should be replaced by -1/2 ln[2 \pi e]
or "-1/2 - 1/2 ln(2 \pi)"
p.190 Eq 11.46. Replace C'' by C'.
p.190 Following line: insert minus sign before (y-x)^2.
p.214 Table should read
p_b = \frac{3}{N} {{N} \choose {2}} f^2 :
probability of bit error to leading order
(not block error)
p.223 Soln to ex 13.4. should read:
The probability of block error to leading order is
$p_{\rm B} = {{N} \choose {2}} f^2$.
The probability of bit error to leading order is
$p_{\rm b} = \frac{3}{N} {{N} \choose {2}} f^2$.
p.231 eq (14.12) The "=" should be "<="
p.304 Eq 22.25 Both k in denominator should be k'
p.315 Figure 23.5 caption has x where it should say v:
"and shown as a function of $v$ on the left
and $l = \ln v$ on the right."
p.326, third line from the bottom, defining a trellis:
"The leftmost and rightmost states contain only one node."
should read
"The leftmost and rightmost times contain only one node."
p.333 In the solution to ex. 25.9, second line from bottom, the bitwise posterior probabilities
are all listed as P(t_1 | {\bf{y}}). It should read t_1, t_2, and t_3.
p.355 Line 2: "then" should be "than".
p.371 Replace "Because Gibbs sampling is a Metropolis method,"
by
"Because Gibbs sampling is composed of updates that are
Metropolis methods,"
p.407: just after eq 31.25, "Let" should be "let".
p.412 line 3: One could a more accurate comparison
should be
One could make a more accurate comparison
p.441 Change i to i' in the suffix of w_i on the right hand side of eqn (34.20).
P.461 Near bottom of page and in caption of figure 37.4:
Replace
p_A+ < 10 p_B+
by
p_A+ < 0.1 p_B+
p.484: Def 40.1 reads "A set of points...are in
general position..."
But "are" should read "is" (set being singular).
p.533: equation 44.12 right hand side has a sign error. P(t)/P(t|y)
should be P(t|y)/P(t)
p.534: ex 45.1 "There's" should be "There are".
p.538: Just after Eqn (45.9) "discontinuities in its second derivative"
should be "discontinuities in the third derivative".
p.562: line 13: 120t/R should be 120j/R.
p.567 It's been pointed out that the discussion of GF(4) and GF(8)
and clumped bits should be clearer. If I clump the bits in
threes, I work in GF(8). If I clump them in twos, I work in GF(4).
p.581 "... tweaking of turbo codes is a black art, and it
never succeeds in totalling eliminating low-weight...".
"totalling" should be "totally".
p.602: Just after (B.5), a sentence begins "if", rather than "If".
p.610: Eqn (C.22) Left hand side of 2nd line, lambda^(b) should
read \lambda^{(b)}(0).
=======================================================================
X1. Suggested corrections that are NOT correct (for the record)
=======================================================================
p.1: It's often suggested that 'x! \simeq x^x e^{-x}' is an error,
as the factor of sqrt{2 pi x} (in eq 1.11) is missing.
But this suggestion is based on a misunderstanding of Stirling's
approximation. It is a series expansion, and I may quote it
to however many terms I wish. I bet that people who try to slavishly
memorize the expression including the sqrt{2 pi x} run the
risk of making slips in the crucial $x^x$ part. Don't be a
slave. Understand that x! \simeq x^x, and that all the other terms
are just minor corrections.
Saying that "x! ~= x^x Exp[-x] is wrong"
is just like saying
"exp(x) ~= 1+x+x**2/2 is wrong, it should be
exp(x) ~= 1+x+x**2/2+x**3/3".
p.202 A reader writes "On p 202 you claim that
equation 12.6 is "exactly" right. I think it's only approximately right
as this is based on the assumption that pairs are independent. This
independence assumption is a reasonable approximation for low
probability of collision events - at higher probability events like
triangles are more likely eg A=B and B=C => A=C, which breaks independence."
My response: Yes, the pair-collisions are dependent events. But 12.6 _is_
exactly right. If x and y are dependent random variables, and z = x+y,
what is the mean of z? May I suggest = + , or does dependence
mean that means don't add any more?
--------------------------------------------------------------------
X2. Additional references
--------------------------------------------------------------------
1. Recommended for readers who want practice with elementary probability:
@book{Ambegaokar1996,
title={Reasoning about Luck: Probability and its Uses in Physics},
author={Vinay Ambegaokar},
year={1996},
isbn={0521447372}
}
2. Highly recommended for further reading on Bayesian inference, rational
decision making, and the question `does ordinary human reasoning
obey Bayesian probability?' (to which the answer is `often not!')
@book{Tversky1982,
title={Judgment under Uncertainty: Heuristics and Biases},
editor={Daniel Kahneman and Paul Slovic and Amos Tversky},
year={1982},
annote={544 pages},
ISBN={0521284147}
}
3. Have not read this yet, but I should probably include it
@article{arith_coding_revisited,
author={Moffat, A., Neal, R. M., and Witten, I. H.},
year={1998},
title={Arithmetic coding revisited},
journal={ACM Transactions on Information Systems},
volume={16},
pages={256-294}
}
4. Add a reference to
@inproceedings{Huber1998,
author={Mark Huber},
title={Exact Sampling and Approximate Counting Techniques},
booktitle={Proceedings of the 30th ACM Symposium on the Theory of Computing},
pages={31-40},
year={1998},
annote={Mark Huber. Exact Sampling and Approximate Counting Techniques. In Proceedings of the 30th ACM Symposium on the Theory of Computing, pages 31--40, 1998.}
}
on page 419, thus:
Summary state methods were first introduced by
\citeasnoun{Huber1998}; they also go by the names
{sandwiching method}s and {bounding chain}s.
5. Add a reference to
@article{Berlekamp1976,
author={Elwyn R. Berlekamp},
title={Cooperative bridge bidding},
journal={IEEE Transactions on Information Theory},
month={Nov},
year={1976}, vol=22, number=6, pages={753-756}
}
@article{Cohn1976
author={David L. Cohn},
title={An Enumeration Scheme for Bidding Sequences in Bridge},
journal={IEEE Transactions on Information Theory},
month={Nov},
year={1976}, vol=22, number=6, pages={756-757}
}
in the bridge exercise.
6. Add to the bibliography
@Article{Ziv_Lempel77,
author = "J. Ziv and A. Lempel",
title = "A Universal Algorithm for Sequential Data
Compression",
journal = "IEEE Trans. on Info. Theory",
year = 1977,
volume = 23,
number = 3,
pages = "337-343",
month = "May"
}
--------------------------------------------------------------------
Thanks to
---------
Atsushi Shimotani
Iain Murray
Ed Ratzer
Chris Ball
Keith M. Briggs
Ole Winther
jan-hendrik
Nachiketa Sahoo
Ros Polis
Sergio Verdu
KANEMURA Atsunori
Alan N. Hampton
Danilo Silva
Mike Potts
Laurent Perrinet
Oleg Zabronski
Niek Bouman
YW Law
Don Smith
Saeed Iqbal
Aaron Krom
Antti Honkela
Andrew Naish
Lucas Malta
Trifon Triantafillidis
Alexandros Papanikolaou
J D Vlok
Pedro Landin
Issac Trotts
Ulrich Paquet
Peter Conlon
Robert Tough
Joakim Grahl Knudsen
Yash Deshpande
Nao Maeda
-----------------------------------------------------------------------------
VERSION NUMBERS
-----------------------------------------------------------------------------
Version 6.0 is the version of the first printing of the book. (Thu 26/6/03)
Version 6.6, Mon 22/12/03. Second Printing
version 7.0, Mon 30/8/04 Third printing
version 7.2, Mon 21/3/05 Fourth printing