HN Theater @HNTheaterMonth

To understand how error correction works and to learn more about Hamming codes & Reed-Solomon, 3Blue1Brown and Ben Eater were invaluable. 3Blue1Brown and Ben Eater are by far some of the best educational content creators within their fields, mathematics and computer engineering respectively.

I would strongly recommend anyone interested in the topic to check out any of these videos:

How to send a self-correcting message (Hamming codes): https://www.youtube.com/watch?v=X8jsijhllIA

Hamming codes part 2, the elegance of it all: https://www.youtube.com/watch?v=b3NxrZOu_CE

And any of Ben Eater's five videos on error correction: https://eater.net/crc

As an aside, Ben Eater does all of his videos and demonstrations using an 8-bit computer he has built step by step in videos on a breadboard. Very impressive and inspiring.

I'm a big fan of this video from Reducible on Huffman codes: https://www.youtube.com/watch?v=B3y0RsVCyrw, and from 3Blue1Brown on Hamming codes: https://www.youtube.com/watch?v=X8jsijhllIA

⬐ alberto_ol

Thanks. To be more specific, i'm interested in learning Shannon's information theory from scratch. So far I know just the definition of entropy.

⬐ tlb

Shannon's book, The Mathematical Theory of Communication, is approachable with the mathematical background of first-year college calculus. I don't think it requires any more math than is essential to understand the topic.

So how does this relate to Hamming codes? [0]

[0] https://m.youtube.com/watch?v=X8jsijhllIA

⬐ dragontamer

Hamming codes were among the first codes invented after Shannon's paper.

Hamming codes are very tiny, but efficient. There are bigger (and therefore better) codes today, but hamming codes are still used when small codes are useful (or: error correcting ram)

Hamming codes are optimal and efficient for their size. But there is a need for larger codes in most practical situations. If you need single error correcting double error detecting however, Hamming is probably your best bet.

⬐ alg_fun

Visuals are amazing, as always! I've recently learned that 3b1b has his own animation library. https://github.com/3b1b/manim I wonder if there are any manim art out there :)

Nice! pairs well with the 3Blue1Br video on the subject: https://www.youtube.com/watch?v=X8jsijhllIA

Hamming's book The Art of doing Science and Engineer's a solid read. Mixed topics, centered around problem solving techniques, and pitfalls.

⬐ Buttons840

Interested viewers might also enjoy this free book: http://www.inference.org.uk/mackay/itila/

An early chapter talks about Hamming Codes.

I've only worked through the first few chapters, but I recommend it. It seems to be a unique book.

⬐ abhgh

I recommend the book in general, and also his lectures. He has a quirky sense of humour, compares his book with Harry Potter here: http://www.inference.org.uk/mackay/itila/Potter.html