HN Theater @HNTheaterMonth

The best talks and videos of Hacker News.

Hacker News Comments on
Jim Keller: The Future of Computing, AI, Life, and Consciousness | Lex Fridman Podcast #162

Lex Fridman · Youtube · 49 HN points · 11 HN comments
HN Theater has aggregated all Hacker News stories and comments that mention Lex Fridman's video "Jim Keller: The Future of Computing, AI, Life, and Consciousness | Lex Fridman Podcast #162".
Youtube Summary
Jim Keller is a legendary microprocessor engineer, previously at AMD, Apple, Tesla, Intel, and now Tenstorrent. Please support this podcast by checking out our sponsors:
- Athletic Greens: https://athleticgreens.com/lex and use code LEX to get 1 month of fish oil
- Brooklinen: https://brooklinen.com and use code LEX to get $25 off + free shipping
- ExpressVPN: https://expressvpn.com/lexpod and use code LexPod to get 3 months free
- Belcampo: https://belcampo.com/lex and use code LEX to get 20% off first order

EPISODE LINKS:
Jim's Twitter: https://twitter.com/jimkxa
Jim's Wiki: https://en.wikipedia.org/wiki/Jim_Keller_(engineer)
Tenstorrent: https://www.tenstorrent.com/

PODCAST INFO:
Podcast website: https://lexfridman.com/podcast
Apple Podcasts: https://apple.co/2lwqZIr
Spotify: https://spoti.fi/2nEwCF8
RSS: https://lexfridman.com/feed/podcast/
Full episodes playlist: https://www.youtube.com/playlist?list=PLrAXtmErZgOdP_8GztsuKi9nrraNbKKp4
Clips playlist: https://www.youtube.com/playlist?list=PLrAXtmErZgOeciFP3CBCIEElOJeitOr41

OUTLINE:
0:00 - Introduction
1:33 - Good design is both science and engineering
7:33 - Javascript
11:40 - RISC vs CISC
15:39 - What makes a great processor?
17:09 - Intel vs ARM
18:58 - Steve Jobs and Apple
21:36 - Elon Musk and Steve Jobs
27:21 - Father
31:03 - Perfection
37:18 - Modular design
42:52 - Moore's law
49:50 - Hardware for deep learning
56:44 - Making neural networks fast at scale
1:04:22 - Andrej Karpathy and Chris Lattner
1:08:36 - How GPUs work
1:12:43 - Tesla Autopilot, NVIDIA, and Mobileye
1:17:23 - Andrej Karpathy and Software 2.0
1:23:43 - Tesla Dojo
1:26:20 - Neural networks will understand physics better than humans
1:28:33 - Re-engineering the human brain
1:33:26 - Infinite fun and the Culture Series by Iain Banks
1:35:20 - Neuralink
1:40:43 - Dreams
1:44:37 - Ideas
1:54:49 - Aliens
1:59:46 - Jordan Peterson
2:04:44 - Viruses
2:07:52 - WallStreetBets and Robinhood
2:15:55 - Advice for young people
2:17:45 - Human condition
2:20:14 - Fear is a cage
2:25:04 - Love
2:31:27 - Regrets

SOCIAL:
- Twitter: https://twitter.com/lexfridman
- LinkedIn: https://www.linkedin.com/in/lexfridman
- Facebook: https://www.facebook.com/LexFridmanPage
- Instagram: https://www.instagram.com/lexfridman
- Medium: https://medium.com/@lexfridman
- Reddit: https://reddit.com/r/lexfridman
- Support on Patreon: https://www.patreon.com/lexfridman
HN Theater Rankings

Hacker News Stories and Comments

All the comments and stories posted to Hacker News that reference this video.
Something I have taken to doing these days is playing some mindless but fun game while listening to long-form interviews or talks.

As a random example, these days I'm playing Slipways[1], but Diablo-style games or factory/builder games are also suitable.

Meanwhile I like to listen to fantastically insightful interviews with people like Julia Ioffe. You can watch a thousand 1-minute news clips and not gain as much understanding about Putin and the war in Ukraine as from a one-hour interview with her. Similarly, the Telegraph's "Ukraine the latest" is a roughly one-hour podcast I listen to every morning while taking the kid out for a walk. Perun's analysis of the logistics situation also tends to be spot on, and very insightful.

I used to listen to interesting characters on Joe Rogan, but Joe turned a bit... right wing nutjob. Lex Fridman is less crazy but also a less skilled interviewer. Still, he's got some stellar interviews like the one with Jim Killer[1]. Do you want to watch a soundbite from a politician in another country talking about something that will never affect you, or do you want to hear from the horse's mouth how your everyday life will change because of new technology?

I used to feel I didn't have time for this kind of thing, but overlapping it with gameplay makes it seem like zero time "spent" on it.

[1] https://www.youtube.com/watch?v=G4hL5Om4IJ4

Jul 30, 2021 · anonymouse008 on B-tree Path Hints
I'm not qualified to truly understand this, but when Lex first interviewed Jim Keller, Jim basically said regarding processor design -- 'yeah, if you just guess the same result as last time, you get a 50% speed increase.'

First Interview (where that poorly paraphrased quote resides): https://www.youtube.com/watch?v=Nb2tebYAaOA&t=13s

Second Interview: https://www.youtube.com/watch?v=G4hL5Om4IJ4

sitkack
The Weather Prediction Algorithm, weather will be the same as yesterday. Only wrong on transitions, very useful when you have runs of the same state. After that you implement a Markov Chain [1]

https://en.wikipedia.org/wiki/Markov_chain

May 04, 2021 · joakleaf on Efficiency Is the Enemy
I heard Jim Keller (the chip-designer) say this (or something similar) recently in a podcast with Lex Fridman.

It is at the 24.40 mark in "Jim Keller: The Future of Computing, AI, Life, and Consciousness | Lex Fridman Podcast"

https://youtu.be/G4hL5Om4IJ4?t=1480

"So there is a graph. Y-axis is productivity. X-axis at 0 is chaos and infinity is complete order. As you improve order, you increase productivity. And at some point productivity peaks, and it goes down again. Too much order -- Nothing can happen... Once you start moving towards order, the force vector that drives you towards order is unstoppable."

biomcgary
I would extend your point to say that any system with infinite chaos or infinite order necessarily lacks information about the world. Any system encoding information about reality necessarily looks like a mix of chaos and order. Unfortunately, any system that perfectly encodes / decodes information about reality has to be more complicated than reality itself.
Xunjin
Holy Molly, loved this point of view, really makes sense.

Ty for the reference :)

josephg
Yes. At complete chaos you can't see the world, because of information overload. And with complete order, you're no longer acting in response to the world. You're only acting in response to the order you've created. (In practice, models, metrics and beliefs). And at some point that can become self reinforcing if you don't ground your choices out by talking to real humans in the real world.

This happens all the time with ideology. If you get too steeped in any particular ideology, you no longer react to the world. You're only reacting to the ideology. (Or the world framed through the ideology). You see this all the time in the blockchain world. So much effort is going into making software and tools that nobody outside of the blockchain world wants or cares about; because it only makes sense from the perspective of other blockchain stuff. And of course, it happens all the time with twitter style politics.

"We have a problem! How do I solve it?" "Make the metrics go up! Use a blockchain! Acknowledge your privilege!" "Wait! I haven't told you what my problem is yet!"

There's a great quote from Bill Clinton: "The problem with any ideology is that it gives the answer before you look at the evidence."

Karrot_Kream
> There's a great quote from Bill Clinton: "The problem with any ideology is that it gives the answer before you look at the evidence."

Great quote, thanks!

Mar 21, 2021 · 2 points, 0 comments · submitted by tosh
Per Jim Keller, current source of speed in CPU is better branch prediction and data fetching prediction. It is possible C++ (or some other lang) may have more met information to drive these better, in which case it will be faster than C/assembler.

https://www.youtube.com/watch?v=G4hL5Om4IJ4

Feb 21, 2021 · 3 points, 1 comments · submitted by andy_ppp
andy_ppp
The possibilities presented in the podcast and the wisdom is just jaw dropping. Infinite fun and a highly recommended listen.
Feb 20, 2021 · 2 points, 0 comments · submitted by tosh
Feb 19, 2021 · 2 points, 1 comments · submitted by AlchemistCamp
AlchemistCamp
A part about "bad" designs regularly winning both in software and in hardware: https://youtu.be/G4hL5Om4IJ4?t=556

Jim Keller's thoughts of the relationship between productivity and chaos: https://youtu.be/G4hL5Om4IJ4?t=1468

His father's later years: https://youtu.be/G4hL5Om4IJ4?t=1726

The fast and slow versions of Moore's Law: https://www.youtube.com/watch?v=G4hL5Om4IJ4&t=2572s

On Chris Lattner and Swift: https://youtu.be/G4hL5Om4IJ4?t=3961

AlchemistCamp
A part about "bad" designs regularly winning both in software and in hardware: https://youtu.be/G4hL5Om4IJ4?t=556

Jim Keller's thoughts of the relationship between productivity and chaos: https://youtu.be/G4hL5Om4IJ4?t=1468

His father's later years: https://youtu.be/G4hL5Om4IJ4?t=1726

AlchemistCamp
A part about "bad" designs regularly winning both in software and in hardware: https://youtu.be/G4hL5Om4IJ4?t=556

Jim Keller's thoughts of the relationship between productivity and chaos: https://youtu.be/G4hL5Om4IJ4?t=1468

His father's later years: https://youtu.be/G4hL5Om4IJ4?t=1726

The fast and slow versions of Moore's Law: https://www.youtube.com/watch?v=G4hL5Om4IJ4&t=2572s

On Chris Lattner and Swift: https://youtu.be/G4hL5Om4IJ4?t=3961

Do you dream? https://youtu.be/G4hL5Om4IJ4?t=6114

Advice to young people: https://www.youtube.com/watch?v=G4hL5Om4IJ4&t=8155s

Feb 19, 2021 · 4 points, 0 comments · submitted by tdudzik
Feb 18, 2021 · 19 points, 1 comments · submitted by tmfi
ncmncm
Money quote: "I dug ditches. I was good at it."

Any sort of craftsmanship, even ditch-digging, is a source of deep satisfaction. So, carefully choose crafts that yield significant results, in your life or in the world.

Feb 18, 2021 · 12 points, 2 comments · submitted by davidivadavid
gabrielsroka
> audio

And video.

davidivadavid
Yeah, HN automatically edited [Video Podcast] to [audio].
HN Theater is an independent project and is not operated by Y Combinator or any of the video hosting platforms linked to on this site.
~ yaj@
;laksdfhjdhksalkfj more things
yahnd.com ~ Privacy Policy ~
Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.