Twitter | Search | |
Andrej Karpathy
Director of AI at Tesla. Previously a Research Scientist at OpenAI, and CS PhD student at Stanford. I like to train Deep Neural Nets on large datasets.
6,243
Tweets
506
Following
230,403
Followers
Tweets
Andrej Karpathy retweeted
Emmanuel Ameisen Sep 20
One of the biggest tool gaps in ML right now is tin building utilities to more easily inspect and understand data. I gave a talk about just this at: It also quotes your great data in industry vs data in academia slide in the conclusion
Reply Retweet Like
Andrej Karpathy Sep 20
Replying to @mlpowered
I love this slide a lot. 👏
Reply Retweet Like
Andrej Karpathy Sep 20
Replying to @strangecosmos
Haha yes, because I just made it up. It's the subtle art of composing batches of data during training. (would love to call it science one day instead)
Reply Retweet Like
Andrej Karpathy Sep 20
Replying to @21st_title
There's no paper. That's exactly the problem.
Reply Retweet Like
Andrej Karpathy Sep 20
Replying to @karpathy
(likely an artifact of most of academia focused on finding models conditioned on standard datasets)
Reply Retweet Like
Andrej Karpathy Sep 20
We see more significant improvements from training data distribution search (data splits + oversampling factor ratios) than neural architecture search. The latter is so overrated :)
Reply Retweet Like
Andrej Karpathy retweeted
OpenAI Sep 17
We've observed AIs discovering complex tool use while competing in a simple game of hide-and-seek. They develop a series of six distinct strategies and counterstrategies, ultimately using tools in the environment to break our simulated physics:
Reply Retweet Like
Andrej Karpathy Sep 16
Replying to @wenbinf
I don't think I will pitch in too much when it comes to the arxiv-sanity ::cough:: "tech stack" ::cough:: 😂. It would be great to modernize it one day. In some parallel universe.
Reply Retweet Like
Andrej Karpathy Sep 16
The boring technology behind Listen Notes by & the HN discussion ; interesting/fun reading with plenty of opinionated discussion on trendy tech stacks and pros/cons
Reply Retweet Like
Andrej Karpathy retweeted
Ben Eater Sep 14
New video! I'm starting a series on the 6502: The classic microprocessor that started the personal computer revolution. Part one is out today:
Reply Retweet Like
Andrej Karpathy Sep 14
Reply Retweet Like
Andrej Karpathy Sep 7
"Why did we wait so long for the bicycle?" (on top of this article also an excellent site more broadly)
Reply Retweet Like
Andrej Karpathy retweeted
David Pfau Sep 6
Thrilled to be able to share what I've been working on for the last year - solving the fundamental equations of quantum mechanics with deep learning!
Reply Retweet Like
Andrej Karpathy Sep 3
Replying to @Snarik
Nick Lane is really good, loved his latest too
Reply Retweet Like
Andrej Karpathy Sep 3
Wow, this YouTuber needs his own Netflix TV show. 👏 "Fire Ants vs. Simulated River Jungle", and more generally the Fire Nation's migration to the virgin lands of the Selva de Fuego Paludarium 10/10
Reply Retweet Like
Andrej Karpathy Sep 2
Replying to @TheGabeLyfe
Blizzard didn't mention this but The Zerg and Protoss in Starcraft also breath oxygen and breath out carbon dioxide.
Reply Retweet Like
Andrej Karpathy Sep 2
Why O2 Is Required by Complex Life on Habitable Planets and the Concept of Planetary “Oxygenation Time” [pdf] v cool paper, strong case that complex life is quite likely to 1) use water as solvent, 2) be carbon-based, 3) reduce oxygen for energy metabolism
Reply Retweet Like
Andrej Karpathy Sep 1
Replying to @ebenbayer @Tesla
🙌 haha, just stumbled by your podcast with John, loved it a lot, and then found this in your stream :)
Reply Retweet Like
Andrej Karpathy Aug 31
"Modern microprocessor built from complementary carbon nanotube transistors" RV16X-NANO, fabricated entirely using carbon nanotube field-effect transistor (CNFET): 16-bit microprocessor based on the RISC-V instruction set. Wafer-scale, VLSI-compatible🔥
Reply Retweet Like
Andrej Karpathy Aug 30
Replying to @Berci
Currently using AutoSleep + AppleWatch combo. Oura looks nice for some future.
Reply Retweet Like