Deep Reinforcement Learning: Pong from Pixels
Source
- Source kind:
blog-rss-item - URL: http://karpathy.github.io/2016/05/31/rl/
- Discovery source: https://karpathy.github.io/feed.xml
- License:
NOASSERTION - Distribution policy:
public-summary-local-archive-only - Public mirror status:
summary-only - Content hash:
ed7a9fb85f1d517c5033290caa7689a6854f48ac56f0384b10f29d40dc7de658 - First seen: 2026-05-15
- Last changed: 2026-05-15
Classification
- Primary category: Personal heuristics / AI philosophy / learning advice
- Corpus source note: 2026-05-15-karpathy-public-corpus
- Project taxonomy: karpathy-project-taxonomy
- Idea map: karpathy-idea-map
- Topic hub: karpathy-public-work
Summary
— This is a long overdue blog post on Reinforcement Learning (RL). RL is hot! You may have noticed that computers can now automatically learn to play ATARI games (from raw game pixels!), they are beating world champions at Go , simulated quadrupeds are learning to run and leap , and robots are learning how to perform complex manipulation tasks that defy explicit programming. It turns out that all of these advances fall under the umbrella of RL research. I also became interested in RL myself over the last ~year: I worked through Richard Suttonâs book , read through David Silverâs course , watched John Schulmannâs lectures , wrote an RL library in Javascript , over the summer interned at DeepMind working i…
What This Teaches
- How Karpathy frames technical judgment, learning, research, or AI systems in long-form prose.
- Useful as a high-signal idea source for research taste, project framing, and agent workflow design.
Why It Matters
Karpathy’s posts often crystallize reusable heuristics; this wiki should preserve the ideas without relying on chat memory.
Public Handling Notes
- EXTRACTED: This page records public metadata and a source-grounded summary.
- INFERRED: Full local preservation, when available, is for private/local use unless a license or explicit source policy makes public redistribution safe.
- Do not treat this page as permission to republish unlicensed source text or code wholesale.