Theme
Curated Resource List
In one sentence: a curated map of deep learning learning resources — six categories of courses, books, blogs, tool ecosystems, community conferences, and paper collections, each with a one-line description of who it's for and what it solves.
Timeliness note: Course info, tool versions, and other information are current as of 2026-08. Verify before citing. All external links point to public official websites.
Usage tips: Don't just bookmark and forget. Pick a main route from Learning Paths: Three Routes, complete one course, read one book in depth, and search blogs by topic. This focused approach yields far better results than casting a wide net.
1. Classic Courses
| Resource | One-line Description | Who It's For |
|---|---|---|
| Andrew Ng's Deep Learning Specialization (Coursera) | A five-course intro series: neural network fundamentals, tuning, CNNs, sequence models | Zero to beginner. Completing it prepares you for this handbook's concepts section |
| CS231n: Deep Learning for Computer Vision (Stanford) | The gold standard for vision, with excellent assignments (including hand-derived backprop) | Those wanting to go deep into vision. Pair with CNNs & Computer Vision |
| CS224n: Natural Language Processing with Deep Learning (Stanford) | A systematic NLP course from word embeddings to Transformers to large models | Must-watch for NLP/LLM tracks. Complement with Transformer Architecture |
| Andrej Karpathy: Neural Networks: Zero to Hero | A video series from hand-coding micrograd to GPT, exceptionally thorough | Hands-on learners who want to understand every line of code |
| UC Berkeley CS285: Deep Reinforcement Learning (Sergey Levine) | A complete course on deep reinforcement learning | Those wanting to systematically study RL. Pair with Deep Reinforcement Learning |
| Fast.ai: Practical Deep Learning for Coders | Code-first, pedagogically friendly — practice before theory | Those with Python basics who want to quickly start modeling |
2. Essential Books
| Book | One-line Description | Recommendation |
|---|---|---|
| Deep Learning (the "Deep Learning Book", Goodfellow, Bengio, Courville) | The "Bible" of deep learning — the most rigorous math foundations and theory chapters | Free online. Use as a reference — no need to read cover to cover |
| Dive into Deep Learning (D2L, Li Mu et al.) | An interactive textbook combining code + theory, with PyTorch/TF/JAX versions | Read deeply as a mainline. Complements this handbook's concepts section |
| Understanding Deep Learning (Simon J.D. Prince) | A 2023 rising-star textbook, heavily illustrated, intuition-first, covering LLMs and diffusion | A great all-around text for visual learners |
| Probabilistic Machine Learning (Kevin Murphy) | A comprehensive probabilistic view of ML, in two volumes | Advanced reference — tackle after building a solid math foundation |
| The Little Book of Deep Learning (François Fleuret) | A free ultra-condensed handbook, ~100 pages covering the full landscape | Quick way to build an overall framework |
3. High-Quality Blogs & Channels
| Channel | One-line Description |
|---|---|
| distill.pub | Interactive visualizations of papers/articles — explains intuition most elegantly. (Site is archived but content is timeless) |
| Lil'Log (Lilian Weng) | Systematic review blog by an OpenAI researcher. Excellent LLM and RL sections |
| Andrej Karpathy's Blog | Teaching-style deep learning blog. The language model intuition series is a classic |
| Jay Alammar | Author of "The Illustrated Transformer." Illustrates everything |
| The Gradient | A magazine-style media outlet for deep AI long-form articles |
| Inference: Research Blog (David Duvenaud et al.) | In-depth articles on probabilistic ML and generative models |
| colah's blog (Christopher Olah) | A pioneer blog in neural network visualization |
| Sebastian Raschka's Blog & Newsletter | PyTorch and LLM engineering practice, frequent updates |
| Jiqizhixin / PaperWeekly (Chinese channels) | Paper deep dives and industry updates for the Chinese-speaking community |
4. Tools & Ecosystems
| Tool | One-line Description | One-line Use Case |
|---|---|---|
| PyTorch | The dominant deep learning framework in both academia and industry | Main modeling framework. Tutorials: How to Choose Frameworks & Tools |
| Hugging Face Hub / Transformers | An open ecosystem for models, datasets, and inference | Download open-source models and datasets, fine-tune, and deploy |
| Weights & Biases (W&B) | Experiment tracking and visualization platform | Log metrics, compare experiments, collaborate with teams |
| JAX | A functional, auto-differentiable scientific computing framework | Frontier research, large-scale parallel training |
| ONNX Runtime | Cross-platform inference engine | Export models and deploy across devices. See MLOps & Model Deployment |
| vLLM | High-performance LLM inference serving framework | Low-latency, high-throughput LLM serving |
| MLflow | Open-source MLOps platform | Experiment logging, model registry, deployment management |
| Gradio | Rapidly build model demo UIs | Create visual demos for projects and share quickly |
5. Communities & Conferences
| Resource | One-line Description |
|---|---|
| NeurIPS / ICML / ICLR (Top Conferences) | The three top DL conferences. Official websites have free access to all past papers |
| Papers with Code | A unified search platform for papers + code + leaderboards |
| ArXiv (cs.LG, etc.) | The primary venue for pre-print papers. Use alongside Reading Discipline & FAQ |
| Kaggle | Data competitions and dataset community — a great place for hands-on practice |
| Hugging Face Community | Model sharing and discussion — the de facto standard community in the LLM era |
| Reddit r/MachineLearning | Active English-language community for paper discussion and industry talk |
| Chip Huyen (Blog / Newsletter) | Pragmatic and insightful writing on ML systems and engineering |
6. Paper Collections
| Resource | One-line Description |
|---|---|
| The Annotated Transformer (Harvard) | Line-by-line annotated Transformer implementation. Paper + code side by side |
| Attention Is All You Need (original paper) | The foundational Transformer paper. A must-read. See Classic Paper Deep Dives |
| labml.ai annotated paper implementations | Line-by-line PyTorch implementations of many classic papers |
| Papers with Code: SOTA Leaderboards | Entry point to the latest best methods for each task |
The "Too Many Resources" Trap
Learning resources are a classic example of "information-overload choice." Pick 1–2 items per category from this list and stick with them long-term: complete one course, read one book in depth, 1–2 blog posts per week, learn tools as needed. Breadth comes from the Paper Map and this handbook's case-studies section, not from your bookmark folder.
7. Suggested Learning Pace
The value of a resource list is in "selection," not "bookmarking." Below is a practical reference pace — you can also customize it based on the Learning Paths page:
- Weeks 1–2 (lay the foundation): Complete Andrew Ng's first two courses, or Karpathy's Zero to Hero first few videos; pair with this handbook's Neural Network Fundamentals and Backpropagation & Automatic Differentiation to solidify theory;
- Weeks 3–6 (hands-on): Complete 2–3 practical sections using D2L or Fast.ai, aiming to turn "reading tutorials" into "writing code." Use Lil'Log or Jay Alammar articles to build intuition along the way;
- Weeks 7–12 (go deep): Pick a direction (CV/NLP/Generative), follow a corresponding course (CS231n/CS224n), and read the must-read list from the Classic Paper Deep Dives page;
- Ongoing: 1–2 papers per week (find trending ones on Papers with Code), 1 blog deep-dive per month, learn tools as needed (start with PyTorch, add HuggingFace when you need to fine-tune).
Three principles for using resources
- Completing one course beats bookmarking five — switching midstream is the biggest time killer;
- Watching videos without hands-on practice guarantees forgetting within two weeks;
- Use this handbook as the skeleton — external resources fill in the "explain in detail," and this handbook provides the "connect everything." Combining both maximizes efficiency.
Further Reading
- Learning Paths: Three Routes — Resource and route matching recommendations
- Getting Started — The entry point and methods for paper reading
- Classic Paper Deep Dives — Must-read paper list
- How to Choose Frameworks & Tools — Tool selection methodology
- Datasets & Tool Archive — Where to find practice datasets
- Math Primer — Fill in math that courses don't cover