Karpathy's Seven GitHub Repositories Trace a Large Model Learning Path
English text is being prepared.
Andrej Karpathy's 7 open-source repositories on GitHub have collectively received over 300,000 stars, forming in sequence a learning path from hand-written backpropagation to running autonomous research agents. Among them, micrograd demonstrates neural network differentiation with about 100 lines of Python code, while nanochat compresses a training task that cost over $40,000 in 2019 down to a few dozen dollars. The author notes that later-stage projects such as llm.c and autoresearch still require readers to understand memory scheduling and system logs on their own.
View original postKarpathy has just demonstrated what true individual super-productivity looks like. One person plus one Opus 5.5, in two hours, washed clean 43 million discussion records and directly built from scratch a complete, live video platform. Truly f***ing awesome—worthy of the god Karpathy!! And what does the future of full-stack development actually look like? I think Karpathy has already shown us—this is the answer, no rebuttals accepted haha. The background: Karpathy, the god of deep learning education and the godfather of Software 2.0, was fed up with YouTube's algorithm recommendations being all garbage clickbait titles. Over a weekend, he spent two hours having Claude scan 43 million Hacker News discussions from the past twenty years and built HackerTube, a website dedicated to hardcore long-form videos. The entire product has no login barrier, and even the thumbnails are extremely counterintuitive: instead of the exaggerated covers creators carefully design to induce clicks, it directly and forcibly grabs the frame from the exact middle of the video. The more than 6,400 hardcore videos repeatedly filtered and left behind by the geek community over twenty years have all been extracted into pure, high-density long-form content. This is f***ing literally a treasure trove for AI learning, holy crap. But even better than the website itself is his full development workflow. Throughout the entire process, he only did three miscellaneous things in the browser: applied for a YouTube API key on Google Cloud, rented a server, and bought a domain. After the server booted, he threw the IP address directly to Claude, said one sentence—go deploy, harden security, and optimize the code— and the AI did all the rest of the work. A complete launch project that previously required an engineering team to toil over for weeks or even months can now be fully accomplished by one person over breakfast with a few sentences of conversation. AI is no longer an auxiliary tool for writing code; it is completely the minimal productivity loop that compiles an individual's ideas directly into a usable service. Damn, truly awesome. The original project's experience URL, open-source data package, and deployment workflow are compiled in the first floor; take them if needed 👇
View original
Karpathy 刚刚示范了什么是真正的个人超级生产力, 一个人加一个 Opus 5.5,两个小时内把四千三百万条讨论数据洗完,并且直接从零搓出一个完整上线的视频平台,真他喵牛逼,不愧是卡神!! 而且未来的全栈开发到底长什么样?我觉得卡神已经给我们做了示范,这就是版本答案,不接受反驳hh, 背景是深度学习教育之神、Software 2.0 教父 Karpathy 嫌 YouTube 的算法推荐全是垃圾标题党,周末花了两个小时,让 Claude 扫完 Hacker News 二十年来四千三百万条讨论,搓出了一个专门看硬核长视频的网站 HackerTube。 整个产品没有任何登录门槛,连封面图都极其反直觉,它不要创作者精心诱导点击的浮夸封面,而是直接强制抓取视频正中间的那一帧画面。 二十年里极客社区反复筛选留下的六千四百多个硬核视频,全被提取成了纯粹的高密度长内容,这他喵的简直就是AI学习的宝藏啊卧槽, 但比这个网站更好用的是他的开发全流程, 整个过程他只在浏览器里做了三件杂事, 去谷歌云申请了一个 YouTube 的接口密钥, 租了一台服务器,买了个域名, 服务器开机之后,他把 IP 地址直接丢给 Claude, 说了一句去部署、加固安全并优化代码, AI 就把剩下的所有活全干完了。 以前一个需要工程师团队折腾几个星期甚至几个月的完整上线项目, 现在一个人在早餐时间靠几句对话就能全部搞定, AI已经不再是写代码的辅助工具了,完全就是把个人的想法直接编译成可用服务的最小生产力闭环,damn,真的牛逼, 原项目的体验地址、开源数据包和部署工作流整理在一楼,需要自取👇
Body
当世最强的AI大神Karpathy 在 GitHub 上留下的这 7 个仓库,可以说是全网含金量最高的免费 AI 学位了,
没有昂贵门票,没有商业营销,7 个精心打磨的GitHub代码仓库,是他留给这个时代最宝贵也最纯粹质朴的一份礼物!
看遍整个开源社区,能把大模型底层逻辑拆解得如此优雅纯粹的,大概只有 Andrej Karpathy 一人了,
这位深度学习之神,特斯拉智能驾驶教父在代码仓库里,悄悄给我们这些普通人备了一套顶级的硬核人工智能进阶路径。
7 个累计收获超过 30 万星标的开源项目,按顺序串起来,刚好是一条从零手写反向传播直到跑起自主科研智能体的完整路线。
普通人学大模型总以为得先啃完几千页晦涩的高数和论文,最后大多卡在复杂的环境配置与框架依赖里。
但这套代码的绝妙之处,是每一层都在精准拆掉上一代的黑盒: 第一步 micrograd,只用约 100 行干净的 Python 代码,把神经网络求导与学习的本质摊开给你看。
第二步 nn-zero-to-hero,配套完整讲座笔记,带你体验从单个神经元徒手搭到生成式模型的完整链路。
第三步 minbpe,剥开文本编码的底层外衣,带你弄懂所有现代大语言模型最开头的分词原理。
第四步 nanoGPT,全网最适合个人练手微调的小型框架,帮你彻底跑通自己的轻量化生成模型。
第五步 llm.c,直接抛弃厚重的深度学习框架,纯粹用 C 语言和图形处理器硬件指令硬核复现完整训练。
第六步 nanochat,把 2019 年需要花费四万多美元的训练任务,直接压缩到用几十美元就能跑完的完整闭环。
第七步 autoresearch,给代码配上能通宵自主试验、自动验证并迭代优化的研究型智能体。
能把这个链路顺着吃透的人,早就不需要再到处找所谓的提示词速成班了,底层的工业脉络已经全在你的代码库里了,
当然开源代码虽说开箱即用,但后半截涉及纯硬件指令和自主试验的项目,依然需要你真正沉下心去读懂显存调度与系统日志,代码免费不等于能省去动手调试的汗水。
真正拉开认知差距的从来不是你收藏了多少技术文章,而是你有没有亲手从第一行代码把那个模型给跑起来。