Descript 如何让 AI 智能体 Underlord 学会“看”视频
Descript 为 AI 编辑智能体 Underlord 加入媒体理解能力,让它能直接“看”视频画面,而不只依赖转录文本。团队把视频拆成帧交给多模态模型描述,再拼接成可检索文件,从而按画面内容定位片段,例如“找一段 10 秒内有人咬苹果的镜头”。系统还针对屏幕录制、幻灯片和口播视频采用不同分辨率与抽帧策略,并用 Top K 评估检索准确率。
titch them together into like a big file, which you can literally just read,” he says. Imagine a movie script that says “between second zero and second 15 a character is riding a dragon." Now you can ask your video editing agent to "find me a 15 second clip where a girl is riding a dragon" and get an answer in seconds instead of spending an hour scrubbing through footage. The art of making AI predictable One of the trickiest challenges was making the system feel reliable despite AI's inherently
匹配字段正文


