Goodfire 在 Evo 2 中发现生命之树:系统发育被编码为弯曲流形上的几何距离
Goodfire Research 发现,DNA 基础模型 Evo 2 将物种间的系统发育关系以几何方式编码在一条弯曲流形上的距离中,这是目前在基础模型中发现的最复杂流形案例之一。研究基于 Genome Taxonomy Database(GTDB)中 2400+ 个细菌物种的系统发育树,结果支持特征流形通常具有主导的平坦表示加上更高曲率偏差的图景。
R. et al. Nature 620, 1089–1100 (2023). [DOI], disease prediction [3]A catalogue of genetic mutations to help pinpoint the cause of diseases Žiga Avsec and Jun Cheng, 2023. Google DeepMind Blog. [link], and materials discovery [4]Millions of new materials discovered with deep learning Amil Merchant and Ekin Doğuş Çubuk, 2023. Google DeepMind Blog. [link]. These models have several qualities which make interpretability - the science of understanding their internal representations and mechanisms -
匹配字段正文