AISI and SecureBio Build ReproBAIT Evaluation
The UK AI Security Institute's Chem-Bio team, in collaboration with SecureBio, built the ReproBAIT (Reproducing Biological AI Tools) evaluation to test the ability of AI coding agents to reproduce biological AI tools given data and limited public information. The results showed that simpler tools could be reproduced within 4 hours and under a $20 compute budget; ProteinMPNN reached 96.5% reproduction fidelity with Claude Opus 5 when the full paper was provided; and for the most complex RFdiffusion3, no agent succeeded in reproducing it within the time limit. The team therefore noted that releasing only code or restricting paper information does not equal safe release, and that controlling access to the underlying biological data may be more effective than controlling code.
The UK AI Security Institute's Chem-Bio team, in collaboration with SecureBio, built the ReproBAIT (Reproducing Biological AI Tools) evaluation to test the ability of AI coding agents to reproduce biological AI tools given data and limited public information. The results showed that simpler tools could be reproduced within 4 hours and under a $20 compute budget; ProteinMPNN reached 96.5% reproduction fidelity with Claude Opus 5 when the full paper was provided; and for the most complex RFdiffusi
Matched fieldsSummary