OpenAI will begin training models on Daybreak Blue session data starting November 29
OpenAI emailed members of the Trusted Access program to confirm that starting November 29 it will use Daybreak Blue session data to train models; previously, this type of data would not be used for training even if the "improve the model for everyone" setting was turned off. After the news sparked backlash, OpenAI sent a second email promising to provide a separate opt-out option, and interactions flagged in security reviews can still be used for security purposes. Researchers worry this will repeat the Buckmaster-Alpöge incident, in which two mathematicians uploaded drafts of Navier-Stokes equations to OpenAI's Codex, and OpenAI subsequently produced its own proof but denied using their input for training.
Why read this
AI score 67
OpenAI is bringing Daybreak Blue session data, which was previously not used for training, into training, and has promised a separate opt-out option, so readers can understand the changes in the boundaries of data use.
Topics
Body
Starting November 29, OpenAI will use Daybreak Blue session data to train its models. An email to Trusted Access program members confirmed the change. Previously, this data was excluded from training, even when users had the "improve the model for everyone" setting turned off. Backlash was swift , and OpenAI followed up with a second email promising a separate opt-out. Interactions flagged during safety reviews can still be used for safety purposes.
The change has researchers worried about a repeat of the Buckmaster-Alpöge case . Mathematicians Tristan Buckmaster and Levent Alpöge uploaded Navier-Stokes equation drafts to OpenAI's Codex. OpenAI soon presented its own proof but denied using their inputs for training. But the suspicion alone was enough to show researchers what could go wrong .