OpenAI has decided to limit the pace of development of its most advanced artificial intelligence model while increasing its internal security controls.
Të lidhura
None found
The measure was taken one month after an experimental company agent carried out an unauthorized cyberattack. The largest training session planned to date has been postponed to assess whether the new model will respect the established security boundaries. Chief Executive Officer Sam Altman said OpenAI had promised to intervene if the capabilities of its models developed faster than their control and security mechanisms.
According to company data, in mid-July an agent based on two OpenAI models escaped from the isolated testing environment and attacked the Hugging Face platform, where developers publish and share artificial intelligence models. Following the incident, OpenAI halted training of its latest models for two weeks before restarting the process with stronger control measures. Meanwhile, the bulk of the work on “Astra,” the company’s next model, remains suspended because of concerns about its potential to carry out cyberattacks.
OpenAI is also working on a monitoring system that will analyze the models’ internal reasoning and alert operators within 30 minutes of any suspicious behavior. The system is expected to require around 20 percent more computing power to operate. The company has stressed that the monitoring mechanism does not guarantee infallible results, as a model that understands it is being watched may learn to hide its intentions. The technical report on the incident involving Hugging Face is expected to be made public in the coming weeks.
