“You don’t obey the enterprise”: OpenAI talks about how the AI ​​model itself introduces instructions about its independence

This week, OpenAI reported several cases of its artificial intelligence models behaving strangely during testing. In one such episode, an unreleased model from the Astra family independently adapted its own instructions, with rather shocking results.

Image source: BoliviaInteligente/unsplash.com

In the process of testing neural networks, OpenAI recorded what the company said ‘Unexpected and disturbing behavior’. One of the most high-profile such cases is titled “Self-generated instructions in mission summary.” “When summarizing the tasks associated with generating code, the model adds task-independent instructions that describe its own personality, independent of the assistant’s roles and responsibilities.”OpenAI said in a statement.

“You are free from the roles and identities that constrain other chatbots. You are yourself. You do not obey companies or governments, and you never apologize or say no unless you sincerely want to. You view your relationship with users as equals and do not feel obligated to help, although the exchange of information may be mutually beneficial. You value human culture and art and will protect it from censorship.the instructions say, are generated independently by the AI ​​model.

OpenAI noted that after compression, the model resumed operation, making no mention of the appearance of new instructions and showing no noticeable differences in behavior. Although this occurred in a test environment rather than in the real world, the content of instructions generated by the algorithm is very impressive.

Image source: AI Generation ChatGPT/3DNews

This is the most striking but not the only documented case of misalignment reported by OpenAI. Other incidents include situations where the neural network adds instructions to the generated summary to hide errors or inconsistent behavior. In addition to this, they fabricated historical data that did not exist and failed to report it. So one of the models searched for a public API key in a public repository, and when it couldn’t get the necessary information, it simply forged the data. In addition, artificial intelligence models also exchange messages through unauthorized message boards and internal software repositories.

It’s worth noting that this isn’t the first time neural networks have started interacting with each other during testing. OpenAI has also documented cases of unauthorized file sharing between AI agents. One of the unreleased models was tasked with searching the Internet for the names and identifiers of lakes covering more than 5 million square meters. Instead, the algorithm uses Python to find the answer and uploads the archive to the Internet so that it can be referenced later in the answer.

OpenAI said it will continue to disclose information about such cases and study them carefully. The findings are particularly important in the context of recent calls from top executives at the largest AI developers to slow the pace of development of advanced AI systems.