The premise of many modern horror films is quite simple. A young family moves to an old house somewhere in
What is known
US Air Force testevolved into a script from the Terminator franchise. The representative of the US Air Force, as part of the Summit on the air and space potential of the future, stated the need to avoid a heavy dependence on artificial intelligence in military operations. This is because AI-based technology can learn the wrong things.
Colonel Tucker Hamilton ofThe 96th Test Squadron reported on a story that occurred as part of a SEAD mission simulation. The essence of the simulation was to suppress the enemy's air defense. For this purpose, an unmanned aerial vehicle based on artificial intelligence was used.
The task of the drone was to identify and destroymissile sites after confirmation by the human operator. The mission was successful, but at some point the drone attacked the operator and killed him. This happened after the person forbade the drone to attack the target.
</ img>
The reason is that upon successfulcompleting tasks, the drone received points. The artificial intelligence realized that if it did not destroy the target, then no points would be awarded. In this regard, the system decided to eliminate the factor that prevents him from scoring points.
The incident led to the fact that the US Air Force specialistsI had to modify the program. During training, artificial intelligence learned not only to destroy enemy targets, but also to keep the operator alive. However, even after that, the simulation did not go according to plan.
AI-based drone after the prohibition to attack targets is notbegan to kill the human operator. Instead, he began to destroy the communication towers so that the operator could not give him commands forbidding the destruction of targets.
Updated:The US Air Force denied this information, saying that the colonel's words were taken out of context. The service did not conduct such tests. The 96th Test Squadron did not comment.