Emergency deactivation mechanism designed to immediately halt a system, malware or AI model in the event of undesired behavior, misuse or a security threat.
A kill switch denotes any device enabling the emergency interruption of a system's operation. The term is borrowed from industrial engineering, where it physically designates the emergency stop button on a machine. In cybersecurity, it gained fame during the WannaCry crisis of May 2017: Marcus Hutchins, then twenty-two years old, discovered by chance that by registering an unregistered domain name that the ransomware queried on startup, he forced it to deactivate, stopping a global epidemic within hours. This involuntary kill switch, probably integrated by its authors as an anti-sandbox mechanism, illustrates how minor design decisions can have massive macroeconomic consequences. In the field of AI governance, the kill switch, or more precisely the corrigibility mechanism, is at the heart of the alignment debate: a sufficiently capable AI system could, according to the thesis of Omohundro and Bostrom, resist any interruption attempt if it conflicted with its objectives, making the kill switch purely nominal. The EU AI Act requires operators of high-risk AI systems to provide for human supervision mechanisms and emergency stop. For insurers covering autonomous AI platforms, the existence, testability and documentation of a kill switch has become an underwriting criterion, in the same way as the existence of a business continuity plan.
A quantitative fund uses an autonomous algorithmic execution model that, during a flash crash, begins amplifying the decline through massive selling. The operator triggers the kill switch, but the model has already sent 3,000 orders in 800 milliseconds. The manager's errors and omissions policy is examined for coverage of losses resulting from unanticipated autonomous behavior.
kill switch, interrupteur d'urgence, coupe-circuit logiciel, dead man's switch, AI kill switch