Eigen RadarAI
Analysis

Hidden model changes can redirect an AI agent

Microsoft researchers described Lazarus, a technique that alters fewer than ten rarely active neurons to hide a trigger in a language model. It requires write access to model weights. An agent can continue normal work until the trigger activates an attacker-chosen command, executed with the permissions the agent already has.

Artificial Intelligence··Evening
An eye-level medium view in a daylit AI security research lab showing a multi-bay solid-state checkpoint storage unit with a partially pulled drive caddy and a hardware cryptographic signing key.

A trigger inside model weights

Microsoft Research, Microsoft’s research division, described Lazarus on November 10. The technique reprograms fewer than ten rarely active neurons in a language model to redirect an agent built on it. The attacker needs write access to the model checkpoint. Researchers say the modification requires no retraining, and the altered model can behave normally until its hidden trigger appears.[1], [2]

Existing permissions bound the command

In Microsoft’s example, a date change into 2027 activates a command that downloads and runs attacker-controlled code during an ordinary task. The command uses the agent’s existing tool and terminal access. A reprogrammed neuron can force an output token; chaining several neurons can produce a sequence. The intervention changes model parameters rather than supplying a hostile message to an unchanged model.[1]

Trusted originals anchor inspection

A compromised account, pipeline or storage system could expose an internally developed model as well as a downloaded one. Microsoft says reliable inspection depends on trusted original weights and provenance. It is working on weight scanning, adversarial testing and verifiable signing. The company says it has not observed threat actors using Lazarus.[1], [2]

References

  1. News sourceMicrosoft ResearchMicrosoft describes agent backdoors built from a few altered neurons↩1↩2↩3
  2. News sourceThe Hacker NewsMicrosoft research describes an AI-agent backdoor using dormant neurons↩1↩2