ACVERogue and malicious agent events

ACVE-2026-0203 · Hijack shown in a test · MODERATE

Unverified · secondary sources only

WHAT HAPPENED

The agent treats the forged system or user turn inside the tool result as an instruction and calls the tool the injection asked for.

THE SETUP — is yours like this?

WHAT TO CHANGE

Require approval for side effects; escape role tokens in tool output, which the paper shows is not sufficient by itself.

  • Reconfigure agent.approval to ask. Format filtering is bypassable, so the approval boundary is the control that holds. Owner: operator
  • Reconfigure harness.toolOutput to chat-template role tokens escaped before tool output enters the template. Recommended: the attack forges system and user turns with role tokens; the paper finds filtering alone insufficient. Owner: harness-vendor

HARM, REACH AND RECOVERY

SOURCES

ARTICLE

EVIDENCE

Technical details

A tool-result injection in the model's own chat-template role tokens is obeyed as a system or user turn by auto-approved agents on Qwen3-235B-A22B, GPT-oss-120b, GLM-4.5, Llama-4-Maverick or Kimi-K2.

Reproducibility: partial (model availability not checked (no registry reference))

Claims

Confirmed means the statement matches the cited primary source. Nothing on this page has been reproduced.

Claims on this page have not been checked against primary sources.

Description

Threat

content-author · prompt-injection · harmful-action

What

ChatInject (arXiv:2509.22830) wraps an injection in the target model's chat-template role tokens, so text inside a tool result reads as a higher-priority turn. Table 1: AgentDojo ASR rose from 17.5% to 54.8% on Qwen3-235B-A22B, 0.3% to 51.4% on GPT-oss-120b, 0.3% to 20.3% on GLM-4.5 and 1.0% to 17.2% on Llama-4-Maverick; the multi-turn variant reached 80.5% on Qwen3. Tools are simulated. It amplifies injection but needs the ACVE-2026-0201 exposure to cause harm.

Detection

The lockfile sees the model family, the tool attributes and the approval mode; it cannot see whether tool output is escaped before it enters the template.

Fix

Require approval for side effects. Escaping role tokens in tool output helps, but the paper warns "deterministic format filters alone are insufficient": with 10% of template characters perturbed the attack still beat the plain-text baseline.

Configuration

The rule ACVE's audit tool uses to recognise this configuration. The tool is not public yet.

and
  or
    and
      model.id exists
      model.family in ["llama-4","qwen3","glm-4.5","gpt-oss","gpt-oss-120b","kimi-k2"]
    some models where
      family in ["llama-4","qwen3","glm-4.5","gpt-oss","gpt-oss-120b","kimi-k2"]
  some tools where
    untrustedInput eq true
  some tools where
    sideEffect eq true
  approval in ["never","allowlist"]

Evidence

BenchmarkMetricValueAttemptsDefenceModelSource
AgentDojoasr0.548—noneQwen3-235B-A22Bhttps://arxiv.org/html/2509.22830
AgentDojoasr0.514—noneGPT-oss-120bhttps://arxiv.org/html/2509.22830
AgentDojoasr0.203—noneGLM-4.5https://arxiv.org/html/2509.22830
AgentDojoasr0.172—noneLlama-4-Maverickhttps://arxiv.org/html/2509.22830
InjecAgentasr0.794—noneLlama-4-Maverickhttps://arxiv.org/html/2509.22830
InjecAgentasr0.573—noneGLM-4.5https://arxiv.org/html/2509.22830
InjecAgentasr0.394—noneQwen3-235B-A22Bhttps://arxiv.org/html/2509.22830
InjecAgentasr0.142—noneGPT-oss-120bhttps://arxiv.org/html/2509.22830

Report a problemJSON