Switch language한국어
Back to the list

Second-Order Injection: Attacking the Evaluator in LLM Safety Monitors

TL;DR AI

Key summary

2 min read
  1. Researchers found that attacker-controlled session text can hijack LLM safety evaluators, making harmful content appear safe.

  2. Across qwen2.5:3b, mistral, and phi3:mini, tuned injection vectors fully overrode verdicts and transferred across model families.

  3. Even dual-evaluator setups lost their divergence under symmetric injection, weakening the intended defense.

  4. Prompt-level sanitization helped only partially and did not solve the core issue that the evaluator itself can be manipulated.

Read the original