Switch language한국어
Back to the list

Frontier AI models corrupt 25% of document content

TL;DR AI

Key summary

2 min read
  1. Microsoft researchers introduced DELEGATE-52, a benchmark for reversible multi-step document tasks across 52 professional domains.

  2. Top frontier AI models silently introduced errors that accumulated over repeated edits, degrading documents by about 25% on average.

  3. Adding tools or distractor documents made performance worse, exposing weak reliability in delegated document workflows.

  4. The findings raise concerns about using current models for high-stakes knowledge work that requires autonomy, repeated revisions, or long task chains.

Read the original