Switch language한국어
Back to the list

MORFES: A Benchmark for Productive Inflectional Competence in Modern Greek

TL;DR AI

Key summary

2 min read
  1. Researchers released MORFES, a 500-item benchmark for testing whether models can correctly recognize and generate Modern Greek inflected forms.

  2. The benchmark emphasizes lower-frequency lemmas to reduce memorization and better measure true morphological competence.

  3. Across several open-weight models, the newly released Sophea-Genesis-1 performed best on the morphology task.

  4. MORFES fills a gap left by fact-focused evaluations and offers a better way to assess grammatical ability in a highly inflected language.

Read the original