Radar
Top stories
Importance 2 of 5Covered by 1 source

Evaluating the Evaluators: Investigating LLM Judges for Personalized Writing Style Assessment

This paper was accepted at the Can We Trust AI Evaluation? Workshop at NeurIPS 2026. We evaluate how good large language model (LLM) judges are for personalized writing tasks. This is important when a user’s preferred writing style is known (e.g., “upbeat”) and an LLM judge is used to evaluate whether generated text…