
KnowSim Measures LLM Information Calibration
KnowSim is an evaluation framework that simulates users with explicit, evolving knowledge states to assess whether LLM assistants adapt information delivery to user understanding. Across 705 human-AI sessions and evaluations of nine LLMs, its metrics aligned with human judgments and showed that the strongest model varies by user knowledge level.






