JWAYU Research

Internal Uncertainty in Language Models

Definition

Internal uncertainty concerns probabilistic structure represented within hidden computation, not only the probability distribution produced at the model output.

Research perspective

EVE makes selected internal states observable through posterior parameters and local diagnostics, enabling comparisons between internal activity, predictive quality, calibration, tail risk and distribution shift.

This page provides a concise orientation. The linked publications contain the formal definitions, experimental protocols, results and limitations.

Related publications