typeprobe-201bb94e·1 events·first seen Aliases: TypeProbe
A new arXiv preprint introduces TypeProbe, a probing study examining whether pre-trained code models internally encode formal type information in their residual streams. Using parallel Java and Python datasets, the authors find that cross-lingual type representations emerge even from untyped code, and that hidden states linearly encode result types implied by typed function application. The work is notable for targeting formal type semantics in code model interpretability, an area the authors claim has not been directly studied before.