Knowledge Circuits

A mechanistic-interpretability method that isolates the computational subgraphs ("knowledge circuits") which store and express factual knowledge inside pretrained transformers (NeurIPS 2024) — a foundational technique underpinning newer knowledge-editing work. From ZJUNLP (Ningyu Zhang).