概要
nnsight (pronounced 'insight') provides a unified interface to probe and modify the inner workings of PyTorch models, bridging the gap between small local experiments and massive scale inference. It allows researchers to trace computation graphs, save activations, and perform interventions like activation patching on models ranging from GPT-2 to Llama-3-405B. By leveraging the National Deep Inference Facility (NDIF), users can run complex mechanistic interpretability experiments on industrial-scale models without requiring high-end local GPU hardware, making advanced AI research accessible to everyone.
