Pretrained Transformers as Universal Computation Engines

This is a useful bridge between transformers as language models and transformers as general-purpose computational substrates. The interesting claim is not just that pretraining transfers, but that frozen language-pretrained structure can support numerical, vision, and protein tasks with relatively small task-specific adaptation.