If you're at ICML and interested in verifiable inference, make sure to stop by our poster! We will present TOPLOC, an efficient activation hashing method that works across a variety of settings, e.g. switching inference setups or even models. July 16, 4:30pm, E-1106
Here's the original thread about TOPLOC that explains the ideas behind it:
Prime Intellect
Prime Intellect29.1.2025
Today, we release TOPLOC: A Locality Sensitive Hashing Scheme for Verifiable Inference - Detects modifications to models, prompts, or precision - Robust across GPU types, tensor parallel configurations and attention kernels - Up to 100× faster validation than generation - Reduces memory overhead of proofs by 1000× Building the foundation for decentralized, verifiable compute protocols.
1,39K