Stochastic Rounding in Low-Precision Transformer Inference: A Variable-Precision Emulation Study of a Small GPT-2

Stochastic Rounding in Low-Precision Transformer Inference: A Variable-Precision Emulation Study of a Small GPT-2. It centres on Inference, and also names GPT and Perplexity. Reported by arXiv. Bharat Hunt files it under AI Models and AI Research — the section covering a new or updated model, its capabilities, benchmarks or availability.

Written by Bharat Hunt from the headline and the coverage below. The original reporting is the source of truth.