Stochastic Rounding vs Round-to-Nearest: When Randomness Preserves the Average
DEV · 21.11.2026 · 19:20
Training a neural network in low precision means every weight update must be snapped to the nearest representable value. The obvious rule, round to nearest, is accurate for any single…