NVIDIA tests lower-precision arithmetic for interatomic models
NVIDIA researchers and a collaborator at EPFL examined numerical methods for a machine-learning model of atomic interactions. Their technical study pairs matrix arithmetic with checks on forces, energy conservation and structural relaxation. It evaluates particular workloads and hardware methods, with physical behavior considered alongside runtime in the authors’ own experiments.
Artificial Intelligence··Morning
Atomic models meet matrix arithmetic
NVIDIA researchers examined lower-precision matrix arithmetic in the Point Edge Transformer, a machine-learning model that estimates interactions between atoms. Their technical work studies numerical methods for Tensor Cores, specialized computing units in NVIDIA chips. It tests the methods against physical behavior as well as measuring the time needed to run the calculations.[1], [2]
Partial calculations retain a common output format
The approach divides a matrix product into several lower-precision calculations, then combines them in a single-precision floating-point format. Input, weight and output formats stay unchanged, and the model does not require retraining. The authors examine separate methods for Blackwell and Ampere, two NVIDIA chip architectures. Their experiments include small and large versions of the model and different sizes of water systems.[1]
Energy and structural relaxation are checked
The authors examine whether a water simulation conserves total energy and whether an alloy reaches the target force tolerance during structural relaxation. They also compare predicted energy, forces and stress with the baseline calculation. These tests belong to the authors’ own technical evaluation. Model size and work outside matrix multiplication are among the factors the study identifies as affecting overall runtime.[1]
Related columns
For more information on this topic, you can read the related columns.