Skip to content

Support power of 2 scaling factors in float8 training and use e4m3 everywhere #7969

Support power of 2 scaling factors in float8 training and use e4m3 everywhere

Support power of 2 scaling factors in float8 training and use e4m3 everywhere #7969

test (CUDA 2.3, linux.g5.12xlarge.nvidia.gpu, torch==2.3.0, cuda, 12.1)  /  linux-job

succeeded Feb 9, 2025 in 31m 42s