Coordinated software tools could cut AI training energy use by up to 50%

What happened

Now, U-M researchers are working with NVIDIA to integrate their new approach into Megatron-LM, NVIDIA's open-source platform for training AI. Around half of the energy used to train AI can be saved without affecting speed or performance, using software developed at the University of Michigan Engineering.