DeepSpeed: Accelerating large-scale model inference and training via system optimizations and compression - Microsoft Research

Last month, the DeepSpeed Team announced ZeRO-Infinity, a step forward in training models with tens of trillions of parameters. In addition to creating optimizations for scale, our team strives to introduce features that also improve speed, cost, and usability. As the DeepSpeed optimization library evolves, we are listening to the growing DeepSpeed community to learn […]

DeepSpeed: Extreme-scale model training for everyone - Microsoft Research

OpenVINO™ Blog Joint Pruning, Quantization and Distillation for Efficient Inference of Transformers

AI, Free Full-Text

ZeRO-Infinity and DeepSpeed: Unlocking unprecedented model scale for deep learning training - Microsoft Research

LLM（十二）：DeepSpeed Inference 在LLM 推理上的优化探究- 知乎

TensorFlow to PyTorch for SLEAP: Is it Worth it?

the comparison of test and training time of benchmark network

A Fascinating Prisoner's Exploring Different Approaches To, 44% OFF

DeepSpeed: Extreme-scale model training for everyone - Microsoft Research