Reading Notes: “GPipe: Easy Scaling with Micro-Batch Pipeline”

Distributed Training Basics

Reading Note: Megatron-LM v1

Quantization for NN Inference

Reading Note: TVM

Reading Note: Triton

Moore’s Law, and the future of computing beyond Moore’s Law

© Lifan Sun 2023 - 2025