Distributed Deep Learning 101: Introduction

분산 학습이란? - Azure Machine Learning

Intro to Distributed Deep Learning Systems

ZeRO & DeepSpeed: New system optimizations enable training models with over 100 billion parameters - Microsoft Research

DeepSpeed

Turing-NLG: A 17-billion-parameter language model by Microsoft - Microsoft Research

Log in or sign up to view

Introduction to Parallel Computing Tutorial

[DL] Distributed Training (분산 학습) 이란?

DBpia

Feature Overview

[AI_Network_Lab_인사이트(2021-4호]엣지_컴퓨팅을_위한_분산_AI학습_구조 (1).pdf

[러닝 텐서플로]Chap09 - 분산 텐서플로

torchgpipe