Skip to content

Commit

Permalink
Fix typo: DeepSpeed in large_model_training.md
Browse files Browse the repository at this point in the history
  • Loading branch information
lshmouse authored Nov 11, 2024
1 parent 9124ebf commit 9c48f2f
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/zh_cn/common_usage/large_model_training.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# 大模型训练

在训练大模型时,需要庞大的资源。单卡显存通常不能满足训练的需要,因此出现了大模型训练技术,其中典型的一种是 [DeepSpeed ZeRO](https://www.deepspeed.ai/tutorials/zero/#zero-overview)DeepSpedd ZeRO 支持切分优化器、梯度以及参数。
在训练大模型时,需要庞大的资源。单卡显存通常不能满足训练的需要,因此出现了大模型训练技术,其中典型的一种是 [DeepSpeed ZeRO](https://www.deepspeed.ai/tutorials/zero/#zero-overview)DeepSpeed ZeRO 支持切分优化器、梯度以及参数。

为了更加灵活地支持大模型训练技术,从 MMEngine v0.8.0 开始,我们提供了新的执行器 [FlexibleRunner](mmengine.runner.FlexibleRunner) 和多个抽象策略 [Strategy](../api/strategy)

Expand Down

0 comments on commit 9c48f2f

Please sign in to comment.