Skip to content

fix(megatron): shard Megatron rollouts across DP coordinator leaders - #3571

Draft
YigongQin wants to merge 1 commit into
NVIDIA-NeMo:mainfrom
YigongQin:yigongq/m-infdp
Draft

fix(megatron): shard Megatron rollouts across DP coordinator leaders#3571
YigongQin wants to merge 1 commit into
NVIDIA-NeMo:mainfrom
YigongQin:yigongq/m-infdp