想问一下VLM3R是否支持deepspeed zero3训练

[array-svg]

感谢大佬的开源工作！我想用您内置的zero3脚本运行但是报错了，想问一下原本VLM3R是计划支持deepspeed zero3训练的吗？

[jzh15]

Hi, thanks a lot for your kind words and interest in our work!

In theory, VLM-3R should be compatible with DeepSpeed ZeRO-3, but we haven’t tested it ourselves since ZeRO-3 is typically slower than ZeRO-2 in our setup.

Could you please share the specific error message you encountered? I’d be happy to help you debug it.