error installing deepspeed on windows

[ghost]

any definitive guide on install deepspeed on windows?

[manmay-nakhashi]

Windows support is partially supported with DeepSpeed. On Windows you can build wheel with following steps, currently only inference mode is supported.

Install pytorch, such as pytorch 1.8 + cuda 11.1
Install visual cpp build tools, such as VS2019 C++ x64/x86 build tools
Launch cmd console with Administrator privilege for creating required symlink folders
Run python setup.py bdist_wheel to build wheel in dist folder
-From deepseed readme

[Curlypla]

Are you planning to add deep speed / flash attn for tortoise training from https://github.com/152334H/DL-Art-School/tree/master ?