New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

在优化器更新模型参数时会发生的崩溃现象 #2

Open

CaoAnda opened this issue Jan 13, 2025 · 0 comments

CaoAnda commented Jan 13, 2025

在复现实验的过程中，我遇到了一些问题，具体来说，在模型训练阶段，当优化器在反向传播后更新模型参数时（train/train.py, line 217），程序会崩溃。我已检查了梯度和模型参数，未发现溢出现象。不知您在实现过程中是否遇到过类似问题？如果有任何建议或解决方案，我将非常感激。

LoRAFlow/train/train.py

Line 217 in 74c3826

optim_manager.step()

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment