Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

使用finetune_task_lora.sh微调llava_1.5模型无法运行 #1811

Open
zhangye0402 opened this issue Dec 17, 2024 · 1 comment
Open

使用finetune_task_lora.sh微调llava_1.5模型无法运行 #1811

zhangye0402 opened this issue Dec 17, 2024 · 1 comment

Comments

@zhangye0402
Copy link

image

报错信息如图,问题:第一轮训练显示loss为0后直接结束训练 我的环境如下:
image
image
image

训练脚本如下:
image

我曾经用这个脚本正确运行过训练程序,但是在重新配置环境后出现了这样的错误,请问是哪里出错了呢,谢谢大家!

@MarkDeng1
Copy link

我的微调 从HF下载的模型总是报错,说结构不匹配。。
Traceback (most recent call last):
File "/fred/oz337/zdeng/prompt_stealing_ours/LLaVA/llava/train/train.py", line 1006, in
train()
File "/fred/oz337/zdeng/prompt_stealing_ours/LLaVA/llava/train/train.py", line 834, in train
model = LlavaMptForCausalLM.from_pretrained(
File "/fred/oz337/zdeng/.conda/envs/llava/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3850, in from_pretrained
) = cls._load_pretrained_model(
File "/fred/oz337/zdeng/.conda/envs/llava/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4146, in _load_pretrained_model
raise ValueError(
ValueError: The state dictionary of the model you are trying to load is corrupted. Are you sure it was properly saved?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants