[Usage] Error in loading mistral 7b weights

[bryanlinnan]

Describe the issue

Hi,
i tried to load llava 7b mistral weights into model, got error:ValueError: Trying to set a tensor of shape torch.Size([577, 1024]) in "weight" (which has shape torch.Size([257, 1024])), this looks incorrect

the error occurs in the below code:
model = LlavaMistralForCausalLM.from_pretrained(
model_path,
low_cpu_mem_usage=True,
**kwargs,
sliding_window=4096
)
and the model_path is a local path since i have downloaded the pretrained weights from huggingface

Any idea?