Skip to content

Issues: EricLBuehler/mistral.rs

Model Wishlist
#156 opened Apr 16, 2024 by EricLBuehler
Open 101
Tracking: Metal performance vs. MLX, llama.cpp
#903 opened Nov 10, 2024 by EricLBuehler
Open 6
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

74 Open 233 Closed
74 Open 233 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

0.3.4 #1038 works on RTX 4070 but doesn't on GTX1650 4GB VRAM bug Something isn't working
#1043 opened Jan 9, 2025 by misureaudio
2
Speed benchmark comparasion result
#1031 opened Jan 7, 2025 by MonolithFoundation
Can't run the example with metal bug Something isn't working
#1029 opened Jan 5, 2025 by feelingsonice
13
Any rust examples for completion models?
#1028 opened Jan 5, 2025 by kstavro
VLM Prompt Step Error with Pixel Values bug Something isn't working
#1025 opened Jan 2, 2025 by ayushgun
1
BitNet support new feature New feature or request optimization
#1013 opened Dec 28, 2024 by EricLBuehler
1
Model cannot terminate itself when running single GGUF/GGML model bug Something isn't working
#1012 opened Dec 28, 2024 by guoqingbao
OAI compat endpoint w/ Images? bug Something isn't working
#1008 opened Dec 27, 2024 by bioshazard
6
How do I finetune/train models with this? new feature New feature or request
#980 opened Dec 9, 2024 by Tameflame
[Feature Request] -- EfficientQAT (Omniquant Successor) and/or ISTA-DASLab Higgs Quant. Models/Formatting new feature New feature or request
#977 opened Dec 7, 2024 by BuildBackBuehler
1
create_ordering.py not supported with llama 3 loras bug Something isn't working
#976 opened Dec 7, 2024 by kkailaasa
1
KV Cache Quantization new feature New feature or request
#971 opened Dec 4, 2024 by dinerburger
7
fast-forward tokens with llguidance new feature New feature or request
#965 opened Dec 2, 2024 by mmoskal
parallel computation of mask in constrained sampling new feature New feature or request
#964 opened Dec 2, 2024 by mmoskal
rejection sampling for top_p etc bug Something isn't working
#963 opened Dec 2, 2024 by mmoskal
Possible problem with candle 0.8.0 - doesn't build on a GTX1650 (CI 75) nor a GTX1070 (CI 61) bug Something isn't working build Issues relating to building mistral.rs
#954 opened Dec 1, 2024 by misureaudio
4
Create and load standalone quantized UQFF models new feature New feature or request
#947 opened Nov 29, 2024 by FishiaT
6
DiffusionArchitecture not found in python package bug Something isn't working build Issues relating to building mistral.rs resolved
#943 opened Nov 28, 2024 by Manojbhat09
5
Flash Attention not building bug Something isn't working build Issues relating to building mistral.rs triaged This error has been reproduced or otherwise triaged.
#941 opened Nov 27, 2024 by Aveline67
13
Couldnt run any vision model bug Something isn't working
#935 opened Nov 26, 2024 by GraphicalDot
17
Error: Enable to run Lora - Adapter files are empty bug Something isn't working
#929 opened Nov 23, 2024 by kkailaasa
1
Confusion around loading a GGUF locally
#922 opened Nov 20, 2024 by mojadem
2
Speculative decoding support for mistralrs-server new feature New feature or request
#912 opened Nov 16, 2024 by PkmX
Tracking: Metal performance vs. MLX, llama.cpp optimization
#903 opened Nov 10, 2024 by EricLBuehler
6
Add gemma2 architecture support for GGUF models Additions to model or architectures new feature New feature or request
#901 opened Nov 9, 2024 by grpathak22
ProTip! Exclude everything labeled bug with -label:bug.