Skip to content

Pull requests: EricLBuehler/mistral.rs

New pull request New
42 Open 669 Closed
42 Open 669 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

paged-attn:cuda fallback bf16 for compute_cap < 8.0
#1040 opened Jan 8, 2025 by haricot Loading…
1
Refactor transformer implementations, unifying common components
#1030 opened Jan 6, 2025 by p-e-w • Draft
1
Revamp speculative decoding!
#1027 opened Jan 5, 2025 by EricLBuehler • Draft
7
Distributed inference with NCCL
#1017 opened Dec 31, 2024 by EricLBuehler Loading…
1
#1008: Working <|image|> injection
#1015 opened Dec 30, 2024 by bioshazard Loading…
1
New file format for imatrix: .cimatrix
#1004 opened Dec 25, 2024 by EricLBuehler Loading…
1
KV Cache Quantization new feature New feature or request
#988 opened Dec 11, 2024 by EricLBuehler Loading…
3 of 7 tasks
1
Fix panic in mistralrs-server
#981 opened Dec 9, 2024 by cdoko Loading…
1
Add BNB cuda gemv 4bit kernels
#970 opened Dec 4, 2024 by EricLBuehler Loading…
1
Bitsandbytes quantization ISQ support
#968 opened Dec 4, 2024 by EricLBuehler Loading…
1
Add Phi 3.5 MoE, Mixtral support for UQFF
#855 opened Oct 16, 2024 by EricLBuehler Loading…
1
Add a stresstest example
#844 opened Oct 12, 2024 by EricLBuehler Loading…
1
ADDED :- Badges in Readme
#840 opened Oct 11, 2024 by Ruhi14 Loading…
2
Docs update
#837 opened Oct 10, 2024 by FarukhS52 Loading…
1
Update README.md
#826 opened Oct 5, 2024 by kushal34712 Loading…
1
Update README.md
#825 opened Oct 5, 2024 by kushal34712 Loading…
1
Add ISQ support for FLUX
#817 opened Oct 2, 2024 by EricLBuehler Loading…
2
Integrate KBNF grammar
#815 opened Oct 2, 2024 by EricLBuehler Loading…
15
Return stop reason enum in responses breaking
#802 opened Sep 28, 2024 by EricLBuehler Loading…
1
Add Parler TTS models Additions to model or architectures new feature New feature or request
#791 opened Sep 25, 2024 by EricLBuehler Loading…
5 of 15 tasks
1
Add EXL2 Quantization
#782 opened Sep 19, 2024 by EricLBuehler Loading…
1
Reduce CPU usage when idle
#775 opened Sep 15, 2024 by scottwey Loading…
10
Add gguf gemma2 support
#726 opened Aug 29, 2024 by EricLBuehler Loading…
1
Remove unused deps
#725 opened Aug 28, 2024 by EricLBuehler Loading…
1
Initial KV RingAttention code
#684 opened Aug 14, 2024 by joshpopelka20 Loading…
9
ProTip! Type g i on any issue or pull request to go back to the issue listing page.