Support automatic device mapping for gguf models (#1044) #4500

Job	Run time
Rustfmt	15s
Test Suite (ubuntu-latest, stable)	5m 28s
Clippy	1m 58s
Test Suite (windows-latest, stable)	10m 47s
Check (ubuntu-latest, stable)	1m 45s
Test Suite (macOS-latest, stable)	3m 13s
Check (windows-latest, stable)	5m 34s
Check (macOS-latest, stable)	1m 52s
Docs	2m 57s
Typos	15s
	34m 4s

Provide feedback