[FP8][Kernel] Dynamic kv cache scaling factors computation#11906

Open

gshtras wants to merge 22 commits intovllm-project:mainfrom ROCm:kv_cache_dynamic_computation_upstream

+273-1,367

Commits on Jan 8, 2025

Adjusted cpu implementation datatypes
gshtras
committed

Commits on Jan 9, 2025

Merge remote-tracking branch 'origin/main' into kv_cache_dynamic_computation_upstream
gshtras
committed

Commits on Jan 13, 2025

Merge remote-tracking branch 'origin/main' into kv_cache_dynamic_computation_upstream
gshtras
committed

Commits on Jan 15, 2025

Commits on Jan 20, 2025

Merge remote-tracking branch 'origin/main' into kv_cache_dynamic_computation_upstream
gshtras
committed