Code

[Core] Cache policy framework#11928

Code

Draft

ShawnD200 wants to merge 12 commits intovllm-project:mainvllm-project/vllm:mainfrom ShawnD200:cache-policy-frameworkShawnD200/vllm:cache-policy-frameworkCopy head branch name to clipboard

+968-577

Commits

Commits on Jan 10, 2025

• Add slot mapping in BlockList

  Show description for 2f49b49
  ShawnD200

  committed
  2f49b49

  Copy full SHA for 2f49b49

• Add CachePolicy and PhysicalBlockTable, VirtualBlockTable

  Show description for 0ee6ad7
  ShawnD200

  committed
  0ee6ad7

  Copy full SHA for 0ee6ad7

• Add CachePolicyFactory

  Show description for bffc695
  ShawnD200

  committed
  bffc695

  Copy full SHA for bffc695

• Add comments

  Show description for b3bb962
  ShawnD200

  committed
  b3bb962

  Copy full SHA for b3bb962

• Rebase with extra_hash

  Show description for 749d492
  ShawnD200

  committed
  749d492

  Copy full SHA for 749d492

• Delete block_table

  Show description for de7c117
  ShawnD200

  committed
  de7c117

  Copy full SHA for de7c117

Commits on Jan 11, 2025

• Fix rebase bug and static check error

  Show description for 1ded7d1
  ShawnD200

  committed
  1ded7d1

  Copy full SHA for 1ded7d1

• Fix static check error

  Show description for 2789791
  ShawnD200

  committed
  2789791

  Copy full SHA for 2789791

Commits on Jan 14, 2025

• Adapt to flash-attention and fashinfer backend (previously only xformers)

  Show description for 4b1e9a5
  ShawnD200

  committed
  4b1e9a5

  Copy full SHA for 4b1e9a5

• Fix prefix caching abstract type

  Show description for d9b3979
  ShawnD200

  committed
  d9b3979

  Copy full SHA for d9b3979

• Address encoder-decoder

  Show description for 5d8e3c2
  ShawnD200

  committed
  5d8e3c2

  Copy full SHA for 5d8e3c2

Commits on Jan 15, 2025

• Use slot_mapping instead of building it in enc-dec

  Show description for 4d8b14f
  ShawnD200

  committed
  4d8b14f

  Copy full SHA for 4d8b14f