Code

[ Kernel ] AWQ Fused MoE#6422

Code

Closed

robertgshaw2-redhat wants to merge 31 commits intovllm-project:mainvllm-project/vllm:mainfrom neuralmagic:fused-moe-awqneuralmagic/nm-vllm:fused-moe-awqCopy head branch name to clipboard

+961-215

Commits

Commits on Jul 13, 2024

• added files

  robertgshaw2-redhat

  committed
  d40fd4d

  Copy full SHA for d40fd4d

• format

  robertgshaw2-redhat

  committed
  f1d5836

  Copy full SHA for f1d5836

• stash

  robertgshaw2-redhat

  committed
  16baf11

  Copy full SHA for 16baf11

• torch library

  robertgshaw2-redhat

  committed
  03d9d8e

  Copy full SHA for 03d9d8e

• fixed another torch library

  robertgshaw2-redhat

  committed
  54d6a87

  Copy full SHA for 54d6a87

• first end to end run with tp=1

  robertgshaw2-redhat

  committed
  524a94c

  Copy full SHA for 524a94c

• loaded but not running at fp16

  robertgshaw2-redhat

  committed
  febb027

  Copy full SHA for febb027

• correctness end-to-end!

  robertgshaw2-redhat

  committed
  8bca009

  Copy full SHA for 8bca009

• formatted

  robertgshaw2-redhat

  committed
  8527d6e

  Copy full SHA for 8527d6e

• updared the weight loading logic

  robertgshaw2-redhat

  committed
  36d1d82

  Copy full SHA for 36d1d82

• stash

  robertgshaw2-redhat

  committed
  6943e80

  Copy full SHA for 6943e80

• fixed fp8

  robertgshaw2-redhat

  committed
  71e5129

  Copy full SHA for 71e5129

Commits on Jul 14, 2024

• Merge branch 'main' into fused-moe-awq

  robertgshaw2-redhat

  committed
  703e792

  Copy full SHA for 703e792

• merged

  robertgshaw2-redhat

  committed
  5b73064

  Copy full SHA for 5b73064

• formatting

  robertgshaw2-redhat

  committed
  2ef2c92

  Copy full SHA for 2ef2c92

• better comments

  robertgshaw2-redhat

  committed
  db33c3f

  Copy full SHA for db33c3f

• added

  robertgshaw2-redhat

  committed
  f6f60cd

  Copy full SHA for f6f60cd

• formatted

  robertgshaw2-redhat

  committed
  d9def7e

  Copy full SHA for d9def7e

• stash

  robertgshaw2-redhat

  committed
  16eacd0

  Copy full SHA for 16eacd0

Commits on Jul 30, 2024

• Merge branch 'main' into fused-moe-awq

  dsikka

  authored
  0674d2f

  Copy full SHA for 0674d2f

• clean-up, fix tests

  dsikka

  committed
  d6a032e

  Copy full SHA for d6a032e

Commits on Aug 1, 2024

• normalize weights to prevent illegal memory

  dsikka

  committed
  8d52ae5

  Copy full SHA for 8d52ae5

• all MoE tests working

  dsikka

  committed
  c08a5da

  Copy full SHA for c08a5da

Commits on Aug 2, 2024

• revert to reproduce error

  dsikka

  committed
  7325e78

  Copy full SHA for 7325e78

• update to comply with main

  dsikka

  committed
  0538dcc

  Copy full SHA for 0538dcc

Commits on Aug 4, 2024

• PR comments

  dsikka

  committed
  0ba00ab

  Copy full SHA for 0ba00ab

Commits on Aug 5, 2024

• fix tpu forward pass; use kwargs

  dsikka

  committed
  419eb7d

  Copy full SHA for 419eb7d

Commits on Aug 6, 2024

• fix triton import

  dsikka

  committed
  5666fcb

  Copy full SHA for 5666fcb

• further fix imports

  dsikka

  committed
  8013ad4

  Copy full SHA for 8013ad4

• fix

  dsikka

  committed
  be34dc0

  Copy full SHA for be34dc0

• fix fp8

  dsikka

  committed
  6e7bbf9

  Copy full SHA for 6e7bbf9