Code

41 feat batch inference for nitro#101

Code

Merged

tikikun merged 6 commits intomainjanhq/cortex.cpp:mainfrom 41-feat-batch-inference-for-nitrojanhq/cortex.cpp:41-feat-batch-inference-for-nitroCopy head branch name to clipboardNov 6, 2023

+1,602-873

Commits

Commits on Oct 26, 2023

• chore: pump llama cpp to latest version with batch inference

  tikikun

  committed
  26daebc

  Copy full SHA for 26daebc

Commits on Nov 3, 2023

• pump llama

  tikikun

  committed
  2212f89

  Copy full SHA for 2212f89

• feat: add batching inferences + multi threading in drogon cpp

  tikikun

  committed
  d89f30c

  Copy full SHA for d89f30c

Commits on Nov 6, 2023

• remove specific mac

  tikikun

  committed
  f9d03a5

  Copy full SHA for f9d03a5

• disable DBUILD_SHARED_LIBS cmake windows cuda

  jan-service-account

  committed
  b953692

  Copy full SHA for b953692

• Merge pull request #108 from janhq/fix/missing-dll-libs

  Show description for a463cdb
  hiento09

  authored
  a463cdb

  Copy full SHA for a463cdb