Code

feat(ml): ML on Rockchip NPUs#15241

Code

Open

yoni13 wants to merge 78 commits intoimmich-app:mainimmich-app/immich:mainfrom yoni13:rknn-toolkit-lite2yoni13/immich:rknn-toolkit-lite2Copy head branch name to clipboard

+451-41

Commits

Commits on Nov 29, 2024

• untested

  yoni13

  committed
  8ef3e49

  Copy full SHA for 8ef3e49

• test

  yoni13

  committed
  6ffc227

  Copy full SHA for 6ffc227

Commits on Nov 30, 2024

• lowercase

  yoni13

  committed
  7fddf28

  Copy full SHA for 7fddf28

Commits on Dec 1, 2024

• ViT-B-32__openai/textual/ Runs with emulator now.

  yoni13

  committed
  bc849e2

  Copy full SHA for bc849e2

Commits on Dec 3, 2024

• Merge branch 'immich-app:main' into rknn-toolkit2

  yoni13

  authored
  b6c4b37

  Copy full SHA for b6c4b37

Commits on Dec 4, 2024

• Merge branch 'immich-app:main' into rknn-toolkit-lite2

  yoni13

  authored
  4140e93

  Copy full SHA for 4140e93

• Init commit for using rknn, RecognitionFormDataLoadTest doesnt work

  yoni13

  committed
  257cc6c

  Copy full SHA for 257cc6c

Commits on Dec 13, 2024

• Merge branch 'immich-app:main' into rknn-toolkit-lite2

  yoni13

  authored
  da152bd

  Copy full SHA for da152bd

Commits on Dec 25, 2024

• Merge branch 'immich-app:main' into rknn-toolkit-lite2

  yoni13

  authored
  082c426

  Copy full SHA for 082c426

Commits on Jan 9, 2025

• all infrencing works with 1 max job concurrency

  yoni13

  committed
  a94fad5

  Copy full SHA for a94fad5

• Merge branch 'immich-app:main' into rknn-toolkit-lite2

  yoni13

  authored
  8608b9c

  Copy full SHA for 8608b9c

Commits on Jan 10, 2025

• Update rknn.py

  yoni13

  authored
  9bc3e5b

  Copy full SHA for 9bc3e5b

• fix inf,-inf with 2 concurrency

  yoni13

  committed
  4d704e9

  Copy full SHA for 4d704e9

Commits on Jan 11, 2025

• Revert my changes to dockerfiles

  yoni13

  committed
  a2722e1

  Copy full SHA for a2722e1

• support for rknn.rknnpool.is_available

  yoni13

  committed
  c20d110

  Copy full SHA for c20d110

• Merge branch 'immich-app:main' into rknn-toolkit-lite2

  yoni13

  authored
  66004e3

  Copy full SHA for 66004e3

• Handling Import and file not found Error for non-arm devices.

  yoni13

  committed
  d10147f

  Copy full SHA for d10147f

• Set group RKNN to optional

  yoni13

  committed
  d5ef821

  Copy full SHA for d5ef821

• Dockerfile for rknn

  yoni13

  committed
  506ca0d

  Copy full SHA for 506ca0d

• Remove unused imports.

  yoni13

  committed
  7aaf3aa

  Copy full SHA for 7aaf3aa

• Indentation issue

  yoni13

  committed
  f4671f4

  Copy full SHA for f4671f4

• Fix typo: rknnlite.api

  yoni13

  committed
  7f2af6f

  Copy full SHA for 7f2af6f

• ruff format

  yoni13

  committed
  d5e453a

  Copy full SHA for d5e453a

• ruff

  yoni13

  committed
  23d0ea0

  Copy full SHA for 23d0ea0

• Check if NPU drivers is loaded or not.

  yoni13

  committed
  4162119

  Copy full SHA for 4162119

• Install onnxruntime

  yoni13

  committed
  815ed1a

  Copy full SHA for 815ed1a

• Should Fix No module named 'rknn'

  yoni13

  committed
  807111e

  Copy full SHA for 807111e

• add rknn to src

  yoni13

  committed
  665718b

  Copy full SHA for 665718b

• Set running threads from env

  yoni13

  committed
  efaf70e

  Copy full SHA for efaf70e

• fix path

  yoni13

  committed
  19ee48f

  Copy full SHA for 19ee48f

• support core_mask for specfic socs

  yoni13

  committed
  c72cf61

  Copy full SHA for c72cf61

• Fix Please do not set this parameter on other platforms.

  yoni13

  committed
  c665fd2

  Copy full SHA for c665fd2

Commits on Jan 12, 2025

• set default thread num to 2, not everyone has 8 gigs of ram

  yoni13

  committed
  e6ff21b

  Copy full SHA for e6ff21b

• DOCS

  yoni13

  committed
  c109e28

  Copy full SHA for c109e28

• fix formatting

  yoni13

  committed
  bb67a9d

  Copy full SHA for bb67a9d

• Fix docs.

  yoni13

  committed
  68fccad

  Copy full SHA for 68fccad

• Sort them by alphablet

  yoni13

  committed
  1775397

  Copy full SHA for 1775397

• format be happy

  yoni13

  committed
  7ae4b71

  Copy full SHA for 7ae4b71

• Merge branch 'main' into rknn-toolkit-lite2

  yoni13

  authored
  8965a9f

  Copy full SHA for 8965a9f

• only load knnx model when required

  yoni13

  committed
  4c7ac14

  Copy full SHA for 4c7ac14

Commits on Jan 13, 2025

• Add export script

  yoni13

  committed
  daf8860

  Copy full SHA for daf8860

• Load model by SOC name

  yoni13

  committed
  ebdfe1b

  Copy full SHA for ebdfe1b

• typing be happy.

  yoni13

  committed
  2f7e44a

  Copy full SHA for 2f7e44a

• Merge branch 'main' into rknn-toolkit-lite2

  yoni13

  authored
  f328104

  Copy full SHA for f328104

• ignore rknn model if not using it

  yoni13

  committed
  b6cc205

  Copy full SHA for b6cc205

• reformat

  yoni13

  committed
  6c4e6cb

  Copy full SHA for 6c4e6cb

• add test,founds bugs, fix it tomorrow

  yoni13

  committed
  4b0f93c

  Copy full SHA for 4b0f93c

Commits on Jan 14, 2025

• fixed some bugs

  yoni13

  committed
  8b80d03

  Copy full SHA for 8b80d03

• black app export

  yoni13

  committed
  5244ed6

  Copy full SHA for 5244ed6

• Merge branch 'main' into rknn-toolkit-lite2

  yoni13

  authored
  cb01a11

  Copy full SHA for cb01a11

• switch to Runtime error instead of exit()

  yoni13

  committed
  c21ce40

  Copy full SHA for c21ce40

• remove non implemented tests

  yoni13

  committed
  0f03f77

  Copy full SHA for 0f03f77

• this duplicated?

  yoni13

  committed
  b5a4ed5

  Copy full SHA for b5a4ed5

• trying to fix pytest

  yoni13

  committed
  01eb095

  Copy full SHA for 01eb095

• Should FIx the quote that made mypy unhappy

  yoni13

  committed
  9882b83

  Copy full SHA for 9882b83

Commits on Jan 17, 2025

• changes some cases

  yoni13

  committed
  f32d991

  Copy full SHA for f32d991

• add checksum for libnnrt.so

  yoni13

  committed
  26d5fb0

  Copy full SHA for 26d5fb0

• switch to sha256

  yoni13

  committed
  bc48b67

  Copy full SHA for bc48b67

• tpe

  yoni13

  committed
  f067212

  Copy full SHA for f067212

• remove unrequired devices

  yoni13

  committed
  0567592

  Copy full SHA for 0567592

Commits on Jan 18, 2025

• fix granularity

  yoni13

  committed
  3634ae1

  Copy full SHA for 3634ae1

• fix typo and add a propper var name

  yoni13

  committed
  f5de3de

  Copy full SHA for f5de3de

• make these functions snake case.

  yoni13

  committed
  be76857

  Copy full SHA for be76857

• remove unnecessary print

  yoni13

  committed
  87a46dc

  Copy full SHA for 87a46dc

• refactor ignore_patterns

  yoni13

  committed
  d7381ab

  Copy full SHA for d7381ab

• add a simple script to notify user if some op is not supported

  yoni13

  committed
  9926045

  Copy full SHA for 9926045

• Merge branch 'main' into rknn-toolkit-lite2

  yoni13

  authored
  4e42fbc

  Copy full SHA for 4e42fbc

• fix typo in tests

  yoni13

  committed
  b3ae5d3

  Copy full SHA for b3ae5d3

• shellcheck happy

  yoni13

  committed
  d2b7e10

  Copy full SHA for d2b7e10

• prettier happy

  yoni13

  committed
  58f1cc9

  Copy full SHA for 58f1cc9

• fix types and ignored pattern

  yoni13

  committed
  32f3707

  Copy full SHA for 32f3707

• update supported SOCs

  yoni13

  committed
  1653cd9

  Copy full SHA for 1653cd9

Commits on Jan 19, 2025

• raise NotImplementedError for now

  yoni13

  committed
  2b967ca

  Copy full SHA for 2b967ca

• add input outputs

  yoni13

  committed
  ac4ce3e

  Copy full SHA for ac4ce3e

• update mapping

  yoni13

  committed
  20ba9f9

  Copy full SHA for 20ba9f9

• Merge branch 'main' into rknn-toolkit-lite2

  yoni13

  authored
  59e4b65

  Copy full SHA for 59e4b65

• Update permission

  yoni13

  committed
  dd52c2d

  Copy full SHA for dd52c2d

Commits on Jan 22, 2025

• Merge branch 'main' into rknn-toolkit-lite2

  yoni13

  authored
  794da29

  Copy full SHA for 794da29