Code

Multi GPU with PEFT on LLM#102

Code

Merged

avishniakov merged 29 commits intomainzenml-io/zenml-projects:mainfrom feature/OSSK-514-multi-gpu-with-peftzenml-io/zenml-projects:feature/OSSK-514-multi-gpu-with-peftCopy head branch name to clipboardJun 27, 2024

+394-105

Commits

Commits on Apr 17, 2024

• multi GPU with PEFT on LLM

  avishniakov

  committed
  5d2a2ee

  Copy full SHA for 5d2a2ee

• eof

  avishniakov

  committed
  3e9776a

  Copy full SHA for 3e9776a

• fixes for subprocess

  avishniakov

  committed
  d77afdc

  Copy full SHA for d77afdc

• callback patch

  avishniakov

  committed
  7cc1f01

  Copy full SHA for 7cc1f01

• tidy up

  avishniakov

  committed
  377ec0f

  Copy full SHA for 377ec0f

Commits on Apr 19, 2024

• new iteration

  avishniakov

  committed
  8856e5c

  Copy full SHA for 8856e5c

• lint

  avishniakov

  committed
  0c85e8b

  Copy full SHA for 0c85e8b

• fsspec fix

  avishniakov

  committed
  27e6795

  Copy full SHA for 27e6795

• pin datasets to lower version

  avishniakov

  committed
  f257630

  Copy full SHA for f257630

• relax datasets pin a bit

  avishniakov

  committed
  f68a469

  Copy full SHA for f68a469

Commits on May 3, 2024

• polish for step operators

  avishniakov

  committed
  65cdc7e

  Copy full SHA for 65cdc7e

Commits on May 7, 2024

• push some functionality to the core

  avishniakov

  committed
  93398cd

  Copy full SHA for 93398cd

• format

  avishniakov

  committed
  2bb3ab9

  Copy full SHA for 2bb3ab9

• update README

  avishniakov

  committed
  261e2ce

  Copy full SHA for 261e2ce

• update README

  avishniakov

  committed
  c22092b

  Copy full SHA for c22092b

Commits on May 14, 2024

• use AccelerateScaler

  avishniakov

  committed
  b51a111

  Copy full SHA for b51a111

Commits on May 15, 2024

• pass bit config around

  avishniakov

  committed
  f3943b2

  Copy full SHA for f3943b2

Commits on Jun 4, 2024

• functional way

  avishniakov

  committed
  555997e

  Copy full SHA for 555997e

• Merge branch 'main' into feature/OSSK-514-multi-gpu-with-peft

  avishniakov

  committed
  28faf6c

  Copy full SHA for 28faf6c

• remove configs

  avishniakov

  committed
  65b5e11

  Copy full SHA for 65b5e11

• restore configs

  avishniakov

  committed
  d77f50f

  Copy full SHA for d77f50f

• restore reqs

  avishniakov

  committed
  fd3887d

  Copy full SHA for fd3887d

Commits on Jun 5, 2024

• accelerate as a function from the core

  avishniakov

  committed
  5264011

  Copy full SHA for 5264011

• reduce README

  avishniakov

  committed
  d9172c7

  Copy full SHA for d9172c7

Commits on Jun 7, 2024

• og metadata separately

  avishniakov

  committed
  817a1b2

  Copy full SHA for 817a1b2

Commits on Jun 13, 2024

• resume logging

  avishniakov

  committed
  6d988eb

  Copy full SHA for 6d988eb

Commits on Jun 14, 2024

• add trust_remote_code=True

  avishniakov

  committed
  80a1084

  Copy full SHA for 80a1084

Commits on Jun 20, 2024

• final touches

  avishniakov

  committed
  bb9dc65

  Copy full SHA for bb9dc65

• final touches

  avishniakov

  committed
  329cf17

  Copy full SHA for 329cf17