Code

Add new RAG pipeline project#97

Code

Merged

strickvl merged 35 commits intomainzenml-io/zenml-projects:mainfrom feature/new-rag-pipelinezenml-io/zenml-projects:feature/new-rag-pipelineCopy head branch name to clipboardApr 9, 2024

+1,186

Commits

Commits on Mar 25, 2024

• first commit, new llm project

  strickvl

  committed
  02fc428

  Copy full SHA for 02fc428

Commits on Mar 26, 2024

• add indexing functionality

  strickvl

  committed
  603c597

  Copy full SHA for 603c597

• finish basic pipeline functionality

  strickvl

  committed
  05b488b

  Copy full SHA for 05b488b

• Merge remote-tracking branch 'origin/main' into feature/new-rag-pipeline

  strickvl

  committed
  aedc529

  Copy full SHA for aedc529

• update llm_utils and format

  strickvl

  committed
  9c50f80

  Copy full SHA for 9c50f80

• refactored the url scraper + utils

  strickvl

  committed
  c85da66

  Copy full SHA for c85da66

• refactoring part 2

  strickvl

  committed
  362c572

  Copy full SHA for 362c572

• fix DB update functionality

  strickvl

  committed
  998d593

  Copy full SHA for 998d593

• add option to switch out the llm within the CLI

  strickvl

  committed
  35cf8c4

  Copy full SHA for 35cf8c4

• use litellm and drop garbage logs

  strickvl

  committed
  80e8286

  Copy full SHA for 80e8286

• formatting

  strickvl

  committed
  d19ce77

  Copy full SHA for d19ce77

• remove unused title + url

  strickvl

  committed
  74bf3a8

  Copy full SHA for 74bf3a8

Commits on Mar 27, 2024

• rip out langchain completely

  strickvl

  committed
  642209b

  Copy full SHA for 642209b

• error handling and debug statements

  strickvl

  committed
  d4dd39d

  Copy full SHA for d4dd39d

• add code inspo acknowledgements

  strickvl

  committed
  9f7cd9e

  Copy full SHA for 9f7cd9e

• add and update docstrings

  strickvl

  committed
  8964005

  Copy full SHA for 8964005

• remove unused code and use zenml urls

  strickvl

  committed
  7ec4393

  Copy full SHA for 7ec4393

• use smaller embedding model

  strickvl

  committed
  aad2972

  Copy full SHA for aad2972

• update the dimensionality to match the new embedding model

  strickvl

  committed
  cc320fc

  Copy full SHA for cc320fc

• no cache for embeddings generation

  strickvl

  committed
  830de9f

  Copy full SHA for 830de9f

• fix constant

  strickvl

  committed
  0c7cd69

  Copy full SHA for 0c7cd69

• visualise embeddings

  strickvl

  committed
  fb8a2ea

  Copy full SHA for fb8a2ea

• tiny tweaks to params

  strickvl

  committed
  5341331

  Copy full SHA for 5341331

• Merge branch 'feature/new-rag-pipeline' of github.com:zenml-io/zenml-projects into feature/new-rag-pipeline

  strickvl

  committed
  18580d1

  Copy full SHA for 18580d1

Commits on Apr 2, 2024

• add images

  strickvl

  committed
  4ed2552

  Copy full SHA for 4ed2552

Commits on Apr 8, 2024

• update pipeline code to abstract out DB creds

  strickvl

  committed
  66824d8

  Copy full SHA for 66824d8

• add images

  strickvl

  committed
  a70f50b

  Copy full SHA for a70f50b

• final README updates

  strickvl

  committed
  0705761

  Copy full SHA for 0705761

• add RAG pipeline image

  strickvl

  committed
  b6c487d

  Copy full SHA for b6c487d

• Merge branch 'main' into feature/new-rag-pipeline

  strickvl

  authored
  5806d2d

  Copy full SHA for 5806d2d

• formatting

  strickvl

  committed
  a11e4f4

  Copy full SHA for a11e4f4

• add super simple RAG pipeline

  strickvl

  committed
  3897798

  Copy full SHA for 3897798

• even more basic RAG

  strickvl

  committed
  6ba2874

  Copy full SHA for 6ba2874

• add a third irrelevant question

  strickvl

  committed
  0662ec5

  Copy full SHA for 0662ec5

• Refactor preprocess_text and answer_question functions

  strickvl

  committed
  6f342a5

  Copy full SHA for 6f342a5