Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Couple fixes for RAG evaluation #979

Merged
merged 2 commits into from
Apr 3, 2024
Merged

Couple fixes for RAG evaluation #979

merged 2 commits into from
Apr 3, 2024

Conversation

bjwswang
Copy link
Collaborator

@bjwswang bjwswang commented Apr 3, 2024

What type of PR is this?

/kind fix

What this PR does / why we need it

Which issue(s) this PR fixes

Fixes #978

Special notes for your reviewer

The reason to make sure all typed reference have apigroup,namespace set due to below error:

Error: node llm-node init failed: can't convert to langchain llm: an empty namespace may not be set when a resource name is provided
Usage:
  arctl eval gen_test_dataset [flags]

Flags:
      --ground-truths-column string   The column name which provides the answers (default "a")
  -h, --help                          help for gen_test_dataset
      --input-dir string              The input directory where to load original dataset files
      --max-context-length int        The maximum length of the context (default 512)
      --merge                         Whether to merge all generated test data into a single file
      --merge-file string             name of the merged document (default "ragas.csv")
      --output string                 The way to output the generated dataset rows.We support two ways:
                                       - stdout: print row
                                       - csv: save row to csv file
      --question-column string        The column name which provides questions (default "q")

Global Flags:
      --application string   The application to be evaluated
      --home string          home directory to use (default "/root/.arcadia")
  -n, --namespace string     namespace to use (default "default")

panic: node llm-node init failed: can't convert to langchain llm: an empty namespace may not be set when a resource name is provided

goroutine 1 [running]:
main.main()
	/go/src/cmd/arctl/main.go:60 +0x34

@bjwswang bjwswang merged commit 6b7d139 into kubeagi:main Apr 3, 2024
9 of 10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

rag-eval do not have enough permissions to init app runtime
2 participants