add blueprint and tutorial for pre and post process function of Bedrock Rerank API (#3254) #3352
Conversation
…ck Rerank API (opensearch-project#3254) Signed-off-by: tkykenmt <[email protected]>
tkykenmt
requested review from
b4sjoo,
dhrubo-os,
jngz-es,
model-collapse,
rbhavna,
ylwu-amzn,
zane-neo,
Zhangxunmt,
austintlee,
HenryL27 and
xinyual
as code owners
tkykenmt
had a problem deploying
to
ml-commons-cicd-env-require-approval
GitHub Actions
Failure
tkykenmt
temporarily deployed
to
ml-commons-cicd-env-require-approval
GitHub Actions
Inactive
|
|
||
| A [reranking pipeline](https://opensearch.org/docs/latest/search-plugins/search-relevance/reranking-search-results/) can rerank search results, providing a relevance score for each document in the search results with respect to the search query. The relevance score is calculated by a cross-encoder model. | ||
|
|
||
| This tutorial illustrates using the [Amazon Bedrock Rerank API](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_agent-runtime_Rerank.html) to rerank search results using a model hosted on Amazon Bedrock. |
There was a problem hiding this comment.
Can you explain the difference with https://github.com/opensearch-project/ml-commons/blob/main/docs/tutorials/rerank/rerank_pipeline_with_Amazon_Rerank_model_on_Amazon_Bedrock.md ?
I see both can use same model amazon.rerank-v1:0. Which tutorial cx should follow ? Any preference ?
There was a problem hiding this comment.
Previous blueprint requires custom pre and post functions, and calls bedrock invoke API. For invoke API, users need to set model-specific parameters. New blueprint doesn't require custom function code. In addition, new blueprint adopts rerank API. By using Rerank API, users can perform reranking simply by specifying common parameters that are independent of the model. Users can also switch to another model by just changing the model ID.
tkykenmt
requested a deployment
to
ml-commons-cicd-env-require-approval
GitHub Actions
Waiting
Description
Amazon Bedrock introduced Rerank model support. OpenSearch can invoke Rerank models on Bedrock by writing custom pre/post processing function, but pre-built function is good for performance. This PR is for adding blueprint and tutorials to illustrate how to use these process functions.
Related Issues
Resolves #3254
Check List
--signoff.By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.