You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is there a way to use NIM API Calls instead of having a model deployed on the GPU?
Would changing the values.yaml file while deploying the helm chart should do.
Is there any alternate for this, and the other models like reranker and embedding model?
Is there a way to use NIM API Calls instead of having a model deployed on the GPU?
Would changing the
values.yaml
file while deploying the helm chart should do.Is there any alternate for this, and the other models like
reranker
andembedding
model?These pods would associate to the models by NVIDIA, so changing to NIM can also save costs.
Any help would be appreciated.
The text was updated successfully, but these errors were encountered: