Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error Code 504 message while deploying CVO #130

Closed
shubhammer opened this issue Sep 6, 2022 · 6 comments
Closed

Error Code 504 message while deploying CVO #130

shubhammer opened this issue Sep 6, 2022 · 6 comments
Labels
backend Issues related to the backend service or the APIs. Jira Has an Internal Jira Story
Milestone

Comments

@shubhammer
Copy link

In between i see while deploying CVO via terraform the deployment fails with below error

netapp-cloudmanager_cvo_aws.mycvo: Still creating... [12m10s elapsed]
netapp-cloudmanager_cvo_aws.mycvo: Still creating... [12m20s elapsed]
netapp-cloudmanager_cvo_aws.mycvo: Still creating... [12m30s elapsed]
netapp-cloudmanager_cvo_aws.mycvo: Still creating... [12m40s elapsed]
netapp-cloudmanager_cvo_aws.mycvo: Still creating... [12m50s elapsed]
netapp-cloudmanager_cvo_aws.mycvo: Still creating... [13m0s elapsed]
netapp-cloudmanager_cvo_aws.mycvo: Still creating... [13m10s elapsed]

│ Error: code: 504, message:

│ with netapp-cloudmanager_cvo_aws.mycvo,
│ on CVO.tf line 1, in resource "netapp-cloudmanager_cvo_aws" "mycvo":
│ 1: resource "netapp-cloudmanager_cvo_aws" "mycvo" {

But if i go to my cloud manager i see the CVO gets created.

@chuyich
Copy link
Collaborator

chuyich commented Sep 6, 2022

Can this be reproduced? Do you use terraform cloud/enterprise or just run terraform on your laptop terminal? If it's running on your laptop terminal and reproducible, can you do this and share the log with us?
TF_LOG="DEBUG" terraform apply

@lonico
Copy link
Contributor

lonico commented Sep 6, 2022

This sounds like a duplicate of #116 - which is a Cloud Manager backend issue.
Though I wonder if we could retry on a 504, if we believe this can be a transient issue. @chuyich Could you check with Eran?

@lonico lonico added the backend Issues related to the backend service or the APIs. label Sep 6, 2022
@shubhammer
Copy link
Author

@chuyich I am using terraform on my linux machine . I dont think i can reproduce the issue. I tried the same code around 5 times yesterday on 3 instances it worked fine, on 2 instances it failed.

@lonico
Copy link
Contributor

lonico commented Sep 8, 2022

We're adding a retry on 504. This is abit experimental, as we don't control the backend, and we don't know the root cause for now.

@lonico lonico added this to the 22.9.0 milestone Sep 8, 2022
@lonico lonico added the Jira Has an Internal Jira Story label Sep 8, 2022
@lonico
Copy link
Contributor

lonico commented Sep 9, 2022

We released 22.9.0 yesterday (9/8). It provides some retries on 504 errors. Can you see if it helps?

@lonico
Copy link
Contributor

lonico commented Sep 19, 2022

Retries were implemented in 22.9.0.

@lonico lonico closed this as completed Sep 19, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backend Issues related to the backend service or the APIs. Jira Has an Internal Jira Story
Projects
None yet
Development

No branches or pull requests

3 participants