Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[#7674] Add support for AWS batch retry limit #7675

Closed

Conversation

jealous
Copy link

@jealous jealous commented Jan 9, 2025

Description

When submitting jobs to AWS Batch, Cromwell dynamically creates job definitions based on the job configuration. However, the current implementation does not provide a way for users to configure the Batch retry limit in the job definition.

This PR introduces a new batchRetry parameter in the configuration, allowing users to specify a default retry limit for AWS Batch jobs. The parameter is also included in the job runtime settings. By default, batchRetry is set to 0, effectively disabling retries unless explicitly configured by the user.

When submitting jobs to AWS Batch, Cromwell dynamically creates
job definitions based on the job configuration. However, the
current implementation does not provide a way for users to
configure the Batch retry limit in the job definition.

This PR introduces a new batchRetry parameter in the configuration,
allowing users to specify a default retry limit for AWS Batch jobs.
The parameter is also included in the job runtime settings. By
default, batchRetry is set to 0, effectively disabling retries
unless explicitly configured by the user.
@jealous jealous requested a review from a team as a code owner January 9, 2025 05:11
@geertvandeweyer
Copy link

Hi,

We maintain an aws specific fork that has these functionalities .

Check it out here:

https://github.com/henriqueribeiro/cromwell

Or my latest dev release forked from that one :

https://github.com/geertvandeweyer/cromwell

Best,
Geert

@jealous
Copy link
Author

jealous commented Jan 9, 2025

Oh, I don't know this. Thanks for the info. It looks good. Is there any document for what you have changed for the aws batch? Specifically I am looking for the batch retry parameter.

@jealous
Copy link
Author

jealous commented Jan 9, 2025

Oh, I found it. Please ignore the previous comment. Nice work. Thanks!

@jealous
Copy link
Author

jealous commented Jan 9, 2025

I am closing this PR because there are already solutions.

@jealous jealous closed this Jan 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants