Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can't deploy dagster on ecs with docker compose. #10754

Open
seb2704 opened this issue Nov 27, 2022 · 4 comments
Open

Can't deploy dagster on ecs with docker compose. #10754

seb2704 opened this issue Nov 27, 2022 · 4 comments
Labels
area: docs Related to documentation in general

Comments

@seb2704
Copy link

seb2704 commented Nov 27, 2022

What's the issue or suggestion?

I like to deploy dagster with docker compose on ESC. I followed the steps from the github example, but I get the following Error at the last step:

A load balancer cannot be attached to multiple subnets in the same Availability Zone (Service: AmazonElasticLoadBalancing; Status Code: 400; Error Code: InvalidConfigurationRequest; Request ID: 82c117f3-dfa0-498f-8f14-0911e02a2167; Proxy: null) 

I have no clue how to solve this. Do you have any suggestions?

Message from the maintainers

Impacted by this issue? Give it a 👍! We factor engagement into prioritization.

@seb2704 seb2704 added the area: docs Related to documentation in general label Nov 27, 2022
@jmsanders
Copy link
Contributor

This looks to perhaps be related to docker-archive/compose-cli#921

And that it might be fixed in a more recent version of the docker compose cli - can you try upgrading and going through the example again?

@seb2704
Copy link
Author

seb2704 commented Nov 30, 2022

Thank you, i updated docker compose to version 2.12.2, which solved this problem. But now I'm getting the follwing error message: botocore.exceptions.NoRegionError: You must specify a region. , although the environment variable AWS_REGION is set. Dou you have any clue to solve that? I'm working wiht WSL Ubuntu 20.04

@ei-grad
Copy link

ei-grad commented Dec 29, 2022

Faced the same problem with the region, as in the latest comment. Region could be specified via the ~/.aws/config file or by the AWS_DEFAULT_REGION environment variable. It could worth for dagster-aws library to allow to specify the region argument value for boto3.client() calls in the ECSRunLauncher configuration.

@drawnwren
Copy link

I'm still getting the load balancer error with

docker compose 2.16.0
docker cli 23.0.1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area: docs Related to documentation in general
Projects
None yet
Development

No branches or pull requests

4 participants