Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

contribution: Jonboulle nell add aws region #1295

Merged
merged 4 commits into from
Nov 29, 2023

Conversation

dapollak
Copy link
Contributor

No description provided.

Copy link
Contributor

👋 @dapollak
Thank you for raising your pull request.
Please make sure to add tests and document all user-facing changes.
You can do this by editing the docs files in this pull request.

jonboulle and others added 4 commits November 27, 2023 21:21
When initialising a [Boto3 `Session`](https://boto3.amazonaws.com/v1/documentation/api/latest/guide/session.html#session-configurations) it's useful to be able to specify the AWS Region to which the client should connect.

Add an `--aws-region-name` option to the CLI which gets passed through to the `boto3` client used by the S3 client.

Context:

We're trying to use elementary to write to a Cloudflare R2 bucket, which implements the S3 API. However, the S3 endpoints for these buckets do not encode the region, and hence the `--s3-endpoint-url` flag isn't sufficient to be able to configure elementary to successfully access the buckets.

Without this flag, it means we need write an AWS Profile configuration to disk and pass that in to elementary in order to override the region, which isn't desirable in contexts where we integrate elementary (e.g. invoking it from Airflow).
@dapollak dapollak force-pushed the jonboulle-nell-add-aws-region branch from 83a8099 to 6c387d8 Compare November 29, 2023 12:06
@dapollak dapollak merged commit b3755fd into master Nov 29, 2023
5 of 6 checks passed
@dapollak dapollak deleted the jonboulle-nell-add-aws-region branch November 29, 2023 12:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants