Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: add section for S3 migration ? #61

Open
udf2457 opened this issue Sep 7, 2023 · 2 comments
Open

docs: add section for S3 migration ? #61

udf2457 opened this issue Sep 7, 2023 · 2 comments

Comments

@udf2457
Copy link

udf2457 commented Sep 7, 2023

Please consider enhancing the docs by adding a section where you describe the process for migrating between S3 stores.

For example, say you start on MinIO and you wish to migrate to AWS S3, or vice-versa or any other number of examples.

It is not immediately clear how this would be safely done ?

@wojas
Copy link
Member

wojas commented Sep 8, 2023

You can safely copy all snapshots from Minio, upload them to another store like AWS S3, and update the configuration to point at the new S3 backend. You may want to bring the API or server down to prevent changes during this migration.
Perhaps we could add a lightningstream snapshots backup and restore command in the future to make this easier.

Alternatively, you could just point all existing instances at a new empty destination. Since their LMDBs contain all the data, this will write new snapshots that contain all the data needed. If you do a rolling update even the latest changes will get incorporated everywhere. This is probably the easiest way to migrate if you are not running ephemeral instances that start empty after a configuration change.

I agree that it is worth adding this to the documentation.

@udf2457
Copy link
Author

udf2457 commented Sep 8, 2023

Thanks @wojas. Very useful

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants