Skip to content
This repository was archived by the owner on Nov 12, 2025. It is now read-only.

Conversation

@pcholakov
Copy link
Contributor

We want to steer users towards always using a snapshot repository.

  • expand Docker Compose example with Minio
  • update all cluster references to link to the snapshots page
  • add strong recommendation to always use snapshots for clusters

@pcholakov pcholakov force-pushed the expand-snapshots-docs-examples branch from 6dcac1a to 03acdec Compare February 28, 2025 13:36
@cloudflare-workers-and-pages
Copy link

cloudflare-workers-and-pages bot commented Feb 28, 2025

Deploying documentation with  Cloudflare Pages  Cloudflare Pages

Latest commit: 4c7473b
Status:⚡️  Build in progress...

View logs

Copy link
Contributor

@tillrohrmann tillrohrmann left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for updating our documentation to instruct users to use snapshotting and how to set up minio @pcholakov. LGTM. +1 for merging :-)


<Admonition type="caution">
Snapshots are essential to support safe log trimming and also allow you to set partition replication to a subset of all cluster nodes, while still allowing for fast partition fail-over to to any live node. Snapshots are also necessary to add more nodes in the future.
</Admonition>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These change will probably conflict with #547

If you plan to scale your cluster over time, we strongly recommend enabling snapshotting.
Without it, newly added nodes may not be fully utilized by the system.
See the [snapshotting documentation](/operate/data-backup#snapshotting) for more details.
See the [snapshotting documentation](/operate/snapshots) for more details.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same here wrt to #547

Comment on lines +37 to +43
RESTATE_WORKER__SNAPSHOTS__DESTINATION: "s3://restate/snapshots"
RESTATE_WORKER__SNAPSHOTS__SNAPSHOT_INTERVAL_NUM_RECORDS: "1000"
RESTATE_WORKER__SNAPSHOTS__AWS_REGION: "local"
RESTATE_WORKER__SNAPSHOTS__AWS_ENDPOINT_URL: "http://minio:9000"
RESTATE_WORKER__SNAPSHOTS__AWS_ALLOW_HTTP: true
RESTATE_WORKER__SNAPSHOTS__AWS_ACCESS_KEY_ID: "minioadmin"
RESTATE_WORKER__SNAPSHOTS__AWS_SECRET_ACCESS_KEY: "minioadmin"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I assume that nothing changes here when merging restatedev/restate#2796, right?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, these all stay as-is -- #2796 is all about making the same functionality available under the RESTATE_METADATA_CLIENT__ prefix :-)

Base automatically changed from extract-operate-snapshots-page to main March 4, 2025 06:52
We want to steer users towards always using a snapshot repository.

- expand Docker Compose example with Minio
- update all cluster references to link to the snapshots page
- add strong recommendation to always use snapshots for clusters
@pcholakov pcholakov force-pushed the expand-snapshots-docs-examples branch from a4c3d57 to 7a6ac6f Compare March 4, 2025 07:11
@pcholakov
Copy link
Contributor Author

Thanks for the review @tillrohrmann, I'll merge these now and help out with the conflicts under #547.

@pcholakov pcholakov merged commit 300d44a into main Mar 4, 2025
1 of 2 checks passed
@pcholakov pcholakov deleted the expand-snapshots-docs-examples branch March 4, 2025 07:18
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants