Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Default to Rocksdb #1134

Closed
4 tasks
faddat opened this issue Dec 28, 2021 · 2 comments
Closed
4 tasks

Default to Rocksdb #1134

faddat opened this issue Dec 28, 2021 · 2 comments

Comments

@faddat
Copy link
Contributor

faddat commented Dec 28, 2021

Summary

The whisky on the rocks series of patches powers nearly every ibc relay operator's nodes on busy networks like Gaia, Terra, Osmosis and Juno.

Problem Definition

We should move sober gaia to a rocksdb by default build and release process so that she:

  • syncs about 3x faster
    • save operator time
    • save operator money
    • grow network of operators due to lower time burden

Proposal

I'm proposing that we use the following replace line:

https://github.com/notional-labs/osmosis/blob/54c0b7e2c1dd01dd46e7430c155aba9f78db6303/go.mod#L126

in go.mod until either:

  • tecbot accepts a pr fixing his gorocksdb lib

or

  • we change the module path for the cosmos gorocksdb lib and update tm-db so that it imports the cosmos gorocksdb lib.

The performance improvements to many aspects of operating gaia are quite incredible with this one little fix.

In the next 2-4 weeks, Notional should have a quicksync.io style server set up at an unlimited 10gbps provider in the united states. If anyone in the community is aware of hosting centers with true 10gbps connections in asia, preferably Singapore or Hong Kong, we'd glady provide direct asia coverage, too.

This service will provide:

  • Archive
  • Default
  • Fully Pruned

snapshots and should make it much simpler for operators to use rocksdb. Since rocksdb also helps with read performance, analytics on Gaia can be improved, too.


For Admin Use

  • Not duplicate issue
  • Appropriate labels applied
  • Appropriate contributors tagged
  • Contributor assigned/self-assigned
@faddat
Copy link
Contributor Author

faddat commented Dec 28, 2021

tendermint/tm-db#211

@tac0turtle
Copy link
Member

sync is faster but how is overall size of state compared? how is the speed when caught up compared to other databases.

@okwme okwme closed this as completed Jan 19, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants