Materialised views off siot SQLite

[gedw99]

This might be an interesting optional feature.

https://github.com/cashapp/pranadb

Siot has a SQLite db, but not materialised views. Sqlitedb can export CDC , ad those cdc streams can be transported on NATS .

There is a project that does CDC on SQLite with golang onto NATS. Just need to find it again

[gedw99]

Here it is: https://github.com/maxpert/marmot

it’s replicating SQLite using NATS , but it’s basically CDC worthy.

it’s multi master which is a bit worrying in terms of linearisation of ordered changes .

But I think you see the point of the 2 repos I linked.

[cbrake]

thanks @gedw99 -- both fascinating projects!

This is interesting:

Materialized views can take input from one or more other materialized views or sources, so the set of materialized views in a schema form a directed acyclic graph (DAG). As data is ingested into PranaDB it flows through the DAG, updating the materialized views, in near real-time.

One requirement for SIOT is that we be able to synchronize a subset of the DB to an edge device. However, I don't see any reasons that these techniques could not be used for that. I feel the SIOT data model is useful for IoT systems; however, the synchronization mechanism could be improved a lot, so look forward to investigating projects like this at some point.