Replies: 3 comments
-
For zstandard, see: #105 I think (hope?) that I don't need to do anything here. You should be able just use the reader VFS with zstd-seekable-format-go. If you can try and report back, it'd be very welcome. I could add an example to the docs. |
Beta Was this translation helpful? Give feedback.
-
Steampipe is actually a (collection of) virtual table(s), not a VFS. I really wanted to get them working, but they don't seem interested. Sadly, it doesn't really help their business model so I doubt they ever will. |
Beta Was this translation helpful? Give feedback.
-
For HTTP I already have a working (testable!) example: go-sqlite3/vfs/readervfs/example_test.go Lines 21 to 66 in fff8b1c |
Beta Was this translation helpful? Give feedback.
-
I came across https://jtarchie.com/posts/2024-07-02-optimizing-large-scale-openstreetmap-data-with-sqlite today which had this interesting bit of using Zstd's seekable format to implement a (read-only) VFS with compression.
Their code is here https://github.com/jtarchie/sqlitezstd which uses https://github.com/psanford/sqlite3vfs (together with the mattn Cgo driver).
That repository also has an interesting other VFS linked, one that allows (partially) retrieving SQLite databases over HTTP (for example when a DB is stored in S3). That also reminded me a bit of Steampipe but that seems to be a touch more involved.
Beta Was this translation helpful? Give feedback.
All reactions