I read that it is possible to compress sqlite databases with extensions like sqlite-zstd.
In Sqlite3, are there methods, ready to use in Python, that allow both:
- compression of the column
description
(let's say 1 billion of rows, columndescription
is a < 20 char text) - keep the fast lookup that we have when this column has an INDEX (and even full text search e.g.
LIKE '%foo%'
)
?
I was about to write some code with LZ4-compressed rows, but then a single search/lookup would require a full scan (to decompress all values to see if there is match).
Are there Sqlite techniques adapted to this (or other data structures)?
from Compressed Sqlite database and indexing
No comments:
Post a Comment