Osma A on Nostr: kinda surprised how little data is able to completely tank SQLite. I've had a simple ...
kinda surprised how little data is able to completely tank SQLite. I've had a simple data collector thing running long enough to have collected 1.7 million rows of very straightforward data and the DB is now 100 megs or so -- and queries to it take forever.
Published at
2023-11-30 14:18:05Event JSON
{
"id": "b5ce4c615c995987cba0a411c2338adaad095ebae53f3f581e59c476c0271528",
"pubkey": "c5e911ba68147d9efc284a4a7069358904dff0d4a5e93d6df545dd97d64e1fd3",
"created_at": 1701353885,
"kind": 1,
"tags": [
[
"proxy",
"https://mas.to/users/osma/statuses/111499928262663575",
"activitypub"
]
],
"content": "kinda surprised how little data is able to completely tank SQLite. I've had a simple data collector thing running long enough to have collected 1.7 million rows of very straightforward data and the DB is now 100 megs or so -- and queries to it take forever.",
"sig": "e42297b0456657b6f19e802d0e68ff0c4075fe81248804f0cd748c83e9aae79b6d4a9c0c3be860a3ee8a47fc94f742f9e84f5f81f082218e70dea00cc9dd85cd"
}