Adam Bell :catPOWER: on Nostr: Considering LLMs are effectively lossy compressed databases of their training data, ...

Considering LLMs are effectively lossy compressed databases of their training data, would it be unreasonable to assume one could run an LLM locally as a bad™ offline search index?

Take some open source model, throw in the contents of all Swift / Objective-C frameworks documentation, and now you'd have something you can ask questions to without network access (e.g. on a plane)… right?

I mean, assuming it doesn't just completely make shit up and send you on a wild goose chase