Simon Willison on Nostr: Released a new version of my llm-gguf LLM plugin adding support for GGUF embedding ...

Released a new version of my llm-gguf LLM plugin adding support for GGUF embedding models - which means you can use models like the bafflingly small (30.8MB in its smallest quantization) mxbai-embed-xsmall-v1 model with LLM

https://simonwillison.net/2024/Nov/21/llm-gguf-embeddings/