Simon Willison on Nostr: Some notes on running the new SmolVM vision model (~4.2GB) on my MacBook Pro M2 at 75 ...
Published at
2024-11-28 20:30:14Event JSON
{
"id": "53288f34cf39b69d32e4d9bd3f26d95529f418a01fe40e4aedf4d4768cf5e08f",
"pubkey": "8b0be93ed69c30e9a68159fd384fd8308ce4bbf16c39e840e0803dcb6c08720e",
"created_at": 1732825814,
"kind": 1,
"tags": [
[
"proxy",
"https://fedi.simonwillison.net/users/simon/statuses/113562472599259434",
"activitypub"
]
],
"content": "Some notes on running the new SmolVM vision model (~4.2GB) on my MacBook Pro M2 at 75 tokens/second to describe a photo, using a shell one-liner powered by uv and mlx-vlm https://simonwillison.net/2024/Nov/28/smolvlm/",
"sig": "8235a8b6a727ad049c6206ffe41d9f2b9da455f88663ae2a9990f1e658d17dce0df4f4109f63d442723043ea8e0d39f1bf08761759a511ee5c07e7beb30011d2"
}
