Chi Kim on Nostr: Does anyone have a recommendation for #LlamaCPP alternative to run recent vision ...
Does anyone have a recommendation for #LlamaCPP alternative to run recent vision language models on Apple Silicon? Llama.cpp doesn't support any of the recent #VLM such as Qwen2-VL, Phi-3.5-vision, Idefics3, InternVL2, Yi-VL, Chameleon, CogVLM2, GLM-4v, etc.
Minicpm-v 2.6 is the only recent model that was added. Maybe time to move on. :( #LLM #multimodal #AppleSilicon #MacOS #ML #AI
Published at
2024-09-09 15:33:44Event JSON
{
"id": "edaf4b7b01ff214e8e22647d9d7c4de5bb26e05e2ea4652d70a8fe9d29808610",
"pubkey": "9bae200856dfd9681a9424eaf3ad571f2c812635728d2d1f54b5a9439d6b3933",
"created_at": 1725896024,
"kind": 1,
"tags": [
[
"t",
"llamacpp"
],
[
"t",
"vlm"
],
[
"t",
"llm"
],
[
"t",
"multimodal"
],
[
"t",
"AppleSilicon"
],
[
"t",
"macos"
],
[
"t",
"ml"
],
[
"t",
"ai"
],
[
"proxy",
"https://mastodon.social/users/chikim/statuses/113108321830665568",
"activitypub"
]
],
"content": "Does anyone have a recommendation for #LlamaCPP alternative to run recent vision language models on Apple Silicon? Llama.cpp doesn't support any of the recent #VLM such as Qwen2-VL, Phi-3.5-vision, Idefics3, InternVL2, Yi-VL, Chameleon, CogVLM2, GLM-4v, etc.\n Minicpm-v 2.6 is the only recent model that was added. Maybe time to move on. :( #LLM #multimodal #AppleSilicon #MacOS #ML #AI",
"sig": "1924280dc9cbfcc7b9850bc97c0696559ecdee9ba20377b2deacd638d28c2dede57aade7054ca116bbbe3f109b5d737aa1660eb3f53a56b579265ee554fe25b9"
}
