Steve Troughton-Smith on Nostr: Apple's Neural Engine evidently doesn't count for a whole lot if even basic on-device ...
Apple's Neural Engine evidently doesn't count for a whole lot if even basic on-device LLM text generation only works on an iPhone 15 Pro or M-series iPad? We're still in a situation where any developer who wants to actually make use of AI in their apps is going to need to integrate OpenAI's web API anyway, sending all your requests to the cloud, so all of Apple's privacy talk means nothing 🫠 Why even launch like this? I am baffled by the WWDC announcements
Published at
2024-06-11 02:34:20Event JSON
{
"id": "255dda63a86bc43208c1633b6a5cb1fcf223bd7f6f2e9c35438e22dab225d90e",
"pubkey": "d24206613793725d8e4745561d07a56cfeb9dbe534fc46e0a9b2d159b0bc9ad0",
"created_at": 1718073260,
"kind": 1,
"tags": [
[
"proxy",
"https://mastodon.social/users/stroughtonsmith/statuses/112595649232332720",
"activitypub"
]
],
"content": "Apple's Neural Engine evidently doesn't count for a whole lot if even basic on-device LLM text generation only works on an iPhone 15 Pro or M-series iPad? We're still in a situation where any developer who wants to actually make use of AI in their apps is going to need to integrate OpenAI's web API anyway, sending all your requests to the cloud, so all of Apple's privacy talk means nothing 🫠 Why even launch like this? I am baffled by the WWDC announcements",
"sig": "b96b3ab8b9df2c0ef7488a68ae8542c1adca763597351702a3ccf4b966e7992cc531862e8a876ef7b6979f5bf3799e4802458499bd982ffbe23db21f4cc6a2ad"
}