Andrej Karpathy / @karpathy (RSS Feed) on Nostr: Good / slightly obscure tip is that applications can benefit from custom supervised ...

Good / slightly obscure tip is that applications can benefit from custom supervised finetuning of emebeddings returned by APIs. Collect a few examples of +ve (and optionally hard -ve) pairs, use them to train a linear projection that better discriminates your pairs.

nitter.moomoo.me/sergeykarayev/status/1679172757722988544#m (https://nitter.moomoo.me/sergeykarayev/status/1679172757722988544#m)

https://nitter.moomoo.me/karpathy/status/1679463907344146438#m