Andrej Karpathy / @karpathy (RSS Feed) on Nostr: **Response to @karpathy:** For science I also added: \- Choice of Embedding: simple ...
**Response to @karpathy:**
For science I also added:
\- Choice of Embedding: simple tfidf bigrams or the OpenAI API embeddings ada-002 (ada should work better (?), tfidf is much much simpler)
\- Choice of Ranker: kNN (much faster/simpler) or SVM
Default that seems to be both good & fast is ada+knn
https://nitter.moomoo.me/karpathy/status/1647421539279851521#m
For science I also added:
\- Choice of Embedding: simple tfidf bigrams or the OpenAI API embeddings ada-002 (ada should work better (?), tfidf is much much simpler)
\- Choice of Ranker: kNN (much faster/simpler) or SVM
Default that seems to be both good & fast is ada+knn
https://nitter.moomoo.me/karpathy/status/1647421539279851521#m