Scott Williams 🐧 on Nostr: Today, I duct taped together a web scraper in go and some terrible python code to ...
Today, I duct taped together a web scraper in go and some terrible python code to populate a Chroma DB and use it as a RAS to make an LLM that's specific to my employer and runs entirely on my laptop, using the integrated AMD GPU.
It works, but my laptop was very unhappy about this.
Published at
2024-07-20 01:32:52Event JSON
{
"id": "39b96c06700fdd6b6204ccd6242624d06d737a38e941f30143347098224b0382",
"pubkey": "beee28c6450eb5d21bf94279d1f3f41e524c87abf86393835b45e6a1e98390e7",
"created_at": 1721439172,
"kind": 1,
"tags": [
[
"proxy",
"https://mastodon.online/users/vwbusguy/statuses/112816237588071844",
"activitypub"
]
],
"content": "Today, I duct taped together a web scraper in go and some terrible python code to populate a Chroma DB and use it as a RAS to make an LLM that's specific to my employer and runs entirely on my laptop, using the integrated AMD GPU. \n\nIt works, but my laptop was very unhappy about this.",
"sig": "6f5a273ce24e352397e504d652ae67cf757b192a76623a2bb231f4f45e978342f3f124333faab2e0792bb77167e7c171b09db602da807ce33289019f6e71ed5a"
}
