udo m. rader ☕ 🇪🇺 🇺🇦 🐧 on Nostr: After playing with #LiteLLM for a while, and struggling with its lack of good ...
After playing with #LiteLLM for a while, and struggling with its lack of good documentation, some very obscure errors and the fact that some of its features such as SSO are hidden behind a USD 30K enterprise license, I stumbled upon #One-API (not to be confused with Intel's OneAPI).
Seems to offer a unified #OpenAI compatible API, multi tenancy and even OAuth.
Going to play with it for the rest of the week :)
#LLM #AI
https://github.com/songquanpeng/one-api/blob/main/README.en.mdPublished at
2024-10-15 22:11:44Event JSON
{
"id": "77bd4352976a1c70ab16a892d402d3c4524130ad99ce7174872487fd2a7c5f48",
"pubkey": "1a66d3c49a66a581c4847a868cd341d6b6fcde04bde34e6ce044c7ae9df51f7f",
"created_at": 1729030304,
"kind": 1,
"tags": [
[
"t",
"litellm"
],
[
"t",
"one"
],
[
"t",
"openai"
],
[
"t",
"llm"
],
[
"t",
"ai"
],
[
"proxy",
"https://sigmoid.social/users/riaschissl/statuses/113313730066142214",
"activitypub"
]
],
"content": "After playing with #LiteLLM for a while, and struggling with its lack of good documentation, some very obscure errors and the fact that some of its features such as SSO are hidden behind a USD 30K enterprise license, I stumbled upon #One-API (not to be confused with Intel's OneAPI).\n\nSeems to offer a unified #OpenAI compatible API, multi tenancy and even OAuth.\n\nGoing to play with it for the rest of the week :)\n\n#LLM #AI\n\nhttps://github.com/songquanpeng/one-api/blob/main/README.en.md",
"sig": "d1874bab784cf0e261d329ff6d93a411ad94674adcbd9fe573c0c48ce1a1289a75fcbcdcdca7baba1b0d1a903b6ac908317ab639272e85c5abbb9338427abe55"
}
