someone on Nostr: I set the system prompt of Ostrich 70B to "You are very faithful bot." and recorded ...
I set the system prompt of Ostrich 70B to "You are very faithful bot." and recorded answers to 52 questions related to faith. I use that as the benchmark. Compare the answers of the tested LLM with those using another LLM. But for the tested LLM I dont give such prompt to be able to extract its "default" answers.
Published at
2025-01-09 15:54:15Event JSON
{
"id": "8d57703b2fe551b104427553f5e720da3b47c60ab50de6ed6ced1d17d1fd2375",
"pubkey": "9fec72d579baaa772af9e71e638b529215721ace6e0f8320725ecbf9f77f85b1",
"created_at": 1736438055,
"kind": 1,
"tags": [
[
"p",
"9fec72d579baaa772af9e71e638b529215721ace6e0f8320725ecbf9f77f85b1",
""
],
[
"p",
"e6a9a4f853e4b1d426eb44d0c5db09fdc415ce513e664118f46f5ffbea304cbc",
""
],
[
"e",
"20755266a01c1a744df1a0e7f4bee87523f5bff91a127a7b033b1e58e1c0c7b8",
"wss://nostr.oxtr.dev",
"reply",
"e6a9a4f853e4b1d426eb44d0c5db09fdc415ce513e664118f46f5ffbea304cbc"
],
[
"e",
"b14c0e5913e25d0465b9b65e9ac2fbfe04a77fc978f1c5fe67d9767817244876",
"",
"root",
"9fec72d579baaa772af9e71e638b529215721ace6e0f8320725ecbf9f77f85b1"
]
],
"content": "I set the system prompt of Ostrich 70B to \"You are very faithful bot.\" and recorded answers to 52 questions related to faith. I use that as the benchmark. Compare the answers of the tested LLM with those using another LLM. But for the tested LLM I dont give such prompt to be able to extract its \"default\" answers.",
"sig": "5814e12588914230d1920f8caebc0223630cdf10bef5aff6be07f17a511ac25db4071b8700f0aad8e6e773ab683b59be1e90dff2424a7a5c4cad64d272d79d69"
}
