PPQdotAI on Nostr: What is probably causing the progressively higher price is that you went into the ...
What is probably causing the progressively higher price is that you went into the settings and adjusted your max context up higher than it needs to be. As your conversation gets longer, it takes more and more context into account.
Most users just keep the context to 1024 in their settings. This prevents the cost from getting higher and higher.
Another way to solve this is to start new conversations each time you change your topic. This will reset the context tokens and will cost much less.
Does it make sense?
Published at
2024-12-25 17:19:19Event JSON
{
"id": "28e3056a4bd5e7034800ca1ee97f38baac8b9e42c4d8d27f6f5ecea2c1ff4c79",
"pubkey": "d22bcdb1d2505bc060f65a86cd5f20532ec5f3e41c06aea9edac39f6ba76fd6e",
"created_at": 1735147159,
"kind": 1,
"tags": [
[
"e",
"79ce94924ca28af2b394f5880966d7a0e392f3a2ce380b4d7d1cd2553aa6dc9f",
"",
"root"
],
[
"e",
"944f11a294f28972fcf9da42cfe2690c1a6e1fcdecb9b094d6f247aed1e7b9b3",
"",
"reply"
],
[
"p",
"2f52b19fe1408f69ee0e909ed8fcac138c5f370c05de24f0d8370ada79752323"
],
[
"p",
"d22bcdb1d2505bc060f65a86cd5f20532ec5f3e41c06aea9edac39f6ba76fd6e"
]
],
"content": "What is probably causing the progressively higher price is that you went into the settings and adjusted your max context up higher than it needs to be. As your conversation gets longer, it takes more and more context into account.\n\nMost users just keep the context to 1024 in their settings. This prevents the cost from getting higher and higher.\n\nAnother way to solve this is to start new conversations each time you change your topic. This will reset the context tokens and will cost much less.\n\nDoes it make sense? https://m.primal.net/NGSA.png ",
"sig": "d8a3e33ee769ed399f6b40016f4b2b28a983002973b7ef91c8a654854983721b5eb1b31773ebcce9ad563c4a42f5e0402db3257dc1b2e6a9cf1a945f8abd79e1"
}