Gzuuus on Nostr: Tool calling are just structured outputs, but seems that small models sometimes ...
Tool calling are just structured outputs, but seems that small models sometimes struggle to follow the structure, or get confused. I think this will be solved in the tiny models of the future because standards and over feeding
Published at
2025-04-21 15:51:52Event JSON
{
"id": "df86c57f158a7935fae0749f61f9f190f512544766c8f7207f061d9276bf1d53",
"pubkey": "40b9c85fffeafc1cadf8c30a4e5c88660ff6e4971a0dc723d5ab674b5e61b451",
"created_at": 1745250712,
"kind": 1,
"tags": [
[
"e",
"4246a3ea03a8b516fe06559d5ff5929fa1d994060080f2190bc4e0acef3b4d51",
"",
"root"
],
[
"e",
"9b4879e3d192cf343e5aae7b99f4b5b7525d19ff15f00007bd221fb8fa394fa1"
],
[
"e",
"12686b3250d31e9b2abd21f3ca80b1c3cc46c931208cad806df7763116e7489e",
"",
"reply"
],
[
"p",
"036533caa872376946d4e4fdea4c1a0441eda38ca2d9d9417bb36006cbaabf58"
],
[
"p",
"40b9c85fffeafc1cadf8c30a4e5c88660ff6e4971a0dc723d5ab674b5e61b451"
]
],
"content": "Tool calling are just structured outputs, but seems that small models sometimes struggle to follow the structure, or get confused. I think this will be solved in the tiny models of the future because standards and over feeding ",
"sig": "d0861815d123fee06fb13aea7f8bbe55712fe29bde4b0ac6390b54b85f5b5808c0486d625b15bb35df2d5f3353726c95fe5b2c3fab021e5958ce843ae158bd47"
}
