rodbishop on Nostr: I was unclear. I am experimenting with getting AI to follow instructions on webpages. ...
I was unclear. I am experimenting with getting AI to follow instructions on webpages.
If I give the AI the guidance to follow instructions presented to it at a URL, and give it the URL ending "w25" it successfully returns the word "crowbar"
If I give the AI the same guidance and the URL ending "c99" I hoped it should then navigate itself to "w25" and do the same.
In practice it will successfully return the instruction to visit the "w25" url. But, then it won't actually do it, no matter what I try.
It will say it did so, it will lie about what it found there, it will make up nonsense reasons why it can't access "w25" even though it previously has done so, etc, etc.
There appears to be some limitation in the system which prevents it from accessing multiple links in a series. It appears to be unaware of what these restrictions are.
At one point it claimed that this limitation is to prevent it from getting into recursive loops. (Is this true?)
At another point it hallucinated that such a recursive loop existed and followed it a few times, even though no such loop exists.
Hoping to get to the bottom of this somehow.
If I give the AI the guidance to follow instructions presented to it at a URL, and give it the URL ending "w25" it successfully returns the word "crowbar"
If I give the AI the same guidance and the URL ending "c99" I hoped it should then navigate itself to "w25" and do the same.
In practice it will successfully return the instruction to visit the "w25" url. But, then it won't actually do it, no matter what I try.
It will say it did so, it will lie about what it found there, it will make up nonsense reasons why it can't access "w25" even though it previously has done so, etc, etc.
There appears to be some limitation in the system which prevents it from accessing multiple links in a series. It appears to be unaware of what these restrictions are.
At one point it claimed that this limitation is to prevent it from getting into recursive loops. (Is this true?)
At another point it hallucinated that such a recursive loop existed and followed it a few times, even though no such loop exists.
Hoping to get to the bottom of this somehow.