Baldur Bjarnason on Nostr: I will note that I’m much more sceptical than the author is of copilots. Most of ...
I will note that I’m much more sceptical than the author is of copilots. Most of the studies I’ve seen point to a very high error rate (security flaws, bugs, hallucinating APIs) in copilots, so the question is whether dev self-reports are accurate (studies lag reality) or not (devs are falling for confirmation and automation biases).
Published at
2024-09-01 16:44:33Event JSON
{
"id": "366214602f2df31e42f594a0c788c120bdc828132d596cf7dcaad85818a608cd",
"pubkey": "b8fcf3fa16a90df5527b31715505e245a962248ce8e86cdbf914151bcb9998fc",
"created_at": 1725209073,
"kind": 1,
"tags": [
[
"e",
"8f9863b43e9dbf1143b6a5ebff3934b49b708e85c43c8c45cea056849d74445c",
"",
"root",
"b8fcf3fa16a90df5527b31715505e245a962248ce8e86cdbf914151bcb9998fc"
],
[
"proxy",
"https://toot.cafe/@baldur/113063301843272552",
"web"
],
[
"p",
"b8fcf3fa16a90df5527b31715505e245a962248ce8e86cdbf914151bcb9998fc"
],
[
"proxy",
"https://toot.cafe/users/baldur/statuses/113063301843272552",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://toot.cafe/users/baldur/statuses/113063301843272552",
"pink.momostr"
],
[
"-"
]
],
"content": "I will note that I’m much more sceptical than the author is of copilots. Most of the studies I’ve seen point to a very high error rate (security flaws, bugs, hallucinating APIs) in copilots, so the question is whether dev self-reports are accurate (studies lag reality) or not (devs are falling for confirmation and automation biases).",
"sig": "53bd6bf3d9c6407287b97adad3357c9b3a85e7c9dac0e68428b53b3abc0461b548475b21e4029e163ebc10dc7aed5c963a3e137b579d4ee1f975006db30e2588"
}
