What is Nostr?
Martijn Faassen /
npub1v9k…zql0
2024-11-01 17:26:46

Martijn Faassen on Nostr: Concerning how much code is written by LLMs, how is this measured? If it's based on ...

Concerning how much code is written by LLMs, how is this measured? If it's based on the dev accepting an LLM code block then that's a highly flawed metric. I often accept, then modify completely.

A more sophisticated way to measure this would be to remember the suggestions and somehow diff with what is committed.

Or tracking for each character who first wrote it, LLM or human.

Maybe I am missing a simple trick by which this can be measured

#llm #programming.
Author Public Key
npub1v9kpktd0rtpd8p9f5yn236w3ayavwqykp0hg728g2hqx7kfc068qp0zql0