Miguel Afonso Caetano on Nostr: "In more detail, the researchers "engineered a system called WikiCrow, which ...

"In more detail, the researchers "engineered a system called WikiCrow, which generates cited Wikipedia-style articles about human protein-coding genes by combining several PaperQA2 calls on topics such as the structure, function, interactions, and clinical significance of the gene." Each call contributes a section of the resulting article (somewhat similar to another recent system, see our review: "STORM: AI agents role-play as 'Wikipedia editors' and 'experts' to create Wikipedia-like articles"). The prompts include the instruction to "Write in the style of a Wikipedia article, with concise sentences and coherent paragraphs".

With an average cost of $5.50, the generated articles tended to be longer than their Wikipedia counterparts and had higher quality, at least according to the paper's evaluation method:"

https://meta.wikimedia.org/wiki/Research:Newsletter/2024/September#%22Wikicrow%22_AI_less_%22prone_to_reasoning_errors_(or_hallucinations)%22_than_human_Wikipedia_editors_when_writing_gene_articles