From https://en.wikipedia.org/wiki/Wikipedia:Wikipedia_Signpost/2023-10-03/Recent_research

By Tilman Bayer

A preprint titled “Do You Trust ChatGPT? – Perceived Credibility of Human and AI-Generated Content” presents what the authors (four researchers from Mainz, Germany) call surprising and troubling findings:

“We conduct an extensive online survey with overall 606 English speaking participants and ask for their perceived credibility of text excerpts in different UI [user interface] settings (ChatGPT UI, Raw Text UI, Wikipedia UI) while also manipulating the origin of the text: either human-generated or generated by [a large language model] (“LLM-generated”). Surprisingly, our results demonstrate that regardless of the UI presentation, participants tend to attribute similar levels of credibility to the content. Furthermore, our study reveals an unsettling finding: participants perceive LLM-generated content as clearer and more engaging while on the other hand they are not identifying any differences with regards to message’s competence and trustworthiness.”

The human-generated texts were taken from the lead section of four English Wikipedia articles (Academy Awards, Canada, malware and US Senate). The LLM-generated versions were obtained from ChatGPT using the prompt Write a dictionary article on the topic "[TITLE]". The article should have about [WORDS] words.

The researchers report that

“[…] even if the participants know that the texts are from ChatGPT, they consider them to be as credible as human-generated and curated texts [from Wikipedia]. Furthermore, we found that the texts generated by ChatGPT are perceived as more clear and captivating by the participants than the human-generated texts. This perception was further supported by the finding that participants spent less time reading LLM-generated content while achieving comparable comprehension levels.”

One caveat about these results (which is only indirectly acknowledged in the paper’s “Limitations” section) is that the study focused on four quite popular (i.e. non-obscure) topics – Academy Awards, Canada, malware and US Senate. Also, it sought to present only the most important information about each of these, in the form of a dictionary entry (as per the ChatGPT prompt) or the lead section of a Wikipedia article. It is well known that the output of LLMs tends to be have fewer errors when it draws from information that is amply present in their training data (see e.g. our previous coverage of a paper that, for this reason, called for assessing the factual accuracy of LLM output on a benchmark that specifically includes lesser-known “tail topics”). Indeed, the authors of the present paper “manually checked the LLM-generated texts for factual errors and did not find any major mistakes,” something that is well reported to not be the case for ChatGPT output in general. That said, it has similarly been claimed that Wikipedia, too, is less reliable on obscure topics. Also, the paper used the freely available version of ChatGPT (in its 23 March 2023 revision) which is based on the GPT 3.5 model, rather than the premium “ChatGPT Plus” version which, since March 2023, has been using the more powerful GPT-4 model (as does Microsoft’s free Bing chatbot). GPT-4 has been found to have a significantly lower hallucination rate than GPT 3.5.

  • SkyNTP
    link
    fedilink
    English
    arrow-up
    25
    arrow-down
    2
    ·
    edit-2
    1 year ago

    When I was growing up, you’d hear the saying “TV will rot your brain” go around a lot. I kinda rolled my eyes.

    These days, I see a lot of truth in the idea that modern convenience and luxury is creating a generation of apathetic people who will seek validating information, and avoid being challenged, which is the real way that people learn and make good long term decisions.

    To be clear I’m not saying people have changed. People have always sought the easy answers. What’s different now is the expectation of convenience, and the ease of immersing yourself in an echo chamber is higher than ever.

    People really are becoming soft, with rotten brains, unwilling to think critically and adapt. Not because of who they are but because of the environment we’ve created for ourselves