The aim of this paper is to examine the use of chatbots in academic settings, focus-ing on certain aspects of the reliability of bibliographies generated by artificial intelligence (AI). This study uses data obtained from querying ChatGPT 3.5 and Bard to produce a bibli-ography on a specific topic (Open Access Books). The analysis of the query results, along with comparisons to similar studies, has highlighted the low level of accuracy in the bibliographic citations generated by chatbots and the prevalence of phenomena such as hallucinations and confabulations in AI, which can affect the accuracy of the information. The chatbots use real author and editor names and existing titles that are consistent with the prompt terms, but they frequently use them incorrectly.

Sull’affidabilità delle bibliografie generate dai chatbot. Alcune considerazioni

andrea capaccioni
2024

Abstract

The aim of this paper is to examine the use of chatbots in academic settings, focus-ing on certain aspects of the reliability of bibliographies generated by artificial intelligence (AI). This study uses data obtained from querying ChatGPT 3.5 and Bard to produce a bibli-ography on a specific topic (Open Access Books). The analysis of the query results, along with comparisons to similar studies, has highlighted the low level of accuracy in the bibliographic citations generated by chatbots and the prevalence of phenomena such as hallucinations and confabulations in AI, which can affect the accuracy of the information. The chatbots use real author and editor names and existing titles that are consistent with the prompt terms, but they frequently use them incorrectly.
2024
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11391/1584393
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact