Can we Trust Chatbots for now? Accuracy, reproducibility, traceability; a Case Study on Leonardo da Vinci's Contribution to Astronomy - Réseaux, Informatique, Systèmes de Confiance Access content directly
Preprints, Working Papers, ... Year : 2023

Can we Trust Chatbots for now? Accuracy, reproducibility, traceability; a Case Study on Leonardo da Vinci's Contribution to Astronomy

Abstract

Large Language Models (LLM) are studied. Applications to chatbots and education are considered. A case study on Leonardo's contribution to astronomy is presented. Major problems with accuracy, reproducibility and traceability of answers are reported for ChatGPT, GPT-4, BLOOM and Google Bard. Possible reasons for problems are discussed and some solutions are proposed.
Fichier principal
Vignette du fichier
Chatbots.pdf (282.26 Ko) Télécharger le fichier
Origin Files produced by the author(s)
licence
Copyright

Dates and versions

hal-04078350 , version 1 (23-04-2023)
hal-04078350 , version 2 (23-10-2023)

Licence

Copyright

Identifiers

Cite

Didier El Baz. Can we Trust Chatbots for now? Accuracy, reproducibility, traceability; a Case Study on Leonardo da Vinci's Contribution to Astronomy. 2023. ⟨hal-04078350v1⟩
146 View
38 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More