LLMs produce bullshit (by the accepted philosophical definition). Published two years ago this month, the idea deserves wider distribution.
“When [LLMs] produce incorrect information, it is not due to a deliberate intent to deceive (as in lying) or a faulty perception (as in hallucinating). Rather, it is because they are designed to create text that looks and sounds right without any intrinsic mechanism for ensuring factual accuracy,” according to Psypost.org’s summary of the academic work.
LLMs do not have intent or agency. One must not commit the Pathetic Fallacy. But, effectively, LLMs bullshit because their responses disregard the truth of their statements–they are only programmed to please and to simulate accuracy. In short, bullshit. LLMs don’t deliberately lie, they just don’t “know” the truth. LLMs aren’t programmed to determine truth or falsity; that is not a design goal.
Unlike an LLM, I brandish my sources instead of burying them.
SOURCES:
Plain language summary by Psypost.org: Scholars: AI isn’t “hallucinating” it’s bullshitting (June 2024), describing the academic paper ChatGPT is bullshit (June 2024), 1which takes its definition from the widely cited2 Philosophical/Academic definition of Bullshit (2005) by moral philosopher Harry Frankfurt (which precedes a current prominent political bulllshiter by more than a decade, so can’t be considered a mere reflection of current events)