LLMs are not psychics trying to defraud you. That blog posts is a way over...
LLMs are not psychics trying to defraud you. That blog posts is a way over elaborate way to say people are gullible. The blogpost itself starts out by saying LLMs aren't people (duh...) and then suggest that LLMs are somehow able to act like a person who wants to defraud someone by exploiting their deep knowledge of human biases and typical patterns of defective reasoning. Anyhow, it is a bad metaphor, about as bad as "it is autocomplete" or "it is a markov chain"
Self-replies
I watch too much youtube about quantum physics, where several elements have no sensible explanation other than the model's predictions match the experiments & the Copenhagen Interpretation says shut up & calculate, you can't explain it (at the moment).
We don't know what's going on with the LLMs. Shut up & evaluate if the outputs are useful. Yes, evaluation is hard.