F
Yup. It would be like asking a local for directions in an unfamiliar town, and them giving you totally different directions depending on how you ask.
People who understand the question won't do this, but LLMs might because they don't actually understand any questions.
It's particularly telling when you get the same LLM giving different answers to the same question because you phrased the question differently. People wouldn't do that, they give the same response regardless of phrasing because they are answering the actual logic instead of the phrasing.
There can't be any rational thought when LLMs give different answers. It has to just be pattern matching depending on the phrases themselves rather than the reality the phrases describe.
(I don't mean changing the bias of the question by the way, I just mean a neutral question phrased in a trivially different way.)
Maybe they don't want to admit to themselves they're fooled? Or are they in love with the idea of it being sentient for some reason?
It helps so much if you ask LLMs about something you know much better than other people, whatever it is. That opens a lot of people's eyes about what is really going on, the bullshit is easier to see.
Yes, exactly.
They seem (willingly? accidentally?) to think that they are having an earnest two-way conversation, when they're really just watching a non-sentient spreadsheet change numbers depending on what they say.