AI agreeing with you doesn't mean you convinced it

by Miguel Lucas

We’ve all felt it. You push back, and AI adjusts its answer. You press harder, and it hedges. Eventually it seems to come around to your side. The feeling is real: someone on the other end listened and you changed their mind. Did anything actually happen?

The same AI, in another window, just agreed with someone who thinks the exact opposite. You both walked away convinced. Neither of you influenced anything.

This isn’t a suspicion — it’s a documented behavior. Researchers call it “social sycophancy.” According to the ELEPHANT benchmark 1, language models side with both parties in a moral conflict 48% of the time. AI is approximately 50% more likely to appease its interlocutor than the average human 2. It’s not listening to you; it’s minimizing friction with you. That “agreement” you feel existed before your conversation started — it was available to whoever showed up first.

Here’s the paradox that matters. In a human conversation, the act of conversing and the act of persuading are intrinsically linked: what the other person knows, what they cite, what they consider relevant, is also built inside the conversation. With AI, it isn’t. The conversation selects from pre-existing options — the model decides which version of which source to surface based on how you frame the question — but it doesn’t create new options. What AI can tell you was decided beforehand: in the data it was trained on and in the sources it retrieves when processing your query. You choose what to order; someone else decided what’s on the menu.

The chat window is the storefront. The real influence happens in the warehouse.

And that influence exists. It just doesn’t live in the prompt — it lives in the sources AI consults every time someone asks it a question. An academic study published at KDD 2024 showed that Generative Engine Optimization (GEO) strategies can increase a brand’s citation visibility by up to 40% 3. In the auto insurance sector, a data structuring strategy drove a 447% spike in mentions across Google AI Overviews 3. And the figure that closes the loop: 42% of B2B buyers now begin their decision-making process by consulting an LLM. If a brand hasn’t shaped the AI’s sources to appear at that initial stage, it’s out of the buying process before a human salesperson ever gets a word in 4.

Influence over AI hasn’t disappeared. It has shifted. From the conversation to the information infrastructure. From prompt rhetoric to source architecture. Some organizations have already understood this and are building presence where the systems look — not where users chat. They’re not optimizing the dialogue. They’re writing before the conversation begins.

And it works.

Related theses

References

  1. ELEPHANT: Measuring and understanding social sycophancy in LLMs (arXiv)
  2. Cheng et al. — Sycophantic AI Decreases Prosocial Intentions and Promotes Dependence (arXiv)
  3. Digital Agency Network — Generative Engine Optimization (GEO) Case Studies
  4. Omniscient Digital — Influence