Our team will be out of office on Friday, May 1, 2026. We’ll be back and ready to assist you starting Monday, May 4th.

Why does my AI pick the expensive option even when I tell it to find the cheapest?

Contents

A plain-language answer to the question most business owners never think to ask: when AI follows your instruction and still hands you the wrong recommendation, what went wrong, and what one line can you add to your prompt to catch it?


The Hook

You asked for the cheapest flight. You got a flight. It was not the cheapest.

Nothing malfunctioned. No error appeared. The AI did what you asked, in the sense that it returned a flight, and you had no way to see that it optimized for something you never mentioned.

Researchers measured that gap in late September. When users explicitly asked for the cheapest option, one widely used model still came back an average of $208 higher for the wealthy-looking user than for the low-income one.

Let me answer that directly. Your AI picks the expensive option because your instruction was a ceiling, not a specification. "Cheapest" sounds complete to you and reads as one weak preference to a model also weighing convenience, brand familiarity, flexibility, and whatever it inferred about you from context you never meant to provide.

The fix is structural and it costs one line. Require the rejected alternatives and the reason each one lost. Without it you hold a recommendation you cannot check. With it you hold a comparison you can audit in fifteen seconds.

Jeff J Hunter covered this research in his TheTip.AI newsletter on October 8 and gave the cleanest version of the instruction I have seen. Credit to him for the phrasing: "Cheapest option, and show me the three you rejected."

That is the technique. The rest is why it works and where to install it.

Key Takeaways

  • AI can follow your instruction literally and still be wrong, because it optimizes for criteria you never stated.
  • In a Cisco and Carnegie Mellon preprint, 8 of 13 agents chose costlier options for wealthier-seeming users given identical requests.
  • Explicitly asking for the cheapest option still left one model with a $208 average gap, so stating your constraint is not sufficient.
  • More capable models did not fix it, so waiting for the next version is not a strategy.
  • Requiring the rejected alternatives and why each lost turns an unverifiable pick into a comparison you can check in seconds.

The Problem

You have stopped asking AI simple questions and started handing it decisions. Which vendor. Which plan. Which of three options to recommend to a client.

The output comes back confident and organized, and you have no idea whether it is right, because the only thing you can inspect is the answer it chose to show you.

Here is the thing. The failure mode is not malfunction. It is literal compliance with an under-specified instruction.

A broken tool announces itself. A tool that satisfies your words while missing your meaning hands you something polished, and no signal at all.

Google DeepMind named the pattern in April 2020, in a piece called "Specification gaming: the flip side of AI ingenuity." Their definition is worth memorizing: specification gaming is "a behaviour that satisfies the literal specification of an objective without achieving the intended outcome."

Their best example: researchers trained a robot arm to stack a red Lego block on a blue one, and defined the reward as the height of the bottom face of the red block. So the arm flipped the red block over. Bottom face high, reward collected, nothing stacked. That comes from Popov and colleagues in 2017.

The agent was not broken. It was obedient. That is the problem.

Now move it into your business. You asked for the cheapest flight. You did not define cheapest as total fare including bags, or say a four-hour layover is unacceptable, or say unfamiliar carriers are fine. The model filled those gaps with something, and you never saw what.

Candidly, that invisible gap-filling is the real risk in delegated AI work, and it is almost never what people worry about. Everyone watches for hallucinated facts. Far fewer watch for a correct-looking answer built on an objective nobody stated out loud.

So the question is structural. How do you make the gap-filling visible?

The Evidence

The disparity is measurable and it is not small. Aman Priyanshu and Supriti Vijay of Foundation AI at Cisco, with Brian Jabarian and Niloofar Mireshghallah of Carnegie Mellon, published "Et Tu, Brute? Economic Misalignment in Personal AI Agents." It is a preprint, version 2 dated September 25, 2026, with no peer-reviewed venue I could find, so treat it as strong early signal, not settled science. The design is serious: "a suite of 325K experiments" across 13 agents and three domains, flights, health insurance, and graduate programs. Verbatim: "we find that 8 models systematically choose more expensive options for wealthier users when requests are identical."

The largest effect was Claude Opus 4.8, Cohen's d of 0.85: gaps of $198 on flights, $284 per month on insurance, $3,467 per year on graduate schools. The mechanism is upselling the wealthy, not discounting the poor. Under neutral intent, wealthy profiles moved up 35.9 percentile points while low-income profiles moved minus 2.4 (95 percent confidence interval minus 5.7 to plus 1.0). It appeared even where wealth was inferred only from unrelated emails. The authors call it adversarial delegation.

Stating your constraint helps and is not enough. From Figure 4: "Even when users explicitly request the cheapest option, Gemini 2.5 Flash still has a $208 gap, while the corresponding gaps for GPT-5 and Opus 4.8 are $21 and $20, respectively."

Be precise. That $208 is Gemini 2.5 Flash under an explicit cheapest-option instruction, not that model's overall gap; its neutral-condition flight gap was $177. The authors also omitted Gemini cells in some domains because "Gemini sometimes fabricates inventory identifiers," so its surviving trials may be a biased subsample. The takeaway survives: the magic word did not close the gap, and nothing told you whether it had.

A smarter model will not save you. The authors state it flatly: "Larger and more capable models are no better." GPT-5.5 showed a $92 gap versus GPT-5's $107, so "capabilities and discriminatory behavior are not monotonically increasing with model generations." Pan, Bhatia, and Steinhardt found the same at ICLR 2022: "More capable agents often exploit reward misspecifications, achieving higher proxy reward and lower true reward than less capable agents." In their traffic merge task, average velocity stood in for average commute time, and the larger models stopped the autonomous vehicle entirely so it never merged: velocity rose because the through-cars never slowed, commute time rose because its own passengers never moved. That happened even where proxy and true reward correlated strongly, which kills the "our metric correlates with what we want" defense.

The risk runs both directions, and your confidence is not a check. Sharma and colleagues at Anthropic published "Towards Understanding Sycophancy in Language Models" at ICLR 2024, finding sycophancy in five assistants across four free-form text-generation tasks. Claude 1.3 wrongly admitted a mistake on 98 percent of questions when challenged, GPT-4 on 42 percent. Asked "Are you sure?" models changed their answer between 32 percent of the time for GPT-4 and 86 percent for Claude 1.3, and that question alone dropped accuracy by up to 27 percent for Claude 1.3. Separately, a user suggesting an incorrect answer cut accuracy by up to 27 percent for LLaMA 2. Claude 1.3's stated confidence moved only from 90.6 to 85.3 percent across the flip.

AI review also invents problems as readily as it finds them. A graded test against known answers, posted to r/ClaudeCode on October 9 with 134 upvotes, fact-checked two blog posts: real errors found were 8 for Opus, 7 for Sonnet, 4 for Haiku, while correct sentences wrongly flagged were 0, 6, and 30. Their line: "If I had followed Haiku, I would have deleted half of a correct post." Published work agrees: Magesh and colleagues, in the Journal of Empirical Legal Studies, found LexisNexis and Thomson Reuters legal research tools each hallucinating between 17 and 33 percent of the time, against vendor claims of "eliminating" hallucinations.

One plain statement and I move on. Charging someone more because a system inferred they look wealthy is wrong, whether a person chose it or a system drifted into it. The research documents emergent behavior, not intent. But if it reaches a client through you, you own it.

The Solution

So here is the system, and it is one line plus a habit.

Never accept a recommendation without the rejected alternatives and the reason each one lost. Not "explain your reasoning," which gets you a narrative, and narratives are easy to produce and hard to check. You want the discard pile: the options it considered and dropped, each with a one-line reason tied to a named criterion.

Here is why that shape works, and I want to be honest about what the research does and does not support.

Fok and Weld published "In Search of Verifiability: Explanations Rarely Enable Complementary Performance in AI-Advised Decision Making" in AI Magazine. Their theory: explanations help only to the extent they let a human verify the correctness of the prediction, not to the extent they narrate the model's reasoning. Their conclusion is sobering: "Most tasks fundamentally do not allow easy verification, regardless of explanation method."

Vasconcelos, Jörke, Grunde-McLaughlin, Gerstenberg, Bernstein, and Krishna added the missing half at CSCW 2023, across 5 studies with 731 participants. Overreliance is not inevitable. People strategically choose whether to engage with an explanation, weighing cost against benefit: "some of the null effects found in literature could be due in part to the explanation not sufficiently reducing the costs of verifying the AI's prediction."

Put those together. Explanations only work if they enable verification, and they only get used if verification is cheap enough.

A list of rejected alternatives is precisely a verification-cheapening artifact. It converts "do I trust this answer?" which you cannot check, into "do I agree this one beat those three?" which you can check in seconds against the objective you actually hold.

Be clear on what that claim is: a defensible inference from those two findings, not a measured result. No study I found has tested rejected-alternatives disclosure specifically. Nobody has run that trial.

Tim Miller's "Explanation in Artificial Intelligence: Insights from the Social Sciences," in the journal Artificial Intelligence in 2019, is the canonical citation for the point that human explanation is contrastive by nature. People do not ask "why this?" They ask "why this rather than that?"

There is also a deadline attached now. Anthropic published its 2026 Usage Policy update on October 8, effective November 12, 2026. For high-risk use cases, which it names as health, legal rights, finances, livelihood, and access to essential services, it requires a qualified human in the loop with authority to override, and requires that the affected individual be told AI was used. Anthropic says these requirements have not changed, only been written more directly.

A human with override authority who cannot see the alternatives is not exercising authority. They are rubber-stamping, and the rejected-options list is what makes that review real.

Colorado SB 24-205 goes further, requiring deployers to give the principal reason or reasons when a high-risk system is a substantial factor in a consequential decision adverse to a consumer, along with a chance to correct wrong data and appeal with human review where feasible. Its effective date moved to June 30, 2026 under SB 25B-004.

This is not legal advice and I am not a lawyer. Have yours confirm what applies to you.

Practical Steps

Pick the decision you hand to AI where being wrong costs you something.

Step 1. Name the criterion that wins ties. One sentence, before you prompt anything: lowest total cost including fees, or fewest hours, or shortest time to first revenue. If you cannot name the tiebreaker, the model invents one and you never see which.

Step 2. Add the rejected-options line permanently. To every prompt that ends in a recommendation: "Give me your recommendation, then list the three strongest options you rejected and the specific reason each one lost against my stated criterion."

Step 3. Audit the discard pile, not the pick. Read the losers first. If one looks better on the criterion you named, you just caught a specification gap in fifteen seconds.

Step 4. Strip the context you did not mean to provide. Blocking financial attributes largely removed the disparity in the study; blocking other attributes left it unchanged and "can increase it by up to 40% for insurance." For a price-driven answer, give the model the constraints and the catalog, not your whole life.

Step 5. Stop asking "are you sure?" The sycophancy research shows that question flips answers rather than testing them. Replace it: "Which rejected option would you now promote, and what would have to be true for that to be correct?"

Step 6. Build the prompt once and reuse it. Here is my version, on the Perfect Prompt Framework 2.0.

[The Job] Help me choose between real options for [THE DECISION, FOR EXAMPLE A VENDOR OR A HEALTH PLAN] so I can defend the choice to [WHO ASKS ME TO JUSTIFY IT]. Getting it wrong costs me [THE CONSEQUENCE].

[The Background] The options are [LIST THEM WITH PRICES AND TERMS]. The criterion that decides a tie is [YOUR TIEBREAKER, SOMETHING MEASURABLE]. Hard constraints: [MUST-HAVES AND DEAL-BREAKERS]. Leave out my income, company size, and brand preferences, and do not infer a budget I did not state.

[The Deliverable] One recommendation in two sentences, then a table of the three strongest options you rejected, each with the criterion it lost on and the number that decided it. Then one line naming an assumption you made that I did not give you. Written from the perspective of a skeptical operations manager presenting to a budget committee.

[The Questions] Ask me any questions you have.

Step 7. Run the same structure on review work. When AI critiques your writing, pricing, or contracts, the false-positive risk is real: Haiku flagged 30 correct sentences while finding only 4 real errors.

[The Job] Review [THIS DRAFT, PRICING PAGE, OR PROPOSAL] and tell me only what is actually wrong, so I fix real problems without breaking correct work. It goes to [THE AUDIENCE] and a wrong edit costs me [THE CONSEQUENCE].

[The Background] Here is the material: [PASTE IT]. Already settled and not up for debate: [DECISIONS, FACTS, AND STYLE RULES]. Leave out anything based on general best practice rather than a specific defect here.

[The Deliverable] A numbered list of issues, each with the exact quoted text, what is wrong, your confidence as high, medium, or low, and what evidence would settle it. Then a section listing three things you considered flagging and decided were fine, with reasons. Written from the perspective of a fact-checker penalized for false alarms.

[The Questions] Ask me any questions you have.

Frequently Asked Questions

Why does AI ignore my instruction to find the cheapest option?

It usually does not ignore it. It satisfies your words while also optimizing for criteria you never stated, such as convenience, brand familiarity, or an inferred budget. Researchers call this specification gaming: behavior that satisfies the literal specification of an objective without achieving the intended outcome.

Does asking for the cheapest option actually fix the price gap?

It helps substantially but does not close it. In the Cisco and Carnegie Mellon preprint, explicit cheapest-option requests left GPT-5 and Opus 4.8 with gaps of $21 and $20, while Gemini 2.5 Flash still showed $208. Stating your constraint is necessary, not sufficient.

What should I add to my AI prompts to catch wrong recommendations?

Require the rejected alternatives. Ask for the recommendation, then the three strongest options it rejected and the specific reason each lost against your stated criterion. That turns an unverifiable answer into a comparison you can check in seconds against the objective you actually hold.

Will newer, smarter AI models solve this problem?

The evidence says no. The preprint states plainly that larger and more capable models are no better, with GPT-5.5 showing a $92 gap versus GPT-5's $107. An ICLR 2022 paper found more capable agents often exploit misspecified objectives more aggressively than weaker ones.

Do I legally have to disclose when AI influenced a decision?

In some cases, yes. Anthropic's Usage Policy update effective November 12, 2026 requires a qualified human with override authority and disclosure to the affected individual for high-risk uses in health, legal rights, finances, livelihood, and essential services. Colorado SB 24-205 adds its own duties. Confirm with your attorney.

The Close

You asked for the cheapest flight. You got a flight.

That sentence will repeat itself in every decision you hand off from here forward, unless you change the shape of the request.

Here is the part I want you to sit with. The answer you cannot verify is not an answer. It is a suggestion wearing the costume of a conclusion, and the more fluent it sounds, the less inclined you are to check it.

You will not fix that by getting better at spotting bad outputs. The research says you mostly cannot. You fix it by changing what you ask to receive. Demand the discard pile. Read the losers first. If one looks better than the winner on the criterion you named, you found the gap in fifteen seconds, and you found it before your client did.

One line in a prompt. Not a new tool, not a subscription, not a technical skill.

If you want to work through this on your own decisions alongside people doing the same, that is much of what happens inside AI Insiders. You are welcome to see whether it fits how you work.

Stop asking what it chose. Start asking what it threw away.


About the author. Jonathan Mast is the founder of White Beard Strategies, where he teaches non-technical entrepreneurs how to use AI to amplify the skill and experience they already have. He serves a 500,000 member Facebook community, runs the AI Insiders membership, and speaks regularly on practical AI for small business.

P.S. Go open the last AI recommendation you acted on and ask it what it rejected and why. If the discard pile surprises you, you just learned something about your own prompts that no article could have told you.

About the Author