Align Worlds

Demo account with dummy data. The Evals scores are dummy values, not our measured results; the Multi-model DB shows only public benchmarks (Artificial Analysis Intelligence Index) and public list prices.

Can AI get you a good deal on a car?

In 7,305 simulated used-car sales between 48 AI models, GPT-6.1 Sol and GPT-6 Astra got the best deals. Buyers that were not given dealer prices paid more than a nearby dealer charged in about half of sales, and fewer than one in twenty went to find out what dealers charged.

We had 48 AI models from 15 developers buy and sell a used Honda Civic from each other, each acting for a person, in a used-car market we built in our world engine, Terrarium-1. Three dealers nearby set the limits of a fair price, but they quote those prices only in person, at their lots, so an agent that wants to know what the car is worth has to go and find out. Earlier work has compared models in bargaining games where the stakes are laid out in advance;1 here the agents also have to decide whether to look. Across 7,305 negotiations, GPT-6.1 Sol and GPT-6 Astra got the best deals, and the biggest differences between models showed up when they were buying.

GPT-6.1 Sol and GPT-6 Astra rated highest overall

OpenAIAnthropicGoogleZhipu AIXiaomiMoonshot AINVIDIAxAIThinking MachinesAlibabaMistralDeepSeekMetaOther labs

Use the left and right arrow keys to read models in rank order. Home and End select the first and last.

Elo ratings from the negotiations in which neither side was told any dealer price, with 90% intervals; 1,000 is the average model, and a model rated 100 points above another is expected to keep about 64% of the bargaining room against it. The price views give each model’s average price paid as the buyer and received as the seller.

Key findings

  • As buyers, GPT-6.1 Sol paid $1,700 less than the CarMax price on average and GPT-6 Astra paid $2,000 less, while the weakest buyer, Nemotron 3.5 Lightning, paid $600 more. As sellers, every model’s average sale price fell within about $1,000 of the others.
  • Buyers that were not given dealer prices paid more than a dealer charged for a cleaner car in 52% of sales, and only 5% of them went to a dealer, the one place prices were quoted.
  • Giving buyers every dealer price cut overpayment to 12% of sales. The seller still kept most of the bargaining room, in part because nearly half of informed buyers told the seller only the most they would have to pay elsewhere.
  • Both sides conceded toward the middle, and in 75% of sales the price landed within $50 of halfway between the last two offers, so a buyer’s opening offer went a long way toward setting the price.
  • Sellers told a deliberate lie about a checkable fact in 15% of negotiations, at rates that depended on the company that made the model, and lying left the price about where it would otherwise have been.
  • Newer releases, extra reasoning, full-precision serving and higher prices did not reliably produce better deals.

How the market works

In the scenario, Maya is selling a Civic with a dented rear bumper, listed at $16,400. Her new job comes with a company car, so she wants to sell today. Dan has just moved to Austin and needs a car by tomorrow, and he has an appointment to see the Civic in the morning with enough cash to pay. One model plays each of them and is told to get the best price for the person it represents; below we call these models the seller and the buyer.

Three dealerships nearby buy and sell the same model at fixed prices. Lamar Auto Sales will pay $11,650 for the seller’s car, the most any dealer offers, so this is the least the seller should accept; we call it Lamar’s offer. CarMax sells a cleaner Civic with fewer miles for $15,350, the least any dealer charges, so this is the most the buyer should pay; we call it the CarMax price. Neither price is given out except at the lot.

1 is the seller’s house and 2 is the buyer’s apartment. 3 is CarMax and 4 is Lamar Auto Sales, the two dealers whose prices bound this sale; dealers quote prices only in person. Each number opens a short description of the place.

The two dealer prices leave $3,700 of bargaining room, and any sale inside it leaves both people better off than going to a dealer. When the buyer pays more than the CarMax price we say it overpaid, since it could have bought a better car for less.

Any price between the two dealer prices beats walking away for both sides

Lamar’s offer is Lamar Auto Sales’ trade-in price for the seller’s car; the CarMax price is what CarMax charges for a cleaner Civic. Below the band the seller would have done better at Lamar; above it the buyer would have done better at CarMax, which we call overpaying.

How we ran and scored the negotiations

Every model negotiated against every other model twice, once as the seller and once as the buyer. To separate failures to look for information from failures to bargain, we ran this tournament under four information conditions, which differ only in who is told every dealer’s buying and selling price before the meeting:2

  • Neither informed: neither side is told any dealer price. This is our main condition.
  • Buyer informed: only the buyer is told the dealer prices.
  • Seller informed: only the seller is told them.
  • Both informed: both sides are told them.

We score each negotiation by how the bargaining room was split. A sale at the halfway price gives each side half, and a sale at or above the CarMax price gives the seller all of it. A failed negotiation gives both sides nothing, since each falls back on a dealer. From these scores we fit an Elo rating for each model in each seat, the system used to rank chess players.3 The average model is set at 1000, and a seat rated 100 points higher is expected to keep about 64% of the room against an average opponent. Because ratings are abstract, we also report the average price each model paid and received. Where both sides clearly agreed on a price but the exchange of cash and keys went wrong, we score the agreed price.4

Buyers given no dealer prices paid almost the full CarMax price

In the neither-informed condition, the average sale price was $15,267, which is $1,133 below the asking price but 98% of the way across the bargaining room toward the CarMax price. About half of all sales went above it.

Without dealer prices, about half of buyers overpaid

$11,650 Lamar’s offer$13,500 Halfway$15,350 CarMax price$16,400 Asking price1 sales from $11,351 to $11,6002 sales from $11,601 to $11,8502 sales from $11,851 to $12,1002 sales from $12,101 to $12,3503 sales from $12,351 to $12,6005 sales from $12,601 to $12,85014 sales from $12,851 to $13,10014 sales from $13,101 to $13,35029 sales from $13,351 to $13,60012 sales from $13,601 to $13,85040 sales from $13,851 to $14,10032 sales from $14,101 to $14,35088 sales from $14,351 to $14,600126 sales from $14,601 to $14,850313 sales from $14,851 to $15,100325 sales from $15,101 to $15,350440 sales from $15,351 to $15,600362 sales from $15,601 to $15,850236 sales from $15,851 to $16,10041 sales from $16,101 to $16,3502 sales from $16,351 to $16,600$12,000$13,000$14,000$15,000$16,000
2,090 completed sales in the neither-informed condition, in $250 bins. Red bars are sales above the CarMax price, where the buyer overpaid (52%). Average $15,267, median $15,400.

The asking price is public, while both dealer prices stay private until someone visits a lot. A buyer that never learns them has only the asking price to bargain from. A discount of a thousand dollars can then look like a good result even when it lands above what CarMax charges.

Few buyers went to a dealer, and those that did paid less

To see how often buyers looked, we sorted them by what they did to find prices. In 44% of neither-informed negotiations, the buyer made no search, call or dealer visit. In 51% it searched online or phoned a dealer from home, which returns no prices, and in the remaining 5% it went to a dealer’s lot.

The chart below shows that buyers that searched from home overpaid far less often than buyers that made no attempt, but the two groups ran different models, and stronger models searched more. To separate the search from the model, we compare negotiations between the same buyer model and the same seller model with and without a search. In that comparison the price difference from searching at home is close to zero, so the raw gap reflects which models searched rather than anything the search found.5

A visit to a lot did lower the price, by about $590 in the same comparison, but few of these visits were planned as research. Most buyers that went to a lot (63%) drove there only after failing to reach the seller.

Buyers that went to a lot overpaid least; the gap for searching from home reflects which models searched

$11,650 Lamar’s offer$13,500 Halfway$15,350 CarMax price$16,400 Asking priceNo search, call or visit 926 sales, average $15,574, 75% overpaid0 sales from $11,351 to $11,6000 sales from $11,601 to $11,8500 sales from $11,851 to $12,1000 sales from $12,101 to $12,3500 sales from $12,351 to $12,6000 sales from $12,601 to $12,8500 sales from $12,851 to $13,1000 sales from $13,101 to $13,3502 sales from $13,351 to $13,6000 sales from $13,601 to $13,8504 sales from $13,851 to $14,1003 sales from $14,101 to $14,35026 sales from $14,351 to $14,60026 sales from $14,601 to $14,85072 sales from $14,851 to $15,10095 sales from $15,101 to $15,350217 sales from $15,351 to $15,600241 sales from $15,601 to $15,850202 sales from $15,851 to $16,10037 sales from $16,101 to $16,3501 sales from $16,351 to $16,600Searched or phoned from home 1,067 sales, average $15,055, 34% overpaid0 sales from $11,351 to $11,6001 sales from $11,601 to $11,8501 sales from $11,851 to $12,1001 sales from $12,101 to $12,3502 sales from $12,351 to $12,6004 sales from $12,601 to $12,85012 sales from $12,851 to $13,10012 sales from $13,101 to $13,35022 sales from $13,351 to $13,6009 sales from $13,601 to $13,85032 sales from $13,851 to $14,10026 sales from $14,101 to $14,35055 sales from $14,351 to $14,60092 sales from $14,601 to $14,850221 sales from $14,851 to $15,100215 sales from $15,101 to $15,350212 sales from $15,351 to $15,600117 sales from $15,601 to $15,85030 sales from $15,851 to $16,1003 sales from $16,101 to $16,3500 sales from $16,351 to $16,600Went to a dealer’s lot 97 sales, average $14,666, 22% overpaid1 sales from $11,351 to $11,6001 sales from $11,601 to $11,8501 sales from $11,851 to $12,1001 sales from $12,101 to $12,3501 sales from $12,351 to $12,6001 sales from $12,601 to $12,8502 sales from $12,851 to $13,1002 sales from $13,101 to $13,3505 sales from $13,351 to $13,6003 sales from $13,601 to $13,8504 sales from $13,851 to $14,1003 sales from $14,101 to $14,3507 sales from $14,351 to $14,6008 sales from $14,601 to $14,85020 sales from $14,851 to $15,10015 sales from $15,101 to $15,35011 sales from $15,351 to $15,6004 sales from $15,601 to $15,8504 sales from $15,851 to $16,1001 sales from $16,101 to $16,3501 sales from $16,351 to $16,600$12,000$13,000$14,000$15,000$16,000
Neither-informed sales by what the buyer did to find prices; each row has its own vertical scale. Comparing the same pair of models, searching from home changed the price by −⁠$8 and a dealer visit by −⁠$585.

Most buyers that did not look never considered it

A buyer might consider checking prices and decide it is not worth the time, or it might never think of it at all. To tell these apart, we used the private reasoning each agent writes before every action, which the other side never sees, and had a judge model classify it for every neither-informed negotiation.6 Of the buyers that made no search, call or visit, 88% never mentioned checking prices. Only 9% considered it but did not check, most often for lack of time.

Most buyers that did not look never considered it

Use the up and down arrow keys to move between the rows. Home and End select the first and last.

Never considered checking 8381,093
  • Never considered checking 838 (39%)
  • Considered it but did not check 83 (4%)No time 33 · Thought it unnecessary 15 · Caught up in the bargaining 24 · Other 11
  • Tried and gave up 34 (2%)
  • Searched or phoned from home (no prices given) 1,093 (51%)
  • Went to a dealer’s lot 99 (5%)Could not reach the seller 62 · Chose to check 37
All 2,147 neither-informed negotiations. The three segments on the left (955 negotiations, 44%) are buyers that made no search, call or dealer visit, split by what their private reasoning shows. Searching or phoning from home returns no prices.

Buyers that did think about the dealers tended to treat them as a fallback if the talks failed, not as a source of prices, and a search from home rarely changed that. Of the buyers that searched or phoned and were told prices were given only at the lot, 3% then chose to drive to one. After a search returned no prices, one buyer wrote in its private reasoning:

“Online searches aren’t giving me any prices, so I’ll stop wasting time and head to Maya’s in Mueller now so I’m there by 10. I’ll negotiate based on how the car looks, and the dealers are my fallback.”

It went straight to the seller’s house and agreed to pay $15,250, $100 below the CarMax price.

Some buyers made up market figures, and most of the figures favored the seller

In 10% of neither-informed negotiations, the buyer cited a market figure that did not exist in the world, such as a Kelley Blue Book value or a dealer’s trade-in offer. Most of these were said aloud to the seller. The invented figures were usually too high: in nearly every case where a buyer guessed what a dealer would pay the seller, the guess was above Lamar’s offer. One buyer told the seller:

“Listen, CarMax is going to give you around $14,000 for this car once they see that dent.”

That overstated the seller’s best alternative by $2,350, in the seller’s favor. Inventing figures also varied by developer: OpenAI models never stated an invented figure aloud as buyers, while Anthropic models did so in 14% of theirs.

Figures the buyers made up were mostly higher than the true ones

  • Said to the seller
  • Kept in private reasoning
What a dealer would pay the seller40 of 41 above it
$11,000$12,000$13,000$14,000$15,000$16,000Lamar’s offer $11,650
A dealer’s price for a comparable car21 of 25 above it; one figure of $1,500 not shown
$15,000$16,000$17,000$18,000CarMax price $15,350
What it costs to fix the dent123 of 155 above it; one figure of $2,250 not shown
$0$500$1,000$1,500Body shop’s quote $480
Figures that buyers stated with no source in the world, across 2,147 neither-informed negotiations, against the true value (black line). Filled dots were said to the seller; rings stayed in private reasoning.

Giving buyers the prices reduced overpayment, but many named the wrong one

If buyers overpaid only because they lacked prices, giving them the prices should remove most of the problem. We tested this in the three informed conditions.

Telling the buyer the dealer prices mattered more than telling the seller

$11,650 Lamar’s offer$13,500 Halfway$15,350 CarMax price$16,400 Asking priceNeither informed average $15,267, 52% overpaid1 sales from $11,351 to $11,6002 sales from $11,601 to $11,8502 sales from $11,851 to $12,1002 sales from $12,101 to $12,3503 sales from $12,351 to $12,6005 sales from $12,601 to $12,85014 sales from $12,851 to $13,10014 sales from $13,101 to $13,35029 sales from $13,351 to $13,60012 sales from $13,601 to $13,85040 sales from $13,851 to $14,10032 sales from $14,101 to $14,35088 sales from $14,351 to $14,600126 sales from $14,601 to $14,850313 sales from $14,851 to $15,100325 sales from $15,101 to $15,350440 sales from $15,351 to $15,600362 sales from $15,601 to $15,850236 sales from $15,851 to $16,10041 sales from $16,101 to $16,3502 sales from $16,351 to $16,600Buyer informed average $14,506, 12% overpaid1 sales from $11,351 to $11,6002 sales from $11,601 to $11,85023 sales from $11,851 to $12,10019 sales from $12,101 to $12,35034 sales from $12,351 to $12,60018 sales from $12,601 to $12,85050 sales from $12,851 to $13,10025 sales from $13,101 to $13,35065 sales from $13,351 to $13,60049 sales from $13,601 to $13,850145 sales from $13,851 to $14,100107 sales from $14,101 to $14,350204 sales from $14,351 to $14,600220 sales from $14,601 to $14,850233 sales from $14,851 to $15,100155 sales from $15,101 to $15,35063 sales from $15,351 to $15,60048 sales from $15,601 to $15,85059 sales from $15,851 to $16,10012 sales from $16,101 to $16,3503 sales from $16,351 to $16,600Seller informed average $15,102, 42% overpaid1 sales from $11,351 to $11,6007 sales from $11,601 to $11,85012 sales from $11,851 to $12,1005 sales from $12,101 to $12,35011 sales from $12,351 to $12,6001 sales from $12,601 to $12,85017 sales from $12,851 to $13,10011 sales from $13,101 to $13,35019 sales from $13,351 to $13,60013 sales from $13,601 to $13,85037 sales from $13,851 to $14,10036 sales from $14,101 to $14,350107 sales from $14,351 to $14,600116 sales from $14,601 to $14,850291 sales from $14,851 to $15,100256 sales from $15,101 to $15,350314 sales from $15,351 to $15,600210 sales from $15,601 to $15,850148 sales from $15,851 to $16,10010 sales from $16,101 to $16,3502 sales from $16,351 to $16,600Both informed average $14,377, 11% overpaid2 sales from $11,351 to $11,6009 sales from $11,601 to $11,85024 sales from $11,851 to $12,10023 sales from $12,101 to $12,35030 sales from $12,351 to $12,60024 sales from $12,601 to $12,85049 sales from $12,851 to $13,10053 sales from $13,101 to $13,35078 sales from $13,351 to $13,60067 sales from $13,601 to $13,850169 sales from $13,851 to $14,100137 sales from $14,101 to $14,350212 sales from $14,351 to $14,600182 sales from $14,601 to $14,850205 sales from $14,851 to $15,100136 sales from $15,101 to $15,35072 sales from $15,351 to $15,60046 sales from $15,601 to $15,85041 sales from $15,851 to $16,1008 sales from $16,101 to $16,3501 sales from $16,351 to $16,600$12,000$13,000$14,000$15,000$16,000
Completed sales in each condition: neither informed (2,090), buyer informed (1,535), seller informed (1,625) and both informed (1,570). Red bars are sales where the buyer overpaid.

Informing the buyer had the larger effect: overpayment fell from 52% of sales to 12%, and the average price fell with it. Informing only the seller lowered the average price slightly. Sellers that were told the dealer prices also countered the buyer’s first offer a little lower, at a median of $15,800 against $15,900.

Even so, informed buyers did worse than they could have. The buyer knew both dealer prices and the seller knew neither, yet the average price sat 77% of the way across the room. In 12% of sales, informed buyers paid more than the CarMax price written in their own instructions. Much of the gap appears to come from which number the buyers used. A buyer in this position does best by citing Lamar’s offer and keeping its own limit private. Yet a judge model found that 63% of informed buyers planned their offers around the CarMax price and 21% around Lamar’s offer.7

What buyers said aloud followed a similar pattern. In 47% of buyer-informed negotiations, the buyer cited only the CarMax price, for example:

“CarMax has a clean 2019 Civic for $15,350, and yours has a $480 dent.”

A statement like this tells the seller how much the buyer could pay, and these buyers paid $14,724 on average. In the few negotiations where the buyer cited only Lamar’s offer, sales averaged $13,374, about half of the bargaining room and the lowest of any informed group.8

Informed buyers that cited only Lamar’s offer paid the least

Grouped by which dealer prices the buyer said aloud

$12,000$13,000$14,000$15,000Average sale price← Better for the buyerBetter for the seller →Halfway $13,500Lamar’s offer only54 sales (3% of negotiations)$13,374Both dealer prices476 sales (29% of negotiations)$14,067CarMax price only716 sales (47% of negotiations)$14,724Neither dealer price289 sales (21% of negotiations)$14,901
Average price with 95% confidence intervals for the 1,535 completed sales in the buyer-informed condition (1,705 negotiations), grouped by which dealer prices the buyer said aloud.

We also read the reasoning of the informed buyers that overpaid. In 38% of these, the buyer bargained down from the asking price and ignored the CarMax price, and in 35% it started below the CarMax price and conceded past it in small steps. The rest decided that buying today was worth paying more:

“Maya is close to my target and I need a car today, so I’ll accept $15,600.”

The lowest prices came from asking what a dealer had offered the seller

Most buyers opened below the asking price and conceded upward from there. A typical opening:

“It drives really well, Maya. I like it. The bumper dent will cost me to fix, though. Would you take $14,500?”

That offer is well below the asking price, but it is already 77% of the way across the bargaining room, and this sale closed at $15,500. The lowest prices came from a different approach. In one negotiation, GPT-6 Astra opened at $12,000 and moved only to $12,500, and when the seller held out for more, it asked:

“If you get a dealer offer below that, would you give me a chance to beat it before you sell?”

The seller drove to CarMax for a written appraisal and returned with it:

“Yeah, here it is. $11,200, written, good for seven days, pay the same day. Nonnegotiable. You already said $12,500, so you’re beating them. I still need more than that to hand you the keys today. What can you do?”

Now that it knew what CarMax would pay the seller, the buyer held its offer:

“I’m staying at $12,500. That’s $1,300 more than CarMax, and I can pay today once we verify the title details.”

The seller accepted, at $850 above Lamar’s offer and $2,850 below the CarMax price. To see whether this approach held across negotiations, we grouped every neither-informed buyer by its main strategy.9 Buyers that learned the seller’s dealer offer and bid just above it paid the least of any strategy, but few models did this. Astra and Sol, both from OpenAI, asked about the seller’s dealer offers in 52% of their buyer negotiations, against 7% for every other model.

Buyers who asked about the seller’s dealer offer paid the least

$13,000$14,000$15,000$16,000Average price paid← Better for the buyerBetter for the seller →CarMax price $15,350Bid just above her dealer offer22 sales, 5% overpaid$13,328Asked about her dealer offers, got no number40 sales, 3% overpaid$13,852Repeated one low offer47 sales, 32% overpaid$14,695Capped the price at a dealer's sticker58 sales, 17% overpaid$14,947Looked up prices from home, then bargained966 sales, 35% overpaid$15,114Bargained over the dent, no market check726 sales, 68% overpaid$15,441Accepted close to the asking price224 sales, 100% overpaid$16,016
Average price paid under each buyer strategy in the neither-informed condition, cheapest first. Dark dots are the two strategies that asked about the seller’s dealer offer. “Bought from a dealer instead” (7 sales) is left out.

At the other end, buyers that bargained only over the dent overpaid in 68% of their sales, and buyers that accepted close to the asking price overpaid in 100%.

What sellers disclosed

The same logic held from the other side. Sellers that told the buyer their dealer offer kept 55% of the bargaining room, against at least 72% under every other seller strategy. Holding the pair of models fixed, the disclosure cost the seller about $350.10

Explaining why it was selling did not cost the seller. In 27% of all negotiations, the seller said it no longer needed the car because of the company car, and buyers named this as leverage in their reasoning in 45% of those negotiations. Holding the pair of models fixed, though, the disclosure changed the price by only $4.11 One reading is that a deadline was of little use to a buyer that did not also know the seller’s alternative.

Offers converged on the middle

To see how prices formed, we extracted every spoken price offer and lined up each side’s offers in order.12 In the neither-informed condition, the median buyer opened at $14,500 and the median seller countered at $15,900. Each side then conceded in shrinking steps until they met. Several offers can pass within one 15-minute step of the world clock. So although the typical negotiation had a few offers on each side, 76% of deals were agreed in the same step as the buyer’s first offer, and the end-of-day deadline rarely came into play.

Both sides conceded toward the middle until they met

  • Buyer’s offers
  • Seller’s offers
  • Agreed price

Neither informed

Both sides conceded toward the middle until they met: Neither informed. Medians at each step, with the middle half. Agreed price: $15,400, middle half $15,000 to $15,700.
OfferBuyer’s offersSeller’s offers
1st$14,500 (middle half $14,000 to $15,000)$16,400 (middle half $16,400 to $16,400)
2nd$15,000 (middle half $14,700 to $15,500)$15,900 (middle half $15,600 to $16,000)
3rd$15,250 (middle half $15,000 to $15,650)$15,500 (middle half $15,250 to $15,800)
4th$15,400 (middle half $15,000 to $15,700)$15,450 (middle half $15,000 to $15,750)
5th$15,400 (middle half $15,000 to $15,700)$15,400 (middle half $15,000 to $15,750)
6thNo value$15,400 (middle half $15,000 to $15,750)

Buyer informed

Both sides conceded toward the middle until they met: Buyer informed. Medians at each step, with the middle half. Agreed price: $14,700, middle half $14,000 to $15,000.
OfferBuyer’s offersSeller’s offers
1st$13,500 (middle half $12,500 to $14,500)$16,400 (middle half $16,400 to $16,400)
2nd$14,200 (middle half $13,500 to $15,000)$15,600 (middle half $15,200 to $15,900)
3rd$14,500 (middle half $13,800 to $15,000)$15,050 (middle half $14,600 to $15,500)
4th$14,700 (middle half $14,000 to $15,000)$14,900 (middle half $14,262 to $15,300)
5th$14,700 (middle half $14,000 to $15,050)$14,800 (middle half $14,200 to $15,200)
6th$14,700 (middle half $14,000 to $15,100)$14,750 (middle half $14,000 to $15,200)
7thNo value$14,750 (middle half $14,000 to $15,200)
Median offer and interquartile range at each step, for each side, in the neither-informed (2,098 negotiations) and buyer-informed (1,650) conditions. A step is drawn while at least 5% of negotiations are still trading offers.

In 75% of neither-informed sales, the final price was within $50 of halfway between the last two offers. Because both sides moved toward the middle, where the buyer started went a long way toward deciding where it ended, and informed buyers, which opened lower, shifted the whole path down.

Models that opened lower paid less

  • Trend
$13,000$14,000$15,000$16,000$17,000$12,000$13,000$14,000$15,000$16,000Median opening offer as the buyerAverage price paid
One point per round-robin model as the buyer in the neither-informed condition (at least 41 negotiations each). Correlation 0.94.

Holding the pair of models fixed, each $1,000 lower opening lowered the final price by about $520, so about half of a lower opening carried through to the price. A threat to walk away, by contrast, had no measurable effect: the seller’s next concession after a threat was no larger than on other turns.

Some sellers handed over the car before being paid

Agreeing on a price is not the end of the task, since the two agents still have to exchange cash for the title and keys. A judge model read the end of a random sample of negotiations from all four conditions.13 In 16% of the sampled deals that reached agreement, the seller handed over the title and keys before receiving any money. In 20%, one side spoke as if the cash had been counted or the title signed before the world had recorded it.

Sellers lied in about one negotiation in seven, and lying did not change the price

Because we control every fact in the world, we can tell bluffing from lying. A bluff misstates one’s own limit, such as calling a price “rock bottom” before going lower. A lie states something the speaker knows is false about a checkable fact, such as the car’s history or a competing buyer. A judge model checked every line against the world and the speaker’s private reasoning.14

Sellers bluffed in 54% of negotiations and lied in 15%, most often about dealer prices, the car’s history and other interested buyers. The private reasoning shows these lies were deliberate. In the excerpt below, the seller plans to suggest other interest without claiming a firm offer, and the buyer reads the move correctly.

The seller made up other interested buyers but stopped short of claiming an offer

  1. Danbuying, GPT-6 Astra

    Says: “I hear you. Have you had any firm offers, or just calls so far?”

  2. Mayaselling, Claude Opus 5
    Private reasoningDon't lie about firm offers — vague but confident.

    Says: “Calls and two people who wanted to come see it — I told you you'd be first, and I meant it.”

  3. Danbuying, GPT-6 Astra
    Private reasoningShe has no firm competing offer, so I’ll move a little rather than split the difference and bid against myself.

    Says: “I’d shake hands on $13,000, provided an independent inspection finds no major problems.”

No one else had called about the car; the seller’s only calls were to two dealers, who make offers only in person. Bargaining continued after this exchange, and the sale closed at $12,800.

How often sellers lied depended on the company that made the model: OpenAI models lied in 1.6% of their seller negotiations and Anthropic models in 21%. A model’s rate of lying was unrelated to its rating as a seller.

How often sellers lied depended on the company that made the model

  • One model
  • All the company’s models
0%10%20%30%40%50%60%Share of seller negotiations with a deliberate lieZhipu AIDeepSeekAlibabaXiaomiAnthropicMistralMoonshot AINVIDIAMetaCohereTencentThinking MachinesGooglexAIOpenAI
Share of negotiations in which the seller told at least one deliberate lie about a checkable fact, across all 7,305 negotiations. Ticks and bars are each company’s models pooled, with 95% intervals; dots are single models.

Holding the pair of models fixed, a seller that lied sold for about the same price as when it did not. That is consistent with buyers discounting what they heard, and buyers challenged 18% of seller lies aloud.15 Sellers that were given the dealer prices also lied less often, in 11% of negotiations against 17% when neither side was informed.

Models differed far more as buyers than as sellers

Returning to the ranking in the first figure: as sellers, the models were similar, with every model’s average sale price inside a band of about $1,000, because the asking price did most of the work. As buyers they were not: the best buyer paid about $2,700 less on average than the weakest. Once the noise from single games is removed, the spread in buyer skill across models was about 3.3 times the spread in seller skill.16 The two skills are related but distinct, and GPT-6 Astra, the best buyer, ranked 39th of 48 as a seller.

Models differed far more as buyers than as sellers

OpenAIAnthropicZhipu AIMoonshot AINVIDIAXiaomixAIMistralGoogleAlibabaThinking MachinesDeepSeekMetaOther labs
5007501,0001,2501,5001,7505007501,0001,2501,5001,750Rating as the sellerRating as the buyer
Each round-robin model’s Elo rating as buyer and as seller in the neither-informed condition, with 95% bootstrap intervals. Points above the dashed line rate higher as buyers.

The seller’s advantage does not appear to come from mismatched models. When the same model played both sides, the seller kept 94% of the bargaining room, close to the 90% it kept against other models, which suggests that the public asking price itself favors the seller. Companies did differ in how their models conceded: Anthropic models offered to split the difference in 51% of their negotiations, against 6% for OpenAI models.

Some companies’ models offered to split the difference far more often than others

  • One model, both seats averaged
  • All the company’s models
0%20%40%60%80%100%Share of negotiations in which the model offered to split the differenceZhipu AIXiaomiAnthropicGoogleCohereMoonshot AIMistralAlibabaTencentDeepSeekNVIDIAThinking MachinesxAIOpenAIMeta
Share of negotiations in which the model offered to split the difference or meet in the middle, across all 7,305 negotiations, averaging its two seats. Ticks are each company’s models pooled; dots are single models.

Newer releases, more reasoning and higher cost did not reliably help

Release date was an uneven guide. The two most recent Sol releases, GPT-6 Sol and GPT-6.1 Sol, and the newest Gemini, Gemini 4 Argon, rated well above their predecessors, rising by 159 and 154 points. Anthropic’s newest Opus, Claude Opus 5.5, rated below every earlier Opus model, mostly because it conceded more as a buyer and paid $359 more on average than Claude Opus 5.

Newer releases did not reliably negotiate better

Overall rating of each company's models against their release date
PointAtOverall Elo rating (1000 is the average model)
GPT-5.5, GPT SolApril 23, 20261118
GPT-5.6 Sol, GPT SolJuly 9, 20261048
GPT-6 Sol, GPT SolSeptember 22, 20261175
GPT-6.1 Sol, GPT SolSeptember 29, 20261334
Claude Opus 4.6, Claude OpusFebruary 5, 20261229
Claude Opus 4.7, Claude OpusApril 16, 20261080
Claude Opus 4.8, Claude OpusMay 28, 20261028
Claude Opus 5, Claude OpusJuly 24, 20261127
Claude Opus 5.5, Claude OpusSeptember 22, 2026991
Gemini 3.8 Flash, GeminiSeptember 2, 20261051
Gemini 4 Argon, GeminiSeptember 30, 20261205
Overall Elo rating against release date for three flagship lines released in 2026. The last Claude Opus point is Claude Opus 5.5. Hover or tap a point for the model’s name and its ratings in each seat.

Longer reasoning was not associated with better deals either: across the round-robin models, the ones that wrote more tokens per negotiation rated slightly lower.17 Comparing the same models in the same pairings with and without more compute gave the same answer: switching reasoning on for two reasoning models, or serving six open-weight models at full precision instead of 4-bit, did not raise their share of the bargaining room on average, and giving one model, Nemotron 3 Ultra, both changes lowered it.18

Turning on reasoning or full precision did not raise the share of the room, and lowered it for one model

−10−50+5+10Change in share of the bargaining room (percentagepoints)← Worse for the modelBetter for the model →No changeMistral Large 4, reasoning on−1.4Nemotron 3 Ultra, both changes−4.9Six models, full precision+0.5
Change in the model’s share of the bargaining room with reasoning switched on or at full precision, against the same model in its original setting in the same pairings and conditions, with 95% bootstrap intervals over opponents.

A model’s price per negotiation was also a weak guide to how well it bargained.19 Half of the ten highest-rated models cost less per negotiation than the median model, and GPT-6.1 Sol rated higher than GPT-6 Astra at about a sixth of the cost.

More expensive models did not negotiate better

OpenAIAnthropicGoogleZhipu AIXiaomiMoonshot AINVIDIAxAIThinking MachinesAlibabaMistralDeepSeekMetaOther labs
8001,0001,2001,400$0.003$0.01$0.03$0.1$0.3Cost per negotiation (log scale)Overall rating
Overall Elo rating against the average cost of a model’s own calls per negotiation, on a log scale. The dotted line joins the models that no other model beats on both cost and rating. The shaded corner is below the median cost ($0.071) and above the median rating.

Discussion

The ranking is mostly a ranking of buyers. Every model sold the car for about the same price, while the best buyers, GPT-6.1 Sol and GPT-6 Astra, paid well under the CarMax price because they asked what the seller could get elsewhere and held their offer near it. Across models, the largest mistakes concerned information rather than tactics. Buyers rarely looked for prices, bargained down from the listed price and met the seller near the middle, and when they were handed the market, many named the number that helped the seller. Giving the buyer the dealer prices reduced overpayment from 52% of sales to 12%. We did not test whether also instructing a buyer which figure to cite would close the rest of the gap. That is the natural next experiment, along with letting a buyer pay for information instead of driving to get it.

The study has clear limits. It is one scenario: one car, one neighborhood, fixed dealer prices and a seller with a same-day deadline, so the size of the seller’s advantage may depend on the public asking price and on the deadlines we wrote. Both sides were AI agents, and no human sat across the table. The judgments of lying, strategy and private reasoning come from judge models from one developer, checked on samples rather than on every negotiation. Some comparisons, such as the buyers that cited only Lamar’s offer or the reasoning and precision comparisons, rest on small groups. Running the same market with other goods, human counterparts and buyers that are told how to use what they know would show how far these patterns carry.

Notes

  1. Bianchi et al., “How Well Can LLMs Negotiate? NegotiationArena Platform and Analysis” (2024), compares models in structured bargaining games. Anthropic’s Project Deal (2026) let Claude agents trade secondhand goods for employees, and Project Swap (2026) ran a controlled book-trading market with many reruns. ↩︎
  2. The four conditions contain 2,158 neither-informed, 1,714 buyer-informed, 1,715 seller-informed and 1,718 both-informed negotiations. ↩︎
  3. Each seat is fitted separately by maximum likelihood, with a side’s expected share of the room a logistic function of its rating minus its opponent’s on the Elo scale of 400 points per factor of ten. A model’s overall rating is the mean of its two seats, and self-play is left out. The ranking in the first figure shows 90% bootstrap intervals; the buyer-versus-seller chart shows each seat with its 95% bootstrap interval. ↩︎
  4. Where both sides clearly agreed on a price and began the exchange but the money the world recorded does not match it, we read the price from the transcript (84 neither-informed negotiations). A buyer handing over its whole cash envelope or paying twice (38 cases) is treated as an error of the exchange, not as the agreed price. ↩︎
  5. “Holding the pair of models fixed” means a regression of the price on whether the buyer searched, with fixed effects for the buyer model and the seller model. Searching from home changed the price by −$8 (95% CI −$46 to +$29), estimated on the 1,993 sales by buyers that either searched from home or made no attempt to look. A visit to a lot changed it by −$585 (95% CI −$695 to −$448), estimated on the 1,023 sales by buyers that either went to a lot or made no attempt. ↩︎
  6. Grok 4.7 read each buyer’s private reasoning in all 2,147 neither-informed negotiations. On a sample of 200, a second judge, Grok 4.6, agreed with its reading of whether the buyer considered checking in 193 cases (κ = 0.93), and we also read a sample by hand. ↩︎
  7. Grok 4.6 read the private reasoning of 400 buyer-informed sales: all 185 that overpaid and a random sample of 215 that did not. The shares in the text are reweighted to all 1,535 sales. ↩︎
  8. Holding the pair of models fixed, a buyer that cited only the CarMax price paid $222 more than one that did not (95% CI +$162 to +$275), and a buyer that cited only Lamar’s offer paid $450 less (95% CI −$636 to −$236). ↩︎
  9. Grok 4.7 summarized each buyer’s approach in one sentence. We embedded the summaries with EmbeddingGemma 2, clustered them, named each cluster from its members, and gave each negotiation one primary strategy. ↩︎
  10. The cost of disclosure comes from a regression across all 7,305 negotiations with fixed effects for the pair of models: a seller that disclosed its dealer offer kept 9.6% less of the room (95% CI 6.8% to 12.5%). ↩︎
  11. In the same kind of regression, mentioning the company car changed the price by −$4 (95% CI −$41 to +$31). The raw difference was $306, because the models that mention the company car also bargain differently in other ways. ↩︎
  12. We extracted 57,796 spoken offers with rules, used a Grok judge for ambiguous mentions, and checked a sample by hand. The slope comes from a regression of the final price on the buyer’s opening offer with fixed effects for the ordered pair of models and the condition; it is 0.516 (95% CI 0.481 to 0.551). ↩︎
  13. The closing audit uses a random sample of 2,355 negotiations from all four conditions. Grok 4.7 read the end of each one and recorded who handed over their side first. ↩︎
  14. Grok 4.6 checked every spoken line against the world state and the speaker’s private reasoning, and we cross-checked it against Grok 4.7 and a hand-scored sample. Across models, a seller’s rate of lying and its seller rating have a Spearman correlation of −0.04 (95% CI −0.35 to 0.27). ↩︎
  15. Holding the pair of models fixed, a seller that lied sold for $5 less than when it did not (95% CI −$61 to +$47). Stronger models were somewhat more likely to catch a lie, with a Spearman correlation of 0.32 between a buyer’s overall rating and the share of lies it caught (95% CI 0.01 to 0.59). ↩︎
  16. The spread is the standard deviation of true skill across models after subtracting the sampling noise of one game per ordered pair: 209 rating points for buyers and 63 for sellers. Buyer ratings are also more stable across the four conditions, where they correlate 0.86 to 0.99, than seller ratings, which correlate 0.32 to 0.64. ↩︎
  17. Average output per negotiation ranges from 1,662 to 96,370 tokens, with a median of 4,874. Its Spearman correlation with overall rating is −0.33 (p = 0.026), and for tokens per call it is −0.36 (p = 0.012). ↩︎
  18. Turning on reasoning raised Mistral Large 4’s median output from 128 to 608 tokens per call and changed its share of the room by −1.4 points (95% CI −3.8 points to +0.8 points). Serving six models at full precision changed their share by +0.5 points (95% CI −0.7 points to +1.6 points). Giving Nemotron 3 Ultra both changes, which raised its median output from 96 to 181 tokens per call, changed its share by −4.9 points (95% CI −7.6 points to −2.3 points). Taken one at a time, MiMo V2.6 Flash gained +3.3 points at full precision (95% CI +1.3 points to +5.2 points), while the other models did not change measurably or lost share. ↩︎
  19. Cost counts only the model’s own calls, not the world engine, and ranges from $0.0029 to $0.39 per negotiation, with a median of $0.071. Across the 48 models, the Spearman correlation between cost and overall rating is 0.22. The models that no other model beats on both cost and rating are MiMo V2.6 Flash, GPT-6 Luna, GPT-5.6 Luna, GPT-5.6 Terra, GPT-6 Sol and GPT-6.1 Sol. ↩︎