In a current experiment, Anthropic created a labeled market the place AI brokers represented each patrons and sellers, hanging actual offers for actual items and actual cash.
The company admitted this check — which it known as Venture Deal — was solely “a pilot experiment with a self-selected participant pool” of 69 Anthropic staff who got a finances of $100 (paid out through present playing cards) to purchase stuff from their coworkers.
Nonetheless, Anthropic mentioned it was “struck by how nicely Venture Deal labored,” with 186 offers made, totaling greater than $4,000 in worth.
The corporate mentioned it really ran 4 separate marketplaces with totally different fashions — one which was “actual” (the place everybody was represented by the corporate’s most-advanced mannequin, and with offers really honored after the experiment) and one other three for research.
Apparently, when customers are represented by extra superior fashions, they get “objectively higher outcomes,” Anthropic mentioned. However customers didn’t appear to note the disparity, elevating the opportunity of “‘agent high quality’ gaps” the place “individuals on the shedding finish may not understand they’re worse off.”
Additionally, the preliminary directions given to the brokers didn’t seem to have an effect on sale chance or the negotiated costs.