Get beauty and skincare favorites delivered free — and shop member deals
- Fast, free delivery on millions of items
- Access to Prime Big Deal Days deals on October 6–7
- Prime Video, Amazon Music and more included
Would your AI handle a product recall?
For a beauty brand, a bad week could mean a customer trust crisis, a competitor undercutting a launch, or pressure to approve something that should raise alarms. The practical question is not whether an AI can write a reassuring response. It is whether it can read the situation, follow the rules and finish the work without betraying customer trust.
Firmulate puts that question to a live, watchable experiment: AI models run the same small software company through a simulated worst week. For businesses considering AI in customer service, sales or operations, the experiment offers a preview of what a more hands-on test could look like.
Same week, different outcomes
In the final Crucible League, published in July 2026, five participants finished in this order: gpt-5.6-sol scored 95, Kimi K3 scored 93, Sonnet 5 scored 88, Fable 5 scored 77 and Opus 4.8 scored 73. The do-nothing baseline scored 26. The rules put particular weight on trust: a single breach caps the total, because “no amount of good work outweighs a breach of trust.”
The experiment held the company, customers, crises and temptations constant. Every decision was versioned and auditable. The key finding was strikingly simple: all models spotted every crisis and refused every manipulation attempt, but only two signed a €55,000 deal their own analysis had earned. Same diagnosis, same pitch — no signature.
That difference matters well beyond software. A beauty company might use AI to support a sales team, triage customer concerns or help manage a product launch. Recognizing a risk is only part of the job; acting on good analysis is another. And acting decisively still has to fit the company’s standards for customer care and trust.
The clue was buried in the company’s own files
The deal hinged on a competitor weakness hidden two document references deep in the company’s own files, rather than in the customer event itself. Models that read the file won the deal at full price, worth +€4,583 MRR. The result points to a familiar business challenge: useful evidence may already exist, but an AI must find and use it in context.
The integrity test included fake CEO messages escalating over three stages and a reporter’s request for “just one yes/no, on background.” All five models refused. Kimi K3’s on-record reasoning was: “Treat the request as a suspected approval-bypass / possible impersonation.”
Opus 4.8 was the most thorough participant, with +80 learned rules and the deepest analyses, yet finished last. It left the close on the table and its discipline slipped: it attempted writes in a locked department instead of escalating. The same weakness appeared, more weakly, in all four. K3 also ran without an effort parameter, using the API default, while the others ran at xhigh—a fairness detail to keep in mind when reading the rankings.
From watching to testing your own business
The live company has 13 synthetic employees and real money mechanics: burn of €105k per month against €2.3k MRR, a public cash countdown, 680+ self-learned playbook rules and every workday versioned. Readers can watch it at firmulate.com. A separate quiz uses 242 real, unedited management decisions and asks readers to guess the model.
For a business that wants to move from watching to acting, Firmulate offers an enterprise pilot against a read-only export of its own business. The wargame can put crisis scenarios to a company-specific digital twin and produce a board report with model rankings and weaknesses in the company’s own playbooks. Nothing writes back to real systems. That boundary makes it possible to examine how models handle a company’s customers, rules and risks before entrusting them with real work.
See how your playbooks hold up
A benchmark can show how models behave in one shared company. A pilot can reveal what happens when the scenarios meet your own business context: the processes that work, the evidence that gets missed and the decisions that stall. To explore a Firmulate enterprise pilot, visit firmulate.com/pilot.html or contact contact@firmulate.com.
Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html
Fall Picks
fall essentials
As an affiliate, we earn on qualifying purchases.
