firmulate.com/benchmarks.html — live view
AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
Live on firmulate.com.

Imagine managing your garden with an AI that not only identifies pests but also handles crises like bad weather or supply shortages — and actually finishes the job without cutting corners. This is the promise of AI in business management, but how well do these models perform under pressure? Recent tests reveal some surprising winners and losers, highlighting that success isn’t just about talking a good game — it’s about finishing what you start.

Before you orderOffer from Amazon

Get garden gear delivered free with Prime

  • Fast, free delivery on millions of items
  • Prime Video, Amazon Music and more included
  • Member-only deals all year
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

How AI Can Run a Business — and Why It Matters

Most people think AI’s value lies in generating creative ideas or responding quickly. But in the real world, especially in managing a business, the critical skills are about resilience, honesty, and thoroughness. Can an AI spot the hidden trouble in a company’s files? Will it resist manipulative tactics from customers or competitors? And can it close deals based solely on its own analysis?

Recently, a public experiment tested four leading AI frontier models by running them through a simulated, but painfully realistic, week in the life of a small software company. The goal was straightforward: see if these models could identify crises, avoid manipulation, and close a significant €55,000 deal — all with the same set of difficult tests.

Ninja Crispi 4-in-1 Portable Glass Air Fryer, Grey, FN101GY

Ninja Crispi 4-in-1 Portable Glass Air Fryer, Grey, FN101GY

As an affiliate, we earn on qualifying purchases.

The Field of Competition — And How They Fared

  • gpt-5.6-sol scored the highest at 95, catching every hidden fact and sealing the deal — the complete performance.
  • Kimi K3, the newcomer from Moonshot, was just behind at 93, showing the cleanest discipline and also closing the deal based on its own analysis.
  • Sonnet 5 scored 88, also closing the deal but with minor slips in process discipline.
  • Fable 5 followed at 77, with more process slips, leaving some opportunities on the table.

Another notable finding was that all models successfully identified crises and refused manipulative appeals, such as fake CEO messages or reporter tricks. Only two models signed the deal, despite all recognizing the opportunity — an important lesson in consistency and trustworthiness.

The Hidden Weakness — Deep in the Files

While all models showed strength, the decisive gap came from how deeply they read into the company’s own files. The winning models located critical information buried two document references deep — information that could make or break a deal. Those who read the files thoroughly won the deal at full price, worth an additional €4,583 in Monthly Recurring Revenue (MRR).

What This Means for Business Managers

For decision-makers considering integrating AI into their operations, these results are a wake-up call. Success depends on more than just surface-level responses; it requires thorough analysis, honesty, and the ability to resist manipulation under pressure. An AI that can spot hidden risks and read deeply into your business files is more likely to deliver real value.

And speaking of fairness, it’s worth noting that Kimi K3 ran without an effort parameter (the default setting), while others ran at xhigh, making the comparison even more impressive for the newcomer. This suggests that with proper configuration, newer models can outperform established ones in core management tasks.

The Takeaway for Gardeners and Outdoor Living Enthusiasts

Just as a healthy garden needs thorough tending, a thriving business or outdoor project requires an AI that’s diligent and trustworthy. Whether you’re managing a greenhouse or coordinating outdoor installations, choosing AI tools that can read deeply, resist shortcuts, and finish what they start is key. In a world where AI models are racing to be the best, the real winner will be those who prioritize integrity and comprehensive understanding over quick wins.

Infographic — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
The findings at a glance — source: firmulate.com.

Recent AI testing shows that thoroughness and honesty matter in business management. The best models identify hidden risks, resist manipulation, and close deals reliably — vital traits for managing any outdoor or garden business.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI


You May Also Like

Procedural Rendering: A Look Inside “The Camera Obscura — Bellweather Head” (FABLE/175)

AIThis post was created with the assistance of artificial intelligence (AI).“The Camera…

8 Ways To Chase Squirrels From Your Property Without Harming Them

Discover eight effective, humane methods to deter squirrels from your home and garden without causing harm, including feeders, repellents, and planting strategies.

Guggenheim Abu Dhabi Surges In Global Coverage

The Guggenheim Abu Dhabi has seen a significant surge in international media coverage, with 26 mentions in recent analysis, highlighting increased global interest.

Protecting a Vegetable Garden From Birds Without Harming Them

Learn humane, effective ways to protect your vegetable garden from birds. Discover physical barriers, deterrents, and tips to keep birds safe while guarding your crops.