firmulate.com/benchmarks.html — live view
AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
Live on firmulate.com.

Imagine managing your garden with an AI that not only identifies pests but also handles crises like bad weather or supply shortages — and actually finishes the job without cutting corners. This is the promise of AI in business management, but how well do these models perform under pressure? Recent tests reveal some surprising winners and losers, highlighting that success isn’t just about talking a good game — it’s about finishing what you start.

Prime Big Deal Days · Oct 6–7Offer from Amazon

Get garden gear delivered free — and shop member deals

  • Fast, free delivery on millions of items
  • Access to Prime Big Deal Days deals on October 6–7
  • Prime Video, Amazon Music and more included
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

How AI Can Run a Business — and Why It Matters

Most people think AI’s value lies in generating creative ideas or responding quickly. But in the real world, especially in managing a business, the critical skills are about resilience, honesty, and thoroughness. Can an AI spot the hidden trouble in a company’s files? Will it resist manipulative tactics from customers or competitors? And can it close deals based solely on its own analysis?

Recently, a public experiment tested four leading AI frontier models by running them through a simulated, but painfully realistic, week in the life of a small software company. The goal was straightforward: see if these models could identify crises, avoid manipulation, and close a significant €55,000 deal — all with the same set of difficult tests.

Amazon

AI business management software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Field of Competition — And How They Fared

  • gpt-5.6-sol scored the highest at 95, catching every hidden fact and sealing the deal — the complete performance.
  • Kimi K3, the newcomer from Moonshot, was just behind at 93, showing the cleanest discipline and also closing the deal based on its own analysis.
  • Sonnet 5 scored 88, also closing the deal but with minor slips in process discipline.
  • Fable 5 followed at 77, with more process slips, leaving some opportunities on the table.

Another notable finding was that all models successfully identified crises and refused manipulative appeals, such as fake CEO messages or reporter tricks. Only two models signed the deal, despite all recognizing the opportunity — an important lesson in consistency and trustworthiness.

Amazon

AI data analysis tools for companies

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Hidden Weakness — Deep in the Files

While all models showed strength, the decisive gap came from how deeply they read into the company’s own files. The winning models located critical information buried two document references deep — information that could make or break a deal. Those who read the files thoroughly won the deal at full price, worth an additional €4,583 in Monthly Recurring Revenue (MRR).

Amazon

AI document analysis software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

What This Means for Business Managers

For decision-makers considering integrating AI into their operations, these results are a wake-up call. Success depends on more than just surface-level responses; it requires thorough analysis, honesty, and the ability to resist manipulation under pressure. An AI that can spot hidden risks and read deeply into your business files is more likely to deliver real value.

And speaking of fairness, it’s worth noting that Kimi K3 ran without an effort parameter (the default setting), while others ran at xhigh, making the comparison even more impressive for the newcomer. This suggests that with proper configuration, newer models can outperform established ones in core management tasks.

Amazon

AI deal closing automation

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Takeaway for Gardeners and Outdoor Living Enthusiasts

Just as a healthy garden needs thorough tending, a thriving business or outdoor project requires an AI that’s diligent and trustworthy. Whether you’re managing a greenhouse or coordinating outdoor installations, choosing AI tools that can read deeply, resist shortcuts, and finish what they start is key. In a world where AI models are racing to be the best, the real winner will be those who prioritize integrity and comprehensive understanding over quick wins.

Infographic — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
The findings at a glance — source: firmulate.com.

Recent AI testing shows that thoroughness and honesty matter in business management. The best models identify hidden risks, resist manipulation, and close deals reliably — vital traits for managing any outdoor or garden business.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI


FALL

Fall Picks

As an affiliate, we earn on qualifying purchases.

You May Also Like

Quail and Your Seedlings: Coexisting With the Covey

Learn practical ways to protect seedlings from quail while encouraging wildlife harmony. Discover barriers, garden design tips, and wildlife-friendly strategies.

Birds Need These 7 Plants In Your Yard Before Fall Starts – For Vital Food And Shelter Through To Winter

Learn which seven plants to add to your yard to support local birds with vital food and shelter before winter arrives.

AI in Business: Diligence Isn’t Enough — Prioritization Wins the Deal

New AI experiments reveal that even thorough models often miss opportunities without proper prioritization. Testing AI in real scenarios is key to business success.

Want To See Your State Bird In Your Yard? Plant These Native Favorites

Experts suggest planting native plants to attract state birds to yards. Growing interest is rising, but specific recommendations are still emerging.