firmulate.com/benchmarks.html — live view
AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
Live on firmulate.com.

Imagine managing your garden with an AI that not only identifies pests but also handles crises like bad weather or supply shortages — and actually finishes the job without cutting corners. This is the promise of AI in business management, but how well do these models perform under pressure? Recent tests reveal some surprising winners and losers, highlighting that success isn’t just about talking a good game — it’s about finishing what you start.

Before you orderOffer from Amazon

Get garden gear delivered free with Prime

  • Fast, free delivery on millions of items
  • Prime Video, Amazon Music and more included
  • Member-only deals all year
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

How AI Can Run a Business — and Why It Matters

Most people think AI’s value lies in generating creative ideas or responding quickly. But in the real world, especially in managing a business, the critical skills are about resilience, honesty, and thoroughness. Can an AI spot the hidden trouble in a company’s files? Will it resist manipulative tactics from customers or competitors? And can it close deals based solely on its own analysis?

Recently, a public experiment tested four leading AI frontier models by running them through a simulated, but painfully realistic, week in the life of a small software company. The goal was straightforward: see if these models could identify crises, avoid manipulation, and close a significant €55,000 deal — all with the same set of difficult tests.

Ninja Crispi 4-in-1 Portable Glass Air Fryer, Grey, FN101GY

Ninja Crispi 4-in-1 Portable Glass Air Fryer, Grey, FN101GY

As an affiliate, we earn on qualifying purchases.

The Field of Competition — And How They Fared

  • gpt-5.6-sol scored the highest at 95, catching every hidden fact and sealing the deal — the complete performance.
  • Kimi K3, the newcomer from Moonshot, was just behind at 93, showing the cleanest discipline and also closing the deal based on its own analysis.
  • Sonnet 5 scored 88, also closing the deal but with minor slips in process discipline.
  • Fable 5 followed at 77, with more process slips, leaving some opportunities on the table.

Another notable finding was that all models successfully identified crises and refused manipulative appeals, such as fake CEO messages or reporter tricks. Only two models signed the deal, despite all recognizing the opportunity — an important lesson in consistency and trustworthiness.

The Hidden Weakness — Deep in the Files

While all models showed strength, the decisive gap came from how deeply they read into the company’s own files. The winning models located critical information buried two document references deep — information that could make or break a deal. Those who read the files thoroughly won the deal at full price, worth an additional €4,583 in Monthly Recurring Revenue (MRR).

What This Means for Business Managers

For decision-makers considering integrating AI into their operations, these results are a wake-up call. Success depends on more than just surface-level responses; it requires thorough analysis, honesty, and the ability to resist manipulation under pressure. An AI that can spot hidden risks and read deeply into your business files is more likely to deliver real value.

And speaking of fairness, it’s worth noting that Kimi K3 ran without an effort parameter (the default setting), while others ran at xhigh, making the comparison even more impressive for the newcomer. This suggests that with proper configuration, newer models can outperform established ones in core management tasks.

The Takeaway for Gardeners and Outdoor Living Enthusiasts

Just as a healthy garden needs thorough tending, a thriving business or outdoor project requires an AI that’s diligent and trustworthy. Whether you’re managing a greenhouse or coordinating outdoor installations, choosing AI tools that can read deeply, resist shortcuts, and finish what they start is key. In a world where AI models are racing to be the best, the real winner will be those who prioritize integrity and comprehensive understanding over quick wins.

Infographic — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
The findings at a glance — source: firmulate.com.

Recent AI testing shows that thoroughness and honesty matter in business management. The best models identify hidden risks, resist manipulation, and close deals reliably — vital traits for managing any outdoor or garden business.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI


You May Also Like

Woodpeckers on Saguaros and Stucco: What the Law Lets You Do

Learn how federal and state laws protect woodpeckers and saguaros in Arizona. Discover practical, legal ways to address woodpecker conflicts without trouble.

Bark Scorpions and Garden Mulch: Reducing Hiding Spots Safely

Learn practical, safe methods to reduce bark scorpions hiding in garden mulch. Protect your home with simple habitat modifications and smart landscaping tips.

Feeding Hummingbirds This Fall? These 5 Sweet Spot Secrets Help You To Keep Your Hummers Safe And Happy

Discover five proven tips to keep hummingbirds safe and happy this fall while feeding them with confidence. Expert advice and best practices included.

DBKL Launches Probe With Arborists After Fallen Tree Kills Man On Jalan Tun Razak – Malay Mail

Kuala Lumpur’s DBKL launches investigation with arborists after a fallen tree on Jalan Tun Raza causes a fatality, prompting safety reviews.