Knowing that benchmarks predict automation isn’t enough. You need a framework for action. Here’s how to navigate the benchmark landscape strategically.
Track benchmark saturation rates for tasks in your industry. Key benchmarks to watch:
SWE-bench: Software engineering capabilities
MATH/GSM8K: Mathematical reasoning
HumanEval: Code generation
MMLU: General knowledge and reasoning
When scores approach 90%+, the window is closing. The capability is about to be commoditized.
2. Map Your Workflows
Identify which of your business processes have objective, measurable outcomes. Ask: “Can a computer verify if this task was done correctly?”
If yes, it’s an automation candidate. If no, it requires human judgment.
3. Pilot Early
Run pilots for saturated capabilities now. First-movers build proprietary data advantages and workflow optimizations that late adopters can’t easily replicate.
Priority areas: code generation, summarization, data extraction.
4. Invest in Unbenchmarkables
Double down on human skills that resist measurement: trust-building, creative strategy, ethical judgment, relationshipmanagement.
These remain durable human advantages because no benchmark can capture them.
Gennaro is the creator of FourWeekMBA, which reached about four million business people, comprising C-level executives, investors, analysts, product managers, and aspiring digital entrepreneurs in 2022 alone | He is also Director of Sales for a high-tech scaleup in the AI Industry | In 2012, Gennaro earned an International MBA with emphasis on Corporate Finance and Business Strategy.
