AI-Fluent or Out: What the Next Three Years Actually Demand From Enterprises
A practical breakdown of a seasoned investor's forecast for the LLM and AI agent wave: which claims hold up technically, why CEOs who never touch AI are the most exposed, how to draw the automation boundary for high-risk scenarios, what the unit economics of AI infrastructure really look like, and how enterprise teams should move from scenario selection to engineering implementation. You will get an evaluation framework, risk tiering, architecture patterns, security and compliance baselines, and a phased rollout plan.
Introduction: A Veteran Investor’s Pragmatic Take
On a recent tech podcast, an investor who has lived through several technology cycles — the spread of the personal computer, the internet era, and the rise of streaming — shared his view of the large language model and AI agent boom. His conclusions come almost entirely from commercial instinct rather than academic reasoning: over the next three years, enterprises will roughly fall into two categories, those fluent in AI and those that are out; CEOs who do not use AI will be cleared out of the market by competitors without ceremony; the hundreds of billions or even trillions of dollars that tech giants are pouring into compute may be difficult to recoup; and the business model of selling standardized software purely by seat is facing serious pressure.
These statements sound aggressive, but each one rests on a clear technical and operational logic. This article takes them apart from the technical side: which claims hold up, and how enterprises should actually implement the implications.
1. The Gap Between the Hype Cycle and Daily Experience
AI is in the feed every day, yet most people’s actual use still falls into two scenarios: polishing an email, or using it as a fancier search box. On one side sit data center investments in the tens of billions of dollars; on the other, a daily workflow that has barely changed. That mismatch makes it easy to suspect AI is a bubble.
The gap can be explained by the technology adoption lifecycle. Innovators and early adopters are already chaining multi-step tasks with agents, while the early majority has only just encountered the chat interface. There is a visible chasm between a technology that “demos beautifully” and one that is “reliably embedded in a process.” The reason is that real business processes are typically made of a dozen systems, a large number of exception branches, and strict permission rules — and a general-purpose model cannot adapt to them out of the box.
So the gap is itself the signal: the main battlefield for enterprise AI is not the model, but engineering — wiring the model into real data and real processes, adding permissions, evaluation, monitoring, and cost control, so that it can reliably own a specific task.
2. Why the CEO Who “Doesn’t Use AI” Is the Most Likely to Be Eliminated
This claim is not a dismissal of traditional management skill. When technology cycles turn, the people who get eliminated are usually not the ones who don’t understand technology, but the ones still making decisions with an old cost structure and an old span of management.
From an organizational behavior standpoint, a manager’s attitude toward a technology propagates down through every layer of the organization. Whether that manager uses it personally determines three things:
- Information quality: whether they can tell the difference between a demo and real production capacity — for example, the gap between vendor benchmarks and performance on real business data;
- Resource allocation: whether they keep investing in engineering governance, data governance, and talent development, rather than only buying seats;
- Risk tolerance: whether they are willing to let AI take over part of decision-making and execution inside clearly drawn boundaries.
If the decision maker has never used the technology, the organization usually drifts to one of two extremes: total wait-and-see, which forfeits the efficiency gains, or blind deployment, which triggers a wholesale rejection after a single incident. The safer path is for managers to become heavy users themselves, build judgment on real tasks, and then set boundaries for the organization.
3. Two Kinds of AI Users: Outsourced Learning and Accelerated Learning
The investor observed that AI users today split into roughly two groups: those who use AI so that they “don’t have to learn anything,” and those who use it so that they “can learn everything.” Both feed the same model, yet they end up on completely different capability growth curves.
| Dimension | Learning-outsourcing user | Learning-accelerating user |
|---|---|---|
| Core goal | Skip understanding and practice; get the answer directly | Shorten the path to understanding; grasp principles and practice faster |
| Typical usage | Generate once, copy and paste | Draft first, then unpack the reasoning, ask about edge cases and counterexamples |
| Attitude to errors | Cannot detect them, cannot localize them | Can identify them quickly with tests and verification |
| Long-term result | Unreviewable output, stalled capability | Reviewable output, steadily improving judgment |
This distinction has a direct implication for engineering teams. When developers use generative tools for coding and care only whether “it runs,” they will struggle to notice implementations that look fine but carry boundary-condition defects. If they insist on a generate–review–test loop, the tool becomes an amplifier instead of a substitute.
Practical team norms include:
- Code review requires the author to explain the rationale behind key design decisions, not just paste the result;
- Generated code must pass unit tests, static analysis, and security checks on dependencies before it reaches the main branch;
- Build an internal library of vetted prompt templates, an internal knowledge index, and sample code repositories to cut down repeated trial and error;
- Periodically review the defect distribution of AI-generated code and turn frequent problems into coding standards or automated checks.
4. Where Automation Should Stop in High-Risk Scenarios
The investor mentioned that when a blind person crosses the street, he would always choose the guide dog over an AI phone, because “AI today cannot anticipate the consequences of its own actions.” That statement has a precise technical meaning.
Generative models produce output probabilistically and can deliver wrong content in a fluent, confident tone — the so-called “hallucination.” More importantly, it is hard for them to explicitly express “I am not sure about this,” and hard for them to bear auditable responsibility for the result. So whether a scenario can be handed to AI can be assessed along three dimensions:
- Reversibility of consequences: can a mistake be undone or corrected at low cost?
- Observability of uncertainty: can the model produce a reliable confidence signal, or does an executable verification method exist?
- Traceability of accountability: after an error, can the cause be located, the responsible party identified, and a complete audit trail preserved?
On that basis, enterprise scenarios fall into three tiers:
- Low risk, safe to automate: log summarization, document drafts, ticket classification, knowledge retrieval Q&A. Errors are caught and fixed quickly, so these are the first candidates for scaling.
- Medium risk, human review: outbound customer service replies, operations involving money, and code merged to production — use “AI drafts, a human confirms.”
- High risk, automate cautiously: medical diagnosis recommendations, financial trading decisions, judicial and compliance determinations, and control logic affecting personal safety or irreversible operations. These should be driven primarily by rule systems and human decisions, with AI limited to assisting with organization and retrieval.
Common implementation measures include:
- Validate structure and content before output, for example by defining the return format with a JSON Schema and rejecting or retrying non-compliant output;
- Apply least privilege and a second confirmation step to tool calls; require idempotency for write operations to prevent duplicate execution;
- Provide a human escalation path, automatically handing low-confidence requests to a person;
- Log the full chain: input, retrieved material, output, and human edits are all recorded for later audit;
- Roll out gradually before scaling up, and use circuit-breaker thresholds to cap the rate of abnormal output.
5. The Economics of Compute Infrastructure: Why “Invest and It Pays Back” Doesn’t Necessarily Hold
On trillions of dollars of compute investment, the investor doubts the money can be recovered. From a unit-economics standpoint, that skepticism has grounding. The unit cost of inference service can be expressed roughly like this:
# Illustrative inference cost model (all figures are assumptions, shown only to demonstrate the calculation)Daily compute demand = daily request count × average compute per requestCompute utilization = actual compute demand / total deployed capacityAmortized cost per request = (depreciation + power + data center + operations + network)/ (total requests × compute utilization)Revenue per successful delivery = per-request payment from the customer (or labor cost saved per task) × successful delivery rateBreak-even condition: revenue per successful delivery > amortized cost per request + extra cost from retries after failed inference
Utilization is the amplifier. Real demand has clear peaks and troughs; resources provisioned for the peak sit largely idle in the trough, and the amortized cost multiplies accordingly. Several other variables matter:
- Technology iteration: faster chips and more efficient inference approaches (quantization, distillation, speculative decoding, and others) keep pushing down the unit cost of inference. Once the depreciation schedule of heavy assets falls out of step with the technology iteration cycle, those assets can lose value early;
- Fragmented demand: many enterprises have scattered, fluctuating needs that are hard to use to fill dedicated capacity;
- Migration cost: enterprises are often unwilling to be locked to a single facility, and spreading workloads further lowers the utilization of any one of them;
- Successful delivery rate: retries caused by failed inference, plus human fallback, are a commonly underestimated hidden cost.
For enterprises, the conclusion is not “don’t invest” but “invest in tiers”:
- High-frequency, stable, latency-sensitive workloads can use annual or monthly committed capacity, or reserved resources, to lower unit cost;
- Volatile, exploratory workloads are better suited to pay-as-you-go elastic resources;
- Put multiple model services behind a unified AI gateway to get routing, degradation, and failover, and avoid deep coupling with a single vendor;
- Build a cost attribution system that tracks inference cost by business unit, team, and feature, and periodically clean up low-value calls.
6. The Software Business Model: From Charging per Seat to Charging for Outcomes
Selling standardized software by account count has been one of the most successful business models of the past two decades: revenue grows linearly with the number of customers and the marginal cost is low. Generative AI is destabilizing its premises:
- When large volumes of execution-type work can be done by agents, customers need fewer accounts, and a “one person plus several agents” working style can emerge, so seats no longer scale with workload;
- Foundational AI capability increasingly looks like general-purpose infrastructure, and a thin feature wrapper is hard to defend;
- Customers will ask: am I paying for software features, or for a definite business outcome?
This does not mean software value disappears. The center of gravity shifts from “recording information” to “executing tasks.” Three responses:
- Product: upgrade systems from systems of record — where people enter and look up data — into systems of action that execute directly inside the business process, for example closing the loop on reconciliation, compliance pre-checks, or ticket resolution automatically;
- Pricing: move from seat subscriptions to usage-based and outcome-based pricing, such as per document processed, per task automated, or a share of quantifiable cost savings and efficiency gains;
- Engineering: provide open APIs, event notifications, and automated workflow integration so the product embeds in the customer’s existing process and raises switching costs.
Buyers should adjust their evaluation approach too. Beyond feature lists and unit price, assess the hidden costs: wasted idle seats, integration and training effort, the difficulty of data export and migration, and the long-term risk of vendor lock-in.
7. Enterprise Implementation: From Scenario Selection to Engineering
7.1 Scenario Selection Matrix
Evaluate candidate scenarios on two dimensions: business value and implementation feasibility. Feasibility itself depends on four things — is the data available, are errors acceptable, is there already a verification method, and are the compliance constraints clear. Start with high-frequency scenarios that have relatively clear rules and quickly correctable errors.
7.2 Architecture Essentials
A typical task-oriented AI application contains these modules:
- Knowledge ingestion and retrieval augmentation: chunk and index internal documents; add reranking and citation labeling at retrieval time to reduce hallucination;
- Tool and business system connections: controlled function calls to query databases, create tickets, and send notifications; write operations must be idempotent;
- Orchestration and state management: multi-step tasks need an explicit state machine plus timeout and retry policies, so the agent does not loop;
- Caching and deduplication: route frequent repeated requests through a semantic cache to cut both cost and latency;
- Evaluation, monitoring, and cost modules: running across the whole flow, these are the foundation for continuous iteration.
7.3 Evaluation and Observability
Without an evaluation set, you cannot tell whether a change is an improvement or a regression. For each core scenario, build a small, representative offline evaluation set containing both typical and boundary cases, and run it automatically as a regression whenever the prompt, the model version, or the retrieval strategy changes.
Illustrative code:
# Scenario evaluation with a regression gate and cost attribution (illustrative; measure actual values in your own environment)import jsonfrom pathlib import Pathdef run_regression(eval_set: Path, solve, thresholds: dict) -> dict:cases = [json.loads(line) for line in eval_set.read_text().splitlines()]total_cost = 0.0passed = 0for case in cases:result, cost = solve(case["input"]) # cost: estimated cost of this calltotal_cost += costif all(result.get(k) == v for k, v in case["expected"].items()):passed += 1metrics = {"success_rate": passed / len(cases),"avg_cost": total_cost / len(cases),}failures = {name: value for name, value in metrics.items()if value < thresholds.get(name, 0.0)}if failures:raise RuntimeError(f"Regression failed, release blocked: {failures}")return metrics
# Tiered routing: choose a model tier by scenario and confidence, with human fallback (illustrative)def route(request):if request.category in LOW_RISK and request.confidence >= 0.90:return light_model(request) # low-risk, high-confidence requests go to a lightweight modelif request.risk_level == HIGH:return escalate_to_human(request) # high-risk scenarios go to human decision makersreturn standard_model(request) # remaining requests go to a general-purpose model
Production needs monitoring as well. Core metrics include task completion rate, first-attempt correctness, human takeover rate, P95 latency, and cost per task; supporting metrics include tool call failure rate and timeout rate. These capabilities can be built on general-purpose cloud products such as log services, monitoring and alerting, and message queue services — for example, the log service, cloud monitoring, and Kafka-compatible message service offered by providers such as Baidu AI Cloud. Alert thresholds should be based on historical baselines rather than guesswork.
8. The Bottom Lines on Security, Permissions, and Compliance
AI applications introduce a new attack surface that has to be considered at design time:
- Prompt injection: external documents, web pages, or user input can hide malicious instructions that induce the model to leak data or perform unauthorized operations; treat all retrieved external content as untrusted data;
- Data leakage: model context may contain sensitive information, so tiered authorization, masking of sensitive data, and a clear statement of whether data is used for service improvement are required;
- Supply chain risk: a model version update can cause behavior drift, so pin versions and pair them with regression evaluation;
- Compliance and audit: critical scenarios must retain input, output, and operation records to meet traceability requirements;
- Output safety: public-facing content needs to pass content moderation to avoid inappropriate or infringing output.
9. A Phased Rollout Roadmap
- Awareness and inventory (about 1 month): management leads by using it; map business processes and produce a candidate scenario list with risk assessments;
- Pilot (2–3 months): pick 2–3 low-risk, high-value scenarios, build an evaluation set and baseline metrics, and validate both effect and cost;
- Standardization (3–6 months): consolidate a shared AI gateway, knowledge base, evaluation platform, and permission system, so teams reuse instead of rebuilding;
- Scaling and process redesign (after 6 months): embed validated scenarios into core processes, and adjust job responsibilities, performance evaluation, and pricing or billing models accordingly.
10. A Rational View of the Hype and the Bubble
“Enterprises fluent in AI survive; the rest are out” reads more like a trend judgment than a timeline. Historically, technology bubbles have coexisted with real productivity change: capital gets misallocated, infrastructure gets overbuilt, but organizations that genuinely embed the technology into their business processes always keep the capability after the bubble deflates.
For enterprises, there is no need to bet on one model vendor or one piece of infrastructure. The three things worth investing in do not go out of date: high-quality internal data and knowledge assets, reliable engineering evaluation and governance, and a team that understands both the business and how to operate AI tools. Get those right, and whatever the technology cycle does, the enterprise keeps converting new technology into dependable productivity.
