05 — Journal
AI contextualization, the capability behind every working AI system
Executive TL;DR
- AI models are generic by design. Contextualization is the engineering work that turns generic output into a system that knows your customers, your constraints, and your obligations.
- Most AI programs stall because nobody built the context layer. The model was fine.
- The gap between a pilot that impresses and a deployment that compounds is almost always a contextualization gap.
- Leaders who treat contextualization as infrastructure, not a prompt trick, will have defensible AI programs in eighteen months. The rest will be rebuilding.
The Shift
For two years, enterprise AI buying was a model selection exercise. Which foundation model. Which benchmark. Which vendor. That framing is no longer enough.
The evidence is now clear. Gartner reports that only 28% of AI use cases in infrastructure and operations meet ROI expectations. The winners succeed by integrating into existing workflows, not by picking a better model (Gartner, 2026). MIT’s NANDA review of 300 public deployments found that roughly 95% of enterprise generative AI pilots deliver no measurable P&L impact. It pinned the gap on integration and a learning gap, not model performance (Fortune reporting on MIT NANDA, 2025). Gartner also predicts that through 2026, organizations will abandon 60% of AI projects that lack AI-ready data (Gartner, 2025).
Read those three together and the point is simple. The model is a commodity input. What the model knows about your business is the actual asset.
Why It Matters Now
Foundation models commoditized faster than almost anyone planned for. When two vendors deliver comparable output at comparable cost, the advantage moves upstream. It moves into the layer that tells the model what your business is, what it sells, who it sells to, and what it is not allowed to say. McKinsey makes the same point from a different angle. Only 39% of organizations report enterprise-level EBIT impact from AI. The high performers are nearly three times more likely than peers to have redesigned their workflows around AI instead of bolting it on (McKinsey, 2025). Redesign is a context decision.
When the model is no longer the advantage, your ability to contextualize is the only moat worth defending.
What Most Companies Are Still Doing
Three failure patterns repeat across enterprise programs. They are not execution problems. They are category errors about what contextualization actually is.
The first is treating search-and-prompt setups as a substitute for real context architecture. A search index wired to a chat window is not a context layer. It is a lookup. No version history. No rules written in. No owner. No audit trail. It performs in the demo and degrades in production, because no one built it to be maintained.
The second is letting each team build its own context in isolation. Sales builds one. Support builds another. Marketing builds a third. None are governed. None are reusable. None can be inspected when legal asks what the system actually knows.
The third is judging AI by how good the demo looks, instead of by how well it follows the operational, legal, and brand rules that govern real use. A model that writes a beautiful email and ignores a regulated disclosure has not succeeded. It has created exposure.
What the Best Operators Are Doing Instead
The operators compounding value made one deliberate choice. They treat contextualization as a core capability, with named ownership, written standards, and a maintenance rhythm. It is not a setup task that ends at launch. It is infrastructure, and they fund it that way.
1. Context as a managed asset. The structured knowledge about the business, its customers, and its constraints is an asset, and the best operators govern it like one. They review every change. They keep the history. Ownership is explicit. The context layer keeps a log of every change, because the business does.
2. Constraints built in before launch. They write the legal, regulatory, and brand guardrails into the context layer itself. They do not bolt them on afterward as filters. A filter catches a violation after the model produces it. A rule built into the layer stops the model from producing it at all. That difference matters in regulated categories and anywhere the EU AI Act applies.
3. Reuse context across functions. A context layer built for one system becomes a shared input for the next. The same structured picture of your customers that powers the support agent also powers the sales summaries and the marketing briefs. The first investment compounds. You do not pay to build the same thing three times.
4. Continuous context auditing. The team tests the context layer against real outputs on a fixed schedule. That way, they catch the drift between what the system knows and what the business needs before it becomes a failure the customer sees, or a regulatory one. Think of it the way a director watches dailies. You do not wait for the final cut to find out the lighting is wrong. You check every day, because every day is when the fix is still cheap.
Implications for the Next 12 Months
Context Debt Becomes Visible
Organizations that moved fast on pilots without building context infrastructure are about to recognize the cost. It will not show up as a write-down. It will show up as rework, inconsistent outputs across teams, and stalled scaling. You cannot extend the deployment that worked for one business unit to the next without rebuilding from scratch. Gartner reports that organizations abandoned at least 50% of generative AI projects after proof of concept by the end of 2024. The causes: data quality, inadequate risk controls, escalating costs, and unclear value (Gartner, 2025). Every one of those traces back to the context layer.
Governance Pressure Arrives at the Context Layer Specifically
The EU AI Act’s obligations for providers of general-purpose AI models took effect on 2 August 2025. The AI Office gains full enforcement powers on 2 August 2026 (European Commission, 2025). Penalties for breaches reach 15 million euros, or 3% of worldwide annual turnover. Penalties for prohibited practices reach 35 million euros, or 7% (EU AI Act Article 99, 2024). Those numbers are not theoretical. Meeting the documentation and accountability requirements means knowing exactly what context your systems run on. Organizations that cannot answer that on demand are not compliant. They are exposed.
The Ownership Question Cannot Stay Open
Who owns the context layer. How is it funded. How does it connect to product, legal, and brand. Those three questions separate the organizations reaching enterprise-grade AI from those stuck in perpetual pilot mode. CEO and Chief AI Officer have to align on the answer before anything else moves. Leave it ambiguous and you have decided the layer belongs to no one. That is how it ends up built three times and trusted by no one.
Executive Next Step
Map the context layer your highest-priority AI system actually runs on. Find out who owns it. Then ask whether it would survive an audit on three things: accuracy, whether it follows its own constraints, and whether it can be reused. That audit is the difference between a strategy and a pile of pilots.
Sources
- Gartner, 2026. Gartner found that only a small minority of enterprise AI initiatives actually deliver ROI, with most failures rooted in integration and operational alignment rather than model capability. https://www.gartner.com/en/newsroom/press-releases/2026-04-07-gartner-says-artificial-intelligence-projects-in-infrastructure-and-operations-stall-ahead-of-meaningful-roi-returns
- Fortune (reporting on MIT NANDA ‘The GenAI Divide: State of AI in Business 2025’), 2025. MIT’s NANDA initiative documented that the overwhelming majority of enterprise generative AI pilots produce no measurable financial return, and pinpointed integration, not model quality, as the root cause. https://fortune.com/2025/08/18/mit-report-95-percent-generative-ai-pilots-at-companies-failing-cfo/
- Gartner, 2025. Gartner has tied a majority of AI project abandonment specifically to data and context readiness, validating that the failure point sits upstream of the model. https://www.gartner.com/en/newsroom/press-releases/2025-02-26-lack-of-ai-ready-data-puts-ai-projects-at-risk
- McKinsey & Company, 2025. McKinsey’s 2025 State of AI survey shows that enterprise-wide value capture remains rare and is concentrated among organizations that redesign workflows around AI rather than bolting AI onto existing processes. https://www.mckinsey.com/capabilities/quantumblack/our-insights/the-state-of-ai
- European Commission, Shaping Europe’s Digital Future, 2025. The EU AI Act’s obligations on general-purpose AI providers are already in force, creating accountability requirements that turn the context and documentation layer into a regulated artifact. https://digital-strategy.ec.europa.eu/en/policies/guidelines-gpai-providers
- EU Artificial Intelligence Act, Article 99 (Regulation (EU) 2024/1689), 2024. The EU AI Act backs its governance requirements with penalties that materially exceed GDPR, making context-layer documentation and constraint encoding a board-level concern. https://artificialintelligenceact.eu/article/99/
- Gartner, 2025. Gartner’s longitudinal tracking of GenAI projects shows abandonment has accelerated, with data, risk-control, and value-definition issues, all properties of the context layer, driving cancellations. https://www.gartner.com/en/articles/genai-project-failure