Mastering AI: SAP’s Bet On Owning The Record System Instead Of Outsourcing Intelligence

SAP has launched Joule, its enterprise AI platform, which is now integrated into over 35 solutions including S/4HANA Cloud and SuccessFactors. This move represents a strategic shift to prioritize owning enterprise data over building or sourcing large language models externally, aiming to secure its dominance in enterprise AI infrastructure.

SAP’s Joule acts as a comprehensive AI interface for business operations, with over 2,500 ‘Joule Skills’ and plans to expand to 50 assistants by Q3 2026. The platform is designed to leverage SAP’s Knowledge Graph, which reads structured, permissioned data directly from SAP’s Business Technology Platform, ensuring context-rich, accurate responses tailored to specific enterprise workflows.

At SAP Sapphire in May, the company announced a €100 million partner fund to develop custom agents using Joule Studio, its low-code agent builder. Early case studies include a retail chain reducing HR cycle times by 50% and an airport operator cutting operational costs significantly. SAP’s strategic narrative frames this as creating an Autonomous Enterprise, where AI agents become as vital as human operators.

Implications of SAP’s Data-Centric AI Strategy

This approach positions SAP uniquely in the enterprise AI landscape, emphasizing data ownership and structured metadata over the development of large, open-ended models. It aims to create a moat around SAP’s installed base, especially given the complexity and regulation of enterprise data. By controlling the data layer, SAP seeks to maintain a competitive advantage as models become commoditized, reducing dependency on external AI providers and fostering a more predictable, secure AI environment for clients.

SAP’s Enterprise AI Evolution and Strategic Positioning

Until now, SAP’s AI efforts focused on integrating AI features into existing solutions and acquiring third-party models, such as Prior Labs, to enhance its capabilities. The company’s core strategy has been to leverage its extensive installed base—many of which are mission-critical, heavily customized systems—to build trust and reliability. The launch of Joule and the emphasis on data infrastructure reflect a deliberate move to shift from model development to data ownership, aligning with broader industry trends toward data-centric AI architectures.

This development follows SAP’s ongoing migration to the cloud and its push for a clean core approach, which simplifies data structures and accelerates AI integration. The company’s investments in the Knowledge Graph and partner ecosystem underscore its focus on structured, context-rich data as the foundation for enterprise AI.

“Joule is designed to read business metadata directly from SAP’s platform, ensuring contextually accurate AI responses tailored to enterprise workflows.”

— SAP spokesperson

Uncertainties Around Adoption and Model Dependency

While SAP has outlined its technical architecture and initial deployments, it is still unclear how quickly and broadly organizations will adopt Joule at scale. The success depends heavily on demand-side adoption, which SAP itself acknowledges may require subsidies and active engagement. Additionally, the strategy’s resilience depends on the stability and capabilities of external frontier models, which could shift due to pricing, access, or quality issues.

It remains uncertain how SAP will manage potential dependencies on third-party models and whether its own orchestration approach can sustain its competitive advantage if external model quality or availability declines.

Next Steps for SAP’s Enterprise AI Roadmap

SAP plans to expand Joule’s capabilities, with a roadmap targeting 50 assistants and 200 agents by Q3 2026. The company will likely focus on increasing partner ecosystem engagement, refining AI integration, and demonstrating measurable ROI for clients. Monitoring adoption rates and client feedback will be critical to assess whether SAP’s data-centric approach can reshape enterprise AI and sustain its market position.

Further developments may include new use cases, expanded integrations, and potentially more transparent pricing models to foster wider adoption across diverse enterprise sectors.

Key Questions

How does SAP’s Joule differ from other enterprise AI solutions?

Joule emphasizes owning and reading structured, permissioned enterprise data directly from SAP’s platform, rather than relying solely on external AI models. Its architecture leverages SAP’s Knowledge Graph to ensure contextually accurate responses tailored to specific workflows.

What are the main risks associated with SAP’s AI strategy?

The key risks include unpredictable AI consumption costs, dependence on external models that could change in quality or availability, and slow adoption due to the complexity of enterprise environments and the need for trust and compliance.

Will SAP’s approach reduce reliance on external AI providers?

Yes, by focusing on owning and orchestrating its data layer and models, SAP aims to reduce dependency on external providers, creating a more controlled and secure AI environment for enterprise customers.

How might this strategy impact SAP’s existing customers?

Existing customers will need to adapt their data structures and workflows to leverage Joule effectively, which could accelerate migration to SAP’s cloud solutions but may require initial investment and change management.

When will SAP’s full AI vision be realized?

Full realization is expected by the end of 2026, with ongoing updates, new features, and broader adoption expected over the next 12-18 months.

Source: ThorstenMeyerAI.com