TL;DR

Memory costs have surged to nearly two-thirds of total AI chip component expenses, driven by increased demand and production costs. This shift impacts the overall chip manufacturing landscape and supply chain dynamics.

Memory has grown to nearly two-thirds (63%) of the total component costs for AI chips, according to recent analysis of industry data, marking a significant shift in the supply chain distribution for major manufacturers like Nvidia, AMD, Google, and Amazon.

Analysis based on estimated per-chip costs and quarterly production volumes indicates that memory (specifically high-bandwidth memory or HBM) increased its share from 52% in early 2024 to approximately 63% by the first quarter of 2026. During this period, total component spending on AI chips rose from around $22 billion to $52 billion, with memory costs alone accounting for roughly $20 billion of that increase. For more on industry challenges, see related legal actions.

Other component categories, such as advanced packaging and auxiliary components, saw declines in their share of total costs — packaging fell from 19% to 15%, and auxiliary components from 15% to 9%. The share of logic dies remained relatively stable at around 13–14%. These shifts reflect changing priorities and cost structures in AI chip manufacturing, driven by increased memory demand and supply chain pressures.

Why It Matters

This trend indicates a significant shift in the AI hardware supply chain, with memory now dominating component costs. For industry stakeholders, this underscores the importance of memory technology development and supply chain resilience. The rising costs could influence chip pricing, design choices, and manufacturing strategies, potentially impacting the affordability and deployment of AI hardware across sectors.

MEMORY WAR: HBM's Dominance Beyond NVIDIA — The 12-Year Monopoly Formula (The Memory Hegemony Series Book 1)

MEMORY WAR: HBM's Dominance Beyond NVIDIA — The 12-Year Monopoly Formula (The Memory Hegemony Series Book 1)

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Background

Prior to this analysis, the industry primarily viewed logic and packaging as major cost drivers. The recent data suggests a reversal, with memory costs surging due to increased demand from AI applications and supply chain constraints. This change coincides with the rapid growth in AI chip production, which expanded from approximately $22 billion in 2024 to over $52 billion in 2025.

“Memory’s share of AI chip component costs has nearly doubled over the past year, reflecting increased demand and supply chain pressures.”

— industry analyst

“The rising costs of high-bandwidth memory could influence future chip designs and pricing strategies across the industry.”

— supply chain expert

Yahboom Jetson Orin NX Super 157TOPS with AI Large Model Voice Module,IMX219 CSI Camera,256GB SSD,Jetson Aluminum Case for Mechanical Engineers Embedded Edge Systems

Yahboom Jetson Orin NX Super 157TOPS with AI Large Model Voice Module,IMX219 CSI Camera,256GB SSD,Jetson Aluminum Case for Mechanical Engineers Embedded Edge Systems

【Core Parameters】★AI Perf: 117/157 TOPS★GPU: 1024-core N-VI-DIA Ampere architecture GPU with 32 Tensor Cores★CPU: 8-core Arm Cortex-A78AE v8.2…

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

What Remains Unclear

While the data indicates a clear increase in memory costs as a share of total component expenses, the precise reasons—such as supply chain disruptions, technological advancements, or demand spikes—are still under investigation. Additionally, future cost trends remain uncertain as market conditions evolve.

KlNGST0N 1 x 96GB DDR5 5600MT/s ECC RDIMM Server RAM (KSM56R46BD4PMI-96MBI) - Dual Rank, CL46, 288-Pin, 1.1V Registered DIMM Memory with Locked BOM & Micron B-Die DRAM for Servers & Threadripper PCs

KlNGST0N 1 x 96GB DDR5 5600MT/s ECC RDIMM Server RAM (KSM56R46BD4PMI-96MBI) – Dual Rank, CL46, 288-Pin, 1.1V Registered DIMM Memory with Locked BOM & Micron B-Die DRAM for Servers & Threadripper PCs

[ Maximize Data Center Throughput ] Upgrade your infrastructure with a powerhouse 96GB DDR5 5600MT/s Registered DIMM. This…

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

What’s Next

Further detailed analysis is expected as more quarterly data becomes available, particularly regarding supply chain developments and technological innovations in memory manufacturing. Industry stakeholders will likely monitor cost trends closely to adjust their strategies accordingly.

Yahboom K230 AI Development Board 1.6GHz High-performance chip/2.4-inch Display/Open Source Robot Maker Python, Supports AI Visual Recognition CanMV Sensor (with Heightened Bracket)

Yahboom K230 AI Development Board 1.6GHz High-performance chip/2.4-inch Display/Open Source Robot Maker Python, Supports AI Visual Recognition CanMV Sensor (with Heightened Bracket)

【Flagship performance, extremely fast response】Equipped with a 1.6GHz main frequency chip, the KPU computing power is 13.7 times…

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Key Questions

Why has memory become such a large part of AI chip costs?

Memory, especially high-bandwidth memory (HBM), has seen increased demand due to the growth of AI workloads, and supply constraints have driven up its cost share.

How might this trend affect AI hardware prices?

Rising memory costs could lead to higher prices for AI chips, potentially impacting the cost of deploying AI systems across industries.

Is this trend expected to continue?

It is uncertain; future developments in memory technology, supply chain resilience, and AI demand will influence whether this cost share continues to grow.

Which companies are most affected by this change?

Major AI chip manufacturers like Nvidia, AMD, Google, and Amazon are most impacted, as they rely heavily on memory components in their designs.

Source: Hacker News

You May Also Like

How AI Engineers Consumer Behavior Through Subtle Digital Cues

Unlock the secrets behind how AI engineers subtly influence your choices through digital cues that shape your behavior without your awareness.

Wirestock raises $23M to supply creative multi-modal data to AI labs

Wirestock has raised $23 million to provide AI research labs with diverse multi-modal datasets, enhancing AI training capabilities.

US Law Enforcement Warns of ‘Anti-Tech Extremism’ as AI Hatred Grows

US agencies warn of growing threats from anti-technology extremists amid AI-related protests and violence, highlighting new surveillance efforts.

From Industry to Education, Germany Invests Heavily in AI Innovation.

Much remains to be seen as Germany’s substantial AI investments transform industry and education, shaping the future of innovation and societal progress.