AI SSD Procurement Capacity Estimated to Exceed 45 EB in 2024; NAND Flash Suppliers Accelerate Process Upgrades
TrendForce observes that increased orders for enterprise SSDs from AI server customers have resulted in contract prices for this category rising by over 80% from 4Q23 to 3Q24. SSDs play a crucial role in AI development. In AI model training, SSDs primarily store model parameters, including evolving weights and deviations.
Another key application of SSDs is creating checkpoints to periodically save AI model training progress, allowing recovery from specific points in case of interruptions. Due to a high reliance on fast data transfer and superior write endurance for these functions, customers typically opt for 4 TB/8 TB TLC SSD to meet the demanding requirements of the training process.
TrendForce points out that SSDs used in AI inference servers assist in adjusting and optimizing AI models during the inference process. Notably, SSDs can update data in real time to fine-tune inference model outcomes. AI inference primarily provides retrieval-augmented generation (RAG) and LLM services. SSDs store the reference documents and knowledge bases that RAG and LLM use to generate more informative responses. Additionally, as more generated information is displayed as videos or images, the storage capacity required also increases, making high-capacity SSDs such as TLC/QLC 16 TB or larger the preferred choice for AI inference applications.
Growth rate of AI SSD demand exceeds 60% as suppliers accelerate development of high-capacity products
In 2024, the AI server SSD demand market has seen a significant increase in demand for products larger than 16 TB starting in the second quarter. With the arrival of NVIDIA’s H100, H20, and H200 series products, customers have begun to further boost their orders for 4 TB and 8 TB TLC enterprise SSDs. TrendForce estimates that this year’s AI-related SSD procurement capacity will exceed 45 EB. Over the next few years, AI servers are expected to drive an average annual growth rate of over 60% in SSD demand, with AI SSD demand potentially rising from 5% of total NAND Flash consumption in 2024 to 9% in 2025.
AI inference servers will continue to adopt high-capacity SSD products. Suppliers have already started accelerating process upgrades and are aiming for mass production of 2YY/3XX-layer products from 1Q25, as well as eventually producing 120 TB enterprise SSD products.