Amazon just made a key AI cloud service more expensive

Insight summary

• •Amazon Web Services raised prices for EC2 Capacity Blocks for ML by about 20% starting July, after a 15% increase in January.
• •This service allows companies to reserve GPUs in advance to prevent workload interruptions, popular for large AI model training.
• •Price increases reflect high demand for GPUs and tight supply of critical components like high-bandwidth memory.
• •Other tech companies such as Apple and Xbox have also raised prices due to soaring memory chip costs.
• •Physical hardware constraints, especially memory shortages, limit AI cloud service expansion and increase costs.
• •Cloud giants like AWS, Microsoft, Google, and Oracle have increased pricing power due to scarce GPU capacity.
• •Memory-chip makers Micron and SK Hynix benefit from high AI-driven demand, pushing market prices to record levels.