NVIDIA’s Vera Rubin Racks Are the Costliest to Date, but AI Giants Pay to Avoid Falling Behind

Key summary
Vera Rubin rack is reported to cost between $3 million and $7 million per rack, digiTimes reported per-rack cost range.
Features seven newly designed chips including the Vera CPU and Rubin GPU and an enhanced NVLink 6 chip, vera Rubin rack includes seven newly designed chips and components such as Vera CPU and Rubin GPU.
Server ODMs would earn about $300,000 at a 10% margin if a Rubin NVL72 rack costs $3 million report cites OEM/ODM margin example at 10% for a $3 million rack.
Server manufacturers have experienced diluted profit margins since rack-scale deployment became prevalent manufacturers face decreasing per-rack profit margins amid rack-scale deployments.
Hyperscalers have placed orders for NVIDIA Vera Rubin NVL72 racks, including OpenAI, Amazon, and Microsoft orders placed by major cloud providers.
