The AI disruption: Challenges and guidance for data center design
- By Victor Avelar, Patrick Donovan, Paul Lin, Wendy Torell, Maria A. Torres Arango
- 12 Oct 2023
- 1 min read
From large training clusters to small edge inference servers, AI is becoming a larger percentage of data center workloads. This represents a shift to higher rack power densities. AI start-ups, enterprises, colocation providers, and internet giants must now consider the impact of these densities on the design and management of the data center physical infrastructure. This paper explains relevant attributes and trends of AI workloads and describes the resulting data center challenges. Guidance to address these challenges is provided for each physical infrastructure category including power, cooling, racks, and software management.
Latest in Digitalization
The rise of smarter homes
The case for BESS
AI disruption: Data center design challenges and guidance
United for net-zero: Public-private collaboration to accelerate industry decarbonization