How 6 AI Attributes Change Data Center Design

From large training clusters to small edge inference servers, AI is becoming a larger percentage of data center workloads. This represents a shift to higher rack power densities. AI start-ups, enterprises, colocation providers, and internet giants must consider the impact of these densities on the design and management of the data center physical infrastructure. This paper explains the attributes and trends of AI applications that impact data center physical infrastructure. We then present key design considerations for power, cooling, and rack systems. Finally, we explain how good supply chain practices, software management tools, and services mitigate risks inherent in AI deployments and highlight future physical infrastructure.