Electrical and thermal power concentrated in a single server rack, rising sharply with artificial intelligence workloads.
Rack power density measures the electrical, and therefore thermal, power concentrated in a single server rack, expressed in kilowatts per rack. Historically a few kilowatts, this density has exploded with artificial intelligence workloads: racks housing graphics processor clusters for training large models now reach several tens, or exceed a hundred kilowatts. This concentration mandates liquid or immersion cooling, as air no longer suffices. For insurance, rack density is a direct determinant of potential severity: a thermal failure on a very high-density rack can damage equipment of considerable value within minutes, and the physical proximity of components concentrates exposure. The rapid rise in densities outpaces the accumulation of loss data, keeping pricing uncertainty high on these recent configurations.
A rack dedicated to AI training can exceed a hundred kilowatts, against a few kilowatts for a classic server, multiplying the value exposed to a thermal failure.
densité kW rack, kW per rack, rack density, densité de puissance