7 Liquid Cooling, High-Density Architectures, and Technology Cooling Systems (TCS)
Technical-Commercial Measurement Breakdown: Liquid Cooling and TCS Packages
When rack thermal power densities surpass 20 kW to 30 kW per cabinet, air becomes thermodynamically inefficient and physically constrained due to fan power consumption, acoustic thresholds, and volumetric airflow limits (ASHRAE TC 9.9 2023; h2x Engineering 2024). The deployment of artificial intelligence (AI) and high-performance computing (HPC) clusters operating between 40 kW and 132 kW per rack requires Direct-to-Chip (DTC) or immersion liquid cooling architectures (ASHRAE TC 9.9 2023; APALTEK 2024).
This transition fundamentally alters the Bill of Quantities (BOQ), requiring quantity surveyors to measure two distinct, hydronically isolated circuits: the primary Facility Water System (FWS) and the secondary Technology Cooling System (TCS), coupled thermally through plate-frame Coolant Distribution Units (CDUs) (ASHRAE TC 9.9 2023; Reliability Engine 2024).
The secondary TCS circuit, operating directly across micro-channel server cold plates (25\text{ to }100\text{ }\mu\text{m} fin pitch), demands warmer supply temperatures (ASHRAE W27 to W45 classes) and strict fluid cleanliness (ASHRAE TC 9.9 2023; Reliability Engine 2024). This loop must be priced using high-grade stainless steel (ASTM A312 TP304L or TP316L) or high-density polypropylene (PP-RCT) pipework to prevent chemical leaching, galvanic corrosion, and particulate fouling (ASHRAE TC 9.9 2023; APALTEK 2024). The CDU serves as the technical and contractual partition between FWS and TCS, housing primary modulating control valves, brazed or gasketed SS316/titanium plate heat exchangers, redundant variable-speed circulators, dual A/B power feeds, and 50\text{ }\mu\text{m} filtration skids (Reliability Engine 2024; Keentel Engineering 2024).
| Mechanical System Element | Takeoff Measurement Unit | Primary Material & Engineering Specifications | Critical QS Inclusions & Cost Drivers |
|---|---|---|---|
| Coolant Distribution Units (CDUs) | Number (No.) / Exchange Capacity (kW) | Liquid-to-liquid floor-standing or in-row units (300\text{ kW to } 1500+\text{ kW}); brazed or gasketed titanium/SS316 plates (ASHRAE TC 9.9 2023; Keentel Engineering 2024). | Redundant N+1 integrated pumps, dual A/B UPS electrical power supplies, leak containment drip trays, 50\text{ }\mu\text{m} duplex filters, and Modbus/BACnet interface cards (Reliability Engine 2024). |
| Secondary Technology Piping (TCS) | Linear Meter (m) by diameter | Grade 304L or 316L stainless steel (Schedule 10S/40S); orbital TIG welded or sanitary flanged; PP-RCT alternatives (ASHRAE TC 9.9 2023; Reliability Engine 2024). | Precision chemical pickling and passivation, clean-room particulate flushing protocols, borescope weld inspection, and continuous under-pipe drip containment trays (RICS 2021; Helonic 2024). |
| Blind-Mate Quick Disconnects (QD) | Number (No.) of sets | Non-drip, flat-face push-to-connect dual shut-off valved couplings (OCP / Mila standard); SS316 construction (ASHRAE TC 9.9 2023; Reliability Engine 2024). | High-pressure EPDM/FKM wetted elastomer seals, low pressure-drop coefficient (C_v), and 100\% factory helium/hydrostatic leak testing (Reliability Engine 2024). |
7.1 Direct-to-Chip (DTC) liquid cooling infrastructure: Coolant Distribution Units (CDUs)—Liquid-to-Liquid and Liquid-to-Air typology measurement
The MEP-QS classifies CDUs into two architectural typologies (ASHRAE TC 9.9 2023; Reliability Engine 2024):
- Liquid-to-Liquid (L2L) CDUs: Reject TCS heat directly into the primary chilled water or condenser water FWS loop. Sized from 300\text{ kW} (in-row rack footprint) to 1,500\text{–}2,500\text{ kW} (end-of-row or gallery skid). Require both primary FWS carbon-steel/stainless connections and secondary TCS SS316L header connections (Keentel Engineering 2024).
- Liquid-to-Air (L2A) CDUs: Reject TCS heat directly into the white space air stream via an internal finned coil and fan array. Used for tactical AI cluster retrofits inside legacy air-cooled halls where extending FWS piping is unfeasible (APALTEK 2024).
7.2 Secondary hydronic network (TCS): Stainless steel (304/316L) headers, polypropylene-RCT piping, clean-break blind-mate quick disconnects (QD)
Unlike primary FWS carbon steel pipework, secondary TCS pipework cannot tolerate mill scale, welding slag, or iron oxide corrosion products that would instantly plug server micro-channel cold plates (ASHRAE TC 9.9 2023). Takeoff rates for SS316L TCS headers must include:
- High-Purity Orbital TIG Welding: Automated orbital welding with internal argon purge gas backing to eliminate interior weld oxidation (“sugaring”), plus borescope inspection logs (ASHRAE TC 9.9 2023; Reliability Engine 2024).
- Rack Cooling Manifolds & Flexible Whip Hoses: Vertical stainless steel rack manifolds (40\text{ to }84\text{ ports} per rack) and kink-resistant EPDM/PTFE braided flexible hoses connecting header isolation ball valves to each server blade via dripless Quick Disconnects (QDs) (ASHRAE TC 9.9 2023; Reliability Engine 2024).
7.3 Heat transfer thermodynamics: Determining hydronic flow demand from design rack Delta-T (\Delta T) and chip envelope limits
The thermodynamic relationship governing the fluid mass flow rate (\dot{m}) required to remove heat from the white space is (ASHRAE TC 9.9 2023; Reliability Engine 2024):
Q = \dot{m} C_p \Delta T \tag{7.1}
where Q represents the heat rejection duty in kilowatts (\text{kW}), \dot{m} is the fluid mass flow rate in kilograms per second (\text{kg/s}), C_p is the specific heat capacity of the heat transfer fluid in \text{kJ/(kg}\cdot\text{K)}, and \Delta T represents the temperature difference between the TCS supply and return lines in kelvin (\text{K}) (Reliability Engine 2024).
Converting mass flow into volumetric flow rate (\dot{V}) in liters per second (\text{L/s}), accounting for fluid density (\rho):
\dot{V} = \frac{Q}{\rho C_p \Delta T} \tag{7.2}
For the MEP-QS, changes in the design \Delta T alter fluid flow requirements, which directly impacts pipe sizing, valve bodies, pumping kilowatts, and insulation volumes (h2x Engineering 2024). In a direct-to-chip architecture with a narrow design temperature difference (\Delta T = 10\text{ K}) using a standard 25% propylene glycol solution (PG25: \rho \approx 1020\text{ kg/m}^3, C_p \approx 3.93\text{ kJ/(kg}\cdot\text{K)}), the volumetric flow rate per megawatt (1000\text{ kW}) of critical IT heat load is:
\dot{V} = \frac{1000\text{ kW}}{1.02\text{ kg/L} \times 3.93\text{ kJ/(kg}\cdot\text{K)} \times 10\text{ K}} \approx 24.95\text{ L/s} \quad (1497\text{ L/min}) \tag{7.3}
This confirms the empirical rule of approximately 1.5\text{ L/min} per kilowatt of critical load (Keentel Engineering 2024). Expanding the design \Delta T to 20\text{ K} halves the volumetric flow rate to 12.47\text{ L/s} (748.4\text{ L/min}) (h2x Engineering 2024). This reduction permits smaller header sizes (reducing a nominal bore from \text{DN125} to \text{DN80}), cutting stainless steel tonnage and orbital welding labor while reducing secondary pumping power requirements by approximately 70\% (h2x Engineering 2024).
Code
import math
def dtc_flow_calculator(it_load_kw=1000.0, delta_t_k=10.0, rho_kg_m3=1020.0, cp_kj_kg_k=3.93, max_vel_m_s=2.4):
rho_kg_l = rho_kg_m3 / 1000.0
v_dot_l_s = it_load_kw / (rho_kg_l * cp_kj_kg_k * delta_t_k)
v_dot_l_min = v_dot_l_s * 60.0
l_min_per_kw = v_dot_l_min / it_load_kw
# Standard Sch 10S SS316L pipes (DN, ID_mm)
pipes = [(50, 54.79), (65, 66.93), (80, 82.80), (100, 108.20), (125, 134.50), (150, 161.46)]
selected_dn, actual_vel = pipes[-1][0], 0.0
for dn, id_mm in pipes:
area_m2 = math.pi * ((id_mm / 1000.0) / 2.0) ** 2
vel = (v_dot_l_s / 1000.0) / area_m2
if vel <= max_vel_m_s:
selected_dn, actual_vel = dn, vel
break
return v_dot_l_s, v_dot_l_min, l_min_per_kw, selected_dn, actual_vel
print(f"{'Delta-T (K)':<12} | {'Flow (L/s)':<12} | {'Flow (L/min)':<14} | {'L/min/kW':<10} | {'Header DN':<10} | {'Velocity (m/s)'}")
print("-" * 78)
for dt in [8.0, 10.0, 12.0, 15.0, 20.0]:
v_ls, v_lmin, l_kw, dn, vel = dtc_flow_calculator(1000.0, dt)
print(f"{dt:<12.1f} | {v_ls:<12.2f} | {v_lmin:<14.1f} | {l_kw:<10.2f} | DN{dn:<8} | {vel:.2f}")Delta-T (K) | Flow (L/s) | Flow (L/min) | L/min/kW | Header DN | Velocity (m/s)
------------------------------------------------------------------------------
8.0 | 31.18 | 1871.0 | 1.87 | DN125 | 2.19
10.0 | 24.95 | 1496.8 | 1.50 | DN125 | 1.76
12.0 | 20.79 | 1247.3 | 1.25 | DN100 | 2.26
15.0 | 16.63 | 997.9 | 1.00 | DN100 | 1.81
20.0 | 12.47 | 748.4 | 0.75 | DN80 | 2.32
7.4 Heat exchanger approach temperature analysis and secondary pumping power quantification
The CDU plate heat exchanger approach temperature (\Delta T_{\text{approach}} = T_{\text{TCS,supply}} - T_{\text{FWS,supply}}) typically ranges from 2\text{ K to }4\text{ K} (ASHRAE TC 9.9 2023; Keentel Engineering 2024). Tightening the approach temperature to 1.5\text{ K} enables warmer FWS water and higher economizer free-cooling hours, but increases CDU titanium/SS316 plate surface area (A = Q / (U \cdot \text{LMTD})) and CDU unit CapEx by 25\%\text{ to }40\% (Keentel Engineering 2024). Furthermore, because liquid-cooled racks possess minimal thermal mass and can suffer thermal trip in seconds if coolant circulation stops, all secondary CDU pumps must be priced on uninterruptible UPS electrical feeds (h2x Engineering 2024; Budlong 2024).
7.5 Rear Door Heat Exchangers (RDHx) and Immersion Cooling systems: Single-phase and two-phase dielectric fluid measurement and containment tanks
- Rear Door Heat Exchangers (RDHx): Passive or active fan-assisted chilled-water coils mounted directly to the rear frame of standard 19-inch racks (25\text{ to }50\text{ kW/rack}), measured per door (
No.) plus overhead/underfloor flexible hose drops and condensation management controls (ASHRAE TC 9.9 2023; APALTEK 2024). - Single-Phase & Two-Phase Immersion Tanks: Submerge IT servers in synthetic hydrocarbon or fluorocarbon dielectric fluids inside horizontal bath tanks (50\text{ to }200\text{ kW/tank}). The MEP-QS must quantify the dielectric fluid initial fill volume (\text{Liters}, often representing a major chemical capital cost), overhead gantry cranes for blade extraction, and vapor recovery condensers (APALTEK 2024; Budlong 2024).
7.6 Secondary loop treatment: Treated demineralized water, propylene glycol mixes (PG25), biocide packages, micron filtration, and wetted materials compatibility
ASHRAE TC 9.9 mandates strict wetted-materials compatibility across the entire TCS loop (restricting wetted components to SS316L, copper, brass, EPDM, and inhibited PG25 or deionized water with azole corrosion inhibitors and non-oxidizing biocides—strictly prohibiting aluminum or galvanized steel) (ASHRAE TC 9.9 2023; Reliability Engine 2024). Pre-commissioning BOQ items must include full chemical pickling, passivation, 5\text{ }\mu\text{m} temporary bypass flushing cartridges, and accredited laboratory water quality testing certificates prior to server cold-plate connection (ASHRAE TC 9.9 2023; CxPlanner 2024).