-
RoCEv2's operational friction at scale comes from four sources: PFC as a system dependency (pause storms, misconfig propagation), DCQCN's 2-RTT feedback latency, low-entropy ECMP requiring explicit spraying configuration, and out-of-order delivery limitations.
-
UEC is a four-component specification (UET transport + retransmit + congestion control + multipath) ratified in Q4 2024. It targets PFC elimination, native packet spraying, and ACK-based congestion control with 1-RTT feedback latency.
-
The UET packet format replaces BTH with a 20-byte header using Message ID + Packet Offset instead of PSN. This enables out-of-order reassembly natively. Destination UDP port is 4792.
-
UEC reliability uses SACK-based retransmit at the NIC firmware layer. Individual packet loss costs approximately 1 RTT of added latency (microseconds) vs RoCEv2's QP-error recovery path (milliseconds).
-
UEC congestion control marks the same ECN CE bits as DCQCN but reads them from ACK packets rather than CNPs. The feedback loop is 1 RTT instead of 2 RTT -- relevant at 400G and above.
-
Switch requirements: ECN marking is sufficient for baseline UEC. NPM path feedback and path-ID-aware forwarding improve multipath performance but require newer firmware or ASICs.
-
Deployment reality (March 2026): AMD Pensando Salina is production-available UEC silicon. Intel Gaudi 3 has UEC-capable ports. NVIDIA ConnectX-7/BF3 (used in all current DGX nodes) do not support UEC. A DGX cluster cannot run UEC without NIC replacement.
-
Operationally: if you are running a DGX cluster today, you run RoCEv2. UEC is the evaluation framework for your next NIC/switch purchase cycle. The right question to ask vendors in 2026 is "UEC 1.0 compliant?" not "does this support RoCEv2?"
Chapter 20: Ultra Ethernet Consortium (UEC) · Part 10 of 10
What you now know
Jump to section
1. Introduction2. Why RoCEv2 at Scale Has Friction3. What UEC Is: The Consortium and the Spec4. The UET Packet Format5. Reliability: SACK Without Lossless Fabric6. Congestion Control: End-to-End Without Pause Frames7. Native Packet Spraying: Multipath Without RSHP8. What UEC Requires From the Switch9. Deployment State: March 202610. What you now know