Terabit Ethernet

History

Facebook and Google, among other companies, have expressed a need for TbE.{{cite web

The University of California, Santa Barbara (UCSB) attracted help from Agilent Technologies, Google, Intel, Rockwell Collins, and Verizon Communications to help with research into next generation Ethernet. |access-date = December 15, 2011

In early 2016, core router platforms from Cisco, Juniper and other major manufacturers supported 400 Gbit/s full duplex data rates per slot. One, two and four-port 100 GbE and one port 400 GbE line cards were available. In early 2019, 200 GbE line cards became available after 802.3cd standard ratification. In 2020 the Ethernet Technology Consortium announced a specification for 800 Gigabit Ethernet.

200G Ethernet uses PAM4 signaling, which allows 2 bits to be transmitted per clock cycle, but at a higher implementation cost. Cisco introduced an 800G Ethernet switch in 2022. In 2024, Nokia routers with 800G Ethernet were deployed.

Standards development

The IEEE formed the "IEEE 802.3 Industry Connections Ethernet Bandwidth Assessment Ad Hoc", to investigate the business needs for short and long term bandwidth requirements. |access-date = May 23, 2013 |access-date = December 15, 2011

IEEE 802.3's "400 Gb/s Ethernet Study Group" started working on the 400 Gbit/s generation standard in March 2013. Results from the study group were published and approved on March 27, 2014. Subsequently, the IEEE 802.3bs Task Force started working to provide physical layer specifications for several link distances.

The IEEE 802.3bs standard was approved on December 6, 2017.

The IEEE 802.3cd standard was approved on December 5, 2018.

The IEEE 802.3cn standard was approved on December 20, 2019.

The IEEE 802.3cm standard was approved on January 30, 2020.

The IEEE 802.3cu standard was approved on February 11, 2021.

The IEEE 802.3ck and 802.3db standards were approved on September 21, 2022.

In November 2022 the IEEE 802.3df project objectives were split in two, with 1.6T and 200G/lane work being moved to the new IEEE 802.3dj project

• Original IEEE P802.3df Objectives
• Updated IEEE P802.3df Objectives to reduce scope to 800G Ethernet using 100G physical lanes
• IEEE P802.3dj Objectives for 1.6 Tbit/s Ethernet and PHYs that employ 200 Gbit/s lanes
• IEEE P802.3dj Objectives updated in May 2023 to include 200G/lane backplane Ethernet
• IEEE P802.3dj Objectives updated in January 2024 to include additional PHY types

The IEEE 802.3df standard was approved on February 16, 2024.

IEEE project objectives

Like all speeds since 10 Gigabit Ethernet, the standards support only full-duplex operation. Other objectives include:

1. Preserve the Ethernet frame format utilizing the Ethernet MAC
2. Preserve minimum and maximum frame size of current Ethernet standard
3. Support a bit error ratio (BER) of 10−13, which is an improvement over the 10−12 BER that was specified for 10GbE, 40GbE, and 100GbE.
4. Support for OTN (transport of Ethernet across optical transport networks), and optional support for Energy-Efficient Ethernet (EEE).

802.3bs project

Define physical layer specifications supporting:

• 400 Gbit/s Ethernet
  • at least 100 m over multi-mode fiber (400GBASE-SR16) using 16 parallel strands of fiber each at 25 Gbit/s
  • at least 500 m over single-mode fiber (400GBASE-DR4) using 4 parallel strands of fiber each at 100 Gbit/s
  • at least 2 km over single-mode fiber (400GBASE-FR8) using 8 parallel wavelengths (CWDM) each at 50 Gbit/s
  • at least 10 km over single-mode fiber (400GBASE-LR8) using 8 parallel wavelengths (CWDM) each at 50 Gbit/s
  • 8 and 16 lane chip-to-chip/chip-to-module electrical interfaces (400GAUI-8 and 400GAUI-16)
• 200 Gbit/s Ethernet
  • at least 500 m over single-mode fiber (200GBASE-DR4) using 4 parallel strands of fiber each at 50 Gbit/s
  • at least 2 km over single-mode fiber (200GBASE-FR4) using 4 parallel wavelengths (CWDM) each at 50 Gbit/s
  • at least 10 km over single-mode fiber (200GBASE-LR4) using 4 parallel wavelengths (CWDM) each at 50 Gbit/s
  • 4 or 8 lane chip-to-chip/chip-to-module electrical interfaces (200GAUI-4 and 200GAUI-8)

802.3cd project

• Define four-lane 200 Gbit/s PHYs for operation over:
  • copper twin-axial cables with lengths up to at least 3 m (200GBASE-CR4).
  • printed circuit board backplane with a total channel insertion loss of ≤ 30 dB at 13.28125 GHz (200GBASE-KR4).
• Define 200 Gbit/s PHYs for operation over MMF with lengths up to at least 100 m (200GBASE-SR4).

802.3ck project

• 200 Gbit/s Ethernet
  • Define a two-lane 200 Gbit/s Attachment Unit interface (AUI) for chip-to-module applications, compatible with PMDs based on 100 Gbit/s per lane optical signaling (200GAUI-2 C2M)
  • Define a two-lane 200 Gbit/s Attachment Unit Interface (AUI) for chip-to-chip applications (200GAUI-2 C2C)
  • Define a two-lane 200 Gbit/s PHY for operation over electrical backplanes an insertion loss ≤ 28 dB at 26.56 GHz (200GBASE-KR2)
  • Define a two-lane 200 Gbit/s PHY for operation over twin axial copper cables with lengths up to at least 2 m (200GBASE-CR2)
• 400 Gbit/s Ethernet
  • Define a four-lane 400 Gbit/s Attachment Unit interface (AUI) for chip-to-module applications, compatible with PMDs based on 100 Gbit/s per lane optical signaling (400GAUI-4 C2M)
  • Define a four-lane 400 Gbit/s Attachment Unit Interface (AUI) for chip-to-chip applications (400GAUI-4 C2C)
  • Define a four-lane 400 Gbit/s PHY for operation over electrical backplanes an insertion loss ≤ 28 dB at 26.56 GHz (400GBASE-KR4)
  • Define a four-lane 400 Gbit/s PHY for operation over twin axial copper cables with lengths up to at least 2 m (400GBASE-CR4)

802.3cm project

• 400 Gbit/s Ethernet
  • Define a physical layer specification supporting 400 Gbit/s operation over 8 pairs of MMF with lengths up to at least 100 m (400GBASE-SR8)
  • Define a physical layer specification supporting 400 Gbit/s operation over 4 pairs of MMF with lengths up to at least 100 m (400GBASE-SR4.2)

802.3cn project

• 200 Gbit/s Ethernet
  • Provide a physical layer specification supporting 200 Gbit/s operation over four wavelengths capable of at least 40 km of SMF (200GBASE-ER4)
• 400 Gbit/s Ethernet
  • Provide a physical layer specification supporting 400 Gbit/s operation over eight wavelengths capable of at least 40 km of SMF (400GBASE-ER8)

802.3cu project

• Define a four-wavelength 400 Gbit/s PHY for operation over SMF with lengths up to at least 2 km (400GBASE-FR4)
• Define a four-wavelength 400 Gbit/s PHY for operation over SMF with lengths up to at least 6 km (400GBASE-LR4-6)

802.3cw project

• Provide a physical layer specification supporting 400 Gbit/s operation on a single wavelength capable of at least 80 km over a DWDM system (400GBASE-ZR) Dual polarization 16-state quadrature amplitude modulation (DP-16QAM) with coherent detection is proposed. The project was canceled in 2024.

802.3db project

• 200 Gbit/s Ethernet
  • Define a physical layer specification that supports 200 Gbit/s operation over 2 pairs of MMF with lengths up to at least 50 m (200GBASE-VR2)
  • Define a physical layer specification that supports 200 Gbit/s operation over 2 pairs of MMF with lengths up to at least 100 m (200GBASE-SR2)
• 400 Gbit/s Ethernet
  • Define a physical layer specification that supports 400 Gbit/s operation over 4 pairs of MMF with lengths up to at least 50 m (400GBASE-VR4)
  • Define a physical layer specification that supports 400 Gbit/s operation over 4 pairs of MMF with lengths up to at least 100 m (400GBASE-SR4)

'IEEE P802.3db 100 Gb/s, 200 Gb/s, and 400 Gb/s Short Reach Fiber Task Force'

802.3df project

• Adds 800G Ethernet rate and specifies port types using existing 100G per lane technology

IEEE P802.3df Objectives for 800 Gbit/s Ethernet and 400G and 800G PHYs using 100 Gbit/s lanes

802.3dj project

• Adds 1.6 Tbit/s Ethernet rate and specifies port types using new 200 Gbit/s per lane technology.

IEEE P802.3dj Objectives for 1.6 Tbit/s Ethernet and 200, 400 800 Gbit/s, and 1.6 Tbit/s PHYs using 200 Gbit/s lanes

802.3ds project

• Adds 200, 400, 800 Gbit/s and 1.6 Tbit/s MMF PHYs with 30m and 50m reach.

IEEE P802.3ds Objectives for 200 Gb/s per Wavelength MMF PHYs

200G port types

400G port types

800G port types

1.6T port types

References

References

1. "IEEE 802.3 NGOATH SG Adopted Changes to 802.3bs Project Objectives".
2. "Network boffins say Terabit Ethernet is TOO FAST: Sticking to 400Gb for now".
3. "On-board optics: beyond pluggables | Fibre Systems".
4. "[STDS-802-3-400G] IEEE P802.3bs Approved!". IEEE 802.3bs Task Force.
5. "[802.3_B400G] IEEE P802.3df Standard Approved!".
6. (30 Aug 2016). "OIF Launches CEI-112G Project for 100G Serial Electrical Links". Businesswire.
7. "802.3df Public Area".
8. (2023-11-28). "Adopted IEEE P802.3dj Timeline".
9. "Service Provider Network and Technology Services".
10. "Alcatel-Lucent boosts operator capacity to deliver big data and video over existing networks with launch of 400G IP router interface".
11. "Rebranded Ethernet Technology Consortium Unveils 800 Gigabit Ethernet".
12. Smith, Ryan. "Micron Spills on GDDR6X: PAM4 Signaling For Higher Rates, Coming to NVIDIA's RTX 3090".
13. "Cisco powers up Nexus switch, offers 800GB optic modules".
14. (16 January 2024). "NL-ix deploys a range of Nokia service routers".
15. (July 19, 2012). "IEEE Industry Connections Ethernet Bandwidth Assessment". IEEE 802.3 Ethernet Working Group.
16. "400 Gb/s Ethernet Study Group". IEEE 802.3.
17. "IEEE P802.3bs 400 Gb/s Ethernet Task Force".
18. (Mar 2014). "Objectives". IEEE 802.3bs Task Force.
19. "100 m MMF draft proposal".
20. "400GBase-SR16 draft specifications".
21. "IEEE 802.3 Ethernet Working Group Liaison letter to ITU-T Questions 6/15 and 11/15".
22. "400G-PSM4: A Proposal for the 500 m Objective using {{nowrap".
23. "400 Gb/s 8x50G PAM4 WDM 2km SMF PMD Baseline Specifications".
24. "Baseline Proposal for 8 x 50G NRZ for 400GbE 2 km and 10 km PMD".
25. [http://www.ieee802.org/3/bs/public/16_03/NGOATH_3bs_Objectives_16_0316.pdf IEEE 802.3 NGOATH SG Adopted Changes to 802.3bs Project Objectives] Updated by IEEE 802.3 NGOATH Study Group, Mar 16, 2016, IEEE 802 Mar 2016 Plenary, Macau, China.
26. "IEEE 802.3bs 200/400 Gb/s Ethernet (Standards Informant)".
27. "Adopted Objectives".
28. "Approved Objectives".
29. "IEEE P802.3cw Adopted Objectives".
30. "Review of Decisions in P802.3ct related to P802.3cw".
31. (2017-06-04). "Exploring The IEEE 802 Ethernet Ecosystem". IEEE.
32. (2016-05-22). "Multi-Port Implementations of 50/100/200GbE". Brocade.
33. "100Gb/s Electrical Signaling". IEEE 802.3 NEA Ad hoc.
34. "400G-FR4 Technical Specification". 100G Lambda MSA Group.
35. "400G-LR4-10 Technical Specification". 100G Lambda MSA Group.