๐งTom's HardwareโขRecentcollected in 55h
Foundries Race Toward Co-Packaged Optical Connectivity
๐กCPO may determine how future AI clusters overcome copper bandwidth limits.
โก 30-Second TL;DR
What Changed
AI system growth is pushing traditional copper interconnects toward their performance limits.
Why It Matters
CPO could become an important interconnect direction as AI clusters require greater bandwidth and scale. Different foundry approaches may influence future accelerator, switch, and advanced-packaging supply chains.
What To Do Next
Review your next AI cluster design for CPO readiness, including optical I/O, advanced packaging, and switch-interconnect requirements.
Who should care:Enterprise & Security Teams
Key Points
- โขAI system growth is pushing traditional copper interconnects toward their performance limits.
- โขTSMC, Intel, Samsung Foundry, and GlobalFoundries are pursuing four distinct CPO roadmaps.
- โขMoving optics closer to compute could improve scale-up connectivity for next-generation AI infrastructure.
๐ง Deep Insight
AI-generated analysis for this event.
๐ Enhanced Key Takeaways
- โขCPO integration is shifting from pluggable transceivers to silicon photonics engines integrated directly onto the substrate or interposer to reduce power consumption by up to 30-50% compared to traditional electrical I/O.
- โขThermal management remains the primary technical hurdle, as laser sources are highly sensitive to the heat generated by high-TDP AI accelerators, necessitating advanced packaging solutions like TSMC's COWOS-L.
- โขStandardization efforts, such as the Universal Chiplet Interconnect Express (UCIe) and the Optical I/O Consortium, are critical to ensuring interoperability between different foundry-specific optical engines and compute dies.
- โขThe transition to CPO is being accelerated by the adoption of 1.6T and 3.2T Ethernet standards, where copper reach limitations make electrical signaling physically impractical for rack-scale AI clusters.
- โขFoundries are increasingly utilizing heterogeneous integration, combining III-V compound semiconductors (like Indium Phosphide) for light generation with standard Silicon-on-Insulator (SOI) processes for photonics routing.
๐ Competitor Analysisโธ Show
| Feature | TSMC (CoWoS-L/CPO) | Intel (Silicon Photonics) | Samsung (I-Cube/CPO) | GlobalFoundries (Fotonix) |
|---|---|---|---|---|
| Primary Focus | High-end AI/HPC | Datacenter/Cloud | Mobile/AI/Memory | Automotive/Industrial |
| Integration Tech | CoWoS-L/R | Embedded Bridge | I-Cube S/E | Fotonix 300mm SOI |
| Maturity | High (Production) | High (Internal) | Medium (Pilot) | Medium (Platform) |
๐ ๏ธ Technical Deep Dive
- Utilization of Silicon Photonics (SiPh) platforms to integrate optical modulators, waveguides, and photodetectors directly onto the silicon die.
- Implementation of micro-ring resonators to enable dense wavelength division multiplexing (DWDM) for increased bandwidth density.
- Use of advanced packaging techniques like TSMC's Chip-on-Wafer-on-Substrate (CoWoS) to bridge the gap between electrical compute dies and optical engines.
- Integration of external laser sources (ELS) to isolate heat-sensitive laser components from the high-temperature compute environment.
- Adoption of 3D stacking (TSV - Through Silicon Vias) to minimize signal latency between the optical engine and the processor.
๐ฎ Future ImplicationsAI analysis grounded in cited sources
CPO will become the dominant interconnect standard for AI clusters exceeding 100,000 GPUs by 2028.
The physical limitations of copper reach and power density at 1.6T+ speeds make electrical signaling unsustainable for large-scale AI fabric architectures.
Foundry-specific proprietary optical interfaces will consolidate into a unified industry standard.
The high cost of R&D for optical packaging will force foundries to adopt open standards to ensure ecosystem compatibility and volume adoption.
โณ Timeline
2021-03
TSMC forms the Silicon Photonics Alliance to accelerate CPO ecosystem development.
2022-08
GlobalFoundries launches the Fotonix platform, a 300mm silicon photonics solution.
2023-06
Intel demonstrates integrated silicon photonics chiplets for high-bandwidth optical I/O.
2024-05
Samsung Foundry announces the expansion of its advanced packaging roadmap to include CPO integration for AI accelerators.
2025-11
TSMC achieves volume production readiness for CoWoS-L configurations supporting integrated optical engines.
๐ฐ
Weekly AI Recap
Read this week's curated digest of top AI events โ
๐Related Updates
AI-curated news aggregator. All content rights belong to original publishers.
Original source: Tom's Hardware โ