The world’s largest chip scales to new heights.
By Paul Alcorn
Cerebras, the company that builds the world’s largest chip, the Wafer Scale Engine 2 (WSE-2), unveiled its Andromeda supercomputer today. Andromeda combines 16 of the wafer-sized WSE-2 chips into one cluster with 13.5 million AI-optimized cores that the company says delivers up to 1 Exaflop of AI computing horsepower, or 120 Petaflops of 16-bit half-precision.
The chips are housed in sixteen CS-2 systems. Each chip delivers up to 12.1 TB/s of internal bandwidth (96.8 Terabits) to the AI cores, but the data is fed to the CS-2 processors via 100 GbE networking spread across 124 server nodes in 16 racks. In total, those servers are powered by 284 third-gen EPYC Milan processors wielding 64 cores apiece, totaling 18,176 cores.
The entire system consumes 500 KW, which is a drastically lower amount of power than somewhat-comparable GPU-accelerated supercomputers. However, scaling a workload across such massively-parallel supercomputers has long been one of the primary inhibitors — at some point, scaling tends to break down, so adding more hardware results in a rapidly diminishing point of returns.
Continue reading… “Cerebras Reveals Andromeda, a 13.5 Million Core AI Supercomputer”