IBM developed the Telum II processor and the Spyre accelerator for the AI operation
29.08.24
IBM has officially introduced its new artificial intelligence chips, including the Telum II processor and Spyre AI accelerators, designed for the IBM Z-series mainframes. These chips significantly accelerate traditional AI tasks and work with large language models on IBM server systems.
The Telum II processor is equipped with eight high-performance cores with a clock frequency of 5.5 GHz. Each core has 36 MB of second-level cache memory, and the total amount of built-in cache memory reaches 360 MB. The virtual cache memory of the fourth level supports the amount of up to 2.88 GB per processor unit, which is 40% more compared to the previous generation. Cores received improved branch prediction, 160 registers and reduced power consumption by 15%.
Telum II is equipped with a built-in AI accelerator that provides high performance output operations with low latency and high throughput. The performance of the accelerator is 24 TOPS per processor, 192 TOPS per block and 768 TOPS per system. In addition to this, the processor includes a new DPU I/O acceleration unit that increases data transfer density by 50%. The chip is manufactured using Samsung’s 5HPP technology and contains 43 billion transistors on a 600mm die.
Spyre accelerators are designed for the enterprise level and provide performance of more than 300 TOPS in AI tasks with 128 GB of LPDDR5 memory. In a system with eight such accelerators, the total memory reaches 1 TB. Each accelerator is equipped with 32 computing cores supporting INT4, INT8, FP8 and FP16 data types, with a power consumption level (TDP) of only 75 W.
IBM plans to begin shipping solutions with Telum II processors to enterprise customers in 2025. Spyre’s accelerators, which are in the early technical version stage, should also go on sale next year.
Don't miss interesting news
Subscribe to our channels and read announcements of high-tech news, tes
Asus Zenbook S 16 (UM5606): new wave
The new Asus Zenbook S 16 laptop is made in an unusual metal case, built on the basis of a fresh AMD platform adapted for AI, and has excellent autonomy. Let’s talk about this premium laptop in more detail
Akash System uses diamonds to cool processors in data centers, space and military equipment development processor
Akash System has signed a memorandum with the US Department of Commerce, expecting $18.2 million in direct funding and $50 million in tax incentives. In addition, the startup has already raised $18 million from venture capitalists.
Bugatti W16 Mistral accelerates to 453.91 km/h and becomes the fastest roadster in the world car
Although Bugatti did not disclose whether any changes were made to the powertrain, the car used the same 8.0-liter W16 engine with four turbines and an output of 1,600 hp.