Huawei
Huawei reportedly boosts AI CloudMatrix chip tech supply to developers
Huawei has reportedly started increasing the supply of its AI CloudMatrix 384 supernode chip tech to developers. The company launched the respective technology to meet the demand for AI products in China amid growing US export controls.
CloudMatrix 384 is a high-performing AI computing infrastructure. It has 384 Ascend 910C processors, which form an interconnected “all-to-all” arrangement.
The Chinese tech giant unveiled the new AI chip technology as an effective replacement for Nvidia’s NVL72 system. The Ascend 910C-based supernode addresses and resolves the communication efficiency issues of large-scale AI clusters.
Huawei held a Kunpeng Ascend Developer Conference last Friday, where the President of the Ascend computing business, Zhang Dixuan, delivered a speech, saying:
“As the scale of parallel processing grows, cross-machine bandwidth in traditional server architectures has become a critical bottleneck for training.”
Zhang suggested that amid the constantly increasing US restrictions, the all-new CloudMatrix 384 AI chip technology will meet future training requirements in China that often require innovative computing architectures.
Huawei reportedly boosts AI CloudMatrix chip tech supply to developers (Image Credits: Huawei)
CloudMatrix 384
Huawei has built its new AI chip technology using 384 Ascend AI chipsets across 12 computing cabinets and 4 bus cabinets. Together, these elements can deliver 300 petaflops of computing power and 48 TB of high-bandwidth memory.
The new supernode is also considered the industry’s largest AI training platform. A few benchmark tests showed that the CloudMatrix 384 can provide 132 tokens per second (TPS) per card on dense AI models like Meta, LLama3, implying that it is 2.5x faster than other legacy clusters in the market.
According to the previous revelations, CloudMatrix can outperform the NVL72 in key metrics and is around 67% higher in computing power, with 3x larger capacity in aggregate memory.
Last month, the tech maker started supplying the new AI chip technology to some of Nvidia’s Chinese clients. Now, Huawei is reportedly increasing the supply of the CloudMatrix 384 supernode to developers.
The company’s efforts show that it is trying its best to hit back at US restrictions with its self-developed technologies.
Read More:
[source]
