back to top
Thursday. 31 October 2024

China turns to supercomputers for AI development amid US chip sanctions

China turns to supercomputers for AI development amid US chip sanctions, aiming for technological self-sufficiency and innovation.

Published:

Published:

Trending Stories

- Advertisement -

You must find an alternative approach to artificial intelligence (AI) development in China as US sanctions continue to block access to advanced semiconductors and chip-making equipment. Industry experts suggest that China leverages its supercomputing technology developed over the past two decades to overcome these restrictions.

Leveraging supercomputing technology

According to Zhang Yunquan, a researcher at the Institute of Computing Technology under the Chinese Academy of Sciences (CAS), using supercomputers could help break the US-led stranglehold on China's AI industry. In a state-backed tabloid Global Times report, Zhang emphasised the importance of supercomputing systems for training large language models (LLMs). These models underpin generative AI services like ChatGPT and could replace the power-hungry data-centre computing clusters that typically use 10,000 to 100,000 graphics processing units (GPUs) for such training.

China's effort to build a viable and advanced computing platform for training LLMs and developing AI highlights the urgency of achieving technological self-sufficiency. The country's AI progress remains hampered by limited GPU choices due to US sanctions that have prevented , the top GPU firm, from supplying its most cutting-edge chips to China.

Developing alternative solutions

According to a Reuters report, Nvidia is reportedly working on a version of its new flagship AI chips for the Chinese market that is compatible with current US export controls. CAS academician Chen Runsheng, speaking at the same conference as Zhang, stated that building LLMs is not just about adding more chips. Instead, these models must learn to lower energy consumption while improving efficiency, similar to the human brain.

China, the Asia-Pacific's most significant data centre market with 3,956 megawatts of capacity, relies heavily on coal power, generating nearly two-thirds of its electricity from coal last year. Chen urged China to focus on fundamental research for intelligent computing of LLMs and high-performance computing (HPC) technology to achieve breakthroughs in computing power. HPC refers to processing data and performing complex calculations at high speeds, accomplished by supercomputers containing thousands of compute nodes working together.

Pushing for innovation

According to Chen, the current batch of LLMs developed in China is based on models and algorithms from the US without enough consideration of fundamental theories. He believes that progress in fundamental theory could lead to groundbreaking and authentic innovation.

Chinese companies have been building computing clusters to train LLMs with over 10,000 GPUs, including home-grown chips from the Chinese GPU start-up Moore Threads Technology. Big Tech firms, like Tencent Holdings, are optimising their infrastructure to enhance AI training efficiency. For example, Tencent's Xingmai HPC network can support a single computing cluster with more than 100,000 GPUs.

This move towards supercomputing reflects China's commitment to becoming technologically self-sufficient, ensuring its AI development remains robust despite external restrictions.

Tech Edition has partnerships that involve sponsored content. While this financial support helps us with daily operations, it doesn't affect the integrity of our reviews. We remain committed to delivering honest and insightful content to our readers.

Tech Edition is now on Telegram! Join our channel here and catch all the latest tech news!



Emma Job
Emma Job
Emma is a news editor at Tech Edition. With a decade's experience in content writing, she revels in both crafting and immersing herself in narratives. From tracking down viral trends to delving into the most recent news stories, her goal is to deliver insightful and timely content to her readers.

Featured Content

Layoffs reshape Asia’s business landscape: From tech giants to e-commerce leaders

Mass layoffs in Asia's tech, e-commerce, fashion, and sports sectors raise questions about how businesses can balance profitability, operational efficiency, and employee welfare.

Related Stories