Wednesday, 27 November 2024
24.7 C
Singapore

New AI method could cut energy use by 95% but requires fresh hardware

A new AI method could cut energy use by 95% but needs special hardware, highlighting the potential for greener technology in the future.

The demand for artificial intelligence () continues to grow, driving the need for computing power and electricity. As AI becomes more integrated into daily life, concerns about its environmental impact have intensified. However, a breakthrough offers hope for significantly reducing the energy AI systems require.

Researchers at BitEnergy AI have developed a computational method called linear Complexity Multiplication, which could lower AI energy consumption by as much as 95%. While this innovation can potentially transform AI’s energy usage, it may also require overhauling existing hardware systems.

Moving beyond floating-point multiplication

Most current AI systems rely on floating-point multiplication (FPM), an essential technique for handling complex calculations involving large or small numbers. This precision is especially critical for deep learning models, which perform intricate computations to generate accurate results. However, FPM is highly energy-intensive, contributing significantly to the overall power usage of AI applications.

Linear complexity multiplication shifts away from FPM; integer addition is used to perform calculations. According to the researchers, this change drastically reduces the energy demands of AI systems while maintaining performance levels. Despite the lower energy requirements, early tests indicate no computational accuracy or efficiency drop.

The hardware hurdle

Despite its promising benefits, adopting Linear-Complexity Multiplication is challenging. Most AI systems today are built on hardware optimised for FPM, such as GPUs from leading manufacturers like . To implement the new method effectively, entirely new hardware will be needed.

The research team claims they have already designed, built, and tested the required hardware. However, making this technology widely available involves licensing and manufacturing processes that could take time to finalise. Until then, the AI industry may face difficulties integrating the energy-saving technique into its systems.

AI’s growing energy problem

The potential of linear Complexity Multiplication comes at a critical moment for the AI industry. AI systems’ energy demands are soaring. OpenAI’s ChatGPT, for instance, reportedly consumes approximately 564 megawatt-hours (MWh) of electricity daily—enough to power 18,000 American homes. Experts predict AI’s annual energy consumption could soon reach 100 terawatt-hours (TWh), rivalling Bitcoin mining, one of the most energy-intensive digital processes.

Rising energy consumption has sparked calls for more sustainable AI technologies. The introduction of linear Complexity Multiplication represents a significant step forward, but its success hinges on widespread adoption and the availability of compatible hardware.

The researchers at BitEnergy AI are optimistic about their method’s potential to reshape AI’s energy footprint. Still, the road ahead involves navigating technological, economic, and manufacturing challenges.

Hot this week

Japan tourism takes centre stage at Anime Festival Asia Singapore 2024

Discover Japan at Anime Festival Asia Singapore 2024 with JNTO’s interactive booth, featuring travel tips, omikuji fortunes, and exciting giveaways.

Casio unveils its first digital ring: A miniature watch for your finger

Casio celebrates 50 years of digital watches with the CRW-001-1JR, a sleek digital ring watch with time-only features, which will launch in December 2024.

Perplexity launches shopping tool to challenge Google and Amazon

Discover Perplexity’s AI-powered shopping tool offering unbiased product suggestions, visual search, and one-click checkout for Pro subscribers.

Sony considers a Steam Deck-style portable PS5

Sony could re-enter portable gaming with a handheld PS5, combining power and portability. Here's what the rumours say about their next step.

Alexa may improve with practical partnerships over generative AI

Amazon refines Alexa with partnerships, focusing on practical solutions over generative AI for smoother real-world task management.

Sony considers a Steam Deck-style portable PS5

Sony could re-enter portable gaming with a handheld PS5, combining power and portability. Here's what the rumours say about their next step.

17LIVE strengthens virtual influencer presence with acquisition of leading Japanese VTuber company

17LIVE acquires Japan's mikai Inc., strengthening its virtual IP strategy with top VTubers like Re:AcT, aligning with its transformation into an IP-driven platform.

Insured Nomads and Doerscircle launch global health insurance platform for independent workers

Insured Nomads and Doerscircle unveil a global health insurance platform tailored for freelancers, entrepreneurs, and small businesses worldwide.

Pure Storage expands FlashArray portfolio with FlashArray//C20 for smaller and edge deployments

Pure Storage unveils FlashArray//C20, delivering cost-effective enterprise-grade storage for edge and smaller deployments with seamless scalability.

Related Articles

Popular Categories