Thursday, 24 April 2025
26.8 C
Singapore
29.9 C
Thailand
19.5 C
Indonesia
28.8 C
Philippines

Microsoft supports new startups as it launches an AI processor that skips GPUs and expensive memory

Discover how d-Matrix's new AI processor, Corsair, backed by Microsoft, redefines AI inference with a GPU-free and cost-effective solution.

D-Matrix Inc., a hardware startup based in Santa Clara, California, has unveiled its first AI processor, Corsair, which aims to redefine AI inference. This innovative product does away with traditional GPUs and costly high-bandwidth memory (HBM), offering a more efficient and cost-effective solution.

Supported by Microsoft and embracing cutting-edge advancements, Corsair is available to early-access customers and is expected to reach broader availability by the second quarter of 2025.

What makes Corsair stand out?

Corsair is purpose-built to tackle demanding AI inference tasks, particularly those involving generative AI models. The processor achieves remarkable speeds, handling 60,000 tokens per second at 1 millisecond per token when running models like Llama3 8B on a single server.

For larger-scale applications, such as Llama3 70B, Corsair achieves 30,000 tokens per second at 2 milliseconds per token on a single rack. This performance significantly lowers energy consumption and operational costs compared to traditional GPU-based systems.

Built on d-Matrix’s Nighthawk and Jayhawk II tiles, Corsair utilises a 6nm manufacturing process. Each Nighthawk tile has four neural cores and a RISC-V CPU, optimised for large-model inference. It incorporates digital in-memory computation (DIMC) and supports versatile datatype processing, including block floating point (BFP).

Corsair’s chiplet packaging integrates memory and computation to boost efficiency. It adheres to the PCIe Gen5 full-height, full-length card form factor, making it compatible with DMX Bridge cards for scalable performance. The card is powered by 2400 TFLOPs of 8-bit peak computing power, 2GB of integrated performance memory, and 256GB of off-chip memory capacity.

A partnership with Nvidia’s key ally

Micron Technology, a significant partner of Nvidia, is collaborating with d-Matrix to support Corsair’s development and growth.

Although initially slated for release in late 2023, d-Matrix restructured its architecture to align with the growing demand for generative AI. This shift allowed Corsair to incorporate advanced features tailored for transformer models, agentic AI, and emerging applications like interactive video generation.

“Our vision for d-Matrix was to address the massive computing challenges of generative AI and transformers,” said Sid Sheth, co-founder and CEO of d-Matrix. “Corsair is a groundbreaking platform, delivering blazing-fast token generation for interactive AI applications, making generative AI commercially viable.”

Corsair’s focus on cost efficiency, scalability, and high-performance positions it as a promising solution in the rapidly evolving AI landscape.

Hot this week

Apple’s iPhone sales drop in China amid growing trade tensions

Apple’s iPhone sales in China fell 9% as local brands grew, and trade tensions created more uncertainty for the smartphone market.

Anbernic stops US shipments amid rising tariff concerns

Anbernic halts US shipments due to rising tariffs, urging customers to order from its US warehouse to avoid high import duties.

Chinese tech companies race to expand AI services using new open-standard protocol

Chinese tech firms race to adopt MCP, boosting AI agent use and shaping the future of smart services in payment, maps, and cloud tools.

Bethesda releases The Elder Scrolls IV: Oblivion Remastered – and you can play it now

Bethesda released Oblivion Remastered, which features full visual upgrades and quality-of-life improvements and is now available across major platforms.

Microsoft highlights growing AI-assisted scams and offers advice on how to stay safe

Microsoft’s latest report warns of rising AI-driven scams and outlines new tools and tips to help users stay safe online.

POCO launches entry-level C71 smartphone in Singapore with premium features

POCO launches the budget-friendly C71 smartphone in Singapore, offering premium design, enhanced cameras, and smooth performance at S$109.

NVIDIA uses AI to address climate, wildlife and disaster risks

NVIDIA’s AI tools support climate action, wildlife monitoring, and disaster risk mitigation, with uses spanning sea, land, sky and space.

Netflix raises subscription prices in Singapore again

Netflix again raises subscription prices in Singapore, with new rates for all plans and extra member slots.

GameMax unveils Blade Concept ATX case with bold design and powerful features

GameMax launches the Blade Concept ATX case, which features a striking blade design, RGB lighting, and support for high-end liquid-cooled PC builds.

Related Articles

Popular Categories