Tuesday, 4 March 2025
26.1 C
Singapore
26.7 C
Thailand
19.4 C
Indonesia
26.6 C
Philippines

Microsoft supports new startups as it launches an AI processor that skips GPUs and expensive memory

Discover how d-Matrix's new AI processor, Corsair, backed by Microsoft, redefines AI inference with a GPU-free and cost-effective solution.

D-Matrix Inc., a hardware startup based in Santa Clara, California, has unveiled its first AI processor, Corsair, which aims to redefine AI inference. This innovative product does away with traditional GPUs and costly high-bandwidth memory (HBM), offering a more efficient and cost-effective solution.

Supported by Microsoft and embracing cutting-edge advancements, Corsair is available to early-access customers and is expected to reach broader availability by the second quarter of 2025.

What makes Corsair stand out?

Corsair is purpose-built to tackle demanding AI inference tasks, particularly those involving generative AI models. The processor achieves remarkable speeds, handling 60,000 tokens per second at 1 millisecond per token when running models like Llama3 8B on a single server.

For larger-scale applications, such as Llama3 70B, Corsair achieves 30,000 tokens per second at 2 milliseconds per token on a single rack. This performance significantly lowers energy consumption and operational costs compared to traditional GPU-based systems.

Built on d-Matrixโ€™s Nighthawk and Jayhawk II tiles, Corsair utilises a 6nm manufacturing process. Each Nighthawk tile has four neural cores and a RISC-V CPU, optimised for large-model inference. It incorporates digital in-memory computation (DIMC) and supports versatile datatype processing, including block floating point (BFP).

Corsairโ€™s chiplet packaging integrates memory and computation to boost efficiency. It adheres to the PCIe Gen5 full-height, full-length card form factor, making it compatible with DMX Bridge cards for scalable performance. The card is powered by 2400 TFLOPs of 8-bit peak computing power, 2GB of integrated performance memory, and 256GB of off-chip memory capacity.

A partnership with Nvidiaโ€™s key ally

Micron Technology, a significant partner of Nvidia, is collaborating with d-Matrix to support Corsairโ€™s development and growth.

Although initially slated for release in late 2023, d-Matrix restructured its architecture to align with the growing demand for generative AI. This shift allowed Corsair to incorporate advanced features tailored for transformer models, agentic AI, and emerging applications like interactive video generation.

โ€œOur vision for d-Matrix was to address the massive computing challenges of generative AI and transformers,โ€ said Sid Sheth, co-founder and CEO of d-Matrix. โ€œCorsair is a groundbreaking platform, delivering blazing-fast token generation for interactive AI applications, making generative AI commercially viable.โ€

Corsairโ€™s focus on cost efficiency, scalability, and high-performance positions it as a promising solution in the rapidly evolving AI landscape.

Hot this week

Microsoft to shut down Skype in May and focus on Teams

Microsoft will shut down Skype on May 5 and focus on Teams. Users can transfer their chats and contacts to Teams for a seamless switch.

Meta prepares to launch a separate app for its AI assistant

Meta is reportedly developing a standalone AI chatbot app and testing a paid subscription model to expand its AI offerings.

Proofpoint ranked top in 4 out of 5 categories in 2025 Gartner report on email security platforms

Proofpoint ranked first in 4 out of 5 categories in Gartnerโ€™s 2025 Critical Capabilities Report for Email Security Platforms.

German startup earns recognition for breakthrough fusion reactor design

German startup Proxima Fusion makes a breakthrough in nuclear fusion with its Stellaris reactor, aiming for a commercial plant by 2031.

Xiaomi 15 Ultra to launch globally on March 2

Xiaomi confirms the global launch of the Xiaomi 15 Ultra on March 2, 2025. It features Leica branding, 90W fast charging, and a Snapdragon 8 Elite chip.

Smart Communications reveals 5 key trends shaping customer conversations in 2025

Smart Communicationsโ€™ 2025 Trends Report highlights key trends in AI, personalisation, and modernisation, shaping the future of customer conversations.

Microsoft to shut down Skype in May and focus on Teams

Microsoft will shut down Skype on May 5 and focus on Teams. Users can transfer their chats and contacts to Teams for a seamless switch.

Trump pushes for U.S. crypto reserve to boost digital assets

Donald Trump calls for a U.S. crypto reserve to support digital assets, highlighting XRP, Solana, and Cardano and later adding Bitcoin and Ethereum.

Appleโ€™s fully modernised Siri might not arrive until 2027

Apple may not release a thoroughly modern version of Siri until 2027, with a major AI-powered upgrade expected to roll out in phases.

Related Articles