Saturday, 22 February 2025
28.5 C
Singapore
36.4 C
Thailand
22 C
Indonesia
27.5 C
Philippines

DeepSeek claims its ‘reasoning model’ outperforms OpenAI’s o1 on key benchmarks

DeepSeek’s R1 claims to outperform OpenAI’s o1 in reasoning tasks, but regulatory and geopolitical issues shape its limitations and potential impact.

Chinese AI lab DeepSeek has unveiled its reasoning model, DeepSeek-R1, which it says rivals OpenAI’s o1 on several key AI benchmarks. The model, now available on the AI development platform Hugging Face under an MIT license, is open for commercial use without restrictions.

DeepSeek claims that R1 surpasses o1 performance on benchmarks such as AIME, MATH-500, and SWE-bench Verified. AIME evaluates models using other models, MATH-500 tests word problem-solving, and SWE-bench Verified assesses programming tasks.

How R1 works and what sets it apart

R1 is designed as a reasoning model, meaning it checks its work to avoid common pitfalls faced by typical AI systems. While this self-checking process takes slightly longer — often seconds to minutes more — it ensures higher reliability, especially in science, mathematics, and physics.

The model boasts an impressive 671 billion parameters, significantly enhancing its problem-solving capabilities. For comparison, models with more parameters are typically better at understanding and solving complex problems. Alongside the full version of R1, DeepSeek has also released smaller “distilled” versions, ranging from 1.5 billion to 70 billion parameters. The smallest versions are light enough to run on a standard laptop, while the full-scale R1 requires robust hardware.

For developers who need access to the full R1 but lack the necessary infrastructure, DeepSeek offers the model through its API at costs 90%-95% lower than those of OpenAI’s o1, making it an attractive option for many users.

Challenges and geopolitical implications

However, DeepSeek’s Chinese origins bring certain limitations. The model’s outputs must comply with regulations imposed by China’s internet watchdog, ensuring that its responses align with “core socialist values.” This means R1 avoids answering politically sensitive topics, such as Tiananmen Square or Taiwan’s autonomy. Many other Chinese AI models also avoid controversial discussions to remain in compliance with the government.

The launch of R1 coincides with rising tensions between the U.S. and China over AI technology. Recently, the Biden administration proposed stricter export rules, limiting China’s access to advanced AI chips and models. These rules would tighten existing restrictions on the tools needed to develop cutting-edge AI systems if implemented.

In a policy recommendation last week, OpenAI urged the U.S. government to prioritise American AI development to maintain its competitive edge. Chris Lehane, OpenAI’s VP of policy, identified DeepSeek’s parent company, High Flyer Capital Management, as a competitor to watch.

A growing trend in Chinese AI

DeepSeek is not alone in challenging U.S. dominance in AI. Other Chinese labs, such as Alibaba and Moonshot AI’s Kimi, have also developed models they claim rival OpenAI’s o1. DeepSeek, however, was the first to preview its reasoning model, R1, back in November.

Dean Ball, an AI researcher at George Mason University, noted that these developments suggest Chinese AI labs are becoming “fast followers.” He highlighted the accessibility of DeepSeek’s distilled models, which allow powerful reasoning capabilities to operate on local hardware.

With models like R1, Chinese AI firms continue to push boundaries despite regulatory challenges and geopolitical tensions.

Hot this week

OPPO Find N5 review: A foldable experience refined

OPPO Find N5 features a lightweight design, AI-powered enhancements, a large immersive display, fast charging capabilities, and a long-lasting battery.

Tesla refreshes Model Y for Singapore, adding new features and design updates

Tesla’s refreshed Model Y is now available in Singapore with an updated design, improved interior features, and enhanced performance.

ASUS launches ZenScreen Duo OLED MQ149CD, a portable monitor with dual OLED displays

ASUS unveils the ZenScreen Duo OLED MQ149CD, a portable dual-screen monitor with OLED technology, delivering stunning visuals and flexible work setups.

Xiaomi 15 Ultra clears IMDA registration, set to launch in Singapore

Xiaomi 15 Ultra has cleared IMDA registration, indicating a Singapore launch soon after MWC 2025. Find out what this means for buyers.

Apple may introduce reverse wireless charging on iPhone 17 Pro

Apple may introduce reverse wireless charging in the iPhone 17 Pro, allowing users to power AirPods and Apple Watch without extra cables.

Nvidia acknowledges RTX 5090 and 5070 Ti manufacturing defect

Nvidia confirms a rare manufacturing defect in the RTX 5090 and 5070 Ti, affecting less than 0.5% of GPUs. Affected users can request a replacement.

DJI’s RS 4 Mini stabiliser now features advanced subject tracking

DJI’s RS 4 Mini stabiliser introduces subject tracking, improved battery life, and better handling, making it an excellent tool for content creators.

American Airlines introduces AirTag location sharing for lost luggage

American Airlines now supports Apple’s AirTag location sharing, making it easier for passengers to track and recover lost luggage.

Google may launch YouTube Premium Lite in more countries

Google may launch YouTube Premium Lite in the US, Australia, Germany, and Thailand, offering a cheaper plan with fewer ads. Pricing is yet to be confirmed.

Related Articles