Wednesday, 22 January 2025
24.6 C
Singapore
27.7 C
Thailand
23.2 C
Indonesia
26.2 C
Philippines

DeepSeek claims its ‘reasoning model’ outperforms OpenAI’s o1 on key benchmarks

DeepSeek’s R1 claims to outperform OpenAI’s o1 in reasoning tasks, but regulatory and geopolitical issues shape its limitations and potential impact.

Chinese AI lab DeepSeek has unveiled its reasoning model, DeepSeek-R1, which it says rivals OpenAI’s o1 on several key AI benchmarks. The model, now available on the AI development platform Hugging Face under an MIT license, is open for commercial use without restrictions.

DeepSeek claims that R1 surpasses o1 performance on benchmarks such as AIME, MATH-500, and SWE-bench Verified. AIME evaluates models using other models, MATH-500 tests word problem-solving, and SWE-bench Verified assesses programming tasks.

How R1 works and what sets it apart

R1 is designed as a reasoning model, meaning it checks its work to avoid common pitfalls faced by typical AI systems. While this self-checking process takes slightly longer — often seconds to minutes more — it ensures higher reliability, especially in science, mathematics, and physics.

The model boasts an impressive 671 billion parameters, significantly enhancing its problem-solving capabilities. For comparison, models with more parameters are typically better at understanding and solving complex problems. Alongside the full version of R1, DeepSeek has also released smaller “distilled” versions, ranging from 1.5 billion to 70 billion parameters. The smallest versions are light enough to run on a standard laptop, while the full-scale R1 requires robust hardware.

For developers who need access to the full R1 but lack the necessary infrastructure, DeepSeek offers the model through its API at costs 90%-95% lower than those of OpenAI’s o1, making it an attractive option for many users.

Challenges and geopolitical implications

However, DeepSeek’s Chinese origins bring certain limitations. The model’s outputs must comply with regulations imposed by China’s internet watchdog, ensuring that its responses align with “core socialist values.” This means R1 avoids answering politically sensitive topics, such as Tiananmen Square or Taiwan’s autonomy. Many other Chinese AI models also avoid controversial discussions to remain in compliance with the government.

The launch of R1 coincides with rising tensions between the U.S. and China over AI technology. Recently, the Biden administration proposed stricter export rules, limiting China’s access to advanced AI chips and models. These rules would tighten existing restrictions on the tools needed to develop cutting-edge AI systems if implemented.

In a policy recommendation last week, OpenAI urged the U.S. government to prioritise American AI development to maintain its competitive edge. Chris Lehane, OpenAI’s VP of policy, identified DeepSeek’s parent company, High Flyer Capital Management, as a competitor to watch.

A growing trend in Chinese AI

DeepSeek is not alone in challenging U.S. dominance in AI. Other Chinese labs, such as Alibaba and Moonshot AI’s Kimi, have also developed models they claim rival OpenAI’s o1. DeepSeek, however, was the first to preview its reasoning model, R1, back in November.

Dean Ball, an AI researcher at George Mason University, noted that these developments suggest Chinese AI labs are becoming “fast followers.” He highlighted the accessibility of DeepSeek’s distilled models, which allow powerful reasoning capabilities to operate on local hardware.

With models like R1, Chinese AI firms continue to push boundaries despite regulatory challenges and geopolitical tensions.

Hot this week

Samsung Galaxy S25 Slim: What you need to know

Discover the 6.4-mm-thin Samsung Galaxy S25 Slim, which will launch in May 2024. It features triple cameras and a Snapdragon 8 Elite processor.

Marvel Snap faces sudden ban, joining TikTok in ByteDance crackdown

Marvel Snap faces an unexpected ban in the U.S. due to ByteDance ties, leaving players without access. Second Dinner promises updates soon.

Apple iPhone SE 4 dummy units reveal updated design and lack of Touch ID

Discover the new design and features of Apple’s iPhone SE 4, expected to launch in March 2025 with a starting price of around US$499.

TikTok goes dark in the US as federal ban takes effect

TikTok goes dark in the US after a federal ban takes effect, leaving millions without the app as the government debates its future.

How to download your TikTok videos and data before the ban

The Supreme Court has upheld a TikTok ban, and here’s how you can back up your videos and data before it happens.

UK unveils digital wallet and AI chatbot to revolutionise public services

The UK announces a digital wallet for IDs and an OpenAI-powered chatbot to enhance public services, aiming for secure and efficient solutions.

Apple set to launch iPhone SE 4 with Dynamic Island and iPad Air featuring M3 chip

The iPhone SE 4 with Dynamic Island and iPad Air with M3 chip are expected to launch soon. They will offer modern design and performance upgrades.

President Trump signs executive order delaying TikTok ban for 75 days

Trump delayed the TikTok ban with a 75-day executive order, allowing time to address national security concerns and find a resolution.

President Trump repeals Biden’s AI executive order on first day in office

President Trump repeals Biden's 2023 AI executive order on day one, sparking debate over AI regulation, innovation, and national security risks.

Related Articles