Thursday, 3 April 2025
27.3 C
Singapore
31 C
Thailand
20.5 C
Indonesia
28.1 C
Philippines

Safety concerns continue to plague OpenAI

OpenAI employees voice safety concerns over rushed launches and inadequate protocols, questioning the company's commitment to AI safety.

OpenAI, a leader in developing AI as intelligent as a human, is facing ongoing safety concerns voiced by its employees. Despite being valued at US$80 billion, the nonprofit research lab has been under scrutiny, with employees speaking out in the press and on podcasts about safety issues. According to an anonymous source from The Washington Post, OpenAI rushed through safety tests and celebrated their product’s launch prematurely.

โ€œThey planned the launch after-party before knowing if it was safe to launch,โ€ an anonymous employee told The Washington Post. โ€œWe failed at the process.โ€

Rising safety concerns

Safety issues at OpenAI are becoming more frequent. Current and former employees have signed an open letter demanding better safety and transparency practices. This comes shortly after the safety team was dissolved following the departure of cofounder Ilya Sutskever. Additionally, Jan Leike, a key OpenAI researcher, resigned, stating that โ€œsafety culture and processes have taken a backseat to shiny productsโ€ at the company.

Safety is a core principle for OpenAI. The companyโ€™s charter includes a clause that pledges to assist other organisations in advancing safety if a competitor achieves AGI (artificial general intelligence). Despite claiming dedication to solving safety problems in its complex system, OpenAI has faced criticism for prioritising other aspects over safety.

โ€œWeโ€™re proud of our track record of providing the most capable and safest AI systems and believe in our scientific approach to addressing risk,โ€ OpenAI spokesperson Taya Christianson said in a statement to The Verge. โ€œRigorous debate is critical given the significance of this technology, and we will continue to engage with governments, civil society, and other communities worldwide in service of our mission.โ€

The stakes are high

The stakes around safety in AI are immense. In March, a report commissioned by the US State Department highlighted that โ€œcurrent frontier AI development poses urgent and growing risks to national security.โ€ The report compared the potentially destabilising effects of advanced AI and AGI to introducing nuclear weapons.

The recent controversies at OpenAI followed the boardroom coup last year that briefly ousted CEO Sam Altman. The board cited a failure to be โ€œconsistently candid in his communicationsโ€ as the reason for his removal, leading to an investigation that did little to reassure the staff.

OpenAI spokesperson Lindsey Held told the Post that the GPT-4o launch โ€œdidnโ€™t cut cornersโ€ on safety. However, another unnamed company representative admitted that the safety review timeline was compressed to a week. โ€œWe are rethinking our whole way of doing it,โ€ the anonymous representative told the Post. โ€œThis was  just not the best way to do it.โ€

Attempts to address safety concerns

OpenAI has made several announcements addressing safety concerns in response to the rolling controversies. This week, the company announced a partnership with Los Alamos National Laboratory to explore how advanced AI models, such as GPT-4o, can safely aid in scientific research. The announcement emphasised Los Alamosโ€™s strong safety record. Additionally, an anonymous spokesperson told Bloomberg that OpenAI has created an internal scale to track the progress of its large language models towards achieving AGI.

Despite these efforts, OpenAI’s safety-focused announcements seem like defensive measures in the face of growing criticism. It’s clear that OpenAI is under pressure, but public relations efforts alone will not suffice to safeguard society. If OpenAI continues to develop AI without strict safety protocols, as claimed by those within the company, the potential impact on people beyond the Silicon Valley bubble is significant. The average person has no say in the development of privatised AGI, yet their protection from OpenAIโ€™s creations is at stake.

โ€œAI tools can be revolutionary,โ€ FTC chair Lina Khan told Bloomberg in November. However, she expressed concerns that โ€œa relatively small number of companies control the critical inputs of these tools.โ€

If the numerous claims against OpenAIโ€™s safety protocols are accurate, it raises serious questions about its fitness to steward AGI, a role the organisation has essentially assigned itself. Allowing one group in San Francisco to control potentially society-altering technology is cause for concern, and there is an urgent demand for transparency and safety, even within OpenAI’s ranks.

Hot this week

RedCurl group linked to new ransomware strain in first documented attack

Bitdefender uncovers RedCurl's first ransomware campaign, revealing QWCrypt's unique tactics and the group's evolving cyber threat model.

Zelle is removing its stand-alone app

Zelle is shutting down its stand-alone app, but you can still use the service through your bankโ€™s app. Hereโ€™s what you need to know.

Chinese investor questions commercial future of humanoid robots

Chinese venture capitalist Allen Zhu questions the commercial potential of humanoid robots, sparking debate amid rising AI investment in China.

Most APAC developers now view AI agents as vital to software development

Over four in five APAC developers believe AI agents are becoming as essential to app development as traditional software tools.

New AI features coming to Final Cut Pro

Apple updates Final Cut Pro with AI-powered tools, Image Playground, and new features for Mac, iPad, and iPhone, enhancing video editing workflows.

YouTube expands shopping affiliate programme in Singapore through Shopee partnership

YouTube teams up with Shopee to launch its Shopping affiliate programme in Singapore, giving creators new ways to monetise their content.

Misconceptions about STEM careers continue to deter young women in Singapore

New research shows stereotypes and lack of support are deterring young women from STEM careers, posing a risk to Singaporeโ€™s innovation goals.

Synagie and HKT launch ShopHK to help Hong Kong brands expand into Southeast Asia

Synagie and HKT launch ShopHK, helping Hong Kong SMEs tap into Southeast Asia's booming US$600 billion e-commerce market.

Informatica introduces new AI features to boost cloud data integration and management

Informatica adds AI tools to simplify data integration and improve enterprise access to AI-ready data across its cloud platform.

Related Articles