Wednesday, 5 February 2025
24.7 C
Singapore
22.9 C
Thailand
21.4 C
Indonesia
25 C
Philippines

New Relic introduces AI observability integration with DeepSeek to drive faster AI adoption and returns

New Relic introduces DeepSeek AI observability integration to help businesses optimise costs, boost performance, and accelerate AI adoption.

New Relic has launched the industryโ€™s first observability solution designed for DeepSeek, aiming to reduce the complexity and costs of developing, deploying, and monitoring generative AI (GenAI) applications. The solution, available for both DeepSeek and DeepSeek on Microsoft Azure AI Foundry, enables businesses to gain comprehensive visibility across their AI stacks through a streamlined setup while ensuring data security. With DeepSeekโ€™s open-source, cost-efficient models enhancing AI accessibility, the integration is expected to help enterprises adopt AI at a faster pace and achieve a quicker return on investment (ROI).

By combining New Relicโ€™s observability expertise with DeepSeekโ€™s advanced models, organisations can optimise their AI performance, improve cost management, and innovate more efficiently.

Addressing the need for optimised AI model deployment

Gartner projects that over 80% of enterprises will use or deploy GenAI applications by 2026, creating a highly competitive market. Organisations often juggle hundreds of models simultaneously, increasing the pressure to choose the right AI models for specific use cases. Quick deployment of optimal models is now crucial for maintaining a competitive advantage.

New Relicโ€™s AI monitoring solution offers a comprehensive view of the AI application stack, covering services, infrastructure, and AI layers. This visibility ensures smoother, cost-effective operations.

New Relic CEO Ashan Willy explained, โ€œThere are a steady release of new models like DeepSeek, Alibaba’s Qwen2.5-Max, and more, and organisations cannot afford to make the wrong AI implementation decisions in today’s hyper-competitive market. Observability solves this challenge by providing visibility across the AI stack. We are pioneering AI observability and extending our platform to include AI apps built with DeepSeek so enterprises can make the right decisions on which AI models to deploy and where to use them. Combining DeepSeekโ€™s cost-effective AI models with our expertise in observability and APM gives enterprises a competitive edge in the AI race.โ€

Enhancing AI application performance with better monitoring

AI applications often lead to complex tech stacks, higher security risks, and increased operational costs. To address this, New Relic AI monitoring provides businesses with a holistic view of their AI operations. The platform offers key performance metrics, such as throughput, latency, and cost tracking, while maintaining data privacy. It also traces the flow of requests across different services and models, giving teams a clear picture of how their AI applications function.

New Relicโ€™s integration with DeepSeek simplifies AI implementation by offering features that help organisations select, compare, and optimise models. As the AI market continues to expand and become more competitive, this partnership offers a much-needed solution for managing costs and ensuring efficient operations.

According to New Relic, the benefits of this integration include:

  • Reliability and performance assurance: Full visibility into the performance of AI applications powered by DeepSeek, enabling faster issue resolution.
  • Cost optimisation: By combining New Relicโ€™s insights with DeepSeekโ€™s cost-effective models, businesses can reduce AI development expenses through token usage monitoring.
  • Confident model switching: Unique model comparison features allow users to assess how changes in models affect app performance and token usage.
  • Accelerated AI innovation: The collaboration between New Relic and DeepSeek fosters quicker AI development and deployment.

Strengthening AI partnerships and integrations

This collaboration adds to New Relicโ€™s extensive ecosystem of AI partnerships, which already includes over 60 integrations such as Nvidia NIM, Amazon Bedrock, OpenAI, Claude, LangChain, and Pinecone. These partnerships make New Relicโ€™s observability platform one of the most comprehensive in the industry, providing robust support for enterprises navigating the AI landscape.

The AI monitoring feature is available through New Relicโ€™s all-in-one observability platform, offered under its usage-based pricing model.

Hot this week

Intel secures US$2.2 billion in federal grants for chip production

Intel secures US$2.2 billion in CHIPS Act grants to boost U.S. semiconductor manufacturing, with an additional US$5.66 billion pending disbursement.

The fall of quick commerce: What went wrong in Southeast Asia?

Uncover the reasons behind quick commerceโ€™s decline in Southeast Asia, from operational challenges to shifting consumer behaviour post-pandemic.

OpenAI introduces ChatGPT deep research for in-depth analysis

OpenAI unveils ChatGPT Deep Research, an AI-powered tool for in-depth analysis that offers well-documented insights for professionals and consumers alike.

Microsoftโ€™s AI business thrives while Xbox struggles

Microsoftโ€™s AI and cloud business is booming, but Xbox is struggling. Gaming revenue fell 7%, while AI growth surged 175% year-over-year.

AI agents transform e-commerce as Qeen.ai secures US$10M seed funding

AI startup Qeen.ai secures US$10M to revolutionise e-commerce with autonomous AI agents, enabling small businesses to scale without relying on ads.

SECO partners with impact.com to boost Senheng appโ€™s growth through affiliate marketing

SECO partners with impact.com to scale the Senheng app through affiliate marketing, aiming for growth, better ROI, and personalised consumer engagement.

Commvault partners with CrowdStrike to improve cyber threat detection and recovery

Commvault partners with CrowdStrike to enhance threat detection and data recovery, providing businesses with faster responses and stronger cyber resilience.

Unlock free skins during the Overwatch 2 spotlight livestream on February 12

Watch the Overwatch 2 spotlight livestream on February 12 to claim free skins, including Lucioโ€™s Cyber DJ and Flirty Flare Baptiste.

Singtel dominates mobile speeds in Singapore

Singtel and MyRepublic top Ooklaโ€™s 2024 Speedtest Connectivity Report, offering Singaporeans faster and more reliable mobile and broadband internet.

Related Articles