Saturday, 5 April 2025
26.1 C
Singapore
29.2 C
Thailand
20.6 C
Indonesia
26.9 C
Philippines

Microsoft’s AI could soon make your photos talk and sing

Explore how Microsoft's new AI tool VASA-1 can bring your photos to life by creating realistic videos of them talking and singing.

Microsoft Research Asia has just unveiled VASA-1, an experimental AI tool that could transform still images or drawings of people into realistic videos where they appear to talk or sing. Using an existing audio file, this tool can animate your photos with facial expressions, head movements, and perfectly synced lip movements that match the audio’s speech or song.

On the project’s webpage, you can find numerous examples that showcase how lifelike these animations can be. Although some lip and head movements might still look a bit mechanical and not perfectly in sync, the overall effect is convincing enough that it could easily be mistaken for real footage.

There’s a significant potential for misuse, particularly in the creation of deepfake videos, which is something Microsoft’s researchers are quite aware of. Consequently, they have decided against releasing any public demos, APIs, or additional details about the implementation until they can ensure the tool will be used responsibly and in accordance with stringent regulations. They haven’t mentioned specific safeguards to prevent misuse by malicious actors for harmful purposes like creating deepfake pornography or misinformation campaigns.

Despite these concerns, the technology promises several beneficial applications. It could enhance educational equity and improve accessibility for individuals with communication challenges by giving them access to an avatar that can communicate on their behalf. Additionally, this tool could provide companionship and therapeutic support, especially in programmes that offer interactions with AI-powered characters.

VASA-1 was trained using the VoxCeleb2 dataset, which includes over 1 million spoken expressions from 6,112 celebrities extracted from YouTube videos. Interestingly, it works not just on real faces but also on artistic ones. An amusing example is the animation of the Mona Lisa synced with an audio clip of Anne Hathaway’s viral rendition of Lil Wayne’s “Paparazzi,” which is quite delightful and worth a watch.

Hot this week

Misconceptions about STEM careers continue to deter young women in Singapore

New research shows stereotypes and lack of support are deterring young women from STEM careers, posing a risk to Singaporeโ€™s innovation goals.

Tenable reveals privilege escalation flaw in Google Cloud Run

Tenable uncovers a privilege escalation flaw in Google Cloud Run, exposing risks linked to inherited permissions and service interdependencies.

Apple prepares for M5 iPad Pro and MacBook Pro release

Apple is set to launch the M5 iPad Pro and MacBook Pro in late 2024, with the M6 models expected to introduce an in-house modem in 2027.

Google’s Gemini 2.5 Pro AI model is now available for all users

Google's Gemini 2.5 Pro AI model is now available for all users, offering advanced coding and reasoning abilities with a free trial for Gemini Advanced.

Informatica introduces new AI features to boost cloud data integration and management

Informatica adds AI tools to simplify data integration and improve enterprise access to AI-ready data across its cloud platform.

MediaTekโ€™s Kompanio Ultra chip challenges Copilot+ PCs with AI power

MediaTekโ€™s Kompanio Ultra chip brings powerful AI processing and high-end performance to Chrome OS, competing with Windows Copilot+ PCs.

Pixel 10 to feature more cameras, but with downgraded specs

Google's Pixel 10 may feature more cameras but with downgraded specs, including a telephoto lens, while the Pixel 10 Pro retains its advanced setup.

Samsung unveils Galaxy Tab S10 FE+ and S10 FE with AI features

Samsung launches the Galaxy Tab S10 FE+ and S10 FE, its first AI-powered FE tablets, in Singapore on April 25, 2025, with special offers.

OpenAI invests in cybersecurity to combat AI-driven threats

OpenAI has made its first cybersecurity investment in Adaptive Security, a startup that uses AI to train employees to detect and prevent cyber threats.

Related Articles