Meta’s SAM Audio is a new open-source tool that lets users isolate specific sounds from audio or video files using simple text prompts, making audio cleanup and creative editing easy and accessible. The video demonstrates its impressive ability to separate voices, instruments, and other sounds with precision, highlighting its usefulness for content creators and potential applications in assistive technology.
Meta has recently released a groundbreaking open-source model called SAM Audio, which is part of their impressive SAM 3 family. This tool allows users to isolate specific sounds from video and audio files using simple text prompts. The video demonstrates how easy it is to use SAM Audio through Meta’s Segment Anything Playground, where users can upload files, type in the sound they want to isolate, and quickly receive separate audio tracks. The model is available for free, and users can download and modify it as they wish.
The first demonstration uses a clip from the Tomb Raider video game. By typing “woman” as the prompt, the tool instantly separates the woman’s voice from the rest of the audio. It provides three tracks: the original, the isolated sound (the woman’s voice), and everything except the isolated sound. This showcases the model’s ability to cleanly extract specific audio elements, which is particularly impressive given the complexity of audio mixing in video games.
A second example features a woman speaking on the phone in a noisy restaurant. The unedited audio is full of background noise, but by simply typing “voice,” SAM Audio isolates her speech with remarkable clarity. The tool also allows users to isolate other sounds, such as footsteps or utensils clinking, by entering those prompts. This level of precision is typically difficult to achieve, especially with free and open-source software.
Beyond isolation, SAM Audio offers a variety of audio effects that can be applied to the extracted tracks. For instance, users can add a “studio sound” effect to make the voice warmer or experiment with fun effects like “robot voice.” The video also demonstrates isolating instruments from a song, such as extracting just the guitar or drums, and applying effects like “concert hall” or “underwater” to change the audio’s ambiance.
Overall, SAM Audio is a powerful tool for audio cleanup, mixing, and creative editing. It is especially useful for content creators who need to remove unwanted background noise or isolate specific sounds in their projects. The technology also has potential applications in assistive devices, such as hearing aids, where users could isolate important sounds in real time. Meta’s open-source approach makes this advanced audio processing accessible to everyone, opening up new possibilities for both professionals and hobbyists.