Connect with us

Hi, what are you looking for?

The Whale CapitalsThe Whale Capitals

Tech News

Google DeepMind’s new AI tool uses video pixels and text prompts to generate soundtracks

Photo illustration of the shape of a brain on a circuit board.
Illustration: Cath Virginia / The Verge | Photos: Getty Images

Google DeepMind has taken the wraps off of a new AI tool for generating video soundtracks. In addition to using a text prompt to generate audio, DeepMind’s tool also takes into account the contents of the video.

By combining the two, DeepMind says users can use the tool to create scenes with “a drama score, realistic sound effects or dialogue that matches the characters and tone of a video.” You can see some of the examples posted on DeepMind’s website — and they sound pretty good.

For a video of a car driving through a cyberpunk-esque cityscape, Google used the prompt “cars skidding, car engine throttling, angelic electronic music” to generate audio. You can see how the sounds of skidding match up with the car’s movement. Another e…

Continue reading…

You May Also Like

Tech News

Picking up my new passport at the post office. | Photo by Sean Hollister / The Verge Perhaps you’ve heard you can now renew...

Tech News

Brazilian regulators say Meta’s “excessive and unjustified obstacles” make it difficult for users to opt out of AI training. | Illustration: Nick Barclay /...

Tech News

Proton Docs does comments, collaboration, and a bunch of other Google Docs-y things. | Image: Proton Proton Docs looks a lot like Google Docs:...


There are multiple letters circulating among House Democrats that would call for President Biden to step aside in the 2024 White House race, two...