Media & Entertainment

Facebook Adds Shazam-Style Audio Recognition To Help You Automatically Tag Posts With TV Shows And Songs

Comment

Facebook has a new weapon in the battle against Twitter to host lucrative conversations about media. A Shazam-esque opt-in feature coming to the iOS and Android status composer can activate your phone’s microphone, recognize a TV show you’re watching or song you’re listening to, and tag it in your News Feed post. Friends can then listen to a 30-second preview of songs or see a link to a TV show’s Page.

How IT worksFacebook built the audio recognition feature from scratch over the last year and it will roll out to iOS and Android users in the U.S. over the coming weeks. It’s an extension of the feelings and activity sharing option rolled out last year that lives in the little emoticon icon in the status composer. Facebook says 5 billion posts have used the option to share what you’re feeling (excited, tired), doing (Drinking coffee, playing basketball), or what media you’re enjoying. Soon that last activity type will be much easier to share thanks to the audio ID since you won’t have to already know the name of the song or show, and won’t have to type it in.

If users don’t turn it on, nothing will change about their Facebook experience. But if they do, they’ll see a little audio levels indicator when they open the status composer that can identify any of millions of songs or TV shows on 160 channels (U.S.-only). The song or show will then appear in the list of activities you can choose from, and be added to a post with one click.

Thanks to APIs from Spotify, Rdio, and Deezer, users will be able to listen to 30-second audio previews of songs their friends share in-line in the Facebook News Feed. Licensing issues limit the ability to show video previews, so Facebook just displays the season and episode number, a thumbnail image, and a link to the show’s Facebook Page instead.

I tried the feature, and it was able to quickly identify popular songs, TV shows like Game Of Thrones, and even live TV like CNBC’s “Closing Bell” — sometimes in as little as six seconds. Facebook also says it can recognize live sports — a popular topic in social media feeds that could even more prevalent now. One shortcoming is that Facebook’s song database is still limited and can’t ID more obscure tracks. It also can’t detect what you’re playing through your phone’s headphones, only what’s heard allowed, unless you’re using the default iPhone or Android audio player. So no tagging Spotify songs you’re silently jamming to on the bus.

The launch could spell trouble for audio ID heavyweights SoundHound and industry leader Shazam, which now has 90 million users and just raised $3 million more bringing it to $95 million in total funding. After people find out “what’s the name of this awesome song on the radio”, a common use case for these apps is sharing to social networks. Here, Facebook is cutting out the middleman, and putting the feature in one of the most ubiquitous apps in the world. However, Shazam has an index of over 25 million songs, meaning it’s much more likely to be able to nail down exotic tracks.

Below you can see a video demo from Facebook of how its audio ID feature works:

If users turn on the feature and use it, audio ID could encourage more people to discuss music and TV on Facebook instead of elsewhere. Twitter has long reigned as the king of conversations about television and other current events, but Facebook has been on quest to steal that crown. In the last year Facebook launched hashtagsverified profiles, and embeddable posts, plus it acquired public sports data filter SportStream and opened up new data visualization APIs for TV news and other media outlets.

This fight is partly about helping users connect around media, which can inspire passionate debate and engagement. But there’s also a lot of money to be made by being the digital watercooler. Facebook and Twitter both want to host the conversation because it provides them with monetizable data about what media people consume. It can then use that targeting data to coax big TV studios, movie producers, and record labels to buy ad campaigns.

While receiving the demo from the feature’s product manager Aryeh Selekman, I kept thinking “Wow, I bet Twitter wish it thought of this.” When I blurted it out, Selekman and the accompanying PR reps couldn’t help but let out a round of triumphant chuckles, though refused to comment.

If Twitter is serious about owning public discussion of media, adding some form of audio ID would be smart, whether though buying, building, or partnering. Perhaps Twitter should just buy Shazam. It might be expensive, though, which is the reason I said Twitter shouldn’t buy SoundCloud (and apparently the reason it passed on the deal). The rise of a common enemy in Facebook could catalyze at least a partnership between Twitter and Shazam.

music-match

“On the ads front, no one is able to target these posts directly today”, Selekman says. However, he admits “it’s definitely something we’ve thought about and will potentially do in the future.” For example, if you posted that you were listening to the new Beyoncé album, you could one day be targeted with ads for the singer’s new concert tour.

For now, though, Facebook will pass along tallies of how many times a song or show is tagged to its respective artist or studio. That includes matches that users decline to share. The data could help bands pick their next single or what song to pitch to TV commercials.

Audio ID is Facebook’s second new feature in a month that’s opt-in, showing a stronger commitment to privacy. The ability for Facebook to turn on your phone’s microphone is sure to stoke fears the company is wiretapping everyone. However, Facebook says it will only listen for songs and TV, not voices or other background noise, and none of the recordings will be stored.

feeling-proud-drinking-iced-coffee
5 billion of these feeling and activity posts have been shared on Facebook since the feature debuted in January 2013

On the brighter side are the new behaviors audio ID could unlock. Selekman tells me he’s getting married soon as is desperately trying to convince his future wife to make Michael Jackson’s “Rock With You” their first dance. He hopes that when guests inevitably go to take photos or videos of the special moment, they’ll use Facebook audio ID to tag their posts with a little snippet of the song so people reading from the feed feel more like they were there.

 

More TechCrunch

There are many iPad apps to help you organize recipes; sync tasks across devices; be more productive; and manage your notes.

Best iPad apps to boost productivity and make your life easier

While online discourse would make it seem that venture has retreated to the Bay Area, with San Francisco being the most important place to build a startup, Index Ventures is…

Why Index Ventures is bulking up its investment team in NYC

In August, a Russian warlord posted a video on Telegram, showing a pair of Cybertrucks patrolling a road in Chechnya, armed seemingly with heavy machine guns. Leaving aside unanswerable (for…

A Russian warlord said he’ll take Cybertrucks into Ukraine; some experts think that’s unwise

WordPress.org has lifted its ban on hosting provider WP Engine until October 1, after putting a block on it earlier this week. The block prevented several sites from updating their…

WordPress.org temporarily lifts its ban on WP Engine

The world of WordPress, one of the most popular technologies for creating and hosting websites, is going through a very heated controversy. The core issue is the fight between WordPress…

The WordPress vs. WP Engine drama, explained

ChatGPT could get more expensive to use in coming years. The New York Times, citing internal OpenAI docs, reports that OpenAI is planning to raise the price of individual ChatGPT…

OpenAI might raise the price of ChatGPT to $44 by 2029

Binance founder Changpeng “CZ” Zhao was released from U.S. custody on Friday after serving out his four-month sentence in a low-security correctional facility. CZ’s sentence was the product of a…

Binance founder ‘CZ’ released from custody after four-month sentence

EV startup Canoo has been hit with two new lawsuits from suppliers linked to the drivetrains that power its electric vehicles, just weeks after the company kicked off a major…

Canoo hit with two supplier lawsuits as last remaining co-founder leaves

Welcome to Startups Weekly — your weekly recap of everything you can’t miss from the world of startups. Want it in your inbox every Friday? Sign up here. This week…

AI dominated both YC Demo Day and startup news

Three Iranian hackers working for the Islamic Revolutionary Guard Corps (IRGC) targeted the Trump campaign in an attempted hack-and-leak operation, according to the Department of Justice.

Iranian hackers charged with hacking Trump campaign to ‘stoke discord’

Wordy is a new iOS app that offers a unique way to learning English. The app automatically translates and defines unknown words while you watch your favorite movies or TV…

Wordy’s new app helps you learn vocabulary while watching movies and TV shows

The WSJ reports that OpenAI’s next funding round, worth around $6.5 billion, could close as soon as the first week in October.

OpenAI’s $6.5B funding round may close as soon as next week

We’re thrilled to welcome Bret Taylor to TechCrunch Disrupt 2024. As the former co-CEO of Salesforce, founder of Quip, former CTO of Facebook, the co-creator of Google Maps, and current…

Bret Taylor of Sierra joins TechCrunch Disrupt 2024

The U.K.s’ antitrust authority has concluded that Amazon’s partnership and equity investment in AI startup Anthropic can’t be investigated under current merger rules due to the size and scope of…

Amazon dodges antitrust scrutiny in UK over Anthropic investment

We’re in the final hours to save up to $600 on TechCrunch Disrupt 2024 tickets! Grab your tickets now and seize this final opportunity for major savings before the countdown…

Last hours to snag up to $600 off TechCrunch Disrupt 2024 passes

Reset your clocks: Meta has been hit with yet another privacy penalty in Europe. On Friday, Ireland’s Data Protection Commission (DPC) announced a reprimand and a €91 million fine —…

Meta fined $101.5M for 2019 breach that exposed hundreds of millions of Facebook passwords

The world’s second-largest money transfer provider, which filed a data breach notice with U.K. authorities, serves over 50 million people.

UK data watchdog confirms it’s investigating MoneyGram data breach

Note-taking apps typically aim to make you more efficient and productive. A lot of those apps concentrate on quickly jotting down your thoughts, organizing them better, or a mix of…

Napkin is a note-taking app that is not about making you more productive

Here are the startups from YC Demo Day 2 that we thought stood out from the flock.

9 startups that stood out on YC Demo Day 2

UAE-based Redwood has acquired a majority stake in the game streaming platform Loco as the Indian firm looks to expand focus to international markets, TechCrunch has learned and confirmed. Redwood,…

Indian game streaming startup Loco sells majority stake to Redwood

SpaceX’s Starlink satellite internet network is expected to hit a new customer milestone this week, company President Gwynne Shotwell told Texas legislators on Tuesday.  “This week, by the way, we…

Starlink hits 4 million subscribers

AI video generators need to believe that filmmakers will use their models in the production process. Otherwise why exist? To jump-start the new AI film ecosystem, Runway has set aside…

Runway earmarks $5M to fund up to 100 films using AI-generated video

Departures might be dominating the week’s OpenAI-related headlines. But comments on AI bias from Anna Makanju, the company’s VP of global affairs, also grabbed our attention. Makanju, speaking on a…

OpenAI’s VP of global affairs claims o1 is ‘virtually perfect’ at correcting bias, but the data doesn’t quite back that up

Lending startup Figure will be launching an AI tool powered by GPT-4 to help catch errors in lending documents. 

Former Brex COO who now heads unicorn fintech Figure says GPT is already upending the mortgage industry

Drata, a security compliance automation platform that helps companies adhere to frameworks such as SOC 2 and GDPR, has laid off 9% of its workforce, amounting to 40 people. Founded in 2020, Drata integrates…

Security compliance unicorn Drata lays off 9% of its workforce

As OpenAI boasts about its o1 model’s increased thoughtfulness, small, self-funded startup Nomi AI is building the same kind of technology. Unlike the broad generalist ChatGPT, which slows down to…

Nomi’s companion chatbots will now remember things like the colleague you don’t get along with

The company recently closed a $130 million round, according to an SEC filing, bringing the total to $327 million.

Zap Energy investors in recent $130M round included Soros Fund and Laurene Powell Jobs’ Emerson Collective

Welcome back to TechCrunch Mobility — your central hub for news and insights on the future of transportation. Sign up here for free — just click TechCrunch Mobility! I’ve been…

Uber snags another robotaxi deal, aviation startups land VC bucks, and where Rivian Foundation money is going

That lack of user interaction — or request for consent — is what confused and concerned some former Kaspersky customers.

Kaspersky defends force-replacing its security software without users’ explicit consent

Featured Article

Tesla Superchargers: GM, Ford, Rivian, and other EV brands with access

EV owners of GM vehicles like the Chevrolet Silverado EV and Cadillac Lyriq will now officially have access to Tesla’s Superchargers.

Tesla Superchargers: GM, Ford, Rivian, and other EV brands with access