Media & Entertainment

Facebook Adds Shazam-Style Audio Recognition To Help You Automatically Tag Posts With TV Shows And Songs

Comment

Facebook has a new weapon in the battle against Twitter to host lucrative conversations about media. A Shazam-esque opt-in feature coming to the iOS and Android status composer can activate your phone’s microphone, recognize a TV show you’re watching or song you’re listening to, and tag it in your News Feed post. Friends can then listen to a 30-second preview of songs or see a link to a TV show’s Page.

How IT worksFacebook built the audio recognition feature from scratch over the last year and it will roll out to iOS and Android users in the U.S. over the coming weeks. It’s an extension of the feelings and activity sharing option rolled out last year that lives in the little emoticon icon in the status composer. Facebook says 5 billion posts have used the option to share what you’re feeling (excited, tired), doing (Drinking coffee, playing basketball), or what media you’re enjoying. Soon that last activity type will be much easier to share thanks to the audio ID since you won’t have to already know the name of the song or show, and won’t have to type it in.

If users don’t turn it on, nothing will change about their Facebook experience. But if they do, they’ll see a little audio levels indicator when they open the status composer that can identify any of millions of songs or TV shows on 160 channels (U.S.-only). The song or show will then appear in the list of activities you can choose from, and be added to a post with one click.

Thanks to APIs from Spotify, Rdio, and Deezer, users will be able to listen to 30-second audio previews of songs their friends share in-line in the Facebook News Feed. Licensing issues limit the ability to show video previews, so Facebook just displays the season and episode number, a thumbnail image, and a link to the show’s Facebook Page instead.

I tried the feature, and it was able to quickly identify popular songs, TV shows like Game Of Thrones, and even live TV like CNBC’s “Closing Bell” — sometimes in as little as six seconds. Facebook also says it can recognize live sports — a popular topic in social media feeds that could even more prevalent now. One shortcoming is that Facebook’s song database is still limited and can’t ID more obscure tracks. It also can’t detect what you’re playing through your phone’s headphones, only what’s heard allowed, unless you’re using the default iPhone or Android audio player. So no tagging Spotify songs you’re silently jamming to on the bus.

The launch could spell trouble for audio ID heavyweights SoundHound and industry leader Shazam, which now has 90 million users and just raised $3 million more bringing it to $95 million in total funding. After people find out “what’s the name of this awesome song on the radio”, a common use case for these apps is sharing to social networks. Here, Facebook is cutting out the middleman, and putting the feature in one of the most ubiquitous apps in the world. However, Shazam has an index of over 25 million songs, meaning it’s much more likely to be able to nail down exotic tracks.

Below you can see a video demo from Facebook of how its audio ID feature works:

If users turn on the feature and use it, audio ID could encourage more people to discuss music and TV on Facebook instead of elsewhere. Twitter has long reigned as the king of conversations about television and other current events, but Facebook has been on quest to steal that crown. In the last year Facebook launched hashtagsverified profiles, and embeddable posts, plus it acquired public sports data filter SportStream and opened up new data visualization APIs for TV news and other media outlets.

This fight is partly about helping users connect around media, which can inspire passionate debate and engagement. But there’s also a lot of money to be made by being the digital watercooler. Facebook and Twitter both want to host the conversation because it provides them with monetizable data about what media people consume. It can then use that targeting data to coax big TV studios, movie producers, and record labels to buy ad campaigns.

While receiving the demo from the feature’s product manager Aryeh Selekman, I kept thinking “Wow, I bet Twitter wish it thought of this.” When I blurted it out, Selekman and the accompanying PR reps couldn’t help but let out a round of triumphant chuckles, though refused to comment.

If Twitter is serious about owning public discussion of media, adding some form of audio ID would be smart, whether though buying, building, or partnering. Perhaps Twitter should just buy Shazam. It might be expensive, though, which is the reason I said Twitter shouldn’t buy SoundCloud (and apparently the reason it passed on the deal). The rise of a common enemy in Facebook could catalyze at least a partnership between Twitter and Shazam.

music-match

“On the ads front, no one is able to target these posts directly today”, Selekman says. However, he admits “it’s definitely something we’ve thought about and will potentially do in the future.” For example, if you posted that you were listening to the new Beyoncé album, you could one day be targeted with ads for the singer’s new concert tour.

For now, though, Facebook will pass along tallies of how many times a song or show is tagged to its respective artist or studio. That includes matches that users decline to share. The data could help bands pick their next single or what song to pitch to TV commercials.

Audio ID is Facebook’s second new feature in a month that’s opt-in, showing a stronger commitment to privacy. The ability for Facebook to turn on your phone’s microphone is sure to stoke fears the company is wiretapping everyone. However, Facebook says it will only listen for songs and TV, not voices or other background noise, and none of the recordings will be stored.

feeling-proud-drinking-iced-coffee
5 billion of these feeling and activity posts have been shared on Facebook since the feature debuted in January 2013

On the brighter side are the new behaviors audio ID could unlock. Selekman tells me he’s getting married soon as is desperately trying to convince his future wife to make Michael Jackson’s “Rock With You” their first dance. He hopes that when guests inevitably go to take photos or videos of the special moment, they’ll use Facebook audio ID to tag their posts with a little snippet of the song so people reading from the feed feel more like they were there.

 

More TechCrunch

Private social networking is making a comeback. Gratitude Plus, a startup that aims to shift social media in a more positive direction, is expanding its wellness-focused, personal reflections journal to…

Gratitude Plus makes social networking positive, private and personal

With venture totals slipping year-over-year in key markets like the United States, and concern that venture firms themselves are struggling to raise more capital, founders might be worried. After all,…

Can AI help founders fundraise more quickly and easily?

Google has found a way to bring a variation of its clever “Circle to Search” gesture to iPhone users. The new interaction, launched in January, allows Android users to search…

Google brings a variation on ‘Circle to Search’ to iPhone users

A new sculpture going live on Wednesday in the Flatiron South Public Plaza in New York is not your typical artwork. It combines technology, sociology, anthropology and art to let…

Always-on video portal lets people in NYC and Dublin interact in real time

Apple’s iPad event had a lot to like. New iPads with new chips and new sizes, a new Apple Pencil, and even some software updates. If you are a big…

TechCrunch Minute: When did iPads get as expensive as MacBooks?

Autonomous, AI-based players are coming to a gaming experience near you, and a new startup, Altera, is joining the fray to build this new guard of AI agents. The company announced…

Bye-bye bots: Altera’s game-playing AI agents get backing from Eric Schmidt

Google DeepMind has taken the wraps off a new version AlphaFold, their transformative machine learning model that predicts the shape and behavior of proteins. AlphaFold 3 is not only more…

Google DeepMind debuts huge AlphaFold update and free proteomics-as-a-service web app

Uber plans to deliver more perks to Uber One members, like member-exclusive events, in a bid to gain more revenue through subscriptions.  “You will see more member-exclusives coming up where…

Uber promises member exclusives as Uber One passes $1B run-rate

We’ve all seen them. The inspector with a clipboard, walking around a building, ticking off the last time the fire extinguishers were checked, or if all the lights are working.…

Checkfirst raises $1.5M pre-seed to apply AI to remote inspections and audits

Close to a decade ago, brothers Aviv and Matteo Shapira co-founded a company, Replay, that created a video format for 360-degree replays — the sorts of replays that have become…

Controversial drone company Xtend leans into defense with new $40 million round

Usually, when something starts to rot, it gets pitched in the trash. But Joanne Rodriguez wants to turn the concept of rot on its head by growing fungus on trash…

Mycocycle uses mushrooms to upcycle old tires and construction waste

Monzo has raised another £150 million ($190 million), as the challenger bank looks to expand its presence internationally — particularly in the U.S. The new round comes just two months…

UK challenger bank Monzo nabs another $190M as US expansion beckons

iRobot has announced the successor to longtime CEO, Colin Angle. Gary Cohen, who previous held chief executive role at Timex and Qualitor Automotive, will be heading up the company, marking a major…

iRobot names former Timex head Gary Cohen as CEO

Reddit — now a publicly-traded company with more scrutiny on revenue growth — is putting a big focus on boosting its international audience, starting with francophones. In their first-ever earnings…

Reddit tests automatic, whole-site translation into French using LLM-based AI

Mushrooms continue to be a big area for alternative proteins. Canada-based Maia Farms recently raised $1.7 million to develop a blend of mushroom and plant-based protein using biomass fermentation. There’s…

Meati Foods bites into another $100M amid growth to 7,000 retail locations

Cleaning the outside of buildings is a dirty job, and it’s also dangerous. Lucid Bots came on the scene in 2018 with its Sherpa line of drones to clean windows…

Lucid Bots secures $9M for drones to clean more than your windows

High interest rates and financial pressures make it more important than ever for finance teams to have a better handle on their cash flow, and several startups are hoping to…

Israeli startup Panax raises a $10M Series A for its AI-driven cash flow management platform

The European Union has deepened the investigation of Elon Musk-owned social network, X, that it opened back in December under the bloc’s online governance and content moderation rulebook, the Digital Services Act…

EU grills Elon Musk’s X about content moderation and deepfake risks

For the founders of Atlan, a data governance startup, data has always been at the heart of what they do, even before they launched the company. In fact, co-founders Prukalpa…

Atlan scores $105M for its data control plane, as LLMs boost importance of data

It is estimated that about 2 billion people, especially those in lower and middle-income countries, lack access to quality and affordable essential medicines. The situation is exacerbated by low-quality or even killer…

Axmed raises $2M from Founderful to streamline drug supply chains in underserved markets

For decades, the Global Positioning System (GPS) has maintained a de facto monopoly on positioning, navigation and timing, because it’s cheap and already integrated into billions of devices around the…

Xona Space Systems closes $19M Series A to build out ultra-accurate GPS alternative

Bankruptcy lawyers representing customers impacted by the dramatic crash of cryptocurrency exchange FTX 17 months ago say that the vast majority of victims will receive their money back — plus interest. The…

FTX crypto fraud victims to get their money back — plus interest

Google on Wednesday launched its digital wallet in India with local integrations, nearly two years after the app was relaunched as a digital wallet platform in the U.S. As TechCrunch exclusively reported last month,…

Google Wallet is now available in India

Bluesky has launched a new product roadmap for the coming months. The decentralized social network said on Tuesday that it is planning to introduce direct messages, support for videos, improved…

Bluesky to add DMs, video support and in-app custom feed curation

Samsung Medison, a medical device unit of Samsung Electronics that specializes in developing diagnostic imaging devices, said on Wednesday it plans to acquire Sonio, a Paris-based startup that makes AI-powered software…

Samsung Medison to acquire French AI ultrasound startup Sonio for $92.7M

Kyle Kuzma is a lot of things. He’s a forward for the Washington Wizards NBA team and a 2020 NBA champion. He’s also a style icon — depending on who…

NBA champion Kyle Kuzma looks to bring his team mentality to Scrum Ventures

Ofcom is cracking down on Instagram, YouTube and 150,000 other web services to improve child safety online. A new Children’s Safety Code from the U.K. Internet regulator will push tech…

Ofcom to push for better age verification, filters and 40 other checks in new online child safety code

Lipids are fatty, waxy or oily compounds that, for instance, typically come in the form of fats and oils. As a result they are heavily used in the production of…

After a $20M Series A funding, Germany’s Insempra plans eco-friendly lipid production

Tesla CEO Elon Musk has said that lidar sensors are a “crutch” for autonomous vehicles. But his company has bought so many from Luminar that Tesla is now the lidar-maker’s…

Tesla is Luminar’s largest lidar customer

U.S. realty trust giant Brandywine Realty Trust has confirmed a cyberattack that resulted in the theft of data from its network. In a filing with regulators on Tuesday, the Philadelphia-based…

Brandywine Realty Trust says data stolen in ransomware attack