Apps

Airbnb leans on reviews to make listings more reliable as it tests review summaries using generative AI

Comment

Airbnb logo displayed on a phone screen laying on a map of Krakow
Image Credits: Jakub Porzycki/NurPhoto / Getty Images

Airbnb has given hotels a run for their money with offerings that are often more flexible, sometimes cheaper, and more characterful than their traditional hospitality counterparts. One area where Airbnb has stumbled, however, is consistency: Hotels are still considered to have better service and customers still regularly complain that Airbnb listings are not accurate.

Now, to try to bridge those gaps — and at the very least to better manage everyone’s expectations — today Airbnb is unveiling an overhaul of guest reviews. Alongside that, Airbnb is adding two more ways for hosts to help surface more nuance about their properties, by way of a new top-rated badge and tools to communicate more information about properties.

The updates are coming as part of the company’s latest winter release, and as we talked about those with Airbnb’s Brian Chesky, the CEO and co-founder also revealed some of its future roadmap, including tests it’s running using generative AI to write review summaries.

Overall, Chesky said the company’s main priority was to bring more predictability to Airbnb, since the reason people often stay in hotels is because they know what they’re going to get in terms of service.

“Our homes are one of a kind — that’s a strength [for us], but their reliability is the big question,” he said in an interview. “We can’t inspect every home, and we don’t want to try to inspect every home. So we’re just going to be investing a lot more into a review and reputation system. That’s why we’re upgrading reviews, and we’re going to be doing a lot more stuff like that.”

Airbnb ratings
Image Credits: Airbnb

The redesigned reviews page will feature a carousel at the top that will display overall and category-specific ratings. Users can now also sort reviews by most recent or highest rated.

The new badge being rolled out is a signal of how Airbnb is trying to bake in customer service incidents and customer feedback to understand if the property is worth a shout-out. Called “Guest Favorites,” the badge will be used to designate highly rated properties. Currently, the properties with this label have an average rating of 4.9, less than a 1% cancelation rate, and a less than 1% incident rate.

The company didn’t specify the exact criteria by which it picked the 2 million “Guest Favorites” property in the first batch. But Airbnb said that it considered “signals that have the loudest guest voice.” such as reviews and cancelation rates.

You can think of Guest Favorites as the property equivalent of the “Superhost” badge that hosts can earn by maintaining a 4.8 overall rating across their properties; less than 1% cancelation rate; and at least 10 short-term stays or 100 nights stayed in the past year. “Guest Favorites” will be more property-specific and subject to changing more frequently: They are updated weekly, while the “Superhost” badge is evaluated quarterly.

Whether customers ever understand the distinction between those two badges remains to be seen. But ultimately, there are other reasons to have launched Guest Favorites: The more frequent updating makes hosts more accountable, and the information gives more transparency to would-be guests. It also gives Airbnb another way to understand its customer base, and also surface properties based on the “Guest Favorites” filter.

Guest Favorites
Image Credits: Airbnb

Still, the five-star rating system, popularized by hotels — ironically, the very industry Airbnb aims to disrupt — is far from perfect, something Chesky admitted.

For starters, there is a lot of opportunity for gaming right now. A property with a 4.6-star rating on Airbnb, for example, is actually at the bottom 20% of all listings. In 2022, the U.S. average review score was 4.75, and it was just above 4.6 in the rest of the world, according to short-term rental analytics firm AirDNA. In other words, given that many of those “lower” rated properties are not actually that nice, this undermines the whole idea of the ratings in the first place.

Bram Gallagher, an economist at AirDNA, said that heterogeneity is a big challenge for companies like Airbnb, but it’s also a big draw for customers.

“I don’t think Airbnb wants to commodify listings by making them uniform. A move towards providing more details would relieve some of the uncertainty in consumers that might be preventing them from going to a short-term rental,” he said.

On the other side, though, Airbnb is stuck between a rock and a hard place in trying to improve this.

“We didn’t want to blow up the five-star rating system because we have more than 317 million reviews and two out of three people leave a review on our platform,” Chesky explained. “[So] we will try to create more context on the rating with labels like guest favorites.”

Airbnb EU review scores by price tier
Image Credits: AirDNA

On the host end of things, Airbnb is adding more tools to keep them sweet. An easily accessible “Listings” tab on the home page has tools to add amenities, as well as an AI-powered photo tour to arrange images uploaded by the host by different rooms automatically.

Airbnb listings
Image Credits: Airbnb

Investing in AI and future roadmap

Airbnb has introduced a few AI-powered features in this release, but Chesky said that the plan is to add more. Top of the list, he said, is a test using generative AI to produce review summaries. He noted that those summaries can also take into account prior info such as customer service contacts.

He also mentioned that generative AI can improve areas such as search, identifying amenities of a property from photos and customer service. In particular, it can help with language translation between a host and guest who are fluent in two different languages. Additionally, AI can help in quickly parsing the policy pages to understand what might be relevant for an issue — both for users and customer service agents.

“Imagine a Japanese guest staying with a German host. Neither of them speaks the same language and they are calling a call center, and very few people speak both languages. Agents are trying to deal with a resolution within minutes while dealing with many policies [applicable to the situation] that could be like very many pages long. So I think what AI can do just generally, is it can reimagine our service reimagined customer service,” Chesky said.

In a set of interviews in the last few months, Chesky said that Airbnb is trying to overhaul its core services before focusing on other things. He told TechCrunch that there might be one or two releases focusing on improving affordability, reliability and customer service.

Airbnb registered $3.4 billion in revenues for Q3 2023, with an 18% growth year-on-year. However, the company presented cautious guidance saying that it is seeing “greater volatility early in Q4.”

In a note to investors, Bernstein said that the firm adjusted its night booking guidance for the financial year 2023 from 455 million to 449 million because of the guidance.

November 9, 7 AM PT: The story has been updated to clarify that Airbnb hasn’t publically defined the exact criteria for properties to get a “Guest Favorite” label. The numbers released by the company were reflective of average ratings and cancelation rates for the initial batch of properties with the “Guest Favorite” label. 

More TechCrunch

Tags

India’s mobile payments regulator is likely to extend the deadline for imposing market share caps on the popular UPI payments rail by one to two years, sources familiar with the…

India weighs delaying caps on UPI market share in win for PhonePe, Google Pay

Line Man Wongnai, an on-demand food delivery service in Thailand, is considering an initial public offering on a Thai exchange or the U.S. in 2025.

Thai food delivery app Line Man Wongnai weighs IPO in Thailand, US in 2025

The problem is not the media, but the message.

Apple’s ‘Crush’ ad is disgusting

Ever wonder why conversational AI like ChatGPT says “Sorry, I can’t do that” or some other polite refusal? OpenAI is offering a limited look at the reasoning behind its own…

OpenAI offers a peek behind the curtain of its AI’s secret instructions

The federal government agency responsible for granting patents and trademarks is alerting thousands of filers whose private addresses were exposed following a second data spill in as many years. The…

US Patent and Trademark Office confirms another leak of filers’ address data

As part of an investigation into people involved in the pro-independence movement in Catalonia, the Spanish police obtained information from the encrypted services Wire and Proton, which helped the authorities…

Encrypted services Apple, Proton and Wire helped Spanish police identify activist

Match Group, the company that owns several dating apps, including Tinder and Hinge, released its first-quarter earnings report on Tuesday, which shows that Tinder’s paying user base has decreased for…

Match looks to Hinge as Tinder fails

Private social networking is making a comeback. Gratitude Plus, a startup that aims to shift social media in a more positive direction, is expanding its wellness-focused, personal reflections journal to…

Gratitude Plus makes social networking positive, private and personal

With venture totals slipping year-over-year in key markets like the United States, and concern that venture firms themselves are struggling to raise more capital, founders might be worried. After all,…

Can AI help founders fundraise more quickly and easily?

Google has found a way to bring a variation of its clever “Circle to Search” gesture to iPhone users. The new interaction, launched in January, allows Android users to search…

Google brings a variation on ‘Circle to Search’ to iPhone users

A new sculpture going live on Wednesday in the Flatiron South Public Plaza in New York is not your typical artwork. It combines technology, sociology, anthropology and art to let…

Always-on video portal lets people in NYC and Dublin interact in real time

Apple’s iPad event had a lot to like. New iPads with new chips and new sizes, a new Apple Pencil, and even some software updates. If you are a big…

TechCrunch Minute: When did iPads get as expensive as MacBooks?

Autonomous, AI-based players are coming to a gaming experience near you, and a new startup, Altera, is joining the fray to build this new guard of AI agents. The company announced…

Bye-bye bots: Altera’s game-playing AI agents get backing from Eric Schmidt

Google DeepMind has taken the wraps off a new version of AlphaFold, their transformative machine learning model that predicts the shape and behavior of proteins. AlphaFold 3 is not only…

Google DeepMind debuts huge AlphaFold update and free proteomics-as-a-service web app

Uber plans to deliver more perks to Uber One members, like member-exclusive events, in a bid to gain more revenue through subscriptions.  “You will see more member-exclusives coming up where…

Uber promises member exclusives as Uber One passes $1B run-rate

We’ve all seen them. The inspector with a clipboard, walking around a building, ticking off the last time the fire extinguishers were checked, or if all the lights are working.…

Checkfirst raises $1.5M pre-seed to apply AI to remote inspections and audits

Close to a decade ago, brothers Aviv and Matteo Shapira co-founded a company, Replay, that created a video format for 360-degree replays — the sorts of replays that have become…

Controversial drone company Xtend leans into defense with new $40 million round

Usually, when something starts to rot, it gets pitched in the trash. But Joanne Rodriguez wants to turn the concept of rot on its head by growing fungus on trash…

Mycocycle uses mushrooms to upcycle old tires and construction waste

Monzo has raised another £150 million ($190 million), as the challenger bank looks to expand its presence internationally — particularly in the U.S. The new round comes just two months…

UK challenger bank Monzo nabs another $190M as US expansion beckons

iRobot has announced the successor to longtime CEO, Colin Angle. Gary Cohen, who previous held chief executive role at Timex and Qualitor Automotive, will be heading up the company, marking a major…

iRobot names former Timex head Gary Cohen as CEO

Reddit — now a publicly-traded company with more scrutiny on revenue growth — is putting a big focus on boosting its international audience, starting with francophones. In their first-ever earnings…

Reddit tests automatic, whole-site translation into French using LLM-based AI

Mushrooms continue to be a big area for alternative proteins. Canada-based Maia Farms recently raised $1.7 million to develop a blend of mushroom and plant-based protein using biomass fermentation. There’s…

Meati Foods bites into another $100M amid growth to 7,000 retail locations

Cleaning the outside of buildings is a dirty job, and it’s also dangerous. Lucid Bots came on the scene in 2018 with its Sherpa line of drones to clean windows…

Lucid Bots secures $9M for drones to clean more than your windows

High interest rates and financial pressures make it more important than ever for finance teams to have a better handle on their cash flow, and several startups are hoping to…

Israeli startup Panax raises a $10M Series A for its AI-driven cash flow management platform

The European Union has deepened the investigation of Elon Musk-owned social network, X, that it opened back in December under the bloc’s online governance and content moderation rulebook, the Digital Services Act…

EU grills Elon Musk’s X about content moderation and deepfake risks

For the founders of Atlan, a data governance startup, data has always been at the heart of what they do, even before they launched the company. In fact, co-founders Prukalpa…

Atlan scores $105M for its data control plane, as LLMs boost importance of data

It is estimated that about 2 billion people, especially those in lower and middle-income countries, lack access to quality and affordable essential medicines. The situation is exacerbated by low-quality or even killer…

Axmed raises $2M from Founderful to streamline drug supply chains in underserved markets

For decades, the Global Positioning System (GPS) has maintained a de facto monopoly on positioning, navigation and timing, because it’s cheap and already integrated into billions of devices around the…

Xona Space Systems closes $19M Series A to build out ultra-accurate GPS alternative

Bankruptcy lawyers representing customers impacted by the dramatic crash of cryptocurrency exchange FTX 17 months ago say that the vast majority of victims will receive their money back — plus interest. The…

FTX crypto fraud victims to get their money back — plus interest

On Wednesday, Google launched its digital wallet in India with local integrations, nearly two years after the app was relaunched as a digital wallet platform in the U.S. As TechCrunch exclusively reported last month,…

Google Wallet is now available in India