Media & Entertainment

Facebook tiptoes into translation within Messenger

Comment

Image Credits: Bryce Durbin / TechCrunch

Facebook could use more evidence that it brings the world together rather than tearing it apart. Luckily, technology is finally catching up with the dream of letting people become friends across language barriers. Today at its F8 conference, Facebook announced it will begin rolling out chat translation within Messenger through its M Suggestions assistant.

Facebook’s head of Messenger, David Marcus, also announced that Messenger now has more than 200,000 active developers and 300,000 active bots (up from 100,000 of each a year ago), which facilitate 8 billion messages between people and businesses each month — up 4X since last year. Messenger is also getting hooked up with augmented reality for marketers.

Facebook starts translating English-Spanish conversations in Marketplace

Translation is starting super slowly with just English-Spanish conversions for users in the U.S. who start a conversation through Facebook Marketplace, its peer-to-peer commerce feature. But in the coming weeks, all U.S. Messenger users will get access, and over time Facebook says it will “launch this functionality in additional languages and countries.”

While users spend most of their time talking with offline friends who typically share a common language, Marketplace and Groups are too areas of Facebook where people are often exposed to strangers. Eradicating the language gap could let Group members get to know each other across cultures, and realize how much they have in common. Translation could also expand the potential customer base for Marketplace posts, helping people sell quicker and giving them more reasons to ditch Craigslist and other low-tech alternatives.

Amidst the recent Cambridge Analytica, fake news and election interference scandals, Facebook has started to take on a less savory public image. That could lead to less trust and less sharing. But in 2016, Facebook got serious about translation, switching from Microsoft Bing’s technology to its own stack. Advances in neural machine learning have made phrase-based translation more accurate, and M Suggestions started recommending Messenger features like payments or location sharing in Spanish to Spanish language users based on their chat text. Facebook already offers translation for News Feed comments and posts, but the expansion to Messenger could make for a great PR talking point.

Messenger embraces marketing AR

Facebook made two other significant Messenger announcements today. They could encourage businesses to invest more in creating content and customer service on Messenger by making the experiences more efficient and better at driving sales.

Businesses can now build augmented reality experiences directly into Messenger. Marcus tells me, “If you’re a brand and you want people to experience AR at scale, there’s really no way to do that.” Snapchat might offer branded AR, but there’s no way for a business to message you about it or pull you back into a conversation afterwards to turn your excitement into sales.

Nike can prompt users to explore its shoes in AR without leaving Messenger

Now when people interact with certain businesses on Messenger, they can be prompted to open the app’s camera and use a pre-populated brand-specific AR effect. They can then return to the conversation, or shoot a photo or video of the experience and share it with friends.

Once users have checked out the AR shoes, they can buy them from within Messenger

Branded AR in Messenger is launching in closed beta. Launch partners include a way to drop a virtual Kia car onto your driveway and try out customizations, an ASUS phone unboxing experience, a Sephora AR make-up try-on demo and a chance to check out Nike’s newest Kyrie Irving shoes. Users will then be able to make purchases, like buying the new Nikes, straight from within Messenger using their payment info on file with Facebook. That payments feature is still in closed beta too, but Marcus says it will open to more partners soon.

Wit.ai is shutting down Bot Engine as Facebook rolls NLP into its updated Messenger Platform

Smarter Bots

Facebook Messenger is letting businesses use its “built-in natural language processing” feature that launched last year within their Page inboxes. That way, when their followers message their Page, Facebook can automatically cobble together previously given answers to respond automatically. For example, if a Page is frequently asked questions like “what are your hours” and “when are you open,” they might create a “store hours” entity via the Page inbox training that can be sent when a question about store hours is recognized.

Simpler Design

And finally, users will get the promised simplifications to Messenger’s interface. The app’s quest to embrace businesses, bots, Stories and visual sharing have made it bloated. Marcus wrote in January that “The app became too cluttered” and they will be paring it back, but we’ve only seen more features stuffed inside for Messenger’s 1.3 billion users.

Today, though, CEO Mark Zuckerberg showed off a stripped down new design for Messenger that cuts out the games and camera tabs from the navigation bar. Last night I haphazardly tweeted that Messenger should build a night mode…and today it announced that will be part of the redesign that Marcus says is supposed to be coming “very, very soon”. I should have known when he fav’d that tweet.

This cleaner look should help keep the focus on the core utility of chat while giving the other new features more room to shine. For a while, WhatsApp was the clean chat app while Messenger sought to expand. But now it seems Facebook has realized that people come to these apps for messaging, not all the bells and whistles, so it’s smart to shove those in a menu drawer.

More TechCrunch

The deck included some redacted numbers, but there was still enough data to get a good picture.

Pitch Deck Teardown: Cloudsmith’s $15M Series A deck

The company is describing the event as “a chance to demo some ChatGPT and GPT-4 updates.”

OpenAI’s ChatGPT announcement: What we know so far

Unlike ChatGPT, Claude did not become a new App Store hit.

Anthropic’s Claude sees tepid reception on iOS compared with ChatGPT’s debut

Welcome to Startups Weekly — Haje‘s weekly recap of everything you can’t miss from the world of startups. Sign up here to get it in your inbox every Friday. Look,…

Startups Weekly: Trouble in EV land and Peloton is circling the drain

Scarcely five months after its founding, hard tech startup Layup Parts has landed a $9 million round of financing led by Founders Fund to transform composites manufacturing. Lux Capital and Haystack…

Founders Fund leads financing of composites startup Layup Parts

AI startup Anthropic is changing its policies to allow minors to use its generative AI systems — in certain circumstances, at least.  Announced in a post on the company’s official…

Anthropic now lets kids use its AI tech — within limits

Zeekr’s market hype is noteworthy and may indicate that investors see value in the high-quality, low-price offerings of Chinese automakers.

The buzziest EV IPO of the year is a Chinese automaker

Venture capital has been hit hard by souring macroeconomic conditions over the past few years and it’s not yet clear how the market downturn affected VC fund performance. But recent…

VC fund performance is down sharply — but it may have already hit its lowest point

The person who claims to have 49 million Dell customer records told TechCrunch that he brute-forced an online company portal and scraped customer data, including physical addresses, directly from Dell’s…

Threat actor says he scraped 49M Dell customer addresses before the company found out

The social network has announced an updated version of its app that lets you offer feedback about its algorithmic feed so you can better customize it.

Bluesky now lets you personalize main Discover feed using new controls

Microsoft will launch its own mobile game store in July, the company announced at the Bloomberg Technology Summit on Thursday. Xbox president Sarah Bond shared that the company plans to…

Microsoft is launching its mobile game store in July

Smart ring maker Oura is launching two new features focused on heart health, the company announced on Friday. The first claims to help users get an idea of their cardiovascular…

Oura launches two new heart health features

Keeping up with an industry as fast-moving as AI is a tall order. So until an AI can do it for you, here’s a handy roundup of recent stories in the world…

This Week in AI: OpenAI considers allowing AI porn

Garena is quietly developing new India-themed games even though Free Fire, its biggest title, has still not made a comeback to the country.

Garena is quietly making India-themed games even as Free Fire’s relaunch remains doubtful

The U.S.’ NHTSA has opened a fourth investigation into the Fisker Ocean SUV, spurred by multiple claims of “inadvertent Automatic Emergency Braking.”

Fisker Ocean faces fourth federal safety probe

CoreWeave has formally opened an office in London that will serve as its European headquarters and home to two new data centers.

CoreWeave, a $19B AI compute provider, opens European HQ in London with plans for 2 UK data centers

The Series C funding, which brings its total raise to around $95 million, will go toward mass production of the startup’s inaugural products

AI chip startup DEEPX secures $80M Series C at a $529M valuation 

A dust-up between Evolve Bank & Trust, Mercury and Synapse has led TabaPay to abandon its acquisition plans of troubled banking-as-a-service startup Synapse.

Infighting among fintech players has caused TabaPay to ‘pull out’ from buying bankrupt Synapse

The problem is not the media, but the message.

Apple’s ‘Crush’ ad is disgusting

The Twitter for Android client was “a demo app that Google had created and gave to us,” says Particle co-founder and ex-Twitter employee Sara Beykpour.

Google built some of the first social apps for Android, including Twitter and others

WhatsApp is updating its mobile apps for a fresh and more streamlined look, while also introducing a new “darker dark mode,” the company announced on Thursday. The messaging app says…

WhatsApp’s latest update streamlines navigation and adds a ‘darker dark mode’

Plinky lets you solve the problem of saving and organizing links from anywhere with a focus on simplicity and customization.

Plinky is an app for you to collect and organize links easily

The keynote kicks off at 10 a.m. PT on Tuesday and will offer glimpses into the latest versions of Android, Wear OS and Android TV.

Google I/O 2024: How to watch

For cancer patients, medicines administered in clinical trials can help save or extend lives. But despite thousands of trials in the United States each year, only 3% to 5% of…

Triomics raises $15M Series A to automate cancer clinical trials matching

Welcome back to TechCrunch Mobility — your central hub for news and insights on the future of transportation. Sign up here for free — just click TechCrunch Mobility! Tap, tap.…

Tesla drives Luminar lidar sales and Motional pauses robotaxi plans

The newly announced “Public Content Policy” will now join Reddit’s existing privacy policy and content policy to guide how Reddit’s data is being accessed and used by commercial entities and…

Reddit locks down its public data in new content policy, says use now requires a contract

Eva Ho plans to step away from her position as general partner at Fika Ventures, the Los Angeles-based seed firm she co-founded in 2016. Fika told LPs of Ho’s intention…

Fika Ventures co-founder Eva Ho will step back from the firm after its current fund is deployed

In a post on Werner Vogels’ personal blog, he details Distill, an open-source app he built to transcribe and summarize conference calls.

Amazon’s CTO built a meeting-summarizing app for some reason

Paris-based Mistral AI, a startup working on open source large language models — the building block for generative AI services — has been raising money at a $6 billion valuation,…

Sources: Mistral AI raising at a $6B valuation, SoftBank ‘not in’ but DST is

You can expect plenty of AI, but probably not a lot of hardware.

Google I/O 2024: What to expect