Commerce

Amazon updates visual search, AR search and more in challenge to Google

Comment

In this photo illustration, the Amazon logo is displayed in the Apple App Store on an iPhone.
Image Credits: Sheldon Cooper/SOPA Images/LightRocket / Getty Images

Amazon is introducing new features that make it easier to search for products on mobile and is challenging other product search engines, like Google and Pinterest in the process. The retailer announced a handful of new search and discovery features, including multimodal search (searching with text plus images), an expansion of its AR efforts and a new “Find-on-Amazon” feature that finds similar products to those in a photo you share directly with the Amazon app, among other things.

One of the new features improves upon Amazon’s existing visual search engine that lets consumers snap a photo to find matching products. Now, consumers can also add text to these queries to help narrow down the results. For instance, if you were searching for a replacement part for an appliance, you could take a photo of the part, then add the name of the appliance, like “Frigidaire,” Amazon explains.

Image Credits: Amazon

This feature is similar to Google’s, which launched multisearch last year that lets consumers search using text and images. Google later expanded it to search for products at retailers. It also offers its advanced image search feature Lens directly on its home page.

The retailer’s augmented reality feature, which previously allowed consumers to see furniture and décor in their own space, now supports tabletop items, like lamps and small appliances like toasters or coffee makers. You can also move things around from one surface to another as you use the AR tool.

Image Credits: Amazon

Another new feature, the Find-on-Amazon tool, more directly takes on features that Google and Pinterest already offer as it now allows you to search for products using a photo from anywhere. When you come across something you like — whether that’s on social media, browsing the web, checking email or chatting online — you can now tap on the “Share” button, then share the image with the Amazon Shopping app.

This will allow the app to return visually similar products even if you don’t know what the product is called or how to describe it.

The feature takes aim at both Google and Pinterest, the latter which has long pioneered visual search efforts that help consumers find products they like based on photos.

Image Credits: Amazon

Other changes are smaller improvements, including the addition of sales trend data (e.g. “10K+ bought in past month”) next to listings, and a better way to search for previously purchased items. Now, when Amazon detects you’re looking for a product you’ve bought before, it will present it at the top of the search results with the date of your last purchase.

Image Credits: Amazon

While the individual updates on their own may be minor, combined, the new tools have the ability to impact consumer behavior and shift more searches directly to Amazon. Before, shoppers may have otherwise used another search engine for product discovery to accomplish similar tasks. These changes, as a result, could then impact Google’s ad revenue, as well, as Amazon has already been catching up to the Google-Meta duopoly on digital ad spend.

Image Credits: Amazon

To date, Amazon has kept its search functionality fairly traditional, relying largely on keyword search, barcode scanning and photo-based search that has been hit-or-miss. It had yet to release so many changes to its core search feature at the same time.

Some of the new features were recently launched but weren’t officially announced, while others are rolling out now.

More TechCrunch

PayHOA, a previously bootstrapped Kentucky-based startup that offers software for self-managed homeowner associations (HOAs), is an example of how real-world problems can translate into opportunity. It just raised a $27.5…

Meet PayHOA, a profitable and once-bootstrapped SaaS startup that just landed a $27.5M Series A

Restaurant365, which offers a restaurant management suite, has raised a hot $175M from ICONIQ Growth, KKR and L Catterton.

Restaurant365 orders in $175M at $1B+ valuation to supersize its food service software stack 

Venture firm Shilling has launched a €50M fund to support growth-stage startups in its own portfolio and to invest in startups everywhere else. 

Portuguese VC firm Shilling launches €50M opportunity fund to back growth-stage startups

Chang She, previously the VP of engineering at Tubi and a Cloudera veteran, has years of experience building data tooling and infrastructure. But when She began working in the AI…

LanceDB, which counts Midjourney as a customer, is building databases for multimodal AI

Trawa simplifies energy purchasing and management for SMEs by leveraging an AI-powered platform and downstream data from customers. 

Berlin-based trawa raises €10M to use AI to make buying renewable energy easier for SMEs

Lydia is splitting itself into two apps — Lydia for P2P payments and Sumeria for those looking for a mobile-first bank account.

Lydia, the French payments app with 8 million users, launches mobile banking app Sumeria

Cargo ships docking at a commercial port incur costs called “disbursements” and “port call expenses.” This might be port dues, towage, and pilotage fees. It’s a complex patchwork and all…

Shipping logistics startup Harbor Lab raises $16M Series A led by Atomico

AWS has confirmed its European “sovereign cloud” will go live by the end of 2025, enabling greater data residency for the region.

AWS confirms will launch European ‘sovereign cloud’ in Germany by 2025, plans €7.8B investment over 15 years

Go Digit, an Indian insurance startup, has raised $141 million from investors including Goldman Sachs, ADIA, and Morgan Stanley as part of its IPO.

Indian insurance startup Go Digit raises $141M from anchor investors ahead of IPO

Peakbridge intends to invest in between 16 and 20 companies, investing around $10 million in each company. It has made eight investments so far.

Food VC Peakbridge has new $187M fund to transform future of food, like lab-made cocoa

For over six decades, the nonprofit has been active in the financial services sector.

Accion’s new $152.5M fund will back financial institutions serving small businesses globally

Meta’s newest social network, Threads, is starting its own fact-checking program after piggybacking on Instagram and Facebook’s network for a few months.

Threads finally starts its own fact-checking program

Looking Glass makes trippy-looking mixed-reality screens that make things look 3D without the need of special glasses. Today, it launches a pair of new displays, including a 16-inch mode that…

Looking Glass launches new 3D displays

Replacing Sutskever is Jakub Pachocki, OpenAI’s director of research.

Ilya Sutskever, OpenAI co-founder and longtime chief scientist, departs

Intuitive Machines made history when it became the first private company to land a spacecraft on the moon, so it makes sense to adapt that tech for Mars.

Intuitive Machines wants to help NASA return samples from Mars

As Google revamps itself for the AI era, offering AI overviews within its search results, the company is introducing a new way to filter for just text-based links. With the…

Google adds ‘Web’ search filter for showing old-school text links as AI rolls out

Blue Origin’s New Shepard rocket will take a crew to suborbital space for the first time in nearly two years later this month, the company announced on Tuesday.  The NS-25…

Blue Origin to resume crewed New Shepard launches on May 19

This will enable developers to use the on-device model to power their own AI features.

Google is building its Gemini Nano AI model into Chrome on the desktop

It ran 110 minutes, but Google managed to reference AI a whopping 121 times during Google I/O 2024 (by its own count). CEO Sundar Pichai referenced the figure to wrap…

Google mentioned ‘AI’ 120+ times during its I/O keynote

Firebase Genkit is an open source framework that enables developers to quickly build AI into new and existing applications.

Google launches Firebase Genkit, a new open source framework for building AI-powered apps

In the coming months, Google says it will open up the Gemini Nano model to more developers.

Patreon and Grammarly are already experimenting with Gemini Nano, says Google

As part of the update, Reddit also launched a dedicated AMA tab within the web post composer.

Reddit introduces new tools for ‘Ask Me Anything,’ its Q&A feature

Here are quick hits of the biggest news from the keynote as they are announced.

Google I/O 2024: Here’s everything Google just announced

LearnLM is already powering features across Google products, including in YouTube, Google’s Gemini apps, Google Search and Google Classroom.

LearnLM is Google’s new family of AI models for education

The official launch comes almost a year after YouTube began experimenting with AI-generated quizzes on its mobile app. 

Google is bringing AI-generated quizzes to academic videos on YouTube

Around 550 employees across autonomous vehicle company Motional have been laid off, according to information taken from WARN notice filings and sources at the company.  Earlier this week, TechCrunch reported…

Motional cut about 550 employees, around 40%, in recent restructuring, sources say

The keynote kicks off at 10 a.m. PT on Tuesday and will offer glimpses into the latest versions of Android, Wear OS and Android TV.

Google I/O 2024: Watch all of the AI, Android reveals

Google Play has a new discovery feature for apps, new ways to acquire users, updates to Play Points, and other enhancements to developer-facing tools.

Google Play preps a new full-screen app discovery feature and adds more developer tools

Soon, Android users will be able to drag and drop AI-generated images directly into their Gmail, Google Messages and other apps.

Gemini on Android becomes more capable and works with Gmail, Messages, YouTube and more

Veo can capture different visual and cinematic styles, including shots of landscapes and timelapses, and make edits and adjustments to already-generated footage.

Google Veo, a serious swing at AI-generated video, debuts at Google I/O 2024