Hardware

Pokémon Go changes everything (and nothing) for AR/VR

Comment

Image Credits:

Tim Merel

Contributor

Tim Merel is managing director of Digi-Capital.

More posts from Tim Merel

“Stop calling Pokémon Go AR,” say the purists. But who cares what you call something that is so successful? Just be glad it happened, and let’s figure out what it means for the AR/VR industry.

Pokémon Go is the singularity for AR/VR that everyone was waiting for, but looks very different to what everyone expected. It isn’t space glasses from the future, it isn’t high tech, it doesn’t require new hardware and it’s free. Who saw that coming?

It would be fair to say that not even Pokémon Go’s developer Niantic did, as, despite their enormous success, the overwhelming demand from users led to reports of significant server downtime at launch (not helped by DDoS attacks).

But the great thing about Pokémon Go is that hundreds of millions of consumers aged 8 to 80 have played it worldwide, watched others play it with bemusement or read about odd experiences with it in the miles of column inches and vast numbers of electrons devoted to it by mainstream media. AR/VR is no longer the creature of industry insiders, innovators and early adopters (or TechCrunch readers). AR/VR became a mainstream phenomenon in less than a week, and it did so years before the most bullish industry insiders thought it would (us included).

So why has Pokémon Go been so successful?

First, Pokémon has a treasured place in our hearts. Millennials grew up with it, watched by doting Gen X parents and baby boomer grandparents — it is a brand that is everywhere.

Second, a pervasive platform. We’re approaching 4 billion smartphone and tablet mobile broadband subscriptions this year — a platform that is everywhere.

Third, a fast core user loop. It’s not the Pokémon you played as a kid. It’s even more accessible — a core user loop that works for everyone.

Fourth, a purely mobile experience. You can play it wherever you go, and wherever you go is part of why you play it. And that’s key not just to the success of Pokémon Go, but the success of all AR. Augmented reality is inherently mobile, and mobility has driven much of the tech innovation of the last decade.

AR is from Mars, VR is from Venus

But still the purists will tell you, “Pokémon Go is not AR.” So are they right or wrong?

Let’s revisit some definitions. Virtual reality places users inside the virtual world, immersing them. Augmented reality overlays virtual objects on the user’s real world, augmenting it. Although closely related to AR, mixed reality anchors apparently solid virtual objects in the user’s real world. So they appear to the user as real. So far, so simple.

Digi-Capital Reality Matrix

But the technology is a bit more diverse than it first appears. Digi-Capital’s Reality Matrix segments the market using a few basic definitions:

  • Virtual: real world is blocked out (i.e. user can only see the virtual world and virtual objects)
  • Augmented: real world is not blocked out (i.e. user can see the real world and virtual objects)
  • Immersive: the technology drivers (too deep into the weeds — see more here) combine to trick the user’s brain into reacting as though it was a real experience
  • Ambient: one or more of the technology drivers doesn’t provide the same level of experience as Immersive (Note: this may be desirable, particularly for some augmented reality applications)

The Reality Matrix is made up of four sectors, with some players operating across them to meet different user needs:

Console/PC VR makes users jump out of the way when a virtual whale swims toward them under the sea (e.g. HTC Vive, Oculus, PlayStation VR); Mobile VR provides a very good VR experience, but isn’t as immersive because of key drivers like positional tracking (e.g. Samsung Gear VR, Google Cardboard and Daydream); Augmented Reality ranges from the equivalent of Iron Man’s holographic display with transparent virtual objects in the real world in daylight (e.g. Atheer) to smartphone/tablet “magic window” AR (e.g. Google Project Tango); Mixed Reality gives users virtual objects that appear solid in the real world in daylight (e.g. Microsoft HoloLens, Magic Leap, Meta), or switches easily between AR and VR (e.g. ODG)

But where does this leave Pokémon Go?

It’s augmented reality, Jim — but not as we know it

Here’s the bit where the purists get upset (and not just by the Star Trek misquote from The Firm). So I’m just going to say it.

Pokémon Go is AR. Just a really basic version of it.

In many ways, Pokémon Go is only location-based entertainment, and not AR in the way that industry folks think about it. But that’s the point. This is no longer about industry folks. It’s about public perception.

And the public thinks Pokémon Go is AR. So it is.

What you call it doesn’t matter when you’re walking around the neighborhood with your friends hunting Pokémon. It doesn’t matter that the tech is old school (GPS, clock, camera). It doesn’t matter that there are no fancy optics, SLAM (Simultaneous Localization and Mapping), advanced computer vision or other tech wizardry involved. None of that matters.

Because it’s fun. And it’s everywhere. And folks think it’s AR whether you like it or not. So deal with it.

Everything and nothing

So what does Pokémon Go mean for the development of AR/VR?

In terms of consumer acceptance, it’s monumental. People who wouldn’t have been aware of or tried VR/AR/MR for years are actively engaged with the market today. It’s stupendously good for the industry, because there’s now mass market consumer awareness.

For app developers, everyone is scrambling to figure out whether or not they can get on the bandwagon. Folks who were on the fence about devoting resources to VR/AR/MR are now at least thinking about it. And budding engineers-in-the-making who are deciding what they’ll do with their careers are being influenced by it. For talent flowing into the market, that’s hugely helpful.

For core VR/AR/MR technology companies (i.e. the hardware guys), Pokémon Go has had little impact on how the technology is being developed. All the challenges remain, and AR still needs that magic combination of hero device, long battery life, cellular capability, strong app ecosystem and telco cross-subsidization before it can really take off (around 2018, based on current road maps).

For investors, it’s been both very exciting and highly confusing. Pokémon Go is a very specific application with a lot going for it. Hard to replicate at scale. Nintendo stock has looked more like a yoyo than a Pokéball. So while there is more buzz around the market than already existed (if that’s even possible), the underlying thinking of VCs is broadly unchanged.

Apple CEO Tim Cook said it best: “AR can be really great. We have been and continue to invest a lot in this. We are high on AR for the long run. We think there are great things for customers and a great commercial opportunity…it will be huge.”

One small step for Pokémon, one giant leap for Poké-kind.

More TechCrunch

Blue Origin’s New Shepard rocket will take a crew to suborbital space for the first time in nearly two years later this month, the company announced on Tuesday.  The NS-25…

Blue Origin to resume crewed New Shepard launches on May 19

This will enable developers to use the on-device model to power their own AI features.

Google is building its Gemini Nano AI model into Chrome on the desktop

It ran 110 minutes, but Google managed to reference AI a whopping 121 times during Google I/O 2024 (by its own count). CEO Sundar Pichai referenced the figure to wrap…

Google mentioned ‘AI’ 120+ times during its I/O keynote

Firebase Genkit is an open source framework that enables developers to quickly build AI into new and existing applications.

Google launches Firebase Genkit, a new open source framework for building AI-powered apps

In the coming months, Google says it will open up the Gemini Nano model to more developers.

Patreon and Grammarly are already experimenting with Gemini Nano, says Google

As part of the update, Reddit also launched a dedicated AMA tab within the web post composer.

Reddit introduces new tools for ‘Ask Me Anything,’ its Q&A feature

Here are quick hits of the biggest news from the keynote as they are announced.

Google I/O 2024: Here’s everything Google just announced

LearnLM is already powering features across Google products, including in YouTube, Google’s Gemini apps, Google Search and Google Classroom.

LearnLM is Google’s new family of AI models for education

The official launch comes almost a year after YouTube began experimenting with AI-generated quizzes on its mobile app. 

Google is bringing AI-generated quizzes to academic videos on YouTube

Around 550 employees across autonomous vehicle company Motional have been laid off, according to information taken from WARN notice filings and sources at the company.  Earlier this week, TechCrunch reported…

Motional cut about 550 employees, around 40%, in recent restructuring, sources say

The keynote kicks off at 10 a.m. PT on Tuesday and will offer glimpses into the latest versions of Android, Wear OS and Android TV.

Google I/O 2024: Watch all of the AI, Android reveals

Google Play has a new discovery feature for apps, new ways to acquire users, updates to Play Points, and other enhancements to developer-facing tools.

Google Play preps a new full-screen app discovery feature and adds more developer tools

Soon, Android users will be able to drag and drop AI-generated images directly into their Gmail, Google Messages and other apps.

Gemini on Android becomes more capable and works with Gmail, Messages, YouTube and more

Veo can capture different visual and cinematic styles, including shots of landscapes and timelapses, and make edits and adjustments to already-generated footage.

Google Veo, a serious swing at AI-generated video, debuts at Google I/O 2024

In addition to the body of the emails themselves, the feature will also be able to analyze attachments, like PDFs.

Gemini comes to Gmail to summarize, draft emails, and more

The summaries are created based on Gemini’s analysis of insights from Google Maps’ community of more than 300 million contributors.

Google is bringing Gemini capabilities to Google Maps Platform

Google says that over 100,000 developers already tried the service.

Project IDX, Google’s next-gen IDE, is now in open beta

The system effectively listens for “conversation patterns commonly associated with scams” in-real time. 

Google will use Gemini to detect scams during calls

The standard Gemma models were only available in 2 billion and 7 billion parameter versions, making this quite a step up.

Google announces Gemma 2, a 27B-parameter version of its open model, launching in June

This is a great example of a company using generative AI to open its software to more users.

Google TalkBack will use Gemini to describe images for blind people

Google’s Circle to Search feature will now be able to solve more complex problems across psychics and math word problems. 

Circle to Search is now a better homework helper

People can now search using a video they upload combined with a text query to get an AI overview of the answers they need.

Google experiments with using video to search, thanks to Gemini AI

A search results page based on generative AI as its ranking mechanism will have wide-reaching consequences for online publishers.

Google will soon start using GenAI to organize some search results pages

Google has built a custom Gemini model for search to combine real-time information, Google’s ranking, long context and multimodal features.

Google is adding more AI to its search results

At its Google I/O developer conference, Google on Tuesday announced the next generation of its Tensor Processing Units (TPU) AI chips.

Google’s next-gen TPUs promise a 4.7x performance boost

Google is upgrading Gemini, its AI-powered chatbot, with features aimed at making the experience more ambient and contextually useful.

Google’s Gemini updates: How Project Astra is powering some of I/O’s big reveals

Veo can generate few-seconds-long 1080p video clips given a text prompt.

Google’s image-generating AI gets an upgrade

At Google I/O, Google announced upgrades to Gemini 1.5 Pro, including a bigger context window. .

Google’s generative AI can now analyze hours of video

The AI upgrade will make finding the right content more intuitive and less of a manual search process.

Google Photos introduces an AI search feature, Ask Photos

Apple released new data about anti-fraud measures related to its operation of the iOS App Store on Tuesday morning, trumpeting a claim that it stopped over $7 billion in “potentially…

Apple touts stopping $1.8B in App Store fraud last year in latest pitch to developers