How augmented and virtual reality will reshape the food industry

Comment

Jenny Dorsey

Contributor

Jenny Dorsey is a professional chef.Her culinary work has been featured in publications such as Harper’s Bazaar, Bustle, Brit+Co, Food Network and Oxygen TV and her writing can be found at Girlboss, Huffington Post, Taste.Company and SWAAY.

Augmented reality content can be found on everything from wine bottles to IKEA’s catalog and virtual reality experiences are much more detailed, with rich layers of interactivity from hand controllers to gaze triggers, and a VR film has even won an Oscar. With Apple and Google both debuting augmented reality platforms (ARKit and ARCore, respectively), Facebook heavily invested in its Oculus headset and Amazon unveiling augmented shopping features, AR and VR is primed to change many parts of our everyday lives. 

Within the food industry, AR and VR have also begun to make headway. Although development costs are still high, more and more F&B businesses are beginning to realize the potential of AR/VR and see it as a worthwhile investment. Three main areas – human resources, customer experiences, food products – have seen the most concentration of AR/VR development so far and will likely continue to push the envelope on what use cases AR & VR have within the industry.

Streamlining Employee Training 

One of the most tangible payoffs of AR/VR technology is using it for consistent and thorough employee training. The current process of developing training materials can not only be costly, but also vary in quality by team, store, or region. Many times, human resources face the conundrum of choosing between low-touch, high-efficiency (i.e. mass group workshops with the potential downside of low retention and lackluster individualized learning) or high-touch, high-cost (i.e. small group sessions with in-store, real-time training).

Enter virtual reality. Virtual reality can create a detailed visual world for employees to safely interact with their to-be everyday job surroundings and mentally and physically learn the tasks required. These VR lessons range from managing Walmart’s holiday rush to cooking noodles at Honeygrow to perfecting the espresso pull.

On the flip side, augmented reality allows for side-by-side training and execution by layering additional information on top of an employee’s direct view. For instance, a research study found AR to be effective in helping subjects visually estimate serving sizes. Maintenance and repair, a necessary evil of the food world, has benefited from equipping technicians with AR headsets to disassemble and reassemble products without being on-site. 

These new possibilities for learning and development for businesses small and large not only increase the effectiveness of training material, but also allow companies to employ a wider breadth of workers with different needs and learning styles. As headsets begin to decrease in price and more developers pour into AR/VR, it’s likely more and more companies will begin to trial and A/B test these new learning platforms. Perhaps one day, we’ll even view former mass conference workshops with the same nostalgia as the milk delivery man.

Creating Wonder in the Customer Experience

“Experiential marketing” has fundamentally changed the purpose and construction of food and hospitality driven events. Millennials especially view experiences as a means of social capital, and sharing their attendance and participation at an en vogue experience is an important piece of their curated social identities. The success of events such as the Museum of Ice Cream and 29 Rooms have convinced many brands – Grey Goose, Red Bull, Zappos, to name a few – to begin reallocating advertising dollars to experiences and sponsorships. 

Augmented and virtual reality play naturally into this shift. Both are vehicles to activate all senses and immerse the consumer within a specific branded experience. VR experiences in particular have seen growing traction for use during food & beverage events. A great example is the “Boursin Sensorium”, a CGI-based VR experience that paired motion (through moving chairs), scents and tasting samples of Boursin cheese. Patron tequila used 360 video to showcase the behind-the-scenes making process at its event booths and Innis & Gunn beer used coordinated VR footage to complement the taste of its beer. Restaurants and bars are also taking notice: Baptise & Bottle in Chicago unveiled a VR tour to pair with physical scotch; SubliMotion in Ibiza lets diners go skydiving in Samsung Gear VR; Space Needle has launched a sky-high VR bar.

Augmenting the physical world with interesting and shareable content has been the focus of AR in experiential marketing. Remy Martin and Macallan both used holographic visuals for their Microsoft Hololens-specific “Rooted in Excellence” experience and The Macallan gallery experience, respectively. Given Hololens’ hefty price tag ($3,000 for the base Development Edition), most other brands have stuck with mobile AR – such as Coca Cola’s Christmas magic campaign that gave users the ability to see virtual Santa and hidden scenes across branded bus stops in NYC or Patron’s AR-enabled tasting experience with a mini bartender. Brick-and-mortar locations are also toying with fun AR elements, with London’s City Social debuting cocktail coasters outfitted with augmented visuals and India-based chain Beer Café using AR to educate drinkers on the origins, ABV, category and taste of each beer available.

If the last few years are any indication, even more futuristic applications of AR/VR are soon to come. Visual enjoyment is a major part of any eating and drinking experience and brands have come to embrace virtual overlays – whether immersed in VR or augmented in AR – as a way to educate, inspire, and prompt consumers to action. In one extreme scenario, like the world Project Nourish paints, we could all be eating and sensing two entirely different things!

Chef pouring sauce on dish in the kitchen
Chef pouring sauce on dish in the kitchen

 

Adding Interactivity to Products

Since Bill Gates’ famous 1996 essay, the adage “content is king” has been echoed and taken to heart by companies large and small. In recent years, the rise of platforms such and Instagram and Pinterest – and the social influencers and blogger celebrities it has created – have shown even more clearly that engaging with consumers digitally result in real action. Products and retail locations may still be static, but its content must extend beyond physical space to attract the attention of potential and returning buyers. 

Augmented reality can bridge this gap between consumer, product and product content. The ability to overlay additional information, visual stimulus and interaction on top of specific items give product companies the chance to combine the digital world with the physical one in a targeted and seamless way. Food and beverage companies have begun to utilize AR in innovative new ways: Treasury Wine Estates’ line 19 Crimes brings each label’s pictured convict to life in AR; Nestle used a character from the movie “Rio” for an AR game available on 26 million boxes; Walmart and Kraft teamed up for an AR-backed summer sweepstakes to sell more Kraft products. One recent, poignant example was when chef & restauranteur David Chang released his limited-edition Momofuku x Nike sneaker via Nike’s AR app SNKRS, which would only allow fans buying access to the shoe when physically located at Fuku’s East Village location.

The potent ability of AR to enrich the knowledge and visuals of physical content goes beyond marketing purposes. Companies can use the technology to educate consumers on nutritional information and product composition or even make healthy but bland-looking foods appear more appealing. AR also allows physical content, like cookbooks, to merge with digital content for a simultaneous cross-medium experience as HoloYummy showcased with 3D dish renderings of Chef Dominique Crenn’s book Metamorphosis of Taste.

As consumers become more comfortable with AR, its presence will become a more continuous expectation. Instagram’s rise to prominence resulted in an entire industry of specialists across the world, allowing for mass adoption for even small businesses. AR is at the base of the same mountain; big brands are already repeatedly using AR outreach, but it still needs momentum from creators, developers and marketers to make it accessible for anyone and everyone.

More TechCrunch

Tags

Zen Educate, an online marketplace that connects schools with teachers, has raised $37 million in a Series B round of funding. The raise comes amid a growing teacher shortage crisis…

Zen Educate raises $37M and acquires Aquinas Education as it tries to address the teacher shortage

“When I heard the released demo, I was shocked, angered and in disbelief that Mr. Altman would pursue a voice that sounded so eerily similar to mine.”

Scarlett Johansson says that OpenAI approached her to use her voice

A new self-driving truck — manufactured by Volvo and loaded with autonomous vehicle tech developed by Aurora Innovation — could be on public highways as early as this summer.  The…

Aurora and Volvo unveil self-driving truck designed for a driverless future

The European venture capital firm raised its fourth fund as fund as climate tech “comes of age.”

ETF Partners raises €284M for climate startups that will be effective quickly — not 20 years down the road

Copilot, Microsoft’s brand of generative AI, will soon be far more deeply integrated into the Windows 11 experience.

Microsoft wants to make Windows an AI operating system, launches Copilot+ PCs

Hello and welcome back to TechCrunch Space. For those who haven’t heard, the first crewed launch of Boeing’s Starliner capsule has been pushed back yet again to no earlier than…

TechCrunch Space: Star(side)liner

When I attended Automate in Chicago a few weeks back, multiple people thanked me for TechCrunch’s semi-regular robotics job report. It’s always edifying to get that feedback in person. While…

These 81 robotics companies are hiring

The top vehicle safety regulator in the U.S. has launched a formal probe into an April crash involving the all-electric VinFast VF8 SUV that claimed the lives of a family…

VinFast crash that killed family of four now under federal investigation

When putting a video portal in a public park in the middle of New York City, some inappropriate behavior will likely occur. The Portal, the vision of Lithuanian artist and…

NYC-Dublin real-time video portal reopens with some fixes to prevent inappropriate behavior

Longtime New York-based seed investor, Contour Venture Partners, is making progress on its latest flagship fund after lowering its target. The firm closed on $42 million, raised from 64 backers,…

Contour Venture Partners, an early investor in Datadog and Movable Ink, lowers the target for its fifth fund

Meta’s Oversight Board has now extended its scope to include the company’s newest platform, Instagram Threads, and has begun hearing cases from Threads.

Meta’s Oversight Board takes its first Threads case

The company says it’s refocusing and prioritizing fewer initiatives that will have the biggest impact on customers and add value to the business.

SeekOut, a recruiting startup last valued at $1.2 billion, lays off 30% of its workforce

The U.K.’s self-proclaimed “world-leading” regulations for self-driving cars are now official, after the Automated Vehicles (AV) Act received royal assent — the final rubber stamp any legislation must go through…

UK’s autonomous vehicle legislation becomes law, paving the way for first driverless cars by 2026

ChatGPT, OpenAI’s text-generating AI chatbot, has taken the world by storm. What started as a tool to hyper-charge productivity through writing essays and code with short text prompts has evolved…

ChatGPT: Everything you need to know about the AI-powered chatbot

SoLo Funds CEO Travis Holoway: “Regulators seem driven by press releases when they should be motivated by true consumer protection and empowering equitable solutions.”

Fintech lender SoLo Funds is being sued again by the government over its lending practices

Hard tech startups generate a lot of buzz, but there’s a growing cohort of companies building digital tools squarely focused on making hard tech development faster, more efficient and —…

Rollup wants to be the hardware engineer’s workhorse

TechCrunch Disrupt 2024 is not just about groundbreaking innovations, insightful panels, and visionary speakers — it’s also about listening to YOU, the audience, and what you feel is top of…

Disrupt Audience Choice vote closes Friday

Google says the new SDK would help Google expand on its core mission of connecting the right audience to the right content at the right time.

Google is launching a new Android feature to drive users back into their installed apps

Jolla has taken the official wraps off the first version of its personal server-based AI assistant in the making. The reborn startup is building a privacy-focused AI device — aka…

Jolla debuts privacy-focused AI hardware

The ChatGPT mobile app’s net revenue first jumped 22% on the day of the GPT-4o launch and continued to grow in the following days.

ChatGPT’s mobile app revenue saw its biggest spike yet following GPT-4o launch

Dating app maker Bumble has acquired Geneva, an online platform built around forming real-world groups and clubs. The company said that the deal is designed to help it expand its…

Bumble buys community building app Geneva to expand further into friendships

CyberArk — one of the army of larger security companies founded out of Israel — is acquiring Venafi, a specialist in machine identity, for $1.54 billion. 

CyberArk snaps up Venafi for $1.54B to ramp up in machine-to-machine security

Founder-market fit is one of the most crucial factors in a startup’s success, and operators (someone involved in the day-to-day operations of a startup) turned founders have an almost unfair advantage…

OpenseedVC, which backs operators in Africa and Europe starting their companies, reaches first close of $10M fund

A Singapore High Court has effectively approved Pine Labs’ request to shift its operations to India.

Pine Labs gets Singapore court approval to shift base to India

The AI Safety Institute, a U.K. body that aims to assess and address risks in AI platforms, has said it will open a second location in San Francisco. 

UK opens office in San Francisco to tackle AI risk

Companies are always looking for an edge, and searching for ways to encourage their employees to innovate. One way to do that is by running an internal hackathon around a…

Why companies are turning to internal hackathons

Featured Article

I’m rooting for Melinda French Gates to fix tech’s broken ‘brilliant jerk’ culture

Women in tech still face a shocking level of mistreatment at work. Melinda French Gates is one of the few working to change that.

2 days ago
I’m rooting for Melinda French Gates to fix tech’s  broken ‘brilliant jerk’ culture

Blue Origin has successfully completed its NS-25 mission, resuming crewed flights for the first time in nearly two years. The mission brought six tourist crew members to the edge of…

Blue Origin successfully launches its first crewed mission since 2022

Creative Artists Agency (CAA), one of the top entertainment and sports talent agencies, is hoping to be at the forefront of AI protection services for celebrities in Hollywood. With many…

Hollywood agency CAA aims to help stars manage their own AI likenesses

Expedia says Rathi Murthy and Sreenivas Rachamadugu, respectively its CTO and senior vice president of core services product & engineering, are no longer employed at the travel booking company. In…

Expedia says two execs dismissed after ‘violation of company policy’