Hardware

Google’s 3D video calling booths, Project Starline, will now be tested in the real world

Comment

Image Credits: Google

While Meta is trying to convince consumers to strap on its VR headsets to enter the metaverse, Google continues to experiment with a different sort of false reality: its holographic video chat project known as Project Starline. Announced last year, Project Starline is a video-calling booth that uses 3D imagery, high-resolution cameras, custom depth sensor sensors and a breakthrough light field display to create a lifelike experience for callers on both sides of the screen — and all without a required headset. Now, Google says it’s expanding its real-world tests with an early access program that will see Starline used in the offices of various enterprise partners, including Salesforce, WeWork, T-Mobile and Hackensack Meridian Health. 

Google will begin installing Project Starline prototypes in select partner offices for regular testing starting later this year, it noted.

Until now, the 3D calling booths were found in Google’s offices in the U.S. where employees were able to test them for things like meetings, employee onboarding sessions, and more. The company had also invited more than 100 enterprise partners in areas like media, healthcare and retail to demo the technology in its offices and offer their feedback about the experience.

With the launch of the new early access program, those partners will be able to test the calling booths in their own offices, providing Google with valuable feedback and insights about how such a technology would be used in the real world and what sort of challenges it may face.

Those who have been able to test Project Starline have described the experience as being incredibly realistic and an impressive technology, even in its early phases.

But there have been questions about to what extent Starline would ever exist beyond being a very cool tech demo, versus a technology that would eventually become a part of office workers’ — much less consumers’ — everyday lives. It’s unclear if Google has a plan to actually commercialize the tech, what these calling booths would cost businesses to either purchase and maintain, and whether or not there’s enough demand for the technology in a world where Zoom and Google Meet are considered “good enough” solutions for virtual meetings. (Plus, they can support more than the one-on-one conversations Starline offers.)

In addition, Project Starline’s long-term status at Google has been unknown as the project was wrapped up into a reorg a year ago that saw Google relocating its various AR and VR technologies, along with its internal R&D group known as Area 120, into a new “Labs” team. This September, Google then slashed the number of projects in Area 120 by half — an indication that it may not see these sorts of experiments as priorities in the current economic environment. Even some Googlers were not sure how Project Starline was still around, given the situation.

Still, Starline’s tech is an interesting bet on a different kind of “virtual” reality — one where people aren’t represented with gaming-like avatars, but rather as their real selves. Instead of developing tech that uses cameras to track eye and face movements to make avatars more realistic, as Meta is now doing, or figuring out how to add legs to your in-VR body, Google is working to present a person as they are — and without the additional encumbrance of having to wear something on your head.

Meanwhile, as more businesses are trying to figure out the hybrid future of work model, technology like Starline could bridge the gap between in-person meetings and the less-idea 2D video chat experience we have today.

Partners like WeWork and Salesforce spoke of their interest in trying out the tech, which they believe could help make connections between people more meaningful.

“In today’s digital-first world, companies need to provide the technology and tools to help employees be more productive and effective at work,” Andy White, SVP of Business Technology at Salesforce, said in a statement. “At Salesforce, we’re constantly exploring new ways to deliver incredible experiences to our employees and customers around the world. Project Starline has the potential to drive deeper connections between people by bridging in-person and virtual experiences.”

Google says it will share more about what it learns from its early access program next year.

Google is making a 3D, life-size video calling booth

More TechCrunch

It ran 110 minutes, but Google managed to reference AI a whopping 121 times during Google I/O 2024 (by its own count). CEO Sundar Pichai referenced the figure to wrap…

Google mentioned ‘AI’ 120+ times during its I/O keynote

Firebase Genkit is an open source framework that enables developers to quickly build AI into new and existing applications.

Google launches Firebase Genkit, a new open source framework for building AI-powered apps

In the coming months, Google says it will open up the Gemini Nano model to more developers.

Patreon and Grammarly are already experimenting with Gemini Nano, says Google

As part of the update, Reddit also launched a dedicated AMA tab within the web post composer.

Reddit introduces new tools for ‘Ask Me Anything,’ its Q&A feature

Here are quick hits of the biggest news from the keynote as they are announced.

Google I/O 2024: Here’s everything Google just announced

LearnLM is already powering features across Google products, including in YouTube, Google’s Gemini apps, Google Search and Google Classroom.

LearnLM is Google’s new family of AI models for education

The official launch comes almost a year after YouTube began experimenting with AI-generated quizzes on its mobile app. 

Google is bringing AI-generated quizzes to academic videos on YouTube

Around 550 employees across autonomous vehicle company Motional have been laid off, according to information taken from WARN notice filings and sources at the company.  Earlier this week, TechCrunch reported…

Motional cut about 550 employees, around 40%, in recent restructuring, sources say

The keynote kicks off at 10 a.m. PT on Tuesday and will offer glimpses into the latest versions of Android, Wear OS and Android TV.

Google I/O 2024: Watch all of the AI, Android reveals

Google Play has a new discovery feature for apps, new ways to acquire users, updates to Play Points, and other enhancements to developer-facing tools.

Google Play preps a new full-screen app discovery feature and adds more developer tools

Soon, Android users will be able to drag and drop AI-generated images directly into their Gmail, Google Messages and other apps.

Gemini on Android becomes more capable and works with Gmail, Messages, YouTube and more

Veo can capture different visual and cinematic styles, including shots of landscapes and timelapses, and make edits and adjustments to already-generated footage.

Google Veo, a serious swing at AI-generated video, debuts at Google I/O 2024

In addition to the body of the emails themselves, the feature will also be able to analyze attachments, like PDFs.

Gemini comes to Gmail to summarize, draft emails, and more

The summaries are created based on Gemini’s analysis of insights from Google Maps’ community of more than 300 million contributors.

Google is bringing Gemini capabilities to Google Maps Platform

Google says that over 100,000 developers already tried the service.

Project IDX, Google’s next-gen IDE, is now in open beta

The system effectively listens for “conversation patterns commonly associated with scams” in-real time. 

Google will use Gemini to detect scams during calls

The standard Gemma models were only available in 2 billion and 7 billion parameter versions, making this quite a step up.

Google announces Gemma 2, a 27B-parameter version of its open model, launching in June

This is a great example of a company using generative AI to open its software to more users.

Google TalkBack will use Gemini to describe images for blind people

This will enable developers to use the on-device model to power their own AI features.

Google is building its Gemini Nano AI model into Chrome on the desktop

Google’s Circle to Search feature will now be able to solve more complex problems across psychics and math word problems. 

Circle to Search is now a better homework helper

People can now search using a video they upload combined with a text query to get an AI overview of the answers they need.

Google experiments with using video to search, thanks to Gemini AI

A search results page based on generative AI as its ranking mechanism will have wide-reaching consequences for online publishers.

Google will soon start using GenAI to organize some search results pages

Google has built a custom Gemini model for search to combine real-time information, Google’s ranking, long context and multimodal features.

Google is adding more AI to its search results

At its Google I/O developer conference, Google on Tuesday announced the next generation of its Tensor Processing Units (TPU) AI chips.

Google’s next-gen TPUs promise a 4.7x performance boost

Google is upgrading Gemini, its AI-powered chatbot, with features aimed at making the experience more ambient and contextually useful.

Google’s Gemini updates: How Project Astra is powering some of I/O’s big reveals

Veo can generate few-seconds-long 1080p video clips given a text prompt.

Google’s image-generating AI gets an upgrade

At Google I/O, Google announced upgrades to Gemini 1.5 Pro, including a bigger context window. .

Google’s generative AI can now analyze hours of video

The AI upgrade will make finding the right content more intuitive and less of a manual search process.

Google Photos introduces an AI search feature, Ask Photos

Apple released new data about anti-fraud measures related to its operation of the iOS App Store on Tuesday morning, trumpeting a claim that it stopped over $7 billion in “potentially…

Apple touts stopping $1.8B in App Store fraud last year in latest pitch to developers

Online travel agency Expedia is testing an AI assistant that bolsters features like search, itinerary building, trip planning, and real-time travel updates.

Expedia starts testing AI-powered features for search and travel planning