AI

Brilliant Labs puts AI in front of your eye with its tiny open source AR lens

Comment

Man wearing Brilliant Labs Monocle, looking down
Image Credits: Brilliant Labs

Brilliant Labs’ augmented reality wearable stands in stark contrast to Apple’s pricey, bulky, stealthy Vision Pro. The startup’s inaugural product, Monocle, is an open source, pocket-sized AR lens that can be clipped on any eyewear or held to the eye, Launched in March, Monocle has a much more accessible price tag of $349.

“Other AR and VR headsets tend to keep you around your couch at home. We are running in the exact opposite direction,” said Bobak Tavangar, CEO and co-founder of Brilliant Labs, in an interview with TechCrunch.

To integrate its AR device into people’s daily life, Singapore-based Brilliant Labs aims to embed generative AI into its compact wearable. It’s raised some money to pursue this vision. Today, the startup announced its $3 million seed funding led by Brendan Iribe, co-founder of Oculus; Adam Cheyer, co-founder of Siri; Eric Migicovsky, founder of Pebble and former partner at Y Combinator; Plug & Play Ventures; among others.

An open approach

Monocle’s open-source community has already gained a dedicated following. In March, it went viral thanks to a group of Stanford students who transformed the eyepiece into a display for GPT-4. With the ability to listen to a user’s conversation through their phone’s microphone in real time, Monocle can generate personalized support, such as offering suggestions for what to say on a date.

The computing process happens on OpenAI’s server. The responses are then transmitted through Bluetooth from the user’s phone to Monocle and projected to the lens in front of the user’s eye.

Brilliant Labs has also developed a similar application in-house. The arGPT solution, as it’s called, is able to receive sound natively through Monocle’s mic and other sensors, enabling low-latency dialogue with GPT-4.

So far, Monocle has mostly attracted developers, hackers, hobbyists and researchers experimenting with the little palm-sized device, an approach that the founder believes can unleash the potential of fusing generative AI and AR.

“There is something important about allowing people to dig into [the AR device’s] heart and understand it and play with it and share that with others, not just passively receive something that’s the closed box that a few people far away have designed for the rest of us,” he said. “We think there’s something really philosophically important there.”

The challenge, of course, is how it branches out of the initial geeky customer base and comes up with a product that appeals to the broader consumer market.

A lightweight strategy

Monocle comes with five different processors, including a hackable field-programmable gate array (FPGA) accelerator chip that handles the data coming in from the device’s camera, microphone and capacitive touch sensor. The use of low-power electronics and miniaturized electronic parts, according to the founder, allows the lens to be compact and weigh only 15 grams.

“Every other device company was doing bulky, expensive headsets. They weren’t making money out of them,” said Tavangar. “This age of AI is upon us, and from day one — even before GPT — we saw a market opportunity with computer vision.”

At this stage, a smartphone is needed to act as a point of relay between Monocle and cloud-based AI apps. In the long term, however, the goal is to create a direct connection between the hardware and the cloud, doing away with the need for a phone host.

Eventually, the company’s vision is to run deep learning models directly on its tiny AR devices, which means even lower latency and functionality even if an internet connection is lost.

Brilliant Labs’ emphasis on a lightweight design extends to its management style. Despite being established in 2019, the startup is still run solely by its three co-founders, which makes one wonder why other mixed reality device makers need hundreds if not thousands of staff. There are signs of overhiring. In February 2021, as many as 200 people were affected during a layoff at Pico, a VR company acquired by ByteDance.

Tavangar attributes his management style to his time at Apple, where he worked as a program lead. He believes that focus is key, and that success comes from choosing one idea to pursue out of hundreds of potential options.

“How do you do really lightweight, affordable, focused hardware to deliver that AI-powered experience? [We are not chasing] the graphical intensity or big field of view [but rather] the singular AI in front of the eye experience,” the founder suggested.

“That means you don’t need an army of people who are battling with Qualcomm and all of these various different vendors and engaging in really risky, low-yield R&D and production, and still selling your end device at a loss. It means that we work with technology that has high yield and factory-floor partners that are eager to work with us, in some cases, have invested in us, like our key optics manufacturer and contract manufacturer.”

Path to profitability

While Tavangar declined to disclose Monocle’s sales figures, he said Brilliant Labs makes “a fair bit of money per unit” and “the margins are really good.” The company does “quite well” just from hardware sales without any marketing efforts, he added.

The Monocle AR lens weighs only 15 grams. Image: Brilliant Labs

“This is again something I learned from Apple. If you can get the unit economics right and if your yields are 80, 90% and above at low volume, then you’ve got the operational discipline, the good foundation, and are able to start scaling and be a profitable company,” the founder said.

Case in point, the startup is currently seeing “almost 3x in terms of what we’re able to sell it for versus what it costs us to make it.” In comparison, many other mixed reality companies are selling at zero or negative margins, Tavangar said.

Aside from selling hardware, Brilliant Labs plans to layer on more services powered by large language models, which presents an opportunity to charge for the services. Brilliant Labs integrated with GPT first because it has a “well-documented API.” But the large language model is compute-intensive and the team is constantly on the look for more compressed LLMs.

“I think over time we will see how compressed the models can become even as efficiency increases. As an undercurrent to that, the hardware we make will be more powerful even as the hardware stays low power,” the founder said.

The company is on track to “far exceed” its sales target this year. It has close to 2,000 developers in its Discord community to date.

When questioned about Brilliant Labs’ competitive edge, Tavangar reckoned that the startup’s tightly integrated software and hardware ecosystem is hard to copy, not least because it has a fledgling open-source community.

The company also enjoys a data advantage, he said, as the user information collected by the sensors continues to inform the AI services running on the platform, which in turn improves user personalization. Brilliant Labs does not store any customer data on its devices or server as it’s “not interested in selling data to advertisers,” the founder noted.

Apple’s Vision Pro reignites excitement in China’s XR world

More TechCrunch

Here’s what one insider said happened in the days leading up to the layoffs.

Tesla’s profitable Supercharger network is in limbo after Musk axed the entire team

StrictlyVC events deliver exclusive insider content from the Silicon Valley & Global VC scene while creating meaningful connections over cocktails and canapés with leading investors, entrepreneurs and executives. And TechCrunch…

Meesho, a leading e-commerce startup in India, has secured $275 million in a new funding round.

Meesho, an Indian social commerce platform with 150M transacting users, raises $275M

Some Indian government websites have allowed scammers to plant advertisements capable of redirecting visitors to online betting platforms. TechCrunch discovered around four dozen “gov.in” website links associated with Indian states,…

Scammers found planting online betting ads on Indian government websites

Around 550 employees across autonomous vehicle company Motional have been laid off, according to information taken from WARN notice filings and sources at the company.  Earlier this week, TechCrunch reported…

Motional cut about 550 employees, around 40%, in recent restructuring, sources say

The deck included some redacted numbers, but there was still enough data to get a good picture.

Pitch Deck Teardown: Cloudsmith’s $15M Series A deck

The company is describing the event as “a chance to demo some ChatGPT and GPT-4 updates.”

OpenAI’s ChatGPT announcement: What we know so far

Unlike ChatGPT, Claude did not become a new App Store hit.

Anthropic’s Claude sees tepid reception on iOS compared with ChatGPT’s debut

Welcome to Startups Weekly — Haje‘s weekly recap of everything you can’t miss from the world of startups. Sign up here to get it in your inbox every Friday. Look,…

Startups Weekly: Trouble in EV land and Peloton is circling the drain

Scarcely five months after its founding, hard tech startup Layup Parts has landed a $9 million round of financing led by Founders Fund to transform composites manufacturing. Lux Capital and Haystack…

Founders Fund leads financing of composites startup Layup Parts

AI startup Anthropic is changing its policies to allow minors to use its generative AI systems — in certain circumstances, at least.  Announced in a post on the company’s official…

Anthropic now lets kids use its AI tech — within limits

Zeekr’s market hype is noteworthy and may indicate that investors see value in the high-quality, low-price offerings of Chinese automakers.

The buzziest EV IPO of the year is a Chinese automaker

Venture capital has been hit hard by souring macroeconomic conditions over the past few years and it’s not yet clear how the market downturn affected VC fund performance. But recent…

VC fund performance is down sharply — but it may have already hit its lowest point

The person who claims to have 49 million Dell customer records told TechCrunch that he brute-forced an online company portal and scraped customer data, including physical addresses, directly from Dell’s…

Threat actor says he scraped 49M Dell customer addresses before the company found out

The social network has announced an updated version of its app that lets you offer feedback about its algorithmic feed so you can better customize it.

Bluesky now lets you personalize main Discover feed using new controls

Microsoft will launch its own mobile game store in July, the company announced at the Bloomberg Technology Summit on Thursday. Xbox president Sarah Bond shared that the company plans to…

Microsoft is launching its mobile game store in July

Smart ring maker Oura is launching two new features focused on heart health, the company announced on Friday. The first claims to help users get an idea of their cardiovascular…

Oura launches two new heart health features

Keeping up with an industry as fast-moving as AI is a tall order. So until an AI can do it for you, here’s a handy roundup of recent stories in the world…

This Week in AI: OpenAI considers allowing AI porn

Garena is quietly developing new India-themed games even though Free Fire, its biggest title, has still not made a comeback to the country.

Garena is quietly making India-themed games even as Free Fire’s relaunch remains doubtful

The U.S.’ NHTSA has opened a fourth investigation into the Fisker Ocean SUV, spurred by multiple claims of “inadvertent Automatic Emergency Braking.”

Fisker Ocean faces fourth federal safety probe

CoreWeave has formally opened an office in London that will serve as its European headquarters and home to two new data centers.

CoreWeave, a $19B AI compute provider, opens European HQ in London with plans for 2 UK data centers

The Series C funding, which brings its total raise to around $95 million, will go toward mass production of the startup’s inaugural products

AI chip startup DEEPX secures $80M Series C at a $529M valuation 

A dust-up between Evolve Bank & Trust, Mercury and Synapse has led TabaPay to abandon its acquisition plans of troubled banking-as-a-service startup Synapse.

Infighting among fintech players has caused TabaPay to ‘pull out’ from buying bankrupt Synapse

The problem is not the media, but the message.

Apple’s ‘Crush’ ad is disgusting

The Twitter for Android client was “a demo app that Google had created and gave to us,” says Particle co-founder and ex-Twitter employee Sara Beykpour.

Google built some of the first social apps for Android, including Twitter and others

WhatsApp is updating its mobile apps for a fresh and more streamlined look, while also introducing a new “darker dark mode,” the company announced on Thursday. The messaging app says…

WhatsApp’s latest update streamlines navigation and adds a ‘darker dark mode’

Plinky lets you solve the problem of saving and organizing links from anywhere with a focus on simplicity and customization.

Plinky is an app for you to collect and organize links easily

The keynote kicks off at 10 a.m. PT on Tuesday and will offer glimpses into the latest versions of Android, Wear OS and Android TV.

Google I/O 2024: How to watch

For cancer patients, medicines administered in clinical trials can help save or extend lives. But despite thousands of trials in the United States each year, only 3% to 5% of…

Triomics raises $15M Series A to automate cancer clinical trials matching

Welcome back to TechCrunch Mobility — your central hub for news and insights on the future of transportation. Sign up here for free — just click TechCrunch Mobility! Tap, tap.…

Tesla drives Luminar lidar sales and Motional pauses robotaxi plans