Menu TechCrunch Search
  • Follow Us
  • Facebook
  • Instagram
  • Twitter
  • Youtube
  • Flipboard
  • LinkedIn
  • Google+
  • RSS
  • More
    • Youtube
    • Flipboard
    • LinkedIn
    • Google+
    • RSS
Got a tip? Let us know.
  • News
    • Channels
      • Startups
      • Mobile
      • Gadgets
      • Enterprise
      • Social
      • Europe
      • Asia
      • Crunch Network
      • Unicorn Leaderboard
      • Gift Guides
    All Topics All Galleries All Timelines
  • Video
    Shows
      • Apps
      • Bullish
      • Crunch Report
      • Disrupt NY 2017
      • Judah vs the Machines
      • Gadgets
      • Interviews
      • News
      • Reviews
      • TC Features
    All Shows
    All Videos
  • Events
    • TechCrunch Events
      • Disrupt
      • Startup Battlefield
      • Crunchies
      • Meetups
      • International City Events
      • Hackathon
      • Sessions
      • Include
      • TechCrunch Store
    • News About
      • Mobile World Congress
      • CES
    All Events
  • Crunchbase
  • Trending
  • Facebook
  • Tesla
  • Snap
  • News
  • Startups
  • Mobile
  • Gadgets
  • Enterprise
  • Social
  • Europe
Search TechCrunch

Hi!

You are about to activate our Facebook Messenger news bot. Once subscribed, the bot will send you a digest of trending stories once a day. You can also customize the types of stories it sends you.

Click on the button below to subscribe and wait for a new Facebook message from the TC Messenger news bot.

Thanks,
TC Team

TC Sessions RoboticsDiscover The Next Evolution Of The Startup / Robotics Ecosystem Register Today

F8 2017

April 18 - 19, 2017

  • Coverage
Apps
  • Bumble is opening a physical space in New York for dates to meet up

    Bumble is opening a physical space in New York for dates to meet up

  • Voiceitt lets people with speech impairments use voice-controlled technology

    Voiceitt lets people with speech impairments use voice-controlled technology

  • Brand new Vellum picks a fight for prettier (e)books

    Brand new Vellum picks a fight for prettier (e)books

  • Browse more...

Facebook
  • Facebook lets you add any post to albums, not just photos

    Facebook lets you add any post to albums, not just photos

  • Social media giants making progress on illegal hate speech takedowns: EC

    Social media giants making progress on illegal hate speech takedowns: EC

  • UK eyeing fines for social media content-moderation failures

    UK eyeing fines for social media content-moderation failures

  • Browse more...

Snapchat Clone
  • Instagram launches Story Search for hashtags and locations

    Instagram launches Story Search for hashtags and locations

  • Instagram Location Stories appear in Explore. Is Story Search coming?

    Instagram Location Stories appear in Explore. Is Story Search coming?

  • Instagram on copying Snapchat: “This is the way the tech industry works”

    Instagram on copying Snapchat: “This is the way the tech industry works”

  • Browse more...

Facebook Camera Effects Platform
  • The augmented reality gold rush is afoot

    The augmented reality gold rush is afoot

  • Snap’s anti-developer attitude is an augmented liability

    Snap’s anti-developer attitude is an augmented liability

  • Browse more...

F82017
  • Machine intelligence is the future of monetization for Facebook

    Machine intelligence is the future of monetization for Facebook

  • Facebook plans ethics board to monitor its brain-computer interface work

    Facebook plans ethics board to monitor its brain-computer interface work

  • Talking fiber, drones and open-source hardware with Facebook’s Yael Maguire

    Talking fiber, drones and open-source hardware with Facebook’s Yael Maguire

  • Browse more...

Facebook launches augmented reality Camera Effects developer platform

Posted Apr 18, 2017 by Josh Constine (@joshconstine)
  • 0

    SHARES
Next Story

Theranos starts to agree to things

Facebook will rely on an army of outside developers to contribute augmented reality image filters and interactive experiences to its new Camera Effects platform. After today’s Facebook F8 conference, the first effects will become available inside Facebook’s Camera feature on smartphones, but the Camera Effects platform is designed to eventually be compatible with future augmented reality hardware, such as eyeglasses.

While critics thought Facebook was just mindlessly copying Snapchat with its recent Stories and Camera features in Facebook, Messenger, Instagram and WhatsApp, Mark Zuckerberg tells TechCrunch his company was just laying the groundwork for today’s Camera Effects platform launch.

Facebook’s Camera Effects Platform offers object recognition

Because stylish, affordable AR glasses might be years away but everyone already has a camera phone, Zuckerberg tells me “the first augmented reality platform that becomes mainstream isn’t going to be glasses, it’s going to be cameras.” He says other apps (like Snapchat) have been keeping their augmented reality experience creation tools to themselves, but “building an open platform I think is going to be one of the big advances that pushes this forward . . . all developers can work on [the open platform] so that way you don’t just have 10 or 20 effects but you have thousands.”

That’s the same logic behind my August thought piece on why the camera should be Facebook’s next platform, which it now is. Developers let Facebook offer a much wider diversity of experiences.

Facebook is now allowing developers to apply for access to the closed beta of the platform’s AR Studio tool. It will allow developers to use precise location, object recognition and depth detection to create their effects. Facebook’s camera will be able to recognize specific objects like a coffee cup, and bubble up related effects to users like steam coming off the cup or sharks swimming inside the coffee.

Meanwhile, anyone can now use the Frame Studio to upload simple, static overlaid image filters that will appear in Facebook Camera to their friends or a Page’s fans. There’s no need for coding knowledge to use Frame Studio, you just upload an image and your name will appear on the Frame’s preview and News Feed posts to give you credit.

Facebook’s Frame Studio lets anyone create an image filter

For now Facebook won’t allow any branding or advertising unless pre-approved, though it will eventually monetize the platform, with a spokesperson saying “We are focused on making this product great for people before introducing paid ways for businesses to participate.”

The three categories of augmented reality content

Zuckerberg imagines AR experiences breaking down into three major categories: augmenting objects in the physical world with additional information like putting directions atop the street or a restaurant’s reviews on their storefront, layering new virtual objects onto reality like a chess board or working television and enhancing objects that are already there with extra effects, like giving you a glitter beard or adding a castle turret to your apartment building.

Zuckerberg sees three areas for AR experiences (from left): Overlaying information, adding virtual objects and enhancing real objects

Zuckerberg tells me people underestimate AR as just, “Oh, a lot of people are using these primitive tools because, I don’t know, like this is what kids do now.” But he believes that as the necessary tech finally arrives and developers get creative, we’ll be doing much more than just adding fake mustaches to our faces.

Developers could make informational tools like overlaid suggestions from experts on businesses, interactive games and mind-bending art that Zuckerberg says would be impossible to create in the real world. Meanwhile, users will be able to add augmented reality notes to different specific locations, so they could tell friends their favorite dish at a restaurant.

Anyone can use the simple Frame Studio to upload static camera effects

Developers can user three inputs to trigger their augmented reality effects: Face Tracker (but not identity or facial recognition), Sensor data, such as the gyroscope and location, and Scripting APIs to pull in data from other apps and respond to user inputs in real time. Launch partners and experiences include Manchester United pulling in soccer match data and “GOOAALL!” image overlays with crowd noises, while game developer EA has built a Mass Effect-themed helmet mask that pulls in stats from your progress in the game. Nike will overlay a sweatband on your head and pull in your recent running route as an overlaid map.

AR Studio developers can also make effects for Facebook Live, with effects launching today including an overlaid viewer polling This or That feature and comment hashtags that surface a Giphy Live animated GIF the broadcaster can show on-screen.

Facebook Live’s new augmented reality effects can be built with the Camera Effects Platform’s AR Studio tool

Zuckerberg’s vision of an AR world

For now, Zuckerberg says that at Facebook, “we definitely see ourselves as more on the software and services side.” Luckily, the next phase of AR on camera phones won’t require special hardware. “We don’t need to build the phones because the phones are already there.” Yet he admits, “In the beginning of any platform, the hardware and software are not separable,” so when AR glasses technology comes of age, Facebook might end up making its own.

At that point, Zuckerberg’s grand vision sees augmented reality as an economic equalizer. “The ability to just have glasses or eventually contact lenses where you can overlay whatever information you want . . .[means] we could put a TV on the wall and have it be a $1 app instead of a $500 piece of hardware that a lot of people can’t afford. So if the glasses cost $500 or whatever it is, you’re saving a ton of money compared to all the other hardware that you would have to buy.”

And that’s where augmented reality blends with Zuckerberg’s 6,000-word manifesto on the future of community. One aspect of his letter discussed how automation could force some people out of traditional jobs and into roles more directly serving their community and creating art. AR could make the latter easier and more affordable.

“I think more people are going to be doing work and spending more of their time . . . connecting with people and expressing themselves and doing art,” Zuckerberg tells me. “And that I think dovetails very well with an AR world where a lot of what we’re going to be able to do is just about creating ideas and crafting them and sharing them. In AR, paint is free.”

The previous computing platforms were entirely digital and accessible to anyone connected to the internet. But the real world is huge — bigger than even Facebook can fill with augmented reality experiences. By opening this developer platform, Facebook doesn’t have to build everything by itself. While Snapchat might have had a headstart in bringing AR to consumers, Facebook has just mapped out how it plans to take augmented reality several steps further.

  • 0

    SHARES
Advertisement
Advertisement

Crunchbase

  • Facebook

    • Founded 2004
    • Overview Facebook is an online social networking service that allows its users to connect with friends and family as well as make new connections. It provides its users with the ability to create a profile, update information, add images, send friend requests, and accept requests from other users. Its features include status update, photo tagging and sharing, and more. Facebook’s profile structure includes …
    • Location Menlo Park, CA
    • Categories Social Media, Social Network, Social
    • Website http://www.facebook.com
    • Full profile for Facebook

Newsletter Subscriptions

SEE ALL NEWSLETTERS »

Latest Crunch Report

  • High Times Sells 60% of Company | Crunch Report

    High Times Sells 60% of Company | Crunch Report

Watch More Episodes
  • Snapchat Clone
  • Facebook Camera Effects Platform
  • Facebook
  • F82017
  • Apps
  • Popular Posts

Featured Stories

  • Facebook launches augmented reality Camera Effects developer platform

    Judah vs emotion identifying robot

    VIDEO | 6:13 | Judah vs the Machines
  • Meal ingredient delivery service Blue Apron is the next big consumer IPO

    Meal ingredient delivery service Blue Apron is the next big consumer IPO

    6 hours ago | Matthew Lynley
  • Venture investors blast US decision to withdraw from Paris Climate Accord

    Venture investors blast US decision to withdraw from Paris Climate Accord

    7 hours ago | Jonathan Shieber
  • Elon Musk leaving Trump advisory councils following Paris agreement withdrawal

    Elon Musk leaving Trump advisory councils following Paris agreement withdrawal

    7 hours ago | Darrell Etherington
  • Announcing the agenda for TechCrunch Sessions: Robotics

    Announcing the agenda for TechCrunch Sessions: Robotics

    14 hours ago | Matt Burns, Ned Desmond

Latest From Social

  • Instagram celebrates Pride Month with a very rainbowy sticker set

    Instagram celebrates Pride Month with a very rainbowy sticker set

    7 hours ago | Taylor Hatmaker
  • Twitter’s COO explains why charging all users doesn’t make sense

    Twitter’s COO explains why charging all users doesn’t make sense

    10 hours ago | Josh Constine
  • Facebook lets you add any post to albums, not just photos

    Facebook lets you add any post to albums, not just photos

    11 hours ago | Josh Constine
  • Social media giants making progress on illegal hate speech takedowns: EC

    Social media giants making progress on illegal hate speech takedowns: EC

    13 hours ago | Natasha Lomas
Comment moderation powered by BrandBastion
Up Next

Theranos starts to agree to things

Posted Apr 18, 2017

CrunchBoard

Job Listings

  • Lead Data Analyst at Unbound (New York City, NY, United States)

  • Editor­-in­-Chief at Unbound (New York City, NY, United States)

  • Director of Growth at Unbound (New York City, NY, United States)

  • Enterprise Sales Executive at Resolute Innovation (New York, NY, United States)

  • Solution Architect [Fully Remote Role] at iMerit Technology (San Francisco, CA, United States)

More from CrunchBoard
Advertisement

TechCrunch

  • News
  • Video
  • Events
  • Crunchbase
  • TechCrunch Store

About

  • Staff
  • Contact Us
  • Advertise With Us
  • Event & Editorial Calendar
  • Send Us A Tip
  • Activations Blog

International

  • China
  • Europe
  • Japan

Follow TechCrunch

  • Facebook
  • Twitter
  • Google+
  • LinkedIn
  • Youtube
  • Pinterest
  • Tumblr
  • Instagram
  • StumbleUpon
  • Feed

TechCrunch Apps

  • iOS
  • Android
  • Windows 8

Subscribe to The Daily Crunch

Latest headlines delivered to you daily

Subscribe to <span class="no-mobile">Subscribe to </span>The Daily Crunch
© 2013-2017 AOL Inc. All rights reserved. Aol Tech Privacy Policy About Our Ads Anti Harassment Policy Terms of Service
Powered by WordPress.com VIP
Fonts by <Webtype>
  • TechCrunch
    • News
      • Startups
      • Mobile
      • Gadgets
      • Enterprise
      • Social
      • Europe
      • Asia
      • Crunch Network
      • Unicorn Leaderboard
      • Gift Guides
      • All Galleries
      • All Timelines
    • Videos
      • Apps
      • Bullish
      • Crunch Report
      • Disrupt NY 2017
      • Judah vs the Machines
      • All Shows
      • All Videos
    • Events
      • Disrupt
      • Startup Battlefield
      • Crunchies
      • Meetups
      • International City Events
      • Hackathon
      • Sessions
      • Include
      • TechCrunch Store
      • All Events
  • Crunchbase
Message Us
Most Popular
Crunch Report | High Times Sells 60% of Company
1 hour ago by Khaled "Tito" Hamze
Tim Cook says he tried to persuade Trump not to leave the Paris agreement “but it wasn’t enough”
2 hours ago by Greg Kumparak
OneLogin admits recent breach is pretty dang serious
3 hours ago by Devin Coldewey
US approves social media background checks for visa applicants
4 hours ago by Jonathan Shieber
The DJI Spark is fun, but not the mainstream drone we were promised
4 hours ago by Brian Heater
Bumble is opening a physical space in New York for dates to meet up
5 hours ago by Fitz Tepper
The meeting that showed me the truth about VCs
6 hours ago by Tomer Dean
Voiceitt lets people with speech impairments use voice-controlled technology
6 hours ago by Lora Kolodny
Draper’s DragonflEye cyber-bug takes flight
6 hours ago by Devin Coldewey
Watch SpaceX launch its first reused Dragon capsule to resupply the ISS
6 hours ago by Darrell Etherington