Facebook on Wednesday acquired face recognition technology provider FacioMetrics in a move to beef up its photo and video capabilities. Financial terms of the deal were not disclosed.
A spin-off from Carnegie Mellon University in 2015 as a response to market demand surrounding use of facial image analysis, FacioMetrics is the producer of developer tools for understanding facial behavior and demographic from videos, detection, and even letting you swap faces. It appears that all of its apps have been removed from both the App Store and Google Play store.
Companies that used FacioMetrics’ technology include those in the academic and industry world, such as Lightricks, Anki, Meograph, University of Kentucky, Carnegie Mellon University, Massachusetts Institute of Technology (MIT), and a “leading social networking company” — perhaps Facebook?
“How people share and communicate is changing and things like masks and other effects allow people to express themselves in fun and creative ways,” remarked a Facebook spokesperson in a statement. “We’re excited to welcome the Faciometrics team who will help bring more fun effects to photos and videos and build even more engaging sharing experiences on Facebook.”
The purchase of FacioMetrics comes weeks after Facebook demonstrated Prisma-like filters for its live video product. At this year’s WSJD Live conference, chief product officer Chris Cox showcased a new app which would let you transfer the style of an artist, such as Rembrandt onto your image using Convolutional Neural Network and computer vision. It also isn’t the social networking company’s first foray into the image recognition space.
Cox explained that real-time implementation was the hardest challenge the company faced, as the program functions at 24 frames per second. “It’s taking something that’s a known technology, but it was getting it to be fast on a phone and to be able to be done at a low-enough latency, without dropping frames, stuttering, or…blurring.” The app is still in its prototyping phase, but there’s certainly an advantage to get these augmented reality filters up and running sooner than later.
The battle for influencers and content creators around live video is heating up and while giving people the ability to livestream is one thing, empowering them to own the experience is another. And it’s here where FacioMetrics could play an important role.
Certainly this is impactful for Facebook and will pair well with technology gleaned through its Face.com purchase in 2012. Although primarily focused on photos and videos on the social network, there’s obvious implications, should the company leverage the technology around Oculus. FacioMetrics’ technology could assist developers in developing more realistic-like experiences so avatars appear and respond more like the user.
Here’s FacioMetrics’ announcement of the acquisition by its chief executive Fernando De La Torre:
We started FacioMetrics to respond to the increasing interest and demand for facial image analysis – with all kinds of applications including augmented/virtual reality, animation, audience reaction measurement, and others. We began our research at Carnegie Mellon University developing state-of-the-art computer vision and machine learning algorithms for facial image analysis. Over time, we have successfully developed and integrated this cutting-edge technology into battery-friendly and efficient mobile applications, and also created new applications of this technology.
Now, we’re taking a big step forward by joining the team at Facebook, where we’ll be able to advance our work at an incredible scale, reaching people from across the globe. We are thrilled for our next big step forward by joining Facebook. We’d like to thank Carnegie Mellon University and our clients for their trust and support – we couldn’t have made it this far without them.
We are looking forward to getting started at Facebook!