- Face Tracking
- 24th March 2020
- Woohoo Pay
- UI/Ux, Design
How Our Face Tracking Differs
Most face tracking solutions need significant computing power. They impose limitations to Face AR experiences, especially on mobile devices with limited CPU. To solve that, we trained the technology to “see” the face in 3D.
Live face tracking in 3D
Unlike face landmark SDKs, our facial tracking technology builds on the 3D math model. It tracks the face by identifying 37 characteristics represented as face morphs. They include different facial expressions, anthropometry and face position in the video frame. It allows us to accurately track the face in the camera and optimize our face detection software for mobile platforms.
We optimize our technology for mobile devices. It functions well on iPhone-Xs and $100-Androids, at low lighting, and with up to 70% occlusion. Our device support starts with iPhone 5S, Android 5.0 with Camera 2 API and OpenGL ES 3.0. It covers 97% of all iOS devices and 80% of all Android ones.
Made for Face AR
Our Face Tracking SDK precisely detects and tracks several faces in a video stream in real-time. We develop it for Face AR, enabling you to create the most realistic and feature-rich facial animation. You can overlay 3D objects on the face, ad AR lens or turn faces into live avatars and emojis.
- Multi-face tracking
- Distance up to 7 meters
- High performance (min 25-30 fps on early devices)
- Extreme angles, ranging from –90 to +90
- Operates in poor lighting
- Supports up to 70% face occlusion
- Stable detection with glasses and complex haircuts
- A 3D model of a face with up to 3,308 vertices
- Supports 360 degrees rotation of the camera