Technical Specification
This page provides technical metrics of Face AR SDK feature performance. The values below are for your reference only. We received them on fixed conditions. However, many factors may influence the actual technology performance, e.g. the state of device, other apps running, wi-fi enabled, room temperature, etc. We encourage you to test each feature within your environment.
Please visit SDK Features and SDK Features for Unity for the information regarding features support on different platforms.
- FPS — Frames per second of the face detection algorithm on a given device.
- Angles — Maximum angle on which the technology was able to work during the measurement.
- Distance — Maximum distance on which the technology was able to work during the measurement.
- Real-time (online) — Technology performance in real-time.
- Photo (offline) — The processing time needed to take a photo or process it from the gallery.
SDK Features
Face Detection
Android
| Android Mid Samsung Galaxy S7 | Android Top Pixel 3 XL | |
|---|---|---|
| FPS | 30 | 30 |
| Angles, degree | 70 | 70 |
| Distance, cm | 120 | 120 |
iOS
| iOS Mid iPhone 7 | iOS Top iPhone 11 | |
|---|---|---|
| FPS | 30 | 60 |
| Angles, degree | 70 | 70 |
| Distance, cm | 120 | 120 |
Single-face Tracking
Android
| Android Mid Samsung Galaxy S7 | Android Top Pixel 3 XL | |
|---|---|---|
| FPS | 30 | 30 |
| Angles, degree | 70 | 70 |
| Distance, cm | 180 | 200 |
iOS
| iOS Mid iPhone 7 | iOS Top iPhone 11 | |
|---|---|---|
| FPS | 30 | 60 |
| Angles, degree | 70 | 70 |
| Distance, cm | 180 | 200 |
Multi-face Tracking
Android
| Android Mid Samsung Galaxy S7 | Android Top Pixel 3 XL | |
|---|---|---|
| Faces Number | 3 | 3 |
| 2 Faces, FPS | 20 | 30 |
| 3 Faces, FPS | 20 | 30 |
iOS
| iOS Mid iPhone 7 | iOS Top iPhone 11 | |
|---|---|---|
| Faces Number | 3 | 3 |
| 2 Faces, FPS | 30 | 60 |
| 3 Faces, FPS | 30 | 60 |
Faces Number* — Maximum number of faces which SDK can track with acceptable quality and performance on most mobile devices. The actual number allowed for multi-face tracking is not limited by the technology but only by the physical ability of the device and proportions of the screen.
Effect performance
Banuba SDK allows for a variety of Face AR effects. Some of them require only face tracking and can be represented as a single 3D mask with textures and materials. Other effects are implemented with separately trained neural networks.
Below, you may find information on the real-time performance of Face AR effects which require only face tracking, i.e. face filters, avatars with action units, beautification, and makeup filter (without lipstick).
Android
| Android Mid Samsung Galaxy S7 | Android Top Pixel 3 XL | |
|---|---|---|
| FPS | 30 | 30 |
iOS
| iOS Mid iPhone 7 | iOS Top iPhone 11 | |
|---|---|---|
| FPS | 30 | 60 |
Beautification
Beautification filter
Basic face beautification filter includes skin smoothing, morphing, teeth whitening, eyes flare and LUT. It requires only face tracking, so please, refer to the Effects performance section. Other features given below are based on neural networks, and their performance differs.
Acne removal (manual)
iOS only, neural network, photo processing (offline only)
| iOS Mid iPhone 7 | iOS Top iPhone 11 | |
|---|---|---|
| Photo, sec | 1 | < 1 |
Acne removal (auto)
iOS only, neural network, photo processing (offline only)
| iOS Mid iPhone 7 | iOS Top iPhone 11 | |
|---|---|---|
| Photo, sec | < 2 | < 1 |
Eye bag removal
iOS only, neural network, photo processing (offline only)
| iOS Mid iPhone 7 | iOS Top iPhone 11 | |
|---|---|---|
| Photo, sec | < 2 | < 1 |
Skin smoothing
iOS only, neural network, photo processing (offline only)
| iOS Top iPhone 11 | |
|---|---|
| Photo, sec | < 1 |
Neck beautification
iOS only, neural network, photo processing (offline only)
| iOS Mid iPhone 7 | iOS Top iPhone 11 | |
|---|---|---|
| Photo, sec | 1 | < 1 |
Makeup
The Makeup filter allows for a realistic try on of foundation, eyeshadow, eyeliner, highlighter, contour, and blusher. It requires only face tracking, so please, refer to the Effects performance section. The lipstick try on requires lips segmentation neural network with a separate algorithm for Lips Shine effect.
Lips coloring
Android
| Android Mid Huawei P30 Lite | Android Top Samsung Galaxy S10+ | |
|---|---|---|
| Real-time, FPS | 23 | 30 |
| Photo, sec | < 3 | < 2 |
iOS
| iOS Mid iPhone 7 | iOS Top iPhone 11 | |
|---|---|---|
| Real-time, FPS | 30 | 80 |
| Photo, sec | < 1 | < 1 |
Web
| Real-time, FPS | |
|---|---|
| Chrome | 30 |
| Safari | 12 |
Lips Shine (Glossy lipstick)
Android
| Android Mid Huawei P30 Lite | Android Top Samsung Galaxy S10+ | |
|---|---|---|
| Real-time, FPS | 18 | 30 |
| Photo, sec | 3 | 2 |
iOS
| iOS Mid iPhone 7 | iOS Top iPhone 11 | |
|---|---|---|
| Real-time, FPS | 30 | 60 |
| Photo, sec | < 1 | < 1 |
Web
| Real-time, FPS | |
|---|---|
| Chrome | 18 |
| Safari | 12 |
Background separation
Android
| Android Mid Samsung Galaxy S7 | Android Top Pixel 3 XL | |
|---|---|---|
| Real-time,FPS | 20 | 30 |
| Photo, sec | < 3 | < 3 |
iOS
| iOS Mid iPhone 7 | iOS Top iPhone 11 | |
|---|---|---|
| Real-time, FPS | 30 | 60 |
| Photo, sec | < 1 | < 1 |
Distance
| Device | Distance, cm |
|---|---|
| iPhone XR | Portrait 160 cm, Landscape 195 cm |
| iPhone 8 Plus | Portrait 175 cm, Landscape 180 cm |
| Huawei Mate 20 Pro | Portrait 175 cm, Landscape 225 cm |
| MacBook Pro (13", 2017) | 180 cm |
Image formats support
Currently, the following images formats are supported as background texture:
.jpeg.jpg.png.ktx.gif
Video formats support
Used as part of animated background.
| Video format | MacOS | iOS | Android* | Windows |
|---|---|---|---|---|
| .mp4 | ✅ | ✅ | ✅ | ✅ |
| .avi | ✅ | ❌ | ❌ | ✅ |
| .flv | ✅ | ❌ | ❌ | ✅ |
| .mkv | ✅ | ❌ | ✅ | ✅ |
| .mov | ✅ | ✅ | ❌ | ✅ |
| .mts | ✅ | ❌ | ❌ | ✅ |
| .webm | ✅ | ❌ | ✅ | ✅ |
| .wmv | ✅ | ❌ | ❌ | ✅ |
* See more information about supported video formats on Android in the official Android developers guide — https://developer.android.com/guide/topics/media/media-formats#video-codecs.
Hair segmentation
Hair Recoloring
Android
| Android Mid Samsung Galaxy S7 | Android Top Pixel 3 XL | |
|---|---|---|
| Real-time,FPS | 20 | 30 |
| Photo, sec | < 3 | < 2 |
iOS
| iOS Mid iPhone 7 | iOS Top iPhone 11 | |
|---|---|---|
| Real-time,FPS | 30 | 60 |
| Photo, sec | < 1 | < 1 |
Hair Strands Recoloring
iOS only, works for photo processing (offline only)
| iOS Mid iPhone 7 | iOS Top iPhone 11 | |
|---|---|---|
| Photo, sec | < 2 | < 1 |
Skin segmentation
Android
| Android Mid Samsung Galaxy S7 | Android Top Pixel 3 XL | |
|---|---|---|
| Real-time,FPS | 20 | 30 |
| Photo, sec | < 3 | < 2 |
iOS
| iOS Mid iPhone 7 | iOS Top iPhone 11 | |
|---|---|---|
| Real-time,FPS | 30 | 60 |
| Photo, sec | < 1 | < 1 |
Eyes recoloring
Android
| Android Mid Samsung Galaxy S7 | Android Top Pixel 3 XL | |
|---|---|---|
| Real-time,FPS | 20 | 30 |
| Photo, sec | < 3 | < 3 |
iOS
| iOS Mid iPhone 7 | iOS Top iPhone 11 | |
|---|---|---|
| Real-time,FPS | 30 | 60 |
| Photo, sec | < 1 | < 1 |
Hand gestures
Basic information
- Supported gestures:
- Palm ✋
- Victory✌️
- Rock 🤘
- Like 👍
- Ok 👌
- Maximum distance — 1.1m
iOS
| Device | Realtime FPS* |
|---|---|
| iPhone 11 | 54 |
| iPhone 7 | 41 |
| iphone 6s | 25 |
* Means technology FPS. In real usage, FPS is usually limited with the render value and locked by 30 or 60 FPS.
Android
| Device | Realtime FPS* |
|---|---|
| top-end Huawei | 30 |
| middle-end Xiaomi | 25 |
* Means technology FPS. In real usage, FPS is usually limited with the render value and locked by 30 or 60 FPS.
Full Body segmentation
iOS
| iPhone 7 | iPhone 11 | |
|---|---|---|
| Real-time, FPS* | 30 | 60 |
| Photo, sec | < 1 | < 1 |
| Activation time, sec | ~2 | ~1 |
| Memory usage, mb | 135 | 170 |
* Means technology FPS. In real usage, FPS is usually limited with the render value and locked by 30 or 60 FPS.