Technical Specification
This page provides technical metrics of Face AR SDK feature performance. The values below are for your reference only. We received them on fixed conditions. However, many factors may influence the actual technology performance, e.g. the state of device, other apps running, wi-fi enabled, room temperature, etc. We encourage you to test each feature within your environment.
Please visit SDK Features and SDK Features for Unity for the information regarding features support on different platforms.
note
- FPS β Frames per second of the face detection algorithm on a given device.
- Angles β Maximum angle on which the technology was able to work during the measurement.
- Distance β Maximum distance on which the technology was able to work during the measurement.
- Real-time (online) β Technology performance in real-time.
- Photo (offline) β The processing time needed to take a photo or process it from the gallery.
#
SDK Features#
Face DetectionAndroid
Android Mid Samsung Galaxy S7 | Android Top Pixel 3 XL | |
---|---|---|
FPS | 30 | 30 |
Angles, degree | 70 | 70 |
Distance, cm | 120 | 120 |
iOS
iOS Mid iPhone 7 | iOS Top iPhone 11 | |
---|---|---|
FPS | 30 | 60 |
Angles, degree | 70 | 70 |
Distance, cm | 120 | 120 |
#
Single-face TrackingAndroid
Android Mid Samsung Galaxy S7 | Android Top Pixel 3 XL | |
---|---|---|
FPS | 30 | 30 |
Angles, degree | 70 | 70 |
Distance, cm | 180 | 200 |
iOS
iOS Mid iPhone 7 | iOS Top iPhone 11 | |
---|---|---|
FPS | 30 | 60 |
Angles, degree | 70 | 70 |
Distance, cm | 180 | 200 |
#
Multi-face TrackingAndroid
Android Mid Samsung Galaxy S7 | Android Top Pixel 3 XL | |
---|---|---|
Faces Number | 3 | 3 |
2 Faces, FPS | 20 | 30 |
3 Faces, FPS | 20 | 30 |
iOS
iOS Mid iPhone 7 | iOS Top iPhone 11 | |
---|---|---|
Faces Number | 3 | 3 |
2 Faces, FPS | 30 | 60 |
3 Faces, FPS | 30 | 60 |
Faces Number* β Maximum number of faces which SDK can track with acceptable quality and performance on most mobile devices. The actual number allowed for multi-face tracking is not limited by the technology but only by the physical ability of the device and proportions of the screen.
#
Effect performanceBanuba SDK allows for a variety of Face AR effects. Some of them require only face tracking and can be represented as a single 3D mask with textures and materials. Other effects are implemented with separately trained neural networks.
Below, you may find information on the real-time performance of Face AR effects which require only face tracking, i.e. face filters, avatars with action units, beautification, and makeup filter (without lipstick).
Android
Android Mid Samsung Galaxy S7 | Android Top Pixel 3 XL | |
---|---|---|
FPS | 30 | 30 |
iOS
iOS Mid iPhone 7 | iOS Top iPhone 11 | |
---|---|---|
FPS | 30 | 60 |
#
Beautification#
Beautification filterBasic face beautification filter includes skin smoothing, morphing, teeth whitening, eyes flare and LUT. It requires only face tracking, so please, refer to the Effects performance section. Other features given below are based on neural networks, and their performance differs.
#
Acne removal (manual)iOS only, neural network, photo processing (offline only)
iOS Mid iPhone 7 | iOS Top iPhone 11 | |
---|---|---|
Photo, sec | 1 | < 1 |
#
Acne removal (auto)iOS only, neural network, photo processing (offline only)
iOS Mid iPhone 7 | iOS Top iPhone 11 | |
---|---|---|
Photo, sec | < 2 | < 1 |
#
Eye bag removaliOS only, neural network, photo processing (offline only)
iOS Mid iPhone 7 | iOS Top iPhone 11 | |
---|---|---|
Photo, sec | < 2 | < 1 |
#
Skin smoothingiOS only, neural network, photo processing (offline only)
iOS Top iPhone 11 | |
---|---|
Photo, sec | < 1 |
#
Neck beautificationiOS only, neural network, photo processing (offline only)
iOS Mid iPhone 7 | iOS Top iPhone 11 | |
---|---|---|
Photo, sec | 1 | < 1 |
#
MakeupThe Makeup filter allows for a realistic try on of foundation, eyeshadow, eyeliner, highlighter, contour, and blusher. It requires only face tracking, so please, refer to the Effects performance section. The lipstick try on requires lips segmentation neural network with a separate algorithm for Lips Shine effect.
#
Lips coloringAndroid
Android Mid Huawei P30 Lite | Android Top Samsung Galaxy S10+ | |
---|---|---|
Real-time, FPS | 23 | 30 |
Photo, sec | < 3 | < 2 |
iOS
iOS Mid iPhone 7 | iOS Top iPhone 11 | |
---|---|---|
Real-time,FPS | 30 | 80 |
Photo, sec | < 1 | < 1 |
#
Lips Shine (Glossy lipstick)Android
Android Mid Huawei P30 Lite | Android Top Samsung Galaxy S10+ | |
---|---|---|
Real-time, FPS | 11 | 15 |
Photo, sec | 3 | 2 |
iOS
iOS Mid iPhone 7 | iOS Top iPhone 11 | |
---|---|---|
Real-time, FPS | 30 | 60 |
Photo, sec | < 1 | < 1 |
#
Background separationAndroid
Android Mid Samsung Galaxy S7 | Android Top Pixel 3 XL | |
---|---|---|
Real-time,FPS | 20 | 30 |
Photo, sec | < 3 | < 3 |
iOS
iOS Mid iPhone 7 | iOS Top iPhone 11 | |
---|---|---|
Real-time, FPS | 30 | 60 |
Photo, sec | < 1 | < 1 |
#
DistanceDevice | Distance, cm |
---|---|
iPhone XR | Portrait 160 cm, Landscape 195 cm |
iPhone 8 Plus | Portrait 175 cm, Landscape 180 cm |
Huawei Mate 20 Pro | Portrait 175 cm, Landscape 225 cm |
MacBook Pro (13", 2017) | 180 cm |
#
Video formats supportUsed as part of animated background.
Video format | MacOS | iOS | Android | Windows |
---|---|---|---|---|
.mp4 | β | β | β | β |
.avi | β | β | β | β |
.flv | β | β | β | β |
.mkv | β | β | β | β |
.mov | β | β | β | β |
.mts | β | β | β | β |
.webm | β | β | β | β |
.wmv | β | β | β | β |
#
Hair segmentation#
Hair RecoloringAndroid
Android Mid Samsung Galaxy S7 | Android Top Pixel 3 XL | |
---|---|---|
Real-time,FPS | 20 | 30 |
Photo, sec | < 3 | < 2 |
iOS
iOS Mid iPhone 7 | iOS Top iPhone 11 | |
---|---|---|
Real-time,FPS | 30 | 60 |
Photo, sec | < 1 | < 1 |
#
Hair Strands RecoloringiOS only, works for photo processing (offline only)
iOS Mid iPhone 7 | iOS Top iPhone 11 | |
---|---|---|
Photo, sec | < 2 | < 1 |
#
Skin segmentationAndroid
Android Mid Samsung Galaxy S7 | Android Top Pixel 3 XL | |
---|---|---|
Real-time,FPS | 20 | 30 |
Photo, sec | < 3 | < 2 |
iOS
iOS Mid iPhone 7 | iOS Top iPhone 11 | |
---|---|---|
Real-time,FPS | 30 | 60 |
Photo, sec | < 1 | < 1 |
#
Eyes recoloringAndroid
Android Mid Samsung Galaxy S7 | Android Top Pixel 3 XL | |
---|---|---|
Real-time,FPS | 20 | 30 |
Photo, sec | < 3 | < 3 |
iOS
iOS Mid iPhone 7 | iOS Top iPhone 11 | |
---|---|---|
Real-time,FPS | 30 | 60 |
Photo, sec | < 1 | < 1 |
#
Hand gesturesBasic information
- Supported gestures:
- Palm β
- VictoryβοΈ
- Rock π€
- Like π
- Ok π
- Maximum distance β 1.1m
iOS
Device | Realtime FPS* |
---|---|
iPhone 11 | 54 |
iPhone 7 | 41 |
iphone 6s | 25 |
* Means technology FPS. In real usage, FPS is usually limited with the render value and locked by 30 or 60 FPS.
Android
Device | Realtime FPS* |
---|---|
top-end Huawei | 30 |
middle-end Xiaomi | 25 |
* Means technology FPS. In real usage, FPS is usually limited with the render value and locked by 30 or 60 FPS.