Skip to main content

Technical Specification

This page provides technical metrics of Face AR SDK feature performance. The values below are for your reference only. We received them on fixed conditions. However, many factors may influence the actual technology performance, e.g. the state of device, other apps running, wi-fi enabled, room temperature, etc. We encourage you to test each feature within your environment.

Please visit SDK Features and SDK Features for Unity for the information regarding features support on different platforms.

note
  • FPS β€” Frames per second of the face detection algorithm on a given device.
  • Angles β€” Maximum angle on which the technology was able to work during the measurement.
  • Distance β€” Maximum distance on which the technology was able to work during the measurement.
  • Real-time (online) β€” Technology performance in real-time.
  • Photo (offline) β€” The processing time needed to take a photo or process it from the gallery.

SDK Features#

Face Detection#

Android

Android Mid
Samsung Galaxy S7
Android Top
Pixel 3 XL
FPS3030
Angles, degree7070
Distance, cm120120

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
FPS3060
Angles, degree7070
Distance, cm120120

Single-face Tracking#

Android

Android Mid
Samsung Galaxy S7
Android Top
Pixel 3 XL
FPS3030
Angles, degree7070
Distance, cm180200

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
FPS3060
Angles, degree7070
Distance, cm180200

Multi-face Tracking#

Android

Android Mid
Samsung Galaxy S7
Android Top
Pixel 3 XL
Faces Number33
2 Faces, FPS2030
3 Faces, FPS2030

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
Faces Number33
2 Faces, FPS3060
3 Faces, FPS3060

Faces Number* β€” Maximum number of faces which SDK can track with acceptable quality and performance on most mobile devices. The actual number allowed for multi-face tracking is not limited by the technology but only by the physical ability of the device and proportions of the screen.

Effect performance#

Banuba SDK allows for a variety of Face AR effects. Some of them require only face tracking and can be represented as a single 3D mask with textures and materials. Other effects are implemented with separately trained neural networks.

Below, you may find information on the real-time performance of Face AR effects which require only face tracking, i.e. face filters, avatars with action units, beautification, and makeup filter (without lipstick).

Android

Android Mid
Samsung Galaxy S7
Android Top
Pixel 3 XL
FPS3030

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
FPS3060

Beautification#

Beautification filter#

Basic face beautification filter includes skin smoothing, morphing, teeth whitening, eyes flare and LUT. It requires only face tracking, so please, refer to the Effects performance section. Other features given below are based on neural networks, and their performance differs.

Acne removal (manual)#

iOS only, neural network, photo processing (offline only)

iOS Mid
iPhone 7
iOS Top
iPhone 11
Photo, sec1< 1

Acne removal (auto)#

iOS only, neural network, photo processing (offline only)

iOS Mid
iPhone 7
iOS Top
iPhone 11
Photo, sec< 2< 1

Eye bag removal#

iOS only, neural network, photo processing (offline only)

iOS Mid
iPhone 7
iOS Top
iPhone 11
Photo, sec< 2< 1

Skin smoothing#

iOS only, neural network, photo processing (offline only)

iOS Top
iPhone 11
Photo, sec< 1

Neck beautification#

iOS only, neural network, photo processing (offline only)

iOS Mid
iPhone 7
iOS Top
iPhone 11
Photo, sec1< 1

Makeup#

The Makeup filter allows for a realistic try on of foundation, eyeshadow, eyeliner, highlighter, contour, and blusher. It requires only face tracking, so please, refer to the Effects performance section. The lipstick try on requires lips segmentation neural network with a separate algorithm for Lips Shine effect.

Lips coloring#

Android

Android Mid
Huawei P30 Lite
Android Top
Samsung Galaxy S10+
Real-time, FPS2330
Photo, sec< 3< 2

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
Real-time,FPS3080
Photo, sec< 1< 1

Lips Shine (Glossy lipstick)#

Android

Android Mid
Huawei P30 Lite
Android Top
Samsung Galaxy S10+
Real-time, FPS1115
Photo, sec32

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
Real-time, FPS3060
Photo, sec< 1< 1

Background separation#

Android

Android Mid
Samsung Galaxy S7
Android Top
Pixel 3 XL
Real-time,FPS2030
Photo, sec< 3< 3

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
Real-time, FPS3060
Photo, sec< 1< 1

Distance#

DeviceDistance, cm
iPhone XRPortrait 160 cm,
Landscape 195 cm
iPhone 8 PlusPortrait 175 cm,
Landscape 180 cm
Huawei Mate 20 ProPortrait 175 cm,
Landscape 225 cm
MacBook Pro (13", 2017)180 cm

Video formats support#

Used as part of animated background.

Video formatMacOSiOSAndroidWindows
.mp4βœ…βœ…βœ…βœ…
.aviβœ…βŒβœ…βœ…
.flvβœ…βŒβŒβœ…
.mkvβœ…βŒβœ…βœ…
.movβœ…βœ…βœ…βœ…
.mtsβœ…βŒβŒβœ…
.webmβœ…βŒβœ…βœ…
.wmvβœ…βŒβœ…βœ…

Hair segmentation#

Hair Recoloring#

Android

Android Mid
Samsung Galaxy S7
Android Top
Pixel 3 XL
Real-time,FPS2030
Photo, sec< 3< 2

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
Real-time,FPS3060
Photo, sec< 1< 1

Hair Strands Recoloring#

iOS only, works for photo processing (offline only)

iOS Mid
iPhone 7
iOS Top
iPhone 11
Photo, sec< 2< 1

Skin segmentation#

Android

Android Mid
Samsung Galaxy S7
Android Top
Pixel 3 XL
Real-time,FPS2030
Photo, sec< 3< 2

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
Real-time,FPS3060
Photo, sec< 1< 1

Eyes recoloring#

Android

Android Mid
Samsung Galaxy S7
Android Top
Pixel 3 XL
Real-time,FPS2030
Photo, sec< 3< 3

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
Real-time,FPS3060
Photo, sec< 1< 1

Hand gestures#

Basic information

  • Supported gestures:
    • Palm βœ‹
    • Victory✌️
    • Rock 🀘
    • Like πŸ‘
    • Ok πŸ‘Œ
  • Maximum distance β€” 1.1m

iOS

DeviceRealtime FPS*
iPhone 1154
iPhone 741
iphone 6s25

* Means technology FPS. In real usage, FPS is usually limited with the render value and locked by 30 or 60 FPS.

Android

DeviceRealtime FPS*
top-end Huawei30
middle-end Xiaomi25

* Means technology FPS. In real usage, FPS is usually limited with the render value and locked by 30 or 60 FPS.

Last updated on