Skip to main content

Technical Specification

This page provides technical metrics of Face AR SDK feature performance. The values below are for your reference only. We received them on fixed conditions. However, many factors may influence the actual technology performance, e.g. the state of device, other apps running, wi-fi enabled, room temperature, etc. We encourage you to test each feature within your environment.

Please visit SDK Features and SDK Features for Unity for the information regarding features support on different platforms.

note
  • FPS — Frames per second of the face detection algorithm on a given device.
  • Angles — Maximum angle on which the technology was able to work during the measurement.
  • Distance — Maximum distance on which the technology was able to work during the measurement.
  • Real-time (online) — Technology performance in real-time.
  • Photo (offline) — The processing time needed to take a photo or process it from the gallery.

SDK Features

Face Detection

Android

Android Mid
Samsung Galaxy S7
Android Top
Pixel 3 XL
FPS3030
Angles, degree7070
Distance, cm120120

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
FPS3060
Angles, degree7070
Distance, cm120120

Single-face Tracking

Android

Android Mid
Samsung Galaxy S7
Android Top
Pixel 3 XL
FPS3030
Angles, degree7070
Distance, cm180200

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
FPS3060
Angles, degree7070
Distance, cm180200

Multi-face Tracking

Android

Android Mid
Samsung Galaxy S7
Android Top
Pixel 3 XL
Faces Number33
2 Faces, FPS2030
3 Faces, FPS2030

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
Faces Number33
2 Faces, FPS3060
3 Faces, FPS3060

Faces Number* — Maximum number of faces which SDK can track with acceptable quality and performance on most mobile devices. The actual number allowed for multi-face tracking is not limited by the technology but only by the physical ability of the device and proportions of the screen.

Effect performance

Banuba SDK allows for a variety of Face AR effects. Some of them require only face tracking and can be represented as a single 3D mask with textures and materials. Other effects are implemented with separately trained neural networks.

Below, you may find information on the real-time performance of Face AR effects which require only face tracking, i.e. face filters, avatars with action units, beautification, and makeup filter (without lipstick).

Android

Android Mid
Samsung Galaxy S7
Android Top
Pixel 3 XL
FPS3030

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
FPS3060

Beautification

Beautification filter

Basic face beautification filter includes skin smoothing, morphing, teeth whitening, eyes flare and LUT. It requires only face tracking, so please, refer to the Effects performance section. Other features given below are based on neural networks, and their performance differs.

Acne removal (manual)

iOS only, neural network, photo processing (offline only)

iOS Mid
iPhone 7
iOS Top
iPhone 11
Photo, sec1< 1

Acne removal (auto)

iOS only, neural network, photo processing (offline only)

iOS Mid
iPhone 7
iOS Top
iPhone 11
Photo, sec< 2< 1

Eye bag removal

iOS only, neural network, photo processing (offline only)

iOS Mid
iPhone 7
iOS Top
iPhone 11
Photo, sec< 2< 1

Skin smoothing

iOS only, neural network, photo processing (offline only)

iOS Top
iPhone 11
Photo, sec< 1

Neck beautification

iOS only, neural network, photo processing (offline only)

iOS Mid
iPhone 7
iOS Top
iPhone 11
Photo, sec1< 1

Makeup

The Makeup filter allows for a realistic try on of foundation, eyeshadow, eyeliner, highlighter, contour, and blusher. It requires only face tracking, so please, refer to the Effects performance section. The lipstick try on requires lips segmentation neural network with a separate algorithm for Lips Shine effect.

Lips coloring

Android

Android Mid
Huawei P30 Lite
Android Top
Samsung Galaxy S10+
Real-time, FPS2330
Photo, sec< 3< 2

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
Real-time, FPS3080
Photo, sec< 1< 1

Web

Real-time, FPS
Chrome30
Safari12

Lips Shine (Glossy lipstick)

Android

Android Mid
Huawei P30 Lite
Android Top
Samsung Galaxy S10+
Real-time, FPS1830
Photo, sec32

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
Real-time, FPS3060
Photo, sec< 1< 1

Web

Real-time, FPS
Chrome18
Safari12

Background separation

Android

Android Mid
Samsung Galaxy S7
Android Top
Pixel 3 XL
Real-time,FPS2030
Photo, sec< 3< 3

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
Real-time, FPS3060
Photo, sec< 1< 1

Distance

DeviceDistance, cm
iPhone XRPortrait 160 cm,
Landscape 195 cm
iPhone 8 PlusPortrait 175 cm,
Landscape 180 cm
Huawei Mate 20 ProPortrait 175 cm,
Landscape 225 cm
MacBook Pro (13", 2017)180 cm

Image formats support

Currently, the following images formats are supported as background texture:

  • .jpeg
  • .jpg
  • .png
  • .ktx
  • .gif

Video formats support

Used as part of animated background.

Video formatMacOSiOSAndroid*Windows
.mp4
.avi
.flv
.mkv
.mov
.mts
.webm
.wmv

* See more information about supported video formats on Android in the official Android developers guide — https://developer.android.com/guide/topics/media/media-formats#video-codecs.

Hair segmentation

Hair Recoloring

Android

Android Mid
Samsung Galaxy S7
Android Top
Pixel 3 XL
Real-time,FPS2030
Photo, sec< 3< 2

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
Real-time,FPS3060
Photo, sec< 1< 1

Hair Strands Recoloring

iOS only, works for photo processing (offline only)

iOS Mid
iPhone 7
iOS Top
iPhone 11
Photo, sec< 2< 1

Skin segmentation

Android

Android Mid
Samsung Galaxy S7
Android Top
Pixel 3 XL
Real-time,FPS2030
Photo, sec< 3< 2

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
Real-time,FPS3060
Photo, sec< 1< 1

Eyes recoloring

Android

Android Mid
Samsung Galaxy S7
Android Top
Pixel 3 XL
Real-time,FPS2030
Photo, sec< 3< 3

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
Real-time,FPS3060
Photo, sec< 1< 1

Hand gestures

Basic information

  • Supported gestures:
    • Palm ✋
    • Victory✌️
    • Rock 🤘
    • Like 👍
    • Ok 👌
  • Maximum distance — 1.1m

iOS

DeviceRealtime FPS*
iPhone 1154
iPhone 741
iphone 6s25

* Means technology FPS. In real usage, FPS is usually limited with the render value and locked by 30 or 60 FPS.

Android

DeviceRealtime FPS*
top-end Huawei30
middle-end Xiaomi25

* Means technology FPS. In real usage, FPS is usually limited with the render value and locked by 30 or 60 FPS.

Full Body segmentation

iOS

iPhone 7iPhone 11
Real-time, FPS*3060
Photo, sec< 1< 1
Activation time, sec~2~1
Memory usage, mb135170

* Means technology FPS. In real usage, FPS is usually limited with the render value and locked by 30 or 60 FPS.