Technical Specification

This page provides technical metrics of Face AR SDK feature performance. The values below are for your reference only. We received them on fixed conditions. However, many factors may influence the actual technology performance, e.g. the state of device, other apps running, wi-fi enabled, room temperature, etc. We encourage you to test each feature within your environment.

note
  • FPS โ€” Frames per second of the face detection algorithm on a given device.
  • Angles โ€” Maximum angle on which the technology was able to work during the measurement.
  • Distance โ€” Maximum distance on which the technology was able to work during the measurement.
  • Real-time (online) โ€” Technology performance in real-time.
  • Photo (offline) โ€” The processing time needed to take a photo or process it from the gallery.

SDK Features

Face Detection

Android

Android Mid
Samsung Galaxy S7
Android Top
Pixel 3 XL
FPS3030
Angles, degree7070
Distance, cm120120

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
FPS3060
Angles, degree7070
Distance, cm120120

Single-face Tracking

Android

Android Mid
Samsung Galaxy S7
Android Top
Pixel 3 XL
FPS3030
Angles, degree7070
Distance, cm180200

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
FPS3060
Angles, degree7070
Distance, cm180200

Multi-face Tracking

Android

Android Mid
Samsung Galaxy S7
Android Top
Pixel 3 XL
Faces Number33
2 Faces, FPS2030
3 Faces, FPS2030

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
Faces Number33
2 Faces, FPS3060
3 Faces, FPS3060

Faces Number* โ€” Maximum number of faces which SDK can track with acceptable quality and performance on most mobile devices. The actual number allowed for multi-face tracking is not limited by the technology but only by the physical ability of the device and proportions of the screen.

Effect performance

Banuba SDK allows for a variety of Face AR effects. Some of them require only face tracking and can be represented as a single 3D mask with textures and materials. Other effects are implemented with separately trained neural networks.

Below, you may find information on the real-time performance of Face AR effects which require only face tracking, i.e. face filters, avatars with action units, beautification, and makeup filter (without lipstick).

Android

Android Mid
Samsung Galaxy S7
Android Top
Pixel 3 XL
FPS3030

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
FPS3060

Beautification

Beautification filter

Basic face beautification filter includes skin smoothing, morphing, teeth whitening, eyes flare and LUT. It requires only face tracking, so please, refer to the Effects performance section. Other features given below are based on neural networks, and their performance differs.

Acne removal (manual)

iOS only, neural network, photo processing (offline only)

iOS Mid
iPhone 7
iOS Top
iPhone 11
Photo, sec1< 1

Acne removal (auto)

iOS only, neural network, photo processing (offline only)

iOS Mid
iPhone 7
iOS Top
iPhone 11
Photo, sec< 2< 1

Eye bag removal

iOS only, neural network, photo processing (offline only)

iOS Mid
iPhone 7
iOS Top
iPhone 11
Photo, sec< 2< 1

Skin smoothing

iOS only, neural network, photo processing (offline only)

iOS Top
iPhone 11
Photo, sec< 1

Neck beautification

iOS only, neural network, photo processing (offline only)

iOS Mid
iPhone 7
iOS Top
iPhone 11
Photo, sec1< 1

Makeup

The Makeup filter allows for a realistic try on of foundation, eyeshadow, eyeliner, highlighter, contour, and blusher. It requires only face tracking, so please, refer to the Effects performance section. The lipstick try on requires lips segmentation neural network with a separate algorithm for Lips Shine effect.

Lips coloring

Android

Android Mid
Samsung Galaxy S7
Android Top
Pixel 3 XL
Real-time, FPS2030
Photo, sec< 3< 3

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
Real-time,FPS3060
Photo, sec< 1< 1

Lips Shine (Glossy lipstick)

Android (offline only)

Android Mid
Samsung Galaxy S7
Android Top
Pixel 3 XL
Photo, sec4< 3

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
Real-time, FPS2030
Photo, sec< 1< 1

Background segmentation

Android

Android Mid
Samsung Galaxy S7
Android Top
Pixel 3 XL
Real-time,FPS2030
Photo, sec< 3< 3

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
Real-time, FPS3060
Photo, sec< 1< 1

Hair segmentation

Hair Recoloring

Android

Android Mid
Samsung Galaxy S7
Android Top
Pixel 3 XL
Real-time,FPS2030
Photo, sec< 3< 2

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
Real-time,FPS3060
Photo, sec< 1< 1

Hair Strands Recoloring

iOS only, works for photo processing (offline only)

iOS Mid
iPhone 7
iOS Top
iPhone 11
Photo, sec< 2< 1

Skin segmentation

Android

Android Mid
Samsung Galaxy S7
Android Top
Pixel 3 XL
Real-time,FPS2030
Photo, sec< 3< 2

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
Real-time,FPS3060
Photo, sec< 1< 1

Eyes Recoloring

Android

Android Mid
Samsung Galaxy S7
Android Top
Pixel 3 XL
Real-time,FPS2030
Photo, sec< 3< 3

iOS

iOS Mid
iPhone 7
iOS Top
iPhone 11
Real-time,FPS3060
Photo, sec< 1< 1
Last updated on