Skip to main content

Type of effects

Banuba Face AR SDK enables the following types of effects

Skinned Mesh Animation#

You can create face filters by adding animation to 3D geometry. The animation can play continuously in a loop, according to a specific scenario or enabled with triggers.

Example: Animated 3D example

Beauty#

You can create beautification or face retouch filter with skin smoothings, eyes and teeth whitening, "expressive eyes" effect, color correction and skin tone adjustment (darker or lighter). You can use it as a standalone filter in live streaming, social networking, dating apps or video chats to enhance the user camera experience or as part of face filters adding animation, virtual accessories or entertainment masks.

Example: Retouch example
Example: Beauty API
Tutorial: How to create face Beautification filter

Makeup try on#

You can enable virtual makeup application for:

  • Foundation
  • Eyelashes
  • Eyeliner
  • Lipstick
  • Eyeshadow
  • Blusher
  • Highlighter
  • Contouring

Example: Makeup API

Virtual try on#

You can enable realistic representation on facewear products to allow users to virtually try on:

  • Glasses
  • Jewelry: necklaces, earrings
  • Piercing
  • Hats

Physics#

You can design AR models that behave like the real objects in the flow of real-world light and physics, e.g. support gravity or mirror the light with the camera rotates and user head tilts.

Tutorial: Physics effect creation

Multiple Face Detection#

You can apply face filters for multiple users where one effect is applied to each face recognized in the camera, or different effects are applied to several faces simultaneously.

Trigger#

You can enable AR scenarios in face filters with user facial expressions. The user can interact with effects or call them opening mouth, smiling, raising eyebrows or frowning.

Tutorial: Trigger effect creation

Background change#

You can separate a user on the foreground from the background in a video to remove the background, replace it with another graphical image or add video file.

Tutorial: Static & Animated
Tutorial: 3D Background

Animated texture and billboard#

You can create effects with animated textures represented as a video file or a sequence of pictures. Billboards are usually represented with polygons, although it can be any object that always faces up the camera with its Z axis and Y axis always pointing upwards, regardless of its position in space.

Example: Animated texture example

Morphing#

Morphing allows for modifying the size of the face and its facial features by moving the vertices of the 3D model of the face. You can slim down or enlarge the face, change the shape of the nose, eyes, lips, chin, or produce any other deformations.

Example: Morphing example

LUT Post-Processing#

You can create Instagram-like filters enabling real-time or offline color correction of pre-recorded images.

Action Units#

You can apply blendshapes to animate 3D emojis, avatars or full-face AR masks that support and copy user facial expressions in real-time.

Example: Action Units example

Last updated on