Type of effects

Banuba Face AR SDK enables the following types of effects

Skinned Mesh Animation

You can create face filters by adding animation to 3D geometry. The animation can play continuously in a loop, according to a specific scenario or enabled with triggers.

Beauty

You can create beautification or face retouch filter with skin smoothings, eyes and teeth whitening, "expressive eyes" effect, color correction and skin tone adjustment (darker or lighter). You can use it as a standalone filter in live streaming, social networking, dating apps or video chats to enhance the user camera experience or as part of face filters adding animation, virtual accessories or entertainment masks.

Makeup try on

You can enable virtual makeup application for:

  • Foundation
  • Eyelashes
  • Eyeliner
  • Lipstick
  • Eyeshadow
  • Blusher
  • Highlighter
  • Contouring

Virtual try on

You can enable realistic representation on facewear products to allow users to virtually try on:

  • Glasses
  • Jewelry: necklaces, earrings
  • Piercing
  • Hats

Physics

You can design AR models that behave like the real objects in the flow of real-world light and physics, e.g. support gravity or mirror the light with the camera rotates and user head tilts.

Multiple Face Detection

You can apply face filters for multiple users where one effect is applied to each face recognized in the camera, or different effects are applied to several faces simultaneously.

Trigger

You can enable AR scenarios in face filters with user facial expressions. The user can interact with effects or call them opening mouth, smiling, raising eyebrows or frowning.

Background change

You can separate a user on the foreground from the background in a video to remove the background, replace it with another graphical image or add video file.

Animated texture and billboard

You can create effects with animated textures represented as a video file or a sequence of pictures. Billboards are usually represented with polygons, although it can be any object that always faces up the camera with its Z axis and Y axis always pointing upwards, regardless of its position in space.

Morphing

Morphing allows for modifying the size of the face and its facial features by moving the vertices of the 3D model of the face. You can slim down or enlarge the face, change the shape of the nose, eyes, lips, chin, or produce any other deformations.

LUT Post-Processing

You can create Instagram-like filters enabling real-time or offline color correction of pre-recorded images.

Action Units

You can apply blendshapes to animate 3D emojis, avatars or full-face AR masks that support and copy user facial expressions in real-time.

Last updated on