Banuba Face AR SDK enables the following types of effects
Skinned Mesh Animation
You can create face filters by adding animation to 3D geometry. The animation can play continuously in a loop, according to a specific scenario or enabled with triggers.
- Example: Animated 3D example
You can create beautification or face retouch filter with skin smoothings, eyes and teeth whitening, "expressive eyes" effect, color correction and skin tone adjustment (darker or lighter). You can use it as a standalone filter in live streaming, social networking, dating apps or video chats to enhance the user camera experience or as part of face filters adding animation, virtual accessories or entertainment masks.
- Example: Retouch example
- Example: Beauty example
- Tutorial: How To Create Face Beautification Filter In Effect Constructor
Makeup try on
You can enable virtual makeup application for:
Virtual try on
You can enable realistic representation on facewear products to allow users to virtually try on:
- Jewelry: necklaces, earrings
You can design AR models that behave like the real objects in the flow of real-world light and physics, e.g. support gravity or mirror the light with the camera rotates and user head tilts.
- Tutorial: Physics effect creation
Multiple Face Detection
You can apply face filters for multiple users where one effect is applied to each face recognized in the camera, or different effects are applied to several faces simultaneously.
You can enable AR scenarios in face filters with user facial expressions. The user can interact with effects or call them opening mouth, smiling, raising eyebrows or frowning.
- Tutorial: Trigger effect creation
You can separate a user on the foreground from the background in a video to remove the background, replace it with another graphical image or add video file.
Animated texture and billboard
You can create effects with animated textures represented as a video file or a sequence of pictures. Billboards are usually represented with polygons, although it can be any object that always faces up the camera with its Z axis and Y axis always pointing upwards, regardless of its position in space.
- Example: Animated texture example
Morphing allows for modifying the size of the face and its facial features by moving the vertices of the 3D model of the face. You can slim down or enlarge the face, change the shape of the nose, eyes, lips, chin, or produce any other deformations.
- Example: Morphing example
You can create Instagram-like filters enabling real-time or offline color correction of pre-recorded images.
You can apply blendshapes to animate 3D emojis, avatars or full-face AR masks that support and copy user facial expressions in real-time.
- Example: Action Units example