Type of effects
Banuba Face AR SDK enables the following types of effects
#
Skinned Mesh AnimationYou can create face filters by adding animation to 3D geometry. The animation can play continuously in a loop, according to a specific scenario or enabled with triggers.
Example: Animated 3D example
#
BeautyYou can create beautification or face retouch filter with skin smoothings, eyes and teeth whitening, "expressive eyes" effect, color correction and skin tone adjustment (darker or lighter). You can use it as a standalone filter in live streaming, social networking, dating apps or video chats to enhance the user camera experience or as part of face filters adding animation, virtual accessories or entertainment masks.
Example: Retouch example
Example: Beauty API
Tutorial: How to create face Beautification filter
#
Makeup try onYou can enable virtual makeup application for:
- Foundation
- Eyelashes
- Eyeliner
- Lipstick
- Eyeshadow
- Blusher
- Highlighter
- Contouring
Example: Makeup API
#
Virtual try onYou can enable realistic representation on facewear products to allow users to virtually try on:
- Glasses
- Jewelry: necklaces, earrings
- Piercing
- Hats
#
PhysicsYou can design AR models that behave like the real objects in the flow of real-world light and physics, e.g. support gravity or mirror the light with the camera rotates and user head tilts.
Tutorial: Physics effect creation
#
Multiple Face DetectionYou can apply face filters for multiple users where one effect is applied to each face recognized in the camera, or different effects are applied to several faces simultaneously.
#
TriggerYou can enable AR scenarios in face filters with user facial expressions. The user can interact with effects or call them opening mouth, smiling, raising eyebrows or frowning.
Tutorial: Trigger effect creation
#
Background changeYou can separate a user on the foreground from the background in a video to remove the background, replace it with another graphical image or add video file.
Tutorial: Static & Animated
Tutorial: 3D Background
#
Animated texture and billboardYou can create effects with animated textures represented as a video file or a sequence of pictures. Billboards are usually represented with polygons, although it can be any object that always faces up the camera with its Z axis and Y axis always pointing upwards, regardless of its position in space.
Example: Animated texture example
#
MorphingMorphing allows for modifying the size of the face and its facial features by moving the vertices of the 3D model of the face. You can slim down or enlarge the face, change the shape of the nose, eyes, lips, chin, or produce any other deformations.
Example: Morphing example
#
LUT Post-ProcessingYou can create Instagram-like filters enabling real-time or offline color correction of pre-recorded images.
#
Action UnitsYou can apply blendshapes to animate 3D emojis, avatars or full-face AR masks that support and copy user facial expressions in real-time.
Example: Action Units example