Skip to main content

Changelog

[1.18.1] - 2026-04-30​

Changed

  • Improved makeup effects performance

Fixed

  • Other improvements and performance enhancements

[1.18.0] - 2026-03-09​

Changed

  • Upgraded face tracking algorithm
  • Improved glasses lens segmentation
  • Improved glasses frame color detection
  • Improved skin tone detection
  • Improved 3d objects positioning on the face

Fixed

  • Other improvements and performance enhancements

[1.17.7] - 2025-12-19​

Added

  • Glitter effect for makeup
  • Glasses detection algorithm
  • Glasses lens segmentation algorithm
  • Glasses frame color detection algorithm

Changed

  • Virtual Background segmentation improvements
  • Face shape detection algorithm improvements

[1.17.6] - 2025-09-29​

Added

  • Face shape detection

Changed

  • Enhancements for various platforms and effects

[1.17.5] - 2025-08-29​

Added

  • Gloss and chameleon color effects for eyeshadows
  • Numerous enhancements for various platforms and effects

Changed

  • Improved virtual background segmentation

[1.17.4] - 2025-07-18​

Added

  • Gloss and chameleon color effects for makeup
  • Numerous enhancements for various platforms and effects

Changed

  • Improved Gender Recognition model

[1.17.3] - 2025-06-06​

Added

  • Lips Glare effect for Windows, OSX and Emscripten

Fixed

  • Bug fixes and improvements for various platforms

[1.17.2] - 2025-05-23​

Added

  • "Weatherman" mode
  • Support for video textures in effects

Changed

  • Improved background segmentation
  • Improved hair segmentation

Fixed

  • Bug fixes and improvements for various platforms

[1.17.1] - 2025-04-16​

Added

  • Experimental feature "Weatherman"

Changed

  • Resource linking

[1.17.0] - 2025-03-20​

Added

  • Light source detection & correction

Changed

  • Major performance optimization
  • Optimized performance of teeth whitening algorithm
  • Updated face tracking
  • Improved stability of face description model

Fixed

  • Bug fixes and improvements for various platforms

[1.16.4] - 2025-01-28​

Added

  • Hair segmentation mask stabilization

Fixed

  • Bug fixes and improvements for various platforms

[1.16.3] - 2024-12-17​

Fixed

  • Performance meter crash

[1.16.2] - 2024-12-12​

Added

  • Light conversion effect

Changed

  • Numerous documentation improvements
  • Switch to FFMPEG 4.10.2 for Windows

Fixed

  • Functioning of Biometric Match feature
  • Scripting memory leak for iOS and macOS

[1.16.1] - 2024-11-29​

Changed

  • Improved VITA Shade tone detection and teeth whitening

Fixed

  • Bug fixes for various platforms

[1.16.0] - 2024-10-17​

Added

  • Light Source Detection

Changed

  • Improved face morphings
  • Improved hair segmentation

Fixed

  • Acne removal
  • Music playback on certain effects

[1.15.1] - 2024-08-07​

Added

  • Load Banuba Native Code using Relinker Library (Android)
  • Zoom and torch to player API
  • Teeth tone to generator

Fixed

  • Permissions on start
  • Fixed long loading time for makeup
  • Fixed effects freezing in the new version of Chrome
  • Crash when frame size is not a multiple of 16
  • Face Morphing fix

[1.14.0] - 2024-06-07​

Added

  • New teeth whitening algorithm
  • Gender detection
  • ASTC format support
  • Frown Action Units

Changed

  • Face attributes (Personalized 3D avatar)

Fixed

  • Some fixes for prefabs
  • Texture formats on Metal

[1.13.2] - 2024-05-27​

Fixed

  • KTX dynamic upload

[1.13.1] - 2024-05-30​

Fixed

  • Android strip symbols

[1.13.0] - 2024-04-30​

Added

  • Biometric match
  • Pupillary distance
  • Nails and eyelenses prefabs
  • GLTF 2.0 Support

Changed

  • Eyelashes texture

[1.12.1] - 2024-04-10​

Fixed

  • Web:
    • Frame leak, when source changed
    • Analytics crash
  • Video textures in effects (Win)
  • Unity:
    • Background & hair segmentation
    • Lips shine scale

[1.12.0] - 2024-04-02​

Added

  • Personalized 3D avatar (iOS) - beta version
  • Nails segmentation (Android)
  • Improved creating effects process
  • FP16 flag XNNPACK for TFLite
  • Privacy manifest and signing (iOS)
  • Asynchronous pixels reading
  • Studio lightning effect
  • useFutureFilter option (Web)

Fixed

  • Actions Units improvements
  • Face tracking performance improvements (Android + Web Safari)
  • Video track loading (Web)

[1.11.1] - 2024-02-23​

Added

  • Fit mode for Unity

Fixed

  • Win: GLTF models for AMD GPUs
  • Unity:
    • Segmentation clamp issues
    • Materials in effects
    • Hand skeleton transformation and rendering

[1.11.0] - 2024-02-09​

Added

  • Improved background segmentation in landscape
  • New skin segmentation
  • Android:
    • VideoInput to Player API
    • TextureOutput to Player API
    • IRenderStatusCallback to Player API
    • IFrameRotationProviderCallback to Player API
  • WebAR: mediastream processor
  • iOS:
    • Player.onRender callback

Changed

  • UV scale

Fixed

  • FRX scattering
  • iOS:
    • breaking segmentation on the lower parts of the frame, camera orientation track
  • Android:
    • Calculation of strides for FrameOutput in the Player API

[1.10.1] - 2024-01-10​

Added

  • Face-skin segmentation for Unity

Fixed

  • Flashing morphing unity
  • Support for simulators

[1.10.0] - 2023-12-20​

Added

  • Eye’s dark circles removal
  • New face morphs in the Makeup API
  • Teeth segmentation
  • ActionUnits antijitter
  • Ability to download iOS packages via SPM
  • SeverityLevel.NONE to disable logs

Changed

  • Lip segmentation
  • Removed GLTF autoscale

Fixed

  • iOS: Photo input now tracks device orientation (Player API)
  • Android: correctly resume audio from a paused or stopped state
  • Webar:
    • OpenCV SIMD instructions for Safari 16.4
    • Empty files unzip
    • useFutureInterpolate option
    • Crash during module loading in an unsupported browser
    • Webcamera performance improved
  • Red AR 3D Mask bad colours

[1.9.3] - 2023-12-06]​

Changed

  • Remove auto-scale from GLTF loading

[1.9.2] - 2023-11-29​

Added

  • Face skin segmentation
  • Android & iOS: apply a watermark to recorded video (Player API)
  • Full HD video recording iOS

[1.9.1] - 2023-11-8​

Fixed

  • Action Units eyes blinking
  • Android: support for relative paths for video textures
  • WebAR:
    • Player FPS restriction
    • Perf measure
    • Rendering delay (Firefox)
    • NPM package missing modules
    • Agora Filter Extension v2.0.0
  • Unity:
    • Prefabs ordering (export layers)
    • Makeup prefab
    • Camera UV after resize
    • Morphing prefab
    • UI rework

[1.9.0] - 2023-10-19​

Added

  • Rendering quality improvements for head wearable and arm wearable products
  • Earlobes detection
  • Skin smoothing and morphing improvements in Unity
  • Transmissive materials in GLTF files
  • New Effect Player API for Web, iOS & Android. Information about migration can be here

Changed

  • Turned off future filter on eyes
  • Render improvements for caps & rings
  • Makeup softlight texture

Fixed

  • iOS: Online mode for acne removal, some effects, call callback on the main thread, Video recording
  • WebAR: Process crash, broken textures in effects WebAR

[1.8.1] - 2023-09-01​

Fixed

  • Bug with special symbols in paths
  • Background transparency
  • WebGL context lost
  • Some fixes for OpenGL
  • Incorrect display of textures in Firefox

[1.8.0] - 2023-08-17​

Added

  • Acne removal for Android
  • Adjustable acne correction size through effect settings

Changed

  • New lip segmentation
  • Support for Visual Studio 2022 instead of Visual Studio 2019
  • WebAR: localhost logic
  • OEP callback status
  • GLTF serialization
  • Default enabled morphing
  • Skin smoothing

Fixed

  • Android Demo App Crash
  • Added vector binding
  • TFlite model cache
  • Lips dithering
  • View scale
  • Background segmentation for M1
  • Flipped MV in script
  • Makeup for Unity
  • Nose morphing
  • Accelerated physics on processed photos and videos
  • Makeup eyes colouring
  • Unity packages

[1.7.1] - 2023-06-15​

Added

  • Web telemetry
  • Portrait background segmentation for desktop and web
  • Manual acne removal for iOS

Changed

  • Faster loading for segmentation neural networks
  • Enable OpenCL on Android 12

Fixed

  • Unity packages
  • Video track
  • Camera texture
  • Effect reset
  • Eyes morphings
  • Memory leak
  • JNI initialization
  • Camera switching
  • Bad JS cast

[1.7.0] - 2023-05-12​

Added

  • Turbo FRX (default is ON in web)
  • Motion detector for all segmentation neural networks
  • Lips ditering
  • New makeup morphings
  • Reduced detectors
  • Background neural networks's with Neural Engine support (iOS only)
  • Parallel FRX for multiface

Changed

  • Sorting of effects for iOS
  • New EffectPlayer API for iOS
  • Desktop delivery
  • FRX update (FRX8)
  • Render Optimization
  • Reduced CPU consumption for the hand detector
  • Resize for metal
  • Eyebrow correctors

Fixed

  • UI for rings
  • Segmentation postprocessing
  • TFlite initialization
  • Action Units eyebrows
  • Hair AR 3D Mask size
  • Shaders instancing and names for the new Makeup API
  • iOS: sound in recordered video, gif playback, video from gallery rotation,
  • Android: Crash, Assets load, Mips generation
  • WebAR: Memory leak and some bug fixes for Safari 16.4
  • Win: Background issues
  • Unity: Makeup
  • OEP: Enable audio for Android, Video as a background

[1.6.1] - 2023-03-20​

Added

  • UI for ring fitting

Changed

  • Replace int8 with fp16 in neural networks for Android

Fixed

  • Background video play

  • Neuro_beauty effect

  • Photo processing for Android & iOS

  • Sound in the recorded video

  • ANR during initialization

  • Android: Methods for Video Editor; Missed video textures in effects;

  • iOS: Effect events;

  • MacOS: Incorrect processing output;

  • WebAR: missing cleanup; memory leak; playback of the effect's video textures;

  • OEP: Crash after choosing .gif; background video textures;

  • Unity: Incorrect camera output.

[1.6.0] - 2023-01-23​

Added

  • Faster face tracking for Safari
  • Add an API to check compatibility between the browser and SDK
  • New rings for each finger
  • Background mode for effects (iOS)
  • Two types of denoising (Web only)
  • Play control functions (pause/play) for Android
  • Python build for M1

Changed

  • SSD Update
  • Webcam video enhancer opt-in
  • Agora example update (for Android)
  • Reduced size of skin_segm_tflite
  • Eyes neural network update

Fixed

  • bnb_UVMORPH texture
  • Broken face texture when using brow correctors
  • Missed background in gltf_avatar effect iOS: MSAA crashed iOS, Crash on Makeup Android: Flipped-up effect test_touch_gestures MacOS: Video processing on MacOS WebAR: Token-caused crash of WebAR Win: Missed UI in viewer, spamming error messages during processing Unity: Unity Android crash OEP: Background video mode in OEP

[1.5.3] - 2022-11-17​

Added

  • Unity
  • Hand tracking
  • Hand skeleton
  • Eyebrow segmentation
  • Makeup

Fixed

  • Accurate video seek on Android
  • Action Units update
  • Crash on multiface
  • Videodecoding on the Web

[1.5.1] - 2022-10-10​

Added

  • Variable frame video support (15, 30, 60 FPS etc.)

Changed

  • A new blur background algorithm with more accurate borders
  • Ugly action unit MOUTH_STRETCH has been excluded from the pipeline
  • New background segmentation models in landscape for Desktop platforms

Fixed

  • Blur background radius settings
  • Flyout when no lips are found
  • Android
  • Crash during JavaScript execution
  • Video textures for MediaTek+PowerVR devices

[1.5.0] - 2022-08-24​

Added

  • OEP: Added support for BT601 and BT709, full and video ranges
  • Enabled neural network cache on Android
  • AR Avatars: technology updates, support for GLTF models added
  • Makeup API: Added return values for lips, hair, and teeth
  • Android: Ability to record original video without effects in the Demo app
  • Unity: More segmentation neural networks
  • Upgrade TFlite to version 2.9
  • New face detector
  • C API: eval_js method added
  • Face tracking for medical AR 3D Masks (does not ship with the regular Face AR SDK, contact your sales manager for more details)
  • Virtual Background: *Background.getBackgroundVideo() method added
  • Ability to pause background video right after it's loaded

Changed

  • WebAR is now delivered as an NPM package.
  • iOS Demo: Now video capture stops after pushing videoButton
  • Upgraded lips segmentation neural network for all platforms except Apple
  • Effects resources are now loaded asynchronously
  • iOS, MacOS: New background landscape model
  • Android Demo App: Improved UI Layout in landscape mode
  • Eyebrow technology: improved performance and stability
  • Smile and mouth opening trigger improvements
  • Improved stability of face tracking and detection
  • Unity
  • Plugin and Demo scene refactoring
  • Morphing refactoring

Fixed

  • C API built on Windows
  • Crash on Viewer closing
  • Various serialization issues with effects (broken physics, etc.)
  • Crash on some devices with error: Resource deadlock would occur
  • Background video unexpected line
  • Deserialization of empty textures
  • Crash or image freeze when a face goes out of the screen border
  • OEP:
  • Memory leak in FPS Draw
  • Memory leak when loading effect synchronously
  • Released external surface before creating new (leak fix)
  • WebAR:
  • Upside down screenshot on Safari 14
  • Added better error messages for Outputs
  • Runtime error when using iframe.srcdoc
  • Inability to reuse MediaStream
  • Player.destroy() memory leak
  • Makeup API:
  • Makeup.lashes affects Eyelashes.color
  • Unity:
  • Various effects issues
  • Various startup errors
  • Demo scene UI fixes
  • Broken face in landscape
  • Beautification scene
  • Issue with multiple faces

[1.4.4] - 2022-07-26​

Added

  • Option to disable future frame filtration in the recognizer

Changed

  • Disable the future frame feature for OEP

[1.4.3] - 2022-07-11​

Added

  • Background.getBackgroundVideo() method added to the virtual background feature
  • Android OEP Demo: Add virtual background samples

Changed

  • Add play and loop parameters to the background texture

Fixed

  • OEP: Frame is flashing when switching from blur to video
  • The app does not start on lower-end devices

[1.4.2] - 2022-07-04​

Added

  • The path to the application cache (internal storage) is available via resource_manager
  • Enable neural network model cache on Android
  • Enable the software MSAA on the Adreno 6xx series
  • iOS: support of the OpenGL backend for the OEP Demo app
  • Android, iOS OEP Demo functionality improvements

Changed

  • Upgrade Tflite to version 2.8 (iOS, Android)
  • Virtual background: scaling and rotation are disabled when background is not set
  • Virtual background: rotation changed from ccw to cw
  • Virtual background: video formats support updates
  • Android: use xnnpack runner while gpu runner is is loading

Fixed

  • Unexpected line on background video when using OEP
  • Background video frame is flashing when switching the background
  • SDK Version 1.3.X Crash on iOS system 12.X
  • Build made with modules crashed when the license  expired (missing watermark file)
  • OEP: iOS 1.3.1 blur and transparency don't work
  • OEP: BG video orientation (recorded front, back cameras) is flipped, stretched, or squeezed
  • OEP: Background flipped upside down If portrait orientation lock is off
  • MacOS: hair and BG recognition
  • Xiaomi Mi8 Pro crash
  • Exception: 'transformation matrix is singular'
  • Windows: camera crashes when creating a new camera
  • Windows: deadlock

[1.4.1] - 2022-05-16​

Fixed

  • The makeup API didn't work on iOS versions below 14
  • WebAR failed to start on Chrome 100 and up (Windows platform only)
  • Video processing was taking longer
  • Unity: Incorrect face texture display in some cases

[1.4.0] - 2022-04-20​

Added

  • Face AR SDK for iOS and Android distribution as pods or maven packages
  • iOS, Android: All Face AR SDK examples on Github are switched to pods, and Maven packages
  • Component-based face tracking for all supported platforms (only in online mode)
  • Unity: brand-new demo scene with effects carousel
  • Android: restored external texture support to the effect_player
  • Hand AR: Textured nails
  • M1 simulator support has been restored
  • Makeup API: Eyebrows makeup
  • WebAR: ability to load Effect via Request
  • WebAR: ability to play gif as background texture
  • WebAR: Effect.preload progress listener
  • WebAR: Check out our new tutorials section with extensive WebAR insides and best-practices
  • Rendering Engine: GLTF support

Changed

  • iOS: Upgraded lips segmentation neural network
  • B&W lip colouring support without additional parameters
  • Makeup API: reduced number of uniforms
  • WebAR: Improved WebAR archive UX
  • Rendering Engine: Reduce LUT memory size
  • OEP: extend supported image formats

Fixed

  • Black screen flash on effects loading
  • Android: memory leak in the OEP
  • Android: Pixel 3a crashes after applying certain face filters
  • Android: deadlock during video_frame draw
  • Android: Xiaomi Mi 8 Pro crashes
  • iOS: iPhone 13 is recognised as middle-end hardware
  • Fixed invisible entities for some face filters
  • Effects API: Api.drawingAreaWidth() & Api.drawingAreaHeight() return 0
  • Windows: Impossible to apply effect with path containing extended Unicode
  • Windows, MacOS: Banuba Viewer saves video without sound
  • MSAA issues in face filters
  • WebAR: Fixed processing of RGB images
  • WebAR: Fixed MediaStreamCapture crash on Safari 14
  • Makeup API: Fixed serialization of empty textures
  • Hand AR: hand skeleton false detections
  • OEP: crash if input buffer format changes
  • OEP: green frame if texture is not ready
  • OEP: fixed rapid camera switch

[1.3.1] - 2022-03-02​

Changed

  • An OCV-based camera on Windows is able to select a camera by index

Fixed

  • OEP crash or black background on first choice of background blur
  • OEP Metal crash
  • noFaceActions & faceActions functions are incorrect call in config.js
  • Viewer v1.3.0 crashes on Macbook
  • WebAR: MediaStreamCapture produces black frames
  • WebAR: Makeup effect crashes web page on iPhone 8, iOS 15
  • WebAR: Fixed result of ImagCapture.takePhoto
  • WebAR: Effect crashes on iOS Safari
  • WebAR: Effect animations lag on iOS Safari 14
  • Android alooper crash
  • Photo loading black screen: buffer is not large enough for dimensions
  • Incorrect face texture display when using lip correctors
  • Hand skeleton can be recognized on different objects

[0.38.6] - 2022-02-16​

Added

  • Offscreen app performance improvement

Changed

  • Drop any frame_data fields on effect loading

Fixed

  • Fix SDK work on Android 6
  • Recording audio from effect_player to file
  • Crash when making a photo or video from the Demo App
  • Avoid the copy frame in the case of the Banuba SDK Demo
  • OEP Android FATAL EXCEPTION: CameraThread
  • Distorted image after turning on blur for row stride not equal width

[1.3.0] - 2022-01-27​

Version 1.3.0 also includes all changes from SDK v0.x releases up to v0.38.5 version. Please, refer to the changelog below.

Added

  • Face tracking antijitter based on optical flow algorithm
  • Ability to draw face mesh landmarks (and test effect)
  • Face mesh lip correctors (optional)
  • Face mesh eyebrow correctors (optional)
  • Native Metal API support (iOS, MacOS)
  • Metal multiinstance
  • Arm64 support with a Metal backend for simulators and MacOS
  • Makeup API: Lips morphing
  • WebAR: Tflite libs for emscripten (3.0.1)
  • WebAR: Throw an error when rendering an unexpected DOM element
  • unloadEffect method
  • OEP: Metal YUV converter
  • SDK Manager added to the API documentation
  • AR Rings technology

Changed

  • WebAR: TFLite delegate creation failed error now shows as warning
  • WebAR: Optimized CPU and GPU usage
  • WebAR: Reduced RAM usage and camera pixels retrieving time
  • WebAR: Added warning if effect.evalJs is called before the effect application
  • Rebuild OpenCV for Android only with the required set of features
  • Switch Hand Gestures and recognition to Tflite for iOS and Mac
  • The Android Beauty example switched to the Makeup API usage
  • Face mesh correctors are controlled directly from needed effects (including Makeup API)
  • An Android Demo app can be built now with Java 11+ and Gradle 7+ versions
  • Correct work of alpha channel blending (used in background transparency)
  • OEP: Improved performance of the YUV converter for Android
  • Makeup API: Improved the effect activation time
  • Removed copying of U and V textures for i420

Fixed

  • Makeup API: Correctly resolve loading resources from different modules
  • Makeup API: Hair blending incorrect brightness
  • Makeup API: Incorrect blur behaviour when comparing to 0.x version
  • WebAR: Electron: License error 0xff00f
  • WebAR: User-friendly error messages for misconfigured locateFile
  • WebAR: Delay in loading animation on Safari
  • WebAR: Makeup effect crashes iOS Safari
  • WebAR: Fixed GPU memory leak
  • Various crashes in the Offscreen Effect Player (OEP)
  • SDK v1.1.0 crashed on the unload effect in the Android quickstart app
  • Incorrect work of Api.playVideoRange
  • Windows: Effects cannot be enabled when extended Unicode is used in the app's location name
  • Windows: OEP-desktop-c-api example build has failed to launch
  • Android Demo app has crashed on switching effects and closing activity
  • iOS: sdkManager.output?.takeSnapshot method not working in SDK 1.x
  • iOS: Distorted videos/snapshots when using non-standard RenderSize

[0.38.5] - 2021-12-14​

Added

  • EffectPlayer sound playback recording

Changed

  • Android: Updated lips segmentation neural network

Fixed

  • Incorrect shiny lip application
  • OEP: fix YUV aliasing

[1.2.1] - 2021-12-01​

Fixed

  • iOS: x86_64 simulator support
  • Makeup API: Incorrect display of blurred background
  • Makeup API: Incorrect virtual background ratio in landscape mode
  • Virtual background: incorrect alpha blending when using transparent images

[1.2.0] - 2021-11-24​

Version 1.2.0 also includes all changes from SDK v0.x releases up to v0.38.4 version. Please, refer to the changelog below.

Added

  • Hand gestures and Hand skeleton model for all platforms
  • Light Streaks effect support in Scene (1.x versions)
  • Add a warning if the versions of neural nework and FaceAR SDK are different
  • Face skin segmentation neural network for Tflite (all platforms except iOS and MacOS)
  • Makeup API: Eyelashes 3D support
  • Android: Automatically select RGB or YUV camera mode (better performance on some low and mid-end devices)
  • WebAR: Ability to enable heavy hair neural networks
  • Error message when trying to load an old effect (from 0.x versions)
  • Ruler (distance to face) effect
  • Introduce evalJs for calling effect methods from the application
  • iOS: Support for hair segmentation in landscape mode
  • Ability to combine Face AR effects with a virtual background in runtime
  • Eval js support for OEP

Changed

  • New Tflite Lips neural network (all platforms except iOS and MacOS)
  • WebAR: Optimized Image processing
  • Remove unnecessary libraries and dependencies
  • iOS, MacOS: Switch face tracking neural networks to Tflite
  • Android: Updated hair segmentation neural network
  • The new body segmentation (v2) neural network is enabled by default

Fixed

  • WebAR: Fixed Emscripten auto GC
  • WebAR: Added ability to release WASM memory
  • WebAR: Fixed Photo editing
  • WebAR: Hand segmentation and gesture support
  • WebAR: Fixed Next.js compatibility
  • Remove unneeded iteration for hair recolor
  • The second call of BNBUtilityManager.initialize or BanubaSdkManager.inialize causes a crash in the release
  • Eye segmentation nn performance incorrect display
  • Makeup API: Fixed Hair coloring algorithm
  • Various OEP fixes
  • Imgui display on Windows
  • Effects fix for Safari 15

[1.1.1] - 2021-10-19​

Added

  • Makeup API: beauty morphings

Changed

  • Makeup API: Blur algorithm

Fixed

  • callJsMethod fails when pass parameters

[0.38.4] - 2021-11-02​

Fixed

  • full_image_from_yuv_i420_img is too slow

[0.38.3] - 2021-10-07​

Added

  • face_search_mode in the EffectPlayer API
  • Windows: Sign and add description to EffectPlayer dlls
  • i420 yuv pixel format support

Changed

  • Improved face tracking performance
  • New tflite hair segmentation neural network for Android and Windows

Fixed

  • Morphing behaviour at the screen edges

[0.38.2] - 2021-09-16​

Added

  • iOS 15 support

[1.1.0] - 2021-09-30​

Version 1.1.0 also includes all changes from SDK v0.x releases up to v0.38 version.

Added

  • Makeup API support
  • Action Units: Multi-face support
  • Full Body Segmentation v2 neural network (for all platforms)
  • Windows: Added description to dlls
  • Windows: Sign Banuba SDK dlls
  • Face triggers support (mouth open, smile, etc.)
  • iOS: Effect info UI in SDK Demo App
  • iOS 15 support
  • Api.isMirroring()
  • WebAR: Distance to phone support

Changed

  • Android: Updated lips segmentation neural network
  • Skin segmentation neural network support on all platforms (including the Web)

Fixed

  • nn_api Lips aliasing
  • WebAR: iOS 13 does not show a video stream

[0.38.1] - 2021-08-17​

Added

  • C API documentation + deadlock fixes (Windows)

[0.38.0] - 2021-08-16​

Added

  • Windows: MSMF camera usage
  • iOS, Android: Hand gesture tracking

Changed

  • Android: Use tflite GPU info library to range device classes
  • iOS: Use the same background segmentation neural networks for all devices
  • iOS: Remove unneeded UI from the demo app
  • Renamed license utils symbols

Fixed

  • tflite_runner assorted fixes
  • iOS: White eyelashes when making photos
  • iOS: Time range issues in video player
  • MacOS: Crash on M1
  • CubemapEverest test effect autorotation
  • WebAR: broken SIMD support
  • WebAR: Fixed creation of MediaStreamCapture
  • Android: Multitouch crash in demo app
  • Unity: minimum version of Android SDK
  • Unity: Android build on Windows
  • Win32: Background NN work
  • Incorrect lips shine work

[0.37.1] - 2021-07-27​

Added

  • Android x86_64 preliminary support

Changed

  • Android: Common gradle for SDK Demo projects
  • Updated background segmentation neural network models for Web and Desktop platforms

Fixed

  • iOS: missing image from camera when using ARKit on iPhone 12
  • Android: Crash on C API
  • Android: Missing photos in the gallery when using the Demo app on some Android devices

[0.37.0] - 2021-07-09​

Added

  • New Eyes segmentation neural network with separate detection of eye parts: pupil, sclera, and iris (all platforms)
  • Token updates for Eye bags and Acne features (new token required)
  • iOS: Lips corrector
  • MacOS: reworked implementation of the MacOS framework
  • WebAR: API to set the number of faces to track
  • Unity: Action Units interface
  • Ability to show camera frames during effect initialization
  • M1 support (including simulators)
  • Accepting YUV i420
  • Lip morphing effect
  • Ability to set Neck smoothing from JS (in effect)
  • Effect Player C API

Changed

  • Update Win tflite x64 and x86 from 2.3 to 2.4.1
  • Eyes corrector is included in release archives by default
  • Eyes corrector enabled for Win and Web
  • Preload all Android NN classes instead of creating them on request
  • Improved performance of the Lips Shine effect
  • Makeup API updates:
  • The SetInitialRotation method is added to the bg-image and bg-video classes
  • Transparent BG fix
  • Consistent methods of naming
  • Fixed usage of the skin segmentation with background features
  • Android: Remove unneeded rotateBg calls and all related code
  • iOS: Include bitcode into minimal builds
  • iOS: Updated background segmentation NNs for high-end and low-end devices
  • Updated Face tracking neural network (all platforms)

Fixed

  • Makeup Transfer exception
  • WebAR: Fixed inactive tab video throttling
  • Standalone: remove legacy resource copy
  • Effects of video texture crashes on some devices with MediaTek and PowerVR
  • OEP long loading during app initialization

[1.0.0] - 2021-06-22​

Added

  • WebAR: Video texture support
  • WebAR: API to set the number of faces to track
  • WebAR: Lips effects support on iOS (Safari)
  • Xcode 12.5 supports

Changed

Fixed

  • Android: Screen is flashing when switching effects
  • Android: GPU-specific deadlock issues
  • iOS: Demo app crash on iOS < 13.5
  • WebAR: Fixed texture alpha-blending
  • Windows: Effect with the video has failed to load
  • Windows: standalone build failure on the x86 platform
  • Do not crash the app when assert has failed
  • JS engine fixes
  • Lips shine effect
  • Various effects fixes

[0.36.1] - 2021-05-24​

Changed

  • WebAR: FrameData is available in the WebAR SDK
  • Distance to phone improvements

Fixed

  • Unity: Triggers incorrect work
  • Unity: iOS camera initialization

[0.36.0] - 2021-05-03​

Added

  • WebAR: Human-readable exception messages
  • WebAR: Updated background segmentation
  • WebAR: Optional SIMD
  • WebAR: Made WebAR SDK SSR compatible
  • WebAR: Crop, resize, horizontalFlip support
  • Desktop: Updated background segmentation
  • Android: Offscreen Effect Player (OEP) example
  • iOS: Offscreen Effect Player (OEP) example
  • Unity: Face morphing support
  • GIF textures support
  • Lip segmentation support for Web and Desktop
  • Makeup API: Exposed extra APIs
  • Hand AR API: Nails segmentation
  • Windows: SDK dlls come signed

Changed

  • Invalidate texture cache in case of file change
  • WebAR: Speed up frames obtaining
  • WebAR: Improved memory usage
  • WebAR: Throw if the effect has zero length
  • Mac: build SDK as a macOS framework
  • iOS: Remove ARKit dependency if ARKit face search is disabled

Fixed

  • Error logs when loading empty effect
  • Android: Region cropping when applying zoom
  • WebAR: Prevent playback stops during unsuccessful effect application
  • WebAR: Inactive tab throttling
  • Makeup API: "black square" on lips with alpha channel
  • Unity: UI scaling for the Beautification scene
  • Crash on effect switching
  • Standalone demo app signing

[1.0.0-beta] - 2021-04-23​

Added

  • New render engine aka Scene
  • WebGL 1.0 support (for Safari)
  • Metal support

[0.35.0] - 2021-02-26​

Added

  • Support non-ASCII symbols in paths
  • New Background segmentation neural networks (Desktop)
  • New Background segmentation neural networks (Web)
  • Hair segmentation support on the Windows platform
  • WebAR: Effect.preload and Player.applyEffect will now throw an exception if the effect's underlying source is not a .zip archive
  • Initial support for the Apple M1

Changed

  • ARKit disabled by default (iOS)
  • Strip unnecessary symbols on macOS
  • Use only the minimum required subset of OpenCV on macOS
  • Use TFLite 2.4.1 without Metal delegate on macOS
  • API to set animated background in effects dynamically

Fixed

  • WebAR: Firefox video processing issue
  • Android: Orientation fixes
  • Android: Sound issues and minor improvements
  • Unity: iOS plugin size

[0.34.1] - 2021-01-26​

Added

  • Face Ruler for Android platform
  • Unity: New Action Units effect with background segmentation

Changed

  • Distribute EffectPlayer for iOS as xcframework

Fixed

  • Build with disabled face tracking

[0.34.0] - 2021-01-19​

Added

  • WebAR: Background support in landscape
  • The BG support field in effect_info
  • Android: Java 8+ API desugaring support
  • Viewer extra options for processing

Changed

  • tflite_runner: different delegates support each feature
  • Android: Add static TensorFlow lite version
  • Enable RGB cameras on devices with Snapdragon 625
  • Processed image location in Banuba Viewer
  • Skin smoothing NN update (iOS)

Fixed

  • WebAR: ES6 to ES5 transpilation issue
  • WebAR: loading of non existing effects
  • WebAR: several performance issues
  • Hair segmentation: TFLite input copy error
  • Prior fixes to work with frx_meta logic
  • Incorrect effects display on Android 10
  • Android: Effect size after rotation

[0.33.1] - 2020-12-10​

Added

  • Add listener as soon as test_Ruler or FaceRuler effect is activated

Changed

  • Enable a face recognition neural network for mid-end Android devices

Fixed

  • setEffectSize fix for Android
  • Lips shine AR 3D Mask incorrect work with back camera

[0.33.0] - 2020-11-30​

Added

  • Display FPS stats in the Desktop Viewer App
  • Beauty scene for Unity plugin
  • Android: Ability to Override Detected Resolution
  • Lips recoloring with a glitter effect (also supported in Banuba Viewer)
  • Distance to face (ruler feature)

Changed

  • Updated tflite for Windows to 2.3
  • Both tflite runners were created on first request
  • Text texture is enabled by default

Fixed

  • iOS: incorrect BG work on photo in landscape
  • Unity: fix aspect on mobile devices
  • Delayed camera start
  • Repacking errors
  • Front camera flip
  • 'Face not found' message after loading photo from gallery
  • Added handling of IllegalArgumentException to prevent crashes dependent on surface configuration

[0.32.1] - 2020-11-05​

Added

  • Effect activation listener
  • Unity: Separate render target for the beauty scene for the LUTs

Changed

  • Decreases CPU load on MacOS

Fixed

  • Crash during effect preload
  • Mesh trembling with fast face tracking
  • Unity: Aspect of Background segmentation
  • Crash during fast effect switching

[0.32.0] - 2020-10-20​

Added

  • New background model
  • New WebAR API
  • WebAR Quickstart Demo App
  • WebAR beauty demo app
  • Native OSX camera implementation
  • Web and Desktop getting started added
  • Possibility to customise the capture session preset (iOS)
  • Desktop app examples for Windows and Mac
  • Demo effects without face recognition
  • Xcode 12 supports

Changed

  • Eye corrector v2.0: improved stability and performance
  • Makeup API improvements
  • Use setBackgroundTexture with an absolute path
  • Face tracking stability and performance optimization
  • Update offline face tracking (Android)

Fixed

  • Crash with bitcode in the JavaScript core
  • Separate AR 3D Mask for neck smoothing feature
  • Crash with effect reset (Android)
  • Missing logs in Viewer Standalone
  • Android video player loop
  • Memory leak on desktop when using animated textures
  • Quickstart example app fixes
  • Unity background fix
  • ARKit face detection failure

[0.31.0] - 2020-08-27​

Added

  • SDK features control and repacking with client token and client configuration
  • Minimal SDK archive
  • SDK build for MacOS
  • Makeup transfer feature
  • Photo online processing in Banuba Viewer
  • Ability to enable effects and neural networks without a face recognizer
  • Eye brow segmentation NN
  • Neck smoothing neural network
  • Set camera FPS mode on Android (fixed/adaptive)
  • Represent SDK frames as OpenGL textures (WebRTC for Android)
  • New beautification API

Changed

  • Updated Background Segmentation neural network for standalone builds
  • Face recognizer works on full frame
  • Landmarks smooth filter
  • Updated eye corrector
  • Updated face recognition neural network
  • Unity scene works in full screen mode
  • OpenCV updated to 4.3.0
  • Range of android devices hardware class and max resolution for it

Fixed

  • Unity plane does not update rect
  • Video player fix
  • Heart rate measurement with neural network face search
  • Segmentation neural networks work with arkit
  • Unity WebGL build
  • Fix Unity failure on the Windows platform
  • Crashes on effect unload
  • Correctly handle MRT rendering into background camera texture
  • Black screen on devices with ARKit
  • Background segmentation on Windows x86
  • WebAR SDK blocks the backspace key
  • Banuba SDK works on devices with iOS 14

[0.30.2] - 2020-07-15​

Fixed

  • Second AR 3D Mask freezes on the screen in scene effects

[0.30.1] - 2020-07-14​

Added

  • Eyes correction feature

Changed

  • Hide Boost symbols

Fixed

  • Asynchrony of sound and video after file import
  • iOS: The app freezes after background in Editing mode
  • Android Beauty: Screen is flashing after launch
  • Crash on Editing Image
  • App crashed in editing mod on iPhone XS Max
  • EffectPlayer is not launched for the first time
  • Second face is missed if to use the front Camera (with ARKit)

[0.30.0] - 2020-06-11​

Added

  • WebAR support for Unity platform
  • Background segmentation for Unity platform
  • Max Faces support in client token
  • Videocall example for iOS
  • Minimal configuration of Banuba SDK
  • EffectPlayer EffectManager

Changed

  • The EP version has changed to 5.6
  • Enable bitcode by default (iOS)

Fixed

  • Compilation error on Ubuntu
  • Body segmentation neural network rotation
  • Viewer Standalone build
  • MSVC x64 Eigen crash
  • The app won't throw an exception when neural network resources are missing
  • Optimized face beautification
  • Fix audio session (iOS)
  • Bakground segmentation failures (iOS)
  • Creepy smile fixes
  • Portrait match fixes
  • Skin smoothing fixes

[0.29.1] - 2020-05-19​

Fixed

  • Crash on Android with neural face recognition

[0.29.0] - 2020-04-30​

Added

  • Creepy smile neural network (iOS)
  • Manual audio session in BNBEffectPlayer
  • Skin smoothing neural network (iOS)
  • New face recognition and tracking algorithm for offline (Android)

Changed

  • Banuba Viewer colour picker reacts to background and lip neural networks
  • Make WebAR SDK ES6 module
  • Updated llvm backend for WebAR
  • WebAR improvements

Fixed

  • Lip segmentation on the Android HQ photo
  • Memset buffer overflow when using Action Units
  • Jaw mesh stretching fix in the face tracking algorithm

[0.28.3] - 2020-04-29​

Added

  • Enabled bitcode in iOS release

Fixed

  • Portrait match technology

[0.28.2] - 2020-04-22​

Added

  • Portrait match technology

[0.28.1] - 2020-04-09​

Added

  • Update Effect Player for video calls, support callkit audio session specifics

Changed

  • Switch to a fast face recognition algorithm for weak iOS devices

Fixed

  • Celebrity match technology fixes
  • Crash on Banuba Viewer close

[0.28.0] - 2020-03-23​

Added

  • New face recognition and tracking algorithm for realtime (iOS)

Changed

  • Full Body segmentation can be applied again (iOS)
  • Banuba Viewer UI changes
  • Adapt Action Units to use the new face recognition algorithm (iOS)
  • Adapt triggers to use Action Units (iOS)

Fixed

  • Physics behaviour for effects on devices with ARKit (iOS)
  • Effects render on low-level Android devices

[0.27.2] - 2020-03-12​

Fixed

  • Unity openCV error
  • Small recognizer fixes for the iOS platform

[0.27.1] - 2020-02-27​

Added

  • ARKit multiface support

Changed

  • Android strong device list updated

Fixed

  • Multiface effects render
  • Multiface issues
  • Crash when processing a photo with two faces
  • Effects render with ARKit on iPhone X

[0.27.0] - 2020-02-19​

Added

  • Greatly improved face detection in offline mode (iOS, for photos)
  • Objective-C full support
  • More examples for iOS and Android
  • Improved beauty effect
  • Lip shine effect improved
  • Ability to choose a camera from the command line on Desktops

Changed

  • Persistent OpenGL context on Android (don't recreate it after the app goes in background)
  • Safely ignore GL errors on Android
  • The beauty effect is enabled by default

Fixed

  • Lips shine effect
  • Neural network behaviour after the face was lost

[0.26.0] - 2020-01-17​

Added

  • Advanced lip recoloring
  • Action Units from ARKit
  • x86 support for Windows
  • Lazy textures load

Changed

  • Improve Unity sample effects
  • The Bokeh effect improved
  • Enable beauty by default in sample effects
  • Improve acne and bag removal performance
  • Hair stand blending performance improvement

Fixed

  • Threads leak on Android
  • WebGL FPS stabilization
  • Memory issue on Android
  • Memory issue on iPhone6+
  • Crash during rendering on Adreno 610

[0.25.2] - 2020-01-09​

Fixed

  • Camera open error on Android

[0.25.1] - 2019-12-31​

Fixed

  • Bundle version in the xCode project

[0.25.0] - 2019-12-23​

Added

  • Eye bug removal
  • Neural network based acne removal
  • Use ARKit for face tracking when available
  • dvcam post-process effect
  • Eyes state trigger and ruler features in recognizer API
  • API to change sound volume from Java Script
  • Option to add effects from an external folder in the sample application (Android)
  • Improve API (SDK for browsers)

Changed

  • Don't reload effect if there was an error in JavaScript.

Fixed

  • Decrease memory pressure while creating multiple BanubaSdkManager instances (Android)
  • Crash on effects with 3 or more faces
  • Improved camera FPS on selected low-end Android devices

[0.24.1] - 2019-11-06​

Changed

  • Update documentation with examples of new UI

Fixed

  • Video recording on Android
  • Crash after exiting from the application
  • Memory leak on Android
  • Crashes when interacting with the Android Demo app

[0.24.0] - 2019-11-01​

Added

  • Glasses detection
  • Improved stability (aka jittersing) of face tracking
  • Extended Recognizer API
  • Recognition results in Python bindings

Changed

  • Migration to AndroidX
  • New redesigned UI for Banuba SDK Demo AP (Android and iOS)

Fixed

  • Video texture decoding on Android 10
  • Crash while going to background on iOS
  • Audio recording speed on Android
  • Lag during neural network initialization
  • Various camera fixes for Android

[0.23.0] - 2019-10-02​

Added

  • A neural network based approach to detecting faces. Quality, detection angles, and speed of the face detection was improved
  • Neural networks support for Windows and Web
  • Unity plugin

Changed

  • Sync audio and video during recording on Android
  • Fast background on iPhone 6 and lower.
  • Correct neural network behaviour during device rotations

Fixed

  • Video texture support (Android 10)
  • Crashes on Adreno chipsets
  • Stability fixes

[0.22.0] - 2019-08-28​

Added

  • Lip colouring API in Beauty effect
  • Option to switch off face recognition in config.json
  • Option to set preferred frame-rate on iOS

Changed

  • Lips segmentation neural network updated (Android)

Fixed

  • Rendering on Andreno GPUs
  • Video texture decoding issue on Android
  • Android crash on app coming from background
  • Crash on iPhone 5 after video capture

[0.21.0] - 2019-08-05​

Added

  • Hair and lips recoloring in the "Beauty" effect
  • EffectPlayer threading model documentation
  • SDK feature documentation
  • API to check if device is compatible with Neural Networks player

Changed

  • BanubaSdkManager can be instantiated more than once (see "Migration Guides").
  • Use the background AR 3D Mask transform for the background separation layer from config.json

Fixed

  • Sample app signing (iOS)
  • Rendering bugs after the effect switch
  • Correct screenshot size on Android
  • "End touch" event (iOS)

[0.20.2] - 2019-07-24​

Fixed

  • background separation layer from config.json (Android)

[0.20.1] - 2019-07-17​

Fixed

  • Fix photo processing with MSAA enabled on Android

[0.20.0] - 2019-07-12​

Added

  • Sample ASMR effects
  • Render passes
  • Rendered frame forwarding as byte arrays (Android)
  • Ability to debug JS
  • Reset effect cache API call

Changed

  • Watermark gravity (Android)
  • Sample background separation effect blending improved
  • Background separation feature respects gyroscope data
  • Ignore the gyroscope during photo and video processing
  • Beauty effect improvements

[0.19.1] - 2019-06-24​

Added

  • Colour post-processing effect
  • Face rect API from face recognition result

Changed

  • Beauty effect improvements

Fixed

  • Post-processing effect (when applied to framebuffer)
  • Image glitches and crashes in photo editing mode (Android)

[0.19.0] - 2019-06-17​

Added

  • Bokeh effect example
  • Icons and cons for sample effects
  • New documentation, programming guides have been added
  • Rendering view transformation API
  • Post-process library
  • Beauty app example

Changed

  • Removed Beauty effect API parameters:
  • eyes_sharping_str
  • blur_bg_enable
  • blur_lod
  • remove_bag_intensity
  • eyes_luts
  • Renamed Beauty effect API parameters:
  • makeup_tex -> eyebrows_tex
  • makeup_alpha -> eyebrows_alpha
  • eyebrows_tex -> lashes_tex
  • eyebrows_alpha -> lashes_alpha
  • Gravity in effect now respects device orientation
  • Remove life-cycle methods from BanubaSDKManader on Android
  • External texture is disabled by default (Android)
  • Action Units sample effect updated
  • Use only one camera session for all tasks (Android)
  • Improved photo processing speed
  • Sound Changer is supplied as a separate plugin
  • Swift 5 support

Fixed

  • Gracefully handle exceptions on OS X
  • Missing and frozen video textures on iOS and Android
  • Open GL crashes on Android
  • Neural network overload on Android
  • Rendering bugs for the Web version
  • Stretched camera preview (iOS)

[0.18.1] - 2019-05-29​

Added

  • SVG watermark support (Android)
  • Proguard rules for the banuba_sdk module (Android)

Changed

  • 'banuba_sdk' is now supplied in compiled form
  • BNBFullImageData can be created from RGB CVPixelBuffer with padding
  • Suspend frame processing while taking low res photo (Android)
  • Beauty effect: return default parameters after animation
  • Restart camera preview session on HR photo (Android)

Fixed

  • Video texture freeze (Android)
  • Crash during render size change

[0.18.0] - 2019-05-24​

Added

  • Processing a bitmap and applying the selected effect to it (Android)
  • Image editing mode in platform modules (Android)
  • Acne removing technology in photo processing
  • Watermarks on video (Android)
  • Considering device orientation in photo taking
  • Ability to setup several listeners in EffectPlayer
  • Support for Bitmap in the FullImageData constructor (Android)
  • Universal framework for devices and simulators (iOS)

Changed

  • Added assertions in the EffetPlayer life cycle (for video processing)
  • The hair segmentation neural network is updated

Fixed

  • Losing face orientation after an Android activity restart is fixed
  • Physics on multiface effects is working correctly
  • The app has crashed on 32 bit Androids with enabled neural networks
  • ActionUnits improvements

[0.17.1] - 2019-04-24​

Fixed

  • Exposure settings (iOS)
  • Continuous photo rendering with updated parameters

[0.17.0] - 2019-04-18​

Added

  • Continuous photo rendering with updated parameters
  • Conversion-free RGB input support
  • Image file processing example (iOS)
  • Support for landscape frame input
  • API to check Android hardware performance

Changed

  • Documentation improved
  • Swift 4.2 support in the example app
  • Updated lip segmentation neural network
  • Improved rendering quality on high-end Android devices

Fixed

  • Removed duplicate functionality in Android samples
  • Correct video orientation (iOS)

[0.16.0] - 2019-04-03​

Added

  • Neural networks for Android: lips, skin, hair, eyes, iris segmentation; background separation
  • Neural network rendering for Android
  • Full body segmentation neural network for iOS
  • Release binaries for Windows
  • New post process effects: acid whip, cathode and rave
  • x86_64 build variant for iOS simulators
  • Face detection in any orientation (Android)

Changed

  • Camera FPS increased on Huawei devices
  • Video now paused when app is in background
  • Process screenshot or HQ camera option for Android
  • Performance on low-end Android devices

Fixed

  • Video textures playback
  • Audio resume after background (Android)
  • Launch time on first run (Android)

[0.15.0] - 2019-03-14​

Added

  • Action Units and Blend Shapes
  • Take high resolution photos with effects, camera switches, and video recording (Android)
  • Post processing stage with simple effects
  • A new neural network for eye segmentation (iOS)
  • Multi-touch

Changed

  • Method to process photos from a file readded to the API
  • Hide eyes if there is no face in the test_Eyes effect
  • Binary size reduced for iOS

Fixed

  • Photo in Landscape mode on iOS
  • Animation position on photos
  • Acne removal performance on photos
  • Sounds after background (Android)

[0.14.3] - 2019-02-21​

Fixed

  • Android crash with external texture
  • Rendering area size for iOS
  • Java documentation

[0.14.2] - 2019-02-09​

Fixed

  • Version number in the iOS framework

[0.14.1] - 2019-02-01​

Added

  • iPad support for the Demo app
  • Analytics serialization
  • New lifecycle: effect is paused before background
  • Videoprocessing (desktop only)

Changed

  • Photo processing optimization
  • Android Demo Activity GC optimization

[0.14.0] - 2019-01-15​

Added

  • Haptic feedback.

Changed

  • Client APIs are automatically generated for both Java and Obj-C.
  • Documentation reflecting Java and Obj-C classes.

Fixed

  • Draw state after VAO modification made by external code (Android).
  • Sound session restoration on iOS.
  • FPS degradation on video textures (Android).

[0.13.3] - 2019-01-15​

Fixed

  • Audio session configuration (iOS)

[0.13.2] - 2019-01-14​

Changed

  • Restore the old RFX classifier

[0.13.1] - 2019-01-11​

Added

  • Watermarks on video (iOS only)

Changed

  • Beauty soft light texture without eye shadows

Fixed

  • Stretched picture during video preview on iOS
  • Fix JS calls with arguments
  • Crashfixes

[0.13.0] - 2018-12-27​

Added

  • Ability to modify the user's voice (voice changer); iOS only
  • A smaller face recognition classifier
  • Eye segmentation textures
  • Neural network for face detection (optional, disabled by default)
  • Acne removal
  • Lip segmentation

Changed

  • Improved hair segmentation on Android
  • BanubaSdkManager improvements on Android

Fixed

  • FPS calculation,
  • Overdraw on Android
  • Black screen on Mali devices

[0.12.6] - 2018-12-20​

Fixed

  • Reverted unnecessary cropping of video pixel buffer

[0.12.5] - 2018-12-19​

Fixed

  • Fix video recording for a custom size of input frame

[0.12.4] - 2018-12-18​

Added

  • Functions for retrieving effects and screen sizes from JS

Fixed

  • Rendering artefacts near the eyelid in a beauty effect (z-fighting)
  • Camera initial mode fix, custom aspect ratio support
  • Adjust the configuring exposure settings method

[0.12.3] - 2018-12-14​

Fixed

  • Fix beautification issues at high resolution
  • Fix coordinate conversion in touch events

[0.12.2] - 2018-12-12​

Fixed

  • Video recording (copy + flip on BanubaSDK side), memory management improvements

[0.12.1] - 2018-12-11​

Changed

  • Turn off the frame_brightness feature by default.
  • Enable gyroscope on demand.
  • Process image improved Fixed
  • Exposure point settings (iOS) Added
  • Effect events for Android
  • Touch events for Android

[0.12.0] - 2018-12-04​

Changed

  • EffectPlayer life cycle methods updated
  • Strict checks of the surface lifecycle
  • Face detection algorithm has been reverted to a more stable implementation
  • Resource finding path changed to subfolder (bnb)
  • Naming banuba.core -> banuba.sdk (iOS)
  • VideoRecording via TextureCache (iOS)

Added

  • Search locations in ResourceManager error message
  • Ability to setup log level and subscribe to SDK's log callback from client code
  • Methods for getting CPU Info on Android
  • Experimental neural network support on Android (background separation, hair segmentation) (special build is required)
  • Bin record interface in BanubaCore
  • Improved error reporting while effect loading
  • Beautification effect added to resources (special build is required)
  • Process a single image method with custom input and output formats (ability to take high-quality photos)
  • Experimental skin segmentation NN added to iOS
  • Experimental eye segmentation NN added to iOS
  • Ability to flip a rendered image along the Y axis
  • Touch events on iOS

Fixed

  • Fix pushFrameYVU420 method
  • Fix crash in effect_context::update (race condition)
  • Return draw error when effect loading failed
  • The Bokeh effect works on Android
  • Fix slow wireframe in DebugRenderer
  • Fix iOS crashes in shader compilation
  • Fix unpack alignment for textures with width * components not multiples of 4
  • Fix process image when external camera texture
  • Fix BG copy MRT on ANGLE WebGL (Web)
  • Fix depth test&write state after morph with hair compacting
  • Fix the minimum and maximum possible coordinates (in face recognition)
  • Fix the exposure point

[0.11.2] - 2018-11-20​

Fixed

  • Drawing artefacts with some effects

[0.11.1] - 2018-11-15​

Changed

  • Updated face recognition algorithm.

Added

  • Ability to link with a simulator on iOS.

Fixed

  • Release number for frameworks fixed
  • Fix runtime crashes with aligned new on iOS 10
  • Correctly stop the Effect Player in onDestroy and initialization in onCreate

[0.11.0] - 2018-11-08​

Added

  • Sound volume control is in effect.
  • Callback to receive events from effects (mainly for analytics).
  • Support for the Bokeh effect.

Changed

  • A new face model classifier.
  • Rendering performance optimization.

Fixed

  • Various crashes

[0.10.2] - 2018-10-08​

Fixed

  • Issues with effects display (black background instead of camera texture).
  • Dynamic shadow lags by one frame.

[0.10.1] - 2018-10-05​

Fixed

  • Face recognition black AR 3D Mask effects have been fixed on some Android devices.

[0.10.0] - 2018-10-05​

Added

  • Support of new pixel formats in effect_player::process_frame: RGBA, BGRA, ARGB, RGB, and BGR. Not supported in BanubaCore yet.
  • Binding EffectPlayer and Recognizer for Python.

Fixed

  • Launch on iOS 10.
  • Issue with audio engine lifecycle.
  • Render: The issue with the effect's shadows has been fixed.
  • Render: The issue with the depth buffer on the Xiaomi Redmi 4a has been fixed.

Changed

  • Render optimization:
  • Excess loading of 1x1 textures for background and hair AR 3D Masks was removed when these features were not used.
  • Colour correction for easysnap (lut-textures background loading - speeds up beauty effect loading and small speed up of lut layer rendering).
  • Broken effects fixes.

[0.9.1] - 2018-10-02​

Fixed

  • The dynamic shadows drawing issue has been fixed (for Banuba 3.0).

Changed

  • EffectPlayer for Backend major version was raised to 5.0.
  • Render performance optimization.
  • The Beauty Effect for both platforms should be taken from 2b959fa12a966956c6f158ded762b634eac988de or later (update Android effect).

[0.9.0] - 2018-09-28​

Fixed

  • A few crashes in the face recognition engine were fixed.
  • The issue with the AR 3D Mask  not respecting head volume after switching the effects has been fixed.

Changed

  • Render performance optimization.

[0.8.6] - 2018-09-24​

Added

  • Android version assembled with NDK 18.

Changed

  • Face recognition improved performance, improved anti-tremble, smoothing and so on.

[0.8.5] - 2018-09-21​

Fixed

  • Fixed initialization crash.

[0.8.4] - 2018-09-21​

Added

  • Debug render antialiasing.

Changed

  • Beautification effect performance has increased.
  • Face recognition performance has increased.

[0.8.3] - 2018-09-21​

Changed

  • The binary file size was reduced for iOS (17.7 MB against 19.7 MB).

[0.8.2] - 2018-09-19​

Fixed

  • Issues with single frame processing were fixed.

Changed

  • Performance has improved.

[0.8.1] - 2018-09-14​

Added

  • Minor render optimizations (excess glGetInteger were removed).

Changed

  • Low-light feature has been reverted because it has issues.

[0.8.0] - 2018-09-12​

Added

  • A new audio player.
  • Callback on low light detection.

Changed

  • Improvements in face recognition library (performance in multiface mode has been increased, recognition angles have been increased, predictability of recognition work time has been improved - detection distribution by frames with self scheduler.
  • Improvements in render performance (number of passed parameters into shader interpolation were decreased - pixel shaders patch in glfx).
  • More accurate draw of the camera image (NEAREST filtration).

[0.7.2] - 2018-09-11​

Fixed

  • Issues with effect_player_wrap-ios.framework were fixed.

[0.7.1] - 2018-09-07​

Fixed

  • Fixed issue with crash in v0.7.0 release.

[0.7.0] - 2018-09-05​

Added

  • Photo mode frame processing (high resolution frame processing).
  • Consistency mode for camera external texture (Android).
  • Ability to get the version of EffectPlayer from the backend.
  • Ability to get the number of rendered frames and pass the number in push_frame.
  • Face recognition finds faces at a large angle (up to 30 degrees).
  • Ability to set the texture parameters through suffixes in their names.
  • The framework version is transferred to Manifest after building, AAR assembling completely automated (Andorid).

Fixed

  • Fixed issue with context loss on Android.
  • Effects with occlusion are fixed.
  • Small bug fixes.

Changed

  • Strong reference on Delegate has been removed in iOS.

[0.6.2] - 2018-08-31​

Fixed

  • Fixed deadlock when drawing regular camera texture.

[0.6.1] - 2018-08-29​

Added

  • Consistent external texture for Android.
  • Zeroing face counter on onStop event.

[0.6.0] - 2018-08-21​

Fixed

  • Fixed and significantly improved inconsistency modes (which were given earlier in unversioned release).
  • Images strides from the camera were fixed for Android.
  • Fixed issue with long camera initialization.

Changed

  • Default iOS mode was changed to inconsistency-without-face (was given earlier in unversioned release).
  • Updates in gender recognition (works fast and once in 3 seconds at the moment).

[0.5.2] - 2018-07-31​

Added

  • Possibility to enable inconsistency mode on iOS, it is possible to skip frame processing to render the image.
  • Possibility to receive device orientation in script (it is possible to disable background separation according to orientation).
  • Possibility to create a few recognizer instances (basically for DiffCat, not yet presented in EP API).
  • Possibility to transmit both camera matrix into the script (needed for morphing creation in accordance to distance from camera).
  • Recognizer coverage with performance tests has started.

Fixed

  • Potential crash with keeping color_plane was fixed.
  • Fixed wrong_fb_after_morph.

[0.5.1] - 2018-07-26​

Fixed

  • Beauty settings doesn’t apply issue has been fixed.

Changed

  • Unnecessary Android resources were removed.

[0.5.0] - 2018-07-24​

Added

  • Consistency/inconsistency modes switching (Android).
  • Blur background.
  • Performance collection using systrace (Android).
  • 32-bit support (but slow at the moment).
  • Possibility to transfer a frame number that has come from the camera.
  • Possibility to disable background separation and other recognizer features from scripts.
  • Switching between external textures and drawing from ImageReader (Android).

Fixed

  • Huawei issues (Android).
  • Colours conversion bug fix (colour correction).

Changed

  • Optimized morphing.