- WebAR: nn_api support (including Safari)
- WebAR: Video textures support
- WebAR: API to set the number of faces to track
- WebAR: Lips effects support on iOS (Safari)
- Xcode 12.5 support
- Android: Screen is flashing when switching effects
- Android: GPU-specific deadlock issues
- iOS: Demo app crash on iOS < 13.5
- WebAR: Fixed textures alpha-blending
- Windows: Effect with video has failed to load
- Windows: standalone build failure on x86 platform
- Do not crash app when assert has failed
- JS engine fixes
- Lips shine effect
- Various effects fixes
- New render engine aka Scene
- WebGL 1.0 support (for Safari)
- Metal support
- Support non-ASCII symbols in paths
- New Background segmentation neural networks (Desktop)
- New Background segmentation neural networks (Web)
- Hair segmentation support on Windows platform
Player.applyEffectwill now throw an exception if effect's underlying source is not a .zip archive
- Initial support of Apple M1
- ARKit disabled by default (iOS)
- Strip unnecessary symbols on macOS
- Use only minimum required subset from OpenCV on macOS
- Use TFLite 2.4.1 without Metal delegate on macOS
- API to set animated background in effects dynamically
- WebAR: Firefox video processing issue
- Android: Orientation fixes
- Android: Sound issues and minor improvements
- Unity: iOS plugin size
- Face Ruler for Android platform
- Unity: New Action Units effect with background segmentation
- Distribute EffectPlayer for iOS as xcframework
- Build with disabled face tracking
- WebAR: Background support in landscape
- BG support field in effect_info
- Android: Java 8+ API desugaring support
- Viewer extra options for processing
- tflite_runner different delegates support for each feature
- Android: Add static tensorflow lite version
- Enable RGB camera on devices with Snapdragon 625
- Processed images location in Banuba Viewer
- Skin smoothing NN update (iOS)
- WebAR: ES6 to ES5 transpilation issue
- WebAR: loading of non existing effect
- WebAR: several performance issues
- Hair segmentation: TFLite input copy error
- Prior fixes to work with frx_meta logic
- Incorrect effects display on Android 10
- Android: Effect size after rotation
- Add listener as soon as test_Ruler or FaceRuler effect is activated
- Enable face recognition neural network for mid-end Android devices
setEffectSizefix for Android
- Lips shine mask incorrect work with back camera
- Display FPS stats in desktop viewer app
- Beauty scene for Unity plugin
- Android: Ability to Override Detected Resolution
- Lips recoloring with glitter effect (also supported in Banuba Viewer)
- Distance to face (ruler feature)
- Updated tflite for windows to 2.3
- Both tflite runners creation on first request
- Text texture enabled by default
- iOS: incorrect BG work on photo in landscape
- Unity: fix aspect on mobile devices
- Delayed camera start
- Repacking errors
- Front camera flip
- 'Face not found' message after load photo from Gallery
- Added handling of IllegalArgumentException to prevent crashes dependent on surface configuration
- Effect activation listener
- Unity: Separate render target for beauty scene for the LUTs
- Decreases CPU load on MacOS
- Crash during effect preload
- Mesh trembling with fast face tracking
- Unity: Aspect of Background segmentation
- Crash during fast effect switching
- New background model
- New WebAR API
- WebAR quickstart Demo app
- WebAR beauty demo app
- Native OSX camera implementation
- Web and Desktop getting started added
- Possibility to customize capture session preset (iOS)
- Desktop apps examples for Win and Mac
- Demo effects without face recognition
- Xcode 12 support
- Eye corrector v2.0: improved stability and performance
- Makeup API improvements
- Use setBackgroundTexture with absolute path
- Face tracking stability and performance optimization
- Update offline face tracking (Android)
- Separate mask for neck smoothing feature
- Crash with effect reset (Android)
- Missing logs in Viewer Standalone
- Android video player loop
- Memory leak on desktop when using animated textures
- Quickstart example apps fixes
- Unity background fix
- ARKit face detection failure
- SDK Features control and repacking with client token and client config
- Minimal SDK archive
- SDK build for MacOS
- Makeup transfer feature
- Photo online processing in Banuba Viewer
- Ability to enable effects and neural networks without face recognizer
- Eye brows segmentation NN
- Neck smoothing neural network
- Set camera FPS mode on Android (fixed/adaptive)
- Represent SDK frames as OpenGL textures (WebRTC for Android)
- New beautification API
- Updated Background Segmentation neural network for standalone builds
- Face recognizer work on full frame
- Landmarks smooth filter
- Updated eyes corrector
- Updated face recognition neural network
- Unity scene works in full screen mode
- OpenCV updated to 4.3.0
- Range android devices hardware class and max resolution for it
- Unity plane does not update rect
- Video player fix
- Heart rate measurement with neural network face search
- Segmentation neural networks work with arkit
- Unity WebGL build
- Fix Unity failure on Win platform
- Crashes on effect unload
- Correctly handle MRT rendering into background camera texture
- Black screen on devices with ARKit
- Background segmentation on Win x86
- WebAR SDK blocks Backspace key
- Banuba SDK work on devices with iOS 14
- Second mask freezes on the screen in scene effects
- Eyes correction feature
- Hide Boost symbols
- Asynchrony of sound and video after file import
- iOS: App freezes after background in Editing mode
- Android beauty: Screen is flashing after launch
- Crash on Editing Image
- App crashed in editing mod on iPhone XS Max
- EffectPlayer is not launched from 1st time
- Second face is missed if to use front Camera (with ARKit)
- WebAR support for Unity platform
- Background segmentation for Unity platform
- Max Faces support in client token
- Videocall example for iOS
- Minimal configuration of Banuba SDK
- EffectPlayer EffectManager
- EP version has changed to 5.6
- Enable bitcode by default (iOS)
- Compilation error on Ubuntu
- Body segmentation neural network rotation
- Viewer Standalone build
- MSVC x64 Eigen crash
- App won't throw exception when neural network resources are missing
- Optimized face beautification
- Fix audio session (iOS)
- Bakground segmentation failures (iOS)
- Creepy smile fixes
- Portrait match fixes
- Skin smoothing fixes
- Crash on Android with neural face recognition
- Creepy smile neural network (iOS)
- Manual audio session in BNBEffectPlayer (https://docs.banuba.com/face-ar-sdk/overview/migration_guides#to-version-029x)
- Skin smoothing neural network (iOS)
- New face recognition and trackig algorithm for offline (Android)
- Banuba Viewer color picker reacts to background and lips neural networks
- Make WebAR SDK ES6 module
- Updated llvm backend for WebAR
- WebAR improvements
- Lips segmentation on Android HQ photo
- Memset buffer overflow when using Action Units
- Jaw mesh stretching fix in face trackig algorithm
- Enabled bitcode in iOS release
- Portrait match technology
- Portrait match technology
- Update Effect Player for video calls, support callkit audio session specifics
- Switch to fast face recognition algorithm for weak iOS devices
- Celebrity match technology fixes
- Crash on Banuba Viewer close
- New face recognition and trackig algorithm for realtime (iOS)
- Full Body segmentation can be applied again (iOS)
- Banuba Viewer UI changes
- Adapt Action Units to use new face recognition algorithm (iOS)
- Adapt triggers to use Action Units (iOS)
- Physics behavior for effects on devices with ARKit (iOS)
- Effects render on low-level Android devices
- Unity openCV error
- Small recognizer fixes for iOS platform
- ARKit multiface support
- Android strong devices list updated
- Multiface effects render
- Multiface issues
- Crash when processing photo with 2 faces
- Effects render with ARKit on iPhone X
- Greatly improved face detection in offline mode (iOS, for photos)
- Objective-C full support
- More examples for iOS and Android
- Improved beauty effect
- Lips shine effect improved
- Ability to choose camera from command line on Desktops
- Persistent OpenGL context on Android (don't recreate it after app goes in background)
- Safely ignore GL errors on Android
- Beauty effect is enabled by default
- Lips shine effect
- Neural networks behaviour after face was lost
- Advanced lips recoloring
- Action Units from ARKit
- x86 support for Windows
- Lazy textures load
- Improve Unity sample effects
- Bokeh effect improved
- Enable beauty by default in sample effects
- Improve acne and bags removal performance
- Hair stands blending perfomance improvement
- Threads leak on Android
- WebGL FPS stabilization
- Memory issue on Android
- Memory issue on iPhone6+
- Crash during rendering on Adreno 610
- Camera open error on Android
- Bundle version in xCode project
- Eye bugs removal
- Neural network based acne removal
ARKitfor face tracking when available
- Eyes state trigger and ruler features in recognizer API
- API to change sound volume from Java Script
- Option to add effect from external folder in sample application (Android)
- Improve API (SDK for browsers)
- Don't reload effect if there was an error in Java Script
- Decrease memory pressure while creating multiple
- Crash on effects with 3 and more faces
- Improved camera FPS on selected low-end Android devices
- Update documentation with examples of new UI
- Video recording on Android
- Crash after exit from application
- Memory leak on Android
- Crashes when interacting with Android Demo app
- Glasses detection
- Improved stability (aka jittersing) of face tracking
- Recognition results in Python bindings
- Migration to AndroidX
- New redesigned UI for Banuba SDK Demo AP (Android and iOS)
- Video textures decoding on Android 10
- Crash while going to background on iOS
- Audio recording speed on Android
- Lag during neural networks initialization
- Various camera fixes for Android
- Neural network based approach to detect faces. Quality, detection angles and speed of face detection was improved
- Neural networks support for Windows and Web.
- Unity plugin
- Sync audio and video during recording on Android
- Fast background on iPhone 6 and lower.
- Correct neural networks behavior during device rotations
- Video textures support (Android 10)
- Crashes on Adreno chipsets
- Stability fixes
- Lips coloring API in
- Option to switch off face recognition in
- Option to set preferred frame-rate on iOS
- Lips segmentation neural network updated (Android)
- Rendering on Andreno GPUs
- Video texture decoding issue on Android
- Android crash on app coming from background
- Crash on iPhone 5 after video capture
- Hair and lips recoloring in "Beauty" effect
EffectPlayerthreading model documentation
- SDK features documentation
- API to check if device is compatible with Neural Networks player
BanubaSdkManagercan be instantiated more then once (see "Migration Guides").
- Use background mask transform for background separation layer from
- Sample app signing (iOS)
- Rendering bugs after effect switch
- Correct screenshot size on Android
- "End touch" event (iOS)
- background separation layer from config.json (Android)
- Fix photo processing with MSAA enabled on Android
- Sample ASMR effects
- Render passes
- Rendered frames forwarding as byte arrays (Android)
- Ability to debug JS
- Reset effect cache API call
- Watermark gravity (Android)
- Sample background separation effect blending improved
- Background separation feature respects gyroscope data
- Ignore gyroscope during photo and video processing
- Beauty effect improvements
- Color post-processing effect
- Face rect API from face recognition result
- Beauty effect improvements
- Post-processing effect (when apply to framebuffer)
- Image glitches and crash in photo editing mode (Android)
- Bokeh effect example
- Icons cons for sample effects
- New documentation, programming guides added
- Rendering view transformation API
- Post-process library
- Beauty app example
Beautyeffect API parameters:
Beautyeffect api parameters:
- makeup_tex -> eyebrows_tex
- makeup_alpha -> eyebrows_alpha
- eyebrows_tex -> lashes_tex
- eyebrows_alpha -> lashes_alpha
Gravity in effect now respects device orientation
Remove life-cycle methods from
External texture disabled by default (Android)
Action Units sample effect updated
Use only one camera session for all tasks (Android)
Improved photo processing speed
Sound Changer is supplied as separate plugin
Swift 5 support
Gracefully handle exceptions on OS X
Missing and frozen video textures on iOS and Android
Open GL crashes on Android
Neural networks overload on Android
Rendering bugs for Web version
Stretched camera preview (iOS)
- SVG watermark support (Android)
- Proguard rules for banuba_sdk module (Android)
banuba_sdknow supplied in compiled form
BNBFullImageDatacan be created from RGB
- Suspend frame processing while taking low res photo (Android)
- Beauty effect: return default parameters after animation
- Restart camera preview session on HR photo (Android)
- Video texture freeze (Android)
- Crash during render size change
- Processing Bitmap and apply current selected effect on it (Android)
- Image editing mode in platform modules (Android)
- Acne removing technology in photo processing
- Watermarks on video (Android)
- Considering device orientation in photo taking
- Ability to setup several listener in EffectPlayer
- Support of Bitmap in FullImageData constructor (Android)
- Universal framework for device and simulator (iOS)
- Added assertions in EffetPlayer life cycle (for video processing)
- Hair segmentation neural network is updated
- Losing face orientation after android activity restart is fixed
- Physics on multiface effects is working correctly
- App has crashed on 32 bit Androids with enabled neural networks
- ActionUnits improvements
- Exposure settings (iOS)
- Continuous photo rendering with updated parameters
- Continuous photo rendering with updated parameters
- Conversions-free RGB input support
- Image file processing example (iOS)
- Support for landscape frame input
- API to check Android hardware performance
- Documentation improved
- Swift 4.2 support in example app
- Updated lips segmentation neural network
- Improved rendering quality on high-end Android devices
- Removed duplicate functionality in Android samples
- Correct video orientation (iOS)
- Neural networks for Android: lips, skin, hair, eyes iris segmentation; background separation.
- Neural networks rendering for Android.
- Full body segmentation neural network for iOS.
- Release binaries for Windows.
- New post process effects: acid whip, cathode, rave.
- x86_64 build variant for iOS simulators.
- Face detection in any orientation (Android).
- Camera FPS increased on Huawei devices.
- Video now paused when app is in background.
- Process screenshot or HQ camera option for Android.
- Performance on low-end Android devices.
- Video textures playback.
- Audio resume after background (Android).
- Launch time on first run (Android).
- Action Units and Blend Shapes
- Take high resolution photo with effect, camera switch, video recording (Android)
- Post processing stage with simple effects
- New neural network for eyes segmentation (iOS)
- Method to process photo from file readded to API
- Hide eyes if there is no face in test_Eyes effect
- Binary size reduced for iOS
- Photo in Landscape mode on iOS
- Animation position on photos
- Acne removal performance on photos
- Sounds after background (Android)
- Android crash with external texture
- Rendering area size for iOS
- Java documentation
- Version number in iOS framework
- iPad support for Demo app
- Analytics serialization
- New lifecycle: effect is paused before background
- Videoprocessing (desktop only)
- Photo processing optimization
- Android Demo Activity GC optimization
- Haptic feedback.
- Client API automatically generated both for Java and Obj-C.
- Documantation reflecting Java and Obj-C classes.
- Draw state after VAO modification made by external code (Android).
- Sound session restore on iOS.
- FPS degradation on video textures (Android).
- Audio session configuration (iOS)
- Restore old RFX classifier
- Watermarks on video (iOS only)
- Beauty soft light texture without eye shadows
- Stretched picture during video preview on iOS
- Fix JS call with arguments
- Ability to modify user's voice (voice changer); iOS only
- Smaller face recognition classifier
- Eyes segmentation textures
- Neural network for face detection (optional, disabled by default)
- Acne removal
- Lips segmentation
- Improved hair segmentation on Android
- BanubaSdkManager improvements on Android
- FPS calculation,
- Overdraw on Android
- Black screen on Mali devices
- Reverted unnecessary cropping of video pixel buffer
- Fix video recording for custom size of input frame
- Functions for retriving effect and screen sizes from js
- Rendering artifacts near eyelid in beauty effect (z-fighting)
- Camera initial mode fix, custom aspect ratio support
- Adjust configuring exposure settings method
- Fix beautification issues on high resolution
- Fix coordinates conversion in touch event
- Video recording (copy + flip on BanubaSDK side), memory management improvements
- Turn off frame_brightness feature by default.
- Enable gyroscope on demand.
- Process image improved Fixed
- Exposure point settings (iOS) Added
- Effect events for Android
- Touch events for android
- EffectPlayer life cycle methods updated
- Strict checks of surface lifecycle
- Face detection algorithm reverted to more stable implementation
- Resource finding path changed to subfolder (bnb)
- Naming banuba.core -> banuba.sdk (iOS)
- VideoRecording via TextureCache (iOS)
- Search locations in ResourceManager error message
- Ability to setup log level and subscribe to SDK's log callback from client code
- Methods for getting CPU Info on Android
- Experimental neural network support on Android (background separation, hair segmentation) (special build is required)
- Bin record interface in BanubaCore
- Improved error reporting while effect loading
- Beautification effect added to resources (special build is required)
- Process single image method with custom input and output formats (ability to take high-quality photos)
- Experimental skin segmentation NN added on iOS
- Experimental eyes segmentation NN added on iOS
- Ability to flip rendered image along the Y axis
- Touch events on iOS
- Fix pushFrameYVU420 method
- Fix crash in effect_context::update (race condition)
- Return draw error when effect loading failed
- Bokeh effect works on Android,
- Fix slow wireframe in DebugRenderer
- Fix iOS crash in shader compilation
- Fix unpack alignment for textures with
width * componentsnot multiple of 4
- Fix process image when external camera texture
- Fix bg copy MRT on ANGLE WebGL (Web)
- Fix depth test&write state after morph with hair compacting
- Fix min and max possible coordinates (in face recognition)
- Fix exposure point
- Drawing artifacts on some effects
- Updated face recognition algorithm.
- Ability to link with simulator on iOS.
- Release number for frameworks fixed
- Fix runtime crash with aligned new on iOS 10
- Correctly stop Effect Player in onDestroy and initialization in onCreate
- Sound volume control in effect.
- Callback to receive events from effects (mainly for analytics).
- Support for Bokeh effect.
- New face model classifier.
- Rendering performance optimization.
- Various crashes
- Issues with effects display (black background instead of camera texture).
- Dynamic shadow lag by one frame.
- Face recognition black mask in effects has fixed on some Android devices.
- Support of new pixel formats in effect_player::process_frame: RGBA, BGRA, ARGB, RGB, BGR. Not supported in BanubaCore yet.
- Binding EffectPlayer and Recognizer for Python.
- Launch on iOS 10.
- Issue with audio engine lifecycle.
- Render: issue with effect's shadows has been fixed.
- Render: issue with depth buffer on Xiaomi Redmi 4a has been fixed.
- Render optimization:
- Excess loading of 1x1 textures for background and hair masks was removed when these features are not used.
- Color correction for easysnap (lut-textures background loading — speeds up beauty effect loading and small speed up of lut layer rendering).
- Broken effects fixes.
- Dynamic shadows drawing issue has been fixed (for Banuba 3.0).
- EffectPlayer for Backend major version was raised to 5.0.
- Render performance optimization.
- Beauty Effect for both platforms should be taken from 2b959fa12a966956c6f158ded762b634eac988de or later (update Android effect).
- A few crashes in face recognition engine were fixed.
- Issue with mask does not respect head volume after switching the effects has been fixed.
- Render performance optimization.
- Android version assembled with NDK 18.
- Face recognition improved performance, improved anti-tremble, smoothing and so on.
- Fixed initialization crash.
- Debug render antialiasing.
- Beautification effect performance has increased.
- Face recognition performance has increased.
- Binary file size was reduced for iOS (17.7 MB against 19.7 MB).
- Issues with single frame processing were fixed.
- Performance has improved.
- Minor render optimizations (excess glGetInteger were removed).
- Low-light feature has been reverted because it has issues.
- New audio player.
- Callback on low light detection.
- Improvements in face recognition lib (performance in multiface mode has been increased, recognition angles has been increased, predictability of recognition work time has been improved — detection distribution by frames with self scheduler.
- Improvements in render performance (number of passed parameters into shader interpolation were decreased — pixel shaders patch in glfx).
- More accurate draw of the camera image (NEAREST filtration).
- Issues with
- Fixed issue with crash in v0.7.0 release.
- Photo mode frame processing (high resolution frame processing).
- Consistency mode for camera external texture (Android).
- Ability to get the version of EffectPlayer from backend.
- Ability to get the number of rendered frame and pass number in push_frame.
- Face recognition finds face at a large angle (up to 30 degrees).
- Ability to set the texture parameters through suffixes in their names.
- Framework version is transferred to Manifest after building, AAR assembling completely automated (Andorid).
- Fixed issue with context lose on Android.
- Effects with occlusion are fixed.
- Small bug fixes.
- Strong reference on Delegate has been removed in iOS.
- Fixed deadlock when drawing regular camera texture.
- Consistent external texture for Android.
- Zeroing face counter on onStop event.
- Fixed and significantly improved inconsistency modes (was given earlier in unversioned release).
- Images strides from the camera were fixed for Android.
- Fixed issue with long camera initialization.
- Default iOS mode was changed to inconsistency-without-face (was given earlier in unversioned release).
- Updates in gender recognition (works fast and once in 3 seconds at the moment).
- Possibility to enable inconsistency mode on iOS, it is possible to skip frame processing to render the image.
- Possibility to receive device orientation in script (it is possible to disable background separation according to orientation).
- Possibility to create a few recognizer instances (basically for DiffCat, not yet presented in EP API).
- Possibility to transmit both camera matrix into the script (needed for morphing creation in accordance to distance from camera).
- Recognizer coverage with performance tests has started.
- Potential crash with keeping color_plane was fixed.
- Fixed wrong_fb_after_morph.
- Beauty settings doesn’t apply issue has been fixed.
- Unnecessary Android resources were removed.
- Consistency/inconsistency modes switching (Android).
- Blur background.
- Performance collection using systrace (Android).
- 32-bit support (but slow at the moment).
- Possibility to transfer frame number which has come from camera.
- Possibility to disabled background separation and other recognizer features from scripts.
- Switching between external texture and drawing from ImageReader (Android).
- Huawei issues (Android).
- Colors conversion bug fix (color correction).
- Optimized morphing.