Softpedia >Windows >Multimedia >Graphic >Graphic Others >Lens Studio >  Changelog

Lens Studio Changelog

What's new in Lens Studio 5.0.2 Beta

Dec 16, 2023
  • Improved:
  • Default blend mode for eye color has been updated
  • Lens Developers can now manage render order directly in the Scene Hierarchy panel
  • Support for multiple head visuals in the 3D Scene Editor
  • Fixed:
  • Interactive Environment move works with english locale only
  • Fixed issue when JS changes were not saved
  • Fixed issue when assets import from Asset Library has been completed with errors
  • Fixed UI issue with text scaling for import dialog
  • Fixed issue when import of VFX asset has been completed with errors
  • Fixed crash of application on assignment of deviceCameraTexture input
  • Fixed issue when scroll has been reset during renaming of object and confirm renaming in Asset Browser
  • Fixed issue when gif was imported incorrectly
  • Fixed issue when Preview doesn't show surface tracking on launch
  • Error message from preview now referencing the script file name instead of Display Name
  • Fixed app crash after push to device
  • Fixed issue with Particle Screen UV
  • EXR format can be imported into application
  • Fixed issue with Show Info for Nodes and node connections
  • Fixed issue in Graph Inspector info for the "If / else" node
  • Move and unified mouse modes now update its manipulator’s rotation after mouse release
  • Fixed issue with VFX export
  • Fixed issue with moving gizmo when it was locked
  • Fixed issue with Lens Based Editor when History panel was active
  • Context menu for Graph/Script/VFX Editors has been restored
  • Fixed issue with Rotation Gizmo in 3D Scene
  • Fixed issue when script is not run when enabling its parent
  • Fixed app crash when loading project saved on different devices
  • Fixed issue when assets from saved project can be replaced with old assets
  • Fixed issue when animation does not work after import
  • Fixed issue when multiple duplicated custom components are present after custom component import
  • Fixed application crash on importing assets from Asset Library
  • Fixed application crash when hitting Cancel in Lens Preview
  • Fixed application crash when passing Render Target to the Texture property of this Render Target
  • Fixed application crash when pressing the Escape key on the Change Layer Color window
  • Fixed issue with lags in 2D scene when working with Canvas
  • Fixed application crash when working with UI Scroll View custom component
  • Fixed application crash when deleting head binding or creating face preset
  • Fixed application crash on specific custom component import
  • Fixed issue when Ambient Lighting doesn't work
  • Fixed application crash when using Favoriting "Head Binding" in Object panel
  • Fixed issue when user can not update render order via Scene Hierarchy panel
  • Fixed application crash on Windows when working with assets in folder in Asset Browser
  • Fixed issue with naming of imported 3D models
  • Fixed issue when saved script can be restored to old saved content

New in Lens Studio 4.55.1 (Dec 13, 2023)

  • New:
  • If you're experiencing consistent crashes while using Lens Studio, the Troubleshooting Lens Studio guide will help you address many issues and provide some recommendations for a more stable experience.

New in Lens Studio 4.53 (Aug 16, 2023)

  • New:
  • Lens Developers building City-Scale AR experiences will now be able to explore the area in an interactive environment in the Preview panel with the new Interactive Camera View.
  • Through our partnership with OpenCV, Snap is providing a training notebook that allows you to train ML Models that support Optical Character Recognition.
  • The Optical Character Recognition Template provides two parts to help Lens Developers get started with OCR; how to train a powerful OCR model, and a Lens Studio template.
  • Lens Studio now offers the ability to utilize Pixels or Points, known as Device Independent Pixels, when adding a SceneObject to a Camera. When setting fields like size, padding, offsets or the various fields of the Layout Element, you can use the new device independent point unit instead of centimeters.
  • The Meme Template offers Lens Developers an easy way to create movable screen sticker Lens by simply providing an image.
  • The Quiz Template provides a convenient way to create quiz Lens by simply providing JSON data or directly editing the quiz in the Inspector panel.
  • Improvements:
  • Major stability improvements, see the FIXED to learn more.
  • Support for ML Assets has been added to Remote Assets.
  • Multiple performance improvements to VFX Editor assets, especially for projects that have a lot of VFX in the scene.
  • Display Street Level Supported Area Info.
  • Spotlights now has a Falloff option.
  • PVR default for JPG in Lens Studio + template update
  • True Size support to Eyewear Try-On Template
  • Convert Graph GPU Particles to use instancing
  • The Particles Template has been updated to use the new Instancing GPU Particles
  • Fixed:
  • Fixed issue when Lens Studio application may crash during undo for parameters on materials/shaders
  • Fixed issue when textures were duplicated on project reopen
  • Fixed issue when Serializated prefab script order does not match unserialized prefab of script
  • Fixed issue when video textures and other resources have been duplicated on project reopen
  • Fixed issue when Lens Studio application can be crashed on project reopen when unsupported entities have been added into project folders accidentally
  • Fixed issue with getPixels function
  • Fixed Lens Studio application crash with mp4 resource
  • Fixed issue when Lens Studio application creates unused folders as resource
  • Fixed issue when user can not see city map in Map panel
  • Fixed issue when Lens Studio application crashes when printing the destroyed collider component
  • Fixed issue when Lens Studio application crashes with old projects structure during scene objects selection
  • Fixed issue with Project Info menu items
  • Fixed issue when projects created on macOS won't open on Windows OS

New in Lens Studio 4.49 (Jun 22, 2023)

  • New:
  • The Lens Performance Toolkit enables Lens Developers to view performance statistics of their Lens by pairing with their mobile device.
  • The Masking Component helps to make sure content is visible only within a certain window of the screen. It helps create an invisible frame that hides content when that content moves outside of frame.
  • The Face Stickers template allows you to quickly build a face sticker Lens. With this template, you can place any images or texts of your choice on positions relative to the face.
  • The Necklace Try-On Template offers a quick way for you to get started with Necklace based AR Try-On Lens experiences
  • With the Eyewear Try-On Template, Lens Developers can create unique glasses AR Try-On experiences at professional level. The Eyewear Try-On Template offers a quick way for you to get started with Glasses based Try-On experiences.
  • The ML Retouch features offers Lens Developers a way to switch this feature on for beauty Lenses, or any Lens that involves the front-facing camera, to naturally enhance a Snapchatter’s face while keeping unique facial features like freckles, beauty marks and more.
  • The "What 'X' Are You?" Template allows you to build your own unique spinner Lens by simply providing a list of words, images, colors, or a combination of them.
  • Lens Studio now supports Machine Learning models from Roboflow.
  • Lens Studio’s scripting runtime has transition to utilize Javascript ES6.
  • Improvements:
  • Face Tracking effects working will now perform more optimally when used together with the Garment Transfer custom component.
  • Footwear Try-On has been updated to a SnapML model that better detects the user’s foot and provides a better quality try-on experience.
  • The Earring Try-On Template has been updated to showcase additional features to enhance the user experience.
  • Raytracing has been updated to improve performance out of the box
  • Lens Studio Project Information has been updated to declare if a Lens will be a Camera Kit Lens directly within Lens Studio.
  • City-Scale AR Template has been updated to showcase more in-depth information about how City-Scale AR Content works.
  • The Wristwear Try-On Template has been updated to utilize a new wrist occluder asset that is customizable to fit your Lens Experience.
  • Fixed:
  • Fixed issue with vertex color on latest Nvidia drivers.
  • Fixed issue with shaders/materials on latest Nvidia drivers.
  • Fixed issue when remote assets rendered without textures.
  • Fixed Tween Manager example.
  • Fixed issue when LS crashed when trying to attach VSCode debugger.

New in Lens Studio 4.46 (May 3, 2023)

  • New:
  • Hand and Nails Normals Maps allows developers to precisely add art to a user’s individual nails with a new subset of the Hand Segmentation Mask.
  • Nail Segmentation is now out of beta and ready for public use.
  • Improvements:
  • The Garment Transfer Custom Component has been updated to include better quality rendering and support for a broader variety of textures and colors. This also includes the ability to create garments that feature animated content, the ability to provide a custom segmentation mask for garments and better target tracking.
  • New Workflows and interactions has been included to make working with Location AR content easier in the Interactive Environment.
  • Update Uber PBR material with code node.
  • `Duplicate` selected button added for Animation Layer.
  • Range Type updated with `Frames` by default.
  • Improves behavior for custom component development to show unknown type widget for user via Logger with error and line number.
  • Fixed:
  • Fixed issue with Lens Studio freeze when Lens Studio is trying to compile TS files.
  • Fixed issue when Lens Studio application can crash during HDR texture import.
  • Fixed issue when project can not be open after resource corruption.
  • Fixed issue when project can be corrupted after prefab import with custom component.
  • Fixed issue when @type name inputs were cleared after resource import-export.
  • Fixed issue when project can be corrupted when saved in cloud services.
  • Fixed issue when specific prefab can freeze Lens Studio application.
  • Fixed issue when project can be corrupted after import of specific prefabs which has VFX resource.
  • Fixed issue when second mobile device which was paired with Lens Studio will not receive notification in Snapchat app after lens push.
  • Fixed issue when user can received notification that shader needs to be updated for VFX asset.
  • Fixed issue when Render Order was forced to AUTO for instantiated prefab.
  • Fixed issue when user can not open project after fbx model was imported into it.

New in Lens Studio 4.43 (Mar 22, 2023)

  • New:
  • Cubemaps offers Lens Developers the ability to apply multiple 2D Textures to an individual face of a cube to be used to generate effects such as skyboxes, reflections and unique lighting setups.
  • The Cubemap Template showcases various ways Lens Developers can use cubemaps to create lightweight and complex lighting solutions.
  • SnapML’s new Portrait Relighting introduces the ability to enhance or change the light and background of photos, as well as adding your own custom lighting to photos.
  • The Gem Rendering Custom Component provides Lens Developers a way to reproduce the unique lighting effects in gemstones such as ruby, sapphires and diamonds.
  • The Gem Rendering Template offers Lens Developers a quick way to get started with building Gemstone focused Lenses.
  • The Physics Lab template in conjunction with the Content Editor Tools, teaches both Lens Developers and Snapchatters how to both author and play a simple physics-based game on device and from within Lens Studio.
  • Lens Studio Visual Studio Code Extension has been released to the VSCode Marketplace to help streamline Lens Studio development in VSCode.
  • Improvements:
  • Lens Developers can now opt-out of using the Version Control Friendly Project Format.
  • Support for Multiple Custom Locations in a single Lens.
  • Fixed:
  • Fixed crash of Lens Studio application when update materials dialog applied for Responsive Plants template
  • Fixed issue when user received update materials button after project reopen instead of on state when assets were added into project
  • Fixed issue when project can not be reopened on macOS after custom components was deleted from the project
  • Fixed crash of Lens Studio application when project with VFX assets was optimized
  • Fixed crash of Lens Studio application when import of ML model was canceled
  • Fixed issue when user received unexpected user dialog in Lens Studio Tutorial
  • Fixed issue when animated WebP asset imported as upside down
  • Fixed issue when ‘getTimeLeft’ for delayed events returning elapsed time, not remaining time
  • Fixed issue when Lens Studio application will not revert updated shaders to old version after Undo
  • Fixed crash of Lens Studio application if script invalidates a physics body
  • Fixed issue on Windows OS when user can not reopen project which was saved in folder connected with Google Drive
  • Fixed issue when Connected lens template shows error level log if not hitting the join button

New in Lens Studio 4.40.1 (Feb 24, 2023)

  • Improvements:
  • Optimized load time when opening a new project.
  • Fixed:
  • Fixed a crash affecting opening the City-Scale AR template.
  • Fixed issue where changes to the node editor would not be saved as they’d get reverted on project-open.
  • Fixed issue where submitting lenses with with special characters in the name resulted in them getting trimmed.
  • Fixed a crash caused by duplicating segmentation texture resources.

New in Lens Studio 4.40.0 (Feb 15, 2023)

  • New:
  • RayTracing in Lens Studio is a rendering technique to produce incredibly realistic looking images by simulating the way light behaves in the real world. With Lens Studio 4.40, the first set of Ray Tracing features include Real Time Reflections and RT Materials.
  • While all features go through foundational testing and QA before release, it’s possible that certain technologies can impact delivery and performance of your Lens. Those first to leverage new capabilities take on the risk of unproven technologies in order to drive innovation and testing. For Sponsored Lenses in particular, make sure to follow our best practices for optimal File Size, Frames per Second (FPS), and other optimizations that are critical for success.
  • The Ray Traced Reflections Template showcases how to get started with creating Ray Traced Reflections within Lens Studio.
  • Lens Studio 4.40 now offers a new Version Control Friendly Project format to help you streamline collaboration on projects, especially when you’re working in teams.
  • Multiple templates have been updated to reflect the new Version Control Friendly Project format.
  • The Facial Features Segmentation Custom Component provides multiple segmentation options for creating different Face AR and Try-On experiences by utilizing different facial landmarks.
  • Lens Studio now offers an offline mode when no internet connection is available.
  • Sync Framework has been updated to address issues and includes a new template to showcase how Sync Framework simplifies creating Connected Lenses.
  • The Voting Template shows you how to use Sync Framework to build an AR experience that allows multiple users to contribute their input for selection in a shared session.
  • The Gravity Gun Template, created by MousePack, offers Lens Developers a unique way to integrate your own physics-based tools within your Lens.
  • [Beta] Nails Segmentation and Tracking enables Lens Developers to build unique Nail Try-On experiences.- Multiple Hand Segmentation Masks are now supported.
  • Lens Studio for Unity Developers is a new guide dedicated to helping Lens Developers bring their knowledge and experience from Unity to Lens Studio to build augmented reality experiences.
  • The Performance and Optimization for Lenses guide provides more information on how best to optimize your Sponsored and Non-Sponsored Lenses and for a wide range of devices.
  • The Asset Library has been updated to include the following features:
  • The Asset Library is now treated as a panel within Lens Studio.
  • New asset type “UI Hints” that encompasses new assets for Lenses.
  • New Places API available in Asset Library.
  • The Lens Analytics guide has been updated to inform Lens Developers about Event Insights and Community Audience, providing ways to learn more about how Snapchatters interact with your Lens
  • The My Lenses portal has been updated to include Lens Submission Error Reporting to learn more about how to track any errors that may affect your Lens Submission.
  • Render Target Scaling allows a Lens Developer to select their desired resolution scale from the UI, instead of having to code your own implementation.
  • Improvements:
  • Lens Studio Start Screen has been redesigned to create a better first time user experience.
  • Lens Studio now Supports Lens and template names with special characters.
  • Optional Parameters in Remote API Codegen are now supported.
  • Print logs from pushed lens running on mobile
  • Spot lights are now supported in Lens Studio.
  • List of Devices in the Device simulation has been updated.
  • TouchBlocking support for InteractiveComponent.
  • Texture compression improvements.
  • Support for Multiple Custom Locations in a single Lens.
  • Face Mesh Reference has been updated to include 3D representation for Ears.
  • Fixed:
  • Video recorded on mobile device has wrong aspect ratio.
  • Fixed issues where materials would not render when pushed to devices.
  • Fixed issue where the application would crash after the Scene Object under Prefab was duplicated and the change was applied.
  • Fixed issue where the application would crash when trying to download remote assets via APIs.
  • Fixed minor text alignment issue in Arabic.
  • Fixed an issue where changing the blend mode for the last added image element caused all others with the same material to become translucent as they use the same darkened blend mode.
  • Fixed issue when new layers are not automatically assigned to Light sources if previously layers were deleted.
  • Fixed issue when Lens Studio crashed on import of HDR textures.
  • Fixed issue when not used VFX resources were not deleted after optimization.
  • Fixed issue when ‘Light Balancing’ custom component does not work with other custom components.

New in Lens Studio 4.36.1 (Dec 22, 2022)

  • New:
  • With LensFest 2022, The Snap AR Engineering team has created two new developer focused tools to help accelerate and streamline Lens Development
  • Sync Framework is a set of scripts and components designed to help you build Connected Lenses for building shared online multiplayer experiences. 
  • The Persistent Noteboard template features a note-taking Lens that utilizes the Canvas component and comprises two note-containers and an Input Modal for creating note entries.
  • The Lens Quality Assurance Troubleshooting guide offers a series of tasks and examples of common bugs you may encounter when building Lenses and how best to resolve those issues.
  • Improvements:
  • New option in 2D scene toolbar to make ScreenTransforms save their screen space coordinates when being reparented.
  • As previously mentioned in our Community Forum post, New Lens submissions using Wannaby Technology will be rejected in Lens Studio. 
  • Please note that existing Lenses using Wannaby Technology will continue to run in perpetuity, however they can no longer be updated.
  • Best Practices for Remote Assets has been added as a way to help create a fluid user experience when building Lenses with Remote Assets.
  • Update of autogenerated code to print error code and messages when API requests fail.
  • Fixed:
  • Fixed bug hiding autocomplete results in script editor.
  • Fixed crash of Lens Studio on specific prefab Apply after it was instantiated.
  • Fixed issue with 'Divide' node for specific mobile and desktop devices.
  • Fixed issue when Custom Component file (.lsc) is showing as modified right after project reopen.
  • Fixed issue when Custom Component typename input can disappear after project reopen.
  • Fixed issue when Lens Studio can not be launched on macOS Ventura.

New in Lens Studio 4.34 (Dec 15, 2022)

  • New:
  • The Garment Transfer Custom Component provides a starting point for building photorealistic upper body garment try-on experiences by utilizing a single 2D image. 
  • Custom Structure Inputs allows Lens Developers to easily group data together based on their own defined data type. 
  • The ML Eraser Custom Component can be used to create unique inpainting effects within Lenses. Inpainting allows removal of objects from camera feed based on a given mask, and realistically generates the missing areas. 
  • To showcase the new ML Eraser Custom Component, there are three new templates that Lens Developers can use: 
  • Paint to Erase showcases how users can paint on their screen to erase content in the world, how to utilize paint with Body Segmentation and how to create a dissolving effect with Paint. 
  • Disappearing Effect builds upon the ML Eraser and Body Segmentation to create unique effects such as a head slicing, hologram and pattern effect.
  • World Eraser utilizes World Tracking and ML Eraser to showcase how users can erase content from the world independently from the camera.
  • With the update to Custom Components, Lens Developers can now create their own Custom Components. These Custom Components make it possible to build reusable, and shareable components with Lens Studio.
  • New Try-On Custom Components and Templates have been designed to help accelerate Lens Developers in building fashion focused AR experiences: 
  • The Wrist Tracking Custom Component allows you to attach objects to the users wrist, such as watches and jewelry.
  • Ear Binding is a new type of Custom Component that enables developers to build Try-On Lenses for earrings. 
  • The Foot Tracking Custom Component gives Lens Developers a more in-depth way to create custom Footwear Try-On Lenses.
  • The Footwear Template has been updated to utilize the new Footwear Try-On Custom Component.
  • Lens Developers can now export out their Custom Location AR Mesh to an OBJ file. This allows developers to adjust the Mesh in an external editor, and then import the Mesh back into Lens Studio.
  • Custom Landmarker has been renamed to Custom Location AR.
  • Improvements:
  • Updated best practices for adding more perspective captures for Custom Location AR.
  • Attachment Mode for Object Tracking.
  • Updated Multi-Object Detection Template.
  • New category 'UI' is added into Asset Library.
  • Drag script asset into Objects hierarchy will create new object with script component.
  • Auto codegen scripts for remote APIs is using JS modules now.
  • API upgrades for Location Resources - Creators can now create LocationMeshes and LocationTextures from script using LocationRenderObjectProvider.create() and LocationTextureProvider.create(). 
  • The City Scale AR template now uses these methods to create the 3x3 grid of "Relative Tile" Location Assets with LocationMeshes with LocationTextures.
  • Fixed:
  • Fixed Learn More link in icon creation window.
  • Fixed issue when Asset Types Filter doesn't have Remote Asset Reference resource type.
  • Fixed issue when Body tracking assets cannot be dragged onto Object Tracking 3D component.
  • Fixed issue when Lens Studio will recreate Proxy Texture for ML and textures from materials will be duplicated as well.
  • Fixed issue when both horizontal and vertical planes are emitted even if only one type is requested.
  • Fixed issue when Audio Output template opens very slow on Windows.
  • Fixed issue when Preview audio is unmuted on every lens reset.
  • Fixed issue when duplicated/imported Pin is not displayed in Map panel.

New in Lens Studio 4.31 (Nov 17, 2022)

  • New:
  • The Garment Transfer Custom Component provides a starting point for building photorealistic upper body garment try-on experiences by utilizing a single 2D image. 
  • Custom Structure Inputs allows Lens Developers to easily group data together based on their own defined data type. 
  • The ML Eraser Custom Component can be used to create unique inpainting effects within Lenses. Inpainting allows removal of objects from camera feed based on a given mask, and realistically generates the missing areas. 
  • To showcase the new ML Eraser Custom Component, there are three new templates that Lens Developers can use: 
  • Paint to Erase showcases how users can paint on their screen to erase content in the world, how to utilize paint with Body Segmentation and how to create a dissolving effect with Paint. 
  • Disappearing Effect builds upon the ML Eraser and Body Segmentation to create unique effects such as a head slicing, hologram and pattern effect.
  • World Eraser utilizes World Tracking and ML Eraser to showcase how users can erase content from the world independently from the camera.
  • With the update to Custom Components, Lens Developers can now create their own Custom Components. These Custom Components make it possible to build reusable, and shareable components with Lens Studio.
  • New Try-On Custom Components and Templates have been designed to help accelerate Lens Developers in building fashion focused AR experiences: 
  • The Wrist Tracking Custom Component allows you to attach objects to the users wrist, such as watches and jewelry.
  • Ear Binding is a new type of Custom Component that enables developers to build Try-On Lenses for earrings. 
  • The Foot Tracking Custom Component gives Lens Developers a more in-depth way to create custom Footwear Try-On Lenses.
  • The Footwear Template has been updated to utilize the new Footwear Try-On Custom Component.
  • Lens Developers can now export out their Custom Location AR Mesh to an OBJ file. This allows developers to adjust the Mesh in an external editor, and then import the Mesh back into Lens Studio.
  • Custom Landmarker has been renamed to Custom Location AR.
  • Improvements:
  • Updated best practices for adding more perspective captures for Custom Location AR.
  • Attachment Mode for Object Tracking.
  • Updated Multi-Object Detection Template.
  • New category 'UI' is added into Asset Library.
  • Drag script asset into Objects hierarchy will create new object with script component.
  • Auto codegen scripts for remote APIs is using JS modules now.
  • API upgrades for Location Resources - Creators can now create LocationMeshes and LocationTextures from script using LocationRenderObjectProvider.create() and LocationTextureProvider.create(). 
  • The City Scale AR template now uses these methods to create the 3x3 grid of "Relative Tile" Location Assets with LocationMeshes with LocationTextures.
  • Fixed:
  • Fixed Learn More link in icon creation window.
  • Fixed issue when Asset Types Filter doesn't have Remote Asset Reference resource type.
  • Fixed issue when Body tracking assets cannot be dragged onto Object Tracking 3D component.
  • Fixed issue when Lens Studio will recreate Proxy Texture for ML and textures from materials will be duplicated as well.
  • Fixed issue when both horizontal and vertical planes are emitted even if only one type is requested.
  • Fixed issue when Audio Output template opens very slow on Windows.
  • Fixed issue when Preview audio is unmuted on every lens reset.
  • Fixed issue when duplicated/imported Pin is not displayed in Map panel.

New in Lens Studio 4.31 (Oct 5, 2022)

  • New:
  • Remote Assets offers developers a way to store assets within Lens Cloud to dynamically load their created content into Lenses at runtime. Since Remote Assets do not count against the Lens size limit, developers can build more complex Lenses and re-use assets across multiple Lenses.
  • With this release of Remote Assets, developers can utilize assets up to 10MB per asset and a max of 25MB per Lens. Organizations can use up to 500 MB of space for storing assets.
  • The Physics System has been updated to enable Developers to create Lenses with more realistic interactions and movement between AR objects in a scene. Some of the major features include;
  • Support for Collision meshes, allowing collision, simulation, and ray casts against arbitrary render meshes.
  • Correct handling of center-of-mass and inertia.
  • Extend ray cast functions to support sweeping a primitive shape, such as a sphere, along a transform path.
  • Support for collision filtering, enabling control over how colliders interact with one another.
  • With the addition of Los Angeles and Santa Monica as new cities available in Lens Studio, creators can now build City-Scale AR content spanning across the multiple cities mapped in Lens Studio.
  • The City Landmarker feature has been renamed to City-Scale AR.
  • Canvas is a new Component that creates a dedicated root within the ScreenTransform hierarchy to dynamically place 2D Components, like Text and Image, in 3D space. The Canvas Component is built to adapt to multiple tracking solutions, giving Developers the flexibility to add more 2D AR enabled content to their experiences.
  • Tooltips have been added to Lens Studio as a quick way to get information about how to use Lens Studio.
  • Improvements:
  • The new Hand Tracking solution has been added to Body Tracking.
  • The ‘Sounds’ section in the Asset Library has been renamed to Music to provide Lens Creators an easier way to add their favorite songs to Lenses.
  • The glTF material and glTF Importer has been updated to support two new extensions: `KHR_materials_sheen` and `KHR_texture_transform`.
  • Lens Studio Templates will now display the name of the Creator on the homepage.
  • Added a dedicated Asset Library button in the Add Resources panel.
  • Fixed:
  • Fixed issue of broken Custom Code Node validation
  • Fixed issue when default envmap textures were deleted during component deletion
  • Fixed issue when studio may crash after copy a physics collider component
  • Fixed issue when Audio Component stops working once joined Connected Lenses session

New in Lens Studio 4.28.1 (Sep 6, 2022)

  • Fixed:
  • Live Tracking now shows 3d model from the project instead of default.
  • JS Docs have been updated update
  • Face Occlusion template no longer opens with errors

New in Lens Studio 4.28.0 (Aug 26, 2022)

  • New:
  • With Spatial Persistence, Snapchatters will be able to read or write AR content at a physical location and retrieve this data at the same physical location when they restart their lens.
  • The new Spatial Persistence Template shows how Lens Creators can build AR content that is tied to a physical location in the world
  • Along with Spatial Persistence, The Content Editor Tools asset provides a set of plug-and-play custom components that enable users to place and manipulate persistent AR content.
  • The new Content Editor Tools Template showcases how to build persistent AR content where users can place and manipulate AR persistent content inside a Lens.
  • Voice ML’s Question Answering Service gives Lens Creators the ability to build voice enabled Lenses that can understand questions about a single topic and receive real time answers based on pre-loaded informational text.
  • A new hand tracking solution has been implemented that now enables Two Hand Tracking within Lenses. This update expands upon the current 3D Hand Tracking solution to efficiently track two hands at once when building content for Spectacles.
  • Lens Creators can now use the new Face Occlusion custom component that can be used to improve Face enabled Lenses by masking out content that is covered by hair, hands or other objects.
  • Improvements:
  • The Speech Recognition Template has been updated to showcase support for French.
  • The Bitmoji Custom Component has been updated to include the new hand tracking solution, allowing for Snapchatters to attach their Bitmoji avatars to bodies in Lenses and enable hand tracking.
  • Support for Arrays of Combo Boxes and Quaternions have been added to the Script Editor.
  • Render Layer Controls now visible in the Inspector for all SceneObjects.
  • Added submission warning box for Lens submissions with one camera turned off, to help creators get maximum reach on Snapchat.
  • Added object preset for empty ScreenTransform.
  • Fixed:
  • Fixed issue when Auto-updater is stuck on restart if permissions to the app folder are not granted to the effective user.
  • Fixed issue when parameters before the light loop node are not displayed in the material inspector.
  • Fixed issue when Interactive Preview movement keys conflict with the common shortcuts.
  • Fixed issue when Live tracking UI missing if you close Preview panel or open other project.
  • Fixed issue with when renaming with pressing Enter can't be finished with pressing Enter second time.
  • Fixed issue when script graphs cannot be exported.
  • Fixed issue when @typename field doesn't refresh inspector

New in Lens Studio 4.25.1 (Jul 22, 2022)

  • Fixed:
  • Fixed issue with My Lenses re-login after Lens Studio launch.
  • Fixed issue when VFX blend mode not applied right away.
  • Improvements:
  • Update for upper garment segmentation model.

New in Lens Studio 4.25 (Jul 14, 2022)

  • New:
  • Similar to Hand Segmentation, Footwear Segmentation allows Lens Creators to segment effects within or around a user’s feet. In our Footwear Segmentation template, you will learn how to utilize the new segmentation feature to render unique effects.
  • The Body Morph template enables Lens Creators to morph the body of a user into another custom mesh which has the same UV map as the standard Body Mesh.
  • Lens Studio scripting now supports Script Modules in the Common JS format. By adopting this industry standard, and providing support for it in lenses, we are enabling professional JS development.
  • There is now a dedicated Script Modules category in the Asset Library.
  • Support for .glTF Physically Based Rendering extensions have been added, including transmission, clear coat and unlit extensions.
  • Improvements:
  • Custom Components have received the following improvements:
  • Creating ScreenTransforms at runtime will now have the same default values as creating them in Lens Studio.
  • Creating Visuals like Text or Image at runtime will now have automatic render order like creating them in Lens Studio.
  • Added ability to view and edit common parameters in inspector for multiple selected resources of different types.
  • We have updated our ASL Template with new animations, models and logic.
  • fixed:
  • fixed issue when VFX material can not be compiled after import from lso.
  • Fixed issue with colocated landmarks materials in Connected Template.
  • Fixed issue with render when Face Inset was duplicated.
  • Fixed Lens Studio crash when occluder material was re-added.
  • Fixed issue with Uber PBR material if Blend Mode was updated.
  • Fixed issue when overlay does not work because of Blend Mode from Post Effect.

New in Lens Studio 4.22.1 (Jun 28, 2022)

  • Improvements:
  • Fixed issue with graph material blendmode.
  • Fixed issue with node disconnect in graph material.
  • Fixed issue when colored material looks flat white.

New in Lens Studio 4.22.0 (Jun 8, 2022)

  • New:
  • With the new 3D Bitmoji integration into Lens Studio, developers will be able to create new innovative ways to bring the power of expression to their avatars. Starting with 4.22, users will be able to drive 3D Bitmoji with Body Tracking.
  • Please visit the Bitmoji Template to see how you can get started adding Bitmoji content to your creations.
  • The Code Node is an advanced feature that enables developers the ability to create custom shader code directly in the Material Editor and VFX Editor, unlocking new effects and performance enhancements.
  • A Code Node Template has been provided to showcase some beginner, intermediate and advanced shader content that is now possible in Lens Studio
  • Included with this release is a dedicated Code Node Reference guide covering the syntax used by the Code Node feature.
  • Shadertoy to Lens Studio is a new guide aiming to help developers migrate their shaders and materials over to Lens Studio.
  • Voice MLnow provides an Automatic Voice Style Selector that allows developers to automatically detect emotions from text. With this feature, developers can create a voice that corresponds to one of five emotional categorizations.
  • Improvements:
  • New assets have been included in the Asset Library to enable developers to quickly add Connected Lenses, Persistent Storage, New Face Styles and Utility functions to your creations.
  • Applying prefabs sometimes caused unnecessary reordering & re-selection of prefab root's immediate children, which created confusion, and has been addressed.
  • Added ability to change compression settings for several objects.
  • Updated the project optimization settings to remove unused render layers and lights.
  • Adjusted how a new face effect is attached to a camera in the scene.
  • Added a way to Sync the editor scene view with direction with map location icon for City Landmarkers.
  • Improve the navigation of city scale landmarkers in Lens Studio
  • Allowing developers to adjust the camera speed in editor scene and interactive preview.
  • You can now test shopping Lenses on push to device.
  • Fixed:
  • Fixed crash of Lens Studio on Import of different glb and glTF files with embedded texture
  • Fixed crash of Lens Studio on update of some custom components
  • Fixed Screen Transform position settings
  • Fixed skeletal detection in preview scene

New in Lens Studio 4.19.0 (Apr 29, 2022)

  • New:
  • Lens Cloud is a collection of backend services, built on the same infrastructure that powers Snapchat. Lens Cloud vastly expands what developers can build in augmented reality by providing Multi-User Services, Location Services, Storage Services and Scanning Services.
  • With the release of Lens Cloud, a City Scale Template has been provided to learn how to get started building city wide content for London, UK.
  • A dedicated Visual Studio Code Extension has been released to give developers the functionality to use VSCode as an IDE for their Lens Studio projects. With the extension installed, VSCode enables; Code editing and smart code completion, JavaScript debugging for Lenses and JavaScript code snippets for Lens development.
  • Body Depth & Normal Texture Guide and Template provides developers a detailed estimate of the depth and normal direction for every pixel of a person including their body, head, hair, and clothes. This lets the user easily create sophisticated lighting effects and calculate realistic occlusion and collisions with AR objects.
  • Depth Render Target gives developers the ability to capture a Camera's depth stencil texture, enabling ways to create custom effects such as screen space normals, custom occlusions, fog, and depth-based particle collisions.
  • SnapML has also received some updated features to enhance a user’s experience and understand the user’s environment.
  • Light Estimation allows developers to do more realistic rendering by matching the real world lighting on objects rendered by the Lens.
  • Noise/Blur Estimation gives developers the ability to match the noise and blur levels from the device’s camera with the AR content.
  • SnapML now supports quantized models, an ML model format. Some of the benefits include; model size reduction by 50%, fast inference speed, and more power efficiency.
  • To help showcase quantized models, a new Multi Class Classification Template has been added to showcase these new features.
  • Lower Garment Segmentation has been added to the Segmentation System allowing developers to get segmentation masks based on data for upper-garment and lower-garment systems simultaneously with low overhead. A Segmentation Trails Template has been added to showcase this functionality.
  • True Size Object Template is a new template that utilizes the best tracking solution available for your device to provide users an accurate scale when placing objects in their physical space. This allows users to test how well physical objects can fit into their environment.
  • Voice ML has received two new templates for developers to learn how to add an extra layer of personalization to their content.
  • 2D Animated Text-to-Speech uses a user’s voice to animate 2D lips to be synced with voice.
  • Sentiment Analyzer is a new ML model that returns one of 28 optional emotion classes, such as hope, happiness and anticipation.
  • Improvements:
  • The API Library has expanded allowing you to now build Lenses with third party APIs that give play by play data from five different sport leagues, daily zodiac astrological predictions, and location specific air quality data.
  • Additionally, we made it easier to build Lenses with third party APIs by automatically generating a block of code used to connect to an API upon importing the API asset into your project.
  • Fixed:
  • Fixed issue when duplicate custom components cannot be created from script
  • Fixed issue when base color textures are tinted blue on import of certain glTF files
  • Fixed crash of Lens Studio with different glTF models
  • Fixed crash of Lens Studio when specific script has errors
  • Fixed issue when 'Device Camera Texture' moved from folder into root of Resources Panel

New in Lens Studio 4.16.1 (Apr 26, 2022)

  • New:
  • Custom Landmarkers enables Lens Creators to create their own location based AR Lenses. With this update to the Landmarker feature, Creators can utilize the new Custom Landmarker Creator lens on their LIDAR-enabled phone to scan and upload their own Landmarkers for use within Lens Studio.
  • With the new Custom Components category in the Asset Library, Creators can now use script components bundled with resources that can be installed easily and added to Lens Studio projects. To celebrate the release of Custom Components, various Face Effects have been released as a Custom Component to let Lens Creator quickly utilize and implement unique face filters powered by SnapML. Popular filters such as baby, bald, anime, 3D animated and poster are now available as a custom component. Try adding them in your own project, or by checking out the Custom Components template
  • Audio Classification is a new Voice ML Template that allows Lens Creators to enable Lenses the ability to listen and categorize sounds into several categories;
  • Human Sounds
  • Animal Sounds
  • Music Sounds
  • Natural Sounds
  • Other Sounds (Such as - Street Cars, Work Tools)
  • With the new Spectacles Voice Control template, Lens Creators can learn how to incorporate transcription and keyword detection to their wearable experience.
  • Native Keyboard support has been introduced as a way to allow Lens users the ability to edit Text and Text3D components in real-time within a Lens.
  • The Physics system has been updated to better support smaller objects, fast moving objects, and objects that vibrate in place. As a part of this update, Physics Matters allow for Lens Creator to adjust the bounciness, and friction settings of a given object.To help demostrate some of these features, a Physics Toybox template has been included with 4.16.
  • Snap is introducing Draco Compression integration into Lens Studio to allow Lens Creators to streamline their process when working with high-poly count and photogrammetry created 3D assets.
  • Auto-Updater in Lens Studio enables users to download and install the latest version from within the application. Along with this, the feature also provides the ability to open older projects in their respective Studio builds, without the need to bump the minimum client versions for the project.
  • Improvements:
  • Documentation for Plume Labs by AccuWeather APIs endpoints has been added
  • Various VoiceML Enhancements have been added in 4.16.
  • Speech Recognition template now supports Spanish and German
  • Voice UI Template now includes 2 new voice commands: “Save to Favorites” ; “Send Lens to Friends”
  • In order to help streamline authentication across multiple platforms, Creators will now be able to log in via their Snapchat account when using Lens Studio.
  • Physics - Static colliders can now be nested without being merged into compound shapes. This makes it so child colliders can be moved and deformed kinematically.
  • Fixed:
  • Fixed a bug that may prevent Lens Studio from starting up.
  • Addressed an issue that would cause Lens Studio to crash when closing a project.
  • Fixed an issue with ScriptComponents that would potentially prevent projects from opening.​
  • Fixed issue with VFX assets disappearing.
  • Fixed compiler errors on VFX Collision template.
  • Fixed problem with saving project after importing resource.

New in Lens Studio 4.13 (Jan 26, 2022)

  • NEW:
  • Installable Content enables dynamic delivery of different types of content, such as templates, presets, etc. that are independent from Lens Studio versions.
  • Audio Output template generates sounds with JavaScript and plays them on device. It provides simple examples such as oscillators, noise generators, audio track file players, etc.
  • Downloadable Shopping Template to create Lenses connected to the Product Catalog for Snapchat Business Accounts.
  • IMPROVEMENTS:
  • Cloth Simulation that was only available through Javascript, now has UI enabled.
  • Foot tracking template that allows you to attach objects to your feet has been updated, and is now available in Lens Studio.
  • FIXED:
  • Fixed error if authentication scope was incorrect.
  • Fixed crash on Mac with Apple Silicon CPU when trying to import HDR with high quality.
  • Fixed issues with Lens Studio locking up on Windows when two or more videos textures were running.
  • Fixed issue with GIF relink on losing connection to original file.

New in Lens Studio 4.10 (Dec 8, 2021)

  • NEW:
  • Sounds - Integration of a sound library in Lens Studio that enables discovery and import of licensed music tracks in Lenses. See an example in the Music Video template.
  • Physics - Physics in Lens Studio enables you to dynamically simulate real-world physics effects in your projects. Objects in the scene can now behave and interact with forces such as gravity, velocity, acceleration, and more. See it in action in the Physics template and in the updated Behavior helper script.
  • API Library - Lens Studio Asset Library now includes 3rd party APIs which can be used in lenses by Lens developers. See the Translation, Weather, Cryptocurrency, and Stock Market templates for examples.
  • World Mesh - Provides 3D mesh reconstruction and depth texture of the real world for recent devices (even without LiDAR). Check out the various templates to see how you can populate the world semantically, do VFX collisions with the world, as well as make depth enabled shader effects.
  • IMPROVEMENTS:
  • Enhancements to the VoiceML Text-To-Speech module which now includes 5 new female voice styles, a new male voice, and configurable playback speed. Check out the updated Text to Speech template to try it out.
  • Audio Analyzer template has been updated to work with any audio track (try it with the new licensed audio sound library!), microphone, or even an array of raw audio samples. Additionally, the template now includes examples of driving material and VFX assets with audio data.
  • VFX Collision template has been updated with an example of colliding VFX particles with 3D meshes through a depth buffer.
  • New triggers and responses have been added to Behavior, including support for physics and 3D Text.
  • FIXED:
  • Fixed Eye material in Face Morph template.
  • Fixed Lens Studio crash when disconnecting Spectacles 2021 from laptop.
  • Fixed different results in shader when using clamp and floor nodes.
  • Fixed position resets after duplication of mesh with pin-to-mesh.

New in Lens Studio 4.7.2 (Nov 17, 2021)

  • Fixed problem with resetting of camera layer for prefabs.
  • Fixed crash with using image texture in Camera’s render target.

New in Lens Studio 4.7.1 (Nov 8, 2021)

  • Fixed problem with textures missing on certain imported assets.

New in Lens Studio 4.7 (Nov 2, 2021)

  • New:
  • SDF (Signed Distance Field) generator - Allows creators to generate a 3D signed distance field texture from any 3D mesh. This is a powerful data format that opens the door to advanced techniques for fast, accurate collisions and to volumetric effects. See the example in the VFX Collision guide for more information.
  • Media Picker - Allows creators to use an image or video from their device's camera roll as a texture. This is an enhancement to Image Picker, and Face Image Picker. See the Green Screen template to see it in action.
  • 3D Text - Generate 3D meshes from text easily using the Text3D Component. See the 3D Text template for examples.
  • 3D Hand VFX Template - A template that combines the using of 3D Hand and VFX effect.
  • Improvements:
  • Primitive collider shape type is available in the Collider component. It now supports primitive shapes with non-uniform scale.
  • New cloth simulation examples for body tracking and primitive collider in Cloth Simulation Template.
  • Preview video now supports audio for VoiceML and AudioML.
  • Fixed:
  • Various bug fixes and performance improvements.

New in Lens Studio 4.4 (Sep 15, 2021)

  • We jumped from Lens Studio 4.1 to Lens Studio 4.4 because we are internally organizing our build & versioning system. Rest assured that you are not missing out on any functionality - this is purely a new naming convention!
  • New:
  • VoiceML - Trigger AR effects and command the Snapchat camera with your spoken words or convert text-driven Lenses to speech with new VoiceML modules:
  • Speech and Command Recognition Module - Transcribe text or define specific keywords that trigger AR effects. This feature has two templates: Speech Recognition Template and Voice UI Template
  • Text-To-Speech (TTS) Module- Convert text to automated oral speech. This feature has a Text To Speech Template
  • System Voice Commands - Enable In-Lens Voice Commands in Snapchat's Camera Tab such as "Take a Snap" or "Record a Video". Check out the helper in the Asset Library to add this function to your Lens.
  • 3D Hand Tracking - Trigger and attach AR effects to hand movements in 3D space. This feature has two templates:
  • 3D Hand Tracking Template - to track 3D hand model to match your left and right hand
  • 3D Hand Interactions Template - to track 3D hand and create custom interactions
  • External Body Mesh - Automatically attach and deform 3D custom meshes with the body pose and shape. This feature has the Try On Template which allows you to create a set of outfits that automatically deform to any body without a rig.
  • 3D Skeleton Display - View and manipulate joints of imported rigged meshes within Lens Studio.
  • Upper Body Skin Segmentation - Mask the skin on one’s upper body excluding their clothing and hair. This feature comes with Portrait Skin Segmentation Template
  • Connected Lenses Development Tools - Invite other Snapchatters to join a Connected Lens session in development by pushing the unsubmitted Lens to their paired account.
  • Improvements:
  • Improved search when adding nodes in VFX graph, Material graph, and visual scripting.
  • Ability to sort templates by name and complexity.
  • Ability to test single plane tracking of Spectacles 2021 Lenses within Lens Studio Interactive Environment.
  • Auto-matching of 3D Body and 3D Hand model joints based on hierarchy.
  • Interactive Environment supports Depth Texture.
  • Fixed:
  • Various bug fixes and performance improvements.

New in Lens Studio 4.1.1 (Aug 24, 2021)

  • Improvements:
  • Various bug fixes and performance improvements.

New in Lens Studio 4.1 (Jul 20, 2021)

  • New:
  • Installer size reduced from 1.7GB to 600MB, which will lead to faster downloads of Lens Studio.
  • Templates are no longer installed, but will need to be downloaded on-demand.
  • Lens Size Limit Increase - Increases the Lens size limits from 4MB to 8MB.
  • Lens Text Localization - Allows creators to add their own localized text assets to Lens Studio from a JSON file.
  • Upper Garment Segmentation - Enables multi-person garment segmentation from garments like shirts, vests, coats, hoodies and dresses.
  • Multi-Object Detection - Detect where in the camera certain objects are, and add effects to them.
  • Order Independent Transparency - Enables rendering of more complex objects with semi-transparency.
  • Scan updates, such as triggers, templates & markers. This will enable 2D bounding box detection of things such as cup, car, dog, cat, bottle, etc.
  • Remote Lens push for Spectacles 2021 is enabled.

New in Lens Studio 4.0 (May 21, 2021)

  • New:
  • Connected Lenses. Create shared experiences with Connected Lenses that allow multiple people to play, explore, build, and dream together, whether they’re in the same room or miles apart!
  • Scan. Build Lenses that react to things that are visible in the camera. Scan’s Visual Classification feature recognizes over 500 object and scene categories in the physical world.
  • Multi-Body 3D Mesh. Industry-defining algorithms can reconstruct a subject’s entire body and hands as a 3D mesh. You can even capture multiple persons simultaneously to maximize your creative options.
  • VFX Editor. Design stunning visual effects with the ultra-powerful VFX Editor, our brand new node-based particle simulation engine. From rain, to magical powers, to swarms of a million emojis, your imagination drives what’s possible. It’s fully optimized for desktop and mobile devices.
  • SnapML Audio. Sound is power. Train a model and create sophisticated, multi-sensory experiences with audio-activated Lenses. SnapML Audio can identify and react to human speech, ambient noise, languages, music, and thousands of everyday sounds that you can use to trigger limitless workflows.
  • Cloth Simulation. Incorporate realistic textiles into your Lens designs with 4.0 Cloth Simulation. Progressive, physics-based mapping means virtual fabrics look and move like the real thing. Experiment with innovative patterns and textures or stick to the basics.
  • Hair Simulation. Create visionary styles with enhanced, 4.0 Hair Simulation. Customize colors, textures, length, and even simulate wind with realistic modeling that replicates hair physics and accounts for various face shapes. For added versatility, import customized styles from partner design programs.
  • Integration with Spectacles (2021). Design, build and deploy immersive experiences for Spectacles (2021).
  • Improvements:
  • Dynamic Environment Maps. Bring more realism to your creations by projecting the real world onto a virtual one.
  • Spatial Audio and Mix To Snap. Create immersive audio experiences for Snapchat and Spectacles (2021) and let your audience enjoy higher quality audio in their Snaps.
  • Fixed:
  • Various bug fixes and performance improvements.

New in Lens Studio 3.4.1 (Apr 9, 2021)

  • Fixed:
  • Various bug fixes and performance improvements.

New in Lens Studio 3.4.0 (Feb 26, 2021)

  • New:
  • Multi-Person 3D Full-Body Tracking - overlay virtual outfits, attach virtual objects to your body, or drive animated 3D characters with this new capability. Tracking of several bodies and tracking of partially visible bodies is supported.
  • Full-Body Segmentation - segmentation mask to apply custom effects to the entire body or background.
  • Hand Joints Tracking - track the joints of the fingers and the wrist to apply or trigger effects.
  • Asset Library - access a library of scripts, materials, SnapML models, plugins, audio and more that make it easier to build more complex Lenses!
  • Improvements:
  • Device Simulation updated to the most recent Snapchat UI.
  • Interactive Preview in Preview Panel improvements - movement to specific location of a scene, locking Y coordinate of position.
  • Added the option to overwrite initial project file during project updates
  • SnapML now loads models asynchronously in order to optimize loading time, either uses a callback function onLoadingFinished or uses a function waitOnLoading
  • SnapML now supports TensorFlow Lite float/quantized models.
  • SnapML now supports new Layers - Embedding, RNN, BatchMatMul.
  • ONNX/TF import – various improvements, learn more in the ML Compatibility table.
  • Depth data from the iOS LiDAR scanner is applied to Depth Texture, including Depth Enabled Templates
  • Material Editor improvements as ability to allow using the Bool Parameter node with other relational nodes (such as equal, greater than, etc.) while maintaining its static capabilities, unpack node precision update.
  • Fixed:
  • Various bug fixes and performance improvements.

New in Lens Studio 3.3.3 (Jan 22, 2021)

  • Fixed:
  • Lens publishing and My Lenses bug fixes.
  • Various bug fixes and performance improvements.

New in Lens Studio 3.3.1 (Dec 24, 2020)

  • Various bug fixes and performance improvements.

New in Lens Studio 3.3.0 (Dec 8, 2020)

  • New:
  • Visual Scripting – Create custom interactivity using node-based scripting, without coding.
  • My Lenses 2.0 – Manage your Lenses in browsers outside the Lens Studio application.
  • Texture Compression – Pack in richer assets for more compelling Lenses with automatic tunable compression inside the app.
  • Logger – Group, filter, and search messages in the logger view.
  • Face Morph Template – Morph a face in 3D using a custom mesh.
  • Configuration Template – Use UI widgets to create an adjustable Lens.
  • Tween Template – Set up animations using a dropdown menu.
  • Improvements:
  • Support for Apple-silicon based Macs.
  • Device Simulation Snapchat UI updated to the most recent one.
  • Ability to reset a Lens during recording.
  • SnapML performance improvements including Elu, Softplus, Softsign for Android GPUs and various CPU optimizations.
  • SnapML supports new Layers – LSTM, Permute.
  • ONNX/TF import – various improvements, learn more in the ML Compatibility table.
  • Fixed:
  • Fixed various issues in SnapML export from pytorch 1.7.
  • 'Optimize project' no longer deletes unused ML models.
  • Various bug fixes and performance improvements.

New in Lens Studio 3.2.0 (Oct 14, 2020)

  • New:
  • Hand Segmentation Template - shows you how to add an image to the hand, as well as occlude things behind the hand. In addition it demonstrates how you can use hand gestures to control the effects around the segmented hand.
  • Behavior Template - demonstrates how you can use the Behavior Helper Script to set up different effects and interactions through a dropdown menu. You can choose different triggers like face or touch interactions, and respond to them with effects like enabling objects, playing tweens, and more!
  • Search for Templates and recent projects - use Search bar in Home Screen to quickly find a template or recent project.
  • Head Mesh - track a user’s whole head shape including skull.
  • Post Effects - Smoothing, Gaussian Blur
  • World Mesh - A dynamic mesh object that provides semantic understanding of the environment, raycasting capabilities, occlusions and more. (Note: available for iOS devices w/ ARKit 3.5+ and a rear-facing LiDAR sensor)
  • Interactive Preview - An interactive preview mode that uses a virtual 3D scene (rather than images or videos) with controls for looking and moving around with 6 degrees of freedom
  • Improvements:
  • Material Editor script nodes improved with possibility to upgrade nodes from previous versions.
  • Ability to create an animation atlas smaller than 256 pixels.
  • Support of webp image format is added
  • SnapML performance improvements:
  • Instance Normalization layer in Android GPU (more than 100% faster)
  • Nearest neighbor upscale in Android GPU
  • Global Average Pooling in Android GPU
  • Various CPU optimizations
  • SnapML new Layers added:
  • Sin
  • Cos
  • Argmin/Argmax
  • Concat and eltwise now works with constant node
  • ONNX/TF import - various improvements, find out more in the ML Compatibility table.
  • Behavior Script can now trigger Lens hints, script APIs, go through a list of custom triggers, as well as check distance between screen transforms
  • Fixed:
  • Device Tracking Rotation doesn't work in preview
  • Various issues in SnapML export from the pytorch 1.6
  • Various bug fixes and performance improvements

New in Lens Studio 3.1.0 (Aug 13, 2020)

  • New:
  • Full Body Triggers Template - Use Full Body Tracking to trigger effects depending on the pose of the user, as well as when a joint hovers over a screen position. This template is great for dance related videos.
  • Full Body Attachments Template - Attach objects between joints provided by Full Body Tracking. It comes with primitive objects attached between each tracking joints used to approximate an occluder for objects to go around.
  • Material Editor Search - Find nodes with a new search feature.
  • Improvements:
  • Export multiple objects to .lso format.
  • Start and stop particle generation using corresponding API methods available. Take a look at the Particles Template to learn more.
  • Replace one resource with another all over the scene for meshes, materials and sounds.
  • Hide/show the grid in the 3D Scene.
  • Updated face images/videos to a new wide format (much larger horizontal Field of View).
  • ONNX/TF import - various improvements, find out more in the ML Compatibility table.
  • Fixed:
  • Fixed flipped textures after glTF import.
  • Various bug fixes and performance improvements.

New in Lens Studio 3.0.1 (Jul 15, 2020)

  • Fixed:
  • Various bug fixes and stability improvements.

New in Lens Studio 3.0 (Jun 11, 2020)

  • NEW:
  • SnapML - Bring your own neural networks to Lens Studio! Train a model and import it to create never-before-seen Lens effects!
  • Style Transfer Template - Stylize the camera to look like a painting, sketch or whatever your imagination can think of!
  • Object Detection Template - Find and track arbitrary objects in the camera. The provided template tracks cars, but you can use the example notebook to train a model to detect any object!
  • Glasses Classification Template - React to a person wearing glasses. The example notebook can be used to train a model to classify other objects that you have training data for.
  • Pizza Segmentation Template - Get a custom segmentation mask and use it to apply unique visual effects. The provided model masks pizzas, but you can retrain the network to segment anything you have training data for.
  • Ground Segmentation Template - Apply visual effects that transform the world around you using the ground segmentation model.
  • Face Expressions Template - Use 3D face mesh blendshapes to animate a custom 3D character.
  • Face Landmarks Template - Leverage 2D face tracking landmarks to drive interesting visual face attachments.
  • Hand Gestures Template - Use common hand gestures like pointed index finger, thumb and the peace sign to trigger sound effects. Modify to use as triggers for your custom effects.
  • 3D Eyeball Tracking - Replace or augment eyes in full 3D, including realistic gaze tracking!
  • IMPROVEMENTS:
  • Refreshed UI with two themes - See more information in the Object, Resource and Inspector panels with an all-new look. Includes more intuitive icons and convenient ‘Close to Home’ button.
  • Dock a minimized preview in scene panel - Keep the preview panel visible without taking up as much screen space by docking it in the lower-right corner of the Scene Panel
  • Script Editor - multiple UX improvements.
  • Material Editor – new types of nodes were added as loops, access to light source properties, working with matrices.
  • HDR Compressed Textures - option to compress environmental map textures to decrease the archive size of your Lenses.
  • Screen Texture - simplified moving of effects between cameras by adding the alias of current render target.
  • Mesh Precision - ability to switch vertex attribute format of any mesh.
  • Materials - added extended frustum culling and instance count.
  • FIXED:
  • Fixed issue with UI getting cut-off for macOS Catalina users
  • Fixed issue with UI scaling on Windows
  • Fixed crash on saving invalid JavaScript
  • Fixed crash on adding UI_Widgets.lso
  • Fixed crash on scrolling My Lenses and expanding Lenses info
  • Fixed issue with infinite loops in JavaScript blocking UI
  • Various bug fixes and performance improvements

New in Lens Studio 2.3.1 (Jun 5, 2020)

  • Improvements:
  • Reduced size of Lenses that use Segmentation or Object Tracking
  • Fixed:
  • Lens Studio now runs on Windows 7
  • Improved stability on GeForce GPU with specific drivers for Windows
  • Fixed creation/opening projects crashes on macOS 10.13 High Sierra with Radeon GPU
  • Other bug fixes and performance improvements