Version 4.4922 June 2023NEW
- The Lens Performance Toolkit enables Lens Developers to view performance statistics of their Lens efficiency when running on devices.
- The Masking Component helps to make sure content is visible only within a certain window of the screen. It helps create an invisible frame that hides content when that content moves outside of frame.
- The Face Stickers template allows you to quickly build a face sticker Lens. With this template, you can place any images or texts of your choice on positions relative to the face.
- The Necklace Try-On Template offers a quick way for you to get started with Necklace based AR Try-On Lens experiences.
- With the Eyewear Try-On Template, Lens Developers can create unique glasses AR Try-On experiences at professional level. The Eyewear Try-On Template offers a quick way for you to get started with Glasses based Try-On experiences.
- The "What ___ Are You?" Template allows you to build your own unique spinner Lens by simply providing a list of words, images, colors, or a combination of them.
IMPROVEMENTS
- Face Tracking effects working will now perform more optimally when used together with the Garment Transfer custom component.
- Footwear Try-On has been updated to a SnapML model that better detects the user’s foot and provides a better quality try-on experience.
- The Earring Try-On template has been updated to showcase additional features to enhance the user experience.
- City-Scale AR template has been updated to showcase more in-depth information about how City-Scale AR Content works.
- The Wristwear Try-On template has been updated to utilize a new wrist occluder asset that is customizable to fit your Lens Experience.
FIXED
- Fixed issue with vertex color on latest Nvidia drivers
- Fixed issue with shaders/materials on latest Nvidia drivers
- Fixed issue when remote assets rendered without textures
- Fixed Tween Manager example
- Fixed issue when LS crashed when trying to attach VSCode debugger.
Version 4.4604 May 2023NEW
- The Masking Component helps to make sure content is visible only within a certain window of the screen. It helps create an invisible frame that hides content when that content moves outside of frame
- Hand and Nails Normals Maps allows developers to precisely add art to a user’s individual nails with a new subset of the Hand Segmentation Mask.
- Nail Segmentation is now out of beta and ready for public use.
IMPROVEMENTS
- The Garment Transfer Custom Component has been updated to include better quality rendering and support for a broader variety of textures and colors. This also includes the ability to create garments that feature animated content, the ability to provide a custom segmentation mask for garments and better target tracking.
- New Workflows and interactions has been included to make working with Location AR content easier in the Interactive Environment.
- Update Uber PBR material with code node.
- `Duplicate` selected button added for Animation Layer.
- Range Type updated with `Frames` by default.
- Improves behavior for custom component development to show unknown type widget for user via Logger with error and line number.
FIXED
- Fixed issue with Lens Studio freeze when Lens Studio is trying to compile TS files.
- Fixed issue when Lens Studio application can crash during HDR texture import.
- Fixed issue when project can not be open after resource corruption.
- Fixed issue when project can be corrupted after prefab import with custom component.
- Fixed issue when @type name inputs were cleared after resource import-export.
- Fixed issue when project can be corrupted when saved in cloud services.
- Fixed issue when specific prefab can freeze Lens Studio application.
- Fixed issue when project can be corrupted after import of specific prefabs which has VFX resource.
- Fixed issue when second mobile device which was paired with Lens Studio will not receive notification in Snapchat app after lens push.
- Fixed issue when user can received notification that shader needs to be updated for VFX asset.
- Fixed issue when Render Order was forced to AUTO for instantiated prefab.
- Fixed issue when user can not open project after fbx model was imported into it..
Version 4.4323 March 2023NEW
- Cubemaps offers Lens Developers the ability to apply multiple 2D Textures to an individual face of a cube to be used to generate effects such as skyboxes, reflections and unique lighting setups.
- The Cubemap Template showcases various ways Lens Developers can use cubemaps to create lightweight and complex lighting solutions.
- SnapML’s new Portrait Relighting introduces the ability to enhance or change the light and background of photos, as well as adding your own custom lighting to photos.
- The Gem Rendering Custom Component provides Lens Developers a way to reproduce the unique lighting effects in gemstones such as ruby, sapphires and diamonds.
- The Gem Rendering Template offers Lens Developers a quick way to get started with building Gemstone focused Lenses.
- The Physics Lab template in conjunction with the Content Editor Tools, teaches both Lens Developers and Snapchatters how to both author and play a simple physics-based game on device and from within Lens Studio.
- Lens Studio Visual Studio Code Extension has been released to the VSCode Marketplace to help streamline Lens Studio development in VSCode.
IMPROVEMENTS
- Lens Developers can now opt-out of using the Version Control Friendly Project Format.
- Support for Multiple Custom Locations in a single Lens.
FIXED
- Fixed crash of Lens Studio application when update materials dialog applied for Responsive Plants template
- Fixed issue when user received update materials button after project reopen instead of on state when assets were added into project
- Fixed issue when project can not be reopened on macOS after custom components was deleted from the project
- Fixed crash of Lens Studio application when project with VFX assets was optimized
- Fixed crash of Lens Studio application when import of ML model was canceled
- Fixed issue when user received unexpected user dialog in Lens Studio Tutorial
- Fixed issue when animated WebP asset imported as upside down
- Fixed issue when ‘getTimeLeft’ for delayed events returning elapsed time, not remaining time
- Fixed issue when Lens Studio application will not revert updated shaders to old version after Undo
- Fixed crash of Lens Studio application if script invalidates a physics body
- Fixed issue on Windows OS when user can not reopen project which was saved in folder connected with Google Drive
- Fixed issue when Connected lens template shows error level log if not hitting the join button.
Version 4.3615 December 2022NEW
- With LensFest 2022, The Snap AR Engineering team has created two new developer focused tools to help accelerate and streamline Lens Development
-- Sync Framework is a set of scripts and components designed to help you build Connected Lenses for building shared online multiplayer experiences.
-- The Persistent Noteboard template features a note-taking Lens that utilizes the Canvas component and comprises two note-containers and an Input Modal for creating note entries.
- The Lens Quality Assurance Troubleshooting guide offers a series of tasks and examples of common bugs you may encounter when building Lenses and how best to resolve those issues.
IMPROVEMENTS
- New option in 2D scene toolbar to make ScreenTransforms save their screen space coordinates when being reparented.
- As previously mentioned in our Community Forum post, New Lens submissions using Wannaby Technology will be rejected in Lens Studio.
-- Please note that existing Lenses using Wannaby Technology will continue to run in perpetuity, however they can no longer be updated.
- Best Practices for Remote Assets has been added as a way to help create a fluid user experience when building Lenses with Remote Assets.
- Update of autogenerated code to print error code and messages when API requests fail.
FIXED
- Fixed bug hiding autocomplete results in script editor
- Fixed crash of Lens Studio on specific prefab Apply after it was instantiated
- Fixed issue with 'Divide' node for Apple Silicon
- Fixed issue when Custom Component file (.lsc) is showing as modified right after project reopen
- Fixed issue when Custom Component typename input can disappear after project reopen.
Version 4.3106 October 2022New
- Remote Assets offers developers a way to store assets within Lens Cloud to dynamically load their created content into Lenses at runtime. Since Remote Assets do not count against the Lens size limit, developers can build more complex Lenses and re-use assets across multiple Lenses.
-- With this release of Remote Assets, developers can utilize assets up to 10MB per asset and a max of 25MB per Lens. Organizations can use up to 500 MB of space for storing assets.
- The Physics System has been updated to enable Developers to create Lenses with more realistic interactions and movement between AR objects in a scene. Some of the major features include;
-- Support for Collision meshes, allowing collision, simulation, and ray casts against arbitrary render meshes.
-- Correct handling of center-of-mass and inertia.
-- Extend ray cast functions to support sweeping a primitive shape, such as a sphere, along a transform path.
-- Support for collision filtering, enabling control over how colliders interact with one another.
- With the addition of Los Angeles and Santa Monica as new cities available in Lens Studio, creators can now build City-Scale AR content spanning across the multiple cities mapped in Lens Studio.
-- The City Landmarker feature has been renamed to City-Scale AR.
- Canvas is a new Component that creates a dedicated root within the ScreenTransform hierarchy to dynamically place 2D Components, like Text and Image, in 3D space. The Canvas Component is built to adapt to multiple tracking solutions, giving Developers the flexibility to add more 2D AR enabled content to their experiences.
- Tooltips have been added to Lens Studio as a quick way to get information about how to use Lens Studio.
Improvements
- The new Hand Tracking solution has been added to Body Tracking.
- The ‘Sounds’ section in the Asset Library has been renamed to Music to provide Lens Creators an easier way to add their favorite songs to Lenses.
- The glTF material and glTF Importer has been updated to support two new extensions: `KHR_materials_sheen` and `KHR_texture_transform`.
- Lens Studio Templates will now display the name of the Creator on the homepage.
- Added a dedicated Asset Library button in the Add Resources panel.
Fixed
- Fixed issue of broken Custom Code Node validation
- Fixed issue when default envmap textures were deleted during component deletion
- Fixed issue when studio may crash after copy a physics collider component
- Fixed issue when Audio Component stops working once joined connected lenses session.
Version 4.2826 August 2022New
- With Spatial Persistence, Snapchatters will be able to read or write AR content at a physical location and retrieve this data at the same physical location when they restart their lens.
-- The new Spatial Persistence Template shows how Lens Creators can build AR content that is tied to a physical location in the world
- Along with Spatial Persistence, The Content Editor Tools asset provides a set of plug-and-play custom components that enable users to place and manipulate persistent AR content.
-- The new Content Editor Tools Template showcases how to build persistent AR content where users can place and manipulate AR persistent content inside a Lens.
- Voice ML’s Question Answering Service gives Lens Creators the ability to build voice enabled Lenses that can understand questions about a single topic and receive real time answers based on pre-loaded informational text.
- A new hand tracking solution has been implemented that now enables Two Hand Tracking within Lenses. This update expands upon the current 3D Hand Tracking solution to efficiently track two hands at once when building content for Spectacles.
- Lens Creators can now use the new Face Occlusion custom component that can be used to improve Face enabled Lenses by masking out content that is covered by hair, hands or other objects.
Improvements
- The Speech Recognition Template has been updated to showcase support for French.
- The Bitmoji Custom Component has been updated to include the new hand tracking solution, allowing for Snapchatters to attach their Bitmoji avatars to bodies in Lenses and enable hand tracking.
- Support for Arrays of Combo Boxes and Quaternions have been added to the Script Editor.
- Render Layer Controls now visible in the Inspector for all SceneObjects.
- Added submission warning box for Lens submissions with one camera turned off, to help creators get maximum reach on Snapchat.
- Added object preset for empty ScreenTransform.
Fixed
- Fixed issue when Auto-updater is stuck on restart if permissions to the app folder are not granted to the effective user.
- Fixed issue when parameters before the light loop node are not displayed in the material inspector.
- Fixed issue when Interactive Preview movement keys conflict with the common shortcuts.
- Fixed issue when Live tracking UI missing if you close Preview panel or open other project.
- Fixed issue with when renaming with pressing Enter can't be finished with pressing Enter second time.
- Fixed issue when script graphs cannot be exported.
- Fixed issue when @typename field doesn't refresh inspector.
Version 4.2514 July 2022New
- Similar to Hand Segmentation, Footwear Segmentation allows Lens Creators to segment effects within or around a user’s feet. In our Footwear Segmentation template, you will learn how to utilize the new segmentation feature to render unique effects.
- The Body Morph template enables Lens Creators to morph the body of a user into another custom mesh which has the same UV map as the standard Body Mesh.
- Lens Studio scripting now supports Script Modules in the Common JavaScript format. By adopting this industry standard, and providing support for it in lenses, we are enabling professional JS development. -- There is now a dedicated Script Modules category in the Asset Library.
- Support for .glTF Physically Based Rendering extensions have been added, including transmission, clear coat and unlit extensions.
Improvements
- Custom Components have received the following improvements: -- Creating ScreenTransforms at runtime will now have the same default values as creating them in Lens Studio. -- Creating Visuals like Text or Image at runtime will now have automatic render order like creating them in Lens Studio. -- Added ability to view and edit common parameters in inspector for multiple selected resources of different types.
- We have updated our ASL Template with new animations, models and logic.
Fixed
- Fixed issue when VFX material can not be compiled after import from lso
- Fixed issue with colocated landmarks materials in Connected Template.
- Fixed issue with render when Face Inset was duplicated.
- Fixed Lens Studio crash when occluder material was re-added.
- Fixed issue with Uber PBR material if Blend Mode was updated.
- Fixed issue when overlay does not work because of Blend Mode from Post Effect..
Version 4.1930 April 2022New
- Lens Cloud is a collection of backend services, built on the same infrastructure that powers Snapchat. Lens Cloud vastly expands what developers can build in augmented reality by providing Multi-User Services, Location Services, Storage Services and Scanning Services.
-- With the release of Lens Cloud, a City Scale Template has been provided to learn how to get started building city wide content for London, UK.
- A dedicated Visual Studio Code Extension has been released to give developers the functionality to use VSCode as an IDE for their Lens Studio projects. With the extension installed, VSCode enables; Code editing and smart code completion, JavaScript debugging for Lenses and JavaScript code snippets for Lens development.
- Body Depth & Normal Texture Guide and Template provides developers a detailed estimate of the depth and normal direction for every pixel of a person including their body, head, hair, and clothes. This lets the user easily create sophisticated lighting effects and calculate realistic occlusion and collisions with AR objects.
- SnapML has also received some updated features to enhance a user’s experience and understand the user’s environment.
-- Light Estimation allows developers to do more realistic rendering by matching the real world lighting on objects rendered by the Lens.
-- Noise/Blur Estimation gives developers the ability to match the noise and blur levels from the device’s camera with the AR content.
- SnapML now supports quantized models, an ML model format. Some of the benefits include; model size reduction by 50%, fast inference speed, and more power efficiency.
-- To help showcase quantized models, a new Multi Class Classification Template has been added to showcase these new features.
- Lower Garment Segmentation has been added to the Segmentation System allowing developers to get segmentation masks based on data for upper-garment and lower-garment systems simultaneously with low overhead. A Segmentation Trails Template has been added to showcase this functionality.
- True Size Object Template is a new template that utilizes the best tracking solution available for your device to provide users an accurate scale when placing objects in their physical space. This allows users to test how well physical objects can fit into their environment.
- Voice ML has received two new templates for developers to learn how to add an extra layer of personalization to their content.
-- 2D Animated Text-to-speech uses a user’s voice to animate 2D lips to be synced with voice.
-- Sentiment Analyzer is a new ML model that returns one of 28 optional emotion classes, such as hope, happiness and anticipation.
Improvements
- The API Library has expanded allowing you to now build Lenses with third party APIs that give play by play data from five different sport leagues, daily zodiac astrological predictions, and location specific air quality data.
-- Additionally, we made it easier to build Lenses with third party APIs by automatically generating a block of code used to connect to an API upon importing the API asset into your project.
Fixed
- Fixed issue when duplicate custom components cannot be created from script.
- Fixed issue when base color textures are tinted blue on import of certain glTF files.
- Fixed crash of Lens Studio with different glTF models.
- Fixed crash of Lens Studio when specific script has errors.
- Fixed issue when 'Device Camera Texture' moved from folder into root of Resources Panel..
Version 4.1301 February 2022NEW
- Installable Content - dynamic delivery of different types of content, such as templates, presets, etc. that are independent from Lens Studio versions.
- The Audio Output template enables you to generate audio data using javascript and play it on a device. It provides simple examples such as oscillators, noise generators, audio track file players, etc.
IMPROVEMENTS
- Cloth Simulation that was only available through Javascript, now has UI enabled.
- Foot tracking template that allows you to attach objects to your feet, has been updated.
FIXED
- Fixed error if authentication scope was incorrect.
- Fixed crash on Mac with Apple Silicon CPU when trying to import HDR with high quality.
- Fixed issues with Lens Studio locking up on Windows when two or more video textures were running.
- Fixed issue with GIF relink on losing connection to original file..
