Skip to main content

Adobe MAX Sneaks 2019: AR prototyping, automatic photo relighting, image manipulation detection, more previewed

Adobe hosted its annual Sneaks event at MAX 2019 tonight, co-hosted by writer and comedian John Mulaney. Sneaks offers a preview into new features Adobe is developing for its Creative Cloud apps, and experimental technologies that may or may not make it to production.

Last year at Sneaks, the project that would later become Premiere Pro’s Auto Reframe was one of 10 features previewed. This year, Adobe highlighted 11 more projects on stage.

More from Adobe MAX 2019:

All In

Using machine learning technology, a subject in a photo can be automatically identified and extracted from the scene. Project All In takes a photo of the same scene where the extracted subject is missing, and blends them seamlessly into the environment. The feature is designed for group photos where the photographer is behind the camera, but would still like to be part of the shot.

Sound Seek

Unwanted, repetitive sounds in an audio clip are automatically identified by selecting one instance of the sound. With one click, all of the selected sounds are removed. Project Sound Seek could be used to remove every instance of a speaker saying “uhh,” or even environmental sounds like a car horn.

Sweet Talk

Animating a character’s face to a voiceover track is currently a tedious process that requires a complex 3D mesh. Project Sweet Talk takes any image file, including illustrations, photos, and paintings, and automatically identifies the subject. The character’s facial expressions are mapped to the audio and the image is animated without any additional work from the user.

Pronto

Based on Adobe Aero technology, augmented reality design mockups can be created by simply sketching on an iPad. The tools allows artists to record a video, insert an AR placeholder device into the 2D video, and track 3D planes. Graphics and freeform illustrations can be mapped to the AR placeholders.

Image Tango

With just a reference photograph, Adobe Sensei can apply textures to a simple sketch with one click, creating completely new photos. Image Tango can also be used to rapidly test multiple textures on a single object. In one example, stock images of various purses were used as reference images to re-texture an existing purse.

Fantastic Fonts

Fantastic Fonts turns typography into a series of infinitely customizable parameters. Simple adjustments like font weight can be manipulated, but the tool goes much further. Using an iPhone or iPad’s accelerometer, fonts can be animated and distorted with various motion effects. The tool enables customizations on live fonts previously only possible by outlining text.

Go Figure

Sensei-based body tracking transfers a character’s motion in a video clip to an animation. The body tracker identifies the arms, legs, and torso of up to 18 characters in a scene. Keyframes are generated and automatically applied to a rigged character. The effect is similar to motion capture, but works without any additional hardware.

Light Right

Using Photoshop, a photo can be relit to change the mood of the scene. Algorithms identify the geometry of the photo and allow the sun to be repositioned. Depending on where the sun is placed, highlights and shadows are adjusted, and the color temperature of the photo changes. Using the same technology, even a video file can be relit.

Awesome Audio 

Troublesome audio with distracting background noise or a muffled voice is corrected using Adobe Sensei technology. Cleaning up a rough audio file is a process that normally takes hours in a tool like Adobe Audition. Voiceover segments recorded in multiple locations can be analyzed, unifying the background ambience across clips.

Glowstick

Built inside of Illustrator, Project Glowstick turns lines and shapes into sources of light and shadow in an image. Light sources and shadows are defined with one click, and influence the coloring of other objects and shapes in an image.

About Face

Project About Face analyzes the pixels in an image to attempt to identify if the photo has been digitally manipulated. The tool displays the probability that a photo was tampered with, and reveals a heat map of questionable pixels.

FTC: We use income earning auto affiliate links. More.

Apple iPhone 11 case deals on Amazon
You’re reading 9to5Mac — experts who break news about Apple and its surrounding ecosystem, day after day. Be sure to check out our homepage for all the latest news, and follow 9to5Mac on Twitter, Facebook, and LinkedIn to stay in the loop. Don’t know where to start? Check out our exclusive stories, reviews, how-tos, and subscribe to our YouTube channel

Comments

Author

Avatar for Michael Steeber Michael Steeber

Michael is a Creative Editor who covered Apple Retail and design on 9to5Mac. His stories highlighted the work of talented artists, designers, and customers through a unique lens of architecture, creativity, and community.

Contact Michael on Twitter to share Apple Retail, design, and history stories: @MichaelSteeber

Manage push notifications

notification icon
We would like to show you notifications for the latest news and updates.
notification icon
You are subscribed to notifications
notification icon
We would like to show you notifications for the latest news and updates.
notification icon
You are subscribed to notifications