When I attended Adobe Max last November, I was able to chat with some key product managers of the team as well as get a sneak peak at projects in the work. Adobe typically holds a session it calls Max Sneaks which demonstrates a few ideas the developers are kicking around. Some of the ideas actually end up in an Adobe product. A project mentioned at last year’s Max was project “Smooth Operator” which has now been announced as the next tool in the AI engine, Sensei. The official name of this AI effect is Auto Reframe as mentioned at IBC.
What Is This New Feature?
The best way to explain this is to think about videos you’ve shot on your phone. Now, think of the times you go to share the video to your Instagram story. In most cases, that video will have to be resized or moved to keep the points of interest in the frame due to Instagram stories being in a portrait format (vertical), and you actually shot in landscape format (horizontal).
image by Adobe
Auto Reframe will take this footage and analyze it in Premiere Pro to figure out the proper framing of your subject matter. Usually, this task would require a lot of keyframing to get the shot framed properly. Especially if it’s a moving subject. Now, video editors can fix this framing issue with the click of a button using Adobe Sensei.
Auto reframe will be available in Premiere Pro “later this year”. Maybe it will be available in November after Adobe Max? We’ll see. Check out this video for a nice demo of Auto Reframe.