Introduced by Runway as “A new way to edit, transform, and generate video,” Aleph is an in-context video model that utilizes the latest (and possibly greatest) AI technology to deliver multi-task visual generations.
Among these multi-task visual generations are sophisticated capabilities such as object addition, removal, and transformation, similar to those seen in photo-editing AI tools like Adobe Photoshop’s Object Removal and Generative Fill.
Even more impressive is Aleph’s ability to generate new angles of a scene or modify its style and lighting.
Runway Aleph Features and Capabilities
While further advancements are expected, here is a summary of Aleph’s current powerful features:
-
Generate New Camera Angles: Create novel views of existing scenes with simple prompts, including reverse shots or low angles, allowing for endless coverage.
-
Generate the Next Shot: Seamlessly continue your story by generating the next shot in your sequence on demand.
-
Style Transfer: Easily apply any desired aesthetic style to your video footage.
-
Change Environments and Time: Modify locations, seasons, and time of day in footage, retaining as much or as little of the source as desired.
-
Add Objects to a Scene: Enhance your footage by integrating crowds, products, or props naturally with accurate lighting, shadows, and perspective.
-
Remove Unwanted Elements: Easily eliminate clutter or distracting objects from scenes.
See More ...
-
Change Objects: Retexture or replace objects and subjects with text prompts or reference images.
-
Apply Motion to Images: Transfer motion from a video to a new first-frame image for fine-grained camera control.
-
Alter Character Appearance: Change actors’ age and appearance with simple prompts without practical makeup or costly effects.
-
Recolor Scene Elements: Modify object colors using a color swatch or palette description.
-
Relight Shots: Transform lighting conditions, such as changing harsh noon light to golden hour or creating dramatic sunset lighting, with natural adjustments to shadows, reflections, and color temperature.
-
Green Screen Isolation: Automatically isolate any person or object with precise edge detection, preserving fine details for seamless export on transparent or solid backgrounds.
Runway reports that early access to Aleph will soon roll out for Runway Enterprise and Creative Partners, with broader access to all users to follow.
For more information, visit Runway’s official website.
