AI’s new AI model of stability turns photos into 3D scenes

Stability AI has released a new AI model, a stable virtual camera that the company claims can turn 2D images into “immersive” videos of realistic depth and perspective.

Virtual cameras are tools that are often used in digital movie creation and 3D animation to shoot and navigate scenes in real time. With a stable virtual camera, the stability strives to add a generative AI to the mixture to provide more great control and customization, the company said in A Blog postS

A stable virtual camera generates “new views” on a scene of one or more images (up to 32 in total) at the camera angles that a user indicates. The model can generate videos that travel on “dynamic” trails of the camera or preset settings, including “Spiral”, “Dolly Zoom”, “Move” and “PAN”.

The current version of the stable virtual camera, the preview of the study, can generate videos in a square (1: 1), a portrait (9:16) and the ratios of the landscape (16: 9) with a length of up to 1000 frames. Stability warns that the model can lead to lower quality results in certain scenarios, especially in images containing humans, animals or “dynamic textures” such as water.

“Highly ambiguous scenes, complex camera paths that cross objects or surfaces, and improperly shaped objects can cause flickering artifacts,” notes stability in the blog post, “Especially when target views differ significantly from entrance images.”

The stable virtual camera is available for research under a non -commercial license. It can be drawn from the hugging face of the AI ​​DEV platform.

Stability, the dressed company behind the popular image generation model Stable diffusion., raised new money last year As investors, including Eric Schmidt and Napster Founder Sean Parker, they tried to turn the business. Emad Mostaque co -founder, Stability stability and former CEO, announces that the financial devastation stability has been managed, which causes staff to resign, partnership with Canva, to collapse investors to bother with the company’s prospects.

In the last few months, stability has hired a new CEO, appointed the director of Titanic James Cameron to his board of directors and have launched several new models to generate imagesS Earlier in March the company Torn with the chipmaker’s hand To bring an AI model that can generate audio, including sound effects on mobile devices working with chips.