Inworld AI teams with Nvidia and Streamlabs for intelligent streaming assistant

Internal AI announced that it is cooperating with Nvidia and Streamlabs to create a smart streaming assistant using AI technology.

Streamlabs’ intelligent streaming assistant acts as an interactive co-host, expert producer and technical assistant that will give independent creators the support of a full production team. Internal AI will provide the brains behind it, using multimodal AI that can offload tasks from streamers who don’t have large production teams.

The companies made the announcement at Nvidia’s CEO Jensen Huangkeynote speech of CES 2025.

The collaboration brings together Streamlabs’ expertise in live streaming and Nvidia’s ACE technology for digital people. The latter includes audio-to-face animations, 3D rendering technology, as well as AI visual models that can understand what’s happening on the screen; and Inworld’s advanced generative AI capabilities for perception and cognition. Together, these technologies simplify streaming while empowering creators to produce high-quality, engaging content.

Creators can choose from assistants that complement the tone of their stream, whether they’re looking for subtle behind-the-scenes support or a lively co-host.

How it works

Here’s how Inworld works under the hood to power this AI agent:

• Interactive host: Using Nvidia’s computer vision capabilities to detect real-time events with Inworld’s ability to manage agent behavior in real-time based on game state and contextual understanding of games like Fortnite, the Intelligent Streaming Assistant can offer contextually relevant comments at the creator’s request. This awareness allows the assistant to do things like highlight a timely build, provide commentary during a dramatic Victory Royale, or call out audience members to submit tips.
• Stream producer: Like a producer overseeing the flow of a live show, the streaming smart assistant can trigger audio and visual effects to enhance high-impact gameplay or cut the best highlights for replay. Inworld processes multimodal inputs from the creator, chat, and game to execute these producer actions through the Streamlabs API, giving the creator complete control over how their stream is deployed.
• Technical Associate: Smart Streaming Assistant also helps with Streamlabs desktop setup and troubleshooting. Inworld processes input from the creator to execute scene transitions or animations through the Streamlabs API, helping ensure the stream runs smoothly.

The smart streaming assistant will be available through the Streamlabs App Store when the product launches later in 2025.

“The pace of innovation in generative AI is nothing short of extraordinary, pushing us beyond first-generation applications into a new era of advanced agent behavior,” said Kaylan Gibbs, CEO of Inworld, in a statement. “Our collaboration with Streamlabs and Nvidia is an example of how Inworld’s AI agents enable real-time, context-aware interactions. More importantly, it demonstrates the real-world potential of AI to augment gaming and entertainment – ​​empowering creators to deepen engagement and delight their audiences.”

Live streaming has never been more popular or more demanding. While millions of creators captivate audiences around the world, the challenges of managing production, engaging with viewers, and providing entertaining commentary all at the same time can be overwhelming.

From juggling stage transitions to providing entertaining commentary, streamers have to deal with a complex mix of technical and creative demands, often with limited resources, Inworld AI said.

For new and smaller creators, those hurdles can be even steeper, making it harder to grow their audience and stay consistent, the company said. Whether acting as a dynamic co-host by engaging audiences through real-time interaction or as a producer streamlining technical workflows, the Intelligent Streaming Assistant enables creators to focus on what matters most – engaging their audience.

“We hope that with this groundbreaking technology, creators can now embrace AI in a way that is authentic to their brand and allows them to push the boundaries of innovation,” Ashray Urs, head of Streamlabs, said in a statement. “The first intelligent streaming assistant represents another leap forward for media, giving creators the power to use this technology to make streaming easier and more immersive, while maintaining the level of authenticity they need to nurture and develop their community.”

Inworld’s AI engine and tools are driving the next generation of gaming and entertainment innovation. Inworld is backed by Lightspeed Venture Partners, Section 32, Intel Capital, Founders Fund, Disney Accelerator, Microsoft’s M12 Fund, BITKRAFT Ventures, First Spark Ventures co-founded by Eric Schmidt, The Venture Reality Fund, Kleiner Perkins, CRV, Stanford University. Meta, Micron Ventures, LG Technology Ventures, Samsung Next, NTT Docomo Ventures and SK Telecom Venture Capital.