NVIDIA Broadcast Enhances Livestreaming and Remote Work with AI-Powered Features
Rongchai Wang Jun 27, 2024 03:29
NVIDIA Broadcast app leverages AI and RTX GPUs to deliver professional-quality audio and video for livestreaming and remote work.
NVIDIA has introduced the latest version of its Broadcast app, aimed at improving the quality of livestreaming and remote work through advanced AI-powered features. According to the NVIDIA Blog, the free application leverages Tensor Cores on RTX GPUs to deliver professional-level audio and video enhancements.
The Stream Dream
Historically, high-quality livestreaming required expensive hardware setups, often involving dual-PC configurations to handle gaming and encoding separately. NVIDIA Broadcast changes the game by utilizing NVENC, a dedicated hardware video encoder on NVIDIA GPUs, which processes encoding tasks and allows the rest of the system to maintain optimal performance. This innovation is supported by popular streaming applications like Open Broadcaster Software (OBS), enabling a new wave of broadcasters on platforms such as Twitch and YouTube.
Additionally, NVIDIA Maxine offers free AI-powered features like virtual green screens and webcam-based augmented reality tracking, eliminating the need for costly physical equipment. These features debuted at TwitchCon 2019 and have since been integrated into the NVIDIA Broadcast app.
Now Showing: NVIDIA Broadcast
NVIDIA Broadcast provides a suite of AI-enhanced features designed to improve audio and video quality across various use cases. Some of the key features include:
- Noise and Acoustic Echo Removal: AI eliminates unwanted background noise from both the microphone and inbound audio.
- Virtual Backgrounds: Features like Background Removal, Replacement, and Blur allow users to customize their backgrounds without expensive equipment.
- Eye Contact: AI makes it appear as though a streamer is looking directly at the camera, even when they are not.
- Auto Frame: Dynamically tracks movements and automatically crops and zooms in on moving objects.
- Vignette: Applies a darkening effect to the corners of the camera image for visual contrast and stylistic flair.
- Video Noise Removal: Removes visual noise in low-light conditions for a clearer picture.
The app creates a virtual camera, microphone, or speaker in Windows, allowing users to set up their devices once and use them across multiple applications, including Discord, Google Meet, Microsoft Teams, OBS Studio, Slack, Webex, and Zoom. NVIDIA Broadcast's AI networks run in real-time on dedicated Tensor Cores found in NVIDIA GeForce RTX, TITAN RTX, NVIDIA RTX, or Quadro RTX GPUs.
The technology behind NVIDIA Broadcast is also available as a software development kit for app developers. Companies like Elgato and independent developers have integrated these AI features into their products, further expanding the reach and utility of NVIDIA's AI advancements.
(Not) Hearing Is Believing
Since its release, NVIDIA Broadcast has gained widespread adoption. Twitch personality Mr_Vudoo and YouTube host Unmesh Dinda have both praised the app's capabilities. Dinda demonstrated the app's noise-canceling features in extreme conditions, showing its effectiveness even with loud background noises. Tom's Hardware editor-in-chief Avram Piltch also tested the app, confirming its ability to filter out various ambient sounds.
NVIDIA Broadcast proves beneficial for remote work as well. It enhances video calls by providing features like background removal, which has been well-received by users in professional settings.
For more information and to download the app, visit the NVIDIA Broadcast page.
Image source: Shutterstock