Heyjo,
You’ll soon be able to test NVIDIA’s Streamline SDK in vvvv, which gives you access to their latest AI-powered rendering technologies.
DLSS 4.5
Super Resolution: Render at lower resolution and let DLSS upscale with their new transformer-based models.
Frame Generation: Generates frames between rendered frames. Up to 6x on RTX 50 series, 4x on RTX 40 series.
Dynamic Frame Generation: Auto mode that enables/disables FG based on whether it actually helps performance.
Denoising: AI denoiser for ray-traced content.
NIS (NVIDIA Image Scaling)
Spatial upscaler with sharpening. Works on all NVIDIA GPUs, no RTX needed. Lighter than DLSS, useful when you just need sharpening or basic upscaling.
DeepDVC
AI color enhancement. Adjustable intensity and saturation boost.
Status
- DLSS SR: working
- DLSS FG: wip (2x-6x depending on GPU)
- Dynamic FG: wip
- Denoising: planned
- NIS: working
- DeepDVC: working
- Reflex: integrated
Requirements
- DLSS: RTX 20+ (FG needs RTX 40+, 4x+ needs RTX 50)
- NIS: Any recent GPU
- DeepDVC: RTX GPU
- GeForce Game Ready Driver 591.74 or later
- Windows 10/11, Hardware GPU Scheduling enabled
Experimental
I’m also looking into using FG for video/non-3D-rendered content where you don’t have proper motion vectors or depth. Early research, might work, might look crappy.
Release soon-ish, will update here.
Commissioned by Refik Anadol Studio.
Cheers!