RetroRGB Interview on Vint
I recently had an interview with Bob from RetroRGB about Vint, 24 FPS video, and display temporals.
Check it out here:
https://retrorgb.com/interview-with-vint-creator-william-sokol-erhard.html
Showing posts with label Video streaming. Show all posts
Showing posts with label Video streaming. Show all posts
Monday, January 12, 2026
Friday, January 24, 2025
My New Temporal Upscaling App, Vint, is Now on Steam
Vint can now be downloaded from itch.io: https://willse.itch.io/vint
I'm happy to announce that the application I've been working on for many months now is ready to release very soon. Vint is focused on improving the temporal fidelity of any video you throw at it. Vint supports the highest quality realtime video interpolation available and allows unique features and control over the configuration. The app also supports many different types of Black Frame Insertion (BFI) strobing to add motion clarity without any interpolation.
Vint uniquely enables CRT scanout beam emulation on all video sources. CRT emulation is based on https://blurbusters.com/crt
Vint can play video from nearly any video format and most web sources. It can even use UVC video sources from capture cards or webcams and upscale on the fly. Vint allows for offline transcoding as well in case you want higher quality, want to watch on a weaker device, or you are making a video and you want to make a slow-mo video from a 30FPS recording.
I write a little more about it here: https://www.willse.me/vint
The release and further information about new features will be coming in the next few weeks.
Let me know what features you want to see.
Tuesday, August 13, 2019
Further Pathtracing and Lessons Learned
Since the last article, I've made some substantial changes. I've added screenspace settings to the build, added multiple rays per pixel, randomly generated the scene at runtime, added movement controls, added fast movement compensation with adaptive temporal accumulation for VR, and finally I added a light Gaussian blur effect to reduce noise.
Dynamically changing the temporal accumulation in addition to improving the reprojection warping allows the user to get a clean image while still remaining temporally stable and responsive to faster movement.
It's clear that simply increasing the rays per pixel has little effect on image quality while absolutely demolishing any semblance of performance. The resulting image remains noisy and generally unsatisfactory.
Temporal accumulation does a substantially better job while not impacting performance and only introducing a somewhat obnoxious temporal artifact that is mitigated by higher framerates and movement compensation. Temporal accumulation alone however still leaves a fine grain noise with pixel sized bright specks and black spots.
Finally, the softer Gaussian blur helps remove those pixel specks and spots and results in a fairly clean image better than nearly anything short of intelligent hardware accelerated denoising.
As a side experiment I tried building to UWP and using holographic remoting to run the project on the Hololens. Performance was great even at 4x resolution due to the low 720p resolution of the Hololens displays but wifi speeds & reliability as well as compression artifacts were problematic.
 |
| Simple high raycount per pixel |
 |
| Lower rays/pixel and no Gaussian blur but high temporal accumulation |
 |
| With light Gaussian blur, lower rays/pixel, and heavy temporal accumulation |
Things that worked:
- Separate rendering for each eye for XR
- Moving Unity GameObjects and meshes each frame
- Gaussian blur to reduce noise
- Dynamically changing RenderTexture resolution
- Distorting temporal accumulation based on 3DOF head rotation
- Changing temporal accumulation rate based on head movement rate
- Hololens support with Holographic remoting
- Foveated rendering with Graphics.CopyTexture()
- OpenGL ES 3.1 compute shaders for Android
- MultiGPU parallel compute shaders
- RT core acceleration
- MultiGPU support with RT cores and/or shaders
- AI tensor core or CPU intelligent realtime denoising
- Dynamic rate of rays per pixel (based on pixel coordinates)
- Foveated rendering with that rays/pixel value
- Complex meshes without stranglehold bandwidth and calculation bottlenecks
Subscribe to:
Posts (Atom)