Nvidia's new patent: 90-240fps low-latency high frame rate streaming

The US Patent and Trademark Office published a patent application from Nvidia titled "Method And System For Low Latency High Frame Rate Streaming." The tech giant describes a low-latency solution designed to achieve 90FPS-240FPS without overloading available bandwidth.

       Nvidia explains: “By limiting the bitrate to the same value used by traditional 60 FPS streaming solutions, the client device and server device collaborate and actively monitor and control the video stream, adjusting the frequency or resolution when necessary to improve the streaming experience, thereby maintaining an acceptable balance between latency and video quality. When the server device captures and sends frames at a higher rate, the software stack executing on the client device is able to display the frames with less latency, even on a display device limited to 60Hz, thereby achieving additional latency reduction.”

       In one embodiment, a higher frame rate limit, a lower frame rate limit, and a target frame rate for streaming a frame to a remote client device are accessed; a streaming bit rate is adjusted according to the performance of the client device; a quality of the frame is determined, the target frame rate is reduced when the quality of the frame is below a lower quality limit, the target frame rate is increased when the quality of the frame is above an upper quality limit, and the frame is streamed to the client device according to the target frame rate and the streaming bit rate. Nvidia noted that the above steps can be repeated for multiple frames.

       The patent was originally filed in November 2018 and was recently published by the U.S. Patent and Trademark Office.