FPS doubling, frame interpolation via GPU

Frame interpolation is known as the ability of software and / or hardware to generate intermediate frames from information from two or more previously rendered frames.

FPS doubling, frame interpolation via GPU

Depending on whether we render the image in 2D or 3D, frame interpolation is performed in a completely different way, the most common of which is the interpolation of images in 2D.

How frame interpolation works

interolación fotogramas

We need two final frames to perform the interpolation, and therefore we have the final information.

In the case when we are talking about interpolation of streaming video, we have two different methods:

  • Interpolation is done by extended artificial intelligence systems who have been trained to detect different objects in one image and classify them. It is widely used in intelligent driving systems.
  • Another method is to record 2D images with an infrared camera or a camera during flight, said camera accompanied by a light emitter, the combination of both produces a depth map of each object, which helps to separate the various elements of the image. scene.

But in video games rendered with a 3D engine in real time (since a depth map is needed to know which objects are drawing preference), it is possible to create a data map with the identification position of each object.


The next step for the hardware is to create a speed buffer. This is built taking into account the start and end position of each previously identified object between two frames, so the system can create an intermediate frame with all the elements that have been moved from one frame to another.

How DMS works in various aspects

Applications and utility of frame interpolation

The most obvious utility is to add extra frames to videos with a low frame rate per second, it is especially used to restore old movies that were recorded at a very low speed or their frames were lost due to degraded transmission. time.

But in terms of games, it has a number of pretty interesting applications. For example, when it comes to streaming games – whether we’re streaming our games to other users over the Internet or playing on a game service, the ability to add intermediate frames helps create a smooth gaming experience. and avoids the feeling that the images reach the player too late.

The reason this idea will eventually be implemented in hardware is because the blocks responsible for video encoding and decoding are very similar in nature to those used to accelerate artificial intelligence algorithms, so hardware designers shouldn’t. im trying to implement this in their products.

Keep in mind that the concept is not that our games are rendered at twice the frames per second, but that their application is intended for streaming Internet applications, as well as the ability to transfer video content between devices over a wireless network. on the local network.

Related Articles

Back to top button

Adblock Detected

Please consider supporting us by disabling your ad blocker. Thanks.