For as long as I can remember, photorealism has been a much sought after milestone in games. I guess that's just one of the things that we humans feel we need to achieve. The last attempt to do this comes from Intel Intelligent Systems Laboratory, where a team of researchers have created an AI that will take the artistic style of a game and remix it into something close to photorealism.
It is called "Improving Photorealism by Improving" and uses a convolutional neural network to analyze and alter a framework to make it look more faithful to life.
The perfect test case? GTA 5, according to researchers Stephan R. Richter, Hassan Abu AlHaija and Vladlen Koltun. Check out the results in the video below.
https://www.youtube.com/watch?v=P1IcaBn3ej0 [/ embed]
It’s a bit of a mixed bag. From a player's perspective, it looks gray, green, and a little murky. It gave me FPS vibrations in the early 2000s, as if saturation had been extracted. From a research perspective, though, it’s clearly a huge success, and I think that’s what we really need to focus on.
The ML technique is a way of transplanting photorealism to an image that has not been represented as such. To do this, you’ll need scenes that are completely drawn by lightning and very heavy workloads, just as only major animation studios can handle frames.
Researchers can also mix the results using different sets of training data. The & # 39; urban landscape & # 39; shown in the video may cause a rather blurry appearance, but the enhanced scene with the & # 39; Mapillary Vistas & # 39; it is much brighter and more colorful.
Clearly, there is a lot to be done to get this technology implemented and really useful for players or, in fact, for any form of support. Intel Labs researchers believe that its improvement could easily be transplanted to game engines for deeper, more realistic results, which could open up a whole new world of game customization, if done right.
The process will have to be accelerated by optimizing before we get anything close to the playback times. Inference with improved photorealism improves today takes half a second on an RTX 3090. Alas.