Methods and systems for game video recording and virtual reality replay

Abstract

Methods and systems for processing computer game videos for virtual reality replay are disclosed. The method, when executed by a processor, comprises first receiving a video recorded using a virtual camera array during a game play of a source computer game. Next, upscaling the received video to a higher resolution, and interpolating neighboring video frames of the upscaled video for insertion into the upscaled video at a server. Finally, generating a spherical video from the interpolated video for replay in a virtual reality environment. The virtual camera array includes multiple virtual cameras each facing a different direction, and the video is recorded at a frame rate and a resolution lower than those of the source computer game. The spherical videos are provided on a video sharing platform. The present invention solves the chicken-and-egg problem of mass adoption of virtual reality technology by easily generating VR content from existing computer games.

Description

NOTICE OF COPYRIGHTS AND TRADEDRESS[0001]A portion of the disclosure of this patent document contains material which is subject to copyright protection. This patent document may show and / or describe matter which is or may become tradedress of the owner. The copyright and tradedress owner has no objection to the facsimile reproduction by anyone of the patent disclosure as it appears in the U.S. Patent and Trademark Office files or records, but otherwise reserves all copyright and tradedress rights whatsoever.FIELD OF THE INVENTION[0002]Embodiments of the present invention are in the field of game video recording and replay, and pertain particularly to methods and systems for 360-degree video recording of 2D, 3D, and VR games, with video and audio post-processing to enable spherical video replay in a virtual reality environment. Embodiments of the present invention leverage the vast number of desktop and mobile games available today and effectively bridge game content with the novel r...

AI Technical Summary

Benefits of technology

This patent describes a system for processing game videos to be played in virtual reality. The system captures video using a virtual camera array with multiple cameras facing different directions. The video is then upscaled to a higher resolution and interpolated frames are added to create a spherical video for replay in virtual reality. The resulting video is suitable for 2D, 3D, or virtual reality games. The system can record monoscopic video or high-resolution screenshots for each virtual camera. The virtual camera array can be stabilized.

Problems solved by technology

Yet content availability is a clear hurdle for mass mainstream adoption of the futuristic technology.

On the one hand, without sufficient VR content, consumers lack motivation to purchase VR headsets or VR-capable personal computing devices that are certain to cost a considerable sum; on the other hand, without a significant VR user base, content producers such as game makers are reluctant to invest significant resources into VR content production.

Without compelling content or a staunch fan base, even dramatic advances in VR technology such as are happening today would not attract enough demand to match the supply of ever more VR hardware into the market.

However, these screencast services record the device screen only, not the entire 360-degree environment.

No known solution exists to convert screencast recordings into spherical media for VR replay, or to render and record in 360 degrees directly within a 3D game.

Nonetheless, such systems are generally offline tools for demo generation by game developers only, and are incapable of real-time capture during game play.

More importantly, these systems are not intended for low-end platforms or user devices, as rendering and compressing stereo VR panorama images at the size of several hundred megapixels necessitate high processing power and careful memory management and optimization.

Therefore, in view of the aforementioned difficulties, there is an unsolved need to make it easy for game developers and players to capture and record existing video games in real-time, and replay, stream, or even live-play in a virtual reality environment.

Images