HMD Virtual Camera Synchronization for 360-Degree Video Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users of head-mounted displays (HMDs) have difficulty recognizing 360-degree panorama videos within a virtual space, as existing technologies simply display thumbnails on a plane surface without indicating the immersive nature of the content.

Innovation Solution

A display control method that generates and updates virtual space data for first and second virtual cameras, synchronizing their movement with the HMD, allowing users to easily identify 360-degree panorama videos by displaying them in a manner that reveals their immersive nature on a display object within the visual field.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a thumbnail of a video advertisement is displayed on an object in the virtual space on a plane surface (two-dimensionally), then the display is simple and easy to implement, but the user cannot easily grasp whether or not the image is a 360-degree panorama video advertisement

Engineering Contradiction:
Improveease of recognitionVSAvoidinformation about immersive nature
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent transforms the display from a two-dimensional plane surface to a three-dimensional spherical surface. The 360-degree panorama video thumbnail is displayed on a spherical object in the virtual space, allowing users to intuitively recognize the immersive nature of the content through its spherical geometry rather than flat representation.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If video advertisements are placed on objects in the virtual space, then the advertisement can be integrated into the virtual environment, but the user still cannot easily recognize the immersive nature of 360-degree panorama videos

Engineering Contradiction:
Improveintegration into virtual spaceVSAvoiddetectability of immersive content
Core Design Contradiction:
Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent uses visual differentiation through rendering techniques to indicate the immersive nature of 360-degree panorama videos. The spherical thumbnails are rendered with visual cues that distinguish them from regular videos, enabling users to detect the immersive content type at a glance while maintaining integration in the virtual space.

Inventive Principle:
Principle #32Color changes

3Measurement precision

If the virtual camera moves in synchronization with the head-mounted display movement, then the visual field image is updated accurately, but the data processing load increases

Engineering Contradiction:
Improvevisual field accuracyVSAvoiddata processing efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent implements selective rendering where 360-degree panorama video thumbnails are only rendered and updated when they enter the user's visual field. This partial action approach maintains accurate visual field representation while reducing overall data processing load by avoiding unnecessary updates of off-screen content.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10277814B2Display control method and system for executing the display control method
Publication Date: 2019.04.30 COLOPL
  • US10277814B2 patent drawing
  • US10277814B2 patent drawing
  • US10277814B2 patent drawing

AI summary

A display control method includes generating first virtual space data defining a first virtual space including a first virtual camera and a display object. The method includes displaying a first visual-field image on a head-mounted display based on a visual field of the first virtual camera and the first virtual space data. The method includes updating the first visual-field image by moving the first virtual camera in synchronization with detected movement of the head-mounted display. The method includes generating second virtual space data for defining a second virtual space including a second virtual camera. The method includes displaying a second visual-field image on the display object based on a visual field of the second virtual camera and the second virtual space data. The method includes updating the second visual-field image by moving the second virtual camera in the second virtual space in synchronization with the detected movement.