VR Image Zenith Nadir Determination via Reference Point Control

Solution Overview

Problem

In VR image display, determining the zenith and nadir is difficult for users without acceleration and angular velocity data during image capture, leading to challenges in horizontal correction and accurate representation of the horizontal plane.

Innovation Solution

An electronic apparatus and method that allows users to easily determine the zenith or nadir of a VR image by displaying a reference point and changing its position upon user instruction, enabling correction of the horizontal plane based on user operation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If horizontal correction is performed based on acceleration and angular velocity data, then measurement precision of the horizontal plane is improved, but device complexity increases and ease of operation deteriorates due to requiring specialized sensors and complex processing

Engineering Contradiction:

Improvehorizontal plane accuracyVSAvoiduser operation simplicity

Core Design Contradiction:

Measurement precisionVSEase of operation

Solution Approach 1:

The system automatically performs horizontal correction by detecting the horizontal line in the VR image and calculating the correction amount without requiring user input or specialized sensors. The correction is applied automatically during image reproduction, making the process self-service and eliminating the need for users to manually specify zenith and nadir points.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical sensor-based system (acceleration and angular velocity sensors) with an image-processing-based system. Instead of relying on physical sensors to determine orientation, the system uses computer vision to detect horizontal lines in the captured VR image and derives orientation information from the image content itself.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If acceleration and angular velocity sensors are used for horizontal correction, then measurement precision is improved, but device complexity increases

Engineering Contradiction:

Improvehorizontal plane accuracyVSAvoidsensor and processing complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical sensor-based system (acceleration and angular velocity sensors) with an image-processing-based system. Instead of relying on physical sensors to determine orientation, the system uses computer vision to detect horizontal lines in the captured VR image and derives orientation information from the image content itself.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system creates a virtual model of the horizontal plane by detecting horizontal lines in the image and calculating the correction amount based on image geometry. This virtual representation replaces the need for physical sensors, allowing the system to determine orientation through image analysis rather than mechanical measurement.

Inventive Principle:

Principle #26Copying

3Ease of operation

If zenith and nadir are manually specified without acceleration and angular velocity data, then ease of operation is improved, but measurement precision deteriorates due to curved horizontal lines making reference specification difficult

Engineering Contradiction:

Improveuser operation simplicityVSAvoidzenith and nadir determination accuracy

Core Design Contradiction:

Ease of operationVSMeasurement precision

Solution Approach 1:

The system automatically performs horizontal correction by detecting the horizontal line in the VR image and calculating the correction amount without requiring user input or specialized sensors. The correction is applied automatically during image reproduction, making the process self-service and eliminating the need for users to manually specify zenith and nadir points.

Inventive Principle:

Principle #25Self-service

Data Source

PatentUS11195256B2Electronic apparatus for determining zenith or nadir of VR image, control method of electronic apparatus and non-transitory computer readable medium

Publication Date: 2021.12.07 CANON KK

AI summary

An electronic apparatus, comprising: a memory and at least one processor and/or at least one circuit to perform the operations of the following units: a control unit configured to 1) display, in a display area, at least a part including a reference point out of a VR image expressed by a projection format using a predetermined point as the reference point, and 2) change the reference point in case an instruction is received from a user; and a determination unit configured to determine the reference point as a zenith or a nadir of the VR image.