Viewpoint Video Display Control for Mixed-Reality Presence

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies fail to effectively manage the perception of presence and sense of presence of specific individuals in virtual spaces, particularly in mixed reality environments, by not adequately controlling the display of viewpoint videos and associated information based on the viewer's angle of view.

Innovation Solution

A display control device and method that acquires viewpoint position and visual line direction information to dynamically control the display of specific information within viewpoint videos, adjusting its size, quality, and aspect based on the viewer's angle of view, using head-mounted displays to enhance the perception of presence.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If viewpoint videos and specific information are displayed without considering the viewer's angle of view, then the system is simple to operate, but the perception of presence of specific individuals is not effectively enhanced

Engineering Contradiction:
Improveperception of presenceVSAvoiddisplay control complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The display control device dynamically adjusts the display of specific information based on the viewer's angle of view in real-time. The control unit modifies display parameters (position, size, visibility) of specific information according to the detected viewpoint position and angle of view, making the system adaptive rather than static. This dynamic adjustment enhances the perception of presence by ensuring that specific individuals are appropriately represented in the virtual space from each viewer's perspective.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system implements a feedback mechanism where the detection unit continuously monitors the viewer's viewpoint position and angle of view, and this information is fed back to the control unit. The control unit then adjusts the display of specific information based on this feedback, creating a closed-loop control system. This feedback mechanism ensures that the display adapts to each viewer's unique perspective, thereby enhancing the perception of presence of specific individuals in the virtual environment.

Inventive Principle:
Principle #23Feedback

2Reliability

If the display size of specific information is dynamically adjusted based on angle of view, then the perception of presence is enhanced, but the processing complexity increases

Engineering Contradiction:
Improveperception of presenceVSAvoidautomatic display adjustment
Core Design Contradiction:
ReliabilityVSExtent of automation

Solution Approach 1:

The display control device performs automatic self-adjustment of the specific information display based on the detected angle of view. The control unit autonomously determines the appropriate display parameters (position, size, visibility) without requiring manual intervention from the viewer. The system serves itself by automatically adapting the display to each viewer's perspective, which enhances the perception of presence while managing processing complexity through automated decision-making algorithms.

Inventive Principle:
Principle #25Self-service

3Loss of information

If specific information is always displayed at full size, then the information is easily readable, but it may obstruct the viewpoint video and reduce the immersive experience

Engineering Contradiction:
Improveinformation visibilityVSAvoidobstruction of viewpoint video
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The system applies different display qualities and parameters to different regions of the display based on the viewer's angle of view. Specific information is selectively adjusted in size, position, or visibility depending on its spatial relationship with the viewpoint video and the viewer's perspective. This local quality adjustment ensures that information remains readable when appropriate while minimizing obstruction to the immersive viewpoint video experience in critical viewing zones.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The control unit dynamically changes display parameters (size, position, transparency, visibility) of specific information based on the detected angle of view and viewpoint position. Instead of maintaining a fixed display state, the system continuously adjusts parameters to optimize both information visibility and video immersion. This parameter change approach allows the specific information to be easily readable when it does not interfere with the viewpoint video, while reducing its prominence when it would obstruct the immersive experience.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20250317546A1Display control device, display control method, and program
Publication Date: 2025.10.09 FUJIFILM CORP
  • US20250317546A1 patent drawing
  • US20250317546A1 patent drawing
  • US20250317546A1 patent drawing

AI summary

A display control device includes a first acquisition unit that acquires first viewpoint position information, and a first control unit that performs a control of displaying a first viewpoint video selected from among a plurality of viewpoint videos generated based on images obtained by imaging an imaging region from a plurality of viewpoint positions on a first display unit, in which the first control unit performs a control of displaying first specific information for specifying a first viewpoint position in the first viewpoint video in a case in which the first viewpoint position indicated by the acquired first viewpoint position information is included in the first viewpoint video and performs a control of changing a display size of the first specific information depending on an angle of view of the first viewpoint video displayed on the first display unit.