Virtual Viewpoint Video Motion Sickness Evaluation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for evaluating visually-induced motion sickness in virtual viewpoint videos fail to accurately distinguish between object and background movements, leading to reduced accuracy in assessing the likelihood of motion sickness.

Innovation Solution

An information processing apparatus that separates foreground and background in virtual viewpoint videos, using camera parameters and motion analysis to determine the likelihood of motion sickness based on specific evaluation conditions tailored to the video scene.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If screen movement is evaluated without separating object and background, then the evaluation process is simple, but the accuracy of motion sickness evaluation deteriorates

Engineering Contradiction:
Improvemotion sickness evaluation accuracyVSAvoidvideo analysis complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the video content into object regions and background regions using motion analysis. The motion vector calculation is performed separately for objects and background, allowing accurate distinction between actual object movement and background screen movement. This segmentation enables precise motion sickness evaluation by focusing only on relevant background movements that cause visual discomfort.

Inventive Principle:
Principle #1Segmentation

2Loss of information

If object and background are not separated, then the processing is faster, but the ability to determine movement source deteriorates

Engineering Contradiction:
Improvemovement source informationVSAvoidvideo processing time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent extracts motion information specifically from the background by separating it from object motion. Using motion vectors calculated from multiple camera viewpoints, the system extracts background movement patterns that are relevant to motion sickness evaluation. This extraction process eliminates object movement interference while preserving the essential background motion characteristics needed for accurate evaluation.

Inventive Principle:
Principle #2Taking out (Extraction)

3Measurement precision

If foreground-background separation is implemented, then motion sickness evaluation accuracy is improved, but processing complexity increases

Engineering Contradiction:
Improvescreen movement measurement accuracyVSAvoidvideo processing system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses motion vectors as an intermediary to facilitate foreground-background separation. By calculating motion vectors from multiple camera viewpoints and analyzing their relationships, the system identifies background movement without requiring complex direct separation techniques. This intermediary approach simplifies the overall processing complexity while achieving accurate screen movement measurement.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11839721B2Information processing apparatus, information processing method, and storage medium
Publication Date: 2023.12.12 CANON KK
  • US11839721B2 patent drawing
  • US11839721B2 patent drawing
  • US11839721B2 patent drawing

AI summary

Provided is an information processing apparatus comprising: a first obtaining unit configured to obtain viewpoint information indicating change of a virtual viewpoint corresponding to a virtual viewpoint video generated on the basis of a plurality of images captured from a plurality of directions with a plurality of image capturing apparatuses; a second obtaining unit configured to obtain condition information indicating a condition associated with the amount of change of a background in the virtual viewpoint video; a determination unit configured to determine whether the viewpoint information obtained by the first obtaining unit satisfies the condition indicated by the condition information obtained by the second obtaining unit; and an output unit configured to output information according to the result of the determination by the determination unit.