Panoramic Video Annotation Display via Time and Direction Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional techniques for displaying panoramic images do not effectively provide additional information alongside the image, limiting user engagement and interaction.

Innovation Solution

An information processing system that allows users to input and display additional information, such as comments, alongside panoramic videos, using a terminal device and monitor setup, where the display range adjusts based on user attitude and input, enabling more interactive and informative experiences.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If conventional techniques are used to display panoramic images, then the display is simple and straightforward, but additional information cannot be effectively provided alongside the image

Engineering Contradiction:
Improveinformation presentationVSAvoiddisplay system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The panoramic image display is segmented into multiple independent regions: the main panoramic video area and separate annotation regions. Each region can display different types of information independently, allowing additional information to be presented without interfering with the main panoramic view. This segmentation enables the system to overcome the limitation of displaying only simple panoramic images while maintaining manageable system complexity through modular design.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a temporal dimension by controlling annotations to be displayed only during specific time ranges when the panoramic video view direction matches predetermined conditions. This time-range control adds a new dimension to information presentation, allowing multiple pieces of information to be displayed throughout the video playback without overwhelming the user at any single moment, thus effectively reducing information loss while managing display complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If multiple pieces of information are displayed together with panoramic video, then user engagement and interaction are enhanced, but the display becomes more complex and information may become overwhelming

Engineering Contradiction:
Improveuser interaction capabilityVSAvoiddisplay control complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The annotation display system is designed to be dynamic, with annotations being automatically shown or hidden based on real-time conditions such as the current view direction and predetermined time ranges. This dynamic behavior allows the display to adapt to user interaction without requiring complex manual controls, enhancing user engagement while keeping the system relatively simple through automated conditional logic.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system incorporates feedback mechanisms where the display of annotations is controlled based on detected conditions (view direction matching predetermined ranges). This feedback loop allows the system to automatically adjust information presentation based on user viewing behavior, enhancing adaptability and user engagement while avoiding the need for complex manual control systems.

Inventive Principle:
Principle #23Feedback

3Loss of information

If annotations are displayed throughout the entire panoramic video, then all information is always visible, but user attention is divided and interaction is reduced

Engineering Contradiction:
Improveinformation availabilityVSAvoiduser interaction ease
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

Annotations are displayed periodically rather than continuously, with each annotation shown only during specific time ranges when the panoramic video view direction corresponds to predetermined ranges. This periodic display ensures that information is available when relevant while maintaining user attention and interaction ease by preventing constant visual distractions throughout the entire video playback.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentEP2782333B1Partial area rendering in a panoramic video, with time range and view direction control data for display of annotations.
Publication Date: 2016.08.03 NINTENDO CO LTD
  • EP2782333B1 patent drawingFigure 1
  • EP2782333B1 patent drawingFigure 2
  • EP2782333B1 patent drawingFigure 3

AI summary

An information processing device obtains control data for a panoramic video. The control data includes a time condition relating to time on a playback time axis of the panoramic video, and a direction condition relating to a viewing direction corresponding to an area of the panoramic video to be displayed. The information processing device displays, on a display device, an image of the panoramic video in a viewing range corresponding to a viewing direction determined based on an input on a predetermined input device. It is determined whether the time condition included in the control data is satisfied for a playback time point of the panoramic video being played on the display device. It is also determined whether the direction condition included in the control data is satisfied for the viewing direction determined based on an input. Based on a determination result for the time condition and the direction condition the information processing device performs a predetermined information process relating to making an output to a user in sync with the panoramic video being played.