Point of Interest Tracking in Panoramic Video Playback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face difficulties in navigating and maintaining focus on primary points of interest within panoramic videos, as existing technologies lack effective methods to track and adjust the field of view accordingly.

Innovation Solution

A computer-implemented method and device that track a point of interest (POI) within panoramic videos by recording POI position data and adjusting the field of view based on this data, ensuring the POI remains in view through user inputs or automatic tracking, utilizing a coordinate system and metadata to manage the field of view during playback.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the user pans left or right or changes the elevational view up or down in a panoramic video, then the user can see other portions of the surrounding scene, but the user loses track of the primary person or object that was the original subject of the video

Engineering Contradiction:
Improveview navigation capabilityVSAvoidtracking of point of interest
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The system continuously monitors the position of the point of interest relative to the current field of view and provides feedback by adjusting the field of view to maintain the POI within the visible area. This closed-loop feedback mechanism ensures that even when users navigate the panoramic video, the primary subject remains trackable.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The field of view is made dynamic and adjustable based on the tracked position of the point of interest. The system automatically repositions the field of view coordinates to follow the POI, creating a dynamic viewing experience that adapts to the subject's movement within the panoramic scene.

Inventive Principle:
Principle #15Dynamics

2Reliability

If the field of view is adjusted frequently to follow a moving point of interest, then the point of interest remains in view, but the complexity of the video playback system increases

Engineering Contradiction:
Improvepoint of interest tracking accuracyVSAvoidfield of view management system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system performs self-service by automatically detecting the point of interest's position and autonomously adjusting the field of view without requiring manual intervention. The playback system manages its own field of view coordinates based on tracked POI data, reducing the need for complex external control mechanisms.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system pre-processes the panoramic video to identify and track the point of interest before playback, storing position data in advance. During playback, the system simply retrieves and applies the pre-calculated field of view adjustments, simplifying the real-time processing requirements.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11272160B2Tracking a point of interest in a panoramic video
Publication Date: 2022.03.08 LENOVO SWITZERLAND INTERNATIONAL GMBH
  • US11272160B2 patent drawing
  • US11272160B2 patent drawing
  • US11272160B2 patent drawing

AI summary

A computer implemented method, device and computer program device are provided that obtain a panoramic video for a scene, with a coordinate system. The method, device and computer program product identify a point of interest (POI) from the scene within the panoramic video, and track a position of the POI within the panoramic video. The method, device and computer program product record POI position data in connection with changes in the position of the POI during the panoramic video. The method, device and computer program product support play back of the panoramic video and adjustment of the field of view based on the POI position data.