360-Degree Image Viewpoint Tracking for Shared Attention Display

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing image sharing systems with 360-degree views cannot convey the user's focus of attention effectively, especially when capturing scenes that require conveying the user's skills, as indicators of the field of view do not adequately communicate where the user is focusing attention.

Innovation Solution

An information processing device and display device that generate and display a 360-degree image with identified viewpoint position coordinates, allowing another user to see the user's focus of attention by integrating multiple cameras and sensors to track and synchronize the user's viewpoint.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If an indicator showing field of view is superimposed on the 360-degree image, then the direction the user is looking can be conveyed, but the user's focus of attention cannot be accurately conveyed

Engineering Contradiction:

Improveinformation on user's focus of attentionVSAvoidcomplexity of viewpoint position identification system

Core Design Contradiction:

Loss of informationVSDevice complexity

Solution Approach 1:

The system segments the 360-degree image into multiple regions corresponding to different viewpoints, and identifies specific viewpoint position coordinates to represent the user's focus of attention. This segmentation allows precise localization of attention within the comprehensive 360-degree view.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces viewpoint position coordinates as an intermediary element between the 360-degree image and the user's actual focus of attention. These coordinates serve as a mediator that accurately represents where the user is looking without requiring complex direct tracking mechanisms.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Area of stationary object

If multiple cameras are used to capture 360-degree images, then comprehensive view is achieved, but accurate identification of viewpoint position becomes more difficult

Engineering Contradiction:

Improvecoverage area of 360-degree imageVSAvoiddifficulty of viewpoint position identification

Core Design Contradiction:

Area of stationary objectVSDifficulty of detecting and measuring

Solution Approach 1:

The system merges the captured images from multiple cameras into a single 360-degree image while simultaneously integrating viewpoint position information. This merging process maintains comprehensive coverage while adding precise viewpoint identification capability through coordinated processing of multiple camera data streams.

Inventive Principle:

Principle #5Merging (Combining)

Data Source

PatentUS20260082022A1Information processing device, display device, and image sharing system

Publication Date: 2026.03.19 SONY GROUP CORP

AI summary

An information processing device includes: a 360-degree image processing unit that generates a 360-degree image on the basis of a plurality of captured images captured by a plurality of cameras worn by a first user; and a 360-degree image viewpoint position identification unit that identifies viewpoint position coordinates of the first user in the 360-degree image.