Spatial Audio Localization for Wide-Area Attention Sharing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems struggle to effectively share the attention of users in a wide area due to differing view directions, making it difficult to transmit attention from one user to others.

Innovation Solution

An information processing device that controls the spatial localization of audio for users based on their view directions, allowing for synchronization of audio coordinates with captured images, thereby facilitating attention sharing among users.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a wide area image is distributed in real time for multi-user viewing, then users can view the same scene from remote locations, but it becomes difficult to transmit attention of a certain person to others due to different view directions

Engineering Contradiction:
Improvemulti-user viewing capabilityVSAvoidattention transmission
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent introduces an audio signal as an intermediary to convey attention information between users. When one user views a particular area, their audio is spatially localized to correspond to that area, serving as a mediator that transmits attention information to other users without requiring them to physically share the same viewpoint.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent adds the audio dimension to the visual wide area image system. By incorporating spatially localized audio signals that correspond to specific areas in the wide area image, the system creates a multi-dimensional attention transmission mechanism that overcomes the limitation of two-dimensional visual-only communication.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If spatial localization of audio is controlled based on view direction information, then attention sharing among users is improved, but system complexity increases due to coordinate synchronization requirements

Engineering Contradiction:
Improveattention sharingVSAvoidcoordinate synchronization system
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent merges the audio coordinate system with the wide area image coordinate system based on view direction information. By synchronizing these coordinate systems and controlling audio spatial localization according to the user's viewing direction, the system integrates multiple information streams into a unified attention transmission mechanism.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS20250159425A1Information processing device, information processing method, and recording medium
Publication Date: 2025.05.15 SONY GROUP CORP
  • US20250159425A1 patent drawing
  • US20250159425A1 patent drawing
  • US20250159425A1 patent drawing

AI summary

There is provided an information processing device, an information processing method, and a recording medium that enable sharing of attention of users existing in a wide area. The information processing device includes a control unit that performs control of spatial localization of an audio of another user except a target user on the basis of information regarding at least one of a view direction of a first user corresponding to a captured image captured by an imaging device provided for the first user or a view direction of a second user who views a surrounding captured image in which surroundings of a position where the first user exists are captured as the captured image. The present disclosure can be applied to, for example, devices constituting a system that shares view information.