Distributed Sensor Array for Localized Audio Beamforming

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies do not provide a means for augmenting a user's body or space with image sensors, microphones, and speakers over a large area, limiting effective communication and interaction between different spaces.

Innovation Solution

An information processing system with a recognizing unit, identifying unit, estimating unit, and signal processing unit that utilizes sensors and actuators to recognize targets, estimate user positions, and process signals for localized output, enabling communication and interaction between spaces without the need for mobile devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If sensors and actuators are distributed over a large area to augment user's body, then communication and interaction between spaces is improved, but device complexity and system configuration becomes more complex

Engineering Contradiction:
Improvecommunication capability between spacesVSAvoidsystem configuration
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system divides the space into multiple regions with sensors and actuators distributed throughout. Each sensor and actuator operates as an independent unit that detects and executes commands locally, while the server coordinates them collectively. This segmentation allows the system to cover large areas without requiring a monolithic complex structure.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The server performs multiple functions including receiving sensor data from distributed sensors, processing commands, identifying targets, and controlling actuators. This multi-functional approach consolidates complex coordination logic into a single universal controller, simplifying the overall system architecture while maintaining adaptability across different spaces.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If sensors are arranged around a specific user to recognize targets, then measurement precision and target recognition is improved, but device complexity increases

Engineering Contradiction:
Improvetarget recognition accuracyVSAvoidsensor arrangement
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Multiple sensors arranged around the user are merged into a unified detection system coordinated by the server. The server aggregates data from all sensors to perform target recognition, combining their individual capabilities into a collective intelligent system. This merging improves measurement precision while avoiding the complexity of each sensor operating independently.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The server acts as an intermediary between the distributed sensors and the target recognition process. It receives raw data from multiple sensors, processes the information to identify targets, and coordinates the results. This intermediary approach simplifies the complexity by centralizing the complex recognition logic while allowing sensors to remain relatively simple detection units.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If actuators are arranged around the user to output localized signals, then sound field localization and user experience is improved, but device complexity increases

Engineering Contradiction:
Improvesound field localization accuracyVSAvoidactuator arrangement
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Each actuator is positioned to provide localized sound output to specific regions around the user. The server controls each actuator to produce sound fields with appropriate local characteristics, creating immersive audio experiences. This local quality approach allows precise sound localization while keeping each actuator relatively simple.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system uses feedback from sensors to dynamically adjust actuator outputs. The server continuously receives sensor data, processes it to determine user position and environmental conditions, and adjusts actuator signals accordingly to maintain accurate sound field localization. This feedback mechanism improves localization accuracy while using simple actuator units that respond to centralized control.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables cooperation between spaces by reproducing voices and images corresponding to targets, augmenting user experiences through distributed sensors and actuators, allowing for new communication methods and immersive interactions.

Implementation Method 1

array speakers that can emit acoustic beams... control amounts of delay and levels of the sounds given out from the respective speakers

Methodology Applied
Scientific EffectAcoustic beam forming: Sound

Implementation Method 2

array microphones having the same principle are being developed. The array microphones can voluntarily set the sound acquisition point by adjusting the levels and amounts of delay of output signals

Methodology Applied
Scientific EffectAcoustic beam forming: Sound

Data Source

PatentUS10075801B2Information processing system and storage medium
Publication Date: 2018.09.11 SONY GROUP CORP
  • US10075801B2 patent drawing
  • US10075801B2 patent drawing
  • US10075801B2 patent drawing

AI summary

An information processing system including a recognizing unit configured to recognize a given target on the basis of signals detected by a plurality of sensors arranged around a specific user, an identifying unit configured to identify the given target recognized by the recognizing unit, an estimating unit configured to estimate a position of the specific user in accordance with the a signal detected by any one of the plurality of sensors, and a signal processing unit configured to process signals acquired from sensors around the given target identified by the identifying unit in a manner that, when output from a plurality of actuators arranged around the specific user, the signals are localized near the position of the specific user estimated by the estimating unit.