3D Audio Interaction for Vehicles Using Spatial Sound Objects

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional infotainment systems in vehicles fail to provide relevant and useful information to occupants while they are on the move, such as nearby attractions or emergency warnings, due to their focus on audio or video entertainment rather than intuitive and non-intrusive information delivery.

Innovation Solution

A system and method for three-dimensional (3D) audio interaction in vehicles, utilizing sensors and audio output devices to generate and output 3D audio objects based on the vehicle's location and relative position to nearby entities, allowing for the intuitive and non-intrusive delivery of information such as promotional notifications, emergency warnings, or media content from other vehicles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Use of energy by moving object

If conventional infotainment systems provide audio or video entertainment to vehicle occupants, then entertainment quality is improved, but relevant information delivery (such as emergency warnings or nearby attractions) deteriorates

Engineering Contradiction:
Improveentertainment qualityVSAvoidrelevant information delivery
Core Design Contradiction:
Use of energy by moving objectVSLoss of information

Solution Approach 1:

The audio output system is segmented into multiple independent audio output devices distributed throughout the vehicle interior. Each device can independently output audio signals, allowing the system to create directional and spatially differentiated audio content. This segmentation enables simultaneous delivery of entertainment content and relevant information (such as emergency warnings or nearby attractions) through different spatial channels, resolving the contradiction between entertainment quality and information delivery.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system transitions from conventional two-dimensional audio output (left/right stereo) to three-dimensional spatial audio by distributing multiple audio output devices throughout the vehicle interior. This dimensional expansion allows information to be delivered not only through content differentiation but also through spatial positioning, enabling occupants to intuitively understand the direction and origin of information sources while maintaining entertainment quality.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If information is delivered to vehicle occupants during travel, then information availability is improved, but intrusiveness and disruption to the riding experience worsens

Engineering Contradiction:
Improveinformation availabilityVSAvoidintrusiveness
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

Different regions of the vehicle interior are assigned different audio output characteristics based on local requirements. Audio output devices positioned at different locations emit sound with specific directional properties, allowing relevant information to be delivered to specific zones without uniformly disrupting the entire vehicle interior. This local differentiation reduces intrusiveness by directing information precisely where needed while preserving the overall riding experience.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system uses spatial audio positioning and directional sound propagation as intermediaries between the information source and the occupant. Rather than directly presenting information through conventional speakers, the system employs multiple distributed audio devices to create virtual sound sources that naturally guide occupant attention through spatial cues, reducing the perceived intrusiveness while maintaining information availability.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Loss of information

If multiple audio output devices are used for 3D audio interaction, then information delivery capability is improved, but device complexity worsens

Engineering Contradiction:
Improveinformation delivery capabilityVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The multiple audio output devices serve multiple functions simultaneously: they provide entertainment audio output, deliver relevant information (emergency warnings, nearby attractions), create spatial audio effects for 3D interaction, and enable directional sound propagation. This multi-functionality justifies the increased device count by consolidating what would otherwise require separate systems into a single integrated architecture, thereby managing complexity through functional consolidation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11438720B2Three-dimensional (3D) audio interaction for vehicles
Publication Date: 2022.09.06 SONY GROUP CORP
  • US11438720B2 patent drawing
  • US11438720B2 patent drawing
  • US11438720B2 patent drawing

AI summary

A system in a first vehicle includes a plurality of sensors, a plurality of audio output devices and circuitry. The circuitry receives a plurality of signals from the plurality of sensors. The circuitry determines a relative position between a first device and the first vehicle based on the received plurality of signals or a geo-location of the first vehicle. The circuitry receives first information from the first device based on the determined relative position between the first device and the first vehicle, and at least one selection criterion. The circuitry generates a first three-dimensional (3D) audio object corresponding to the received first information. The circuitry controls, based on the determined relative position, a first set of audio output devices of the plurality of audio output devices to output the generated first 3D audio object, in a 3D space of the first vehicle at a first time instant.