HMD Sound Control Apparatus for Immersive Object Notification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Head-mounted display (HMD) users experience a decrease in immersion feeling when warned about approaching objects through sound outputs or visual notifications, as these methods disrupt the immersive experience.

Innovation Solution

A sound control apparatus and method that adjusts sound output mode, including volume and frequency, based on the distance between the user and objects in the environment, allowing for subtle notifications without disrupting the immersive experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If a warning sound is output from speaker or headphones when the user approaches an object, then the user is notified of the approaching object, but the immersion feeling of the user is decreased

Engineering Contradiction:
Improvenotification of approaching objectVSAvoiddecrease in immersion feeling
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The patent applies local quality by spatially localizing warning sounds to specific directions corresponding to the location of approaching objects. Instead of using a general warning sound that disrupts immersion, the system outputs directional audio cues that provide spatial information about object locations, allowing users to perceive warnings as part of the immersive environment rather than as disruptive notifications.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent employs parameter changes by dynamically adjusting sound output parameters (volume, frequency, spatial position) based on the distance between the user and approaching objects. As objects approach, the system modifies these parameters to create subtle auditory cues that maintain immersion while effectively notifying users of potential hazards.

Inventive Principle:
Principle #35Parameter changes

2Loss of information

If an object corresponding to the approached object is displayed on the HMD, then the user is notified of the approaching object, but the immersion feeling of the user is decreased

Engineering Contradiction:
Improvenotification of approaching objectVSAvoiddecrease in immersion feeling
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The patent substitutes visual display mechanisms with acoustic warning mechanisms. Instead of displaying visual overlays or graphics on the HMD that would break immersion, the system uses spatial audio to convey information about approaching objects, replacing the mechanical visual notification system with an auditory alternative that integrates more naturally with the immersive experience.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Loss of information

If the volume of sound is increased to ensure user notification, then the user is reliably notified of approaching objects, but the natural immersive experience is disrupted

Engineering Contradiction:
Improvereliability of notificationVSAvoiddisruption of immersive experience
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The patent applies dynamics by making the sound output adaptive and dynamic rather than static. The volume, frequency, and spatial characteristics of warning sounds are continuously adjusted based on real-time distance measurements between the user and approaching objects. This dynamic adjustment ensures reliable notification while maintaining natural immersion, as the sound parameters evolve smoothly with changing conditions rather than abruptly disrupting the experience.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10691405B2Sound control apparatus, sound control method, and program
Publication Date: 2020.06.23 SONY INTERACTIVE ENTERTAINMENT LLC
  • US10691405B2 patent drawing
  • US10691405B2 patent drawing
  • US10691405B2 patent drawing

AI summary

Provided are a sound control apparatus, a sound control method, and a program, which are capable of notifying a user that an object is approached without decreasing an immersion feeling of a user. A sound output control section (70) controls a sound to be output to the user. A distance specification section (78) specifies a distance between the user wearing a head-mounted display and an object existing around the user. A sound changing section (82) changes an output mode of the sound output to the user in accordance with a change in the distance between the user and the object existing around the user generated when the sound is output to the user.