Automated Display and Audio Mode Synchronization for VR Headsets

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users of virtual reality (VR) and mixed reality (MR) technologies face laborious procedures in adjusting both display and audio output devices, as they require manual synchronization to achieve optimal immersion and awareness of their surroundings.

Innovation Solution

An information processing apparatus connected to a head-mounted display and audio output device, which automatically switches between display and audio output modes based on determined conditions, such as ambient visibility and audibility, to synchronize the user's experience without manual intervention.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If manual adjustment of both display device and audio output device is required, then the user can control each device independently, but the user needs to perform laborious procedures to synchronize both devices

Engineering Contradiction:
Improveease of operationVSAvoidtime for adjustment
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent combines the control of display device and audio output device into a unified system. The information processing apparatus simultaneously controls both devices based on a single determination result, merging what were previously separate manual adjustment tasks into one automated operation. This resolves the contradiction by eliminating the need for separate manual adjustments while maintaining synchronized control of both devices.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system performs self-service by automatically determining the appropriate display and audio output modes based on ambient state analysis. The information processing apparatus autonomously switches between first and second display modes, and between third and fourth audio output modes, without requiring user intervention. This resolves the contradiction by making the system self-adjusting while maintaining optimal synchronization between devices.

Inventive Principle:
Principle #25Self-service

2Adaptability or versatility

If the display mode is switched to enhance immersion, then the user experience in VR is improved, but the user's awareness of surrounding environment may be reduced

Engineering Contradiction:
Improveadaptability to different modesVSAvoidreduced awareness of surroundings
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The patent implements dynamic switching between display modes and audio output modes based on real-time determination of ambient state. The system transitions from first mode (high immersion) to second mode (high awareness) and vice versa, depending on whether the user needs immersion or environmental awareness. This dynamic adaptability resolves the contradiction by allowing the system to adjust between opposing states as needed.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes key parameters including display mode (first/second mode) and audio output mode (third/fourth mode) based on determination results. When switching from immersive VR to MR, the display parameter changes to show ambient state, and the audio parameter changes to output ambient sound, thereby adjusting the balance between immersion and awareness.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If the audio output mode is switched to enhance ambient sound audibility, then the user's awareness of surroundings is improved, but the immersion in content may be reduced

Engineering Contradiction:
Improveadaptability to different modesVSAvoidreduced immersion in content
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The patent implements dynamic switching between audio output modes based on real-time determination of ambient state. The system transitions from third mode (high immersion, reduced ambient sound) to fourth mode (high awareness, enhanced ambient sound) depending on user needs. This dynamic adaptability resolves the contradiction by allowing the system to adjust between opposing audio states as needed.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the audio output mode parameter between third and fourth modes based on determination results. When switching from immersive VR to MR, the audio parameter changes to enhance ambient sound audibility, thereby adjusting the balance between immersion and awareness.

Inventive Principle:
Principle #35Parameter changes

4Adaptability or versatility

If separate control of display and audio output devices is maintained, then each device can be optimized independently, but the synchronization between devices becomes complex

Engineering Contradiction:
Improveindependent device optimizationVSAvoidcontrol synchronization complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges the control logic for display device and audio output device into a single information processing apparatus. The determination result simultaneously triggers both display mode switching and audio output mode switching, combining what were previously separate control paths into one unified operation. This resolves the contradiction by simplifying the control structure while maintaining the ability to optimize both devices.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The information processing apparatus performs multiple functions: it determines ambient state, controls display mode switching, and controls audio output mode switching. This universal control mechanism resolves the contradiction by providing a single system that can independently optimize both devices while maintaining synchronization through its multi-functional capability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20250021298A1Information processing apparatus and control method thereof
Publication Date: 2025.01.16 CANON KK
  • US20250021298A1 patent drawing
  • US20250021298A1 patent drawing
  • US20250021298A1 patent drawing

AI summary

An information processing apparatus determines whether or not a display mode of a display device has been switched from a first mode to a second mode, and the first mode and the second mode being different from each other in term of visibilities of an ambient state around a user or the first mode and the second mode being different from each other in term of whether or not an ambient state around the user is visible. In a case where the display mode has been switched from the first mode to the second mode, the information processing apparatus switches an audio output mode of an audio output device from a third mode to a fourth mode, the third mode and the fourth mode being different from each other in terms of audibilities of ambient sound around the user.