Display Rotation Using Sound Direction for Viewpoint Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for rotating displayed visual information on devices often result in unintentional rotation errors, particularly when the device is tilted or capturing spatial audio, leading to misalignment with the user's viewpoint, especially in livestreaming scenarios.

Innovation Solution

An apparatus and method that determines the direction of arrival of sound from a sound source relative to a user device to control the angle of orientation of visual information displayed on a display, using audio signals to maintain alignment with the user's viewpoint, even when the device is tilted or rotated.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the device is tilted or rotated to capture spatial audio or take photos, then the field of view and audio capture capability are improved, but the visual information becomes misaligned with the user's viewpoint

Engineering Contradiction:
Improvedevice orientation flexibilityVSAvoidvisual information alignment
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The system continuously monitors the direction of arrival of sound sources and uses this feedback to dynamically adjust the rotation angle of displayed visual information, ensuring alignment with the user's viewpoint even when the device is tilted or rotated

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

Instead of relying on mechanical sensors alone to detect device orientation, the system substitutes acoustic field detection to determine spatial relationships, using sound direction data to control visual information rotation and achieve alignment without traditional mechanical orientation sensing

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If traditional orientation detection methods are used, then the device can detect its physical orientation, but unintentional rotation errors occur when capturing spatial audio

Engineering Contradiction:
Improveorientation detection accuracyVSAvoidvisual information alignment reliability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system introduces sound direction determination as an intermediary measurement that bridges the gap between device physical orientation and user's actual viewpoint, using acoustic signals as a mediator to accurately infer the intended viewing direction even when the device is tilted

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system separates orientation detection into independent functional components: acoustic signal capture, direction of arrival determination, and visual information rotation control, allowing each component to be optimized independently and reducing interference between spatial audio capture and visual alignment

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Ensures that visual information remains aligned with the user's orientation, improving readability and visibility, especially in situations where the device is tilted or rotated, such as during photography, videography, or livestreaming.

Implementation Method 1

determining a direction of arrival of sound from a sound source relative to a user device using captured at least one audio signal

Methodology Applied
Scientific EffectAcoustic signal detection: Sound

Data Source

PatentEP4044019B1An apparatus, a method and a computer program for rotating displayed visual information
Publication Date: 2026.01.28 NOKIA TECHNOLOGIES OY
  • EP4044019B1 patent drawingFigure 1A~1B
  • EP4044019B1 patent drawingFigure 2A~2B
  • EP4044019B1 patent drawingFigure 3A~3B

AI summary

According to various, but not necessarily all, embodiments there is provided an apparatus comprising means for: determining a direction of arrival of sound from a sound source relative to a user device using at least one captured audio signal; controlling an angle of orientation of visual information displayed on a display, wherein the angle of orientation of the visual information is at least partially dependent upon the determined direction of arrival of sound from the sound source relative to the user device.