Motion-Adaptive User Interfaces for Visual and Audio Synchronization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies fail to effectively synchronize visual and audio effects with the motion experienced by a user, leading to discomfort such as motion sickness when there is a disconnect between perceived and actual motion.

Innovation Solution

Implementing dynamic graphical elements and audio output states that adjust based on detected motion, such as vehicle acceleration and orientation, to enhance synchronization and user comfort.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If visual and audio effects are provided without synchronizing to actual motion, then device complexity is reduced, but user comfort deteriorates due to motion sickness and disconnection between perceived and actual motion

Engineering Contradiction:
Improvesystem complexityVSAvoidmotion sickness
Core Design Contradiction:
Device complexityVSObject-affected harmful factors

Solution Approach 1:

The system uses motion sensors to continuously detect actual device motion and feeds this information back to dynamically adjust visual and audio effects. This closed-loop feedback mechanism synchronizes sensory output with physical motion, eliminating the disconnect that causes motion sickness while maintaining manageable system complexity through automated sensor-driven control.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent implements dynamic adjustment of visual effects (such as parallax scrolling, horizon line orientation, and motion blur) and audio effects (such as panning and volume) based on real-time motion data. This dynamic adaptation allows the system to respond flexibly to changing motion conditions, improving user comfort without requiring overly complex predetermined control logic.

Inventive Principle:
Principle #15Dynamics

2Object-affected harmful factors

If dynamic graphical elements and audio output states are adjusted based on detected motion, then user comfort is improved, but device complexity increases

Engineering Contradiction:
Improveuser comfortVSAvoidsystem complexity
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The system divides motion compensation into separate modular components: visual effect adjustment (parallax, horizon, motion blur) and audio effect adjustment (panning, volume, spatial positioning). Each module processes motion data independently and applies appropriate transformations, reducing overall system complexity while achieving comprehensive motion synchronization for improved user comfort.

Inventive Principle:
Principle #1Segmentation

3Object-affected harmful factors

If visual effects are synchronized with motion, then realism and user experience are improved, but processing requirements and energy consumption increase

Engineering Contradiction:
ImproverealismVSAvoidenergy consumption
Core Design Contradiction:
Object-affected harmful factorsVSUse of energy by moving object

Solution Approach 1:

The system applies motion-based adjustments selectively to key visual and audio parameters rather than processing all graphical elements equally. Critical elements such as the horizon line, parallax scrolling, and audio panning are synchronized with motion, while less critical elements use simplified or static adjustments. This partial action approach maintains realism while reducing overall processing requirements and energy consumption.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS12423900B1Methods and user interfaces based on motion
Publication Date: 2025.09.23 APPLE INC
  • US12423900B1 patent drawing
  • US12423900B1 patent drawing
  • US12423900B1 patent drawing

AI summary

A method includes displaying a dynamic graphical element in a first state and graphical content in a second state. While displaying the graphical content in the second state, the graphical content is displayed in the second state and the dynamic graphical element is displayed in a third state, where the third state is different from the first state, and the third state is based on detected motion.