Vehicle Motion Synchronization for Immersive Virtual Reality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing motion control technologies for applications in moving vehicles fail to effectively mitigate motion sickness and dissonance between real-world and virtual events, as they primarily rely on translating deliberate user movements into in-game inputs, neglecting involuntary movements and real-world events.

Innovation Solution

A system that detects impending changes in a user's center of mass motion using inertial sensors and contextual information, synchronizing these with virtual events to create a more immersive experience by dynamically associating motion in virtual events with physical events, thereby enhancing user interaction with virtual environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If motion control is used to translate deliberate user movements into in-game inputs, then user interaction with virtual environments is enabled, but motion sickness and dissonance between real-world and virtual events occur

Engineering Contradiction:
Improveuser interactionVSAvoidmotion sickness
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The system performs preliminary action by detecting impending physical events (such as upcoming turns, stops, or obstacles) before they occur and pre-synchronizing virtual events to match these detected physical events. This advance preparation allows the virtual environment to anticipate and align with real-world movements, creating a seamless experience that prevents motion sickness while maintaining intuitive user interaction.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If motion control translates only deliberate movements, then control precision is maintained, but involuntary movements and real-world events are neglected causing dissonance

Engineering Contradiction:
Improvecontrol precisionVSAvoidevent synchronization
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system applies universality by implementing a comprehensive motion detection mechanism that simultaneously handles both deliberate user movements and involuntary physical events through a single integrated framework. The inertial sensors and machine learning model work together to detect and synchronize all types of movements, making the system adaptable to various movement types while maintaining control precision through consistent processing methods.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses feedback by continuously monitoring inertial sensor data and comparing it with detected physical events and virtual events. The machine learning model analyzes this feedback loop to refine synchronization timing and ensure that virtual events accurately match real-world events, thereby maintaining both control precision and event synchronization adaptability.

Inventive Principle:
Principle #23Feedback

3Productivity

If virtual events are synchronized with real-world events, then user engagement is enhanced, but system complexity increases

Engineering Contradiction:
Improveuser engagementVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system applies self-service by implementing autonomous event synchronization where the machine learning model automatically detects physical events, determines appropriate virtual events, and synchronizes them without requiring manual configuration or complex system intervention. This self-managing approach enhances user engagement through seamless synchronization while minimizing the operational complexity that users would otherwise need to manage.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach effectively reduces motion sickness and enhances user engagement by seamlessly integrating real-world movements into virtual experiences, making physical events more enjoyable and immersive by synchronizing them with virtual events in real-time.

Implementation Method 1

detecting an impending change in center of mass motion of the user by analyzing motion information from a detecting device

Methodology Applied
Scientific EffectInertial sensing: Accelerometer

Data Source

PatentUS11859981B2Physical event triggering of virtual events
Publication Date: 2024.01.02 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11859981B2 patent drawing
  • US11859981B2 patent drawing
  • US11859981B2 patent drawing

AI summary

A method, system and computer program tie physical events to virtual events by analyzing motion information from a computing device of a vehicle or analyzing contextual information from a computing device of a vehicle. Initiation of a virtual event with a display device is timed in response to detecting an impending change in center of mass motion of the user from analyzing the motion information or contextual information. A motion in the virtual event is dynamically associated with subsequent motion information.