Remote Driving Virtual Reality System with Immersive Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional driving simulators and VR systems lack the capability to enable real-time remote driving of automobiles within a virtual reality environment, failing to provide immersive and interactive experiences that simulate real-world driving conditions effectively.

Innovation Solution

A system comprising a server configured to render real-time virtual reality environments, interacting with head-mounted devices and physical controls, utilizing sensors and information capturing devices in the automobile to provide immersive and interactive driving experiences, allowing users to control the automobile remotely through a VR interface.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional driving simulators are used, then basic driving control is provided, but real-time remote driving capability and immersive VR experience are lacking

Engineering Contradiction:
Improveremote driving capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges conventional driving simulator controls with head-mounted display VR technology and real-time communication systems. The driving simulator includes both physical controls (steering wheel, pedals) and VR display components integrated into a unified system that enables remote driving operations, combining elements that were previously separate into a single versatile platform.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The driving simulator is designed to perform multiple functions: local driving practice, remote driving operation, and VR immersive experience. The system can operate in different modes (local or remote) and provides both traditional simulation capabilities and advanced remote vehicle control, making it adaptable to various training and operational scenarios.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of operation

If VR head-mounted devices are used, then immersive three-dimensional experience is provided, but real-time interaction and control capability are limited

Engineering Contradiction:
Improveimmersive experienceVSAvoidreal-time control reliability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system implements real-time feedback loops where the head-mounted display tracks user head movements and eye direction, translating these into corresponding vehicle control actions. The system continuously monitors user inputs through the VR interface and provides immediate feedback by rendering updated virtual environments and transmitting control commands to the remote vehicle, ensuring reliable real-time interaction.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The head-mounted display acts as an intermediary device that bridges the user's physical movements and the remote vehicle's responses. It captures head position and orientation data, processes this information through the system, and translates it into appropriate vehicle control commands, mediating between the user's immersive experience and the actual vehicle operation.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If remote driving control is implemented, then real-world driving experience is simulated, but system complexity and data processing requirements increase

Engineering Contradiction:
Improvereal-time driving data accuracyVSAvoiddata processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system extracts and transmits only the essential real-time driving data needed for remote operation and VR rendering, such as vehicle position, speed, steering angle, and environmental sensor data. By selecting and transmitting only the most critical data elements rather than all possible vehicle parameters, the system maintains measurement precision while reducing data processing complexity and bandwidth requirements.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS9568995B1Remote driving with a virtual reality system
Publication Date: 2017.02.14 THUNDER POWER NEW ENERGY VEHICLE DEV CO LTD
  • US9568995B1 patent drawing
  • US9568995B1 patent drawing
  • US9568995B1 patent drawing

AI summary

A method and system for facilitating a user drive an automobile remotely in real-time through a virtual reality system is disclosed. The virtual reality environment may present real-time road conditions, weather condition, automobile information, and/or any other information regarding driving of the automobile in real time.