Remote Steering Tactile Interface for Vehicle Situational Awareness

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In automatic driving systems, remote steering support is challenging due to the operator's inability to accurately grasp the vehicle's situation and its surroundings, leading to difficulties in transitioning to appropriate remote control, which can result in safety issues and inefficiencies.

Innovation Solution

An information processing system and device that acquire and generate tactile information for remote steering, allowing operators to effectively manage vehicle control through an interface, including data from the vehicle and its environment, to facilitate accurate and timely remote operation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If remote steering is implemented with external operators, then vehicle control capability is improved, but operator's situational awareness deteriorates

Engineering Contradiction:
Improvevehicle control capabilityVSAvoidoperator's situational awareness
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent introduces an information processing system as an intermediary between the vehicle and the remote operator. This system acquires comprehensive vehicle data (position, speed, acceleration, sensor information) and peripheral environment data (maps, weather, traffic conditions), then presents this processed information to the operator through a display device. The intermediary transforms raw data into meaningful situational awareness for the remote operator, resolving the contradiction between enabling remote control and maintaining operator awareness.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the mechanical presence of an operator in the vehicle with an electronic information transmission system. Instead of the operator physically being in the vehicle to grasp the situation, the system substitutes this with electronic acquisition and presentation of vehicle and environment information. This substitution enables remote operation while compensating for the loss of direct situational awareness through comprehensive data presentation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Loss of information

If comprehensive information is presented to the operator, then situational awareness is improved, but information processing complexity increases

Engineering Contradiction:
Improvesituational awarenessVSAvoidinformation processing complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments the information processing function into distinct modules: an information acquisition unit that collects vehicle data and peripheral environment data separately, and an information generation unit that processes and integrates this data. This segmentation allows the complex processing task to be divided into manageable parts, reducing overall system complexity while still providing comprehensive situational information to the operator.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The information processing system is designed with multi-functional units that can handle various types of data (vehicle status, sensor information, map data, weather conditions) through standardized processes. The information acquisition unit and information generation unit serve multiple functions in processing different data types, reducing the need for separate specialized systems and thereby lowering overall complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20240280997A1Information processing system and information processing device
Publication Date: 2024.08.22 SONY SEMICON SOLUTIONS CORP
  • US20240280997A1 patent drawing
  • US20240280997A1 patent drawing
  • US20240280997A1 patent drawing

AI summary

There is provided an information processing system for remotely steering a mobile body, the information processing system including an information acquisition unit (104) that acquires information concerning the mobile body and information concerning a periphery of the mobile body and an information generation unit (122) that generates, based on the acquired information, tactile information for performing the remote steering and presents the generated tactile information to an operator who performs the remote steering via an interface corresponding to the tactile information.