Vehicle Remote Gesture Verification for Secure Autonomous Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing vehicle remote control systems cannot accurately determine whether a gesture input on a touch panel is made by the operator, leading to potential misidentification and unauthorized operation.

Innovation Solution

The system acquires detected coordinate information from the touch panel and operation device transition information, comparing frequency characteristics to determine correlation and verify operator input, ensuring that the vehicle only executes autonomous travel control when the gesture is input by the operator.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If gesture recognition is implemented using only touch panel coordinate data, then the system is simple and easy to operate, but the system cannot determine whether the gesture is input by the operator or by automation

Engineering Contradiction:
Improvedetermination accuracy of operator inputVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent combines touch panel coordinate information with acceleration sensor data into a unified gesture recognition system. By merging these two data sources and analyzing their frequency characteristics together, the system can determine whether a gesture was input by an operator or by automation, thereby improving reliability without requiring completely separate systems

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces frequency characteristic analysis as an intermediary method to bridge touch panel data and acceleration sensor data. By converting both data types into frequency domain characteristics and comparing them, the system can indirectly determine operator input without directly observing the input source

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If multiple sensors and frequency analysis are used to verify operator input, then the determination accuracy improves, but the processing time and computational load increase

Engineering Contradiction:
Improvedetermination accuracy of operator inputVSAvoidgesture recognition processing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent performs preliminary processing of touch coordinate data and acceleration sensor data by converting them to frequency domain characteristics in advance. This preprocessing allows for faster comparison and determination during actual gesture recognition, reducing the time penalty associated with using multiple sensors and complex analysis

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP4029748B1Vehicle remote control method and vehicle remote control device
Publication Date: 2024.01.10 NISSAN MOTOR CO LTD
  • EP4029748B1 patent drawingFigure 1
  • EP4029748B1 patent drawingFigure 2
  • EP4029748B1 patent drawingFigure 3

AI summary

When a subject vehicle (V) having an autonomous travel control function is remotely operated with a remote operation device (21), detected coordinate information (Dx, Dy) indicating a temporal transition in detected coordinates of a gesture detected by a touch panel (211) of the controller (21) is acquired, and the change amount of a physical change occurring on the remote operation device (21) is detected to acquire operation device transition information (S) indicating a temporal transition in the change amount. Then, the frequency characteristics of the detected coordinate information (Dx, Dy) are compared with the frequency characteristics of the operation device transition information (S) to determine whether or not there is correlation, and when there is correlation, the subject vehicle (V) is controlled to execute autonomous travel control.