Autonomous Vehicle Emergency Control via Key Frame Loss Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing remote monitoring and control systems for autonomous vehicles face challenges in ensuring safety and reducing travel time, particularly when communication quality deteriorates, as they often require frequent speed restrictions during key frame transmission, which does not effectively address the issue of shortening moving time while maintaining safety.

Innovation Solution

A system that includes a mobile object and a server device communicating via a network, where the mobile object captures images, encodes them into key frames and difference frames, and transmits them to the server, which controls the mobile object's movement and sends emergency control signals if key frames are not received within a predetermined period, allowing for adaptive emergency control to maintain safety and reduce travel time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If the system transmits image data including key frames at predetermined intervals to the server device, then the communication efficiency is improved and moving time is reduced, but the safety cannot be ensured when key frames are lost due to communication deterioration

Engineering Contradiction:
Improvemoving timeVSAvoidsafety
Core Design Contradiction:
Loss of timeVSReliability

Solution Approach 1:

The server device monitors the reception status of key frames from the mobile object and provides feedback by transmitting emergency control signals when key frames are lost. This feedback mechanism ensures safety by detecting communication quality deterioration and triggering appropriate emergency responses, while allowing normal operation to continue when communication is stable.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system transmits key frames at predetermined intervals in advance, creating a buffer of visual information at the server device. This preliminary action allows the server to detect key frame loss and initiate emergency control measures before critical safety issues arise, balancing efficient transmission with safety monitoring.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If the system restricts moving speed frequently when communication quality deteriorates, then the safety is secured, but the moving time cannot be shortened

Engineering Contradiction:
ImprovesafetyVSAvoidmoving time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system dynamically adjusts the emergency control response based on the actual key frame reception status. Instead of frequently restricting speed based on general communication quality, the system only triggers emergency control when key frames are actually lost, creating a more precise and less intrusive safety mechanism that minimizes impact on moving time.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the monitoring parameter from general communication quality to specific key frame reception status. This parameter change allows for more accurate detection of actual safety-critical issues, reducing unnecessary speed restrictions while maintaining safety when key frames are lost.

Inventive Principle:
Principle #35Parameter changes

3Quantity of substance

If the system transmits only difference frames without key frames, then the communication data amount is reduced, but the image quality and safety monitoring capability deteriorate

Engineering Contradiction:
Improvecommunication data amountVSAvoidsafety monitoring capability
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The image data transmission is segmented into key frames transmitted at predetermined intervals and difference frames transmitted between key frames. This segmentation reduces overall communication data amount while maintaining safety monitoring capability, as the periodically transmitted key frames provide complete reference images for safety assessment.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system applies different quality levels to different parts of the video stream: key frames are transmitted with complete image quality at regular intervals for safety monitoring, while difference frames use compressed incremental updates for efficiency. This local quality approach balances data reduction with safety monitoring requirements.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10466697B2Monitoring control system, monitoring control device, and monitoring control method
Publication Date: 2019.11.05 HITACHI LTD
  • US10466697B2 patent drawing
  • US10466697B2 patent drawing
  • US10466697B2 patent drawing

AI summary

A monitoring control system includes a mobile object and a server device that communicates with the mobile object. The mobile object includes: a first communication unit; a camera; an encoding unit that generates image data from the image captured by the camera; a transmitting unit that transmits the image data; and a movement control unit that controls movement of the mobile object according to a control signal received from the server device via the first communication unit, and the server device includes: a second communication unit that communicates with the mobile object; and an emergency control signal transmitting unit that transmits an emergency control signal to the mobile object via the second communication unit when at least a part of a key frame among the image data transmitted from the mobile object is not received within a predetermined period.