Remote Vehicle Video Validation for Sensor Stream Malfunctions

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Remote operation of vehicles faces challenges in ensuring the reliability and quality of sensor data streams, such as video feeds, which can experience issues like freezing, delay, and jitter, affecting the ability to safely and efficiently control vehicles remotely, especially in hazardous or inhospitable environments.

Innovation Solution

An apparatus and method utilizing a configurable visual indicator and video sensor to generate a sensor data stream that includes information about the indicator's state, allowing for detection of malfunctions by comparing the actual and observed states, and using checksums and timestamps to verify data integrity and prevent errors, enabling reliable remote operation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If remote operation of vehicles is implemented to eliminate the need for a human driver present in the vehicle, then operational flexibility and safety in hazardous environments are improved, but reliability and dependability of control deteriorate due to sensor data stream issues like freezing, delay, and jitter

Engineering Contradiction:
Improveremote operation capabilityVSAvoidsensor data stream reliability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent implements feedback mechanisms where the remotely operated vehicle sends sensor data streams (including video feeds) back to the remote driving station, and the system monitors for malfunctions such as freezing, delay, and jitter in these data streams. This feedback loop enables detection and response to reliability issues while maintaining remote operation capability.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary actions by establishing validation protocols and malfunction detection mechanisms before remote operation begins. The apparatus is configured to proactively monitor sensor data stream quality and detect issues before they compromise safety or operational reliability.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If automation in the automotive and trucking industry increases to separate drivers from vehicles, then productivity and operational efficiency are improved, but control reliability deteriorates due to communication delays and data stream malfunctions

Engineering Contradiction:
Improveoperational efficiencyVSAvoidcontrol reliability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system uses feedback mechanisms to continuously monitor the quality and reliability of sensor data streams transmitted between the remotely operated vehicle and the remote driving station. This enables real-time detection of malfunctions while maintaining high operational efficiency through automated control.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent introduces intermediary validation mechanisms and monitoring systems that act as mediators between the automated vehicle control system and the remote operator. These intermediaries validate data streams and detect malfunctions, ensuring reliable control despite increased automation and distance.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Object-affected harmful factors

If vehicles are operated remotely in inhospitable environments such as planetary rovers or bomb disarming vehicles, then safety of human operators is improved, but dependability of operation deteriorates due to communication issues and sensor data stream malfunctions

Engineering Contradiction:
Improveoperator safetyVSAvoidoperation dependability
Core Design Contradiction:
Object-affected harmful factorsVSReliability

Solution Approach 1:

The system implements comprehensive feedback mechanisms that monitor sensor data stream quality and detect malfunctions in real-time during remote operation in hazardous environments. This feedback enables the system to maintain dependability by identifying and responding to communication issues while protecting human operators from direct exposure to harmful environments.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent applies beforehand cushioning by establishing redundant communication channels and validation protocols in advance of potential failures. These pre-configured safeguards cushion against communication issues and sensor malfunctions that may occur when operating in inhospitable environments, maintaining operation dependability while ensuring operator safety.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

Data Source

PatentUS20240061422A1Validation of connection of a remotely operable vehicle
Publication Date: 2024.02.22 EINRIDE AB
  • US20240061422A1 patent drawing
  • US20240061422A1 patent drawing
  • US20240061422A1 patent drawing

AI summary

An apparatus including an indicator and a video sensor arranged to generate sensor data dependent on a state of the indicator, control circuitry configured to select the state of the indicator, to process instructions received in the apparatus from a remote driving station, to provide to the remote driving station the sensor data and to at least one of: provide to the remote driving station an indication of the indicator's selected state to enable the remote driving station to detect a malfunction in the sensor data, and obtain an observation of the state of the indicator, based on the sensor data, and determine whether the observation and the selected state of the indicator are consistent, to detect a malfunction in the sensor data, wherein the apparatus is a remotely operated vehicle, or configured to be installed in one.