Remote Vehicle Display Highlighting for Intersection Hazard Direction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Remote operators face difficulty in instantly grasping the traveling direction of a moving body at intersections due to varying camera installation directions and angles, which hinders safety confirmation.

Innovation Solution

A display system that utilizes moving body cameras and intersection cameras to capture images, with processors determining the presence of moving objects and applying highlighting to indicate their direction relative to the vehicle's travel direction on the display device.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If the image of the intersection camera is displayed on the display device, then the remote operator can use image information of the intersection camera, but it is difficult for the remote operator to instantaneously grasp the traveling direction of the moving body in the image

Engineering Contradiction:
Improveinformation about moving object presence and directionVSAvoidease of grasping traveling direction
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system extracts critical information (presence and direction of moving objects) from the complex intersection camera image and presents it in a simplified format through highlighting on the moving body camera image. This allows the remote operator to quickly grasp essential safety information without needing to interpret the entire intersection camera image, resolving the contradiction between information completeness and ease of understanding.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Instead of uniformly processing the entire image, the system applies highlighting selectively to specific regions where moving objects are detected. This local quality approach draws the remote operator's attention precisely to areas of interest (left or right direction relative to traveling direction), making it easy to grasp critical information instantly while maintaining overall situational awareness.

Inventive Principle:
Principle #3Local quality

2Reliability

If the remote operator carefully analyzes the intersection camera image to confirm safety, then accurate safety confirmation can be achieved, but it takes time and increases operator fatigue

Engineering Contradiction:
Improveaccuracy of safety confirmationVSAvoidtime for safety confirmation
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary analysis of the intersection camera image by automatically detecting moving objects and determining their directions before the remote operator needs to make a safety decision. The highlighting is prepared in advance based on this preliminary detection, allowing the operator to immediately see the results without performing the time-consuming analysis themselves, thus achieving both accuracy and speed.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system acts as an intermediary between the complex intersection camera image and the remote operator's decision-making process. By automatically processing the image to detect and highlight moving objects, the system bridges the gap between raw visual data and actionable safety information, reducing the cognitive load and time required for the operator to confirm safety accurately.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If the remote operator focuses attention on the main vehicle images, then the primary driving task can be monitored, but the operator may miss potential obstacles in the intersection area

Engineering Contradiction:
Improveease of monitoring main vehicle imagesVSAvoidsafety confirmation reliability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system merges the information from the intersection camera with the moving body camera images by superimposing highlighting directly on the familiar moving body camera display. This integration allows the remote operator to monitor the main vehicle images while simultaneously perceiving potential obstacles through the highlighting, combining both monitoring functions into a single unified interface that enhances both ease of operation and safety reliability.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS12401767B2Display system
Publication Date: 2025.08.26 TOYOTA JIDOSHA KK
  • US12401767B2 patent drawing
  • US12401767B2 patent drawing
  • US12401767B2 patent drawing

AI summary

A display system includes: one or more moving body cameras that capture one or more images in front of a moving body; one or more intersection cameras; a display device including one or more screens that display, as one or more images for remote operation of the moving body, one or more moving-body camera images; and one or more processors. The one or more processors are configured to: execute a determination process of determining whether or not a moving object is included in an intersection camera image by analyzing the intersection camera image; and execute a highlighting process of applying a highlighting to the one or more moving-body camera images when the moving object is included in the intersection camera image. The highlighting indicates whether the moving object is present in a left or right direction with respect to a traveling direction of the moving body.