Intersection Course Overlay for Remote Vehicle Display Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing display technologies for remote operation of moving bodies, such as automobiles, fail to accurately reflect the driver's intention regarding the vehicle's course through intersections, making it difficult for remote operators to instantly grasp the traffic situation.

Innovation Solution

A display control device that superimposes a course image indicating the planned vehicle path on an intersection image based on the vehicle's traveling direction and the remote operator's intention, using sensors to detect turn signals or steering wheel operations, and optionally adjusts the image orientation to match the vehicle's direction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the course information is determined based on map information and camera parameters, then the display system can show the vehicle direction, but it cannot quickly reflect the driver's actual intention regarding the course

Engineering Contradiction:
Improveaccuracy of course indicationVSAvoidresponse time to driver intention
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary action by detecting the driver's intention through sensors (steering wheel angle, brake operation, accelerator operation) before the vehicle actually changes course. This allows the display to show the intended course in advance, resolving the contradiction by preparing the course indication based on driver input rather than waiting for map-based calculations to catch up with actual driving intentions.

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If the intersection image is displayed without course overlay, then the traffic situation is visible, but the remote operator cannot instantly grasp the vehicle's intended course

Engineering Contradiction:
Improvecompleteness of traffic situation informationVSAvoidtime to grasp vehicle course
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system merges the intersection image (showing traffic situation) with the course image (showing intended vehicle path) into a single composite display. This combining allows the remote operator to simultaneously see both the traffic environment and the vehicle's intended course without switching between multiple displays, thus preserving complete information while reducing the time needed to grasp the vehicle's direction.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system adds a new visual dimension by overlaying the course image (typically showing path direction) onto the two-dimensional intersection image. This dimensional enhancement provides intuitive spatial orientation without obscuring the underlying traffic situation, allowing remote operators to instantly understand vehicle intent while maintaining awareness of the complete traffic environment.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Device complexity

If the course image is displayed in a fixed orientation, then the display is simple, but it does not match the vehicle's actual traveling direction in the intersection

Engineering Contradiction:
Improvesimplicity of display systemVSAvoidintuitiveness of course representation
Core Design Contradiction:
Device complexityVSEase of manufacture

Solution Approach 1:

The system applies dynamics by making the course image orientation variable rather than fixed. The course image is rotated and positioned to match the vehicle's current traveling direction and the camera's viewing angle. This dynamic adjustment ensures the course indication remains intuitive as the vehicle moves through the intersection, while the underlying display system remains relatively simple by using standard image transformation techniques.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS12434634B2Display control device
Publication Date: 2025.10.07 TOYOTA JIDOSHA KK
  • US12434634B2 patent drawing
  • US12434634B2 patent drawing
  • US12434634B2 patent drawing

AI summary

A display control device is configured to control image display of a display device for remote operation of a moving body by a remote operator. The display device includes a first screen that displays an intersection image captured by a camera installed at an intersection and imaging a traffic situation in an area of the intersection. The display control device includes one or more sensors configured to acquire intention information of the remote operator regarding right and left turns of the moving body, and a processor. The processor determines, in accordance with a traveling direction of the moving body in the intersection image and the intention information, a shape of a course image indicating a planned course of the moving body, and displays the course image in a superimposed manner on the intersection image while associating the course image with the moving body in the intersection image.