Electronic Mirror System with Virtual Vehicle Superimposition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing vehicle surroundings monitoring systems fail to accurately depict the relative position of a subject vehicle in the lateral direction on a road, as rear imaging units do not capture the vehicle and composite images may not include it, making it difficult for drivers to gauge their position.

Innovation Solution

An electronic mirror system incorporating a rear imaging unit and left/right rear lateral imaging units, with an image processing unit that generates a composite image and a virtual image of the subject vehicle, including its travel trajectory, to be displayed on a display unit, allowing easy visualization of the vehicle's position relative to the road.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Stability of the object's composition

If image processing is performed to continuously connect rear and lateral images, then image continuity is improved, but the subject vehicle is excluded from the composite image making it difficult to grasp relative position

Engineering Contradiction:
Improveimage continuityVSAvoidsubject vehicle position information
Core Design Contradiction:
Stability of the object's compositionVSLoss of information

Solution Approach 1:

The patent creates a virtual copy of the subject vehicle based on detection data from imaging devices and sensors. This virtual image is then superimposed on the composite image, allowing the vehicle's position to be displayed without disrupting the continuous connection of rear and lateral images. The copying principle resolves the contradiction by providing position information through a generated representation rather than requiring the actual vehicle to appear in the processed image.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent introduces a virtual image as an intermediary element between the imaging system and the driver. This virtual representation serves as a mediator that conveys position information without interfering with the image processing that creates continuous composite views. The intermediary approach allows both image continuity and position information to coexist.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Area of stationary object

If rear imaging units capture wide area images, then coverage is improved, but the subject vehicle is not captured making lateral position assessment difficult

Engineering Contradiction:
Improveimage coverage areaVSAvoidsubject vehicle position information
Core Design Contradiction:
Area of stationary objectVSLoss of information

Solution Approach 1:

The system creates a virtual copy of the subject vehicle using detection data from multiple imaging devices and sensors. This virtual image is superimposed on the wide-area composite image, enabling the driver to assess lateral position relative to road markings and surrounding objects while maintaining comprehensive coverage. The copying approach allows the vehicle to be represented in the image without limiting the imaging area.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent employs multiple imaging devices serving different functions: rear imaging units capture wide-area views for overall coverage, while lateral imaging units and sensors provide position data. The image processing unit integrates these multi-functional inputs to create a composite image with superimposed virtual vehicle position, allowing a single system to achieve both wide coverage and precise position assessment.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If virtual image of subject vehicle is superimposed on composite image, then position visualization is improved, but image processing complexity increases

Engineering Contradiction:
Improveposition visualizationVSAvoidimage processing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent divides the image processing into distinct segments: rear image processing, lateral image processing, virtual vehicle image generation, and superimposition. This segmentation allows each processing stage to be handled independently, reducing overall complexity while achieving comprehensive position visualization. The segmented approach enables modular implementation and easier system management.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11524630B2Electronic mirror system for vehicle
Publication Date: 2022.12.13 TOYOTA JIDOSHA KK
  • US11524630B2 patent drawing
  • US11524630B2 patent drawing
  • US11524630B2 patent drawing

AI summary

A display control device displays, on an electronic inner mirror, a composite image composited by performing image processing on a rear image captured by a rear camera and rear lateral images captured by an outer camera unit such that the rear image and the rear lateral images become a continuous image. A subject vehicle virtual image superimposition display unit of the display control device generates a virtual image of a subject vehicle virtually showing a subject vehicle and displays the virtual image of the subject vehicle superimposed on the composite image. A subject vehicle travel trajectory superimposition display unit of the display control device generates a virtual image of travel trajectory, which extends from left and right rear wheels toward the rear of the vehicle in the composite image, and displays the virtual image of travel trajectory superimposed on the composite image.