Camera Monitor System Augmented Reality Projection Commercial Vehicle

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional exterior mirror systems in commercial vehicles are prone to environmental influences such as dirt and ice, making the mirror image unrecognizable, and are complex, cost-intensive, and bulky, while also being difficult to evaluate at a glance due to their multiple individual mirrors. Additionally, existing camera monitor systems do not fully utilize sensor data to enhance the driver's situational awareness.

Innovation Solution

A camera monitor system that uses cameras to capture the vehicle's surroundings, processes image data, and displays it on monitors inside the vehicle, with the ability to superimpose information from vehicle sensors, such as virtual objects and safety-relevant data, and incorporates augmented reality to improve the driver's perception of the vehicle's environment, including projections of camera arms and trailer positions onto the ground for better maneuvering and collision avoidance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional exterior mirror systems are used, then the driver can see the lateral rear environment, but the mirrors become dirty, ice up, and the image becomes unrecognizable due to environmental influences

Engineering Contradiction:
Improvemirror image recognizabilityVSAvoidenvironmental influences (dirt, ice)
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent replaces the physical mirror with a camera that captures the rear environment and displays it on a monitor inside the vehicle. This optical copy allows the driver to see the lateral rear environment without any physical surface being exposed to environmental contaminants like dirt and ice, completely eliminating the problem of image unrecognizability.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The mechanical mirror system is replaced with an electronic camera-monitor system. Instead of using reflective surfaces that are physically exposed to the environment, the system uses cameras to capture images and electronic displays to show them, substituting mechanical optical components with electronic systems that are protected from environmental influences.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If exterior mirrors with remote-controlled adjustment devices are used, then the mirror position can be adjusted, but the mirrors become complex, cost-intensive, and large-volume components that protrude far from the vehicle

Engineering Contradiction:
Improvemirror position adjustmentVSAvoidadjustment device complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

Instead of using complex mechanical mirrors with adjustment devices, the patent uses cameras with adjustable fields of view that can be controlled electronically. The camera system captures the environment from different angles and displays them on monitors, providing the same adaptability for position adjustment without the mechanical complexity, high costs, and large protruding structures of traditional adjustable mirrors.

Inventive Principle:
Principle #26Copying

3Area of stationary object

If multiple individual mirrors are used on one side of the vehicle, then the lateral surroundings can be covered, but the mirror images are difficult to grasp and evaluate at a glance

Engineering Contradiction:
Improvelateral surroundings coverageVSAvoidimage evaluation ease
Core Design Contradiction:
Area of stationary objectVSEase of operation

Solution Approach 1:

The patent combines multiple camera fields of view into a single integrated monitor display. Instead of showing separate images from multiple mirrors that require the driver to switch between them, the system merges all lateral surroundings coverage into one unified visual presentation on the monitor, making it easy to grasp and evaluate the entire lateral environment at a glance.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent transitions from a spatial arrangement of multiple physical mirrors that require lateral eye movement or head turning to a two-dimensional electronic display that presents all information in a single field of view. This dimensional change allows the driver to access all lateral surroundings information without changing physical viewing position, greatly improving ease of evaluation.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

4Volume of stationary object

If cameras are used instead of mirrors, then the system is smaller and environmental influences are better controlled, but sensor data is not fully utilized to enhance driver situational awareness

Engineering Contradiction:
Improvecamera system volumeVSAvoidsensor data utilization
Core Design Contradiction:
Volume of stationary objectVSLoss of information

Solution Approach 1:

The patent enhances the basic camera-monitor system by integrating additional sensor data (such as object detection, distance measurement, and classification information) and providing feedback to the driver through the monitor display. This feedback mechanism allows the system to not only show the camera image but also to highlight and interpret important elements in the scene, fully utilizing the sensor data to enhance driver situational awareness without increasing system volume.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP3401166B1Mirror replacement system as camera display system of a motor vehicle, in particular a commercial vehicle
Publication Date: 2020.03.11 MAN TRUCK & BUS SE
  • EP3401166B1 patent drawingFigure 1~2
  • EP3401166B1 patent drawingFigure 3~4
  • EP3401166B1 patent drawingFigure 5~6

AI summary

The invention relates to a mirror replacement system as a camera-monitor system (CMS) of a motor vehicle, in particular a commercial vehicle, comprising at least one camera capturing and recording the environment of the motor vehicle in a real-time camera image, at least one control unit to which image data from the at least one camera are supplied for processing, and at least one monitor (5, 11) as a screen in the driver's field of vision, which is connected to the at least one control unit for displaying a monitor image (6) of the current camera image captured by the at least one camera, wherein information displays are superimposed onto the monitor image (6) by means of the control unit, which are obtained by evaluating vehicle-side sensors and/or which represent virtually generated vehicles (37), vehicle parts (36) or stationary objects.wherein the displayed information is perspectively correct as so-called "Augmented Reality" in the monitor image (6) and is inserted into an image representation, wherein the image representation shows a ground-side contact surface around the vehicle and vehicle parts are virtually projected onto the ground as displayed information representations.