Dynamic 3D Surround View Model Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing surround view systems for machines suffer from distortion or degradation of 3-dimensional composite views as the machine travels through different environments, due to initial calibration issues, leading to an unrealistic representation of the surroundings.

Innovation Solution

A surround view system that includes image capturing devices, an object detection system, and an image processing system capable of generating an initial 3-dimensional composite surround view by projecting image data onto a virtual model with a 3-dimensional shape based on initial calibration data, and dynamically modifying this shape based on object position data to create an updated view.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If initial calibration is performed to establish a 3-dimensional shape for the virtual model, then the surround view system can generate an initial 3-dimensional composite surround view, but the view becomes distorted or degraded as the machine travels through different environments

Engineering Contradiction:
Improveaccuracy of surround viewVSAvoidadaptability to different environments
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent applies the dynamics principle by transforming the static virtual model into a dynamic one that can adapt to changing environments. The system continuously modifies the 3-dimensional shape of the virtual model based on real-time object position data detected by the object detection system, allowing the surround view to remain accurate as the machine moves through different environments rather than relying on fixed initial calibration

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements feedback by using object position data from the object detection system to continuously adjust and modify the virtual model's 3-dimensional shape. This closed-loop feedback mechanism ensures that the virtual model remains aligned with the actual surroundings, compensating for distortions that occur during machine movement and maintaining measurement precision across varying environments

Inventive Principle:
Principle #23Feedback

2Reliability

If the virtual model shape is modified based on object position data, then the 3-dimensional composite surround view becomes more realistic and less distorted, but the system complexity increases

Engineering Contradiction:
Improvereliability of surroundings representationVSAvoidcomplexity of image processing system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies universality by integrating multiple functions into the image processing system. The same system that generates the initial 3-dimensional composite surround view also performs object detection integration and dynamically modifies the virtual model shape, eliminating the need for separate dedicated systems and reducing overall device complexity while maintaining reliability

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10475154B2Machine surround view system and method for generating 3-dimensional composite surround view using same
Publication Date: 2019.11.12 CATERPILLAR INC
  • US10475154B2 patent drawing
  • US10475154B2 patent drawing
  • US10475154B2 patent drawing

AI summary

A surround view system for a machine is provided. The surround view system includes a plurality of image capturing devices generating image data of surroundings of the machine, and an object detection system for detecting an object in a target field of view of the machine and generating object position data corresponding to the object. The surround view system also includes an image processing system configured to generate an initial 3-dimensional composite surround view by projecting the image data on a virtual model corresponding to the machine. The virtual model has a 3-dimensional shape based on an initial calibration position data. The image processing system is also configured to modify the 3-dimensional shape of the virtual model based on the object position data, and generate an updated 3-dimensional composite surround view by projecting the image data on the virtual model having a modified 3-dimensional shape.