Dynamic Stitching Line for Unobstructed Surround View

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional imaging systems for heavy equipment with implements, such as backhoe loaders, fail to provide a clear surround view due to the implement blocking the camera's view, resulting in obstructed visibility for operators.

Innovation Solution

An imaging system with at least two cameras mounted on opposing sides of the implement, a processing device that determines the position or angle of the implement, and dynamically adjusts the stitching line to generate a stitched surround view, ensuring the implement does not obstruct the view.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If cameras are mounted on the machine to capture images of the environment, then the operator can see the machine's environment, but the implement blocks the view of one or more cameras causing obstructed visibility

Engineering Contradiction:
Improvevisibility of environmentVSAvoidobstruction by implement
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The stitching line is dynamically adjusted based on the real-time position and angle of the implement. As the implement moves, the stitching line automatically repositions to ensure it does not obstruct the view, allowing the operator to continuously see the environment that would otherwise be blocked by the implement.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the parameter of the stitching line (its position and angle) according to the implement's position and angle. By dynamically modifying the stitching line parameters, the system ensures that the stitching line does not coincide with the implement's location, thereby preventing obstruction of the environment view.

Inventive Principle:
Principle #35Parameter changes

2Device complexity

If a fixed stitching line is used to stitch camera views, then the system is simple to implement, but the implement obstructs portions of the environment in the stitched view

Engineering Contradiction:
Improvestitching system complexityVSAvoidblocked environment view
Core Design Contradiction:
Device complexityVSLoss of information

Solution Approach 1:

The stitching line transitions from a fixed position to a dynamic position that adjusts with the implement's movement. The system continuously updates the stitching line's position and angle based on real-time implement data, ensuring the stitching line does not block the environment while maintaining system simplicity through automated adjustment.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses feedback from the implement's position and angle sensors to automatically adjust the stitching line. This closed-loop control ensures that the stitching line dynamically repositions itself to avoid obstructing the environment, resolving the contradiction between system simplicity and effective obstruction avoidance.

Inventive Principle:
Principle #23Feedback

3Loss of information

If the stitching line is dynamically adjusted according to implement position and angle, then the environment view remains unobstructed, but the processing complexity increases

Engineering Contradiction:
Improveunobstructed environment viewVSAvoidprocessing complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system implements a feedback mechanism where the stitching line's position and angle are automatically adjusted based on real-time data from the implement's position and angle sensors. This automated feedback loop manages the processing complexity by using sensor data to directly control stitching line adjustments, ensuring the environment remains unobstructed while keeping the processing systematic and manageable.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system dynamically changes the stitching line parameters (position and angle) based on implement parameters. By automatically adjusting these parameters in response to implement movement, the system maintains an unobstructed environment view while managing processing complexity through parameter-based control rather than complex image manipulation.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS9871968B2Imaging system for generating a surround-view image
Publication Date: 2018.01.16 CATERPILLAR INC
  • US9871968B2 patent drawing
  • US9871968B2 patent drawing
  • US9871968B2 patent drawing

AI summary

An imaging system for a machine having an implement includes at least two cameras mounted on the machine at opposing sides of the implement and configured to generate at least two camera views of an environment of the machine, and a processing device in communication with the at least two cameras. The processing device is configured to obtain the at least two camera views, obtain at least one of a position or an angle of the implement, determine at least one of a position or an angle of a stitching line according to the at least one of the position or the angle of the implement, and generate a stitched surround view based on the at least two camera views and the stitching line.