Dynamically Augmented Bird's-Eye View for Moveable Members

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current vehicle systems lack an effective method to dynamically visualize the vehicle's surroundings and its own position in a bird's-eye view, especially when equipped with moveable members that are outside the camera's field of view, which can lead to incomplete or inaccurate representations of the vehicle's environment.

Innovation Solution

A system comprising a moveable member, posture sensing system, bird's-eye camera system, and a controller that generates a dynamically augmented bird's-eye view by combining images from cameras, rendered vehicle representation, and rendered path projection, including a moveable member's position and obstacles, using signals from various sensing systems to create a comprehensive and accurate visual representation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If a bird's-eye camera system is used to capture the vehicle's surroundings, then the operator can see the area around the vehicle, but moveable members outside the camera's field of view cannot be visualized

Engineering Contradiction:
Improvefield of view coverageVSAvoidmoveable member position information
Core Design Contradiction:
Area of stationary objectVSLoss of information

Solution Approach 1:

The patent combines data from multiple sources: bird's-eye camera images, posture sensing system data for moveable members, and path projection calculations. By merging these different information streams into a single composite display, the system visualizes both the camera's field of view and the position of moveable members that are outside the camera view, resolving the contradiction between limited camera coverage and complete information visualization.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The controller acts as an intermediary that processes and integrates data from the camera system, posture sensing system, and path projection calculations. It creates a rendered vehicle representation and combines it with actual camera images to produce the augmented bird's-eye view, mediating between the limited camera field of view and the need to display complete vehicle and moveable member information.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If the bird's-eye view is updated in real-time to show moveable member position, then the representation remains accurate, but the system complexity increases

Engineering Contradiction:
Improverepresentation accuracyVSAvoidsensing and processing system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The controller performs multiple functions: it processes camera images, integrates posture sensing data, calculates path projections, and generates the composite augmented display. By making the controller a multi-functional unit that handles all these tasks, the system achieves real-time accurate representation without proportionally increasing overall system complexity, as a single controller handles diverse functions.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system dynamically updates the bird's-eye view by continuously integrating real-time data from the posture sensing system and camera. The rendered vehicle representation and path projection are dynamically adjusted based on current moveable member positions and vehicle movement, maintaining representation accuracy while using efficient real-time processing rather than static pre-computed displays.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If the outer envelope line is adjusted to include moveable member position, then the path projection remains accurate, but additional sensing and processing requirements increase

Engineering Contradiction:
Improvepath projection accuracyVSAvoidsteering angle sensing and processing
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system pre-calculates the outer envelope line based on the vehicle's dimensions and steering angle, then adjusts it by adding the moveable member's offset distance. This preliminary calculation approach allows accurate path projection without requiring complex real-time simulations, as the basic geometric relationships are established in advance and only need dynamic adjustment with moveable member position data.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11072368B2Dynamically augmented bird's-eye view
Publication Date: 2021.07.27 DEERE & CO
  • US11072368B2 patent drawing
  • US11072368B2 patent drawing
  • US11072368B2 patent drawing

AI summary

In accordance with an example embodiment, a vehicle includes a moveable member, posture sensing system, bird's-eye camera system, display, and controller. The posture sensing system indicates the moveable member's posture. The bird's-eye camera system provides images of its field of view, including the ground adjacent to the vehicle. The controller receives a posture signal from the posture sensing system, receives images from the camera system, creates a rendered vehicle representation, creates a rendered path projection, and generates a dynamically augmented bird's-eye view then displays it on the display. The moveable member is positioned in the rendered vehicle representation using the posture signal. The rendered path projection includes an outer envelope line projecting the path of an outermost point of the vehicle, determined using the posture signal. The dynamically augmented bird's-eye view is generated using the images, rendered vehicle representation, and rendered path projection.