Work Vehicle Vision Display Mapping for Context-Aware Camera Views

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing multi-camera vision systems for work vehicles often fail to provide operators with intuitive and comprehensive views of their surroundings, leading to increased mental workload and heads-down time, as they typically offer limited and specific camera feeds that do not accommodate the diverse operational needs of different machines and environments.

Innovation Solution

A multi-camera vision system with a controller and display devices that mount cameras at various locations around the vehicle to capture multiple views, allowing the system to intelligently select and display feeds in a consistent and intuitive manner across different machines, reducing the need for operators to swivel or leave their cab, and providing optimal views based on the operational context.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If multiple camera feeds are displayed to provide comprehensive views, then operator visibility is improved, but display complexity and operator cognitive load increase

Engineering Contradiction:
Improveoperator visibilityVSAvoiddisplay complexity
Core Design Contradiction:
Illumination intensityVSDevice complexity

Solution Approach 1:

The display system segments camera feeds by operational context, showing only relevant feeds based on vehicle mode (transport, work, setup). This divides the comprehensive view into context-specific segments, maintaining visibility while reducing cognitive load by filtering out irrelevant information.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically changes display parameters (which camera feeds are shown, their arrangement, and prominence) based on operational context. In transport mode, different feeds are prioritized compared to work mode, allowing the display to adapt its complexity to match operational needs.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If camera feeds are customized for different machine types, then adaptability is improved, but system complexity increases

Engineering Contradiction:
ImproveadaptabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The display system is designed to be universal across different work vehicle types (sprayers, harvesters, etc.). A single control system handles multiple vehicle types by selecting appropriate camera feeds based on operational context rather than requiring separate systems for each machine type, achieving adaptability without proportional complexity increase.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system dynamically adapts its configuration based on the detected operational context and vehicle type. Rather than being statically customized for each machine, the system flexibly reconfigures display parameters, camera selections, and feed arrangements in real-time based on operational needs.

Inventive Principle:
Principle #15Dynamics

3Loss of information

If operators can view all surrounding areas, then situational awareness is improved, but operator attention is diverted from primary tasks

Engineering Contradiction:
Improvesituational awarenessVSAvoidoperator attention
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system segments information display by operational priority and context. Only camera feeds relevant to the current operational mode are displayed prominently, while less relevant feeds are minimized or hidden. This maintains situational awareness for critical areas without diverting attention to non-critical areas.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system extracts and displays only the essential camera feeds needed for the current operational context. By taking out only the necessary information from the complete set of available feeds, the system provides adequate situational awareness while minimizing distraction from primary operational tasks.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS11772562B2Intuitive work vehicle vision system for enhanced operator visibility
Publication Date: 2023.10.03 DEERE & CO
  • US11772562B2 patent drawing
  • US11772562B2 patent drawing
  • US11772562B2 patent drawing

AI summary

A work vehicle has display devices and cameras coupled to display feeds at display areas. The cameras include a first set on the first side, second side, and central location relative to the first FOV and a second set on a first side, second side, and central location relative to the second FOV. A control system is configured to: in a first mode, display a first set of feeds from the first side, second side, and central location of the display areas so that the feeds are arranged at the first side, second side, and central location relative to the first FOV; and in a second mode, display a second set of feeds from the first side, second side, and central location of the second set at display areas so that the feeds are arranged at the first side, second side, and central location relative to the second FOV.