Multi-Camera Vision System with Gallery Display for Work Vehicles

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing multi-camera vision systems for work vehicles often overwhelm operators with multiple camera feeds, making it difficult to switch between them rapidly and intuitively, which can increase mental workload and heads-down time, reducing situational awareness and operator efficiency.

Innovation Solution

A multi-camera vision system with multiple cameras capturing different views of a work vehicle's surroundings, a controller, and a display device that generates a multi-camera display with framing icons, gallery display areas, and a main display area, allowing operators to easily select and switch between camera feeds by interacting with intuitive graphical user interface elements, such as rearview mirror assembly icons, while maintaining awareness of all available feeds.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If multiple camera feeds are displayed simultaneously, then situational awareness is improved, but operator mental workload increases

Engineering Contradiction:
Improvesituational awarenessVSAvoidmental workload
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The display is segmented into multiple functional zones: a main display area showing the primary camera feed in full screen, and smaller thumbnail areas displaying alternative camera feeds. This segmentation allows operators to see multiple views simultaneously without the complexity of managing equal-sized feeds, as the hierarchical layout intuitively indicates primary versus secondary views.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different portions of the display have different qualities and functions. The main display area provides high-resolution, full-screen viewing for the selected camera feed, while thumbnail areas provide lower-resolution previews of other feeds. This local differentiation optimizes information presentation by giving full attention to the primary view while maintaining awareness of alternative views.

Inventive Principle:
Principle #3Local quality

2Productivity

If operators can switch between camera feeds rapidly, then operational efficiency is improved, but interface complexity increases

Engineering Contradiction:
Improveoperator efficiencyVSAvoidinterface complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The selection interface extracts the switching function from complex menu navigation and embeds it directly into the display itself. Thumbnails of alternative camera feeds are extracted and displayed as clickable elements, allowing operators to switch feeds by simply selecting from visual representations rather than navigating through text menus or pressing combination keys.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The thumbnail images serve as intermediaries between the operator's selection intent and the camera feed switching function. Instead of directly commanding feed switching through complex controls, operators interact with visual thumbnails that mediate the selection process, making the interface more intuitive and reducing the cognitive steps required for switching.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Illumination intensity

If a single camera feed is displayed in full screen, then visual clarity is improved, but awareness of other feeds is reduced

Engineering Contradiction:
Improvevisual clarityVSAvoidawareness of other feeds
Core Design Contradiction:
Illumination intensityVSLoss of information

Solution Approach 1:

The system transitions from a single-dimensional full-screen display to a multi-dimensional layout that incorporates both full-screen and thumbnail views simultaneously. By adding the spatial dimension of thumbnail images alongside the main display, operators gain awareness of other feeds without compromising the visual clarity of the primary feed, as the thumbnails provide contextual information without competing for main viewing attention.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11091100B2Work vehicle multi-camera vision systems
Publication Date: 2021.08.17 DEERE & CO
  • US11091100B2 patent drawing
  • US11091100B2 patent drawing
  • US11091100B2 patent drawing

AI summary

A multi-camera vision system utilized onboard a work vehicle includes, among other components, vehicle cameras and a display device utilized within an operator station of the work vehicle. The vehicle cameras provide vehicle camera feeds of the work vehicle's surrounding environment, as captured from different vantage points. A controller, which is coupled to the vehicle cameras and to the display device, is configured to: (i) generate, on the display device, a multi-camera display including framing icons, gallery display areas within the framing icons, and a main display area; (ii) identify a currently-selected vehicle camera feed and one or more non-selected vehicle camera feeds from the multiple vehicle camera feeds; and (iii) present the currently-selected vehicle camera feed in the main display area of the multi-camera display, while concurrently presenting the one or more non-selected vehicle camera feeds in a corresponding number of the gallery display areas.