Vehicle Camera View Control Using Occupant Gaze Direction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Vehicle occupants face difficulties in maintaining attention to their surroundings while manually selecting and adjusting camera views on a display, especially when maneuvering the vehicle, as this process can divert their attention away from the environment.

Innovation Solution

A vehicle camera control system that uses exterior and interior cameras to determine the occupant's gaze and head direction, automatically displaying relevant camera views on a display, ensuring the occupant can maintain attention on the surroundings by providing desired views based on their focus without manual input.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If manual selection and adjustment of camera views is implemented, then the occupant can select specific views of interest, but the occupant's attention is diverted from the surroundings

Engineering Contradiction:
ImproveManual camera view selectionVSAvoidOccupant attention to surroundings
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system uses interior cameras to automatically detect the occupant's gaze direction and head orientation, then autonomously selects and displays the corresponding exterior camera views without requiring manual input from the occupant. This self-service approach eliminates the need for the occupant to interact with the camera system while maintaining awareness of surroundings.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system continuously monitors the occupant's gaze and head direction through interior cameras and uses this feedback to dynamically adjust which exterior camera views are displayed. This closed-loop feedback mechanism ensures the displayed views automatically correspond to the occupant's line of sight and attention focus.

Inventive Principle:
Principle #23Feedback

2Reliability

If automatic display of camera views based on gaze direction is implemented, then the occupant can maintain attention on surroundings, but the system complexity increases

Engineering Contradiction:
ImproveOccupant attention to surroundingsVSAvoidCamera control system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The interior cameras serve multiple functions: they detect the occupant's gaze direction, determine head orientation, and provide input for automatic camera view selection. This multi-functionality reduces the need for separate dedicated sensors and simplifies the overall system architecture despite the automated capabilities.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses the occupant's existing head movements and gaze directions as natural intermediaries to control camera view selection. Instead of requiring direct interaction with controls, the occupant's natural physical actions serve as the mediation mechanism between their intent and the system response.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Extent of automation

If multiple cameras and processing circuitry are added to enable automatic view display, then the desired camera view is automatically displayed, but the device complexity increases

Engineering Contradiction:
ImproveAutomatic camera view displayVSAvoidCamera control system
Core Design Contradiction:
Extent of automationVSDevice complexity

Solution Approach 1:

The system combines multiple camera feeds and processing functions into a unified automatic view selection process. The interior cameras, exterior cameras, and processing circuitry are merged into an integrated system that automatically correlates occupant orientation with relevant exterior views, reducing the need for separate control mechanisms.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS12139074B2System and method for providing a desired view for a vehicle occupant
Publication Date: 2024.11.12 NINGBO GEELY AUTOMOBILE RES & DEV CO LTD
  • US12139074B2 patent drawing
  • US12139074B2 patent drawing
  • US12139074B2 patent drawing

AI summary

A system, method and computer program product for providing a desired camera view of interest for a vehicle occupant. The method includes obtaining, by the least a first interior view camera, at least a first interior view of the face and/or the head of the vehicle occupant determining, based on the at least first interior view, at least any of a gaze direction and a head direction of the vehicle occupant for understanding where the vehicle occupant is looking, determining, that the view of interest for the vehicle occupant is, at least partly, within the at least first exterior view of the at least first exterior view camera, and displaying the at least first exterior view to the vehicle occupant via the at least first display.