Vehicle Operation Assistance Device Visual Line Recognition

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current vehicle operation assistance systems do not adequately assist operators beyond improving on-board device functions, lacking a comprehensive method to determine the operator's visual line range and alertness to control on-board devices effectively.

Innovation Solution

A vehicle operation assistance device that determines the recognition range of an operator's visual line, calculates alertness and attentiveness, and controls on-board devices based on this information to provide appropriate assistance, using a visual line range determination unit, vigilance calculation unit, and control unit.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the function of on-board devices is improved individually, then each device performs better, but the overall operation assistance capability remains insufficient

Engineering Contradiction:

Improvedevice functionVSAvoidoperation assistance capability

Core Design Contradiction:

ReliabilityVSAdaptability or versatility

Solution Approach 1:

The system integrates multiple functions (visual line detection, alertness calculation, attentiveness assessment, and on-board device control) into a single operation assistance device, enabling it to perform diverse operations based on operator state rather than improving individual devices in isolation

Inventive Principle:

Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If the system monitors operator visual line and calculates alertness, then operation assistance is enhanced, but the device complexity increases

Engineering Contradiction:

Improveoperation assistance capabilityVSAvoidsystem structure

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The operation assistance device acts as an intermediary between the operator and on-board devices, using visual line detection and alertness calculation as intermediate steps to determine appropriate control actions, thereby managing complexity through a structured mediation process

Inventive Principle:

Principle #24Intermediary (Mediator)

3Reliability

If the recognition range determination is added to determine operator attention, then operation safety is improved, but the measurement and detection difficulty increases

Engineering Contradiction:

Improveoperation safetyVSAvoidvisual line range detection

Core Design Contradiction:

ReliabilityVSDifficulty of detecting and measuring

Solution Approach 1:

The system replaces complex mechanical or manual monitoring methods with optical and computational approaches, using cameras and image processing algorithms to detect visual line range and calculate alertness, thereby reducing the practical difficulty of measurement while improving accuracy

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11427206B2Vehicle operation assistance device, vehicle operation assistance method, and program

Publication Date: 2022.08.30 NEC CORP

AI summary

A vehicle operation assistance device is provided with: a visual line range determination unit that determines whether a recognition range including a visual line range of an operator of a mobile body corresponds to either an operation panel range to be operated or an external-environment checking range; a vigilance calculation unit that calculates alertness and attentiveness of the operator on the basis of at least movement of the operator's visual line; and a control unit that controls on-board devices of the mobile body on the basis of the recognition range and at least one of the alertness and attentiveness.