Driver State Determination via Facial Data Decomposition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for monitoring operator states, such as electroencephalography, are cumbersome and costly, making it difficult to effectively determine the mental and physical states of subjects operating machines without imposing a significant burden on the subject.
Innovation Solution
The use of facial skin temperature and photographic image data analysis through singular value decomposition, principal component analysis, or independent component analysis to estimate brain activity without the need for electrodes or probes, allowing for the determination of operator states based on brain function indicators.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If electroencephalography is used to monitor operator states, then measurement precision of brain activity is improved, but device complexity and ease of operation deteriorate due to electrode pretreatment requirements
Solution Approach 1:
The patent replaces the mechanical electrode contact system with an optical imaging system. Instead of using electrodes that require skin preparation and physical contact to detect brain electrical signals, the system uses cameras to capture facial surface images and processes these images to estimate brain activity. This substitution eliminates the need for electrode pretreatment while maintaining brain activity detection capability.
Solution Approach 2:
The patent creates an optical copy of brain activity through facial surface imaging. By capturing images of facial surface characteristics (such as blood flow, temperature, or other physiological indicators visible on the skin) and processing these images through pattern recognition, the system generates a representation of brain activity without directly measuring electrical signals from the brain. This copying approach simplifies the measurement process while preserving the essential information about operator state.
2Reliability
If electroencephalography equipment is used, then reliability of operator state determination is improved, but ease of manufacture and cost deteriorate
Solution Approach 1:
The patent replaces complex electroencephalography equipment with simpler optical imaging devices. Standard cameras or image sensors can capture facial surface data, which is then processed using image processing algorithms. This substitution dramatically reduces manufacturing complexity and cost while maintaining the ability to reliably determine operator state through facial physiological indicators that correlate with brain activity.
Solution Approach 2:
The patent uses inexpensive imaging components and processing methods that can be easily manufactured and deployed. Rather than requiring expensive, specialized electroencephalography equipment, the system uses readily available imaging technology combined with software-based analysis, making the solution more accessible and easier to manufacture while achieving comparable reliability for operator state monitoring.
Data Source
Figure 1(a)~1(b)
Figure 2(a)~2((b)
Figure 3(a)~3(b)
AI summary
A driver state determination device (10, 110, 400, 400A, 400B) includes a facial change information acquisition unit (20, 120, 415, 442), a facial change information decomposition unit (30, 130, 443), and a driver state determination unit (200, 445). The facial change information acquisition unit (20, 120, 415, 442) acquires facial change information indicating time-series changes in facial data of a subject. The facial change information decomposition (30, 130, 443) unit decomposes the facial change information into a plurality of components 1, 2, 3... by singular value decomposition, principal component analysis, or independent component analysis. The driver state determination unit (200, 445) determines the driver state of the subject on the basis of a determination component extracted from the plurality of components 1, 2, 3....