Occlusion Detection Using CNN and Image Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional mouth and nose occluded detection systems often misjudge due to environmental light or cloth color, leading to inaccurate occlusion detection.
Innovation Solution
A method and system utilizing a convolutional neural network to determine occlusion by capturing facial images, extracting mouth portions, and providing warnings, with increased training samples and image processing techniques to enhance accuracy, such as histogram equalization and gamma processing, to reduce environmental factor influence.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional occluded detection systems are used, then the system can detect occlusions, but misjudgment occurs due to environmental light or cloth color
Solution Approach 1:
A convolutional neural network is introduced as an intermediary between image capture and occlusion determination. The CNN processes facial images through multiple layers of feature extraction, transforming raw pixel data into robust occlusion detection that is insensitive to environmental light and cloth color variations.
Solution Approach 2:
The system transforms the detection approach by changing parameters from simple color thresholding to multi-layer neural network parameter spaces. The CNN learns optimal parameter transformations that map diverse lighting and color conditions to accurate occlusion states, resolving the contradiction between reliability and precision.
2Reliability
If more training samples are used, then accuracy improves from 84% to 94%, but system complexity increases
Solution Approach 1:
Comprehensive image processing operations (histogram equalization, gamma processing, brightness adjustment) are performed preliminarily on training samples before feeding them to the CNN. This preliminary action prepares diverse training data that teaches the network to handle various lighting conditions, achieving high accuracy without requiring an overly complex system architecture.
Solution Approach 2:
The system creates multiple transformed copies of each training image through histogram equalization, gamma processing, and brightness adjustments. These synthetic copies expand the training dataset diversity, enabling the CNN to learn robust features that generalize well across different environmental conditions without increasing physical hardware complexity.
3Measurement precision
If image processing techniques like histogram equalization and gamma processing are applied, then environmental factor influence is reduced, but processing time increases
Solution Approach 1:
Image processing techniques such as histogram equalization, gamma processing, and brightness adjustment are applied preliminarily during the training phase. The CNN learns from these pre-processed images, internalizing the corrections for environmental lighting variations. During actual operation, the network performs rapid classification without requiring real-time application of these computationally intensive transformations.
Solution Approach 2:
The system replaces mechanical image processing operations with a neural network-based computational approach. Instead of applying histogram equalization and gamma processing to every incoming image in real-time, the CNN learns the equivalent transformations during training and applies them implicitly through its learned weights, significantly reducing processing time while maintaining precision.
Data Source
AI summary
A mouth and nose occluded detecting method includes a detecting step and a warning step. The detecting step includes a facial detecting step, an image extracting step and an occluded determining step. In the facial detecting step, an image is captured by an image capturing device, wherein a facial portion image is obtained from the image. In the image extracting step, a mouth portion is extracted from the facial portion image so as to obtain a mouth portion image. In the occluded determining step, the mouth portion image is entered into an occluding convolutional neural network so as to produce a determining result, wherein the determining result is an occluding state or a normal state. In the warning step, a warning is provided according to the determining result.


