Occlusion Detection Using CNN and Image Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional mouth and nose occluded detection systems often misjudge due to environmental light or cloth color, leading to inaccurate occlusion detection.

Innovation Solution

A method and system utilizing a convolutional neural network to determine occlusion by capturing facial images, extracting mouth portions, and providing warnings, with increased training samples and image processing techniques to enhance accuracy, such as histogram equalization and gamma processing, to reduce environmental factor influence.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional occluded detection systems are used, then the system can detect occlusions, but misjudgment occurs due to environmental light or cloth color

Engineering Contradiction:
Improveocclusion detection accuracyVSAvoiddetection precision
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

A convolutional neural network is introduced as an intermediary between image capture and occlusion determination. The CNN processes facial images through multiple layers of feature extraction, transforming raw pixel data into robust occlusion detection that is insensitive to environmental light and cloth color variations.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system transforms the detection approach by changing parameters from simple color thresholding to multi-layer neural network parameter spaces. The CNN learns optimal parameter transformations that map diverse lighting and color conditions to accurate occlusion states, resolving the contradiction between reliability and precision.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If more training samples are used, then accuracy improves from 84% to 94%, but system complexity increases

Engineering Contradiction:
Improvedetection accuracyVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

Comprehensive image processing operations (histogram equalization, gamma processing, brightness adjustment) are performed preliminarily on training samples before feeding them to the CNN. This preliminary action prepares diverse training data that teaches the network to handle various lighting conditions, achieving high accuracy without requiring an overly complex system architecture.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates multiple transformed copies of each training image through histogram equalization, gamma processing, and brightness adjustments. These synthetic copies expand the training dataset diversity, enabling the CNN to learn robust features that generalize well across different environmental conditions without increasing physical hardware complexity.

Inventive Principle:
Principle #26Copying

3Measurement precision

If image processing techniques like histogram equalization and gamma processing are applied, then environmental factor influence is reduced, but processing time increases

Engineering Contradiction:
Improvedetection precisionVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

Image processing techniques such as histogram equalization, gamma processing, and brightness adjustment are applied preliminarily during the training phase. The CNN learns from these pre-processed images, internalizing the corrections for environmental lighting variations. During actual operation, the network performs rapid classification without requiring real-time application of these computationally intensive transformations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system replaces mechanical image processing operations with a neural network-based computational approach. Instead of applying histogram equalization and gamma processing to every incoming image in real-time, the CNN learns the equivalent transformations during training and applies them implicitly through its learned weights, significantly reducing processing time while maintaining precision.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10891845B2Mouth and nose occluded detecting method and system thereof
Publication Date: 2021.01.12 NATIONAL YUNLIN UNIVERSITY OF SCIENCE AND TECHNOLOGY
  • US10891845B2 patent drawing
  • US10891845B2 patent drawing
  • US10891845B2 patent drawing

AI summary

A mouth and nose occluded detecting method includes a detecting step and a warning step. The detecting step includes a facial detecting step, an image extracting step and an occluded determining step. In the facial detecting step, an image is captured by an image capturing device, wherein a facial portion image is obtained from the image. In the image extracting step, a mouth portion is extracted from the facial portion image so as to obtain a mouth portion image. In the occluded determining step, the mouth portion image is entered into an occluding convolutional neural network so as to produce a determining result, wherein the determining result is an occluding state or a normal state. In the warning step, a warning is provided according to the determining result.