In-Vehicle Camera Facial Detection via Dynamic Image Enlargement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing systems for in-vehicle cameras struggle to detect the range and facial features of drivers when their faces are not centered or are small in the image frame, leading to inadequate image processing and increased processing load.

Innovation Solution

An image processing method that involves manipulating the image by enlarging it based on detected facial contours, with the enlargement ratio adjusted according to the size of the face, and using the center point (such as the location of the eyes and nose) as a reference for image processing, facilitating the detection of the range and features of the driver.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the driver's face is away from the in-vehicle camera, then the image processing device cannot perform sufficient detection of facial contours and features, but enlarging the image increases processing load and time

Engineering Contradiction:
Improvedetection precision of facial contour and featuresVSAvoidimage processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary detection of the driver's face position and size in the captured image, then pre-calculates the appropriate enlargement ratio and manipulation parameters before actual facial feature detection. This preliminary action prepares the image in advance, ensuring that subsequent detection operations work with optimally scaled images, thus improving detection precision without unnecessarily increasing processing time for each detection cycle.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The image manipulation parameters (enlargement ratio, manipulation range, reference point) are dynamically adjusted based on the detected face position and size. When the face is small or off-center, the system automatically increases enlargement ratio and adjusts manipulation parameters. This dynamic adaptation ensures that the image is always optimally prepared for detection regardless of the driver's position, resolving the contradiction between maintaining detection precision and minimizing processing time.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If the face size in the image is small, then detection of facial features becomes insufficient, but increasing image size requires additional processing steps

Engineering Contradiction:
Improvedetection precision of facial featuresVSAvoidimage processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system changes key parameters (enlargement ratio, manipulation range, reference point coordinates) based on the detected face characteristics. By dynamically adjusting these parameters, the system adapts the image processing to the specific conditions of each frame, ensuring sufficient feature detection precision without requiring complex fixed-processing pipelines. The parameter changes are calculated based on simple geometric relationships, maintaining processing efficiency.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The image manipulation process is self-adapting based on automatic detection results. The system uses the detected face position and size to automatically determine manipulation parameters without requiring manual intervention or complex external control systems. This self-service approach simplifies the overall system architecture while ensuring that images are always optimally prepared for detection based on their specific characteristics.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If standard image processing software is used, then processing of variable-size faces becomes inadequate, but developing specialized software increases system complexity

Engineering Contradiction:
Improveadaptability to different face positions and sizesVSAvoidsoftware system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent creates a universal image manipulation framework that can handle various face positions, sizes, and orientations through parameter adjustment. The same basic manipulation algorithm works for all cases by dynamically changing parameters (enlargement ratio, reference point, manipulation range). This universal approach allows standard image processing software to be effectively adapted to handle diverse facial configurations without requiring completely specialized software for each scenario, thus improving adaptability while controlling system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS8300101B2Image processing method, image processing system, image pickup device, image processing device and computer program for manipulating a plurality of images
Publication Date: 2012.10.30 FUJITSU LTD
  • US8300101B2 patent drawing
  • US8300101B2 patent drawing
  • US8300101B2 patent drawing

AI summary

A system using an in-vehicle camera mounted on a vehicle for an image pickup object of the face of the driver, for: continuously taking an image of the image pickup object; performing manipulation, such as enlargement of an area including the image pickup object with a reference point being the center, for a second image based on image pickup after a first image, on the basis of the range of the image pickup object detected from the first image, the width of the facial contour of the driver, for example, and also a reference point such as the center of the face to be decided based on the location of the eyes and nose of the driver; and performing image processing, such as detection of the range of the image pickup object and decision of the reference point, for the manipulated second image.