Multi-Camera Face Identification via Fuzzy PTZ Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current intelligent video surveillance systems face challenges in obtaining high-resolution face images for remote human identification, as existing object detection and tracking technologies using PTZ cameras often result in image deterioration due to excessive pan-tilt operations and require frequent updates in camera coordinate mappings, failing to provide optimal face images for identification.

Innovation Solution

An apparatus utilizing a multi-camera control module that includes an object tracking unit, online learning unit, and PTZ camera controller, which uses fuzzy inference to control PTZ cameras, maintaining object size at the image center and adjusting pan-tilt-zoom operations to extract object characteristic values, ensuring high-resolution and low-deterioration images for face identification.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If PTZ camera is used to zoom in and track the object, then the resolution of the object image is improved, but the image quality deteriorates due to excessive pan-tilt operations

Engineering Contradiction:
Improveobject image resolutionVSAvoidimage quality
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system dynamically adjusts the balance between fixed camera coverage and PTZ camera zooming based on object distance and importance. The fixed camera provides stable wide-area monitoring while the PTZ camera is activated selectively for specific objects, creating a dynamic adaptation strategy that optimizes image quality based on real-time conditions.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

Instead of continuously using the PTZ camera for all objects, the system applies partial action by selectively activating the PTZ camera only for specific objects that require detailed inspection. This reduces unnecessary pan-tilt operations while still achieving high-resolution imaging when needed.

Inventive Principle:
Principle #16Partial or excessive action

2Measurement precision

If PTZ camera is controlled to keep the interest object at the center of the image, then the tracking accuracy is improved, but the image deteriorates due to excessive pan-tilt operations

Engineering Contradiction:
Improvetracking accuracyVSAvoidimage quality
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system dynamically determines the optimal positioning strategy for tracked objects based on their distance and importance. For distant or critical objects, the system maintains center positioning to ensure accurate tracking. For closer or less critical objects, the system allows more flexible positioning to reduce unnecessary camera movements.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system applies partial centering action rather than forcing all objects to the exact center. This selective centering approach maintains tracking accuracy for important objects while reducing excessive pan-tilt operations for others.

Inventive Principle:
Principle #16Partial or excessive action

3Difficulty of detecting and measuring

If fixed camera and PTZ camera are used together for object detection and tracking, then the detection capability is improved, but the system complexity increases due to coordinate mapping

Engineering Contradiction:
Improveobject detection capabilityVSAvoidcoordinate mapping system
Core Design Contradiction:
Difficulty of detecting and measuringVSDevice complexity

Solution Approach 1:

The system introduces an intermediary coordinate mapping mechanism that automatically translates positions between the fixed camera's wide-area coordinates and the PTZ camera's zoomed-in coordinates. This intermediary layer handles the complexity of coordinate transformation, allowing the dual-camera system to operate seamlessly without requiring manual calibration or complex integration logic.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Measurement precision

If PTZ camera is used for remote human identification, then the face image resolution is improved, but the identification performance deteriorates due to image deterioration from pan-tilt operations

Engineering Contradiction:
Improveface image resolutionVSAvoididentification performance
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system dynamically selects between fixed camera and PTZ camera for face image acquisition based on real-time conditions such as object distance, movement speed, and environmental factors. This dynamic selection ensures that the optimal camera is used for each identification scenario, maintaining identification performance while achieving necessary resolution.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system applies partial zooming action rather than continuously using maximum zoom. By activating the PTZ camera selectively and using appropriate zoom levels based on identification requirements, the system achieves sufficient face image resolution while minimizing image deterioration from excessive camera operations.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS9036039B2Apparatus and method for acquiring face image using multiple cameras so as to identify human located at remote site
Publication Date: 2015.05.19 ELECTRONICS & TELECOMM RES INST
  • US9036039B2 patent drawing
  • US9036039B2 patent drawing
  • US9036039B2 patent drawing

AI summary

An apparatus for acquiring a face image using multiple cameras so as to identify a human being located at a remote site is disclosed. The apparatus for acquiring a face image using multiple cameras allows a PTZ camera to track an interest object from among objects detected/tracked by a fixed camera, and obtains an optimum face image for remote human identification from images generated by the PTZ camera. The apparatus for acquiring the face image using multiple cameras so as to identify a human located at a remote site includes a multi-camera control module for tracking an interest object being detected/tracked by a fixed camera through a Pan-Tilt-Zoom (PTZ) camera, and generating an image of the interest object; and a face-image acquisition module for acquiring a face image appropriate for identifying a face image of the remote human in the interest object image generated by the multi-camera control module.