Composite Map Generation for Overlapping Face Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image data processing systems face challenges in accurately measuring emotional information of all audiences in a venue, such as concerts or sports events, due to obstacles and varying imaging conditions, which lead to incomplete face detection and recognition of personal attributes like age, gender, and emotion.

Innovation Solution

An image data processing device and system that processes data from multiple overlapping imaging devices, detects faces, recognizes personal attributes, generates map data, interpolates overlapping information, and combines it to create composite map data, enabling accurate emotional analysis and visualization through heat maps.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a single imaging device is used to capture audience information, then the device complexity is low, but the measurement precision of emotional information and face detection accuracy deteriorates due to obstacles and limited imaging range

Engineering Contradiction:
Improveface detection accuracyVSAvoidimaging system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The imaging system is divided into multiple imaging devices, each capturing a specific field of view. The audience area is segmented into multiple zones, with each imaging device responsible for capturing information in its designated zone. This segmentation allows each device to focus on a smaller area, improving face detection accuracy while distributing the overall system complexity across multiple components.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Multiple imaging devices are combined to form a comprehensive imaging system. The image data, map data, and personal attribute information from each device are merged and integrated through the processing device. This merging approach consolidates the limited views of individual devices into a complete, accurate representation of the entire audience area, overcoming the limitations of any single device.

Inventive Principle:
Principle #5Merging (Combining)

2Measurement precision

If multiple imaging devices with overlapping imaging ranges are used to improve face detection coverage, then the measurement precision of emotional information improves, but the device complexity increases

Engineering Contradiction:
Improveemotional information accuracyVSAvoiddata processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

A processing device acts as an intermediary between multiple imaging devices and the final output. This intermediary receives image data from multiple sources, performs map data generation, interpolates personal attribute information across overlapping fields of view, and combines the data into unified map data. The intermediary manages the complexity of integrating multiple devices by providing a standardized processing framework.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system changes parameters such as map data resolution, interpolation algorithms, and data combination methods to optimize the integration of multiple imaging devices. By adjusting these parameters, the system can handle varying degrees of overlap and different imaging conditions, managing data processing complexity while maintaining high measurement precision for emotional information.

Inventive Principle:
Principle #35Parameter changes

3Loss of information

If map data from multiple imaging devices is combined without interpolation, then the processing time is short, but the loss of information increases due to gaps in coverage

Engineering Contradiction:
Improvepersonal attribute information completenessVSAvoiddata processing time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system performs preliminary actions by generating map data from image data before final combination. Personal attribute information is extracted and organized in advance for each imaging device's field of view. This preliminary organization of data structure and content prepares the information for efficient interpolation and combination, reducing the computational burden during the final integration phase.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The interpolation process maintains continuity of useful action by filling in gaps in personal attribute information across overlapping fields of view. Rather than creating discontinuities or information loss at the boundaries of each device's coverage area, the interpolation continuously extends the personal attribute data across the entire combined field of view, ensuring complete information coverage without requiring reprocessing of existing data.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS12073652B2Image data processing device and image data processing system
Publication Date: 2024.08.27 FUJIFILM CORP
  • US12073652B2 patent drawing
  • US12073652B2 patent drawing
  • US12073652B2 patent drawing

AI summary

An image data processing device and an image data processing system are provided. An image data processing device performs a process of inputting a plurality of image data items in which imaging ranges at least partially overlap, detecting a face of a person in an image indicated by the image data, and recognizing a personal attribute of the person on the basis of the detected face for each of the image data items, a process of generating map data, in which the recognized personal attribute has been recorded in association with a position of the person in the image indicated by the image data, for each of the image data items, a process of interpolating the personal attribute of the person who overlaps between a plurality of the map data items, and a process of combining the plurality of map data items after the interpolation to generate composite map data.