Privacy-Preserving Heat Map Generation via Background Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing moving information analysis systems fail to generate accurate heat maps when the layout of a store changes, as they require an updated floor plan to match the new camera image, compromising privacy and accuracy.

Innovation Solution

A moving information analyzing system that includes a camera and server, where the camera captures images, generates background images at predetermined times, extracts moving information, and transmits it to the server to create an updated moving information analysis image with superimposed data, ensuring privacy protection by removing individuals from the background.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a heat map image is generated by superimposing moving information on a floor plan, then the level of activity can be analyzed, but the floor plan must be updated when the layout changes, compromising privacy and increasing complexity

Engineering Contradiction:
Improveaccuracy of heat map imageVSAvoidcomplexity of system update
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts the moving information (staying and passing information) from the captured image and separates it from the background image. The background image is updated independently when layout changes occur, while the moving information is overlaid to create the heat map. This extraction allows the system to maintain accuracy without requiring complete system reconfiguration when layouts change.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system performs preliminary actions by capturing images and extracting moving information before the actual heat map generation. The background image is prepared and updated in advance when layout changes are detected, so that when the heat map needs to be generated, all necessary components are ready. This preliminary preparation eliminates the need for real-time system reconfiguration.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If a captured image is used as the base for heat map image, then the layout changes are automatically reflected, but the privacy of persons shown in the image is not protected

Engineering Contradiction:
Improveadaptability to layout changesVSAvoidprivacy violation
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The patent extracts the moving information (staying and passing information) from the captured image and separates it from the background image. The background image is updated independently when layout changes occur, while the moving information is overlaid to create the heat map. This extraction allows the system to maintain accuracy without requiring complete system reconfiguration when layouts change.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system creates a copy of the background image without the moving objects, then overlays the extracted moving information as heat map data. This copying process allows the system to maintain the layout information while removing the actual persons from the display, thus protecting privacy while preserving adaptability to layout changes.

Inventive Principle:
Principle #26Copying

3Ease of operation

If the floor plan is kept invariant, then the system is simple to operate, but the heat map image becomes inaccurate when the layout changes

Engineering Contradiction:
Improveease of system operationVSAvoidaccuracy of heat map image
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent implements dynamics by allowing the background image to be updated when layout changes are detected, while maintaining the heat map generation process. The system dynamically adapts to layout changes by updating the background image and re-extracting moving information, ensuring continuous accuracy without requiring complete system reconfiguration. This dynamic approach balances ease of operation with measurement precision.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system employs feedback mechanisms to detect layout changes and automatically trigger updates to the background image and heat map generation process. When changes are detected, the system feedbacks by updating the background image and reprocessing the moving information, ensuring the heat map remains accurate while maintaining operational simplicity through automation.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP3163872B1Flow line analysis system, camera device, and flow line analysis method
Publication Date: 2020.01.01 PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
  • EP3163872B1 patent drawingFigure 1
  • EP3163872B1 patent drawingFigure 2
  • EP3163872B1 patent drawingFigure 3

AI summary

The present invention relates to a moving information analyzing system in which a camera and a server are connected to each other. The camera includes an imaging section that captures an image of a predetermined imaging region, a background image generating section that repeatedly generates a background image of a captured image of the imaging region at predetermined timings, a moving information analyzing section that extracts moving information regarding a staying position or a passing position in the imaging region of a moving object included in the captured image, and a transmitter that transmits the background image generated by the background image generating section and the moving information of the moving object extracted by the moving information analyzing section to the server at a predetermined transmission cycle. The server includes an image generating section that generates a moving information analysis image in which the moving information of the moving object is superimposed on the background image of the captured image, and a display control section that displays the moving information analysis image generated by the image generating section on a display unit.