Display Control Unit for Event-Linked Frame Image Association

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional digital monitoring systems struggle to accurately confirm the occurrence of events, such as a person misplacing an object, when the detection time differs from the event time, making it difficult for users to identify the responsible individual.

Innovation Solution

An image pickup apparatus and information processing system that includes an object detection unit, event detection unit, and transmission unit to associate frame images with object information, event information, and time information, allowing for the determination and display of event occurrence times.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional event detection methods are used, then event detection capability is provided, but the ability to confirm event occurrence at the correct time is lost when detection time differs from event time

Engineering Contradiction:
Improveevent occurrence time identificationVSAvoidgap between event time and detection time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by continuously capturing and storing frame images with their associated time information before the event detection moment. When an event is detected, the system can immediately retrieve the pre-captured frame image corresponding to the event occurrence time, eliminating the need to wait for detection and ensuring accurate temporal correspondence between the event and its visual record.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates a copy of the frame image at the event occurrence time and associates it with the detected event. This copying mechanism allows the system to preserve and display the exact visual state at the moment the event occurred, even if the detection happens later, thereby maintaining measurement precision of the event occurrence time.

Inventive Principle:
Principle #26Copying

2Ease of operation

If only current video display is provided, then real-time monitoring is achieved, but the ability to identify responsible individuals for past events is lost

Engineering Contradiction:
Improveuser ability to identify responsible individualVSAvoidinformation about event occurrence context
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The system provides feedback by displaying the frame image captured at the event occurrence time when an event is detected. This feedback mechanism allows users to visually confirm the context of the event, including the responsible individual's appearance and actions, thereby preventing information loss and improving ease of operation for identifying responsible persons.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary capture and storage of frame images with time information before event detection. This preliminary action ensures that when an event is detected later, the corresponding visual information is already available for display, enabling users to identify responsible individuals without losing contextual information about the event.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If event detection is performed after the person leaves the scene, then detection accuracy is maintained, but user confirmation of the event is impossible

Engineering Contradiction:
Improveevent detection accuracyVSAvoidvisual information of event occurrence
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The system creates and preserves a copy of the frame image at the event occurrence time, associating it with the detected event. This copying allows the system to maintain detection reliability by using automated analysis while simultaneously preserving visual information for user confirmation, even when the person has left the scene by the time of detection.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system performs preliminary capture and storage of frame images with their time information before the event detection moment. This preliminary action ensures that visual information is preserved even when detection occurs later, allowing users to confirm events accurately without compromising detection reliability.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9679202B2Information processing apparatus with display control unit configured to display on a display apparatus a frame image, and corresponding information processing method, and medium
Publication Date: 2017.06.13 CANON KK
  • US9679202B2 patent drawing
  • US9679202B2 patent drawing
  • US9679202B2 patent drawing

AI summary

An information processing apparatus includes: an object detection unit to detect an object included in a frame image based on a feature amount of the frame image, and generate and output object information concerning the detected object; an event detection unit to detect an event of the object based on the object information output by the object detection unit, and generate and output event concern information concerning the detected event of the object; and a transmission unit to transmit the frame image, the event concern information, concerning the frame image, output by the event detection unit, and time information concerning the frame image, as associating them with others. Thus, even in a case where event detection timing and event occurrence timing are different from each other, it is possible to perform a display by which a user can easily confirm the event.