Dual-Frame Object Detection Display for Label Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing devices face difficulties in accurately checking the detection results of multiple objects within a single picture image, particularly when objects are overlapping or adjacent, and correcting labels is cumbersome due to the complexity of correspondence between buttons, checkboxes, and detection results.

Innovation Solution

An image processing device with a detection result display unit that graphically superimposes detection results on both the entire input picture image and partial images, using a dual-frame system where the first frame displays the entire image and the second frame lists partial images, allowing for easy correction of labels without selecting objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If multiple objects are detected from a single picture image using conventional methods, then the detection capability is improved, but it becomes difficult to check the validity of detection results when objects are overlapping or adjacent

Engineering Contradiction:
Improvenumber of detected objectsVSAvoiddetection result accuracy
Core Design Contradiction:
Quantity of substanceVSMeasurement precision

Solution Approach 1:

The display screen is divided into a first display area showing the entire picture image and a second display area showing enlarged images of individual detected objects. This segmentation allows operators to view both the overall detection results and detailed object information simultaneously, resolving the contradiction between detecting multiple objects and verifying their accuracy.

Inventive Principle:
Principle #1Segmentation

2Device complexity

If conventional display methods are used for detection results, then the system structure is simple, but it is troublesome to correct labels due to complexity of correspondence between buttons, checkboxes, and detection results

Engineering Contradiction:
Improvedisplay system structureVSAvoidlabel correction operation
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The second display area acts as an intermediary between the detection results and the label correction interface. By displaying enlarged images of detected objects with their corresponding labels directly visible, operators can easily identify which object needs correction without having to trace complex correspondences between buttons, checkboxes, and detection results.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates a copy of the detected object image in the second display area, showing it in an enlarged format with its detection result and label. This copied view provides a clear, simplified interface for label correction without requiring operators to navigate complex original interface elements.

Inventive Principle:
Principle #26Copying

3Area of stationary object

If all detected objects are displayed in a single view, then the overview is maintained, but detailed checking of individual objects becomes difficult

Engineering Contradiction:
Improvedisplay area utilizationVSAvoidobject detail verification
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The system transitions from a two-dimensional display by adding a spatial dimension through the second display area that shows enlarged individual objects. This dimensional expansion allows operators to simultaneously maintain an overview of all detected objects in the first display area while examining detailed information of specific objects in the second display area.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS10930037B2Image processing device for displaying object detected from input picture image
Publication Date: 2021.02.23 FANUC LTD
  • US10930037B2 patent drawing
  • US10930037B2 patent drawing
  • US10930037B2 patent drawing

AI summary

An image processing device including an object detection unit for detecting one or more images of objects from an input picture image, on the basis of a model pattern of the object, and a detection result display unit for graphically superimposing and displaying a detection result. The detection result display unit includes a first frame for displaying the entire input picture image and a second frame for listing and displaying one or more partial picture images each including an image detected. In the input picture image displayed in the first frame, a detection result is superimposed and displayed on all the detected images, and in the partial picture image displayed in the second frame, a detection result of an image corresponding to each partial picture image is superimposed and displayed.