Image Processing Area Setting with Robot Movable Range Display

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing systems for robots often fail to efficiently set an image processing area due to limitations in the robot's movable range, preventing accurate positioning and operation of the robot for tasks like gripping, even after image processing has detected the work's position and posture.

Innovation Solution

An image processing device that acquires captured images, displays a setting screen to allow users to set an image processing area, and acquires movable range information to identify the robot's operational limitations, enabling users to set the image processing area within the robot's movable range.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the image processing area is set without considering the robot's movable range, then the image processing can detect the work's position and posture, but the robot cannot move to the detected position because it is outside the movable range

Engineering Contradiction:
Improvework position detection accuracyVSAvoidrobot operation reliability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system performs preliminary action by displaying the robot's movable range on the setting screen before the user sets the image processing area. This allows the user to anticipate and avoid setting areas that would result in positions outside the robot's movable range, preventing operation failures before they occur.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The setting screen acts as an intermediary between the image processing system and the robot control system. It provides movable range information to the user, enabling informed decisions about image processing area configuration that account for robot capabilities.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If the user sets the image processing area without movable range information, then the setting process is simple, but the robot may be unable to perform operations due to limited movable range

Engineering Contradiction:
Improveimage processing area setting easeVSAvoidrobot operational adaptability
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The system provides movable range information in advance on the setting screen, enabling users to configure the image processing area with awareness of robot limitations. This maintains ease of operation while improving adaptability through informed decision-making.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The setting screen provides visual feedback about the robot's movable range, allowing users to adjust their settings accordingly. This feedback mechanism ensures that the configured image processing area corresponds to positions the robot can actually reach.

Inventive Principle:
Principle #23Feedback

3Productivity

If the image processing area covers the entire image, then all works can be detected, but the processing time increases due to larger processing area

Engineering Contradiction:
Improvework detection coverageVSAvoidimage processing time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system applies local quality by allowing the user to set a specific image processing area within the captured image based on the robot's movable range. This concentrates processing resources on the relevant local area rather than processing the entire image, reducing processing time while maintaining detection coverage for all reachable works.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11590657B2Image processing device, control method thereof, and program storage medium
Publication Date: 2023.02.28 CANON KK
  • US11590657B2 patent drawing
  • US11590657B2 patent drawing
  • US11590657B2 patent drawing

AI summary

The image processing device according to the invention includes: a first acquisition unit to acquire a captured image; a display control unit to display a setting screen to allow to user to set an image processing area, which is an area where predetermine image processing is performed, in the image acquired by the first acquisition unit on a display device; and a second acquisition unit configured to acquire movable range information indicating a movable range of a working device, operations of which are controlled on the basis of a result of the predetermined image processing. The display control unit controls the display of the setting screen so as to cause the user to identify a range in which the working device is not able to operate in the image, on the basis of the movable range information acquired by the second acquisition unit.