Robot Camera and Hand Cleanliness Detection by Image Comparison

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current robot devices fail to distinguish between dirt and scratches on camera lenses and hands, leading to inefficient operation and potential contamination of objects being grasped.

Innovation Solution

A robot device equipped with a camera and a hand, utilizing a controller that compares images to determine the presence and location of dirt or scratches by obtaining reference images and detection images, and adjusts accordingly to clean the lens or hand.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Duration of action of stationary object

If robot device operates with dirty lens or hand, then operational continuity is maintained, but object recognition accuracy deteriorates

Engineering Contradiction:
Improveoperational continuityVSAvoidobject recognition accuracy
Core Design Contradiction:
Duration of action of stationary objectVSMeasurement precision

Solution Approach 1:

The patent implements self-service by enabling the robot to automatically detect and identify dirt and scratches on its own camera lens and hand without external intervention. The system uses its own imaging capabilities to perform self-diagnosis, comparing images taken at different hand positions to locate and classify contaminants. This allows the robot to maintain operational awareness and potentially trigger cleaning routines, ensuring continuous operation with maintained recognition accuracy.

Inventive Principle:
Principle #25Self-service

2Measurement precision

If robot device continuously monitors for dirt, then detection accuracy is improved, but system complexity increases

Engineering Contradiction:
Improvedirt detection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses copying by creating multiple copies of images taken at different hand positions and comparing these copies to identify dirt and scratches. Instead of requiring complex real-time analysis, the system captures multiple image copies, aligns them, and compares pixel differences to locate contaminants. This approach simplifies the detection system by using redundant image data rather than complex sensing mechanisms.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11014245B2Robot device, method of controlling robot device, computer program, and program storage medium
Publication Date: 2021.05.25 SONY GROUP CORP
  • US11014245B2 patent drawing
  • US11014245B2 patent drawing
  • US11014245B2 patent drawing

AI summary

Provided is an excellent robot device capable of preferably detecting difference between dirt and a scratch on a lens of a camera and difference between dirt and a scratch on a hand. A robot device detects a site in which there is the dirt or the scratch using an image of the hand taken by a camera as a reference image. Further, this determines whether the detected dirt or scratch is due to the lens of the camera or the hand by moving the hand. The robot device performs cleaning work assuming that the dirt is detected, and then this detects the difference between the dirt and the scratch depending on whether the dirt is removed.