Robot Camera Control Using SLAM for Target Object Focus

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The accuracy of object recognition in robotic systems depends on the quality of captured images, and existing technologies face challenges in focusing on specific subjects when multiple objects at different distances are present in the same image.

Innovation Solution

A control device that generates a map of the surroundings using sensor data from a moving object and controls a camera's focus and angle of view based on the positional relation between the object and the camera, ensuring the target object is in focus and appears large, utilizing simultaneous localization and mapping (SLAM) technology.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If a camera captures an image of multiple subjects at different distances, then the image contains information about all subjects, but the recognition accuracy decreases because it is difficult to identify which subject to focus on

Engineering Contradiction:
Improveinformation about multiple subjectsVSAvoidrecognition accuracy
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

The system performs preliminary actions by generating a map of the environment and identifying the target object before image capture. The control device uses sensor data to create a spatial map, determines which object is the target, and then controls the camera to focus on that specific target. This preliminary identification and positioning enables the camera to capture images with the target in focus, thereby maintaining high recognition accuracy while preserving information about multiple subjects in the scene.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If the camera focuses on a distant target object, then the target object appears larger and clearer, but nearby objects become out of focus and less visible

Engineering Contradiction:
Improvefocus accuracy of target objectVSAvoidvisibility of nearby objects
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The system applies local quality by optimizing the image capture parameters specifically for the target object's location and characteristics. Based on the map information and target object position, the control device adjusts the camera's focus distance and angle of view to ensure the target object is captured with high clarity and appropriate size. This localized optimization for the target object enables precise focus and clear imaging of the distant target while accepting that nearby objects may be out of focus, as they are not the primary subject of interest.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11303799B2Control device and control method
Publication Date: 2022.04.12 SONY GROUP CORP
  • US11303799B2 patent drawing
  • US11303799B2 patent drawing
  • US11303799B2 patent drawing

AI summary

The present technology relates to a control device, a control method, and a program that enable capturing an image suitable for use in image processing such as recognition of a target object. A control device according to an embodiment of the present technology generates a map including a target object existing around a moving object on the basis of output from a sensor provided on the moving object, and controls drive of a camera provided on the moving object that captures an image of the target object on the basis of a relation between a position of the target object and position of the moving object on the map. The present technology can be applied to a robot capable of acting autonomously.