Robot Object Posture Correction for Accessible Handover

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing robot devices struggle to autonomously arrange objects in optimal positions and postures for users, particularly those with disabilities, as they do not consider the surrounding environment or the user's ease of use when placing or handing over objects.

Innovation Solution

A robot device equipped with an environment map, image input unit, target object detection, object position and posture detection, and an object posture correction unit, which learns and retains optimal postures for each environment, allowing for autonomous arrangement and correction of object positions and postures to facilitate user accessibility.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If robot devices place objects in empty spaces without considering optimal position or posture, then the robot can complete the task of storing objects, but the objects are not arranged in a comfortable or accessible manner for users

Engineering Contradiction:
Improveuser accessibility to objectsVSAvoidrobot control system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The robot performs preliminary analysis of the empty space characteristics (size, shape, location) before placing objects. The control unit pre-determines the optimal position and posture within the empty space based on object characteristics and user accessibility requirements, rather than simply placing objects anywhere available.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses image recognition to detect object positions and postures, then compares them against optimal configurations. The control unit adjusts object placement based on this feedback loop, continuously improving placement quality by considering both space constraints and user accessibility needs.

Inventive Principle:
Principle #23Feedback

2Ease of operation

If robot devices hand over objects without considering optimal posture, then the handover task is completed, but the user cannot easily hold or use the object

Engineering Contradiction:
Improveease of object handling for userVSAvoidtime for posture adjustment
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The robot determines the optimal handover posture in advance based on object characteristics and user needs. The control unit prepares the object in the correct orientation before the handover action, eliminating the need for post-handover adjustment and saving time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system autonomously determines and executes optimal handover postures without requiring user guidance or correction. The control unit independently analyzes object properties and selects the most suitable handover configuration, making the robot self-sufficient in providing useful handovers.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If robot devices use simple object placement without environmental consideration, then the placement process is quick, but the arrangement does not create a comfortable environment for users

Engineering Contradiction:
Improveadaptation to surrounding environmentVSAvoidobject placement speed
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The robot analyzes the specific characteristics of each empty space location (size, shape, proximity to user, surrounding objects) and determines placement strategies tailored to each location's unique properties. Different regions of the environment receive different placement treatments based on their local characteristics.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The control unit varies placement parameters (position coordinates, object orientation angles, depth within space) based on environmental analysis. The system dynamically adjusts these parameters to optimize both the comfort of the arranged environment and the efficiency of the placement process.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11345041B2Robot device, method of controlling the same, computer program, and robot system
Publication Date: 2022.05.31 SONY GROUP CORP
  • US11345041B2 patent drawing
  • US11345041B2 patent drawing
  • US11345041B2 patent drawing

AI summary

Provided is a robot device including an image input unit for inputting an image of surroundings, a target object detection unit for detecting an object from the input image, an object position detection unit for detecting a position of the object, an environment information acquisition unit for acquiring surrounding environment information of the position of the object, an optimum posture acquisition unit for acquiring an optimum posture corresponding to the surrounding environment information for the object, an object posture detection unit for detecting a current posture of the object from the input image, an object posture comparison unit for comparing the current posture of the object to the optimum posture of the object, and an object posture correction unit for correcting the posture of the object when the object posture comparison unit determines that there is a predetermined difference or more between the current posture and the optimum posture.