RGBD Stair-Climbing Control for Humanoid Robot Posture Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Humanoid robots face challenges in climbing stairs due to inconsistent stair heights and turns, which affect their mobility safety, as existing technologies are primarily developed for wheeled robots and lack the necessary stability and adaptability for humanoid robots.

Innovation Solution

A robot climbing control method using an RGBD camera to obtain RGB and depth images, extract the outline of the target step, determine relative position information, and adjust posture and direction to safely climb stairs of varying sizes and non-standardized structures, employing grayscale processing, image segmentation, and coordinate systems for accurate positioning.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Stability of the object's composition

If the robot uses a standardized stair climbing approach suitable for wheeled robots, then the robot can maintain stable posture and simplify control, but the robot cannot adapt to inconsistent stair heights and turns, affecting mobile safety

Engineering Contradiction:
Improveposture stabilityVSAvoidadaptability to varying stair configurations
Core Design Contradiction:
Stability of the object's compositionVSAdaptability or versatility

Solution Approach 1:

The robot dynamically adjusts its posture and movement parameters based on real-time detection of stair characteristics. The control system modifies climbing parameters adaptively according to detected stair height, width, and configuration variations, enabling stable operation on non-standardized stairs while maintaining posture stability.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system employs real-time feedback from depth cameras and sensors to detect stair geometry and continuously adjust climbing parameters. The control method processes detected stair information and modifies robot posture and movement in response to actual stair conditions, resolving the contradiction between stability and adaptability.

Inventive Principle:
Principle #23Feedback

2Adaptability or versatility

If the robot detects and processes detailed stair information in real-time, then the robot can adapt to non-standardized stairs, but the processing time and computational complexity increase

Engineering Contradiction:
Improveadaptability to non-standardized stairsVSAvoidprocessing time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system performs preliminary detection of stair characteristics before the robot begins climbing. By advance detection and pre-computation of climbing parameters based on detected stair geometry, the system prepares adjustment strategies in advance, reducing real-time processing requirements and enabling faster response during actual climbing.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The stair detection and processing is divided into distinct stages: initial detection, parameter extraction, and real-time adjustment. This segmentation allows complex processing to be distributed across different time points, reducing instantaneous computational burden while maintaining comprehensive adaptability.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11631192B2Robot climbing control method and device and storage medium and robot
Publication Date: 2023.04.18 UBTECH ROBOTICS CORP LTD
  • US11631192B2 patent drawing
  • US11631192B2 patent drawing
  • US11631192B2 patent drawing

AI summary

A robot climbing control method is disclosed. The method obtains an RGB color image and a depth image of stairs, extracts an outline of a target object of a target step on the stairs from the RGB color image, determines relative position information of the robot and the target step according to the depth image and the outline of the target object, and controls the robot to climb the target step according to the relative position information. The embodiment of the present disclosure allows the robot to effectively adjust postures and forward directions on any size of and non-standardized stairs and avoids the deviation of the walking direction, thereby improving the effectiveness and safety of the stair climbing of the robot.