Six-Foot Robot State Planning With Monte Carlo Tree Search

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing robot state planning methods for six-foot robots result in front-back coupling, affecting their performance in complex terrains due to the influence of previous state planning on subsequent decisions.

Innovation Solution

A robot state planning method using a Monte Carlo tree search algorithm to plan the overall state sequence, starting from an initial state to a target state, avoiding front-back coupling by constructing and extending a Monte Carlo tree to determine a continuous state sequence.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If periodic state planning is used for six-foot robot motion cycles, then the planning process is simplified and can be executed in discrete steps, but front-back coupling occurs where previous state planning results negatively impact subsequent state planning decisions

Engineering Contradiction:
Improvestate planning processVSAvoidpassing capability in complex terrain
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent segments the state planning process into independent motion cycles, where each cycle plans only the next state without being influenced by previous cycles. This is achieved by resetting the planning horizon at each motion cycle boundary, effectively dividing the continuous planning problem into discrete, independent segments that avoid front-back coupling while maintaining planning simplicity

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary evaluation mechanism that assesses the quality of state sequences generated in each motion cycle. This intermediary layer filters out poor planning results before they can affect subsequent cycles, preventing the propagation of negative influences while allowing each cycle to maintain its independent planning process

Inventive Principle:
Principle #24Intermediary (Mediator)

2Power

If only the next state is planned in each motion cycle, then the computational load is reduced and real-time planning is feasible, but the overall state sequence optimization is limited due to Markov process constraints

Engineering Contradiction:
Improvecomputational capacityVSAvoidstate sequence optimization quality
Core Design Contradiction:
PowerVSProductivity

Solution Approach 1:

The patent performs preliminary evaluation of multiple possible next states before committing to a single state transition. By pre-assessing the quality of potential state sequences and selecting the optimal path in advance, the system achieves near-optimal sequence optimization without requiring computationally expensive real-time replanning of entire state sequences

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent maintains continuous optimization by carrying forward the evaluation criteria and partial results from one motion cycle to the next. Although each cycle plans independently, the cumulative effect of consistently applying the optimization criteria across cycles produces an overall optimized state sequence, effectively continuing the useful action of optimization without interruption

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS12370676B2Robot state planning method based on Monte Carlo tree search algorithm
Publication Date: 2025.07.29 HARBIN INST OF TECH
  • US12370676B2 patent drawing
  • US12370676B2 patent drawing
  • US12370676B2 patent drawing

AI summary

A robot state planning method based on a Monte Carlo tree search algorithm. The method comprises: obtaining an initial state and a target state of a robot (step 100); by using the initial state as a starting node, using a Monte Carlo tree search algorithm to expand a Monte Carlo tree until a generated target node reaches the target state (step 200); and determining a state sequence of the robot according to all nodes from the starting node to the target node (step 300). According to the solution, the overall state in the motion process is planned, and a state sequence is generated; thus, effect of front back coupling caused by planning according to periods can be avoided, and the passing capability of a six-foot robot in a complex terrain is improved.