Intelligent robotic controller executing gen-ai generated tasks plans with task failure detection and handling

Abstract

A method and system for intelligent robotic controller with task failure detection and handling via a multi-level failure handler is disclosed. A validated task plan received from a task planning framework is analyzed to extract set of skills for execution of the task plan. Each skill comprising atomic skills or compound skills. For the set of skills, set of provisioned skill specific behavior tree (BT) nodes are loaded from a set of skill ledgers from a skill library defining execution of the extracted set of skills. BT train is created for the set of skills based on the set of skill ledgers and the set of provisioned skill specific BT nodes. Failure event is detected and handled by multi-level failure handler and replanning of task is routed to robotic controller or task planning framework based on detected failure mapping to the set of preconfigured failures and a failure handling capability. 20 26 20 22 98 25 M ar 2 02 6 2 0 2 6 2 0 2 2 9 8 2 5 M a r 2 0 2 6 2 0 2 6 2 0 2 2 9 8 2 5 M a r 2 0 2 6 2 / 11 FIG. 1B 2 / 11 Work Cell 100 Skill 1 General Perception (Vision Foundational Models) Scene (Vision Data) Robot States Skill 2 Validated Plan Text UI 106A Instruction Task Planning framework 110A (Human Robotic Robot ASR Domain Skill 3 + Controller Specific Planning Validator Interface) 112 Text Architecture Re-Plan ? Prompt Skill 4 Text Instruction Task execution Progress update Other ( Image Data, Object Poses, Skill N Plan, Response( Plan Data, Text ) Compound Steps Status ) Skills 20 26 20 22 98 25 M ar 2 02 6 2 / 1 1 2 0 2 6 2 0 2 2 9 8 2 5 M a r 2 0 2 6 1 0 0 " I I I I I I I R o b o t A S R D o m a i n + F I G . 1 B 2 / 1 1 2 0 2 6 2 0 2 2 9 8 2 5 M a r 2 0 2 6 1 0 0 " I I I I I I I R o b o t + F I G . 1 B

Images