The invention relates to an integrated control method for a
chassis and a mechanical arm of a
mobile robot in an unstructured environment, and belongs to the technical field of
robot control, and the method comprises the following steps: S1, obtaining an
RGB image, a depth image, the angle of each joint of the mechanical arm and the motion posture of the
chassis; s2, extracting multi-
modal features of vision, geometry and state, aligning the multi-
modal features, and fusing the aligned multi-
modal features to obtain fused features; s3, performing action sequence decoding on the fusion features by using an action
sequence prediction network to generate a future multi-step coordination action sequence; s4, when the
tail end is close to the target, the optimal grabbing
pose is estimated, the angles of all joints of the mechanical arm are calculated through
inverse kinematics, and the angles are embedded into the cooperative action sequence; and S5, the action sequence is smoothed, and a stable
chassis and mechanical arm control instruction is output. The grabbing precision when the chassis inclines in a field scene can be improved, and the
terrain adaptability of the
robot is improved.