基于多视角视频监督的高保真度仿真环境建立系统及方法

By establishing a robotic arm training simulation environment through multi-view video supervision, and combining semantic segmentation and physical parameter updates, the problem of inaccurate simulation of physical properties of the simulation environment in existing technologies is solved, realizing the rapid establishment of a high-fidelity simulation environment and the high applicability of intelligent algorithms.

CN118596137BActive Publication Date: 2026-07-17娄浩哲

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
娄浩哲
Filing Date
2024-05-23
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Existing methods for establishing training simulation environments for robotic arms cannot accurately simulate the physical properties of real-world environments, resulting in poor applicability of trained intelligent algorithms in complex environments. Furthermore, existing methods are time-consuming or difficult to measure physical parameters.

Method used

A multi-view video supervision method is adopted, which records the movement process of the robotic arm through a camera array. Combined with semantic segmentation and physical parameter updates, a high-fidelity simulation environment is established, including RGB texture model, 3D mesh model and URDF file generation, and the physical parameters of the simulation environment are optimized.

Benefits of technology

It achieves a high-fidelity simulation environment that closely approximates the physical properties of the real environment, reducing setup costs and time, and improving the applicability of intelligent algorithms in complex environments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118596137B_ABST
    Figure CN118596137B_ABST
Patent Text Reader

Abstract

本发明公开了一种基于多视角视频监督的高保真度仿真环境建立系统及方法,系统包括相机阵列、机械臂、工作台、物体、机械臂控制器和终端处理器;方法为:通过多视角图像建立仿真环境,通过多视角视频监督机械臂在仿真环境中的运动,运动差异计算模块对多视角视频数据和仿真图像渲染模块输出的视频数据在同一时刻同一视角下的图像对比,得到仿真环境中机械臂各关节运动与真实环境中机械臂各关节运动的差异;物理参数更新模块根据运动差异计算模块输出的仿真环境中机械臂各关节运动差异对仿真机械臂各关节组成部分的物理参数更新,得到高保真度的机械臂训练仿真环境,解决了高保真度仿真环境建立中物理参数估计困难的问题,降低了人工和时间成本。
Need to check novelty before this filing date? Find Prior Art