Remote monitoring and control system based on augmented reality

An augmented reality and remote monitoring technology, applied in manufacturing tools, instruments, design optimization/simulation, etc., can solve problems such as inability to meet remote path planning, and achieve the effect of improving control accuracy

Active Publication Date: 2018-08-21
烟台朗文汽车零部件有限公司
View PDF11 Cites 31 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This technical solution is an on-site path planning method for equipment, which cannot meet the current needs of remote path planning for enterprises

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Remote monitoring and control system based on augmented reality
  • Remote monitoring and control system based on augmented reality
  • Remote monitoring and control system based on augmented reality

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0036] See figure 1 with figure 2 , A remote monitoring and control system based on augmented reality, including an interactive simulation control mode, which uses a server and a mobile robot located in the remote device and environment to complete the local path planning of the remote operation of the manipulator 2 in a virtual and real way And simulation, specifically:

[0037] The mobile robot includes a robot body 1, and a manipulator 2 and an RGBD camera 3 arranged on the robot body 1;

[0038] The server includes a remote environment reconstruction module 40, a manipulator operation simulation module 50, and an augmented reality display module 60; the remote environment reconstruction module 40 receives the depth images taken by the RGBD camera 3 and captures depth images from different angles. Image synthesis scene three-dimensional point cloud model, the manipulator operation simulation module 50 establishes a manipulator simulation model, and then combines the scene three...

Embodiment 2

[0055] See figure 1 with image 3 The difference between this embodiment and the first embodiment is that the second embodiment can execute the monitoring mode while executing the interactive simulation control mode, and the interactive simulation mode will not be described again.

[0056] The monitoring mode completes the fusion display of monitoring data and monitoring images through the remote data acquisition system located in the remote equipment and the environment, the server and the mobile robot, and the combination of virtual and real. The monitoring images can be pictures and / Or video. specifically:

[0057] The remote data collection system includes an industrial computer 100 and a sensor 200, each of the sensors 200 is connected to the industrial computer 100, each monitoring object is provided with the sensor 200, and each sensor 200 is correspondingly provided with a tag 300; The label 300 includes asymmetrical labels 300 such as QR codes and barcodes;

[0058] The ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a remote monitoring and control system based on augmented reality. The remote monitoring and control system comprises an interactive simulation control mode and a monitoring mode; in the interactive simulation mode, a server receives depth images shot by an RGBD camera on a moving robot, and the depth images shot in the different angles are synthesized into a scene three-dimensional point cloud module; a mechanical hand simulation module is operated according to the scene three-dimensional point cloud module, a path is planned, the mechanical hand simulation module isdriven to move through the path, finally, the dynamic mechanical hand simulation module is overlapped in color images shot by the RGBD camera, and analog display and path planning with the virtualityand reality being combined are achieved; and in the monitoring mode, monitoring data are collected through a remote data collecting system, monitored images of a monitored object are obtained throughmoving robot routing inspection, through the monitoring data obtained through the server, monitoring data overlapping display is achieved, and the display interface is more intuitive.

Description

Technical field [0001] The invention relates to a remote monitoring and control system based on augmented reality, belonging to the field of intelligent manufacturing and computer measurement and control. Background technique [0002] Currently, remote monitoring and control have been widely used in production. However, in terms of monitoring, the current monitoring system displays the monitoring video and monitoring data separately. The monitoring personnel need to associate the video content with the monitoring data by themselves, and the interface is not intuitive enough. In addition, in terms of control, the controller can only estimate the three-dimensional information of the remote environment through the color image, plan the path of the manipulator, and control the remote manipulator to complete the operation in this way, which will cause the robot control to be inaccurate. [0003] The invention patent "CN106863303A" with the publication number CN106863303A, its specific t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): B25J13/00B25J19/04G06F17/50G06T17/00
CPCB25J13/006B25J19/04G06F30/20G06T17/00
Inventor 陈成军于浩信寄遥王天诺
Owner 烟台朗文汽车零部件有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap