Interactive remote expert cooperation maintenance system and method based on augmented reality technology

A remote service and testing technology, applied in general control systems, CCTV systems, control/regulation systems, etc., can solve problems such as increasing product maintenance time and increasing service provider operating costs.

Active Publication Date: 2017-01-18
山东万腾电子科技有限公司
View PDF3 Cites 70 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When there is a problem with the aircraft, special experts must arrive at the scene for inspection and maintenance, which not only increases the time for product maintenance, but also greatly increases the operating cost of the service provider

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Interactive remote expert cooperation maintenance system and method based on augmented reality technology
  • Interactive remote expert cooperation maintenance system and method based on augmented reality technology
  • Interactive remote expert cooperation maintenance system and method based on augmented reality technology

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0097] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0098] Such as figure 1 as shown, figure 1 It is a schematic diagram of the structure of the algorithm. First, the position of the target must be obtained, that is, the target is delineated in the first frame of the video tracking process. With the continuous input of the video stream, the detector continuously detects the target, and the tracker continuously tracks the target. Through learning, the The accuracy of the detector is getting higher and higher, and finally the results of the tracker and the detector are fused to obtain the position of the target.

[0099] Such as figure 2 As shown, the remote expert collaborative maintenance system includes an on-site client and a remote server, and the on-site client and the remote server perform data communication through a wireless network.

[0100] The on-site client includes a camera, an AR process...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an interactive remote expert cooperation maintenance system and a method based on an augmented reality technology. An on-site client side carries out video acquisition or image shooting on equipment to be detected and maintained, and transmits to a remote server side; the remote server side receives a video or an image sent by the on-site client side, receives drawing processing on the video or the image carried out by an expert, and sends the drawn target area image to the on-site client side; after receiving the drawn target area image, the on-site client side completes recognition, location and tracking of a target area in the target area image and an on-site video image through an object tracking algorithm; a detector finds out the target area image; a tracker tracks a target; the detection accuracy of the detector is improved continually through P-N Learning; a marked pattern or a text comment, and current equipment state information are overlapped at the position of the target area in the on-site video image, and an augmented reality image video is generated; the augmented reality technology is utilized to synthesize the augmented reality video, and the fault diagnosis and the maintenance of on-site equipment are completed with the cooperation of the expert.

Description

technical field [0001] The invention relates to an interactive remote expert collaborative maintenance system and method based on augmented reality technology. Background technique [0002] Augmented Reality technology (Augmented Reality, referred to as AR) increases users' perception of the real world through the information provided by the computer system, applies virtual information to the real world, and superimposes computer-generated virtual objects, scenes or system prompts on the real scene , so as to achieve the effect of enhancing reality. The goal of this technology is to embed the virtual world on the screen and interact with the real world. At present, the relatively mature product using AR technology is the Hololens glasses of Microsoft Corporation in the United States, but Hololens only supports the superimposition of computer-generated effects on the real world for a single user to view or interact with, but cannot realize multiple AR technology. interactio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01H04N7/18G05B23/02
CPCG05B23/0275G06F3/011G06F2203/012H04N7/18
Inventor 张镇朱春健张国栋张燕梁波
Owner 山东万腾电子科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap