Expert remote guidance system and implementation method based on hololens glasses

An implementation method and expert technology, applied in the input/output process of data processing, input/output of user/computer interaction, voice analysis, etc., can solve the problems that technicians cannot view data, information cannot be located, and troubleshooting process cannot be recorded. , to achieve the effects of enhancing interactivity, facilitating future tracking, and improving maintenance efficiency

Inactive Publication Date: 2018-06-15
CHINA COMM TECH NANJING
View PDF6 Cites 39 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This invention can realize dynamic interaction between engineers and technicians on the screen. It can only realize video and voice interaction and remote marki

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Expert remote guidance system and implementation method based on hololens glasses
  • Expert remote guidance system and implementation method based on hololens glasses
  • Expert remote guidance system and implementation method based on hololens glasses

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments.

[0030] Such as figure 1 As shown, an expert remote guidance implementation method based on hololens glasses includes the following steps:

[0031] (1) On-site maintenance personnel wear hololens smart glasses, and the hololens smart glasses are connected to the wireless router WiFi;

[0032] (2) Use the camera on the hololens smart glasses to collect the current maintenance scene, and use the microphone on the hololens smart glasses to collect the on-site sound;

[0033] (3) Process the collected video through the CPU, encode it with H264, and convert it into an audio and video stream in mp4 format. Hololens smart glasses transmit the audio and video stream to the wireless router through the wifi module, and the wireless router forwards the data to the server;

[0034] (4) After the server receives the audio and video stream, it sends the aud...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention discloses an expert remote guidance system and implementation method based on hololens glasses. The system comprises hololens smart glasses, a wireless router, a server and a terminal device. The hololens smart glasses forward the collected audio and video to the terminal device through the server; the experts input guidance content on the terminal device; the terminal devicerecords the guidance content, and forwards the guidance content to the hololens smart glasses through the server; the guidance content is displayed in the field of view; the expert guidance voice isplayed through a speaker; and a background terminal automatically generates a maintenance record video file and uploads the maintenance record video file to the server. According to the technical scheme of the present invention, remotely annotated information can be accurately located on the spatial position, so that the expert remote guidance can be more vivid, and both the inspection efficiencyand the inspection accuracy can be improved; the user can interact with the hololens glasses through voice, gesture, and the like, so that the hands are liberated; and the maintenance record can be saved, so that future tracking can be facilitated.

Description

technical field [0001] The invention relates to the technical field of AR equipment maintenance, in particular to an expert remote guidance system based on hololens glasses and an implementation method. Background technique [0002] At present, more and more AR devices are being used. The existing AR glasses are not perfect in terms of three-dimensional overlay display, image space positioning and operation control. In addition, the interaction method is relatively simple. A Chinese invention patent for a method and device for remotely guiding on-site troubleshooting using AR (application publication number: CN107277451A), which discloses its AR glasses, a camera installed on the AR glasses, a CPU module, a wireless communication module, and a camera interface , video interface, and remote terminal control system, wherein the CPU module, wireless communication module, video interface, and camera interface are integrated in a control box and installed on the AR glasses; the C...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G10L15/22
CPCG06F3/011G06F3/017G10L15/22
Inventor 陈康康张学斌吕晨辉王君郭权包振华
Owner CHINA COMM TECH NANJING
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap