Unlock instant, AI-driven research and patent intelligence for your innovation.

Remote video interaction system and method based on augmented reality

A remote video and augmented reality technology, applied in the field of remote video interaction, to achieve the effect of low communication cost, efficient solution of difficult problems, and high communication efficiency

Inactive Publication Date: 2019-09-20
苏芯物联技术(南京)有限公司
View PDF11 Cites 29 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0031] The present invention is aimed at the problems existing in the prior art, and provides a remote video interaction method and system based on augmented reality. , space positioning technology, a self-developed software method, adding an augmented reality module on the basis of traditional video communication, a method of contacting a single expert or multiple experts for remote video interaction, allowing users who request help to communicate with experts Two kinds of accurate circle marks on video objects on the mobile terminal, each circle is marked sequentially, and displayed simultaneously on the multi-person mobile terminal of both the initiator and the responder (s), which is convenient for fast and accurate description of the problem , locate the problem, greatly improve the success rate of remote interaction and reduce the communication cost of remote operation and maintenance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Remote video interaction system and method based on augmented reality
  • Remote video interaction system and method based on augmented reality
  • Remote video interaction system and method based on augmented reality

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0087] Embodiment 1: referring to Fig. 1, a kind of remote video interaction method based on augmented reality, described method comprises the following steps:

[0088] 1) AR marking method that integrates video and spatial positioning technology;

[0089] 2) A real-time multi-person video communication method that integrates AR markers;

[0090] 3) An asynchronous video message communication method that integrates AR tags;

[0091] Wherein, the AR marking method of the fusion video and space positioning technology, the specific steps are as follows:

[0092] The initiator (mobile terminal A) collects the current frame picture in real time from the camera;

[0093] Use analysis software or algorithms to analyze information such as contrast difference and color difference in the collected images, so as to calculate the feature points in the images. The algorithms can be Sift algorithm, Surf algorithm, etc.;

[0094] When the position and angle of the camera of mobile termina...

Embodiment 2

[0111] Example 2: see Figure 7 , Figure 8 , a remote video interactive system based on augmented reality, the system includes a personal module, a management module and an AR remote video interactive module, a personal module history record query and AR real-time remote video, when a user encounters a problem, he can first check the historical video Check the records to see if there are similar problems. If not, perform AR remote video interaction;

[0112] The management module includes historical record query and work order management. When users encounter problems, they can first check whether there are similar problems in the historical video records. If not, submit a work order to the enterprise, fill in the corresponding work order information, and send The service personnel of the enterprise seek AR remote video assistance. If the service personnel are online, start AR real-time remote video interaction; if the service personnel are not online, submit AR offline vid...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a remote video interaction method based on augmented reality and is applied to a mobile terminal (a mobile phone or a tablet computer) supporting augmented reality. Based on an AR image recognition method and a spatial positioning technology, an autonomously developed software method is provided. An augmented reality module is added on the basis of traditional video communication, a method for contacting a single expert or a multi-party expert to carry out remote video interaction is provided. Users and experts requesting help are allowed to carry out accurate circling marking on the video objects at the two mobile terminals; each circle picture is subjected to sequence marking and synchronously displayed on a multi-person mobile terminal of an initiator and a responder, so that problems are conveniently, quickly and accurately described and positioned, the success rate of remote interaction is greatly improved, and the communication cost of remote operation and maintenance is reduced.

Description

technical field [0001] The invention relates to an augmented reality-based remote video interaction system and method, and belongs to the technical field of remote video interaction. Background technique [0002] With the rapid development of Internet technology, remote interaction methods based on network technology are widely used in more and more fields. The processors of electronic devices such as mobile phones and computers continue to develop, making the application of augmented reality (Augmented Reality, AR) more and more accepted by people. Using augmented reality technology in the field of remote interaction is a new way of remote communication, communication, life and work. [0003] Augmented reality AR technology is a technology that overlays and displays computer-generated virtual information (text, pictures, 3D model animation, etc.) in the real world. It improves users' perception of the real world and changes the way users observe the world. Combined with t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04N7/14H04N7/15G06T19/00H04L29/06H04N5/76
CPCH04N7/14H04N7/15G06T19/006H04N5/76H04L65/65
Inventor 李波刘大圣陈非高卉聂兰顺杨松贵
Owner 苏芯物联技术(南京)有限公司