Method and system for interacting with Internet of things equipment through AR camera of robot

A technology of IoT devices and interaction methods, applied in transmission systems, closed-circuit television systems, instruments, etc., can solve the problem of inability to achieve real-time interaction of robotic IoT devices, cumbersome operations, and inability to present basic information of IoT devices to monitoring personnel. Face and other problems, to achieve the effect of flexible real-time interaction process, reducing monitoring dead ends, and reducing equipment performance requirements

Active Publication Date: 2018-12-07
广州高新兴机器人有限公司
View PDF7 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, this solution has limitations, that is, a robot can only realize the functions of a robot itself, and the robot is just a collection of movable cameras and sensors, and it is impossible for the robot to achieve static monitoring, Real-time interaction of IoT devices such as sensors and security devices, and the various basic information of IoT devices cannot be presented in front of monitoring personnel more accurately and vividly. Monitoring personnel can control and operate IoT devices through monitoring centers or APPs more cumbersome

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for interacting with Internet of things equipment through AR camera of robot
  • Method and system for interacting with Internet of things equipment through AR camera of robot
  • Method and system for interacting with Internet of things equipment through AR camera of robot

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0065] Such as figure 1 As shown, Embodiment 1 provides a method for interacting with an IoT device through a robot AR camera, including the following steps:

[0066] S1. The robot shoots real-time video through its AR camera, and obtains the relative position of the AR camera and the IoT device, calculates the position information of the IoT device in the real-time video according to the relative position of the AR camera and the IoT device, and combines the real-time video and The location information is sent to the monitoring terminal;

[0067] S2. The monitoring terminal acquires the basic information of the IoT device and superimposes the obtained basic information in the form of a label on the corresponding position of the IoT device in the real-time video according to the received location information;

[0068] S3. The monitoring personnel operate the IoT device by clicking on the label on the monitoring terminal.

[0069] In the specific implementation, the robot mov...

Embodiment 2

[0089] On the basis of Embodiment 1, the basic information of the IoT device includes not only global location information and altitude information, but also device management information. By knowing the device management information of the IoT devices, it is convenient for monitoring personnel to identify, manage and operate numerous IoT devices on site.

[0090] Such as image 3 As shown, in the specific implementation process of this embodiment 2, when the robot moves near a certain IoT device, it first judges whether a certain IoT device has been marked with an RFID tag, and the RFID tag has the unique global location information of the IoT device , height information, equipment management information.

[0091] If an RFID tag is set on an IoT device, read the RFID tag on the IoT device through the RFID reader installed on the robot to obtain the global location information, height information, and device management information of the IoT device. Then upload the informati...

Embodiment 3

[0101] Such as Figure 4 As shown, Embodiment 3 provides a system for interacting with IoT devices through a robot AR camera 11, including a robot 1, a monitoring terminal 2, and an IoT device 3. The robot 1 includes an AR camera 11 and a position calculation module 12. The monitoring terminal 2 includes a display 21, a controller 22, a playback processor 23, and an information acquisition module 24;

[0102] The AR camera 11 is used to shoot real-time video and send it to the playback processor 23. The AR camera 11 is also used to obtain the relative position of the IoT device 3 relative to the AR camera 11 and send it to the position calculation module 12;

[0103] The position calculation module 12 is used to calculate the position information of the IoT device 3 in the real-time video according to the received relative position, and send it to the playback processor 23;

[0104] The information acquisition module 24 is used to acquire the basic information of the IoT devi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method and system for interacting with Internet of things equipment through an AR camera of a robot. According to the invention, a monitoring terminal obtains basic information, the robot shoots real-time video through the AR camera thereof and obtains the relative position of the AR camera and the Internet of things equipment, position information of the Internet of things equipment in the real-time video is calculated according to the relative position of the AR camera and the Internet of things equipment, the real-time video and the position information are transmitted to the monitoring terminal, the monitoring terminal superimposes the received position information to the position corresponding to the Internet of things equipment in the real-time video in a label mode according to the received position information, and the monitoring personnel operates the Internet of things equipment through clicking the label at the monitoring terminal. The method and system can enable the real-time interaction between the monitoring personnel and the field Internet of things equipment to be more flexible and more convenient.

Description

technical field [0001] The invention relates to the field of intelligent robots, in particular to a method and system for interacting with IoT devices through a robot AR camera. Background technique [0002] The existing solution for on-site monitoring using intelligent robots is to transmit the real-time video captured by the camera installed on the intelligent robot to the monitoring center or APP for display, so that the monitoring personnel can see the situation on site in real time. [0003] However, this solution has limitations, that is, a robot can only realize the functions of a robot itself, and the robot is just a collection of movable cameras and sensors, and it is impossible for the robot to achieve static monitoring, Real-time interaction of IoT devices such as sensors and security devices, and the various basic information of IoT devices cannot be presented in front of monitoring personnel more accurately and vividly. Monitoring personnel can control and opera...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N7/18H04W4/02H04W4/80H04L29/08G06K17/00
CPCG06K17/0029H04L67/12H04N7/18H04W4/025H04W4/80
Inventor 袁添厦舒海燕刘彪柏林宋一兵侯玉清刘双广
Owner 广州高新兴机器人有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap