Immersive remote interaction system and method based on natural walking

A remote interactive and immersive technology, applied in the field of virtual reality, can solve problems such as lack of depth information, difficulty in estimating image distance information for remote operators, inaccurate control of robot remote operation, etc., to achieve strong experience, reduce learning burden, easy-to-use effects

Active Publication Date: 2020-09-29
SHANDONG UNIV
View PDF5 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the video information transmitted back by most robots at present is usually presented on the computer GUI, which lacks depth information, which will make it difficult for the remote operator to estimate the distance information in the image, and may produce inaccurate results for the remote operation of the robot. control

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Immersive remote interaction system and method based on natural walking
  • Immersive remote interaction system and method based on natural walking
  • Immersive remote interaction system and method based on natural walking

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0033] This embodiment provides an immersive remote interaction system based on natural walking;

[0034] Such as figure 1 As shown, the immersive remote interaction system based on natural walking includes:

[0035] The robot, the server, the location tracking device, and the head-mounted virtual reality device worn on the user's head during use; the location tracking device and the head-mounted virtual reality device are in the same physical space, and the robot and the head-mounted virtual reality device are in different places. within the physical space of

[0036] According to the user's motion data, the motion of the robot is remotely controlled, and at the same time, the motion of the robot is transmitted to the head-mounted virtual reality device through the server, and then displayed to the user to realize the interaction between the robot and the user.

[0037] As one or more embodiments, the action of the robot is controlled according to the action data of the use...

Embodiment 2

[0113] This embodiment provides an immersive remote interaction method based on natural walking;

[0114] Immersive remote interaction methods based on natural walking, including:

[0115] According to the user's motion data, the robot's motion is remotely controlled, and at the same time, the robot's motion is transmitted to the user's head-mounted virtual reality device through the server, and then displayed to the user to realize the interaction between the robot and the user.

[0116] The implementation details of each step in the method are consistent with the implementation details of the corresponding steps in Embodiment 1, and will not be repeated here.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an immersive remote interaction system and method based on natural walking. The system comprises a robot, a server, a location tracking device and a head-mounted virtual reality device worn on the head of a user in use; and the location tracking device and the head-mounted virtual reality device are in the same physical space, and the robot and the head-mounted virtual reality device are in different physical spaces. The action of the robot is remotely controlled according to action data of the user; and meanwhile, the action of the robot is transmitted to the head-mounted virtual reality device through the server, and then the action of the robot is displayed to the user, so that the interaction between the robot and the user is realized.

Description

technical field [0001] The present disclosure relates to the technical field of virtual reality, in particular to an immersive remote interaction system and method based on natural walking. Background technique [0002] The statements in this section merely mention background art related to the present disclosure and do not necessarily constitute prior art. [0003] With the development of robot technology, robots have been widely used in industrial production, education, medical treatment and other fields. The remote robot system, that is, a system in which human operators give instructions and the robot completes the instructions, is often used in dangerous or uncertain environments, such as search and rescue, fire fighting, and other environments that require human intervention to detect and monitor abnormalities. For example, at a fire scene, there are dangerous flames, smoke, high temperature, and the possibility of explosion, and it is difficult for firefighters to en...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): B25J11/00B25J5/00B25J9/16B25J19/02
CPCB25J11/0005B25J5/005B25J9/1679B25J9/1697B25J9/1664B25J9/1602B25J19/023
Inventor 盖伟杨承磊赵燕帅师脉旺王雯菲
Owner SHANDONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products