Unlock instant, AI-driven research and patent intelligence for your innovation.

Augmented reality man-machine interaction method and equipment

A human-computer interaction device and augmented reality technology, applied in the input/output process of data processing, image data processing, instruments, etc., can solve problems such as inapplicability of tree structure, obscuring the field of view, irrelevance, etc.

Pending Publication Date: 2021-11-19
SHANGHAI ELECTRICGROUP CORP
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] At present, in the operation process, the interface interaction logic based on the terminal is mainly used to realize the human-computer interaction. Due to the relatively strict requirements on the environment during the operation process, the human-computer interaction method currently used in the operation process is too complicated and inconvenient for the surgeon to operate.
[0003] Gesture operation is one of the main human-computer interface interaction methods in Augmented Reality (AR) technology. It is convenient, intuitive, and sterile. However, due to the complicated logic of traditional interface interaction, the tree structure used Applicable to AR applications, on the one hand, may cause the large-area menu on the terminal screen to block the AR user's field of vision; The operation that needs to be performed, and the process of finding the operation is not related to the object itself, which is not conducive to the direct interaction between AR users and real objects

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Augmented reality man-machine interaction method and equipment
  • Augmented reality man-machine interaction method and equipment
  • Augmented reality man-machine interaction method and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0088] Embodiment 1. Since the traditional interface interaction logic cannot realize direct interaction with the object, the process of finding the operation is not related to the object itself. For any object, it is necessary to find the required operation from the multi-level menu, which is not conducive to AR users directly interact with real objects. For example, when users see two interactive virtual objects on the desktop, one left and one right, or one far and one near, in the AR scene, the user People will instinctively want to directly interact with the virtual object, instead of selecting the desired operation from a menu completely separated from the virtual object, so the traditional menu is not suitable for AR applications, nor is it suitable for AR human-computer interaction interface.

[0089] At present, in the operation process, the human-computer interaction is mainly realized by using the interface interaction logic based on the terminal. Due to the relativ...

Embodiment 2

[0144] Based on the same inventive concept, the embodiment of the present invention also provides an augmented reality human-computer interaction device, since the device is the device in the method in the embodiment of the present invention, and the problem-solving principle of the device is similar to the method , so the implementation of the device can refer to the implementation of the method, and the repetition will not be repeated.

[0145] like Figure 10 As shown, the device includes a processor 1000 and a memory 1001, the memory 1001 is used to store a program executable by the processor 1000, and the processor 1000 is used to read the program in the memory 1001 and perform the following steps :

[0146] Determine the target audience for operations performed by users of augmented reality AR devices;

[0147]In response to the user's gesture instruction, displaying the virtual object of the target object in the virtual space constructed by the AR device, and a circul...

Embodiment 3

[0167] Based on the same inventive concept, the embodiment of the present invention also provides an augmented reality human-computer interaction device, because the device is the device in the method in the embodiment of the present invention, and the problem-solving principle of the device is similar to the method , so the implementation of the device can refer to the implementation of the method, and the repetition will not be repeated.

[0168] like Figure 11 As shown, the device includes:

[0169] A determining unit 1100, configured to determine a target object to be operated by a user using an augmented reality AR device;

[0170] The display unit 1101 is configured to display a virtual object of the target object and a circular menu corresponding to the virtual object in the virtual space constructed by the AR device in response to the user's gesture instruction, wherein the circular menu The menu is used to display command items related to the virtual object;

[01...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an augmented reality man-machine interaction method and equipment, which are used for integrating gesture operation in an AR (Augmented Reality) technology into intraoperative navigation, can perform man-machine interaction in an operation more conveniently and intuitively, and can ensure the sterility of the man-machine interaction in the operation. The method comprises the following steps: determining a target object operated by a user using augmented reality (AR) equipment; in response to a gesture instruction of the user, displaying a virtual object of the target object and an annular menu corresponding to the virtual object in a virtual space constructed by the AR equipment, wherein the annular menu is used for displaying command items related to the virtual object; and in response to an opening instruction triggered by the user through interaction between the gesture and the command item in the virtual space, performing operation of the command item corresponding to the opening instruction on the virtual object.

Description

technical field [0001] The invention relates to the field of augmented reality technology, in particular to a human-computer interaction method and device for augmented reality. Background technique [0002] At present, in the operation process, the human-computer interaction is mainly realized by using the interface interaction logic based on the terminal. Due to the relatively strict requirements on the environment during the operation process, the human-computer interaction method currently used in the operation process is too complicated and inconvenient for the surgeon to operate. [0003] Gesture operation is one of the main human-computer interface interaction methods in Augmented Reality (AR) technology. It is convenient, intuitive, and sterile. However, due to the complicated logic of traditional interface interaction, the tree structure used Applicable to AR applications, on the one hand, may cause the large-area menu on the terminal screen to block the AR user's f...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/0488G06F3/0482G06T19/00
CPCG06F3/04883G06F3/0482G06T19/006
Inventor 陈罡徐欣钱广璞
Owner SHANGHAI ELECTRICGROUP CORP