Augmented reality interaction method and device suitable for real object and storage medium

A technology of augmented reality and interactive methods, applied in the input/output of user/computer interaction, the input/output process of data processing, instruments, etc., can solve the problems of wasting time and achieve the effect of saving search time

Pending Publication Date: 2022-01-21
XI AN JIAOTONG UNIV
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For example, users often forget where certain items are placed, and a lot of time is wasted in the search process. There needs to be a prompt method to remind users; Prompt on the steps and methods of operation; for dangerous items, there are some warning signs, etc.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Augmented reality interaction method and device suitable for real object and storage medium
  • Augmented reality interaction method and device suitable for real object and storage medium
  • Augmented reality interaction method and device suitable for real object and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0058] Create virtual inclusions by virtual tight wrapping of real objects: Obtain virtual 3D models through 3D scanning of real objects to wrap real objects; or select similar virtual objects in the virtual model library to wrap real objects; or use multiple rules Or irregular virtual geometry includes cuboid, cylinder, cone, pyramid, and their combination wrap each functional area of ​​the real object, thus wrapping the whole real object. The virtual object used for wrapping is moved, scaled and rotated so that it completely wraps the real object, and the volume of the virtual object is made as small as possible, thereby establishing a virtual wrapping body of the real object.

[0059] Correspondence and labeling between each part of the virtual inclusion and the functional area of ​​the real object: the interaction method and content are determined by the functions of the functional area of ​​the real object wrapped in the virtual inclusion. The interaction method includes g...

Embodiment 2

[0069] see figure 2 , the embodiment of the present invention is applicable to the augmented reality interaction method of physical objects, including the following steps:

[0070]Step S1, write a program for the natural interaction of physical objects and burn it into the augmented reality device as an application, named PhysicalInteraction, and at the same time enable the eye tracking permission of the device to obtain eye movement data.

[0071] Step S2, after clicking to open the PhysicalInteraction application on the augmented reality device, observe all objects in the entire scene through the perspective of the augmented reality device.

[0072] Step S3, the user selects any object in the room that he wants to interact with.

[0073] In step S4, the user uses the index finger and thumb to tap (airTap) to generate a virtual object model or a plurality of virtual cuboids or similar virtual models in front of his eyes.

[0074] Step S5, through the gesture interaction mo...

Embodiment 3

[0083] desk lamp

[0084] Such as image 3 As shown, the user wears an augmented reality device, clicks in the air, and obtains a virtual 3D model through 3D scanning, or finds the virtual model of the desk lamp from the virtual object model library, or uses multiple irregular geometric shapes to frame the various functional areas of the desk lamp; use The gesture interaction module adjusts the virtual object so that it tightly wraps the real desk lamp; uses gesture interaction and voice input to give corresponding auxiliary prompt information to each component of the desk lamp.

[0085] When the user uses the desk lamp next time, the desk lamp can be found by voice speaking the name or alias of the desk lamp (such as the lamp in the study room), and a virtual sign is displayed at the position of the desk lamp, and the user can easily determine the position of the desk lamp through the virtual sign. When the user interacts with different areas of the desk lamp, the interactio...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an augmented reality interaction method and device suitable for a real object and a storage medium, and the interaction method comprises the following steps: selecting a real object for interaction in a virtual-real mixed space presented by augmented reality equipment; virtually and tightly wrapping a real object, and establishing a virtual wrapping body, wherein each functional area of the real object corresponds to each part of the virtual inclusion; marking each part of the virtual inclusion, defining an interaction mode and content of each part, and marking other real objects in the same mode, wherein a user interacts with a real object in the virtual-real mixed space, actually, an interaction event falls on a virtual inclusion of the real object, and feedback is carried out according to predefined interaction forms and contents of all parts. According to the interaction method, a user can establish an interaction relationship with a real object in an environment where the user is located anytime and anywhere, the real object is conveniently brought into a virtual-real mixed space for interaction, and when the object is moved, the virtual inclusion moves together with the real object according to the collision response of a hand to automatically keep an interaction relationship.

Description

technical field [0001] The invention belongs to the technical field of augmented reality interaction, and in particular relates to an augmented reality interaction method, device and storage medium applicable to real objects. Background technique [0002] Augmented reality devices can present some virtual holographic projections in the real world, and after being superimposed with real objects, a virtual and real scene will be presented in the user's field of vision. At the same time, augmented reality devices also provide a variety of interaction methods: voice interaction, using voice commands as input to make objects in the scene change accordingly; gesture interaction, providing multiple gestures for object movement, clicking and other operations; eye movement interaction , used to trigger corresponding actions based on eye movement behavior. However, these methods are all used to interact with virtual objects, and cannot achieve effective natural interaction with real ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06F3/16
CPCG06F3/011G06F3/012G06F3/013G06F3/017G06F3/167G06F2203/012
Inventor 蔡忠闽金瑞达
Owner XI AN JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap