Method for grabbing and releasing virtual object by hands

A virtual object, hand grasping technology, applied in the interdisciplinary field, can solve the problems of cumbersome implementation process, limited applicability and universality, and expensive equipment.

Active Publication Date: 2021-02-09
JIANGNAN UNIV
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Most of the existing methods cannot be popularized due to expensive equipment and cumbersome implementation process, and the current image-based methods can only obtain the rough positional relationship between virtual and real objects. Poverty, less research on virtual and real occlusion problems in dynamic environments, which limits the applicability and universality of augmented reality

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for grabbing and releasing virtual object by hands
  • Method for grabbing and releasing virtual object by hands
  • Method for grabbing and releasing virtual object by hands

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0059] A method for grasping and releasing virtual objects by hand, comprising the following steps:

[0060] Step 1: Obtain the scaling ratio of the virtual and real objects through the proportional conversion relationship between the virtual objects and the real objects in the real scene, so as to realize the normalization of the virtual objects and facilitate the consistency of the objects in the scene after the virtual and real objects are merged.

[0061] Normalize the length and width of the bottom quadrilateral of the minimum bounding box when the virtual object is drawn, so that the ratio of length and width is the same as that of the real object. The length and width ratio of , and then get the scaling ratio of the virtual and real objects.

[0062] like figure 1 shown, P 1 Represents the spatial position of the minimum bounding box of the virtual object after matrix transformation, P 2 Represents the spatial position of the smallest bounding box normalized by the l...

Embodiment 2

[0098] Embodiment 2 The specific use of the method for grasping and releasing virtual objects by hand

[0099] It is completed by using VS2013, OpenCV and OpenGL under the Windows7 operating system. The hardware environment is a 3.3GHz i5 processor, a desktop computer with 4GB running memory and a binocular camera. The internal parameters of the camera are pre-calculated and the experimental process is relatively stable.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for grabbing and releasing a virtual object by hands, and belongs to the technical field of interdisciplines combining computer graphics and virtual reality. Accordingto the method, the dynamic shielding problem in the virtual-real fusion process is studied, the movement of the hand to the virtual object in natural interaction is achieved by utilizing the change condition of the shielding area in the continuous frame, the movement and depth change condition of the central point pixel of the shielding overlapping area in the continuous frame and the shielding change condition of the area are recorded, collision estimation is carried out on the virtual object and the foreground object, and the stress condition of the overlapping area of the virtual object isfurther analyzed, so that the motion state of the virtual object is obtained, the virtual object is grabbed by a hand, and the problem of virtual-real shielding in a dynamic environment is solved.

Description

technical field [0001] The invention relates to a method for grasping and releasing virtual objects by hand, belonging to the interdisciplinary technical field combining computer graphics and virtual reality. Background technique [0002] The occlusion detection of virtual-real fusion is a core difficulty in augmented reality, a key issue in natural human-computer interaction, and a core difficulty in merging virtual objects and real scenes based on real and virtual environments. Most of the existing methods cannot be popularized due to expensive equipment and cumbersome implementation process, and the current image-based methods can only obtain the rough positional relationship between virtual and real objects. The lack of research on virtual and real occlusion in dynamic environments limits the applicability and universality of augmented reality. SUMMARY OF THE INVENTION [0003] In order to solve at least one of the above-mentioned problems, the present invention aims ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06T19/00
CPCG06F3/011G06T19/006
Inventor 王映辉张乐
Owner JIANGNAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap