A method of grasping and releasing virtual objects by hand

A virtual object and grasping technology, applied in interdisciplinary fields, can solve the problems of lack of research on mutual occlusion, cumbersome implementation process, limited applicability and universality, and achieve the effect of solving the problem of virtual and real occlusion

Active Publication Date: 2021-12-03
JIANGNAN UNIV
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Most of the existing methods cannot be popularized due to expensive equipment and cumbersome implementation process, and the current image-based methods can only obtain the rough positional relationship between virtual and real objects. Poverty, less research on virtual and real occlusion problems in dynamic environments, which limits the applicability and universality of augmented reality

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method of grasping and releasing virtual objects by hand
  • A method of grasping and releasing virtual objects by hand
  • A method of grasping and releasing virtual objects by hand

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0059] A method for grasping and releasing a virtual object by hand, comprising the following steps:

[0060] Step 1: Obtain the scaling ratio of virtual and real objects through the corresponding ratio conversion relationship between virtual objects and real objects in the real scene, realize the normalization of virtual objects, and facilitate the consistency of objects in the scene after virtual and real fusion.

[0061] Normalize the length and width of the bottom quadrilateral of the minimum bounding box when the virtual object is drawn, so that the ratio of length and width is the same as that of the real object. By calculating the length, width and normalized value of the virtual object respectively The length and width ratio value of the object, and then get the zoom ratio of the virtual and real object.

[0062] Such as figure 1 As shown, P 1 Indicates the spatial position of the smallest bounding box of the virtual object after matrix transformation, P 2 Indicates...

Embodiment 2

[0098] Embodiment 2 Specific use of the method of grasping and releasing virtual objects by hand

[0099] It is completed under Windows 7 operating system using VS2013, OpenCV and OpenGL. The hardware environment is a 3.3GHz i5 processor, a desktop computer with 4GB of running memory and a binocular camera. The internal parameters of the camera are pre-calculated and the experimental process is relatively stable.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for grasping and releasing a virtual object by hand, and belongs to the interdisciplinary technical field of combining computer graphics and virtual reality. By studying the dynamic occlusion problem in the process of virtual-real fusion, the invention realizes the movement of the hand to the virtual object in the natural interaction by utilizing the change of the occlusion area in the continuous frames, and records the movement and depth change of the center point pixel of the occlusion overlapping area in the continuous frames conditions and the occlusion changes in this area, the collision estimation between the virtual object and the foreground object is performed, and the force situation in the overlapping area of ​​the virtual object is further analyzed, so as to obtain the motion state of the virtual object and complete the grasping of the virtual object by hand , which solves the problem of virtual and real occlusion in dynamic environments.

Description

technical field [0001] The invention relates to a method for grasping and releasing a virtual object by hand, and belongs to the interdisciplinary technical field of combining computer graphics and virtual reality. Background technique [0002] The occlusion detection of virtual and real fusion is a core difficulty in augmented reality and a key issue of natural human-computer interaction. It is also the core difficulty of realizing the technology of merging virtual objects and real scenes based on real and virtual environments. Most of the existing methods cannot be popularized due to expensive equipment and cumbersome implementation process, and the current image-based methods can only obtain the rough positional relationship between virtual and real objects. Poverty, less research on virtual and real occlusion problems in dynamic environments, which limits the applicability and universality of augmented reality. Contents of the invention [0003] In order to solve at l...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/01G06T19/00
CPCG06F3/011G06T19/006
Inventor 王映辉张乐
Owner JIANGNAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap