Unlock instant, AI-driven research and patent intelligence for your innovation.

Method and apparatus for interacting with virtual objects

A technology of virtual objects and devices, applied in related fields, can solve problems such as complexity

Active Publication Date: 2021-08-10
DEVAR ENTERTAINMENT LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0017] The disadvantage of this prototype is its complexity, since it requires an additional device, namely the Kinekt device itself connected to the user's computer device, and with only one client device of the user, there is no possibility to interact with virtual objects, The client device has a camera and a display, the client device is for example a smartphone, a tablet or a device that is usually always with the user (like augmented reality glasses)

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and apparatus for interacting with virtual objects
  • Method and apparatus for interacting with virtual objects
  • Method and apparatus for interacting with virtual objects

Examples

Experimental program
Comparison scheme
Effect test

example 1

[0079] Example 1. Techniques for interacting with virtual objects.

[0080] The interaction technology between real objects and virtual objects is based on image recognition, that is, a method of comparison with templates. A dummy object is associated with a real object, and changes in the second object directly affect changes in the first object:

[0081] Virtual objects can move and their properties can be changed by moving or changing properties of real objects.

[0082] First of all, a library is necessary for creating images of real objects, with the help of which virtual objects are manipulated (active identity). The virtual object itself can be displayed on its logo (passive logo) or not used at all.

[0083] In the case of flat logos, only one image is required per logo. Uses the camera to search for a specified image of the surrounding world. Identifiers can be applied to the surface of any object in any way, but the original shape must be preserved (scales are al...

example 2

[0090] Example 2. Possibility to manipulate virtual objects.

[0091] A device in the user's hand, such as a tablet, stores in its memory a graphic of a part assembly. With a camcorder, the device receives data from the environment. This video stream is filtered (Laplacian). The identity is located in the image, compared using keypoint descriptors. The homography, spatial orientation and other features of the logo are calculated and combined on the basis of them to form an assembled composite 3D model whose graphic is the logo. Next, the user's hand is entered into the frame as an active marker, which is a control volume whose template library is also present in the device's memory. Since all three coordinates are used, it is possible to "disassemble" the structure into individual parts with the help of the hands as active markers. In particular, here the depth features are used to find out whether the user "grabs" the part with his fingers.

example 3

[0092] Example 3. An example of building a 3D model based on feature points (graphic primitives).

[0093] A binary image applied to a piece of paper is used as the logo. image 3 Original images are shown.

[0094] Analyze preloaded logo images and frames from the camera to determine the presence of graphics primitives - angles, sharpness, etc.

[0095] Figure 4 Signs with detected feature points are shown. and in Figure 5 Frames with detected feature points are shown in .

[0096] The identifiers and frame descriptors are then computed. After computation, the descriptors are compared. This comparison allows you to find out the spatial orientation of the logo image and design it as a first approximation. (see Image 6 ). At this stage, the different colors of the frame borders enable tracking the correctness of the calculations identifying the spatial orientation of the frame.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

This group of inventions relates to methods and systems for interacting with virtual objects, comprising: determining the control unit used to interact with the virtual object; determining the characteristic graphics primitives of the virtual object; determining the spatial position of the control unit; position the graphics primitive associated with the virtual object; and perform a desired action on the virtual object. According to the invention, images are used from a user's client device with a camera and a display, a control unit image library is created based on the received images, and the obtained image library is used to determine graphics primitives for the control unit. The spatial position of the control unit is then determined by calculating the movement of the control unit graphical primitive in space, the calculation of the movement of the control unit graphical primitive in space comprising using a correction that compensates for vibrations of the user's client device. The achieved technical result is that it is possible to interact with virtual objects using only one user client device, which has a camera and a display.

Description

technical field [0001] Related Fields of the Invention [0002] This group of inventions relates to methods and systems designed for interacting with virtual objects, wherein the management agent determines the characteristic graphics primitives of the virtual object, determines the position of the control volume in space, compares the volume management of the graphics primitives of the virtual object in space position, perform desired actions on the virtual object, and interact with the virtual object will be handled by the management agent. [0003] This article uses the following terms. [0004] Virtual objects are created by technological means, and objects are transmitted to humans through their senses (sight, hearing, and others). [0005] Control is the control of a virtual object, which can be a person, a part of a person (such as a hand), or an object controlled by a person in turn (such as a pointer). [0006] An image library is a database of various images of t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/01G06K9/20G06T15/00G06T19/00
CPCG06V20/20G06V10/10G06N3/04G06F3/011G06V10/245G06T7/277G06F3/03G06T19/006G06V10/40G06T1/0007G06T2200/24G06T7/20G06T1/00G06T7/00
Inventor 维塔利·维塔利耶维奇·艾维瑞亚诺夫安德烈·瓦勒耶维奇·科米萨罗夫
Owner DEVAR ENTERTAINMENT LTD