Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Motion collecting and feedback method and system based on stereoscopic vision

A technology of stereo vision and motion acquisition, applied in the input/output of user/computer interaction, mechanical mode conversion, computer components and other directions, can solve the problems of accurate stability and cannot be solved at the same time, and achieves improved control experience, Low hardware cost and stable operation

Active Publication Date: 2014-10-08
XIMMERSE LTD
View PDF6 Cites 30 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] The object of the present invention is to provide a method and system for motion acquisition and feedback based on stereo vision, which can effectively solve the problems in the prior art, especially the problems of cost, delay, and accuracy and stability that the prior art cannot solve at the same time. Problems and failure to generate force feedback

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Motion collecting and feedback method and system based on stereoscopic vision
  • Motion collecting and feedback method and system based on stereoscopic vision
  • Motion collecting and feedback method and system based on stereoscopic vision

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0042] Embodiment 1 of the present invention: a kind of action collection and feedback method based on stereo vision, such as Figure 7 As shown, it includes the following steps: collecting the spatial position of the infrared light source on the accessory device 14 in the front space: the dual camera device 1 fixed in front of the head-mounted display 2 collects the image data ahead through the CMOS or CCD sensors 18 on the left and right sides, This image data becomes digital signal after A / D converter 19 and enters DSP processor 20, carries out exposure, gain, white balance processing; The digital signal after processing enters in encoding chip 21 and carries out signal encoding; After encoding, two road video signals Enter the data bus 22 to synthesize one road and output to the computer 15 through the USB data line that the double camera device 1 carries; value; convert the coordinate value of the infrared light source collected by each lens into the azimuth angle of the ...

Embodiment 2

[0043] Embodiment 2: realize the action collection and feedback system based on stereo vision of the method described in embodiment 1, as Figure 8 As shown, it includes: a dual camera device 1, a base 11, an accessory device 14 and a computer 15, and the base 11 (such as Figure 4 Shown) is provided with A bluetooth module 16 and USB data line 13, and USB data line 13 is connected with computer 15; Described accessory device 14 is provided with B bluetooth module 17, and B bluetooth module 17 is wirelessly connected with A bluetooth module 16 ; Dual camera device 1 is connected with computer 15; Described accessory device 14 is glove-shaped accessory device 3 (as Figure 5 As shown), the glove-shaped accessory device 3 is also provided with an infrared LED 8, a vibration module 4 and a drive box 5, and the drive box 5 is connected to the A Bluetooth module 16 and the vibration module 4 respectively; the dual camera device 1 includes: CMOS or CCD sensor 18, A / D converter 19, ...

Embodiment 3

[0044] Embodiment 3: realize the action collection and feedback system based on stereo vision of the method described in embodiment 1, as Figure 9 As shown, it includes: a dual camera device 1, a base 11, an accessory device 14 and a computer 15, and the base 11 (such as Figure 4 Shown) is provided with A bluetooth module 16 and USB data line 13, and USB data line 13 is connected with computer 15; Described accessory device 14 is provided with B bluetooth module 17, and B bluetooth module 17 is wirelessly connected with A bluetooth module 16 ; Dual camera device 1 is connected with computer 15; Described accessory device 14 is finger ring accessory device 6 (as figure 1 shown), means that the ring-shaped accessory device 6 is also provided with an infrared LED 8; the dual camera device 1 includes: CMOS or CCD sensor 18, A / D converter 19, DSP processor 20 and encoding chip 21, CMOS or CCD Sensor 18, A / D converter 19, DSP processor 20 and coding chip 21 are connected in seque...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a motion collecting and feedback method and system based on stereoscopic vision. The method comprises the following steps that the space position of an infrared light source in an attachment position in a front space is collected, the space position is mapped into a virtual space, and the position and direction of a virtual object are controlled; when the virtual object interacts with a virtual environment, a wireless control attachment device vibrates and simulates the feedback feeling of force. The motion collecting and feedback method and system based on stereoscopic vision have the advantages that positioning is rapid and accurate, and operation is stable; the hardware is quite low in cost, simple in structure and quite small in size; force feedback is achieved and can largely improve the sense of reality of interaction behaviors, and user experience is improved; the reality function is improved, and the man-machine interaction modes are increased.

Description

technical field [0001] The invention relates to a method and system for motion collection and feedback based on stereo vision, and belongs to the technical field of virtual reality and augmented reality. Background technique [0002] Hand movements are collected and used as input signals for computer control, so that hand movements can be reproduced in a virtual environment for human-computer interaction. This type of human-computer interaction usually has the following implementation methods: [0003] 1. Laser scanning: The laser scans the range in front, the sensor collects the reflected light in each direction, calculates the distance, and obtains the depth information of each point in front to form a depth map. If the hand is placed in front of the sensor, the outline of the hand can be displayed on the depth map; and if the laser is used to continuously scan the front range, the spatial position, motion trajectory and posture of the hand can be continuously collected b...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/01
CPCG06F16/00
Inventor 贺杰洪健钧
Owner XIMMERSE LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com