Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method for tracing arm motion in real time video tracking system

A tracking system and real-time video technology, applied in the input/output of user/computer interaction, image data processing, instruments, etc., can solve the problems of restricting promotion and application, expensive price, and interference of target electromagnetic field electromechanical equipment

Inactive Publication Date: 2008-09-03
CHINA JILIANG UNIV
View PDF0 Cites 51 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, since this type of tracking equipment is still in its infancy in China, and the price of foreign products is very expensive, and the target electromagnetic field is easily interfered by many electromechanical devices (computer hosts, monitors, projectors, etc.), it is largely restricted. Its promotion and application in parallel virtual reality environment

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for tracing arm motion in real time video tracking system
  • Method for tracing arm motion in real time video tracking system
  • Method for tracing arm motion in real time video tracking system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] This embodiment provides a complete set of arm motion tracking solution, which mainly includes the following three parts:

[0035] 1. Feature extraction of arm identification ring

[0036] 1) Camera geometry calibration. In the offline state, several checkerboard calibration board images with depth information and checkerboard calibration paper images tiled on the ground were taken by two cameras, and then used MatlabTM The extended toolbox of camera calibration realizes geometric calibration and obtains the internal and external parameters of two cameras.

[0037] 2) Extract the edge feature points of the logo ring. According to the coherence of arm motion, coarse target search windows are separately separated from the interactive images from the two cameras in order to improve the efficiency of feature extraction. Then using the known color features of the logo rings, the edge point sequences corresponding to the wrist and elbow logo rings are extracted respectively...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a method of realizing the visualization of track arm movement in fields such as immersion interactive game, dangerous industrial control, virtual reality, etc. The current method is not very much in line with human daily interaction habits. The method of the invention is: roughly locating the target window for arm position through analyzing the central logo color information of wrist and elbow in real-time image sequence; then carrying out central logo extraction and three-dimensional reconstruction of characteristic points for the rough target window from two synchronized camera; lastly carrying out robust control with the three-dimensional characteristic points of wrist and elbow based on fuzzy predictive control technology, and generating stable navigation control signals. The method of the invention can realize six degrees of freedom arm navigation operation, thus human arms and hands can be in a natural state when interacting, the operator can carry out human-computer interaction in a natural way, which is much more in line with human daily interaction habits.

Description

technical field [0001] The invention belongs to the technical field of automatic control, and relates to a method for visually tracking arm movement in the fields of immersive interactive games, dangerous industrial control and virtual reality, which integrates computer vision, graphic image processing and automatic control. technical background [0002] In a distributed virtual reality environment, in order to provide a more harmonious and friendly human-computer interaction interface, there are a variety of immersive interaction modes to choose from, such as head movement tracking, facial expression recognition, natural language understanding, gesture recognition, etc. A more direct way is to integrate the arm motion tracking results and the gesture output of the data glove to realize human-computer interaction, in which the arm motion tracking provides displacement information, and the gesture output is used to generate semantics such as object selection, translation, and ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/20G06K9/00G06F3/01G06T7/207
Inventor 王修晖杨海波
Owner CHINA JILIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products