Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Vision human hand tracking method and system based on on-line machine learning

A machine learning and vision technology, applied in the field of visual target tracking and intelligent human-computer interaction, can solve the problems of lack of robustness and achieve the effect of enhancing robustness

Inactive Publication Date: 2013-12-04
PEKING UNIV SHENZHEN GRADUATE SCHOOL
View PDF4 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, pure target detection is not robust to simple appearance changes such as lighting changes, fast motion, etc.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Vision human hand tracking method and system based on on-line machine learning
  • Vision human hand tracking method and system based on on-line machine learning
  • Vision human hand tracking method and system based on on-line machine learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0066] It is mainly divided into two stages, namely the tracking stage and the online learning stage. In the human hand tracking stage, an improved tracker-a tracker composed of optical flow tracking based on the bird swarm algorithm is used to track the extracted feature points. At the same time, the detector composed of skin color classifier, random forest classifier, and nearest neighbor classifier also detects target objects in a local area. Among them, the skin color classifier and the nearest neighbor classifier cannot be updated, but the random forest classifier can be updated. The final tracker result and the detector result get the final tracking result (center position and window) through the fusion mechanism. In the online learning stage, since the target center and window are obtained, the present invention can generate a training set of positive and negative samples through time-space-skin color constraints, and retrain the classifier. The specific implementation...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a vision human hand tracking method and system based on on-line machine learning. The system comprises a tracker, a detector and an on-line learning machine. The tracking method is characterized in that detection based on a classifier and tracking based on motion continuity are combined together through the on-line learning, and therefore human hand tracking of actual application scene robustness can be achieved. The hierarchy classifier (detector) is used for classifying pixels in a search area so as to obtain conservative but stable estimation on a target; an optical flow tracker combined with a flock algorithm is used for carrying out estimation, strong in adaptation but unstable, on the target; a tracking result is obtained by combining the two types of estimation through an on-line learning system, a new sample is generated based on time and space limitation to upgrade the hierarchy classifier in an on-line mode, therefore, complementation of the tracker and the detector is achieved, and a more robust tracking result can be obtained. The vision human hand tracking method and system based on on-line machine learning improve robustness on illumination variations and quick movement.

Description

Technical field: [0001] The invention belongs to the field of visual target tracking and intelligent human-computer interaction, and specifically relates to a robust visual human hand tracking method and system based on online machine learning. Background technique: [0002] Vision-based hand tracking technology is a key technology that combines image processing, pattern recognition, artificial intelligence and many other fields. Visual human hand tracking technology has a very wide range of applications, such as video surveillance, smart TV, robot control, visual games and other fields that require human-computer interaction. Because of the huge application prospects of human hand tracking technology, research on visual human hand tracking is in the ascendant both at home and abroad. [0003] In the human-computer interaction environment, human hand tracking technology has faced many challenges. For example, the light changes greatly due to the influence of sunlight and light; t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/66
Inventor 刘宏刘星王灿
Owner PEKING UNIV SHENZHEN GRADUATE SCHOOL
Features
  • Generate Ideas
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More