Binocular vision-based human body posture and action research method

A technology for human posture and movement research, applied in image data processing, instruments, computing, etc., can solve the problems of complex optoelectronic equipment, high cost, and high light requirements.

Active Publication Date: 2014-09-10
NORTH CHINA UNIVERSITY OF TECHNOLOGY
View PDF4 Cites 28 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The structured light method has high requirements on equipment and external light, and is expensive
The time-of-flight method directly uses the propagation characteristics of light and sound waves, and does not require the acquisition and analysis of grayscale im...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Binocular vision-based human body posture and action research method
  • Binocular vision-based human body posture and action research method
  • Binocular vision-based human body posture and action research method

Examples

Experimental program
Comparison scheme
Effect test

no. 1 example

[0090] The first embodiment of the present invention is used to judge whether the subject has squatted and translated in the left and right directions and the front and rear directions, and is realized by the following steps:

[0091] S1: Place the left camera and the right camera on the same horizontal line parallel to the ground, where the two cameras are of the same model, the distance between the two cameras is a set value, and both cameras can capture a complete upper body of human body,

[0092] Among them, the two cameras are both MV-VS078FC cameras, and the two cameras are respectively fixed at the same level by tripods;

[0093] S2: For the dual-target calibration of the left camera and the right camera, first prepare a rectangular calibration board with multiple circular feature points, where the multiple circular feature points are arranged in an array of multiple rows and columns, located in the same row The circle centers of the circular feature points are on the...

no. 2 example

[0144] The second embodiment of the present invention is used to judge the arm posture of the subject. Specifically, it can determine the angle at which the subject's arms are opened and the degree to which the arms are bent respectively. Steps S1 to S29 are the same as those in the first embodiment , so no more details, assuming that the multiple skin color areas in S12 also include the left and right hands of the subject, and the centroid points of the left and right hands of the subject are not discarded in S30, the arm posture of the subject is judged by the following steps:

[0145] The subject keeps his arms straight, so that the arms are in the same plane and the plane where the arms are located is at an angle of 90 degrees to the vertical plane, and the face, left hand and right hand of the subject are calculated respectively using the above steps S10-S28 The coordinates of the centroid point in the world coordinate system, and then calculate the distance between the le...

no. 3 example

[0153] The third embodiment of the present invention is used to judge whether the subject has moved rapidly within a certain period of time. Steps S1 to S30 are the same as those of the first embodiment, so no further details are given. The following steps are used to determine whether the subject has moved rapidly within a period of time. Has rapid movement occurred:

[0154] Set a speed threshold V T ;

[0155] Calculate the movement distance d of the centroid point of the face within the time t0~t1,

[0156] d = | P t 0 P t 1 → | = ( x ′ - x 0 ) ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a binocular vision-based human body posture and action research method. Firstly, internal and external parameters of a camera are acquired through binocular calibration, coordinates of a centroid point of each skin color area are extracted from an image shot by the camera, and the centroid point is matched and judged. Then, coordinates of the matched centroid point in a world coordinate system are found with the world coordinate system as a datum. Finally, the gesture and the action of the human body are judged according to the coordinates of the centroid point in the world coordinate system. According to the binocular vision-based human body posture and action research method, a large number of images do not need to be shot, centroid points of human body key parts such as the face and two hands can be matched in a three-dimensional mode through acquiring video frames in real time, the position relationship among the human body key parts is acquired, and the running cost is low.

Description

technical field [0001] The invention relates to a method for researching human body gestures and actions, in particular to a research method for human body gestures and actions based on binocular vision. Background technique [0002] With the development of computer technology, people can use computers to complete many difficult tasks. The technology of accurately recognizing human body movements through computers can be widely used in the fields of intelligent human-computer interaction, virtual reality, video surveillance and digital entertainment, and is currently a research hotspot in the field of computer vision and pattern recognition. In some fields of virtual reality, such as digital entertainment, the computer usually needs to transmit stimulation signals to the human senses on the one hand, and on the other hand, it also needs to receive the operator's response, such as changes in body posture, etc., and then according to the position of the human body itself and ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/00G06T7/60
Inventor 叶青董俊峰张永梅
Owner NORTH CHINA UNIVERSITY OF TECHNOLOGY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products