Kinect-based motion sensing-control method for manipulator

A somatosensory control and robotic arm technology, applied in the direction of program control of manipulators, manipulators, mechanical mode conversion, etc., to achieve the effects of reducing casualties, convenient expansion and integration, and friendly interaction

Inactive Publication Date: 2013-11-13
三亚哈尔滨工程大学南海创新发展基地
View PDF5 Cites 39 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Existing robot control methods are controlled

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Kinect-based motion sensing-control method for manipulator
  • Kinect-based motion sensing-control method for manipulator
  • Kinect-based motion sensing-control method for manipulator

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach 1

[0046] combine figure 1 ~5, the overall steps of this embodiment are:

[0047] (1) The three-dimensional coordinates of 20 bone points of the human body are obtained through the Kinect sensor. The joint coordinates mainly used in the experiment include the coordinates of the right hip joint, right shoulder joint, right elbow joint, right wrist joint and right hand joint.

[0048] (2) Use the double exponential filter algorithm to smooth the obtained right arm joint coordinate data to reduce the jitter during the movement of the right arm joint.

[0049] (3) Use the filtered right arm joint coordinates to construct a vector in Kinect's three-dimensional space coordinate system. By calculating the angle between the vectors, you can know the angles at the right arm joints, including the angle at the right shoulder joint and the angle at the right elbow joint. , The angle at the right wrist joint. Save the calculation results;

[0050] (4) Fuse the angle information to form a d...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention aims to provide a Kinect-based motion sensing-control method for manipulator comprising the following steps of obtaining the three-diemnsional coordinates of five joints of the right upper limb of a human body by a Kinect sensor; smoothing the obtained five joint coordinate data of the right upper limb by a double-exponential filtering algorithm; constructing vectors in the three-dimensional space coordinate system of the Kinect by utilizing the smoothed 5 joint coordinates of right upper limb, and obtaining the angles of the right upper limb by calculating the vector included angles, wherein the angles of the right upper limb comprise a right shoulder joint angle, a right elbow joint angle and a right wrist joint angle; fusing the angle information to form a data package, adding with a data package head and a checksum, and sending to a robot by a wireless serial port to perform manipulator control. The Kinect-based motion sensing-control method for the manipulator can finish the flexible and accurate control on the manipulator and the moving robot by accurate identification on the human body actions, thus enabling the interaction between people and the robot to be more friendly and improving the intelligence of the robot.

Description

technical field [0001] The invention relates to a robot control method, in particular to a somatosensory robot control method. Background technique [0002] Kinect is a 3D somatosensory camera, and it introduces functions such as real-time motion capture, image recognition, microphone input, voice recognition, and social interaction. Microsoft launched the Kinect for Windows SDK Beta in June 2011. It is a new type of human-computer interaction system and a new type of body perception sensor. It has a wide range of applications, such as virtual fitting mirror, 3D modeling, virtual musical instruments, virtual entertainment, and mechanical control. At present, there are few researches on the robot control method based on Kinect, and the research on using Kinect to realize the flexible control of the robot has a very broad application prospect. [0003] At present, with the help of Japan's advanced robot technology, scientists have conducted experiments on real-time control o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): B25J9/16G06F3/01
Inventor 莫宏伟孟龙龙徐立芳董会云蒋兴洲雍升
Owner 三亚哈尔滨工程大学南海创新发展基地
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap