Uncalibrated human-computer interaction control system and method based on Kinect

A control system and human-computer interaction technology, applied in the field of information barrier-free engineering, can solve problems such as inability to accurately calibrate, color images are easily affected by lighting conditions, etc., and achieve high real-time and interactive effects.

Inactive Publication Date: 2015-04-29
CHONGQING UNIV OF POSTS & TELECOMM +1
View PDF3 Cites 31 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, color images are easily affected by lighting conditions, and traditional vision-based tracking of moving objects

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Uncalibrated human-computer interaction control system and method based on Kinect
  • Uncalibrated human-computer interaction control system and method based on Kinect
  • Uncalibrated human-computer interaction control system and method based on Kinect

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] The technical solutions of the present invention will be described in further detail below with reference to the accompanying drawings and specific embodiments.

[0020] 1 System Framework

[0021] The system block diagram is as follows figure 1 shown:

[0022] The acquisition of human depth image information is mainly completed by the Kinect sensor 2. The computer software system 3 uses the bone tracking technology to process the acquired depth of field data, and establishes 3D coordinates of 20 bone points of the human body. The robotic arm control system 4 obtains the control instructions converted by the computer system, and controls the end effector to follow the movement of the hand, so as to realize real-time guidance of the manipulator end effector by the human hand. Among them, operator 1 is in the workspace of Kinect.

[0023] 2 Obtain hand information and master-slave control method

[0024] 2.1 Introduction to Kinect

[0025] Kinect is a device develop...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

PropertyMeasurementUnit
Frame rateaaaaaaaaaa
Login to view more

Abstract

The invention discloses an uncalibrated human-computer interaction control system and method based on Kinect. The system comprises human skeleton information acquisition, a computer software system and a mechanical arm, wherein human depth image information acquisition is mainly accomplished by a Kinect sensor; the computer software system processes acquired field depth data by utilizing a skeleton tracking technology and establishes a 3D (three-dimensional) coordinate of 20 human skeleton points; and a control system of the mechanical arm acquires a control command sent by conversion of the computer system, and controls an end actuator to follow hand motion to achieve real-time guide of a hand to the end actuator of the mechanical arm. According to the system and the method, master-slave control is performed by constructing a motion mapping relation of the hand relative to a hipbone center and the end actuator relative to a base of the mechanical arm, so that real-time interaction of the hand and the mechanical arm is achieved. An experimental result indicates that the system can well accomplish hand tracking and master-slave control tasks, and has higher timeliness and interactivity.

Description

technical field [0001] The invention belongs to the technical field of information barrier-free engineering, and in particular relates to a Kinect-based non-calibration human-computer interaction control system and method. Background technique [0002] The master-slave teleoperated robotic arm control system is widely used in high-risk operations such as nuclear reactor maintenance, manned spaceflight, and medical surgery simulation training. The hand is the most commonly used part of the human body. Therefore, realizing the robot arm to follow the movement of the hand can greatly improve the human's perceptual ability and behavioral ability. It is of great theoretical and practical significance to study the various movements of the hand and the interaction between the hand and the robotic arm. [0003] At present, there are mainly two types of existing hand tracking and positioning technologies, which are based on data glove technology and gesture recognition based on imag...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G05B13/04G05D3/12
Inventor 林海波王浩张毅罗元谭帅周庭
Owner CHONGQING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap