Human-computer cooperation system based on Kinect skeletal tracking and uncalibrated visual servo

A technology of visual servoing and human-computer collaboration, applied in the direction of manipulators, manufacturing tools, etc., can solve the problems of poor working and experience effects of human-computer interaction technology, improve efficiency and flexibility, improve stability, and improve intelligence Effect

Active Publication Date: 2017-03-22
BEIJING INSTITUTE OF TECHNOLOGYGY
View PDF8 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the face of a complex working environment, such human-computer interaction technology has poor working and experience

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Human-computer cooperation system based on Kinect skeletal tracking and uncalibrated visual servo

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] The present invention will be described in detail below with reference to the accompanying drawings and examples.

[0019] The invention provides a human-machine collaboration system based on Kinect skeleton tracking and uncalibrated visual servo, including: a robot, a human-computer interaction control module, an information collection module and an intelligent control module;

[0020] Its peripheral equipment is a workbench, which is used to provide a place for the robot to complete work tasks;

[0021] Described human-computer interaction control module comprises Kinect and remote control unit, and described Kinect gathers the posture information of human skeleton by its camera, and this posture information is transmitted to remote control unit, and remote control unit transfers this posture information again To the intelligent control module; wherein, the pose information is an interactive signal for controlling the movement of the robot;

[0022] After the informa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a human-computer cooperation system based on Kinect skeletal tracking and uncalibrated visual servo and belongs to the technical field of human-computer cooperation. The human-computer cooperation system comprises a robot, a human-computer interaction control module, an information collection module and an intelligent control module. The human-computer interaction module comprises a Kinect and a remote control unit. The Kinect collects the pose information of a human body skeleton through a Kinect camera and transmits the pose information to the remote control unit, and then the remote control unit transmits the pose information to the intelligent control module. After the information collection module collects the information of a robot specific work task scene on a workbench through the camera, the information is sent to the intelligent control module. After receiving and processing the pose information and the image information, the intelligent control module obtains a movement instruction of the robot and sends the movement instruction to the robot. According to the human-computer cooperation system based on Kinect skeletal tracking and uncalibrated visual servo, the untouched control of human body action to the robot is achieved through the Kinect skeletal tracking technology.

Description

technical field [0001] The invention belongs to the technical field of human-computer cooperation, and in particular relates to a human-computer cooperation system based on Kinect skeleton tracking and uncalibrated visual servoing. Background technique [0002] Robots have the advantages of high work efficiency, stability and reliability, good repeatability, and the ability to operate in high-risk environments. They can play an important role in the transformation and upgrading of traditional manufacturing industries, especially labor-intensive industries. Both "Industry 4.0" and "Made in China 2015" proposed smart manufacturing and smart factories, with the goal of establishing a highly flexible production model of personalized and digital products and services. In the past few decades of industrial manufacturing, the scope of work of robots and humans is relatively independent. Traditional industrial robots cannot meet the complex, flexible, individualized and customized ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): B25J11/00
CPCB25J11/0005
Inventor 马宏宾王浩周浩陈孙杰
Owner BEIJING INSTITUTE OF TECHNOLOGYGY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap