Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

ROS platform online mechanical arm demonstration system based on human body posture recognition

A technology of human body posture and robotic arm, applied in the field of ROS platform online robotic arm teaching system, can solve the problem of low control accuracy, achieve high precision, reduce technical level requirements and system cost, and improve accuracy

Active Publication Date: 2019-08-20
ZHEJIANG UNIV OF TECH
View PDF7 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The gesture control-based manipulator teaching system designed by application number 201711088599.9 also adopts the method of installing sensors on the working end to obtain motion information, but the control accuracy is not high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • ROS platform online mechanical arm demonstration system based on human body posture recognition

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] Embodiments of the present invention will be described in further detail below in conjunction with the accompanying drawings.

[0025] An online manipulator teaching system on the ROS platform based on human body posture recognition, such as figure 1 As shown, it includes two color cameras Microsoft KinectV2, five IMUs based on JY901 and Bluetooth modules, one computer with Ubuntu system installed, and one UR5 robotic arm produced by Universal Robots. The camera and the computer transmit data through a USB connection, the IMU and the computer transmit data through Bluetooth, and the robotic arm is connected to the computer through a local area network. The CPU of the computer in this system uses Intel Core i7-7800K 3.50Ghz, and the GPU uses Nvidia TITAN Xp.

[0026] combine figure 1 , the principle and application process of the patent of the present invention are as follows:

[0027] The image preprocessing module first takes the AR logo ArUco Marker#0 recognized by...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a ROS platform online mechanical arm demonstration system based on human body posture recognition. The system is built on an open source robot operation platform ROS, comprisesan IMU module, an image pre-processing module, a joint identification module, a human body posture solving module, a robot behavior decision-making module and a robot IO module, wherein the IMU module, the image pre-processing module and the joint identification module are used for acquiring human body posture data, the human body posture solving module is used for solving a real-time posture andposition of a human body, the robot behavior decision-making module is used for controlling a mechanical arm to act, and the robot decision-making module sends out a control instruction according toobtained human body posture data, and the instruction is sent to the mechanical arm through the robot IO module so as to realize real-time teaching; and the invention further comprises an informationdisplay module. According to the system, the invention provides an online mechanical arm teaching system which is characterized in that low in technological level of operating personnel, high in precision and small in operation environment limit.

Description

technical field [0001] The present invention designs an online manipulator teaching system, especially an online manipulator teaching system based on human body posture recognition on the ROS platform. Background technique [0002] In recent years, my country's robot industry has developed rapidly. Led by cities in the Yangtze River Delta and Pearl River Delta regions, 36 cities across the country have taken robots as the focus of local industry development, and the amount of financial subsidies has increased significantly. The provincial finance of Zhejiang Province has allocated nearly 600 million funds to support the technological transformation of "machine replacement", and introduced a policy of incentives and subsidies for the purchase of industrial robots. The province and the local government will match each other at a ratio of 1:2, and the purchase of industrial robots will be subsidized by 10% of the price. According to forecasts, the market size of industrial robo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): B25J9/22B25J9/16
CPCB25J9/0081B25J9/16B25J9/1664
Inventor 禹鑫燚胡晨佳董云帆欧林林王正安周晨章焕锭
Owner ZHEJIANG UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products