Intelligent home service robot based on three-dimensional machine vision

A service robot and machine vision technology, applied in manipulators, program-controlled manipulators, manufacturing tools, etc., can solve problems such as limited functions, poor accuracy and flexibility, and cannot be called intelligent robots, and achieve enhanced functions and improved practicality. sexual effect

Active Publication Date: 2016-03-02
QILU UNIV OF TECH
View PDF11 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] At present, the known household robots can only perform simple household cleaning, without the addition of multi-sensory systems such as vision and hearing, and the functions they can provide are limited, so they cannot be called intelligent robots.
In terms of monitoring, there is currently no non-invasive product that can provide the function of following monitoring; in terms of picking up objects, the current picking up robots are less accurate and flexible

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Intelligent home service robot based on three-dimensional machine vision
  • Intelligent home service robot based on three-dimensional machine vision
  • Intelligent home service robot based on three-dimensional machine vision

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0013] (1) Attitude acquisition and processing module

[0014] 3D stereo vision dynamic acquisition and analysis. The three-dimensional stereo vision acquisition equipment is used to realize the dynamic establishment and recognition of three-dimensional space data, especially the recognition function of the human body's movement posture. Identify the skeleton information in the 3D image and return the key joint coordinates, and then judge the target posture and motion trend through the combination of the 3D coordinates of each joint and time. The flow chart of this module is figure 2 .

[0015] (2) Communication module

[0016] The upper computer communicates with people through the Internet and cellular mobile network. The upper computer is equipped with a WIFI module and a GSM wireless module. When the elderly suffer from sudden collapse, they can send distress information to the elderly and children through the Internet or short messages in time.

[0017] (3) Follow tr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a home service robot based on three-dimensional vision, and particularly relates to a method for monitoring a target, and taking an article according to a command. In the method, the skeleton and the posture of the target are identified by virtue of an RGB-D sensor, and recorded in real time, an alarming action is made in case of accidental falling-down of the target, the bit number of the recorded data is far less than that of the recorded video image, and a scene in case of accidental falling-down can be restored; and a gesture indication direction of a user can also be identified by virtue of the RGB-D sensor to obtain the approximately angular coordinates of the article to be taken, and the article can be rapidly and accurately taken in combination with a voice command. A Mecanum wheel omnidirectional moving platform is used, and can realize follow-up movements with various tracks under a complex indoor environment.

Description

technical field [0001] The invention relates to a robot device for providing home service, in particular to a home robot capable of intelligently fetching objects and monitoring falls of the elderly. Background technique [0002] At present, the known household robots can only perform simple household sanitation and cleaning without the addition of multi-sensory systems such as vision and hearing, and the functions they can provide are limited, so they cannot be called intelligent robots. In terms of monitoring, there is currently no non-invasive product that can provide the function of following monitoring; in terms of picking up objects, the current picking up robots are less accurate and flexible. [0003] The emergence of RGB-D sensors has brought new development opportunities for human gesture recognition and object segmentation and positioning. In gesture recognition, it can obtain human skeleton information, including some gestures, so as to realize gesture recognitio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): B25J9/00B25J19/04B25J9/16
CPCB25J9/0003B25J9/1697B25J19/04
Inventor 王庆祥孙兆政段延娟
Owner QILU UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products