Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Target positioning method based on RGBD

A target positioning and target technology, which is applied in the field of target positioning based on RGBD, can solve the problems of changes in the robot's mass distribution and balance conditions, the inability to meet the requirements of the robot's rapid movement, and the robot's inability to obtain its own position information. Interference with similar target colors, enhanced robustness and real-time performance, and fast calculation speed

Inactive Publication Date: 2017-02-08
FOSHAN NANHAI GUANGDONG TECH UNIV CNC EQUIP COOP INNOVATION INST
View PDF4 Cites 30 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] (1) GPS data is generally updated every 1 second, which cannot meet the requirements of fast movement of robots
[0004] (2) When the robot is in some specific postures, such as flying back, diving and weightlessness, it is often impossible to receive GPS signals
[0005] (3) In an indoor environment, the GPS signal cannot be received
[0006] When studying mobile robot control algorithms and environmental perception methods, it is often necessary to conduct experiments indoors. In indoor and some environments where GPS cannot be used, robots often cannot know their own location information, weather conditions, and cloud thickness may also affect GPS signals. take over
In addition, the change of the robot's own load will also change the mass distribution and balance conditions of the robot, making the control of the mobile robot more difficult.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Target positioning method based on RGBD
  • Target positioning method based on RGBD
  • Target positioning method based on RGBD

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0045] Embodiment: a kind of object localization method based on RGBD.

[0046] In the present embodiment, the second generation Kinect sensor is adopted, which includes an RGB camera, an infrared receiver, an infrared emitter and a microphone array, and the RGBD sensor world coordinate system is O n x n Y n Z n, referred to as the N coordinate system, the origin of the N coordinate system is the center point of the color camera of the sensor, the Z axis of the N coordinate system is perpendicular to the Kinect front panel, the X axis goes to the left along the front panel, and the Y axis goes down along the front panel.

[0047] refer to figure 1 As shown, an RGBD-based target positioning method includes the following steps:

[0048] Set up the hardware environment and initialize the device;

[0049] Use the RGBD sensor to obtain the depth image and color image of the aircraft in the current frame during flight, segment the depth image based on the depth data, obtain the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a target positioning method based on a RGBD, and the main steps comprise hardware environment arrangement and device initialization; the RGBD sensor is adopted to acquire depth data and color image of a mobile robot in current frame, a depth image is segmented based on the depth data to obtain a target region in the depth image, the target image is set as SearchRect_depth and is mapped to the color image, and the corresponding color image part is recorded as SearchRectROI; in the color image SearchRectROI, a CAMSHIFT method is utilized to calculate a position (x, y) of a target in the color image; the depth data is combined to calculate world coordinates (xw, yw, zw) of the current target; the world coordinates (xw, yw, zw) of the current target is transmitted to the mobile robot through a communication system, and the robot can control its self motion. According to the invention, the method has advantage of fast calculation speed, accurate positioning, strong adaptability for environment change and good expandability for different targets.

Description

technical field [0001] The invention belongs to the field of visual positioning, and in particular relates to an RGBD-based target positioning method. Background technique [0002] The positioning ability of a mobile robot is the basis and key to realize high-performance and high-precision navigation. It can move autonomously and complete a given task, and must obtain its own precise position and attitude in real time. At present, mobile robots are equipped with GPS and inertial navigation systems. Their technology is relatively mature, and many excellent products can be purchased easily. While GPS and inertial navigation systems have many advantages, there are also some disadvantages that deserve attention: [0003] (1) GPS data is generally updated every second, which cannot meet the requirements of fast movement of the robot. [0004] (2) When the robot is in some specific postures, such as flying backwards, diving and weightlessness, it is often impossible to receive G...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T7/11G06T7/187G06T7/70G06T7/246G06T1/00
CPCG06T1/0014G06T2207/10024
Inventor 李力彭博杨海东周艳红黄坤山
Owner FOSHAN NANHAI GUANGDONG TECH UNIV CNC EQUIP COOP INNOVATION INST
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products