Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Binocular vision environment detection system and method based on tactile perception

A binocular vision and tactile perception technology, which is applied in image data processing, instruments, computing, etc., can solve the problems that low-resolution images cannot effectively extract image edge feature points, and cannot use disparity maps.

Inactive Publication Date: 2019-07-26
王荩立
View PDF15 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0017] The present invention provides a binocular visual environment detection system based on tactile perception, aiming at the high noise and low resolution images obtained by existing robots in low-light or no-light environments, which cannot effectively extract image edge feature points, and cannot use The stereo matching method of binocular vision obtains the disparity map, so as to construct the three-dimensional information of the robot's surrounding environment. This system divides the high-noise and low-resolution images into adjacent statistical characteristic loss areas, so that it can The shared sides of the adjacent statistical property loss areas form the shortest curved path for the robot to walk, and then use the tactile sensor to collect the surface information of the object based on this shortest curved path to compensate for the statistical property loss area to generate a stable support point, so that the support point-based The binocular vision stereo matching method is used to obtain the disparity map, and then the three-dimensional information of the robot's surrounding environment can be obtained through the disparity map to construct the corresponding environment model in real time to realize detection.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Binocular vision environment detection system and method based on tactile perception
  • Binocular vision environment detection system and method based on tactile perception
  • Binocular vision environment detection system and method based on tactile perception

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0048] This embodiment discloses an environment perception system, which can also be an environment detection system based on binocular vision, or an environment detection system based on robot binocular vision perception. The system can be composed of the system of the present invention and / or other Alternative component implementations. For example, the system of the present invention is realized by using various components in the system of the present invention. In the case of no conflict or contradiction, the whole and / or part of the content of the preferred implementations of other embodiments may serve as supplements to this embodiment.

Embodiment approach

[0049] According to a preferred embodiment, a binocular vision environment detection system based on tactile perception at least includes a robot body used for archaeological excavation. Preferably, the robot body can be a hexapod robot. The main body of the robot can also be a multi-legged robot with four legs, eight legs or more legs. The main body of the robot can also be a multi-legged robot with manipulators.

[0050] Preferably, as figure 1As shown, the main body of the robot includes a camera 1 , a touch sensor 2 and a processor 3 . Preferably, the camera device 1 may be a camera device in the visible light band. The imaging device 1 may also be an infrared imaging device in the infrared band. Preferably, the main body of the robot further includes a plurality of imaging devices 1 at different positions for imaging. For example, two camera devices 1 in the same horizontal direction can obtain left and right visual image pairs. The main body of the robot may also i...

Embodiment 2

[0090] This embodiment is a binocular visual environment detection method based on tactile perception corresponding to Embodiment 1, and repeated content will not be repeated.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a binocular vision environment detection system and method based on tactile perception. The system at least comprises a robot main body for archaeological excavation, the robot body comprises a camera device, a tactile sensor and a processor. The processor is configured to: statistical characteristic loss areas adjacent to each other are divided based on at least two visual images with parallax values collected by the camera device so as to form a curve path where the robot body walks, and the tactile information collected by the tactile sensor and related to the curvepath are associated with prior information to generate an object surface statistical feature point set, thereby compensating the features of the statistical feature loss area to extract image edge feature points.

Description

technical field [0001] The invention belongs to the field of archaeological excavation, and relates to an environment perception system, in particular to a binocular vision environment detection system and method based on tactile perception. Background technique [0002] At present, there are a large number of ancient buildings in our country that have not been excavated, especially the ancient buildings in a dangerous environment. For example, due to the long-term closed state of the ancient tomb buildings in the ground, the interior of the ancient buildings has formed a unique ecological environment. Corpses and other substances decayed day by day, and the oxygen in the ancient buildings was exhausted. At the same time, various harmful gases, such as carbon dioxide, hydrogen sulfide, sulfur dioxide, and methane, flooded the ancient buildings. Some ancient buildings such as tombs may also have mercury vapor, and the dark and humid environment underground can also breed mic...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/33G06T7/13
CPCG06T2207/20081G06T7/13G06T7/33
Inventor 王荩立
Owner 王荩立
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products