Scene analysis method based on binocular vision, robot and storage device

An analysis method and binocular vision technology, applied in the field of visual recognition in the robot industry, can solve the problems of consuming computing resources, complicated calculations, cumbersome use, etc., and achieve the effects of simplified data calculations, accurate output results, and simplified operations

Active Publication Date: 2019-07-05
UBTECH ROBOTICS CORP LTD +1
View PDF8 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, scene analysis methods based on binocular vision often complete depth estimation and semantic segmen

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Scene analysis method based on binocular vision, robot and storage device
  • Scene analysis method based on binocular vision, robot and storage device
  • Scene analysis method based on binocular vision, robot and storage device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] The present invention will be described in detail below in conjunction with the accompanying drawings and embodiments.

[0022] see figure 1 , figure 1 It is a flowchart of an embodiment of the scene analysis method based on binocular vision in this application. It should be noted that if there are substantially the same results, the method of the present invention does not figure 1 The flow sequence shown is limited. Such as figure 1 As shown, the method includes the following steps:

[0023] S101: Acquire a first original image and a second original image corresponding to binocular vision, and respectively extract multi-scale features of the first original image and multi-scale features of the second original image.

[0024] Among them, binocular vision is a method of simulating the principle of human vision, based on the principle of parallax and using imaging equipment to obtain two images of the measured object from different positions, and by calculating the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a scene analysis method based on binocular vision, and the method comprises the steps: obtaining a first original image and a second original image corresponding to the binocular vision, and extracting the multi-scale features of the first original image and the multi-scale features of the second original image; combining the multi-scale feature of the first original imagewith the multi-scale feature of the second original image, performing depth estimation operation, and outputting primary depth estimation information of the first original image based on the combinedmulti-scale feature; performing semantic segmentation calculation by using the multi-scale features of the first original image, and outputting primary semantic segmentation information correspondingto the first original image; and fusing the primary depth estimation information, the primary semantic segmentation information and the multi-scale features of the first original image, and outputtingfinal depth estimation information and semantic segmentation information. The calculation efficiency can be improved, the calculation speed is increased, and the calculation precision is improved.

Description

technical field [0001] The present application relates to the field of visual recognition technology in the robot industry, in particular to a scene analysis method based on binocular vision, a robot and a storage device. Background technique [0002] Because binocular vision can overcome the interference of active light sources in the external environment, it has become a commonly used vision system solution, and it is used more and more in robots and drones. At the same time, since robots and drones need to operate autonomously in complex, changeable, uncertain or uncontrolled environments, they must have efficient recognition, perception, understanding, judgment and action capabilities for the surrounding environment and things. These factors make Robots and UAVs rely more and more on vision systems. Therefore, there is a need for a vision system that enables robots and drones to efficiently recognize and perceive the surrounding environment and things. At present, scen...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/62G06K9/46
CPCG06V10/40G06F18/2163G06F18/253
Inventor 熊友军谭圣琦潘慈辉王先基庞建新
Owner UBTECH ROBOTICS CORP LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap