Supercharge Your Innovation With Domain-Expert AI Agents!

Image depth calculation method, device, storage medium and electronic equipment

A technology of image depth and calculation method, applied in the field of computer vision, can solve the problems that terminal equipment cannot realize depth calculation, difficult depth calculation, and high computational complexity

Active Publication Date: 2021-08-24
SHENZHEN SENSETIME TECH CO LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the existing binocular stereo vision implementation scheme, the depth of field calculation has high computational complexity, and it is difficult to realize real-time depth of field calculation
Although the real-time calculation of the depth of field can be realized on the computer under the premise of losing a certain accuracy of the depth of field calculation, the same calculation method of the depth of field is still too complex due to the high computational complexity, so the terminal equipment with low computing power (such as mobile phones) Real-time depth of field calculation cannot be realized on

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image depth calculation method, device, storage medium and electronic equipment
  • Image depth calculation method, device, storage medium and electronic equipment
  • Image depth calculation method, device, storage medium and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0058] figure 1 It is a flow chart showing the image depth calculation method according to Embodiment 1 of the present invention.

[0059] refer to figure 1 , in step S110, based on the photographed at least two correlated view images, corresponding matching cost data is determined.

[0060] Here, at least two view images captured at the same position and in the same shooting direction are referred to as interrelated view images. For example, the above-mentioned two interrelated view images can be obtained by shooting with dual cameras set on the mobile phone; for another example, the same scene can be photographed at the same shooting angle by several camera devices arranged side by side to obtain multiple interrelated views image.

[0061] The image depth calculation method proposed in the embodiment of the present invention performs depth calculation on the previously captured at least two interrelated view images.

[0062] In this step, the matching cost data used to c...

Embodiment 2

[0068] figure 2 It is a flow chart showing the image depth calculation method according to Embodiment 2 of the present invention.

[0069] refer to figure 2 , in step S210, two interrelated view images captured by a binocular camera device are acquired, and the two view images have different resolutions.

[0070] Usually, a high-resolution view image captured by a camera device with a high shooting configuration is used as a main image, and a view image with a lower resolution captured by a camera device with a low shooting configuration is used as an auxiliary image.

[0071] In step S220, the two view images are calibrated so that the lines of the two view images are aligned.

[0072] Generally speaking, the two cameras in the binocular camera device are arranged in parallel. Therefore, when using, for example, a binocular camera device to capture two view images, there may be a pixel deviation between the captured two view images, that is The positions of the same pixe...

Embodiment 3

[0081] image 3 It is a flow chart showing the image depth calculation method according to Embodiment 3 of the present invention.

[0082] refer to image 3 , in step S310, based on the photographed at least two correlated view images, corresponding matching cost data is determined.

[0083] In step S320, a corresponding depth map is generated for a selected image among the at least two view images by using any of the aforementioned image depth calculation methods.

[0084] The selected image may be a main image taken by a binocular camera device, or one or both of a left view image and a right view image taken by a monocular camera device.

[0085] In step S330, perform depth-related processing on the selected image according to the depth map.

[0086] At this step, at least one of the following processes may be performed.

[0087]Optionally, in step S330, perform foreground and background segmentation processing on the selected image according to the depth map. Specific...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Embodiments of the present invention provide an image depth calculation method, device, storage medium and electronic equipment. The image depth calculation method includes: determining corresponding matching cost data based on at least two interrelated view images taken; Selected ones of the images generate corresponding depth maps. Therefore, a relatively high-accuracy depth map is obtained by designing the relatively miniaturized neural network model. On a terminal device with low computing power (such as a mobile phone), after obtaining at least two view images of the same scene captured by the camera device, the corresponding depth map can be generated immediately and quickly, so that the image can be processed according to the generated depth map. Perform various treatments.

Description

technical field [0001] Embodiments of the present invention relate to computer vision technology, and in particular to an image depth calculation method, device, computer-readable storage medium, and electronic equipment. Background technique [0002] Binocular stereo vision is an important form of machine vision, which uses imaging equipment to imitate two eyes to capture two images of the object under test to obtain three-dimensional geometric information of the object. Stereo vision has been more and more widely used in the fields of robot vision, medical imaging and industrial inspection. [0003] In the existing binocular stereo vision implementation scheme, the depth of field calculation has high computational complexity, and it is difficult to realize real-time depth of field calculation. Although the real-time calculation of the depth of field can be realized on the computer under the premise of losing a certain accuracy of the depth of field calculation, the same c...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T7/593G06N3/08
CPCG06N3/08G06T2207/10012G06T7/593
Inventor 任思捷陈晓濠孙文秀庞家昊严琼
Owner SHENZHEN SENSETIME TECH CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More