Three-dimensional target detection method and device and storage medium

A technology for three-dimensional targets and target objects, applied in the field of three-dimensional target detection methods, devices and storage media, can solve the problems of small field of view, low cost, complicated installation of monocular cameras, etc., to improve efficiency and accuracy, and reduce use costs Effect

Active Publication Date: 2020-05-08
JINGDONG TECH HLDG CO LTD
View PDF3 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, most 3D object detection methods rely on lidar data to provide accurate depth information in autonomous driving scenarios, but lidar is expensive and has a relatively small field of view; monocular cameras are complex to install and low in cost, but currently There is no 3D target detection technology solution based on monocular vision

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional target detection method and device and storage medium
  • Three-dimensional target detection method and device and storage medium
  • Three-dimensional target detection method and device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] The present disclosure will be described more fully hereinafter with reference to the accompanying drawings, in which exemplary embodiments of the present disclosure are illustrated. The following will clearly and completely describe the technical solutions in the embodiments of the present disclosure with reference to the accompanying drawings in the embodiments of the present disclosure. Apparently, the described embodiments are only some of the embodiments of the present disclosure, not all of them. Based on the embodiments in the present disclosure, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present disclosure.

[0037] The "first", "second" and so on in the following are only used to describe the difference, and have no other special meanings.

[0038] According to the different output results of target detection, 2D target detection usually uses RGB images for target ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a three-dimensional target detection method and device and a storage medium, and the method comprises the steps: setting a first coordinate center of a target object in a monocular image as a second coordinate center of a 3D bounding box; setting space coordinate constraints of the 3D bounding box according to external parameters and internal parameters, setting a directionloss function and a size loss function of the 3D bounding box, and generating a model loss function; and training the convolutional neural network model by using the monocular image training sample and based on the spatial coordinate constraint and the model loss function so as to perform three-dimensional target detection processing on the monocular image. The spatial coordinate constraint, the direction loss function and the size loss function are set, and the convolutional neural network model is trained to construct the multi-task neural network, so that 3D target detection of a monocularimage can be realized; the efficiency and precision of three-dimensional target detection can be improved, and the use cost is reduced.

Description

technical field [0001] The present invention relates to the technical field of image processing, in particular to a three-dimensional object detection method, device and storage medium. Background technique [0002] Target detection is a traditional task in the field of computer vision. Different from image recognition, target detection not only needs to identify the objects existing on the image and give the corresponding category, but also needs to pass the position of the object through the minimum bounding box (Bounding box) way give. At present, most 3D object detection methods rely on lidar data to provide accurate depth information in autonomous driving scenarios, but lidar is expensive and has a relatively small field of view; monocular cameras are complex to install and low in cost, but currently There is no technical solution for 3D object detection based on monocular vision. Contents of the invention [0003] In view of this, a technical problem to be solved b...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06N3/04G06N3/08
CPCG06N3/08G06V20/64G06N3/045
Inventor 毛伟裴积全吕军张凡
Owner JINGDONG TECH HLDG CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products