Image retrieval method based on object detection

An object detection and image retrieval technology, applied in special data processing applications, instruments, electrical digital data processing, etc., can solve the problems of not having so many images, large subjective consciousness, and inaccurate image segmentation, so as to improve retrieval flexibility and efficiency. Accuracy, improving retrieval speed and efficiency, and the effect of flexible retrieval methods

Active Publication Date: 2017-10-17
XIDIAN UNIV
View PDF7 Cites 28 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Text-based image retrieval uses keywords to annotate images. When users perform image retrieval, they mainly search for tags in matching images, but it has many disadvantages: the text keywords describing images are manually added, and the subjective consciousness is too large. large; the text description cannot express the rich meaning of the image at all, and it is difficult to accurately retrieve the images in the database only in the form of keywords; So much effort to label each image with text, the cost is too high
The disadvantage of this method is that the image segmentation is not accurate enough. The extracted features are low-level features such as color features and texture features. The features are extracted and retrieved for the entire image, and there is no single object retrieval in the image.
The disadvantage of this method is that it only considers the color and spatial information of the object for retrieval. When the number of images is large, too many features are extracted, and the retrieval of a single object in the image is not considered.
When the query image is input, feature extraction and retrieval are performed on the entire image or the main part of the image, and multiple objects in the image are not considered to be detected and features are extracted and retrieved separately. The method is not flexible and accurate enough.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image retrieval method based on object detection
  • Image retrieval method based on object detection
  • Image retrieval method based on object detection

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0035] In the existing image retrieval, the underlying features such as color, texture, shape and SIFT in the image are extracted, and then the image retrieval is performed, and multiple objects in the image are not considered to be detected and the features are extracted and retrieved separately. The method is not flexible enough and precise. With the development of science and technology, people obtain a large number of images from mobile phones, cameras, and the Internet. By processing and retrieving images through technologies such as big data and AI, a lot of useful information can be mined from images. After research, the present invention proposes an image retrieval method based on object detection. The present invention can search for a specific object in an image and find similar objects in other images. For example, in the field of security, according to the photos of criminal suspects, quickly find criminal suspects in a large number of images and obtain timely clue...

Embodiment 2

[0050] The image retrieval method based on object detection is the same as in embodiment 1. In the present invention, the method based on object detection is used to obtain the visual word of the object in the query image. In step 1, the YOLO method is used to detect the object in the query image, and the object in the query image is detected. The process of 1 or more objects, including:

[0051] 1.1, use the VOC2007 dataset to train the YOLO network to obtain weight parameters; YOLO is a method of object detection and a deep learning network.

[0052] 1.2. Input the query image into the trained YOLO network, and perform object detection on the query image. If there are one or more objects in the query image, mark the position of the object with a rectangular frame. The position information includes the center of the object. The coordinates of the point, the width and height of the rectangle, and the object category.

[0053] 1.3. Output the result, get the position informati...

Embodiment 3

[0056] The image retrieval method based on object detection is the same as that described in embodiment 1-2, step 2, extracting SIFT features and MSER features, specifically including:

[0057] 2.1, read the position information of the object in the query image;

[0058] 2.2. Extract the SIFT (Scale-invariant feature transform) feature of the position of the object in the image;

[0059] 2.3. Extract the MSER (Maximally Stable Extremal Regions) feature of the position of the object in the image.

[0060] According to the characteristics of the detected object in the image extracted by object detection, the present invention can separately retrieve each object in the image and find similar objects in other images instead of the whole image, and the retrieval method is more flexible.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an image retrieval method based on object detection. The method is used for solving the problem that multiple objects in an image are not retrieved respectively during image retrieval. According to the implementation process of the method, object detection is performed on an image in an image database, and one or more objects in the image are detected; SIFT features and MSER features of the detected objects are extracted and combined to generate feature bundles; a K mean value and a k-d tree are adopted to make the feature bundles into visual words; visual word indexes of the objects in the image database are established through reverse indexing, and an image feature library is generated; and an object detection method is used to make objects in a query image into visual words, similarity compassion is performed on the visual words of the query image and the visual words of the image feature library, and the image with the highest score is output to serve as an image retrieval result. Through the method, the objects in the image can be retrieved respectively, background interference and image semantic gaps are reduced, and accuracy, retrieval speed and efficiency are improved; and the method is used for image retrieval on a specific object in the image, including a person.

Description

technical field [0001] The invention belongs to the technical field of computer image processing, and mainly relates to image retrieval, in particular to an image retrieval method based on object detection, which can be used for Internet image data retrieval. Background technique [0002] With the advent of the information society and the popularization of computer applications, people are more and more exposed to a large amount of information, among which multimedia information is the most widely accessible information resource. It exists in various forms and grows at an explosive rate as technology advances. Especially in recent years, the application and development of the Internet has further promoted the rapid growth of the data volume of multimedia information. In the face of massive data, people are often at a loss. The rapid growth of information makes people's demand for multimedia information retrieval increase rapidly, so image retrieval technology has become one...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06K9/62
CPCG06F16/5838G06F18/23
Inventor 吴炜张宇沙丽娜
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products