Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

An Image Retrieval Method Based on Object Detection

A technology of object detection and image retrieval, which is applied in Internet image data retrieval and image retrieval based on object detection, can solve the problems of not so many images, high subjective awareness, and inaccurate image segmentation, so as to improve the flexibility and accuracy of retrieval Accuracy, improved retrieval speed and efficiency, and flexible retrieval methods

Active Publication Date: 2020-04-14
XIDIAN UNIV
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Text-based image retrieval uses keywords to annotate images. When users perform image retrieval, they mainly search for tags in matching images, but it has many disadvantages: the text keywords describing images are manually added, and the subjective consciousness is too large. large; the text description cannot express the rich meaning of the image at all, and it is difficult to accurately retrieve the images in the database only in the form of keywords; So much effort to label each image with text, the cost is too high
The disadvantage of this method is that the image segmentation is not accurate enough. The extracted features are low-level features such as color features and texture features. The features are extracted and retrieved for the entire image, and there is no single object retrieval in the image.
The disadvantage of this method is that it only considers the color and spatial information of the object for retrieval. When the number of images is large, too many features are extracted, and the retrieval of a single object in the image is not considered.
When the query image is input, feature extraction and retrieval are performed on the entire image or the main part of the image, and multiple objects in the image are not considered to be detected and features are extracted and retrieved separately. The method is not flexible and accurate enough.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An Image Retrieval Method Based on Object Detection
  • An Image Retrieval Method Based on Object Detection
  • An Image Retrieval Method Based on Object Detection

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0035] In the existing image retrieval, the underlying features such as color, texture, shape and SIFT in the image are extracted, and then the image retrieval is performed, and multiple objects in the image are not considered to be detected and the features are extracted and retrieved separately. The method is not flexible enough and precise. With the development of science and technology, people obtain a large number of images from mobile phones, cameras, and the Internet. By processing and retrieving images through technologies such as big data and AI, a lot of useful information can be mined from images. After research, the present invention proposes an image retrieval method based on object detection. The present invention can search for a specific object in an image and find similar objects in other images. For example, in the field of security, according to the photos of criminal suspects, quickly find criminal suspects in a large number of images and obtain timely clue...

Embodiment 2

[0050] The image retrieval method based on object detection is the same as in embodiment 1. In the present invention, the method based on object detection is used to obtain the visual word of the object in the query image. In step 1, the YOLO method is used to detect the object in the query image, and the object in the query image is detected. The process of 1 or more objects, including:

[0051] 1.1, use the VOC2007 dataset to train the YOLO network to obtain weight parameters; YOLO is a method of object detection and a deep learning network.

[0052] 1.2. Input the query image into the trained YOLO network, and perform object detection on the query image. If there are one or more objects in the query image, mark the position of the object with a rectangular frame. The position information includes the center of the object. The coordinates of the point, the width and height of the rectangle, and the object category.

[0053] 1.3. Output the result, get the position informati...

Embodiment 3

[0056] The image retrieval method based on object detection is the same as that described in embodiment 1-2, step 2, extracting SIFT features and MSER features, specifically including:

[0057] 2.1, read the position information of the object in the query image;

[0058] 2.2. Extract the SIFT (Scale-invariant feature transform) feature of the position of the object in the image;

[0059] 2.3. Extract the MSER (Maximally Stable Extremal Regions) feature of the position of the object in the image.

[0060] According to the characteristics of the detected object in the image extracted by object detection, the present invention can separately retrieve each object in the image and find similar objects in other images instead of the whole image, and the retrieval method is more flexible.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an image retrieval method based on object detection, which solves the problem that multiple objects in the image are not retrieved separately during image retrieval. Its implementation is: perform object detection on the image in the image database, and detect one or more objects in the image; extract the SIFT and MSER features of the detected object and combine them to generate a feature beam; use K-means and k-d tree Generate visual words from feature bundles; create visual word indexes of objects in the image database by inverted index, and generate image feature databases; use object detection method to generate visual words by querying objects in images, and query visual words of images and image feature databases Perform similarity comparison, and output the one with the highest score as the result of image retrieval. The invention can separately retrieve a plurality of objects in an image, reduces background interference and image semantic gap, and improves accuracy, retrieval speed and efficiency; it is used for image retrieval of a specific object in an image, including a person.

Description

technical field [0001] The invention belongs to the technical field of computer image processing, and mainly relates to image retrieval, in particular to an image retrieval method based on object detection, which can be used for Internet image data retrieval. Background technique [0002] With the advent of the information society and the popularization of computer applications, people are more and more exposed to a large amount of information, among which multimedia information is the most widely accessible information resource. It exists in various forms and grows at an explosive rate as technology advances. Especially in recent years, the application and development of the Internet has further promoted the rapid growth of the data volume of multimedia information. In the face of massive data, people are often at a loss. The rapid growth of information makes people's demand for multimedia information retrieval increase rapidly, so image retrieval technology has become one...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/583G06K9/62
CPCG06F16/5838G06F18/23
Inventor 吴炜张宇沙丽娜
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products