Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Mobile terminal-oriented instance-level image retrieval method and device

An image retrieval and instance-level technology, applied in still image data retrieval, digital data information retrieval, still image data clustering/classification, etc., can solve redundancy and other problems, and achieve the effect of reducing model size and parameter quantity

Pending Publication Date: 2022-04-15
ZHEJIANG UNIV OF TECH
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, many typical lightweight neural networks have been proposed in the industry, such as MobileNetV2. Although the network reduces parameters and calculations, it still has a lot of redundancy.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mobile terminal-oriented instance-level image retrieval method and device
  • Mobile terminal-oriented instance-level image retrieval method and device
  • Mobile terminal-oriented instance-level image retrieval method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, not to limit the present application.

[0021] An instance-level image retrieval method for mobile terminals proposed in this application realizes offline deployment of deep learning models on mobile terminals, completes image retrieval tasks, and creates a paradigm for the application of deep models on edge devices. This application proposes a lightweight neural network classification model LMNV2 that is more concise and efficient than MobileNetV2, which not only improves the retrieval accuracy, but also greatly reduces the computational overhead and memory usage of the model. The method includes five processes of network const...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a mobile terminal-oriented instance level image retrieval method and device, and the method comprises the steps: constructing and training a lightweight neural network classification model which comprises an embedded layer, a convolution attention module, seven bottleneck blocks, a full connection layer, a convolution attention module, a binary adaptive mean pooling layer and a classifier; and removing the last layer of classifier of the lightweight neural network classification model to serve as a feature extractor, extracting the image features of the to-be-retrieved image by adopting the feature extractor, calculating the Euclidean distance between the image features of the to-be-retrieved image and the image features of the retrieval data set image, and outputting the retrieval data set image corresponding to the minimum Euclidean distance. According to the method, the problem that a deep neural network model is difficult to deploy in mobile equipment in deep learning is solved, and the lightweight neural network is successfully realized in an image retrieval task at a time.

Description

technical field [0001] The present application belongs to the technical field of image retrieval, and in particular relates to an instance-level image retrieval method and device for mobile terminals. Background technique [0002] Content-based image retrieval, by extracting the visual information of images, can quickly and accurately retrieve the images needed by users from a large number of digital images. This research has great value both in the research field and in commercial applications. In recent years, with the rapid development of deep learning methods, thanks to the accurate expression of image content by deep features, significant progress has been made in using deep learning models to retrieve images. [0003] However, the computation and parameters of most convolutional neural networks are large, and most state-of-the-art convolutional neural networks are difficult to deploy on resource-constrained mobile devices due to the limitations of storage space and pow...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/55G06F16/583G06V10/74G06K9/62G06N3/04
Inventor 白琮张晓青陈胜勇
Owner ZHEJIANG UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products