An image abstract generation method based on object detection

An image abstraction and target detection technology, applied in biological neural network models, instruments, character and pattern recognition, etc., can solve the problems of computer hardware consumption, waste of resources, poor flexibility, etc., and achieve the effect of reducing the amount of calculation and waste.

Pending Publication Date: 2019-03-29
NORTH CHINA UNIVERSITY OF TECHNOLOGY
View PDF3 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The above-mentioned methods have their own advantages, but their shortcomings are also very obvious. The template-based method has a single sentence pattern, and the method based on the transfer title generation strategy is very inflexible. Although the traditional deep learning method is effective, However, the global information of the entire image is used, resulting in a waste of resources, which is a great consumption of computer hardware.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An image abstract generation method based on object detection
  • An image abstract generation method based on object detection
  • An image abstract generation method based on object detection

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] The technical solution of this patent will be further described in detail below in conjunction with specific embodiments.

[0024] see Figure 1-7 , an image summary generation method based on target detection, including image local area feature extraction, attention mechanism system and image description generation, the image local area feature extraction is connected to the attention mechanism system, and the attention mechanism system is connected to the image description generation Connected; the feature extraction of the image local area can extract the image features of the relevant area from the pre-trained network, and then combine the extracted image features with the attention mechanism for weighted calculation, and finally send them to the image description generation system to generate sentences.

[0025] Such as figure 2 As shown, the image local area feature extraction adopts the Faster RCNN detection method to extract image area features, and the Faster...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an image abstract generation method based on object detection, which comprises the following steps: feature extraction of image local area, attention mechanism system and imagedescription generation. The feature extraction of image local area is connected with the attention mechanism system, and the attention mechanism system is connected with the image description generation. The image local region feature extraction adopts Faster RCNN detection method to extract image region feature, and Faster RCNN consists of three parts: original image feature extraction, RPN network and ROI pooling. The present invention applies the object detection algorithm to the image summary task, and uses the local area image feature to represent the whole image, which greatly reduces the calculation amount and the waste of resources without losing the image information. The invention expands the research thought of the image summary task, and has certain reference value for the research of the image summary task.

Description

technical field [0001] The invention relates to the technical field of computer image processing, in particular to an image summary generation method based on target detection. Background technique [0002] Due to the rapid development of artificial intelligence, the use of deep learning methods to solve problems has become a hot topic. Image summarization is a comprehensive problem that combines computer vision and natural language processing. It is similar to translating an image into a description. For humans, this task is very easy, but it is very challenging for machines. The machine not only needs to use the model to understand the content of the picture, but also needs to use natural language to express the relationship between them. In addition, the model also needs It is not easy for machines that cannot think independently to be able to capture the semantic information of images and generate human-readable sentences. The image summarization task is of great signi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/46G06K9/32G06N3/04
CPCG06V10/25G06V10/44G06V2201/07G06N3/045
Inventor 曹丹阳高磊朱孟贵候建峰任旭
Owner NORTH CHINA UNIVERSITY OF TECHNOLOGY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap