Reward in image description model and construction method of image description model

An image description and construction method technology, applied in the field of reward and image description model construction, can solve the problem of low accuracy of image description, achieve the effect of solving the problem of uneven word distribution, improving accuracy and reducing correlation

Active Publication Date: 2019-08-16
暗物智能科技(广州)有限公司
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In view of this, the embodiment of the present invention provides a reward and image description model construction method in the image description model to solve the problem of low accuracy of image description

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Reward in image description model and construction method of image description model
  • Reward in image description model and construction method of image description model
  • Reward in image description model and construction method of image description model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0078] In order to make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of the embodiments of the present invention, not all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work shall fall within the protection scope of the present invention.

[0079] To clearly describe the embodiments of the present invention, some terms involved in the embodiments of the present invention are explained as follows:

[0080] (1) Training set: A collection of several images, each image corresponds to a certain number of label descriptions; for example, each image in the training set corresponds to 5 lab...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of image description, in particular to a reward in an image description model and a construction method of the image description model, and the construction method of the reward comprises the steps: obtaining label description of a test image and generation description of a preset image description model based on the test image; based on the label description and the generation description, calculating a reward of the n-tuple in the generation description; comparing the size relationship between the reward of the n-tuple and the first threshold value with the size relationship between the reward of each word in the n-tuple and the second threshold value so as to screen out the word with the reward to be increased in the generated description; and according to the label description and the reward of the n-tuple corresponding to the word with the reward to be increased, calculating the reward of the word with the reward to be increased. According to the method, higher rewards are given to words which are not frequently appeared to realize constraint, so that the problem of non-uniform word distribution can be well solved, more specific visual details of an image can be captured, and the description accuracy of the image can be improved.

Description

Technical field [0001] The present invention relates to the technical field of image description, in particular to a method for constructing a reward in an image description model and an image description model. Background technique [0002] The task of image description is a common task in daily life. Its purpose is to generate a natural language description that complies with grammatical rules to describe the content of the image based on the content of the image. This task can be applied to early childhood education, navigation and guidance in real life. [0003] The intersection of computer vision and natural language processing is the two major areas of artificial intelligence. Although both areas use similar artificial intelligence and machine learning methods for field research, there is still very little interaction between the two areas. However, in recent years, the fields of natural language processing and computer vision have made tremendous progress in analyzing and ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06N3/04G06N3/08G06F16/583
CPCG06N3/08G06F16/583G06N3/045G06F18/22
Inventor 陈添水吴捷梁小丹林倞
Owner 暗物智能科技(广州)有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap