Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image description generation method and device

An image description and target image technology, applied in the field of image processing, can solve problems such as inability to accurately represent high-level semantic information, poor image description accuracy, etc.

Pending Publication Date: 2021-03-16
FUDAN UNIV
View PDF5 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The embodiment of the present application provides a method and device for generating an image description to solve the technical problems existing in the existing methods that cannot accurately represent the relatively complex high-level semantic information in the image, and the accuracy of the generated image description is poor, and achieve It can efficiently generate image descriptions that can accurately represent the high-level semantic information in the target image

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image description generation method and device
  • Image description generation method and device
  • Image description generation method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] In order to enable those skilled in the art to better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described The embodiments are only some of the embodiments of the present application, but not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall fall within the scope of protection of this application.

[0035] After creative thinking, the applicant considers that most of the existing image description generation methods rely on the scene graph to integrate the objects in the image to be processed and the relationship information between objects, and extract the corresponding regional features based on the scene graph , recorded as region...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides an image description generation method and device, and the method comprises the steps: obtaining object data and relation data in a target image; determining theme data of the target image according to the object data and the relation data; calling a pre-trained image processing model to obtain and implicitly deduce high-level semantic information in the target image through bottom-level representation according to the data so as to generate image description corresponding to the target image, wherein the pre-trained image processing model has the capability of abstracting the underlying representation. The method comprises the following steps: abstracting theme data from object data and relational data, and determining image description of a targetimage according to the theme data, the object data and the relational data by utilizing a pre-trained image processing model containing theme nodes; therefore, the image description capable of accurately representing the high-level semantic information in the target image can be efficiently obtained.

Description

technical field [0001] The present application relates to the technical field of image processing, in particular to a method and device for generating an image description. Background technique [0002] When applying existing image description generation methods to generate image descriptions for describing semantic information in images, most of them obtain corresponding scene graphs based on images, and then generate corresponding image descriptions based on the regional features and text features of the scene graph. . [0003] However, based on the above methods, only relatively simple low-level semantic information can be represented, but the more complex and important high-level semantic information in the image cannot be accurately represented. [0004] For the above problems, no effective solution has been proposed yet. Contents of the invention [0005] The embodiment of the present application provides a method and device for generating an image description to s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06N3/044G06N3/045G06F18/214Y02T10/40
Inventor 魏忠钰范智昊
Owner FUDAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com