Method and system for estimating semantic similarity among music and images

A technology of acquaintance and image, applied in image analysis, image data processing, calculation, etc., can solve the problem of inaccurate recognition of music and images, and achieve accurate estimation

Active Publication Date: 2014-05-14
汤晓鸥
View PDF4 Cites 21 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Based on this, it is necessary to provide a method for estimating the semantic acquaintance between music and images, which can accurately identify the relationship between music and images.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for estimating semantic similarity among music and images
  • Method and system for estimating semantic similarity among music and images
  • Method and system for estimating semantic similarity among music and images

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] The method for estimating the degree of semantic acquaintance between music and images and the technical solution of the system will be described in detail below in conjunction with specific embodiments and accompanying drawings, so as to make it more clear.

[0033] Such as figure 1 As shown, in one embodiment, a method for estimating semantic acquaintance between music and images includes:

[0034] Step S110, constructing a database of music and image pairs with matching relationship.

[0035] Specifically, to construct the database, it is first necessary to calibrate the comparison information of the acquaintance degree of the music-image pair in advance, and build a database of music-image pairs with a matching relationship according to the comparison information. Wherein, the pre-marked comparison information of the degree of acquaintance of the pair of music images refers to which pair of music images has a higher degree of acquaintance. Select the music and ima...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and a system for estimating the semantic similarity among music and images. The method includes creating a database with music and image pairs in matching relations; respectively extracting feature representation from the music and the images; building a model for estimating the semantic similarity among the music and the images according to the feature representation and the matching relations by the aid of a machine learning process; acquiring target images and target music and estimating the semantic similarity among the target images and the target music by the aid of the model. The method and the system for estimating the semantic similarity among the music and the images have the advantages that the model for estimating the semantic similarity among the music and the images is built according to the feature representation and the matching relations, the semantic similarity among the target music and the target images can be automatically computed by the aid of the model, accordingly, relations among the music and the images can be accurately estimated, and the method and the system can be widely used in music and image interaction fields such as matching music with images, matching images with music, generating MV (music video) according to music and image and music combined retrieval.

Description

technical field [0001] The invention relates to computer application technology, in particular to a method and system for estimating semantic acquaintance between music and images. Background technique [0002] There is a strong correlation between people's perception and understanding of images and music, and the corresponding music can be associated according to the image or the corresponding image can be associated according to the music. [0003] Traditional algorithms can only perform limited semantic recognition on music or image domains. For example, in the image domain, semantic information is represented by text. Semantic information is mainly divided into three categories: 1. Specific objects, such as horses, cars, etc.; 2. Scenes, scenes, such as natural landscapes, zoos, etc.; 3. Attributes, mainly referring to descriptive words, such as happy, sad, artificial , Natural etc. The earliest recognition algorithm was designed to recognize specific objects in pictu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06T7/00G10L25/48
CPCG06F16/433G06F16/434G10L25/48
Inventor 汤晓鸥吴希宣乔宇
Owner 汤晓鸥
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap