Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A method of converting image to sound

An image and sound technology, applied in the field of image processing and audio processing, can solve the problem of not mining image information in depth

Active Publication Date: 2021-09-10
BEIJING UNIV OF TECH
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0014] It can be seen that the above methods are simple mappings from image to sound, without deep mining of image information, color semantics, and the way music affects people's emotions
None of the current image-to-sound algorithms can truly achieve emotional resonance and create so-called music

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method of converting image to sound
  • A method of converting image to sound
  • A method of converting image to sound

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] Such as Figure 7 As shown, the present invention provides a method for image-to-sound conversion, comprising the following steps:

[0036] Step 1, extracting the spatial distribution of the image color according to the salient features;

[0037]Step 2, extracting the overall and local emotional semantics to the color of the image;

[0038] Step 3, the determination of the emotional tone of the music;

[0039] Step 4, generating specific music fragments for the spatial information extracted from the image;

[0040] Step 5, processing the initial music.

[0041] Step 1 is specifically: to screen information according to the visual attention mechanism of the human eye, so as to achieve the goal that the extracted information is more consistent with the information extracted by humans, and it is also the material for subsequent music creation "inspiration". Starting from the abnormality of the color between regions, the thorn weight function of each pixel can be given ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for image-to-sound conversion, comprising: step 1, extracting the spatial distribution of image colors according to salient features; step 2, extracting the overall and local emotional semantics of image colors; step 3, music Determination of emotional tone; step 4, generating specific music fragments from the spatial information extracted from the image; step 5, processing the initial music. The invention transforms any image into unique music, realizes the unification of the given image and the generated music emotional conception, and simulates the process of human sound-color synesthesia.

Description

technical field [0001] The invention belongs to the technical field of image processing and audio processing, and in particular relates to an image-to-sound conversion method, which can convert any given picture into music. Background technique [0002] Calligraphy, painting and music have been twin sisters since ancient times. When people are intoxicated by the ink paintings of fine arts and photography works written by world masters, a beautiful piece of music based on the works seems to be lingering in their ears. For example, when appreciating the picture scroll of "The Pentium Yellow River", people seem to be able to hear the roar of the Yellow River; Euphemistic singing voice. This kind of sound-color synesthesia exists in everyone, and this mechanism is not only on the level of philosophy and psychology, but can be tracked by a large number of audio-visual experiments. Inspired by the above, according to certain scientific and artistic rules, exploring the mapping r...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/46G10L25/63
CPCG10L25/63G10H2220/441G10H2210/101G06V10/56
Inventor 王波涛李珺
Owner BEIJING UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com