Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Mutual converting system for visual sense, auditory sense and olfactory sense and music visualization application

A technology of mutual transformation and music, applied in the field of interaction of artworks

Active Publication Date: 2019-03-26
方雯晖
View PDF7 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, there are staged objective shortcomings during the popularization of the conversion system. It is necessary to implement functions at different stages according to the base number of application customers (enterprises or individuals), such as automatically identifying whether a music work is infringing, and automatically jumping to the playback platform, etc.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mutual converting system for visual sense, auditory sense and olfactory sense and music visualization application
  • Mutual converting system for visual sense, auditory sense and olfactory sense and music visualization application
  • Mutual converting system for visual sense, auditory sense and olfactory sense and music visualization application

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0058] The 2D pattern conversion scheme of music works is divided into the simplified version of the 2D pattern and the full version of the 2D pattern:

[0059] 1) Convert to a simplified version of the 2D pattern scheme, such as figure 1 As shown, the scheme is mainly applied to the transformation and identification of two-dimensional patterns in the copyright direction of music works:

[0060] (a) identifying vocal or topline parts of musical compositions;

[0061] (b) Use a square as the "outer border" (the length of the square side can be changed according to requirements);

[0062] (c) Make statistics on the total number of measures of the music work, arrange them in a reasonable matrix within the "outer border" (arrange in multiples of 8 measures as a row), and each beat (sound value) in each measure is a "unit" Rectangle" (3 rectangles per measure in 3 / 4, 4 rectangles per measure in 4 / 4, 6 rectangles per measure in 6 / 8);

[0063] (d) Determine the proportion of the n...

Embodiment 2

[0073] The 3D model conversion scheme of music works is divided into conversion into a simplified version of 3D patterns and conversion into full version of 3D patterns:

[0074] 1) Transform into a simplified version of the 3D model scheme, such as figure 2 As shown, this solution is mainly applied to supporting peripheral products (including model touch) in the copyright direction of music works;

[0075] (a) Obtain a simplified version of the 2D pattern according to the simplified version of the 2D scheme process;

[0076] (b) Identify the volume ratio relationship of vocals or toplines in musical works;

[0077] (c) Stretch each "note rectangle" into a "note cube" based on the volume ratio, and the maximum height (maximum volume) of the "note cube" is less than or equal to 1 / 3 of the side length of the "outer border" (specifically The height can be adjusted according to the application requirements);

[0078] (d) Generate a 3D model of the main theme (copyright protect...

Embodiment 3

[0085] The 4D experience model transformation scheme of music works, which is mainly applied to the physical peripheral products of music works or the exhibition of music works (including model touch):

[0086] (1) Based on the color ratio in the 2D pattern or 3D model, the corresponding ratio of the 12 kinds of olfactory sources (extraction) in the system is carried out;

[0087] (2) Mix the olfactory source (extract) according to the ratio;

[0088] (3) Obtain the olfactory source (liquid, solid fragrance) of the musical work.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a mutual converting system for visual sense, auditory sense and olfactory sense. A converting method comprises the steps that (1), a theme segment of a musical work is recognized and marked to generate a unique image of the musical work, and the unique image is taken as a visual sense element; (2), the unique image is converted into audio frequency, and a 'core audio frequency segment' of the image is obtained and finished to be taken as an auditory sense element; (3), order reduction enumeration is conducted according to primary color structure components of the image,associable smells are matched, and the unique image is converted into the smell to be taken as the olfactory sense; (4), the auditory sense, visual sense and olfactory sense elements are changed andadjusted according to the positions of objects of reference, the played musical segment is controlled to change to adapt to the up and down movement of a lifting and lowering unit, and a 3D model is formed. A musical visualization application based on the mutual converting system for the visual sense, the auditory sense and the olfactory sense is capable of allowing enterprises or platforms to recognize, manage and popularize the musical work and allowing individuals to save, popularize, recognize and verify own musical works.

Description

technical field [0001] The invention relates to the technical field of artwork interaction. It involves a phenomenon based on human synaesthesia, inventing a mutual conversion system of vision, hearing, and smell, and then can describe music works in multiple dimensions, such as visual, olfactory, and tactile, and invented interactive applications in the visualization of musical works. Specifically, a visual, auditory, and olfactory mutual conversion system and music visualization application. Background technique [0002] In view of the fact that the existing music works can be recorded and described in a single way, the registration and retention of music copyright (music content) can only be performed by means of notation, and physical records can be played through music copyright operators or individuals. The way the electronic version of the audio player is described (to be heard). [0003] The currently known interactive forms of music works and images basically use ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G10L21/10G10L21/16G06F21/10
CPCG06F21/10G10H2210/056G10H2220/441G10H2240/101G10H2240/121G10L21/10G10L21/16
Inventor 方雯晖
Owner 方雯晖
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products