Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Interactive music generation method and device, intelligent loudspeaker box and storage medium

A technology for smart speakers and music, applied in neural learning methods, biological neural network models, special data processing applications, etc., can solve problems such as reducing user interest, and achieve the effect of enriching interactive methods and improving interactive performance.

Pending Publication Date: 2020-10-02
BEIJING WODONG TIANJUN INFORMATION TECH CO LTD +1
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, as the number of times users use smart speakers increases, the user's interest in familiar functions may be greatly reduced. How to increase the interactive performance of smart speakers has become a technical problem that needs to be solved urgently

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Interactive music generation method and device, intelligent loudspeaker box and storage medium
  • Interactive music generation method and device, intelligent loudspeaker box and storage medium
  • Interactive music generation method and device, intelligent loudspeaker box and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0027] Figure 1a It is a flowchart of a method for generating interactive music provided by Embodiment 1 of the present invention. This embodiment is applicable to a situation where corresponding interactive music is generated according to a video. The method can be executed by an interactive music generating device, and the interactive music generating device can be realized by software and / or hardware. For example, the interactive music generating device can be configured in a smart speaker. like Figure 1a As shown, the method includes:

[0028] S110. Acquire a video to be processed, and extract image frames in the video to be processed.

[0029] In this embodiment, the interactive performance of the smart speaker is improved by enriching the human-computer interaction function in the smart speaker with a screen. Optionally, the video specified by the user can be used as the video to be processed, and the corresponding interactive music can be generated as the background...

Embodiment 2

[0043] figure 2 It is a flow chart of an interactive music generation method provided by Embodiment 2 of the present invention. This embodiment provides a method for training a music generation model. like figure 2 As shown, the method includes:

[0044] S210. Acquire sample image frames and sample music corresponding to the sample image frames.

[0045] In this embodiment, the feature extraction network module and the music generation network module in the music generation model can be trained as a whole, that is, the feature extraction network module and the music generation network module are constructed first, and the feature extraction network module and the music generation network module are constructed according to the constructed feature extraction network module and music generation network module. The music generation network module obtains the constructed music generation model, uses the training sample set to train the constructed music generation model, and ...

Embodiment 3

[0056] image 3 It is a flow chart of an interactive music generation method provided by Embodiment 3 of the present invention. This embodiment provides another method for training a music generation model on the basis of the above embodiments. like image 3 As shown, the method includes:

[0057] S310. Acquire sample image frames and sample music corresponding to the sample image frames.

[0058] In this embodiment, the feature extraction network module and the music generation network module in the music generation model can be trained respectively to obtain the trained feature extraction network module and the trained music generation network module, and the trained feature extraction network module module and the trained music generation network module compose the trained music generation model.

[0059] The training sample set required for feature extraction network module training needs to include sample image frames, and the training sample set required for music ge...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses an interactive music generation method and device, an intelligent loudspeaker box and a storage medium, and the method is applied to the intelligent loudspeaker box, and comprises the steps: obtaining a to-be-processed video, and extracting an image frame in the to-be-processed video; inputting the image frame into a pre-trained music generation model to obtain interactive music output by the music generation model; and playing the interactive music. According to the interactive music generation method provided by the embodiment of the invention, the corresponding interactive music is generated according to the to-be-processed video by training the music generation model, so that the interactive mode of the intelligent loudspeaker box is enriched,and the interactive performance of the intelligent loudspeaker box is improved.

Description

technical field [0001] The embodiments of the present invention relate to the field of smart home, and in particular, to a method and device for generating interactive music, a smart speaker and a storage medium. Background technique [0002] With the opening of the intelligent era, the Internet of Things technology has attracted more and more attention from everyone. In addition to the cutting-edge nature of the technology itself, the most important thing is to realize the interconnection of all things and facilitate people's life experience. As a typical entrance of human-computer intelligent interaction, smart speakers can meet people's daily needs through the interaction between voice and smart speakers, such as listening to songs, making calls, setting alarm clocks, and listening to the radio. Recently, with the emergence of smart speakers with screens, in addition to basic voice interaction with smart speakers, people can also realize multi-modal interaction with smart...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/732G06F16/635G06N3/04G06N3/08
CPCG06F16/7328G06F16/635G06N3/08G06N3/045
Inventor 张金晖
Owner BEIJING WODONG TIANJUN INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com