Multimedia playing method and device with function of voice controlling and humming searching

Abstract

The invention discloses a multimedia playing method and device with the function of voice controlling and humming searching. The multimedia playing method includes the following steps that a user selects a working mode and voice data are collected and pre-processed; under the voice control mode, the voice data and grammar rules are uploaded to a voice recognizing service terminal to undergo voice identification and playing control or resource management is carried out according to an identification result. Under the humming research mode, a fundamental voice sequence is extracted from the voice data and converted into a note sequence. A matching research service terminal is used for finding out identity information of matched multimedia resources and the corresponding multimedia resources are downloaded to the local. The multimedia playing device comprises a human-computer interaction module, a voice input module, a voice data processing module, a central processor, a media storage module, a playing and decoding module, an audio output module, a network interface module, the matching research service terminal and the like. The multimedia playing method and device with the function of voice controlling and humming searching have the advantages of being capable of releasing hands of a user, bringing good experiences to the user, convenient to use, accurate in humming detection and wide in application range.

Description

technical field [0001] The invention relates to the field of multimedia equipment, in particular to a multimedia player with functions of voice control and humming retrieval. Background technique [0002] What the music playing device of prior art possesses is only conventional manipulations such as manual play, pause, last song etc. to the audio file, and the resource search for digital audio is also limited only by the user inputting the name of the song, the singer, etc. conditions to complete. These restrictions make it impossible for users to free their hands when using the player, and at the same time, they cannot search for song resources for songs whose names they are not sure about, which greatly reduces the user experience. [0003] Voice humming retrieval is a kind of digital music retrieval based on humming input. When it is often applied to the content of the digital audio that is not clear to the user, it hums a melody that belongs to the digital audio being s...

AI Technical Summary

Problems solved by technology

Embedded operating system has been widely used in embedded devices with its outstanding functions, low power consumption, scalability, and scalability since it came to people's vision, and has achieved great success. It represents the Android platform. With its friendly interface, the advantages of open source and various levels of programming methods including JNI (Java Native Interface) method, it overcomes the disadvantage that Java cannot directly access the bottom layer of the operating system, and combines the advantages of C / C++ language to improve the performance of the developed software system , but the retrieval accuracy of the voice humming retrieval in the prior art is low

In the voice humming retrieval algorithm used in the prior art, the pitch detection link, as one of the important factors affecting the accuracy of humming retrieval, often uses the classic AMDF (Average Amplitude Difference Function), which calculates the required difference term As the sampling point displacement increases, the peak amplitude of AMDF decreases continuously, which leads to misjudgment of pitch detection and becomes a bottleneck for improving the humming retrieval effect.

Images