Multimedia system and method for performing multimedia operation in multimedia system

Abstract

The invention provides a multimedia system and a method for performing a multimedia operation in the multimedia system. The multimedia system comprises an audio input device and a multimedia electronic device, the audio input device receives a human voice signal of a user so as to convert the human voice signal into human voice audio data; and the multimedia electronic device plays a processed human voice signal and an accompaniment signal corresponding to the human voice signal according to the human voice audio data. The multimedia electronic device comprises a multimedia processor and an audio processor, and the multimedia processor selectively processes the voice audio data according to a specific communication standard to generate processed audio data. And the audio processor plays the processed human voice signal and the accompaniment signal according to the processed audio data.

Description

Technical Field

[0001] The present invention relates to multimedia applications, and particularly to a multimedia system (such as a Karaoke system) and a method for performing a multimedia operation (such as Karaoke and other entertainment activities) in the multimedia system. Background Art

[0002] Currently, many products of smart TVs (such as Android TVs) have been launched on the market, and these smart TVs support various types of multimedia entertainment functions. However, on the current Android TV platform, it is still not possible to support entertainment activities such as Karaoke through a Bluetooth remote control. Therefore, a novel architecture and method are needed to implement a Karaoke system on an Android TV, especially to support operations such as control and sound collection of the Karaoke system using a Bluetooth remote control (such as a Bluetooth microphone), so as to improve the user experience without side effects or with fewer side effects. Summary of the Invention

[0003] The purpose of the present invention is to provide a multimedia system (such as a Karaoke system) and a method for performing a multimedia operation (such as Karaoke and other entertainment activities) in the multimedia system, so that the multimedia operation can properly support various types of remote controls or microphones such as Bluetooth microphones and Universal Serial Bus (USB) microphones.

[0004] At least one embodiment of the present invention provides a multimedia system, wherein the multimedia system includes an audio input device and a multimedia electronic device. The audio input device is used to receive a human voice signal emitted by a user to convert the human voice signal into human voice audio data. The multimedia electronic device is used to receive the human voice audio data transmitted by the audio input device, and play a processed human voice signal corresponding to the human voice signal and an accompaniment signal according to the human voice audio data. The multimedia electronic device includes a multimedia processor and an audio processor, wherein the audio processor is coupled to the multimedia processor. The multimedia processor is used to determine whether the audio input device transmits the human voice audio data to the multimedia electronic device based on a specific communication standard, so as to selectively process the human voice audio data according to the specific communication standard and generate processed audio data. In addition, the audio processor is used to play the processed human voice signal and the accompaniment signal according to the processed audio data.

[0005] At least one embodiment of the present invention provides a method for performing a multimedia operation in a multimedia system. The method includes: receiving a voice signal emitted by a user using an audio input device in the multimedia system to convert the voice signal into voice audio data; receiving the voice audio data from the audio input device using a multimedia electronic device in the multimedia system; using a multimedia processor in the multimedia electronic device to determine whether the audio input device transmits the voice audio data to the multimedia electronic device based on a specific communication standard, and selectively processing the voice audio data according to the specific communication standard and generating processed audio data; and playing a processed voice signal corresponding to the voice signal and an accompaniment signal using an audio processor in the multimedia electronic device based on the processed audio data from the multimedia processor.

[0006] The multimedia system and method provided by the present invention can perform corresponding processing when the audio input device transmits the voice audio data according to the specific communication standard (such as the Bluetooth communication standard), so as to achieve the purpose of supporting a Bluetooth microphone. In addition, the embodiments of the present invention do not significantly increase additional costs. Therefore, the present invention can properly support various types of remote controls or microphones without side effects or with fewer side effects. Brief Description of the Drawings

[0007] Figure 1 It is a schematic diagram of a multimedia system according to an embodiment of the present invention.

[0008] Figure 2 It is for Figure 1 a schematic diagram of a control scheme for an audio input device in the multimedia system shown.

[0009] Figure 3 It is a schematic diagram of the working process of a method for performing a multimedia operation in a multimedia system according to an embodiment of the present invention.

[0010] Symbol Description

[0011] 10: Multimedia system

[0012] 50: Audio input device

[0013] 100: Multimedia electronic device

[0014] 110: Multimedia processor

[0015] 110C: Multimedia application

[0016] 110B: Bluetooth communication module

[0017] 110F: Operating system interface

[0018] 110A: Operating System Suite

[0019] 110A1: Application Controller

[0020] 110A2: Application Data Processing Module

[0021] 110P: Audio Processing Module

[0022] 120: Audio Processor

[0023] 121: Audio Firmware

[0024] 122: Audio Data Processor

[0025] 123: Audio Output Device

[0026] S210~S280, S310~S340: Steps Detailed Implementation Manner

[0027] Figure 1 It is a schematic diagram of a multimedia system 10 according to an embodiment of the present invention. As Figure 1 shown, the multimedia system 10 may include an audio input device 50 and a multimedia electronic device 100. Examples of the multimedia electronic device 100 may include (but are not limited to) an Android TV with Karaoke function, and examples of the audio input device 50 may include (but are not limited to) a Bluetooth microphone and a Universal Serial Bus (USB) microphone, but the present invention is not limited thereto. When the audio input device 50 is a Bluetooth microphone, the audio input device 50 can communicate via Bluetooth (at Figure 1communicates with the multimedia electronic device 100 (labeled as "BT communication" for simplicity). When the audio input device 50 is a USB microphone, the audio input device 50 can communicate with the multimedia electronic device 100 through USB communication (e.g., through a USB cable). In this embodiment, the audio input device 50 is used to receive a voice signal emitted by a user and convert the voice signal into voice audio data. Additionally, the multimedia electronic device 100 is used to receive the voice audio data transmitted by the audio input device 50 (e.g., through BT communication or USB communication), and play a processed voice signal corresponding to the voice signal and an accompaniment signal based on the voice audio data. Additionally, the multimedia electronic device 100 may include a multimedia processor 110 and an audio processor 120, where the audio processor 120 is coupled to the multimedia processor 110. The multimedia processor 110 is used to determine whether the audio input device 110 transmits the voice audio data to the multimedia electronic device 110 based on a specific communication standard (e.g., the Bluetooth communication standard), and selectively process the voice audio data according to the specific communication standard and generate processed audio data, while the audio processor 120 is used to play the processed voice signal and the accompaniment signal based on the processed audio data.

[0028] In this embodiment, when the multimedia processor 110 determines that the audio input device 50 transmits the voice audio data to the multimedia electronic device 100 based on the specific communication standard (e.g., the Bluetooth communication standard) (e.g., transmits the voice audio data to the multimedia processor 110 through the BT communication shown in Figure 1 ), the multimedia processor 110 can process the voice audio data according to the specific communication standard (e.g., the Bluetooth communication standard) to generate the processed audio data, where the processed audio data may carry mixed audio data of the processed voice signal and the accompaniment signal, for the audio processor 120 to play the processed voice signal and the accompaniment signal based on the mixed audio data. When the multimedia processor 110 determines that the audio input device 50 transmits the voice audio data to the multimedia electronic device 100 based on another communication standard different from the specific communication standard (e.g., the USB communication standard), the audio processor 120 can receive the voice audio data from the audio input device 50 according to the another communication standard (e.g., the USB communication standard) (e.g., receives the voice audio data from the audio input device 50 through the USB communication shown in Figure 1 ), for the audio processor to play the processed voice signal based on the voice audio data from the audio input device 50 and play the accompaniment signal based on the processed audio data from the multimedia processor 110.

[0029] In this embodiment, the multimedia processor 110 can execute a multimedia application 110C (such as a Karaoke application) to control operations of receiving the human voice audio data based on the specific communication standard, processing the human voice audio data, and generating the processed audio data. Specifically, the multimedia application 110C can include a communication module (such as a Bluetooth communication module) 110B, an operating system interface (framework) 110F (such as an Android interface), an operating system suite 110A (such as an Android package (APK)), and an audio processing module 110P. The Bluetooth communication module 110B is used to receive the human voice audio data from the audio input device 50 according to the specific communication standard (such as the Bluetooth communication standard). The audio input device 50 (such as a Bluetooth microphone) can transmit Bluetooth packets of the human voice audio data by means of an encoding technique related to the Bluetooth communication standard, and the Bluetooth communication module 110B can use a corresponding decoding technique to decode these Bluetooth packets to obtain the human voice audio data. The operating system suite 110A is used to receive the human voice audio data from the Bluetooth communication module 110B through the operating system interface 110F and output a raw audio data according to the human voice audio data. The audio processing module 110P is used to perform pre-processing on the raw audio data to generate the processed audio data. The pre-processing performed by the audio processing module 110P on the raw audio data can include volume adjustment or noise floor processing (such as performing a corresponding volume adjustment operation or noise cancellation operation according to the sound collection condition or setting of the audio input device 50).

[0030] In this embodiment, the operating system suite 110A may include a control module (such as an application controller) 110A1 and a data processing module (such as an application data processing module) 110A2. The application controller 110A1 is used to control the operation of the operating system suite 110A, and the application data processing module 110A2 is used to process the human voice audio data to output the original audio data. In particular, the application data processing module 110A2 can determine the intensity of the human voice audio data for the application controller 110A1 to control whether the audio input device 50 transmits the human voice audio data using an audio encoding operation based on this intensity. For example, the audio input device 50 can be preset to transmit the human voice audio data using pulse-code modulation (PCM). When the application data processing module 110A2 determines that the intensity of the human voice audio data is insufficient (for example, it is detected that packet loss occurs during the process of receiving the human voice audio data), the application controller 110A1 can issue an encoding request to the audio input device 50 through the operating system interface 110F and the Bluetooth communication module 110B based on this judgment result to control the audio input device 50 to transmit the human voice audio data using adaptive differential pulse-code modulation (ADPCM), thereby reducing the data bandwidth and avoiding packet loss. The application controller 110A1 can control the application data processing module 110A2 to perform decoding related to adaptive differential pulse-code modulation on the human voice audio data to generate the original audio data. When the application data processing module 110A2 determines that the intensity of the human voice audio data is sufficient (for example, it is detected that no packet loss occurs during the process of receiving the human voice audio data), the application controller 110A1 can maintain the current system settings (such as allowing the audio input device 50 to continue to transmit the human voice audio data using pulse-code modulation) based on this judgment result to ensure that the audio quality of the human voice audio data is optimized. The application data processing module 110A2 can generate the original audio data without performing decoding related to adaptive differential pulse-code modulation on the human voice audio data.

[0031] In this embodiment, the audio processor 120 may include an audio firmware 121, an audio processor (such as an audio data processor) 122, and an audio output device 123. The audio firmware is coupled to the multimedia processor 110, the audio data processor 122 is coupled to the audio firmware 121, and the audio output device 123 is coupled to the audio data processor 122. Specifically, after generating the processed audio data, the multimedia processor 110 may write the processed audio data from the audio processing module 110P to the audio firmware 121, so that the audio data processor 122 can receive the processed audio data from the multimedia processor 110 through the audio firmware 121, and perform post-processing on the processed audio data to generate audio output data. The audio output device 123 is used to play the processed human voice signal and the accompaniment signal according to the audio output data. In some embodiments, the audio output device 123 may be a built-in speaker of the multimedia electronic device. In some embodiments, the audio output device 123 may be an audio output interface for connecting an external speaker connected to the audio output interface to play the processed human voice signal and the accompaniment signal.

[0032] In some embodiments, the post-processing performed by the audio data processor 122 on the processed audio data may include removing the human voice part in the accompaniment signal. For example, the audio data processor 122 may execute an artificial intelligence (AI) algorithm to remove the human voice part in a song, so that the sound played by the audio processor 120 only includes the processed human voice signal obtained by receiving the user's voice and the accompaniment signal other than the human voice in the song. In addition, the post-processing performed by the audio data processor 122 on the processed audio data may include acoustic echo cancellation (AEC) to reduce the echo interference as much as possible, thereby improving the user experience.

[0033] Figure 2 For a schematic diagram of a control scheme for an audio input device 50 in the Figure 1 shown multimedia system according to an embodiment of the present invention, the working process of this control scheme can be controlled by the Figure 1 shown application controller 110A1, but the present invention is not limited thereto. It should be noted that, Figure 2 the shown control scheme is only for illustrative purposes and is not a limitation of the present invention. For example, one or more steps may be added, deleted, or modified in the Figure 2 shown control scheme. In addition, these steps do not have to be executed exactly in the Figure 2 shown order if the overall result is not affected.

[0034] In step S210, after the multimedia system 10 is powered on, the application program controller 110A1 can turn on the Karaoke system.

[0035] In step S220, the application program controller 110A1 can determine whether a USB microphone is inserted into the multimedia electronic device 100 (labeled as "USB inserted?" in Figure 2 for simplicity). If the determination result is "yes", the process proceeds to step S230. If the determination result is "no", the process proceeds to step S250.

[0036] In step S230, the application program controller 110A1 can turn on the USB mode of the Karaoke system to support the operation of the USB microphone.

[0037] In step S240, the application program controller 110A1 can determine whether the USB microphone is unplugged (labeled as "USB unplugged?" in Figure 2 for simplicity). If the determination result is "yes", the process proceeds to step S210. If the determination result is "no", the process proceeds to step S240.

[0038] In step S250, the application program controller 110A1 can turn on the Bluetooth low energy (BLE) mode of the Karaoke system to support the detection of a Bluetooth microphone (such as detecting the presence of a Bluetooth microphone).

[0039] In step S260, the application program controller 110A1 can determine whether any Bluetooth microphone is connected to the multimedia electronic device 100 (labeled as "BLE connected?" in Figure 2 for simplicity). If the determination result is "yes", the process proceeds to step S270. If the determination result is "no", the process ends.

[0040] In step S270, the application program controller 110A1 can turn on the Bluetooth low energy mode of the Karaoke system to support the operation of the Bluetooth microphone.

[0041] In step S280, the application program controller 110A1 can determine whether a USB microphone is inserted into the multimedia electronic device 100 (labeled as "USB inserted?" in Figure 2 for simplicity). If the determination result is "yes", the process proceeds to step S210. If the determination result is "no", the process proceeds to step S280.

[0042] Figure 3 It is a schematic diagram of the working process of a method for performing a multimedia operation (such as a Karaoke function) in the multimedia system 10 according to an embodiment of the present invention. It should be noted thatFigure 3 The workflow shown is for illustrative purposes only and is not a limitation of the present invention. For example, one or more steps may be added, deleted, or modified in Figure 3 the workflow shown. Additionally, these steps do not have to be executed exactly in the Figure 3 order shown, provided the overall result is not affected.

[0043] In step S310, the multimedia system 10 may use the audio input device 50 therein to receive a voice signal emitted by a user and convert the voice signal into voice audio data.

[0044] In step S320, the multimedia system 10 may use the multimedia electronic device 100 therein to receive the voice audio data from the audio input device 50.

[0045] In step S330, the multimedia system 10 may use the multimedia processor 110 in the multimedia electronic device 100 to determine whether the audio input device 50 transmits the voice audio data to the multimedia electronic device 100 based on a specific communication standard (such as the Bluetooth communication standard), and selectively process the voice audio data according to the specific communication standard and generate processed audio data.

[0046] In step S340, the multimedia system 10 may use the audio processor 120 in the multimedia electronic device 100 to play a processed voice signal corresponding to the voice signal and an accompaniment signal based on the processed audio data from the multimedia processor 110.

[0047] In summary, the multimedia system 10 and the corresponding method of the present invention set corresponding communication modules and signal processing modules in the multimedia processor to support a remote control or microphone that communicates with the multimedia electronic device 100 using a specific communication standard (such as the Bluetooth communication standard). Additionally, the embodiments of the present invention do not significantly increase additional costs. Therefore, the present invention can properly support various types of remote controls or microphones without side effects or with fewer side effects.

[0048] The above are only the preferred embodiments of the present invention, and all equivalent changes and modifications made according to the claims of the present invention shall fall within the scope of the present invention.

Claims

1. A multimedia system, comprising: An audio input device for receiving a voice signal emitted by a user to convert the voice signal into voice audio data; A multimedia electronic device for receiving the voice audio data transmitted by the audio input device and playing a processed voice signal corresponding to the voice signal and an accompaniment signal according to the voice audio data, wherein the multimedia electronic device comprises: A multimedia processor for determining whether the audio input device transmits the voice audio data to the multimedia electronic device based on a specific communication standard, and selectively processing the voice audio data according to the specific communication standard and generating processed audio data; and An audio processor coupled to the multimedia processor for playing the processed voice signal and the accompaniment signal according to the processed audio data.

2. The multimedia system according to claim 1, wherein when the multimedia processor determines that the audio input device transmits the voice audio data to the multimedia electronic device based on the specific communication standard, the multimedia processor processes the voice audio data according to the specific communication standard to generate the processed audio data, and the processed audio data carries mixed audio data mixing the processed voice signal and the accompaniment signal for the audio processor to play the processed voice signal and the accompaniment signal.

3. The multimedia system according to claim 1, wherein when the multimedia processor determines that the audio input device transmits the voice audio data to the multimedia electronic device based on another communication standard different from the specific communication standard, the audio processor receives the voice audio data from the audio input device according to the another communication standard for the audio processor to play the processed voice signal according to the voice audio data and play the accompaniment signal according to the processed audio data.

4. The multimedia system according to claim 1, wherein the multimedia processor executes a multimedia application program to control operations of receiving the voice audio data based on the specific communication standard, processing the voice audio data, and generating the processed audio data, and the multimedia application program comprises: A communication module for receiving the voice audio data from the audio input device according to the specific communication standard; An operating system suite for receiving the voice audio data from the communication module through an operating system interface and outputting original audio data according to the voice audio data; and An audio processing module for preprocessing the original audio data to generate the processed audio data.

5. The multimedia system according to claim 4, wherein the operating system suite comprises: A control module for controlling the operation of the operating system suite; and A data processing module for processing the human voice audio data to output the original audio data; Wherein the data processing module determines the intensity of the human voice audio data, so that the control module controls whether the audio input device transmits the human voice audio data by means of an audio encoding operation according to the intensity.

6. The multimedia system according to claim 4, wherein the preprocessing performed by the audio processing module on the original audio data includes volume adjustment or background noise processing.

7. The multimedia system according to claim 1, wherein the audio processor includes: An audio data processor for receiving the processed audio data from the multimedia processor through an audio firmware and performing post-processing on the processed audio data to generate audio output data; and An audio output device for playing the processed human voice signal and the accompaniment signal according to the audio output data.

8. The multimedia system according to claim 7, wherein the post-processing performed by the audio data processor on the processed audio data includes removing the human voice part in the accompaniment signal.

9. The multimedia system according to claim 7, wherein the post-processing performed by the audio data processor on the processed audio data includes echo cancellation.

10. A method for performing a multimedia operation in a multimedia system, comprising: Receiving a human voice signal emitted by a user by means of an audio input device in the multimedia system to convert the human voice signal into human voice audio data; Receiving the human voice audio data from the audio input device by means of a multimedia electronic device in the multimedia system; Use a multimedia processor in the multimedia electronic device to determine whether the audio input device transmits the human voice audio data to the multimedia electronic device based on a specific communication standard, and selectively process the human voice audio data according to the specific communication standard and generate a processed audio data; And Use an audio processor in the multimedia electronic device to play a processed human voice signal corresponding to the human voice signal and an accompaniment signal based on the processed audio data from the multimedia processor.

Images