Mixing device and mixing method based on intelligent system

Abstract

The application discloses a kind of based on mixing device and mixing method of intelligent system, mixing device includes intelligent system, the DSP processor of connecting intelligent system and at least one microphone of connecting DSP processor;Intelligent system is installed with application and DOLBY / DTS decoder, and DSP processor has microphone sound receiving module, microphone sound processing module, background sound processing module, mixing module and output module.The application is decoded by installing DOLBY / DTS decoder on intelligent system, and the background sound in application is surround sound, and the audio after processing decoding is handled by DSP processor, and the microphone sound of microphone input is handled, and system audio is converted into the same sampling rate with microphone sound and then mixed, finally, it is output by multi-channel output module, and the viewing and entertainment needs of people at home can be satisfied.

Description

Technical Field

[0001] This invention relates to the technical field of smart homes, and in particular to a mixing device and mixing method based on a smart system. Background Technology

[0002] Karaoke is an accompaniment system where singers can participate in singing with pre-recorded music. The system enhances and refines the singer's voice through sound processing, and when organically combined with the background music, it becomes a seamless stereo song. This accompaniment method brings great convenience and enjoyment to singing enthusiasts. However, current karaoke is limited to fixed locations such as KTVs, homes, or gatherings, and its time and space constraints greatly limit users' entertainment desires.

[0003] With the rapid development of technology and people's pursuit of high-quality entertainment, the demand for home audio-visual experiences has also increased. More and more families hope to be able to sing, watch movies, enjoy audio-visual entertainment, and access online education at home. In cinemas, movies have gradually evolved from 2D to 3D, and sound has evolved from 2D surround sound to a fully immersive, three-dimensional effect. Similarly, more and more people are setting up multi-channel surround sound systems in their homes. However, in the home setting, audio-visual systems that can achieve a fully immersive effect are still very rare. Traditional products require multiple devices and complex connections, most commonly using a combination of a set-top box, karaoke processor, surround sound decoder, and amplifier. However, homes are often limited by space and purchase costs, which restricts the promotion of this combination.

[0004] The current challenge is to create a home environment with a near-cinema-like experience for watching movies and enjoying music, allowing family users to enjoy DVDs with surround sound effects, listen to music from professional-grade audio systems, and support karaoke entertainment.

[0005] In view of this, the inventor has deeply conceived and actively researched and developed this invention to address the many shortcomings and inconveniences caused by the need to use a combination of multiple devices to achieve stereo surround sound in existing home theater systems. Summary of the Invention

[0006] The purpose of this invention is to overcome the shortcomings of the prior art and provide a mixing device based on an intelligent system that can meet users' audio quality requirements when watching movies, as well as people's demand for high-quality karaoke entertainment.

[0007] To achieve the above objectives, the solution of the present invention is: A mixing device based on an intelligent system includes an intelligent system, a DSP processor connected to the intelligent system, and at least one microphone connected to the DSP processor. The intelligent system is equipped with an application program and a multi-channel Dolby / DTS decoder and a sampling rate conversion module connected to the application program. The DSP processor has a microphone audio receiving module, a microphone audio processing module, a background sound processing module, a mixing module, and a multi-channel output module. The microphone audio receiving module is connected to the microphone, the microphone audio processing module is connected to the microphone audio receiving module, the sampling rate conversion module is connected to the Dolby / DTS decoder, the background sound processing module is connected to the sampling rate conversion module, the microphone audio processing module and the background sound processing module are respectively connected to the mixing module, and the mixing module is connected to the output module.

[0008] Furthermore, the output module of the DSP processor includes a multi-channel speaker equalization module and a multi-channel speaker power limiting module connected to the speaker equalization module, and the speaker equalization module is connected to the mixing module.

[0009] Furthermore, the sampling rate conversion module is ASRC.

[0010] Furthermore, the microphone has a data acquisition module, an AD conversion module, and a transmission module. The AD conversion module is connected to the data acquisition module, and the transmission module is connected to the AD conversion module.

[0011] Furthermore, the background sound processing module includes a music volume control module, a music equalization module, and a music bass management module, and the microphone sound processing module includes a microphone volume control module, a microphone equalization module, and a microphone effect sound processing module.

[0012] Another objective of this invention is to overcome the shortcomings of the prior art and provide a mixing method based on an intelligent system that can meet users' audio quality requirements when watching movies, while also satisfying people's demand for high-quality karaoke entertainment.

[0013] To achieve the above objectives, the solution of the present invention is: A mixing method based on an intelligent system includes the following steps: Step 1: The microphone sends digital signals of the microphone sound to the DSP processor; Step 2: The microphone audio receiving module of the DSP processor receives the microphone audio transmitted by the microphone; Step 3: The intelligent system retrieves the background sound corresponding to the microphone sound from the application, decodes the background sound using a multi-channel DOLBY / DTS decoder, converts it into background sound with the same sampling frequency as the microphone sound through a sampling rate conversion module, and sends it to the DSP processor. Step 4: The DSP processor splits the microphone sound and background sound into two paths, one for processing the microphone sound and the other for processing the background sound. Step 5: The DSP processor mixes the processed background sound and microphone sound. Step 6: The DSP processor sends the mixed audio to the multi-channel output module for output.

[0014] Furthermore, the output module includes a multi-channel speaker equalization module and a multi-channel speaker power limiting module connected to the speaker equalization module. The mixed audio from step six is ​​sent to the multi-channel speaker equalization module and then output through the multi-channel speaker power limiter.

[0015] Furthermore, the specific steps of step one are as follows: the microphone collects the microphone sound of the preset frequency of the analog signal, converts the analog microphone sound into a digital microphone sound through the AD conversion module, and then sends the digital microphone sound to the DSP processor through the transmission module.

[0016] Furthermore, the intelligent system can be any one of Android, iOS, or HarmonyOS.

[0017] Furthermore, the DSP processor employs three DSP processing chips to perform digital effects processing on the microphone audio and music from the intelligent system's applications, such as equalization, high-pass, low-pass, noise reduction, phase shifting, reverb, and echo, completely resolving the karaoke feedback problem and resulting in a more perfect tone with stronger penetration. Through equalization compensation of vocals and EQ, the singing and accompaniment become more perfect and pleasing to the ear, allowing users to enjoy beautiful music while singing with greater elegance and confidence.

[0018] With the above structure, the mixing device and method based on the intelligent system of the present invention installs a multi-channel DOLBY / DTS decoder on the intelligent system to perform surround sound decoding on the background sound in the application. The audio output of the system is processed by the DSP processor connected to the intelligent system, and the microphone input is processed at the same time. The background sound is converted into an audio file with the same sampling rate as the microphone sound and then mixed with the microphone sound. Finally, it is output through a multi-channel output module. It can meet people's movie viewing and entertainment needs at home, allowing users to experience the immersive and enveloping feeling of watching a movie in a small environment. At the same time, it meets people's demand for high-quality karaoke, realizing a perfect combination of movie viewing and karaoke. Attached Figure Description

[0019] Figure 1 This is a schematic diagram of the mixing device based on an intelligent system according to the present invention.

[0020] Figure 2 This is a flowchart of the mixing method based on an intelligent system according to the present invention. Detailed Implementation

[0021] To further explain the technical solution of the present invention, the present invention will be described in detail below through specific embodiments.

[0022] In the description of this invention, it should be understood that the terms "center," "longitudinal," "lateral," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," and "outer," etc., indicating orientation or positional relationships, are based on the orientation or positional relationships shown in the accompanying drawings and are only for the convenience of describing this invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of this invention. In the description of this invention, unless otherwise stated, "a plurality of" means two or more.

[0023] like Figure 1 As shown, this invention discloses a mixing device based on an intelligent system, which includes an intelligent system 1, a DSP processor 2 connected to the intelligent system 1, and at least one microphone 3 connected to the DSP processor 2; the intelligent system 1 is any one of existing intelligent systems such as Android, iOS, or HarmonyOS, and the intelligent system is equipped with an application 11 and a 6 / 8 channel DOLBY / DTS decoder 12 and a sampling rate conversion module 13 connected to the application 11, and the application 11 can provide audio and video content.

[0024] The DSP processor 2 includes a microphone audio receiving module 21, a microphone audio processing module 24, a background sound processing module 26, a mixing module 27, and a multi-channel output module 28. The microphone audio receiving module 21 is connected to the microphone 3. In this embodiment, the microphone 3 has a data acquisition module 31, an AD conversion module 32, and an RF transmission module 33. The microphone audio receiving module 21 is the RF receiving module corresponding to the RF transmission module 33 of the microphone 3. The data acquisition module of the microphone 3 is used to acquire microphone audio at a preset sampling rate. The AD conversion module 32 is used to convert analog microphone audio signals into digital microphone audio signals. The RF transmission module 33 is used to send the digital microphone audio signals to the DSP processor. The microphone audio processing module 24 includes a microphone volume control module 241, a microphone equalization module 242, and a microphone effects sound processing module 243. The sampling rate conversion module 13 is connected to the Dolby / DTS decoder 12 to convert the decoded background sound to the same sampling frequency (48kHz) as the microphone sound. In this embodiment, the sampling rate conversion module 13 is ASRC, and mixing can only be performed after the sampling rates of the background sound and the microphone sound are the same. The background sound processing module 26 is connected to the sampling rate conversion module 13 to process the background sound. The background sound processing module 26 includes a music volume control module 261, a music equalizer module 262, and a music bass management module 263.

[0025] Microphone audio processing module 24 and background audio processing module 26 are respectively connected to mixing module 27. Mixing module 27 mixes microphone audio and background music from intelligent system 1 at the same sampling rate. Multi-channel output module 28 is connected to mixing module 27 to output the mixed audio. Output module 28 includes multi-channel speaker equalizer module 281 and multi-channel speaker power limiting module 282 connected to speaker equalizer module 281. Speaker equalizer module 281 is connected to mixing module 27.

[0026] like Figure 2 As shown, this invention also discloses a mixing method based on an intelligent system, which includes the following steps: Step 1: The microphone sends digital microphone audio signals to the DSP processor. Specifically, the microphone collects microphone audio signals at a preset frequency from the analog signal, converts the analog microphone audio signals into digital microphone audio signals through the AD conversion module, and then sends the digital microphone audio signals to the DSP processor through the transmission module.

[0027] Step 2: The microphone audio receiving module of the DSP processor receives the microphone audio transmitted by the microphone; Step 3: The intelligent system retrieves the background sound corresponding to the microphone sound from the application, decodes the background sound using a multi-channel DOLBY / DTS decoder, converts it into background sound with the same sampling frequency as the microphone sound through a sampling rate conversion module, and sends it to the DSP processor. Step 4: The DSP processor splits the microphone sound and background sound into two paths, one for processing the microphone sound and the other for processing the background sound. Step 5: The DSP processor mixes the processed background sound and the processed microphone sound. Step 6: The DSP processor sends the mixed audio to the multi-channel speaker equalization module, and then outputs it through the multi-channel speaker power limiter.

[0028] The aforementioned intelligent system can be any one of Android, iOS, or HarmonyOS.

[0029] This invention's DSP processor employs three DSP processing chips to perform digital effects processing on the microphone audio and music from the intelligent system's applications, such as equalization, high-pass, low-pass, noise reduction, phase shifting, reverb, and echo, completely resolving the karaoke feedback problem and resulting in a more perfect tone with stronger penetration. Through equalization compensation of vocals and EQ, the singing and accompaniment become more perfect and pleasing to the ear, allowing users to enjoy beautiful music while singing with greater elegance and confidence.

[0030] This invention relates to a mixing device and method based on an intelligent system. A multi-channel Dolby / DTS decoder is installed on the intelligent system to perform surround sound decoding on the background audio in the application. The audio output from the system is processed by the DSP processor connected to the intelligent system, while the microphone input is also processed. The background audio is converted into an audio file with the same sampling rate as the microphone audio before mixing. Finally, the audio is output through a multi-channel output module. This invention can meet people's needs for watching movies and entertainment at home, allowing users to experience the immersive and enveloping feeling of watching a movie in a small environment, while also satisfying people's demand for high-quality karaoke, achieving a perfect combination of movie watching and karaoke.

[0031] The DOLBY / DTS decoder enables surround sound decoding processing in intelligent systems, including audio decoding of DOLBY and DTS. Dolby Atmos provides adaptive playback, ensuring the playback is as close as possible to the original creator's vision in any environment and with different speaker configurations. It delivers a powerful new listening experience to moviegoers through more natural and realistic sound, truly immersing them in the sound. DTS technology is an open, next-generation codec standard and an object-based, multi-dimensional spatial audio technology. Whether in a cinema or home environment, DTS delivers a lifelike and breathtaking entertainment experience, providing viewers with an unprecedented immersive surround sound experience. Cinema and home theater users can also personalize settings in various ways to achieve the best results. Unlike existing surround sound systems, DTS audio is not bound by fixed speaker placement or specific channel signals. It can flexibly adjust according to different playback environments to achieve optimal sound performance in that environment. It can also create realistic sound effects at precise locations around the viewer, creating a richer soundscape. By installing a DOLBY / DTS decoder in an intelligent system, surround sound decoding can be achieved within the intelligent system.

[0032] The above embodiments and figures are not intended to limit the product form and style of the present invention. Any appropriate changes or modifications made by those skilled in the art should be considered as not departing from the patent scope of the present invention.

Claims

1. A mixing device based on an intelligent system, characterized in that, The system includes an intelligent system, a DSP processor connected to the intelligent system, and at least one microphone connected to the DSP processor. The intelligent system has an application program installed and a multi-channel Dolby / DTS decoder and a sampling rate conversion module connected to the application program. The Dolby / DTS decoder performs surround sound decoding on the background audio in the application program. The sampling rate conversion module, connected to the Dolby / DTS decoder, converts the decoded background audio to the same sampling frequency as the microphone audio. The DSP processor includes a microphone audio receiving module, a microphone audio processing module, a background audio processing module, a mixing module, and a multi-channel output module. The module includes a microphone volume control module, a microphone equalizer module, and a microphone effects sound processing module. The background sound processing module includes a music volume control module, a music equalizer module, and a music bass management module. The output module includes a multi-channel speaker equalizer module and a multi-channel speaker power limiting module connected to the speaker equalizer module. The microphone sound receiving module is connected to the microphone, the microphone sound processing module is connected to the microphone sound receiving module, the sampling rate conversion module is connected to the DOLBY / DTS decoder, the background sound processing module is connected to the sampling rate conversion module, the microphone sound processing module and the background sound processing module are respectively connected to the mixing module, and the mixing module is connected to the speaker equalizer module of the output module.

2. The mixing device based on an intelligent system as described in claim 1, characterized in that: The sampling rate conversion module is ASRC.

3. The mixing device based on an intelligent system as described in claim 1, characterized in that: The microphone has a data acquisition module, an AD conversion module, and a transmission module. The AD conversion module is connected to the data acquisition module, and the transmission module is connected to the AD conversion module.

4. A mixing method based on a mixing device of an intelligent system, characterized in that, Includes the following steps: Step 1: The microphone sends digital signals of the microphone sound to the DSP processor; Step 2: The microphone audio receiving module of the DSP processor receives the microphone audio transmitted by the microphone; Step 3: The intelligent system retrieves the background sound corresponding to the microphone sound from the application, decodes the background sound using a multi-channel DOLBY / DTS decoder, converts it into background sound with the same sampling frequency as the microphone sound through a sampling rate conversion module, and sends it to the DSP processor. Step 4: The DSP processor splits the microphone sound and background sound into two paths. One path processes the microphone sound through the microphone volume control module, microphone equalization module, and microphone effects sound processing module, while the other path processes the background sound through the music volume control module, music equalization module, and music bass management module. Step 5: The DSP processor mixes the processed background sound and microphone sound. Step 6: The DSP processor sends the mixed audio to the multi-channel speaker equalization module, and then outputs it through the multi-channel speaker power limiting module.

5. The mixing method of the mixing device based on an intelligent system as described in claim 4, characterized in that: The specific steps of step one are as follows: the microphone collects the microphone sound of the preset frequency of the analog signal, converts the analog microphone sound into a digital microphone sound through the AD conversion module, and then sends the digital microphone sound to the DSP processor through the transmission module.

6. The mixing method of the mixing device based on an intelligent system as described in claim 4, characterized in that: The intelligent system can be any one of Android, iOS, or HarmonyOS.

7. The mixing method of the mixing device based on an intelligent system as described in claim 4, characterized in that: The DSP processor uses three DSP processing chips to perform digital effects processing on the microphone audio and the music in the application of the intelligent system.

Images