Entertainment system, method, vehicle and storage medium for a vehicle

By preprocessing in-car audio with a built-in microphone and applying reverberation algorithms, entertainment audio data is generated, solving the problems of poor sound pickup and noise reduction effects and high data transmission latency of in-car microphones, thus improving the user experience.

CN116142101BActive Publication Date: 2026-01-02CHERY AUTOMOBILE CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202310159752.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-02-21
Publication Date
2026-01-02
Estimated Expiration
2043-02-21

AI Technical Summary

Technical Problem

In existing technologies, vehicle microphones are limited by hardware and physical location, resulting in poor sound pickup and noise reduction performance, high data transmission latency, and the need for additional system-side processing due to the shared voice channel with the interactive system, which affects the user experience.

Method used

The system captures the audio data of the occupants inside the vehicle using a built-in microphone, preprocesses it to eliminate echoes and reduce noise, generates dry audio data using a preset reverberation algorithm, and mixes it with the accompaniment audio data to generate entertainment audio data, reducing data transmission latency.

Benefits of technology

It improves the user experience, reduces data transmission latency, lowers costs, and solves the problem of poor sound pickup and noise reduction performance of in-vehicle microphones.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116142101B_ABST
    Figure CN116142101B_ABST
Patent Text Reader

Abstract

The application relates to an entertainment system and method of a vehicle, the vehicle and a storage medium, wherein the system comprises: at least one microphone built in the vehicle, which is used for capturing human audio data of people in the vehicle; a signal processing module, which is used for preprocessing the human audio data to obtain dry audio data; and an application layer module, which has an audio HAL interface and is used for reverberating the dry audio data by using a preset reverberation algorithm, generating wet audio data, and sending the wet audio data and accompaniment audio data to the signal processing module through the audio HAL interface, so that the signal processing module mixes the wet audio data and the accompaniment audio data to generate entertainment audio data. Thus, the technical problems in the prior art that the use of the vehicle microphone is limited by hardware and physical position, the sound pickup, noise reduction and other aspects are not good, the data transmission delay is high, the same voice channel is shared with an interactive system, and additional processing of the system side is required are solved.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of intelligent cockpit of vehicles, in particular to an entertainment system and method of a vehicle, a vehicle and a storage medium. BACKGROUND

[0002] With the rapid development of the automobile Internet of Things ecology and the increasing demand for travel and leisure, the current automobile is no longer just a means of transportation, and people hope that the automobile can bring more entertainment experience while traveling.

[0003] More and more car manufacturers equip the vehicles with entertainment applications such as car singing, which can connect a special microphone to sing in the car machine. The application scenario is flexible and the reverberation effect is good, which can meet the needs of most users. However, the cost of the external special microphone is high.

[0004] In the related art, without using an external microphone, singing with a vehicle-mounted microphone (reusing two pre-installed microphones for voice recognition / calling in the vehicle) brings a new choice for users, without the need to purchase a professional microphone, and can be used with software and third-party algorithms for joint debugging. The car machine provides a non-delayed sound path from the self microphone to the external speaker.

[0005] However, in the related art, the car machine itself is generally a far-field microphone with full directionality, which is suitable for voice interaction, and the effect of sound pickup, noise reduction, etc. is not good, and a lot of environmental noise will be collected. Anti-singing, echo cancellation, etc. are affected by the hardware physical position and are difficult to solve, and the car machine system shares the same voice channel, which also requires additional processing on the system side. In addition, the delay is high, which seriously affects the user experience. SUMMARY

[0006] The present application provides an entertainment system and method of a vehicle, a vehicle and a storage medium to solve the technical problems in the related art that the use of a vehicle-mounted microphone is limited by hardware and physical position, and the effect of sound pickup, noise reduction, etc. is not good, the data transmission delay is high, and the same voice channel is shared with the interactive system, which requires additional processing on the system side.

[0007] The first aspect of the present application provides an entertainment method of a vehicle, comprising: at least one microphone built in the vehicle, used to capture human audio data of people in the vehicle; a signal processing module, used to pre-process the human audio data to obtain dry audio data; an application layer module, having an audio HAL (Hardware Abstraction Layer) interface, used to reverberate the dry audio data by using a preset reverberation algorithm to generate wet audio data, and send the wet audio data and accompaniment audio data to the signal processing module through the audio HAL interface, so that the signal processing module mixes the wet audio data and the accompaniment audio data to generate entertainment audio data.

[0008] Optionally, in an embodiment of the present application, the signal processing module comprises: a preprocessing unit, used to perform noise reduction processing on the human audio data while eliminating echo in the human audio data.

[0009] Optionally, in an embodiment of the present application, further comprising: an interaction module, used to receive an entertainment interaction instruction of a user and generate corresponding entertainment signals based on the entertainment interaction instruction; and a control module, used to control the application layer module to generate corresponding accompaniment audio data while starting the at least one microphone based on the entertainment signals.

[0010] Optionally, in an embodiment of the present application, the application layer module comprises: a matching unit, used to retrieve a preset accompaniment database by using the entertainment signals as an index to obtain the accompaniment audio data.

[0011] Optionally, in an embodiment of the present application, further comprising: an amplifier module, used to control at least one sound playing device of the vehicle to play the entertainment audio data.

[0012] The second aspect of the present application provides an entertainment method of a vehicle, comprising the following steps: capturing human audio data of people in the vehicle; pre-processing the human audio data to obtain dry audio data; reverberating the dry audio data by using a preset reverberation algorithm to generate wet audio data, and mixing the wet audio data and the accompaniment audio data to generate entertainment audio data.

[0013] Optionally, in an embodiment of the present application, the pre-processing of the human audio data comprises: eliminating echo in the human audio data, and performing noise reduction processing on the human audio data.

[0014] Optionally, in an embodiment of the present application, before capturing the human voice audio data of the person in the vehicle, further comprising: receiving an entertainment interaction instruction of a user, and generating a corresponding entertainment signal based on the entertainment interaction instruction; capturing the human voice audio data of the person in the vehicle based on the entertainment signal, and matching the corresponding accompaniment audio data at the same time.

[0015] The third aspect embodiment of the present application provides a vehicle, comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the entertainment method of the vehicle as described in the above embodiments.

[0016] The fourth aspect embodiment of the present application provides a computer readable storage medium, which stores a computer program, and the program is executed by a processor to implement the entertainment method of the vehicle as described above.

[0017] The embodiments of the present application can reduce the cost by using the built-in microphone, and preprocess the human voice audio data of the person in the vehicle captured by the built-in microphone, perform human voice enhancement and noise reduction to obtain dry audio data, use a preset reverberation algorithm to perform reverberation on the dry audio data to obtain wet audio data, and mix the wet audio data and accompaniment audio data to generate entertainment audio data, so as to realize the use of the in-vehicle entertainment function, wherein the dry audio data, the wet audio data and the entertainment audio data can be transmitted through the audio HAL interface, which can reduce the data transmission delay and improve the user experience. Thus, the technical problems in the related art that the use of the vehicle microphone is limited by hardware and physical position, the sound pickup and noise reduction effect is not good, the data transmission delay is high, the same voice channel is shared with the interaction system, and additional processing is required on the system side are solved.

[0018] Additional aspects and advantages of the present application will be in part apparent and in part pointed out hereinafter. BRIEF DESCRIPTION OF DRAWINGS

[0019] The above and / or additional aspects and advantages of the present application will become apparent and be readily appreciated from the following description, including the appended drawings.

[0020] Figure 1 FIG. 1 is a structural schematic diagram of an entertainment system of a vehicle according to an embodiment of the present application;

[0021] Figure 2 FIG. 2 is a structural schematic diagram of an entertainment system of a vehicle according to an embodiment of the present application;

[0022] Figure 3 FIG. 3 is a principle schematic diagram of an entertainment system of a vehicle according to an embodiment of the present application;

[0023] Figure 4 A flowchart of an entertainment method of a vehicle according to an embodiment of the present application is provided.

[0024] Figure 5 A structural diagram of a vehicle according to an embodiment of the present application is provided. DETAILED DESCRIPTION

[0025] Embodiments of the present application are described in detail below with reference to examples illustrated in the accompanying drawings, in which the same or similar components or components having the same or similar functions are denoted by the same or similar reference numerals throughout. The embodiments described below by reference to the accompanying drawings are exemplary and are intended to explain the present application, and cannot be understood as limiting the present application.

[0026] The entertainment system, method, vehicle and storage medium of a vehicle according to an embodiment of the present application are described below with reference to the accompanying drawings. In the related art mentioned in the above background section, the use of the vehicle microphone is limited by hardware and physical location, which has poor effects in sound pickup, noise reduction, etc., high data transmission delay, and the same voice channel is shared with the interactive system, which requires additional processing on the system side. The present application provides an entertainment system for a vehicle, in which the system can reduce costs by using a built-in microphone, and preprocess the human voice audio data of the people in the vehicle captured by the built-in microphone, perform human voice enhancement and noise reduction, obtain dry audio data, use a preset reverberation algorithm to reverberate the dry audio data, obtain wet audio data, and mix the wet audio data and accompaniment audio data to generate entertainment audio data, to realize the use of in-vehicle entertainment functions, wherein the dry audio data, wet audio data and entertainment audio data can be transmitted through the use of an audio HAL interface, which can reduce data transmission delay and improve user experience. Thus, the technical problems of the related art, such as the use of the vehicle microphone being limited by hardware and physical location, poor effects in sound pickup, noise reduction, etc., high data transmission delay, and the same voice channel being shared with the interactive system, which requires additional processing on the system side, are solved.

[0027] Specifically, Figure 1 A structural diagram of an entertainment system for a vehicle according to an embodiment of the present application is provided.

[0028] As Figure 1 shown, the entertainment system 10 for a vehicle includes at least one microphone 100, a signal processing module 200 and an application layer module 300.

[0029] Specifically, the at least one microphone 100 is built into the vehicle to capture human voice audio data of people in the vehicle.

[0030] In actual implementation, when the entertainment function, such as the singing function, is enabled, the embodiment of the application can capture the voice of the person in the vehicle through at least one microphone 100 built in the vehicle, so as to obtain the voice data of the person in the vehicle, without external equipment, thereby reducing the cost.

[0031] The signal processing module 200 is configured to pre-process the voice data of the person to obtain dry voice data.

[0032] In some embodiments, the captured voice data of the person can be transmitted to the signal processing module 200, so as to pre-process the voice data of the person through the signal processing module 200 to realize voice enhancement and noise reduction, thereby obtaining the dry voice data.

[0033] Optionally, in an embodiment of the application, the signal processing module 200 comprises a preprocessing unit configured to perform noise reduction processing on the voice data of the person while eliminating the echo in the voice data of the person.

[0034] It can be understood that the vehicle microphone is generally a far-field microphone, which is omnidirectional and suitable for voice interaction, and has poor effects in sound pickup, noise reduction, etc. Many environmental noises can be collected, and the effects of anti-howling and echo elimination are affected by the physical position of the hardware, which is difficult to solve. Therefore, the embodiment of the application can pre-process the voice data of the person through the signal processing module 200, obtain pure voice dry sound through echo elimination and noise reduction processing, and further generate voice dry sound data.

[0035] The application layer module 300 has an audio HAL interface, which is configured to use a preset reverberation algorithm to perform reverberation on the dry voice data to generate wet voice data, and send the wet voice data and the accompaniment audio data to the signal processing module 200 through the audio HAL interface, so that the signal processing module 200 mixes the wet voice data and the accompaniment audio data to generate entertainment audio data.

[0036] As a possible implementation manner, taking the Android side application layer as an example, the application layer module 300 of the embodiment of the application can comprise an ear return application, a singing application, etc. The ear return application can directly obtain the voice dry sound data through the audio HAL interface, which greatly shortens the time delay caused by the uplink transmission and processing of the audio stream. The singing application can directly obtain the voice dry sound data from the interface of the ear return application to realize the corresponding business logic, such as scoring, recording, etc., by using the voice dry sound data.

[0037] Further, the embodiment of the present application can send the corresponding accompaniment audio data to the earphone application through the singing application, and utilize a preset reverb algorithm in the earphone application to realize the reverb effect of the vocal dry sound and generate vocal wet audio data. The preset reverb algorithm can be set by a person skilled in the art based on the actual situation, and is not specifically limited herein.

[0038] The earphone application can call the audio HAL interface to send the accompaniment audio data and the wet audio data to the signal processing module 200 for mixing, thereby greatly shortening the time delay caused by transmission and processing when the audio stream is downlink to the driver.

[0039] Optionally, in an embodiment of the present application, the entertainment system 10 of the vehicle further comprises an interaction module and a control module.

[0040] The interaction module is configured to receive the entertainment interaction instruction of the user and generate a corresponding entertainment signal based on the entertainment interaction instruction.

[0041] The control module is configured to start at least one microphone 100 based on the entertainment signal, and control the application layer module 300 to generate corresponding accompaniment audio data.

[0042] In actual execution process, the embodiment of the present application can obtain the entertainment interaction instruction of the user, including the entertainment function selection, the song selection, etc., through the interaction module, such as the vehicle central control screen interaction and the mobile terminal interaction bound with the vehicle, and generate the corresponding entertainment signal based on the entertainment interaction instruction.

[0043] The embodiment of the present application can control at least one microphone 100 to start based on the entertainment signal through the control module, so as to capture the vocal audio data, and control the application layer module 300 to generate the accompaniment audio data corresponding to the entertainment interaction instruction.

[0044] Optionally, in an embodiment of the present application, the application layer module 300 comprises a matching unit.

[0045] The matching unit is configured to retrieve the preset accompaniment database with the entertainment signal as an index to obtain the accompaniment audio data.

[0046] In some embodiments, the application layer module 300 can comprise the matching unit. The embodiment of the present application can determine the accompaniment instruction of the user in the entertainment interaction instruction based on the entertainment signal through the matching unit, retrieve the corresponding accompaniment in the preset accompaniment database, match to obtain the accompaniment data, so as to be mixed with the wet audio data.

[0047] Optionally, in an embodiment of the present application, the entertainment system 10 of the vehicle further comprises a power amplifier module.

[0048] The power amplifier module is used to control at least one audio playback device in the vehicle to play entertainment audio data.

[0049] As one possible implementation, embodiments of this application can use a power amplifier module to control at least one audio playback device in the vehicle, such as a car speaker, to play entertainment audio data mixed and generated by the signal processing module 200, thus completing the entertainment singing process. Combined with... Figure 2 and Figure 3 As shown, the working principle of the vehicle entertainment system 10 of this application embodiment will be described in detail with reference to one embodiment.

[0050] like Figure 2 As shown, embodiments of this application may include at least one microphone 100, a signal processing module 200, an application layer module 300, and a power amplifier module 400.

[0051] The signal processing module 200 is taken as the DSP (Digital Signal Processor) built into the DMC host SOC (System on Chip). The SOC is a multi-operating system (QNX+Android) software environment based on a virtual machine. The application layer module 300 can include singing applications, earphone monitoring applications, etc. The singing application and vocal reverb can be deployed in the Android system. The sound noise reduction and vocal reverb are processed by software modules and deployed in the DSP coprocessor, i.e., the signal processing module 200.

[0052] In practical applications, when singing, the human voice is captured by the vehicle microphone 100. The human voice audio stream is sent to the signal processing module 200, where echo cancellation and noise reduction are performed to obtain a pure human voice.

[0053] The human voice audio stream is sent to the Linux kernel audio subsystem of the Android side of the application layer module 300. The singing application of the application layer module 300 bypasses the audio subsystem of the Android Framework layer and directly calls the audio HAL interface to obtain the human voice audio data stream, so that the time delay caused by the transmission and processing of the audio stream in the Android Framework when the audio stream is transmitted to the application layer is greatly shortened. The singing application can use the obtained human voice audio stream to implement corresponding business logic, such as scoring, recording, and the like. The ear return application mixes the human voice to obtain a wet voice audio data stream. The singing application sends the accompaniment audio stream of the song to the signal processing module 200 by calling the audio HAL interface of the ear return application. This operation also bypasses the audio subsystem in the Android, and greatly shortens the time delay caused by the transmission and processing of the audio stream in the Android Framework when the audio stream is transmitted to the driver. After the human voice audio stream is mixed in the signal processing module 200, the human voice audio stream is transmitted to the power amplifier through a digital audio interface such as TDM (time-division multiplexing) and is played by the power amplifier module 400.

[0054] As shown in Figure 3 the embodiments of the present application can include the following steps:

[0055] Step S1: capturing human voice audio data by at least one microphone 100 and transmitting the human voice audio data to the signal processing module 200.

[0056] Step S2: performing echo cancellation and noise reduction processing in the signal processing module 200 to obtain pure human voice dry audio data.

[0057] Step S3: transmitting the dry audio data to the Linux kernel audio subsystem of the Android side of the application layer module 300.

[0058] Step S4: the ear return application of the application layer module 300 bypasses the audio subsystem of the Android Framework layer and directly calls the audio HAL interface to obtain the dry audio data, so that the time delay caused by the transmission and processing of the audio stream in the Android Framework when the audio stream is transmitted to the application layer is greatly shortened.

[0059] Step S5: the singing application can directly obtain the dry audio data from the interface of the ear return application, and use the obtained human voice audio stream to implement corresponding business logic, such as scoring, recording, and the like.

[0060] Step S6: the singing application simultaneously and in real time sends the accompaniment audio stream of the singing song to the ear return application, and uses a reverberation algorithm in the ear return application to implement the reverberation effect of the human voice dry sound to obtain wet audio data.

[0061] Step S7: The ear return application calls the audio HAL interface to send the accompaniment audio data and the wet audio data of the song to the signal processing module 200 for mixing. This operation also bypasses the audio subsystem in Android, greatly shortening the time delay caused by transmission and processing in the Android Framework when the audio stream is sent down to the driver.

[0062] Step S8: After the wet audio data and the accompaniment audio data are mixed and processed in the signal processing module 200, they are transmitted to the power amplifier module 400 through a digital audio interface such as TDM, and are driven by the power amplifier module 400 to play through the car speakers.

[0063] The entertainment system of the vehicle according to the embodiments of the present application can reduce costs by using the built-in microphone, preprocess the human voice audio data of the people in the vehicle captured by the built-in microphone, perform human voice enhancement and noise reduction to obtain dry audio data, use a preset reverberation algorithm to perform reverberation on the dry audio data to obtain wet audio data, mix the wet audio data and accompaniment audio data to generate entertainment audio data, and implement the use of the in-vehicle entertainment function. The dry audio data, the wet audio data, and the entertainment audio data can all be transmitted through the audio HAL interface, which can reduce data transmission delay and improve user experience. Thus, the technical problems in the related art that the use of the vehicle microphone is limited by hardware and physical location, the sound pickup and noise reduction are not good, the data transmission delay is high, the same voice channel is shared with the interactive system, and additional system processing is required are solved.

[0064] Next, the entertainment method of the vehicle according to the embodiments of the present application is described with reference to the accompanying drawings.

[0065] Figure 4 is a flowchart of the entertainment method of the vehicle according to the embodiments of the present application.

[0066] As shown in Figure 4 , the entertainment method of the vehicle includes the following steps.

[0067] In step S401, human voice audio data of people in the vehicle is captured.

[0068] In step S402, the human voice audio data is preprocessed to obtain dry audio data.

[0069] In step S403, a preset reverberation algorithm is used to perform reverberation on the dry audio data to generate wet audio data, and the wet audio data and accompaniment audio data are mixed to generate entertainment audio data.

[0070] Optionally, in an embodiment of the present application, preprocessing the human voice audio data includes eliminating echo in the human voice audio data and performing noise reduction processing on the human voice audio data.

[0071] Optionally, in an embodiment of the present application, before capturing the human voice audio data of the person in the vehicle, further comprising: receiving an entertainment interaction instruction of the user, and generating a corresponding entertainment signal based on the entertainment interaction instruction; capturing the human voice audio data of the person in the vehicle based on the entertainment signal, and matching the corresponding accompaniment audio data at the same time.

[0072] It should be noted that the foregoing explanation and description of the embodiment of the entertainment system of the vehicle also applies to the entertainment method of the vehicle of the embodiment, which will not be described here.

[0073] According to the entertainment method of the vehicle provided in the embodiment of the present application, the cost can be reduced through the built-in microphone, and the human voice audio data of the person in the vehicle captured by the built-in microphone is preprocessed, human life enhancement and noise reduction are performed, dry audio data is obtained, the dry audio data is reverberated by using a preset reverberation algorithm, wet audio data is obtained, the wet audio data and accompaniment audio data are mixed to generate entertainment audio data, and the use of the in-vehicle entertainment function is realized, wherein the dry audio data, the wet audio data and the entertainment audio data can be transmitted through the audio HAL interface, the data transmission delay can be reduced, and the user experience can be improved. Therefore, the technical problems in the related art that the use of the vehicle microphone is limited by hardware and physical position, the sound pickup, noise reduction and other aspects are not good, the data transmission delay is high, the same voice channel is shared with the interaction system, and additional processing is required on the system side are solved.

[0074] Figure 5 The vehicle provided in the embodiment of the present application is shown in the structural schematic diagram. The vehicle can include:

[0075] The memory 501, the processor 502, and the computer program stored in the memory 501 and executable on the processor 502.

[0076] The processor 502 implements the entertainment method of the vehicle provided in the above embodiment when executing the program.

[0077] Further, the vehicle further includes:

[0078] The communication interface 503 is used for communication between the memory 501 and the processor 502.

[0079] The memory 501 is used to store the computer program executable on the processor 502.

[0080] The memory 501 can include a high-speed RAM memory, and can also include a non-volatile memory, for example, at least one disk memory.

[0081] If the memory 501, the processor 502 and the communication interface 503 are implemented independently, the communication interface 503, the memory 501 and the processor 502 can be connected with each other through a bus and complete communication between each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For convenience of representation, Figure 5 Only one thick line is used to represent the bus in the figure, but it does not mean that there is only one bus or only one type of bus.

[0082] Optionally, in a specific implementation, if the memory 501, the processor 502 and the communication interface 503 are integrated on a chip, the memory 501, the processor 502 and the communication interface 503 can complete communication between each other through an internal interface.

[0083] The processor 502 can be a Central Processing Unit (CPU), or an Application Specific Integrated Circuit (ASIC), or one or more integrated circuits configured to implement one or more embodiments of the present application.

[0084] The embodiment also provides a computer readable storage medium, which stores a computer program, and the program is executed by a processor to implement the entertainment method of the vehicle.

[0085] In the description of the present specification, the description of the terms "one embodiment", "some embodiments", "an example", "a specific example" or "some examples" means that the specific features, structures, materials or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present application. In the present specification, the illustrative description of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any one or N embodiments or examples in a suitable manner. In addition, the person skilled in the art can combine and combine the different embodiments or examples described in the present specification and the features of the different embodiments or examples without contradiction.

[0086] Moreover, the terms "first", "second", etc. are used herein only to describe different instances, and do not imply or suggest relative importance or a number of indicated technical features. Thus, the features defined with "first", "second" can include at least one of the features explicitly or implicitly. In the description of the present application, the meaning of "N" is at least two, for example, two, three, etc., unless otherwise explicitly and specifically limited.

[0087] Any process or method descriptions or descriptions of the flow diagrams described herein, or otherwise described herein, can be understood as representing the steps of a method implemented by a computer or a processor, or a computer or processor aided or otherwise assisted method, and / or as representing the steps of a computer program product implemented by a computer or a processor, or a computer or processor aided or otherwise assisted computer program product. The steps of the methods described herein, or otherwise described herein, can be embodied in computer- readable medium containing executable instructions, which when executed by a computer or processor, cause the computer or processor to carry out the steps of the method.

[0088] Logic and / or steps represented in flow diagrams described herein, or otherwise described herein, for example, can be considered as a list of executable instructions for implementing logic functions, and can be specifically embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor- based system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions, or in conjunction with such an instruction execution system, apparatus, or device. For the purposes of this specification, a "computer-readable medium" can be any apparatus that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium include the following: an electrical connection having one or more wires (electrical apparatus), a portable computer diskette (magnetic apparatus), a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber (optical apparatus), and a portable compact disc read-only memory (CDROM). In addition, the computer-readable medium can even be paper or another suitable medium upon which the program is printed, because the program can be electronically captured, via the optical scan of the paper or other medium, then compiled, interpreted, or otherwise processed in a suitable manner, if necessary, and then stored in the computer memory.

[0089] It should be understood that portions of the application can be realized with a combination of hardware, software, firmware, or their combination. In the above-described embodiments, the N steps or methods can be realized with software or firmware stored in a memory and executed by a suitable instruction execution system. As in another embodiment, if realized with hardware, any one or their combination of the following technologies known in the art can be used: discrete logic circuit with logic gate circuit for implementing logic functions on data signals, application specific integrated circuit with suitable combination logic gate circuit, programmable gate array (PGA), field programmable gate array (FPGA), etc.

[0090] Those skilled in the art of the present technology can understand that all or part of the steps carried out by the above-mentioned embodiment methods can be completed by a program instructing the relevant hardware, and the program can be stored in a computer readable storage medium. When the program is executed, it includes one of the steps of the method embodiment or a combination thereof.

[0091] In addition, each functional unit in each embodiment of the present application can be integrated into one processing module, or each unit can exist physically alone, or two or more units can be integrated into one module. The above-mentioned integrated module can be realized in the form of hardware or in the form of a software functional module. When the integrated module is realized in the form of a software functional module and sold or used as an independent product, it can also be stored in a computer readable storage medium.

[0092] The above-mentioned storage medium can be a read-only memory, a magnetic disk or an optical disk, etc. Although the embodiments of the present application have been shown and described above, it should be understood that the above-mentioned embodiments are exemplary and cannot be understood as limiting the present application, and those skilled in the art can make changes, modifications, replacements and variations to the above-mentioned embodiments within the scope of the present application.

Claims

1. An entertainment system of a vehicle, characterized by, The method comprises the following steps: at least one microphone built-in the vehicle is used to capture the human audio data of the people in the vehicle; a signal processing module is used to pre-process the human audio data to obtain dry audio data; an application layer module has an audio HAL interface, which is used to reverberate the dry audio data by using a preset reverberation algorithm to generate wet audio data, and send the wet audio data and accompaniment audio data to the signal processing module through the audio HAL interface, so that the signal processing module mixes the wet audio data and the accompaniment audio data to generate entertainment audio data; wherein the singing application of the application layer module bypasses the audio subsystem of the Android Framework layer, and directly calls the audio HAL interface to obtain the human audio data stream, so as to shorten the time delay caused by the transmission and processing of the audio stream in the Android Framework when the audio stream goes up to the application layer; an interaction module is used to receive the entertainment interaction instruction of the user, and generate corresponding entertainment signals based on the entertainment interaction instruction; a control module is used to control the application layer module to generate corresponding accompaniment audio data based on the entertainment signals and the simultaneous start of the at least one microphone.

2. The system of claim 1, wherein, The signal processing module comprises: a pre-processing unit is used to eliminate the echo in the human audio data and perform noise reduction processing on the human audio data.

3. The system of claim 1, wherein, The application layer module comprises: a matching unit is used to retrieve a preset accompaniment database by using the entertainment signals as an index to obtain the accompaniment audio data.

4. The system of claim 1, wherein, Further comprising: an amplifier module is used to control at least one sound playing device of the vehicle to play the entertainment audio data.

5. An entertainment method of a vehicle, characterized by, The entertainment system of the vehicle according to any one of claims 1-4, wherein the method comprises the following steps: capturing the human audio data of the people in the vehicle; pre-processing the human audio data to obtain dry audio data; reverberating the dry audio data by using a preset reverberation algorithm to generate wet audio data, and mixing the wet audio data and accompaniment audio data to generate entertainment audio data.

6. The method of claim 5, wherein, The pre-processing of the human audio data comprises: eliminating the echo in the human audio data and performing noise reduction processing on the human audio data.

7. The method of claim 5, wherein, Before capturing the human audio data of the people in the vehicle, further comprising: receiving the entertainment interaction instruction of the user, and generating corresponding entertainment signals based on the entertainment interaction instruction; capturing the human audio data of the people in the vehicle based on the entertainment signals, and matching corresponding accompaniment audio data at the same time.

8. A vehicle characterized by comprising: comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the entertainment method of the vehicle according to any one of claims 5-7.

9. A computer-readable storage medium having stored thereon a computer program, characterized in that, The program is executed by the processor to implement the entertainment method of the vehicle according to any one of claims 5-7.

Citation Information

Patent Citations

  • Wheat-free KTV (Karaoke Television) system and method based on vehicle-mounted system-on-chip

    CN114449390A