Audio control method, system and device and storage medium

Abstract

The invention relates to the field of audio processing, in particular to an audio control method, system and device and a storage medium. Comprising the following steps: establishing communication connection between a motorcycle center controller and a Bluetooth module; a first communication end BT1 based on the Bluetooth module is in communication connection with a driving helmet end; a second communication end BT2 based on the Bluetooth module is in communication connection with mobile communication equipment; a third communication end BT3 based on the Bluetooth module is in communication connection with a passenger helmet end; receiving audio information; and analyzing the audio information, converting the audio information into audio data frames, exporting the audio data frames, and sending the audio data frames to the driving helmet end and / or the passenger helmet end. And the convenience and the safety of answering the call or checking the route navigation direction in the motorcycle driving process of the motorcycle driver are effectively and further improved.

Description

Technical Field

[0001] The present application relates to the field of audio processing, and in particular, to an audio control method, system, device, and storage medium. Background Art

[0002] Traditional in-vehicle audio modules include a radio chip, an audio decoder, and a speaker. The radio antenna sends the frequency modulation signals of each radio station into the input circuit. After preliminary station selection, the required radio station signal is sent to the high-frequency amplifier for amplification. The amplified signal and the local oscillator signal are frequency-converted in the mixer, and then the difference frequency signal is selected by the frequency selection circuit and sent to the intermediate-frequency amplifier for amplification. Then, it is limited by the limiter to cut off the amplitude change of the frequency modulation wave. The limited intermediate-frequency frequency modulation signal is sent to the discriminator to demodulate the audio signal. Finally, the audio signal is sent to the speaker of the vehicle body through the low-frequency voltage and power amplifier to emit sound, and the received audio is emitted from the speaker of the vehicle body.

[0003] Common motorcycles do not have the function of in-vehicle audio playback. When a motorcycle driver is driving a motorcycle and needs to answer a call or view the route navigation direction, etc., if the driver maintains the vehicle speed to answer the call or view the route navigation direction, it is easy to cause dangerous driving behaviors; if the motorcycle is parked on one side of the road to answer the call or view the route navigation direction, on the one hand, it is easy to cause road safety hazards, and on the other hand, it will lead to low overall operation convenience for the driver. Summary of the Invention

[0004] In order to further improve the convenience and safety of motorcycle drivers answering calls or viewing route navigation directions during the process of driving a motorcycle, the present application provides an audio control method, system, device, and storage medium.

[0005] In a first aspect, the audio control method provided by the present application adopts the following technical solutions: The audio control method includes the following steps: Establish a communication connection between the motorcycle central control and the Bluetooth module; Based on the first communication end BT1 of the Bluetooth module, communicate with the driving helmet end; Based on the second communication end BT2 of the Bluetooth module, communicate with the mobile communication device; Based on the third communication end BT3 of the Bluetooth module, communicate with the passenger helmet end; Receive audio information; Analyze the audio information and convert it into an audio data frame, export the audio data frame and send the audio data frame to the driving helmet end and / or the passenger helmet end.

[0006] By adopting the above technical solution: based on the Bluetooth module to receive the audio information sent by the mobile communication device, and then converting the corresponding audio information into an audio data frame through the motorcycle central control and sending it to the driving helmet for the driver to receive the audio information, etc., so that there is no need for the driver to manually check the navigation route or answer the phone and other dangerous driving behaviors, thereby realizing the convenience and safety improvement of the motorcycle driver answering the phone or checking the route navigation direction during the process of driving the motorcycle; at the same time, the passenger helmet worn by the passenger can also receive the audio information, which can improve the user experience of the motorcycle passenger. In addition, the call interaction between the passenger and the driver can be realized, thereby further improving the user experience.

[0007] Optionally, the audio information includes mobile device voice, driver voice, and passenger voice; the audio control method further includes the following steps: Identify according to the source of the audio information and mark the audio information as mobile device voice or driver voice or passenger voice.

[0008] By adopting the above technical solution, the received audio information can be identified and processed, and can be sent separately according to the actual use situation.

[0009] Optionally, the mobile device voice includes navigation sound source, call sound source, and entertainment sound source; based on the navigation sound source, driver voice, and actual driving environment information, identify the current driving scene, and the driving scene includes complex sections and regular sections; specifically includes the following sub-steps: Collect the navigation sound source and driver voice in real time for voice signal processing, and obtain the spectral matrix of the driver voice through a preset algorithm and the spectral matrix of the navigation sound source , and then calculate based on the fusion model and to generate a feature matrix ; Import the actual driving environment information into the risk assessment model to calculate the environmental risk index ERI; Input the feature matrix F and the environmental risk index ERI into the specified model together to perform dynamic and accurate judgment on the driving scene.

[0010] The calculation formula for importing the actual driving environment information into the risk assessment model to calculate the environmental risk index ERI is as follows: Where: and are the weights of pedestrians and other vehicles respectively; , are the distances between the current vehicle and the abnormal object, , is the speed of the alien creature, , is the angle between the movement direction of the current vehicle and the movement direction of the alien creature.

[0011] By adopting the above technical solution, multi-source information fusion, that is, the combination of voice and real-time environment monitoring, realizes the dynamic and accurate judgment of the driving scene and adapts to the complex and changeable actual driving conditions.

[0012] Optionally, the exporting of the audio data frame and sending the audio data frame to the driving helmet end and / or the passenger helmet end includes the following sub-steps: If the mobile device voice is recognized as a navigation sound source and an entertainment sound source, and the current driving scene is a complex section, convert the navigation sound source into an audio data frame and send it to the driving helmet end (2) through the Bluetooth module (4), and convert the entertainment sound source into an audio data frame and send it to the passenger helmet end (3) through the Bluetooth module (4); If the mobile device voice is recognized as a navigation sound source and a call sound source, and the current driving scene is a complex section, convert the navigation sound source into an audio data frame and send it to the driving helmet end (2) through the Bluetooth module (4), and then convert the call sound source into an audio data frame and send it to the passenger helmet end (3) through the Bluetooth module (4); If the driver's voice is recognized, convert the driver's voice into an audio data frame and send it to the passenger helmet end (3) through the Bluetooth module (4); If the passenger's voice is recognized, convert the passenger's voice into an audio data frame and send it to the driving helmet end (2) through the Bluetooth module (4).

[0013] By adopting the above technical solution, it is convenient for the driver / passenger to receive the mobile device voice sent by the mobile communication device during the process of driving a motorcycle, and the call interaction between the passenger and the driver can also be realized, thereby further improving the user experience.

[0014] Optionally, after the driver's voice or the passenger's voice is recognized, the following steps need to be further executed: Detect whether the driving helmet end and the passenger helmet end are in the state of transmitting the mobile device voice; If so, perform softening adjustment on the mobile device voice and then convert the passenger voice or the driver's voice into an audio data frame for sending.

[0015] By adopting the above technical solution, when both the driver and the passenger are in the state of receiving mobile device voices, if the driver and the passenger need to communicate, the mobile device voice that is in the transmission state at this time can be softened and adjusted, without affecting the voice interaction between the driver and the passenger, and the navigation voice can also be received simultaneously, with dual-track audio being carried out simultaneously, which can reduce the possibility of the driver and the passenger missing the mobile device voice during voice communication.

[0016] Optionally, the mobile device voice includes a navigation sound source, a call sound source, and an entertainment sound source; the step of receiving audio information includes the following sub-steps: Obtain the main driver microphone sound source and parse out the main driver audio frame; convert the main driver audio frame into the main driver voice; Judge the connection status between the motorcycle central control and the mobile communication device; If the motorcycle central control is in the state of receiving the navigation sound source and / or the entertainment sound source, establish a communication connection between the driver's helmet end and the passenger's helmet end and perform softening adjustment on the mobile device voice, and send the main driver voice to the passenger's helmet end; If the motorcycle central control is in the state of receiving the call sound source, stop obtaining the main driver microphone sound source and repeat the step of judging whether the motorcycle central control is in the state of receiving the mobile device voice.

[0017] By adopting the above technical solution, further priority splitting is performed on the mobile device voice transmitted by the mobile communication device. If the mobile communication device only transmits navigation voice / entertainment voice to the driver's / passenger's helmet end, the interactive voice level between the driver and the passenger at this time is superior to the navigation voice / entertainment voice level. When both voices need to be transmitted, the interactive voice between the driver and the passenger is preferentially transmitted.

[0018] Optionally, the step of softening adjustment specifically includes the following sub-steps: Reduce the volume of playing the mobile device voice to the threshold volume; Incorporate the main driver voice and / or the passenger voice; Perform noise reduction processing on the main driver voice and the passenger voice and then transmit them.

[0019] Optionally, the step of softening adjustment further includes the following sub-steps: Parse the key traffic fields in the navigation voice, and the key traffic fields include speed measurement, left turn, right turn, and lane change; Increase the playing volume of the key traffic fields.

[0020] By adopting the above technical solution, while the motorcycle central control transmits the voice between the driver and the passenger, the mobile communication device is transmitting navigation voice / entertainment voice to the driver's helmet end and the passenger's helmet end. The former is given priority, but the key traffic fields in the navigation voice will be emphasized and broadcast to remind the driver and the passenger of the subsequent route navigation during driving, so as to prevent the driver and the passenger from missing part of the navigation voice when communicating.

[0021] In a second aspect, the audio control system provided by the present application adopts the following technical solution: The audio control system includes a motorcycle central control, a driver's helmet end, a passenger's helmet end, and a Bluetooth module; the motorcycle central control is communicatively connected to the driver's helmet end and the passenger's helmet end through the Bluetooth module and transmits sound sources. The following controls are provided on the motorcycle central control: Driver Mute (adau1787_rider_mute): Controls whether the audio output of the driver's helmet end is muted.

[0022] Passenger Mute (adau1787_passenger_mute): Controls whether the audio output of the passenger's helmet end is muted.

[0023] Driver Microphone Mute (adau1787_rider_mic_mute): Controls whether the microphone of the driver's helmet end is enabled.

[0024] Passenger Microphone Mute (adau1787_passenger_mic_mute): Controls whether the microphone of the passenger's helmet end is enabled.

[0025] Driver Helmet Mute (adau1787_helmet_rider_mute): Controls the mute state of the audio of the driver's helmet end.

[0026] Passenger Helmet Mute (adau1787_helmet_passenger_mute): Controls the mute state of the audio of the passenger's helmet end.

[0027] In a third aspect, the computer device provided by the present application adopts the following technical solution: The computer device includes a processor, a memory, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the above audio control method is implemented.

[0028] By adopting the above technical solution, a computer device capable of executing and implementing the above audio control method is provided.

[0029] Fourthly, the computer-readable storage medium provided by the present application adopts the following technical solutions: A computer-readable storage medium stores a computer program; when the computer program is executed by a processor, the above audio control method is implemented.

[0030] By adopting the above technical solutions, a carrier for a computer program of the audio control method is provided.

[0031] In summary, the present application includes at least the following beneficial technical effects: 1. Based on the Bluetooth module to receive the audio information sent by the mobile communication device, and then convert the corresponding audio information into an audio data frame through the motorcycle central control and send it to the driving helmet end for the driver to receive the audio information, etc., so that there is no need for the driver to manually check the navigation route or answer the phone and other dangerous driving behaviors, thereby realizing the convenience and safety improvement of the motorcycle driver answering the phone or checking the route navigation direction during the process of driving the motorcycle; at the same time, the passenger helmet end worn by the passenger can also receive the audio information, which can improve the user experience of the motorcycle passenger. In addition, the call interaction between the passenger and the driver can be realized, thereby further improving the user experience; 2. When transmitting the voice between the driver and the passenger through the motorcycle central control, the mobile communication device is transmitting navigation voice / entertainment voice to the driver helmet end and the passenger helmet end. The former is given priority, but the key traffic fields in the navigation voice will be emphasized and broadcast to remind the driver and the passenger of the subsequent route navigation during driving, so as to prevent missing part of the navigation voice when the driver and the passenger communicate. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 is the principle block diagram of the audio control system in the embodiment of the present application; Figure 2 is the flowchart of the audio control method in the embodiment of the present application; Description of the reference numerals: 1. Motorcycle central control; 2. Driving helmet end; 3. Passenger helmet end; 4. Bluetooth module. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0033] In order to make the purpose, technical solutions and advantages of the present application clearer, the following will further describe the present application in detail with reference to the Figure 1 - Figure 2 accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0034] The embodiment of the present application discloses an audio control method.

[0035] This embodiment mainly realizes the direct control of audio hardware through tinymix. Tinymix is a tool for configuring and controlling Android audio hardware. By accessing the interface of the ALSA (Advanced Linux Sound Architecture) mixer, it allows developers to manage audio routing and control in a more low-level way.

[0036] S100: Establish a communication connection between the motorcycle central control 1 and the Bluetooth module 4; Specifically, the first communication end BT1 of the Bluetooth module 4 can be communicatively connected to the driving helmet end 2; the second communication end BT2 of the Bluetooth module 4 is communicatively connected to the mobile communication device; the third communication end BT3 of the Bluetooth module 4 is communicatively connected to the passenger helmet end 3; both the first communication end BT1 and the third communication end BT3 of the Bluetooth module 4 are respectively linked to the driving helmet end 2 and the passenger helmet end 3 through BT signals; the second communication end BT2 is connected to the mobile communication device through BT signals. In this embodiment, the mobile communication device can be an electronic watch, a mobile phone, a tablet, etc.

[0037] In summary, voice interaction can be achieved among the driver, the passenger, and the mobile phone user, and at the same time, it does not affect the navigation voice of the motorcycle from being transmitted to the driver, the passenger, and the mobile phone user.

[0038] Furthermore, three Bluetooth modules 4 can also be set. The three Bluetooth modules 4 (BT1, BT2, BT3) are connected to the motorcycle central control 1, and voice interaction is carried out between the three Bluetooth modules 4 and the motorcycle central control 1 through the 12S interface respectively.

[0039] S200: Receive audio information.

[0040] Specifically, in this embodiment, the audio information includes mobile device voice, driver's voice, and passenger's voice; furthermore, the audio information can be identified according to the audio information source and marked as mobile device voice, driver's voice, or passenger's voice; the mobile device voice includes navigation sound source, call sound source, and entertainment sound source.

[0041] Step S200 includes the following sub-steps: S210: Identify the current driving scenario based on the navigation sound source, the driver's voice, and the actual driving environment information. The driving scenario includes complex sections and regular sections; S220: Real-time collect the navigation sound source and the driver's voice for voice signal processing, and obtain the spectral matrix of the driver's voice through a preset algorithm and the spectral matrix of the navigation sound source , and then calculate based on the fusion model and generate a feature matrix ; For example, the spectral matrix of the driver's voice can be obtained through the short-time Fourier transform (STFT). and the spectral matrix of the navigation sound source. Then, a fusion calculation model using the attention mechanism is employed to calculate the fused feature matrix F.

[0042] S230: Import the actual driving environment information into the risk assessment model to calculate the environmental risk index ERI; The calculation formula for importing the actual driving environment information into the risk assessment model to calculate the environmental risk index ERI is as follows: Where: and are the weights of pedestrians and other vehicles respectively; , is the distance between the current vehicle and the abnormal object, , is the speed of the abnormal object, , is the included angle between the movement direction of the current vehicle and the movement direction of the abnormal object.

[0043] For example, during the driving process, a motorcycle may encounter abnormal objects including passing pedestrians and other vehicles. Electronic sensors (such as cameras, millimeter-wave radars, etc.) can be used to continuously monitor the surrounding driving environment of the motorcycle. When sudden situations such as a pedestrian emerging unexpectedly or a vehicle cutting in are detected in the actual driving environment, these environmental factors are quantified.

[0044] S240: Input the feature matrix F and the environmental risk index ERI into the specified model to perform dynamic and accurate judgment on the driving scenario.

[0045] The calculated environmental risk index ERI and the fused voice feature matrix F are input into the improved driving scenario classifier. This classifier, based on the original discrimination of complex sections and regular sections using the support vector machine (SVM), has added a decision branch for temporary sudden environmental factors. For example, when the ERI exceeds a certain threshold, even if the driving scenario is originally judged as a regular section based on the voice features, the system will immediately upgrade the driving scenario to a complex section and quickly trigger a series of emergency assistance functions such as emergency braking assistance, enhanced warning sounds, and pop-up windows to remind the driver to pay attention and avoid, comprehensively ensuring driving safety.

[0046] Through this multi-source information fusion, that is, the combination of voice and real-time environmental monitoring, dynamic and accurate judgment of the driving scenario is achieved, and the corresponding driving scenario is exported, so as to control the audio to adapt to the complex and changeable actual driving situation.

[0047] Further, the motorcycle central control 1 receives audio information from the driver (the main driver's voice is received by the main driver's helmet and then forwarded), the passenger (the passenger's voice is received by the passenger helmet 3 and then forwarded), and the mobile communication device (the mobile device's voice is sent by the mobile communication device) through the Bluetooth module 4. After receiving the above audio information, the motorcycle central control 1 identifies various voices; then step S300 is started to be executed.

[0048] S300: Analyze the audio information and convert it into an audio data frame, export the audio data frame and send the audio data frame to the driving helmet 2 and / or the passenger helmet 3.

[0049] Further, according to the audio information from different sources, when receiving, exporting the audio data frame and sending the audio data frame to the driving helmet 2 and / or the passenger helmet 3 includes the following sub-steps: S310: If it is recognized that the mobile device voice is a navigation sound source and an entertainment sound source, and the current driving scenario is a complex section, convert the navigation sound source into an audio data frame and send it to the driving helmet 2 through the Bluetooth module 4, and convert the entertainment sound source into an audio data frame and send it to the passenger helmet 3 through the Bluetooth module 4; S320: If it is recognized that the mobile device voice is a navigation sound source and a call sound source, and the current driving scenario is a complex section, convert the navigation sound source into an audio data frame and send it to the driving helmet 2 through the Bluetooth module 4, and then convert the call sound source into an audio data frame and send it to the passenger helmet 3 through the Bluetooth module 4; S330: If the main driver's voice is recognized, convert the main driver's voice into an audio data frame and send it to the passenger helmet 3 through the Bluetooth module 4; S340: If the passenger's voice is recognized, convert the passenger's voice into an audio data frame and send it to the driving helmet 2 through the Bluetooth module 4.

[0050] Further, when the driver needs to communicate with the passenger, the main driver's helmet can receive / recognize the driver's voice, that is, the main driver's voice is recognized. Then, convert the main driver's voice into an audio data frame and send it to the passenger helmet 3. The passenger helmet 3 can also receive the preset voice within the specified range in real time, so it is recognized as the passenger's voice, convert it into an audio data frame and send it to the main driver's helmet, so as to realize the voice interaction between the main driver and the passenger.

[0051] After recognizing the main driver's voice or the passenger's voice, the following steps need to be further executed: S340: Detect whether the current driving helmet 2 and the passenger helmet 3 are in the state of transmitting the mobile device voice; If so, soften and adjust the voice of the mobile device, and then convert the voice of the passenger or the driver into an audio data frame for transmission; If not, directly convert the voice of the driver into audio frame data and then send it.

[0052] In summary, this is to ensure the continuity of the entertainment sound source and the navigation sound source for the user. At the same time, the user can manually switch the transmission state of the driver's voice, which can be transmitted alone or the original voice of the mobile device can be softened and adjusted and transmitted synchronously with the driver's voice. When both the driver and the passenger are in the state of receiving the voice of the mobile device, if the driver needs to talk to the passenger, the voice of the mobile device that is in the transmission state at this time can be softened and adjusted, which does not affect the voice interaction between the driver and the passenger, and the navigation voice can also be received simultaneously, and the dual-track audio can be carried out simultaneously, which can reduce the possibility of missing the voice of the mobile device during the voice communication between the driver and the passenger.

[0053] Specifically, step S340 includes the following sub-steps: S341: Obtain the sound source of the driver's microphone and parse out the audio frames of the driver; convert the audio frames of the driver into the voice of the driver.

[0054] S342: Judge the connection state between the motorcycle central control 1 and the mobile communication device; If the motorcycle central control 1 is in the state of receiving the navigation sound source and / or the entertainment sound source, establish a communication connection between the driver's helmet end and the passenger's helmet end 3, soften and adjust the voice of the mobile device, and send the voice of the driver to the passenger's helmet end 3; If the motorcycle central control 1 is in the state of receiving the call sound source, stop obtaining the sound source of the driver's microphone and repeat the step of judging whether the motorcycle central control 1 is in the state of receiving the voice of the mobile device.

[0055] In this embodiment, the steps of softening and adjusting specifically include the following sub-steps: S1: Reduce the volume of playing the voice of the mobile device to the threshold volume; S2: Incorporate the voice of the driver and / or the voice of the passenger; S3: Perform noise reduction processing on the voice of the driver and the voice of the passenger and then transmit it.

[0056] S4: Parse the key traffic fields in the navigation voice, and the key traffic fields include speed measurement, left turn, right turn, and lane change; S5: Increase the playing volume of the key traffic fields.

[0057] While transmitting the voice between the driver and the passenger through the motorcycle central control 1, the mobile communication device is transmitting navigation voice / entertainment voice to the driver's helmet end and the passenger's helmet end 3. The former is given priority, but the key traffic fields in the navigation voice will be emphasized and broadcast to remind the driver and the passenger of the subsequent route navigation during driving, so as to prevent the driver and the passenger from missing some navigation voice when communicating.

[0058] Based on the same design concept, this embodiment also discloses an audio control system.

[0059] Reference Figure 1 - 2 , an audio control system, including a motorcycle central control 1, a driver's helmet end 2, a passenger's helmet end 3, and a Bluetooth module 4; the motorcycle central control 1 communicates and connects with the driver's helmet end 2 and the passenger's helmet end 3 through the Bluetooth module 4 and transmits the sound source.

[0060] In this embodiment, the following controls are provided on the motorcycle central control 1: Driver mute (adau1787_rider_mute): Controls whether the audio output of the driver's helmet end 2 is muted.

[0061] Passenger mute (adau1787_passenger_mute): Controls whether the audio output of the passenger's helmet end 3 is muted.

[0062] Driver microphone mute (adau1787_rider_mic_mute): Controls whether the microphone of the driver's helmet end 2 is enabled.

[0063] Passenger microphone mute (adau1787_passenger_mic_mute): Controls whether the microphone of the passenger's helmet end 3 is enabled.

[0064] Driver helmet mute (adau1787_helmet_rider_mute): Controls the mute state of the driver's helmet audio.

[0065] Passenger helmet mute (adau1787_helmet_passenger_mute): Controls the mute state of the passenger's helmet end 3 helmet audio.

[0066] This application also provides a computer-readable storage medium, storing steps that can be loaded and executed by a processor to implement the above steps.

[0067] The computer-readable storage medium includes, for example: various media such as USB flash drives, mobile hard disks, read-only memories (ROM), random access memories (RAM), magnetic disks, or optical discs that can store program codes.

[0068] Based on the same inventive concept, an embodiment of the present application provides a computer device, including a memory and a processor, and a computer program capable of being loaded and executed by the processor is stored on the memory to implement the above method.

[0069] Those skilled in the art can clearly understand that for the convenience and brevity of description, only the above division of each functional module is used as an example. In actual applications, the above functions can be allocated to different functional modules according to needs, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. The specific working processes of the systems, devices, and units described above can refer to the corresponding processes in the foregoing method embodiments and will not be elaborated herein.

[0070] In several embodiments provided by the present application, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical functional division, and there can be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the couplings or direct couplings or communication connections shown or discussed with each other can be through some interfaces, and the indirect couplings or communication connections of the devices or units can be in electrical, mechanical, or other forms.

[0071] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they can be located in one place or distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0072] In addition, each functional unit in various embodiments of the present application can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit. The above integrated units can be implemented in the form of hardware or in the form of software functional units.

[0073] When the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to execute all or part of the steps of the methods described in various embodiments of this application. The aforementioned storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories, random access memories, magnetic disks, or optical discs that can store program codes.

[0074] As described above, the above embodiments are only used to introduce the technical solution of this application in detail. However, the description of the above embodiments is only for helping to understand the method and its core idea of this application, and should not be construed as a limitation of this application. Any changes or substitutions that can be easily thought of by those skilled in the art within the technical scope disclosed in this application should be covered within the protection scope of this application.

[0075] For example, when a motorcycle is in motion, it will encounter strange animals including passing pedestrians and other vehicles. Electronic sensors (such as cameras, millimeter-wave radars, etc.) can be used to monitor the surrounding driving environment of the motorcycle in real time. When sudden situations such as a pedestrian emerging suddenly or a vehicle cutting in are detected in the actual driving environment, these environmental factors are quantified.

[0076] S240: Input the feature matrix F and the environmental risk index ERI into the specified model together to perform dynamic and accurate judgment on the driving scenario.

[0077] Input the calculated environmental risk index ERI and the fused voice feature matrix F into the improved driving scenario classifier together. This classifier, on the basis of the original discrimination of complex sections and regular sections based on the support vector machine (SVM), adds a decision branch for temporary sudden environmental factors. For example, when the ERI exceeds a certain threshold, even if the section is originally judged as a regular section according to the voice features, the system will immediately upgrade the driving scenario to a complex section and quickly trigger a series of emergency assistance functions such as emergency braking assistance, enhanced warning sounds, and pop-up windows to remind the driver to pay attention to avoidance, comprehensively ensuring driving safety.

[0078] Through this multi-source information fusion, that is, the combination of voice and real-time environmental monitoring, dynamic and accurate judgment of the driving scenario is realized and the corresponding driving scenario is exported, so as to control the audio to adapt to the complex and changeable actual driving situation.

[0079] Further, the motorcycle central control 1 receives audio information from the driver (the main driver's voice is received by the main driver's helmet and then forwarded), the passenger (the passenger's voice is received by the passenger helmet 3 and then forwarded), and the mobile communication device (the mobile device's voice is sent by the mobile communication device) through the Bluetooth module 4. After receiving the above audio information, the motorcycle central control 1 identifies various types of voices; then, step S300 is started to be executed.

[0080] S300: Analyze the audio information and convert it into an audio data frame, export the audio data frame and send the audio data frame to the driving helmet 2 and / or the passenger helmet 3.

[0081] Further, according to the audio information from different sources, when receiving, exporting the audio data frame and sending the audio data frame to the driving helmet 2 and / or the passenger helmet 3 includes the following sub-steps: S310: If it is recognized that the mobile device voice is a navigation sound source and an entertainment sound source, and the current driving scenario is a complex section, convert the navigation sound source into an audio data frame and send it to the driving helmet 2 through the Bluetooth module 4, and convert the entertainment sound source into an audio data frame and send it to the passenger helmet 3 through the Bluetooth module 4; S320: If it is recognized that the mobile device voice is a navigation sound source and a call sound source, and the current driving scenario is a complex section, convert the navigation sound source into an audio data frame and send it to the driving helmet 2 through the Bluetooth module 4, and then convert the call sound source into an audio data frame and send it to the passenger helmet 3 through the Bluetooth module 4; S330: If the main driver's voice is recognized, convert the main driver's voice into an audio data frame and send it to the passenger helmet 3 through the Bluetooth module 4; S340: If the passenger's voice is recognized, convert the passenger's voice into an audio data frame and send it to the driving helmet 2 through the Bluetooth module 4.

[0082] Further, when the driver needs to communicate with the passenger, the main driver's helmet can receive / recognize the driver's voice, that is, the main driver's voice is recognized. Then, convert the main driver's voice into an audio data frame and send it to the passenger helmet 3. The passenger helmet 3 can also receive the preset voice within the specified range in real time, so it is recognized as the passenger's voice, convert it into an audio data frame and send it to the main driver's helmet, so as to realize the voice interaction between the main driver and the passenger.

[0083] After recognizing the main driver's voice or the passenger's voice, the following steps need to be further executed: S340: Detect whether the current driving helmet 2 and the passenger helmet 3 are in the state of transmitting the mobile device voice; If so, perform softening adjustment on the mobile device voice and then convert the passenger's voice or the main driver's voice into an audio data frame for sending; If not, directly convert the driver's voice into audio frame data and then send it.

[0084] In summary, this is to ensure the continuity of the entertainment sound source and navigation sound source received by the user. At the same time, the user can manually switch the transmission status of the driver's voice. The driver's voice can be transmitted alone, or the original mobile device voice can be softened and adjusted and then transmitted synchronously with the driver's voice. When both the driver and the passenger are in the state of receiving the mobile device voice, if the driver needs to communicate with the passenger, the mobile device voice that is in the transmission state at this time can be softened and adjusted, which does not affect the voice interaction between the driver and the passenger, and the navigation voice can also be received simultaneously, and the dual-track audio can be carried out simultaneously, which can reduce the possibility of the driver and the passenger missing the mobile device voice during voice communication.

[0085] Specifically, step S340 includes the following sub-steps: S341: Obtain the sound source of the driver's microphone and parse out the audio frames of the driver; convert the audio frames of the driver into the driver's voice.

[0086] S342: Judge the connection status between the motorcycle central control 1 and the mobile communication device; If the motorcycle central control 1 is in the state of receiving the navigation sound source and / or entertainment sound source, establish a communication connection between the driver's helmet end and the passenger's helmet end 3, soften and adjust the mobile device voice, and send the driver's voice to the passenger's helmet end 3; If the motorcycle central control 1 is in the state of receiving the call sound source, stop obtaining the sound source of the driver's microphone and repeat the step of judging whether the motorcycle central control 1 is in the state of receiving the mobile device voice.

[0087] In this embodiment, the steps of softening and adjusting specifically include the following sub-steps: S1: Reduce the volume of the mobile device voice being played to the threshold volume; S2: Incorporate the driver's voice and / or the passenger's voice; S3: Perform noise reduction processing on the driver's voice and the passenger's voice and then transmit them.

[0088] S4: Parse the key traffic fields in the navigation voice. The key traffic fields include speed measurement, left turn, right turn, and lane change; S5: Increase the playback volume of the key traffic fields.

[0089] When transmitting the voice between the driver and the passenger through the motorcycle central control 1, the mobile communication device is transmitting navigation voice / entertainment voice to the driver's helmet end and the passenger's helmet end 3. The former is given priority, but the key traffic fields in the navigation voice will be highlighted and broadcast to remind the driver and the passenger of the subsequent route navigation during driving, so as to prevent the driver and the passenger from missing some navigation voices when communicating.

[0090] Based on the same inventive concept, this embodiment also discloses an audio control system.

[0091] Reference Figure 1 and Figure 2 , an audio control system, including a motorcycle central control 1, a driver's helmet terminal 2, a passenger's helmet terminal 3, and a Bluetooth module 4; the motorcycle central control 1 communicates with the driver's helmet terminal 2 and the passenger's helmet terminal 3 through the Bluetooth module 4 and transmits the sound source.

[0092] In this embodiment, the following controls are provided on the motorcycle central control 1: Main driver mute (adau1787_rider_mute): Controls whether the audio output of the driver's helmet terminal 2 is muted.

[0093] Co-pilot mute (adau1787_passenger_mute): Controls whether the audio output of the passenger's helmet terminal 3 is muted.

[0094] Main driver microphone mute (adau1787_rider_mic_mute): Controls whether the microphone of the main driver's helmet terminal 2 is enabled.

[0095] Co-pilot microphone mute (adau1787_passenger_mic_mute): Controls whether the microphone of the passenger's helmet terminal 3 is enabled.

[0096] Main driver helmet mute (adau1787_helmet_rider_mute): Controls the mute state of the audio of the main driver's helmet.

[0097] Co-pilot helmet mute (adau1787_helmet_passenger_mute): Controls the mute state of the audio of the passenger's helmet terminal 3.

[0098] This application also provides a computer-readable storage medium, storing a program that can be loaded and executed by a processor to implement the above steps.

[0099] The computer-readable storage medium includes, for example: various media such as USB flash drives, mobile hard disks, read-only memories (ROM), random access memories (RAM), magnetic disks, or optical discs that can store program codes.

[0100] Based on the same inventive concept, an embodiment of this application provides a computer device, including a memory and a processor, and a computer program capable of being loaded and executed by the processor to implement the above method is stored on the memory.

[0101] Those skilled in the art can clearly understand that, for the convenience and conciseness of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above functions can be allocated to different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working processes of the systems, devices, and units described above can refer to the corresponding processes in the foregoing method embodiments and will not be elaborated herein.

[0102] In several embodiments provided in the present application, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division, and there can be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed couplings or direct couplings or communication connections to each other can be through some interfaces, and the indirect couplings or communication connections of the devices or units can be in electrical, mechanical, or other forms.

[0103] The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they can be located in one place or distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0104] In addition, the functional units in each embodiment of the present application can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above integrated units can be implemented in the form of hardware or in the form of software functional units.

[0105] If the above integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or all or part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to execute all or part of the steps of the methods described in each embodiment of the present application. The foregoing storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories, random access memories, magnetic disks, or optical discs that can store program codes.

[0106] As described above, the above embodiments are only used to introduce the technical solutions of the present application in detail. However, the description of the above embodiments is only for helping to understand the method and its core idea of the present application, and should not be construed as a limitation of the present application. Any changes or substitutions that can be easily thought of by those skilled in the art within the technical scope disclosed in the present application should be covered within the protection scope of the present application.

Claims

1. An audio control method, characterized in that: The following steps are involved: Establishing a communication connection between the motorcycle central control (1) and the Bluetooth module (4); The first communication terminal BT1 of the Bluetooth module (4) is communicatively connected to the driving helmet terminal (2); A second communication terminal BT2 of the Bluetooth module (4) is connected to a mobile communication device for communication; The third communication terminal BT3 of the Bluetooth module (4) is communicatively connected to the passenger helmet terminal (3); Receive audio information; The audio information is parsed and converted into audio data frames, the audio data frames are exported and sent to the driving helmet end (2) and / or the passenger helmet end (3).

2. The audio control method according to claim 1, characterized in that: The audio information includes the voice of the mobile device, the driver's voice, and the passenger's voice; the audio control method further includes the following steps: The audio information is identified according to its source and marked as the mobile device voice, the driver's voice or the passenger's voice.

3. The audio control method according to claim 2, characterized in that: The mobile device voice includes navigation audio source, call audio source and entertainment audio source; based on the navigation audio source, the main driver's voice and the actual driving environment information, the current driving scene is identified, and the driving scene includes a complex road section and a regular road section; Specifically include The following sub-steps: Real-time collection of navigation audio source and driver's voice for voice signal processing, and the frequency spectrum matrix of the driver's voice is obtained through the preset algorithm And the spectrum matrix of the navigation sound source , and then calculate based on the fusion model and Generate feature matrix ; Import the actual driving environment information into the risk assessment model to calculate the environmental risk index ERI; The feature matrix F and the environmental risk index ERI are input into the specified model together to perform dynamic and accurate judgment on the driving scenario.

4. The audio control method according to claim 3, characterized in that: The calculation formula for importing the actual driving environment information into the risk assessment model to calculate the environmental risk index ERI is as follows: ； in: and are the weights of pedestrians and other vehicles respectively; , is the distance between the current vehicle and the alien animal, , For the speed of different animals, , It is the angle between the current vehicle's moving direction and the alien animal's moving direction.

5. The audio control method according to claim 3, characterized in that: The following steps are also included: The step of exporting the audio data frame and sending the audio data frame to the driving helmet end (2) and / or the passenger helmet end (3) comprises the following sub-steps: If the mobile device voice is identified as a navigation sound source and an entertainment sound source, and the current driving scene is a complex road section, the navigation sound source is converted into an audio data frame and sent to the driving helmet end (2) through the Bluetooth module (4), and the entertainment sound source is converted into an audio data frame and sent to the passenger helmet end (3) through the Bluetooth module (4); If the mobile device voice is identified as a navigation sound source and a call sound source, and the current driving scene is a complex road section, the navigation sound source is converted into an audio data frame and sent to the driving helmet end (2) through the Bluetooth module (4), and the call sound source is converted into an audio data frame and sent to the passenger helmet end (3) through the Bluetooth module (4); If the driver's voice is recognized, the driver's voice is converted into an audio data frame and sent to the passenger helmet end (3) via the Bluetooth module (4); If the passenger's voice is recognized, the passenger's voice is converted into an audio data frame and sent to the driving helmet end (2) via the Bluetooth module (4).

6. The audio control method according to claim 2, characterized in that: The step of receiving audio information comprises the following sub-steps: Get the main driver microphone sound source and parse the main driver sound frame; Converting the main driver audio frame into the main driver voice; Determining the connection status between the motorcycle central control (1) and the mobile communication device; If the motorcycle central control (1) is in a state of receiving the navigation sound source and / or the entertainment sound source, a communication connection is established between the driver's helmet end and the passenger's helmet end (3), the voice of the mobile device is softened and adjusted, and the driver's voice is sent to the passenger's helmet end (3); If the motorcycle central control (1) is in the state of receiving the call audio source, then stop acquiring the main driving microphone audio source and repeat the step of determining whether the motorcycle central control (1) is in the state of receiving the mobile device voice.

7. The audio control method according to claim 6, characterized in that: The softening adjustment step specifically includes the following sub-steps: Lowering the volume of the voice played on the mobile device to a threshold volume; Incorporating the driver's voice and / or passenger's voice; The driver's voice and the passenger's voice are transmitted after being subjected to noise reduction processing.

8. An audio control system, characterized in that The motorcycle central control (1) comprises a driving helmet end (2), a passenger helmet end (3), and a Bluetooth module (4); the motorcycle central control (1) is connected to the driving helmet end (2) and the passenger helmet end (3) through the Bluetooth module (4) to communicate and transmit sound sources; The motorcycle central control (1) is provided with the following controls: A voice recognition module is used to recognize voice information transmitted by mobile devices, driver helmets, and passenger helmets; Main driver mute adau1787_rider_mute: Controls whether the audio output of the driver's helmet (2) is muted; Co-pilot mute adau1787_passenger_mute: Controls whether the audio output of the passenger helmet terminal (3) is muted; Driver microphone mute adau1787_rider_mic_mute: controls whether the driver's helmet microphone (2) is enabled or not; Passenger microphone mute adau1787_passenger_mic_mute: Controls whether the passenger helmet microphone (3) is enabled or not; Main driver helmet muteadau1787_helmet_rider_mute: controls the mute state of the audio on the main driver helmet (2); Co-pilot helmet mute adau1787_helmet_passenger_mute: Controls the mute state of the helmet audio on the passenger helmet side (3).

9. A computer device, characterized in that The method comprises a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the processor implements the audio control method according to any one of claims 1 to 8 when executing the computer program.

10. A computer-readable storage medium, characterized in that The computer storage medium stores a computer program; when the computer program is executed by a processor, the audio control method according to any one of claims 1 to 8 is implemented.

Images