Vehicle-mounted audio processing method, system and device and computer readable storage medium

Abstract

The invention discloses a vehicle-mounted audio processing method, system and device and a computer readable storage medium, and relates to the technical field of multi-audio playing, and the method specifically comprises the steps: building the wireless connection between an earphone and a vehicle machine system when the earphone at a non-main driving position is detected to be taken out; if it is detected that the wireless connection is established successfully, starting an independent process of a voice assistant to receive a target instruction from the earphone; and feedback information of the target instruction is output through the earphone to prevent influence on a main driver, and the feedback information comprises voice output and audio broadcast of a voice assistant. The driving safety can be improved, and the user experience can be optimized.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of multi-audio playing, and in particular to a vehicle-mounted audio processing method, system, device and computer readable storage medium. BACKGROUND

[0002] With the continuous development of vehicle-mounted voice technology, voice assistants have become a standard function of intelligent cockpits. Many systems support multi-audio zone recognition, which facilitates voice interaction of personnel in different areas in the vehicle. However, there are two obvious deficiencies in the prior art: first, when the copilot uses the vehicle-mounted voice, the sound produced by the operation process (such as issuing instructions) and related entertainment functions (such as playing music and watching videos) of the copilot can easily distract the attention of the driver, thereby posing a potential risk to driving safety; second, the sound of the vehicle-mounted voice assistant or entertainment system may overlap with the voice prompts of the vehicle-mounted navigation, resulting in mixed information and seriously affecting the user experience.

[0003] Therefore, how to improve driving safety and optimize user experience is a problem that needs to be solved at present. SUMMARY

[0004] The present application provides a vehicle-mounted audio processing method, system, device and computer readable storage medium, which can improve driving safety and optimize user experience.

[0005] In a first aspect, an embodiment of the present application provides a vehicle-mounted audio processing method, which comprises: establishing a wireless connection between the earphone and the vehicle-mounted system when detecting that the earphone at a non-driver position is taken out; if it is detected that the wireless connection is successfully established, starting an independent process of a voice assistant to receive a target instruction from the earphone; outputting feedback information of the target instruction through the earphone to prevent affecting the driver, wherein the feedback information comprises voice output and audio broadcast of the voice assistant.

[0006] In combination with the first aspect, in an embodiment, the starting of the independent process of the voice assistant comprises: creating an independent process instance; binding the process instance with an audio input stream and an audio output stream of the earphone.

[0007] In combination with the first aspect, in an embodiment, before the step of establishing the wireless connection between the earphone and the vehicle-mounted system when detecting that the earphone at a non-driver position is taken out, the method further comprises: when detecting that the vehicle-mounted system is equipped with a non-driver screen, performing the step of establishing the wireless connection between the earphone and the vehicle-mounted system when detecting that the earphone at a non-driver position is taken out; When it is detected that the car machine system is only equipped with a main driver screen and the operator is located at a non-main driver position, the step of establishing the wireless connection between the earphone and the car machine system when the earphone is taken out at the non-main driver position is performed.

[0008] In combination with the first aspect, in an implementation, the method further includes: When it is detected that the car machine system is only equipped with a main driver screen and the operator is located at a main driver position, the audio broadcast is output through the car machine speaker.

[0009] In combination with the first aspect, in an implementation, before the step of establishing the wireless connection between the earphone and the car machine system when the earphone is taken out at the non-main driver position, the method further includes: acquiring the earphone power; if the earphone power is less than a preset power threshold, the earphone is placed in an earphone compartment for charging.

[0010] In a second aspect, an embodiment of the present application provides a vehicle-mounted audio processing system, which includes: a first processing module configured to establish a wireless connection between the earphone and the car machine system when the earphone is taken out at a non-main driver position; a second processing module configured to start an independent process of a voice assistant to receive a target instruction from the earphone if it is detected that the wireless connection is successfully established; a third processing module configured to output feedback information of the target instruction through the earphone, so as to prevent affecting the main driver, the feedback information including voice output and audio broadcast of the voice assistant.

[0011] In combination with the second aspect, in an implementation, the second processing module is specifically configured to: create an independent process instance; bind the process instance with an audio input stream and an audio output stream of the earphone.

[0012] In combination with the second aspect, in an implementation, the first processing module is specifically configured to: when it is detected that the car machine system is equipped with a non-main driver screen, the step of establishing the wireless connection between the earphone and the car machine system when the earphone is taken out at the non-main driver position is performed; when it is detected that the car machine system is only equipped with a main driver screen and the operator is located at a non-main driver position, the step of establishing the wireless connection between the earphone and the car machine system when the earphone is taken out at the non-main driver position is performed.

[0013] Thirdly, embodiments of this application provide an in-vehicle audio processing device, which includes a processor, a memory, and an in-vehicle audio processing program stored in the memory and executable by the processor, wherein when the in-vehicle audio processing program is executed by the processor, it implements the steps of the in-vehicle audio processing method as described in any of the preceding claims.

[0014] Fourthly, embodiments of this application provide a computer-readable storage medium storing an in-vehicle audio processing program, wherein when the in-vehicle audio processing program is executed by a processor, it implements the steps of the in-vehicle audio processing method as described in any of the preceding claims.

[0015] The beneficial effects of the technical solutions provided in this application include: When the removal of the earphone from a non-driver's seat is detected, a wireless connection is established between the earphone and the vehicle's infotainment system. If the wireless connection is successfully established, an independent process of the voice assistant is started to receive the target command from the earphone, avoiding auditory interference to the driver and reducing driving risks caused by distraction. The target command includes the voice output and audio playback feedback information of the voice assistant, which is output through the earphone, avoiding conflicts between different audio sources in the vehicle and improving the smoothness and convenience of using the function. Attached Figure Description

[0016] Figure 1 This is a flowchart illustrating an embodiment of the vehicle audio processing method of this application; Figure 2 For this application Figure 1 A detailed flowchart of step S20; Figure 3 This is a schematic diagram of the functional modules of an embodiment of the vehicle audio processing system of this application; Figure 4 This is a schematic diagram of the hardware structure of the in-vehicle audio processing device involved in the embodiments of this application. Detailed Implementation

[0017] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of the present application.

[0018] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0019] In a first aspect, the embodiments of the present application provide a vehicle-mounted audio processing method.

[0020] In an embodiment, the vehicle-mounted audio processing method comprises the following steps. Figure 1 Figure 1 FIG. 1 is a flowchart of the vehicle-mounted audio processing method according to an embodiment of the present application. As shown in FIG. 1, the vehicle-mounted audio processing method comprises the following steps. Figure 1 Step S10: Establishing a wireless connection between the earphone and the vehicle-mounted system when detecting that the earphone at a non-main driving position is taken out.

[0021] In an embodiment of the present application, the non-main driving position refers to a position other than the main driving position, such as the co-driver position. When the system detects that the earphone at the non-main driving position is taken out, a wireless connection establishment process between the vehicle-mounted system and the earphone is triggered. Specifically, the vehicle-mounted system can recognize the signal of the earphone through a wireless communication module (such as Bluetooth or Wi-Fi) and perform pairing to achieve the connection between the earphone and the vehicle-mounted system. The above operation lays the foundation for the independent operation of the voice assistant and avoids interference and information overlap between the main driving area and the non-main driving area.

[0022] Step S20: Starting an independent process of the voice assistant to receive a target instruction from the earphone if it is detected that the wireless connection is successfully established.

[0023] In an embodiment of the present application, when the system detects that the wireless connection between the earphone and the vehicle-mounted system is successfully established, the vehicle-mounted system starts an independent process of the voice assistant according to the connection state. At this time, the voice assistant does not share resources with the voice interaction process of the main driver, but allocates an independent running environment for the earphone in the non-main driving area to ensure that the instruction processing in the non-main driving area does not interfere with the operation in the main driving area. After the independent process of the voice assistant is started, it enters a listening state and specially receives the target instruction transmitted from the non-main driving earphone, so that the voice interaction in the non-main driving area is carried out in an independent and interference-free state, thereby optimizing the user experience and effectively avoiding the influence on the main driver.

[0024] It should be noted that if it is detected that the wireless connection between the earphone and the vehicle-mounted system is not successfully established, the system will issue a warning prompt to remind the non-main driver to check the state of the wireless device or perform other troubleshooting operations. At the same time, the system will remain in a standby state and wait for subsequent connection attempts to ensure that the non-main driver can smoothly use the voice assistant function when the conditions allow.

[0025] Step S30: Outputting feedback information of the target instruction through the earphone to prevent affecting the main driver, wherein the feedback information comprises voice output and audio broadcast of the voice assistant. ​​

[0026] Exemplarily, in the embodiments of the present application, the feedback information includes voice output of the voice assistant and audio broadcast, wherein the voice output of the voice assistant refers to voice feedback (i.e. voice interaction) given by the voice assistant after the non-primary driver issues an instruction; the audio broadcast refers to execution of the specific instruction of the voice assistant by the non-primary driver, such as playing a piece of music or playing a movie (i.e. independent processing of entertainment audio); specifically, after receiving the target instruction of the earphone of the non-primary driver, the car machine system outputs the feedback information of the voice assistant through the earphone instead of playing through the vehicle-mounted loudspeaker; the information is transmitted to the non-primary driver area through the earphone, thereby avoiding interference in the primary driver area. In this way, the voice assistant interaction and entertainment function of the non-primary driver will not affect the driving task of the primary driver, avoiding the primary driver being distracted due to external audio interference, ensuring driving safety, and optimizing user experience in multiple areas in the vehicle.

[0027] The present application establishes a wireless connection between the earphone of the non-primary driver position and the car machine system when detecting that the earphone is taken out, and if it is detected that the wireless connection is successfully established, an independent process of the voice assistant is started to receive the target instruction from the earphone, thereby avoiding auditory interference to the primary driver and reducing driving risks caused by distraction of attention; the feedback information including voice output of the voice assistant and audio broadcast in the target instruction is output through the earphone, thereby avoiding conflict between different audio sources in the vehicle and improving the fluency and convenience of function use.

[0028] Further, in an embodiment, referring to Fig. 2, Figure 2 the starting of the independent process of the voice assistant includes: Step S201: creating an independent process instance; Step S202: binding the process instance with the audio input stream and the audio output stream of the earphone.

[0029] Exemplarily, in the embodiments of the present application, the car machine system first creates an independent process instance, which is specifically used for processing instructions from the earphone of the non-primary driver, and this process is completely isolated from the voice assistant process in the primary driver area, thereby ensuring that the operation of the non-primary driver will not cause any interference to the primary driver area; then the independent process is bound with the audio input stream and the audio output stream of the earphone of the non-primary driver, the principle of which is to identify the audio input and output channels of the earphone through wireless communication technology (such as Bluetooth or Wi-Fi) and connect them with the independent process, so that voice input and system feedback in the non-primary driver area can be processed independently through the earphone, ensuring that the audio signal only flows in the non-primary driver area, avoiding conflict with the audio output in the primary driver area, thereby optimizing driving safety and user experience.

[0030] Further, in an embodiment, before the step of establishing the wireless connection between the earphone and the car machine system when the earphone is taken out in the non-main driving position is detected, the method further comprises: when it is detected that the car machine system is equipped with a non-main driving screen, the step of establishing the wireless connection between the earphone and the car machine system when the earphone is taken out in the non-main driving position is detected is performed; when it is detected that the car machine system is equipped with only a main driving screen and the operator is in the non-main driving position, the step of establishing the wireless connection between the earphone and the car machine system when the earphone is taken out in the non-main driving position is detected is performed.

[0031] For example, in the embodiment of the present application, the non-main driving screen refers to a screen other than the main driving screen. If the car machine is equipped with a non-main driving screen, the system automatically performs the step of establishing the wireless connection between the earphone and the car machine system when the earphone is taken out in the non-main driving position to ensure that the voice interaction function in the non-main driving area can be normally started. If the car machine system is equipped with only a main driving screen, the operator can be determined by a car camera or a position sensor, and if the operator is in the non-main driving position, the system also performs the same step. The above steps ensure that the car machine system can be flexibly adjusted according to different hardware configurations and the position of the operator, and start an independent voice assistant interaction in the non-main driving area to avoid interference with the main driving area, thereby improving safety and user experience.

[0032] Further, in an embodiment, the method further comprises: when it is detected that the car machine system is equipped with only a main driving screen and the operator is in the main driving position, the audio broadcast is output through the car machine speaker.

[0033] For example, in the embodiment of the present application, if the car machine system is equipped with only a main driving screen and the operator is in the main driving position, the car machine system outputs the audio broadcast through the car speaker instead of through the earphone or other devices in the non-main driving area, thereby ensuring that the audio broadcast can be clearly conveyed in the main driving area while avoiding affecting the audio output in the non-main driving area. In this way, the system effectively realizes the management of audio output between different areas, ensures that the main driver can focus on driving, and avoids interference with the non-main driving area, thereby optimizing the audio experience and driving safety in the car.

[0034] Further, in an embodiment, before the step of establishing the wireless connection between the earphone and the car machine system when the earphone is taken out in the non-main driving position is detected, the method further comprises: acquiring the earphone power; if the earphone power is less than a preset power threshold, the earphone is placed in the earphone compartment for charging.

[0035] For example, in the embodiments of the present application, the preset power threshold can be determined according to actual needs, which is not limited herein. The car machine system can establish a connection with the earphone through wireless communication technology and read the battery state information of the earphone, compare the monitored earphone power with the preset power threshold, and if the earphone power is lower than the preset power threshold, it indicates that the earphone needs to be charged. At this time, the system can instruct the user to place the earphone in the earphone compartment for charging to ensure that the earphone has enough power for the next use. Through the above judgment strategy, the system can effectively avoid the inconvenience caused by insufficient earphone power and ensure that the earphone is always in a usable state.

[0036] In a second aspect, the embodiments of the present application also provide a vehicle-mounted audio processing system.

[0037] In an embodiment, with reference to Figure 3 , Figure 3 is a schematic diagram of the functional modules of the vehicle-mounted audio processing system of the present application. As shown in Figure 3 , the vehicle-mounted audio processing system comprises: a first processing module for establishing a wireless connection between the earphone and the car machine system when the earphone is taken out at a non-primary driving position; a second processing module for starting an independent process of the voice assistant to receive target instructions from the earphone if it is detected that the wireless connection is successfully established; a third processing module for outputting feedback information of the target instructions through the earphone to prevent affecting the primary driver, wherein the feedback information includes voice output and audio broadcast of the voice assistant.

[0038] Further, in an embodiment, the second processing module is specifically used for: creating an independent process instance; binding the process instance with the audio input stream and the audio output stream of the earphone.

[0039] Further, in an embodiment, the first processing module is specifically used for: when it is detected that the car machine system is equipped with a non-primary driving screen, performing the step of establishing a wireless connection between the earphone and the car machine system when the earphone is taken out at a non-primary driving position; when it is detected that the car machine system is only equipped with a primary driving screen and the operator is located at a non-primary driving position, performing the step of establishing a wireless connection between the earphone and the car machine system when the earphone is taken out at a non-primary driving position.

[0040] Further, in an embodiment, the first processing module is specifically used for: when it is detected that the car machine system is only equipped with a primary driving screen and the operator is located at a primary driving position, outputting audio broadcast through a car machine loudspeaker.

[0041] Further, in an embodiment, the first processing module is specifically further configured to: acquire the earphone power; if the earphone power is less than a preset power threshold, place the earphone in the earphone compartment for charging.

[0042] The application establishes a wireless connection between the earphone and the vehicle system when detecting the earphone being taken out from the non-primary driving position, and if it is detected that the wireless connection is successfully established, starts an independent process of the voice assistant to receive target instructions from the earphone, avoiding auditory interference to the primary driver and reducing driving risks caused by distraction; outputs feedback information including voice output and audio broadcast of the voice assistant in the target instructions through the earphone, avoiding conflicts between different audio sources in the vehicle and improving the smoothness and convenience of function use.

[0043] Corresponding to each step in the above-mentioned vehicle audio processing method embodiment, the function implementation of each module in the above-mentioned vehicle audio processing system is not repeated here.

[0044] In a third aspect, the embodiments of the application provide a vehicle audio processing device. The vehicle audio processing device can be a personal computer (PC), a notebook computer, a server, or other devices with data processing functions.

[0045] Reference Figure 4 , Figure 4 is a schematic diagram of the hardware structure of the vehicle audio processing device involved in the embodiments of the application. In the embodiments of the application, the vehicle audio processing device can include a processor, a memory, a communication interface, and a communication bus.

[0046] The communication bus can be of any type, used to interconnect the processor, the memory, and the communication interface.

[0047] The communication interface includes input / output (I / O) interfaces, physical interfaces, and logical interfaces, and other interfaces used to interconnect devices inside the vehicle audio processing device, and interfaces used to interconnect the vehicle audio processing device with other devices (such as other computing devices or user devices). The physical interface can be an Ethernet interface, a fiber interface, an ATM interface, etc.; the user device can be a display (Display), a keyboard (Keyboard), etc.

[0048] Memory can be various types of storage media, such as random access memory (RAM), read-only memory (ROM), non-volatile RAM (NVRAM), flash memory, optical storage, hard disk, programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), etc.

[0049] The processor can be a general-purpose processor, which can call the in-vehicle audio processing program stored in the memory and execute the in-vehicle audio processing method provided in the embodiments of this application. For example, the general-purpose processor can be a central processing unit (CPU). The method executed when the in-vehicle audio processing program is called can be referred to in the various embodiments of the in-vehicle audio processing method of this application, and will not be repeated here.

[0050] Those skilled in the art will understand that Figure 4 The hardware structure shown does not constitute a limitation of this application and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0051] Fourthly, embodiments of this application also provide a readable storage medium.

[0052] The present application has a readable storage medium storing an in-vehicle audio processing program, wherein when the in-vehicle audio processing program is executed by a processor, it implements the steps of the in-vehicle audio processing method described above.

[0053] The method implemented when the vehicle audio processing program is executed can be referred to in various embodiments of the vehicle audio processing method of this application, and will not be repeated here.

[0054] The terms "comprising" and "having," and any variations thereof, in the specification, claims, and accompanying drawings of this application are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to such process, method, product, or apparatus. The terms "first," "second," and "third," etc., are used to distinguish different objects, etc., and do not indicate a sequence, nor do they limit "first," "second," and "third" to different types.

[0055] In the description of the embodiments of the present application, "exemplary", "for example", "e.g." or "for instance" are used on the basis that a thing in the example is presented merely as an example, illustration, or description. Any embodiment or design scheme described as "exemplary", "for example", or "for instance" in the embodiments of the present application should not be interpreted as being more preferred or having more advantages than other embodiments or design schemes. Rather, the words "exemplary", "for example", or "for instance" are intended to present the relevant concept in a specific manner.

[0056] In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in the text merely describes the relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which means that there are three cases of A alone, A and B together, and B alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0057] In some processes described in the embodiments of the present application, a plurality of operations or steps are included in a specific order, but it should be understood that these operations or steps can be executed or executed in parallel without the order in which they appear in the embodiments of the present application. The serial number of the operation is only used to distinguish different operations, and the serial number itself does not represent any execution order. In addition, these processes can include more or fewer operations, and these operations or steps can be executed in sequence or in parallel, and these operations or steps can be combined.

[0058] It should be noted that the serial numbers of the above embodiments are only for description, and do not represent the advantages and disadvantages of the embodiments.

[0059] From the above description of the embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment method can be realized by means of software and necessary general hardware platform, of course, it can also be realized by hardware, but in many cases the former is a better embodiment. Based on such understanding, the technical solutions of the present application can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes a plurality of instructions for making a terminal device execute the method described in each embodiment of the present application.

[0060] The above is only the preferred embodiment of the present application, and does not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation based on the content of the specification and drawings, or direct or indirect application in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A method for processing audio in a vehicle, the method comprising: The in-vehicle audio processing method includes: When it is detected that the earphone in a non-driver's seat has been removed, a wireless connection is established between the earphone and the vehicle system. If the wireless connection is successfully established, a separate process for the voice assistant is started to receive the target command from the headset; The feedback information of the target command is output through the headset to prevent it from affecting the driver. The feedback information includes the voice output and audio broadcast of the voice assistant.

2. The in-vehicle audio processing method as described in claim 1, characterized in that, The independent process for launching the voice assistant includes: Create a separate process instance; Bind the process instance to the audio input stream and audio output stream of the headset.

3. The in-vehicle audio processing method as described in claim 1, characterized in that, Prior to the step of detecting that the earphone has been removed from a non-driver's position, the method further includes: When it is detected that the vehicle system is equipped with a non-driver's screen, the step of establishing a wireless connection between the earphone and the vehicle system when it is detected that the earphone in the non-driver's position is removed is executed. When it is detected that the vehicle infotainment system is only equipped with a driver's side screen and the operator is in a non-driver's side position, the step of establishing a wireless connection between the earphone and the vehicle infotainment system when the earphone in the non-driver's side position is detected to be removed is executed.

4. The in-vehicle audio processing method as described in claim 3, characterized in that, The method further includes: When it is detected that the vehicle's infotainment system is only equipped with a driver's side screen and the operator is in the driver's seat, the audio will be output through the vehicle's speakers.

5. The in-vehicle audio processing method as described in claim 1, characterized in that, Before the step of establishing a wireless connection between the earphone and the vehicle system when the earphone is detected to be removed from a non-driver's position, the method further includes: Get headphone battery level; If the earphone battery level is lower than a preset battery threshold, the earphone will be placed in the charging case for charging.

6. An in-vehicle audio processing system, characterized in that, The in-vehicle audio processing system includes: The first processing module is used to establish a wireless connection between the earphone and the vehicle system when it is detected that the earphone in the non-driver's position has been removed. The second processing module is used to start a separate process of the voice assistant to receive target instructions from the headset if the wireless connection is detected to be successfully established. The third processing module is used to output the feedback information of the target instruction through the headset to prevent it from affecting the driver. The feedback information includes the voice output and audio playback of the voice assistant.

7. The in-vehicle audio processing system as described in claim 6, characterized in that, The second processing module is specifically used for: Create a separate process instance; Bind the process instance to the audio input stream and audio output stream of the headset.

8. The in-vehicle audio processing system as described in claim 6, characterized in that, The first processing module is specifically used for: When it is detected that the vehicle system is equipped with a non-driver's screen, the step of establishing a wireless connection between the earphone and the vehicle system when it is detected that the earphone in the non-driver's position is removed is executed. When it is detected that the vehicle infotainment system is only equipped with a driver's side screen and the operator is in a non-driver's side position, the step of establishing a wireless connection between the earphone and the vehicle infotainment system when the earphone in the non-driver's side position is detected to be removed is executed.

9. An in-vehicle audio processing device, characterized in that, The in-vehicle audio processing device includes a processor, a memory, and an in-vehicle audio processing program stored in the memory and executable by the processor, wherein when the in-vehicle audio processing program is executed by the processor, it implements the steps of the in-vehicle audio processing method as described in any one of claims 1 to 5.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores an in-vehicle audio processing program, wherein when the in-vehicle audio processing program is executed by a processor, it implements the steps of the in-vehicle audio processing method as described in any one of claims 1 to 5.

Images