Inside and outside call method, electronic equipment and storage medium

Abstract

The embodiment of the invention provides a communication method inside and outside a vehicle, electronic equipment and a storage medium. In some embodiments of the present application, a vehicle may include an in-vehicle sound acquisition device, an out-vehicle sound acquisition device, and at least one panel sounder mounted to a vehicle body. The in-vehicle and out-vehicle communication method comprises the following steps: in response to a detected in-vehicle and out-vehicle communication instruction, determining an in-vehicle voice signal according to an in-vehicle sound signal generated by an in-vehicle sound acquisition device, and playing the in-vehicle voice signal through a panel sounder; and generating an out-of-vehicle voice signal according to an out-of-vehicle sound signal generated by the out-of-vehicle sound acquisition device, and playing the out-of-vehicle voice signal through the panel sounder.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of control technology, and more specifically, to a method for in-vehicle and out-of-vehicle communication, an electronic device, and a storage medium. Background Art

[0002] With the development of intelligent cars, various sound generators and microphones are installed inside and outside the car to meet various application scenarios. In the car, the driver usually needs to use the in-car microphone to implement voice recognition in the car, such as turning on music, turning on navigation, turning on air conditioning, etc. The driver can also use the in-car microphone to make voice calls with the remote party.

[0003] However, current devices such as sound generators are mainly used to meet the driver's needs for voice control and remote calling of the vehicle, with low utilization rate and room for development. Summary of the invention

[0004] The embodiments of the present application provide a method for in-vehicle and out-vehicle communication, an electronic device and a storage medium that can at least partially solve the above-mentioned problems or other problems existing in the prior art. Passengers in the vehicle and people outside the vehicle can realize voice communication through a panel sounder and an in-vehicle / out-vehicle sound collection device, thereby ensuring the safety of passengers in the vehicle and improving the utilization rate of vehicle components.

[0005] In some embodiments, the in-vehicle and out-vehicle call methods, electronic devices, and storage media provided by the embodiments of the present application play in-vehicle voice signals and out-vehicle voice signals through the same panel speaker, which can eliminate the need for additional in-vehicle speakers for in-vehicle sound, thereby reducing the physical complexity of the sound path and the performance impact caused by the resulting increase in sound transmission delay.

[0006] In some embodiments, the in-vehicle and out-vehicle call methods, electronic devices, and storage media provided by the embodiments of the present application can select a voice channel for calls with people outside the vehicle through a selection button component and other devices, and then realize in-vehicle and out-vehicle calls through the panel sounder and the out-vehicle sound collection device corresponding to the voice channel. Compared with turning on all panel sounders and out-vehicle sound collection devices, it can reduce power consumption while ensuring in-vehicle and out-vehicle calls, and reduce the impact of multi-channel noise input from the out-vehicle environment on call quality.

[0007] In some embodiments, the in-vehicle and out-vehicle call methods, electronic devices, and storage media provided by the embodiments of the present application perform noise reduction and / or echo elimination processing on the collected sound signals, thereby improving the quality of in-vehicle and out-vehicle call quality.

[0008] In some embodiments, the in-vehicle and out-of-car call methods, electronic devices, and storage media provided by the embodiments of the present application can improve the sound processing effect by adapting the parameters of the algorithm used to process the sound signal based on the voice channel currently used for the call.

[0009] The in-vehicle and out-of-vehicle call methods, electronic devices, and storage media provided by the embodiments of the present application detect whether the in-vehicle sound signals contain machine sound signals, so as to cut out the sound of the audio stream played by the in-vehicle device, thereby reducing the risk of information leakage in the vehicle.

[0010] The embodiment of the present application provides a method for in-vehicle and out-vehicle communication, wherein the vehicle includes an in-vehicle sound collection device, an out-vehicle sound collection device, and at least one panel sound generator installed on the vehicle body. The in-vehicle and out-vehicle communication method includes: in response to detecting an in-vehicle and out-vehicle communication instruction, determining an in-vehicle voice signal according to an in-vehicle sound signal generated by the in-vehicle sound collection device, and playing the in-vehicle voice signal through the panel sound generator; and generating an out-vehicle voice signal according to an out-vehicle sound signal generated by the out-vehicle sound collection device, and playing the out-vehicle voice signal through the panel sound generator.

[0011] The embodiment of the present application also provides an electronic device, including at least one processor and a memory. The memory is in communication connection with the at least one processor and stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the in-vehicle and out-of-vehicle call method mentioned in the above embodiment.

[0012] The embodiments of the present application also provide a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, the in-vehicle and out-of-car communication method mentioned in the above embodiments is implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Other features, objects and advantages of the present application will become more apparent by reading the detailed description of non-limiting embodiments made with reference to the following drawings, in which:

[0014] Figure 1 is a schematic structural diagram of a vehicle according to some embodiments of the present application;

[0015] Figure 2 is a schematic diagram of the installation position of the panel sounder according to some embodiments of the present application;

[0016] Figure 3 is a flowchart of a method for communicating inside or outside a vehicle according to some embodiments of the present application;

[0017] Figure 4a is a schematic diagram of the structure of a gating button assembly according to some embodiments of the present application;

[0018] Figure 4b is a schematic structural diagram of a gating button assembly according to other embodiments of the present application;

[0019] Figure 5a and Figure 5b is a schematic diagram of a view control according to some embodiments of the present application;

[0020] Figure 6 is a schematic block diagram of a system for implementing in-vehicle and out-of-vehicle communication according to some embodiments of the present application; and

[0021] Figure 7 is a schematic block diagram of an electronic device according to some embodiments of the present application. DETAILED DESCRIPTION

[0022] In order to better understand the present application, a more detailed description will be made of various aspects of the present application with reference to the accompanying drawings. It should be understood that these detailed descriptions are only descriptions of exemplary embodiments of the present application, and are not intended to limit the scope of the present application in any way. Throughout the specification, the same reference numerals refer to the same elements. The expression "and / or" includes any and all combinations of one or more of the associated listed items.

[0023] It should also be understood that expressions such as "include", "including", "have", "contain" and / or "comprising" are open rather than closed expressions in this specification, which indicate the presence of the stated features, elements and / or components, but do not exclude the presence of one or more other features, elements, components and / or combinations thereof. In addition, when expressions such as "at least one of..." appear after a list of listed features, they modify the entire list of features rather than just the individual elements in the list. In addition, when describing embodiments of the present application, "may" is used to mean "one or more embodiments of the present application". And, the term "exemplary" is intended to refer to an example or illustration.

[0024] Unless otherwise specified, all words (including engineering terms and scientific and technological terms) used in this article have the same meaning as those commonly understood by ordinary technicians in the field to which this application belongs. It should also be understood that, unless clearly stated in this application, words defined in common dictionaries should be interpreted as having the same meaning as their meaning in the context of the relevant technology, and should not be interpreted in an idealized or overly formal sense.

[0025] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. In addition, unless explicitly limited or contradictory to the context, the specific steps included in the method described in the present application are not necessarily limited to the order described, but can be performed in any order or in parallel. The present application will be described in detail below with reference to the accompanying drawings and in conjunction with the embodiments.

[0026] Figure 1 FIG. 1 is a schematic diagram of a vehicle according to an embodiment of the present application. Figure 1 As shown, an embodiment of the present application provides a vehicle, which vehicle 100 may include: a vehicle body 110, a vehicle-mounted host (not shown), at least one in-vehicle sound collection device (for example, 120), at least one out-vehicle sound collection device (for example, 130) and at least one panel sound generator 140.

[0027] In some embodiments of the present application, at least one in-vehicle sound collection device 120 may be communicatively connected to the vehicle host. The vehicle host may process the in-vehicle sound signal collected by the in-vehicle sound collection device 120. The in-vehicle personnel may generally use the in-vehicle sound collection device 120 to implement voice recognition or control in the vehicle, such as turning on music, turning on navigation, turning on air conditioning, etc., and may also use the in-vehicle sound collection device 120 to make a voice call with a remote party.

[0028] It should be understood that, without departing from the teachings of this application, the in-vehicle sound collection device 120 can be a device such as a microphone fixedly installed inside the vehicle 100, or it can be a sound collection device of a mobile device located inside the vehicle 100 and communicatively connected to the vehicle-mounted host, such as the microphone of a mobile phone in the vehicle, etc., without limitation here.

[0029] In some embodiments of the present application, at least one vehicle-external sound collection device 130 may be communicatively connected to the vehicle-mounted host. The vehicle-mounted host may process the vehicle-external sound signals collected by the vehicle-external sound collection device 130. For example, based on the collected vehicle-external sound signals with control authority, voice control of the vehicle, remote voice calls, etc. are performed, so that the driver and other users with vehicle control authority can control the vehicle outside the vehicle, thereby improving the user experience.

[0030] It should be understood that, without departing from the teachings of this application, the vehicle-external sound collection device 130 can be a device such as a microphone fixedly installed on the outside of the vehicle 100, or it can be a sound collection device of a mobile device located outside the vehicle 100 and communicatively connected to the vehicle-mounted host, such as a microphone of a mobile phone outside the vehicle, etc., without limitation here.

[0031] In some embodiments of the present application, at least one panel sounder 140 can be connected to the vehicle host for communication. The vehicle host can send a sound signal to the panel sounder 140, and the sound signal is played through the panel sounder 140. Considering that the traditional sounder is large in size and there is no suitable installation space on the sides outside the vehicle, the traditional sounder is not suitable for the cavity sounding installed on the sides outside the vehicle. Therefore, in the embodiments of the present application, the vehicle panel sounding is used as the sounding method, and the piezoelectric thin film high-power sounding vibrator of the panel sounder 140 can well solve the sound outside the vehicle. In addition, the panel sounder 140 has the advantages of light volume, high sounding efficiency, water resistance, dust resistance, and corrosion resistance, and is more suitable for the scene outside the vehicle. In addition, the panel sounder 140 has the advantage of wide sound frequency band, and basically has a wide-band sounding capability of 150Hz to 20kHz, which can efficiently promote the sound of vehicle metal panels, such as doors, and plastic panels, such as front and rear bumpers and other panel materials. In summary, the panel sound generator 140 can better solve the problem of sound outside the vehicle.

[0032] As an example, Figure 2 Schematic diagram of the installation position of the panel sounder 140 according to some embodiments of the present application. Figure 2 As shown, the panel sound generator 140 may be an exterior panel sound generator mainly used to realize sound emission to the outside of the vehicle. The panel sound generator 140 may be installed between an exterior metal panel 150 and an interior and exterior dry and wet separation board 160 on the outside of the vehicle 100, and an interior trim panel 170 may be provided in the cabin near the interior and exterior dry and wet separation board 160 of the vehicle 100. When the panel sound generator 140 excites the panel (e.g., the exterior metal panel 150) to emit sound, the sound transmission may emit sound to the inside of the vehicle or to the outside of the vehicle.

[0033] In some technologies, the vehicle 100 can realize the ability of communication between people outside the vehicle (such as the driver) and the vehicle outside the vehicle (i.e., the above-mentioned outside vehicle control of the vehicle), and the people outside the vehicle can directly realize simple voice recognition capabilities such as "playing music" outside the vehicle, and can even expand simple voice control capabilities such as "opening the trunk". Since the current outside vehicle sound collection device 130 is usually used to realize outside vehicle voice recognition. This makes it impossible for the vehicle 100 to realize voice interaction between inside and outside the vehicle. However, in some scenarios, the driver inside the car needs to speak to the side outside the car inside the car, and the person outside the car also needs to speak to the driver inside the car outside the car. The current vehicle control method cannot meet such needs.

[0034] For example, in the event of an epidemic, or when a stranger stops a car at night, if the car window is opened, the safety of the people in the car may be at risk. In this case, if voice communication can be achieved through the isolation of the car window glass, the direct close communication between the people in the car and the people outside the car can be reduced, which can protect the safety of the passengers in the car. In addition, if the people in the car can communicate with the people outside the car in two directions around the side of the vehicle, the convenience of voice calls inside and outside the car can be improved.

[0035] In order to improve the utilization rate of vehicle components and better protect the safety of people in the vehicle, Figure 3 1 is a flowchart of a method for in-vehicle and out-vehicle communication according to some embodiments of the present application. The in-vehicle and out-vehicle communication method 300 can be executed by a vehicle-mounted host, or by other devices (such as a sound control panel) that have control authority over the in-vehicle sound collection device, the out-vehicle sound collection device, and the panel sounder, without limitation. For ease of explanation, the following takes the in-vehicle host executing the in-vehicle and out-vehicle communication method 300 as an example to illustrate the in-vehicle and out-vehicle communication method 300. Figure 3 As shown, the in-vehicle and out-of-vehicle communication method 300 may include the following steps:

[0036] S31, in response to detecting an in-vehicle or out-of-vehicle call command, determining an in-vehicle voice signal according to an in-vehicle sound signal generated by an in-vehicle sound collecting device, and playing the in-vehicle voice signal through a panel sounder; and

[0037] S32, generating an external vehicle voice signal according to the external vehicle sound signal generated by the external vehicle sound collecting device, and playing the external vehicle voice signal through the panel sounder.

[0038] According to some embodiments of the present application, passengers in the vehicle and people outside the vehicle can realize voice communication through the panel sounder and the in-vehicle / out-vehicle sound collection device, thereby ensuring the safety of passengers in the vehicle and improving the utilization rate of vehicle components. In addition, by playing the in-vehicle voice signal and the out-vehicle voice signal through the same panel sounder, it is possible to eliminate the need for an additional in-vehicle sounder for in-vehicle sound generation, thereby reducing the physical complexity of the sound path and the adverse effect of the poor latency caused by the complexity of the sound path on the sound output quality.

[0039] It should be understood that for ease of description, Figure 3 The steps of determining an in-vehicle voice signal according to an in-vehicle sound signal generated by an in-vehicle sound collecting device and playing the in-vehicle voice signal through a panel sounder are first described, and then the steps of generating an outside-vehicle voice signal according to an outside-vehicle sound signal generated by an outside-vehicle sound collecting device and playing the outside-vehicle voice signal through a panel sounder are described. Without departing from the teachings of this application, the above two steps can be executed simultaneously or successively, and this application does not limit the execution order of the above two steps.

[0040] For ease of understanding, the following Figure 3 The illustrated in-vehicle and in-vehicle call method 300 is provided for exemplary description.

[0041] In some embodiments of the present application, since the in-vehicle sound collection device 120 needs to be used in the in-vehicle usage scenario (in-vehicle voice recognition control, etc.), it also needs to be used in the out-vehicle usage scenario (such as the in-vehicle and out-vehicle call scenario mentioned in this article), in order to enable the in-vehicle sound collection device 120 to support two usage scenarios, the vehicle-mounted host can determine the voice channel connected to the sound signal collected by the in-vehicle sound collection device 120 based on whether the in-vehicle and out-vehicle call command is received. Optionally, the vehicle-mounted host triggers the in-vehicle and out-vehicle call command to use the in-vehicle sound collection device 120 for the out-vehicle usage scenario. In the above example, by performing channel (i.e., voice channel) multiplexing management on the in-vehicle sound collection device 120, the in-vehicle and out-vehicle call function can be realized by using the original in-vehicle sound collection device 120 for the in-vehicle usage scenario of the vehicle 100, reducing the number of in-vehicle sound collection devices 120 installed without adding additional costs. In other words, some embodiments of the present application realize the management of the voice channel for in-vehicle and out-vehicle calls and the voice channel suitable for in-vehicle usage scenarios through the channel multiplexing management of the in-vehicle sound collection device 120.

[0042] In some embodiments of the present application, methods for triggering in-vehicle and out-of-car call commands include but are not limited to method 1, method 2, and method 3.

[0043] Method 1

[0044] As an example, the vehicle host can determine whether to trigger the in-vehicle or out-vehicle call command according to the selection signal transmitted by the selection button component. For example, a selection button component can be installed on the vehicle's operating console, and the selection button component is connected to the vehicle host in communication. For example, the selection button component can be connected to the vehicle host through a GPIO port, a LIN bus, a CAN bus, or other communication forms. The vehicle host can determine whether to trigger the in-vehicle or out-vehicle call command according to the situation in which the selection button component is controlled.

[0045] For example, Figure 4a is a schematic diagram of the structure of a selection button assembly according to some embodiments of the present application. Figure 4a As shown, the selection button assembly 180a may include a rotating button 181, and the rotating button 181 is movable. If the rotating button 181 is in the first position a1, the vehicle host can determine that the in-vehicle sound collection device 120 is mainly used in the vehicle usage scenario, and if the rotating button 181 is in the second position a2, the third position a3, the fourth position a4 and the fifth position a5, the vehicle host can determine that the in-vehicle sound collection device 120 is mainly used in the vehicle usage scenario, triggering the in-vehicle and out-vehicle call instructions.

[0046] Another example: Figure 4b Schematic diagram of the structure of the gating button assembly according to other embodiments of the present application. Figure 4b As shown, the selection button assembly 180b may include an in-car interaction button 182 and an out-car interaction button 183, and the buttons corresponding to different functions are separated. If the out-car interaction button 183 is pressed, the vehicle host may trigger an in-car and out-car call command.

[0047] It should be understood that the structural form of the selection button assembly can be set as needed without departing from the teachings of the present application, and the present application does not impose any restrictions on this.

[0048] Method 2

[0049] As an example, the vehicle host can determine whether to trigger the in-vehicle and out-vehicle call command by identifying a voice signal containing a preset keyword. For example, if the vehicle occupant is detected to say "turn on the in-vehicle call", the vehicle host can trigger the in-vehicle and out-vehicle call command, and if the vehicle occupant is detected to say "cancel the in-vehicle call", the vehicle host can turn off the in-vehicle and out-vehicle call function, and the in-vehicle sound collection device 130 will be reused for the in-vehicle usage scenario.

[0050] It should be understood that the keywords associated with the in-vehicle and out-of-car call instructions detected by the vehicle-mounted host can be set as needed. For example, it can include the "start out-of-car calls" mentioned above, and can also include "talk to the front of the car", "talk to the left side of the car", etc., without limitation here.

[0051] Method 3

[0052] As an example, the vehicle host can display a view control for selecting a voice channel through the vehicle operation interface, and trigger in-vehicle and out-of-vehicle call commands based on the touch data of the view control.

[0053] For example, Figure 5a and Figure 5b is a schematic diagram of a view control according to some embodiments of the present application. Generally, the display effect of the view control 190 can be as follows: Figure 5a As shown in FIG. 1 , when the vehicle host detects that the middle “Start vehicle-to-vehicle call” is clicked, the vehicle-to-vehicle call command can be triggered. Afterwards, the display effect of the view control 190 can be as follows: Figure 5b When the vehicle host detects that the middle "Cancel car call" is clicked, the car call function can be turned off, and the car sound collection device 130 will be used again in the car usage scenario.

[0054] It should be understood that without departing from the teachings of this application, the number and arrangement of components in the view control can be set as needed, and this application does not impose any restrictions on this.

[0055] After completing the exemplary description of the triggering method of the in-vehicle and out-of-vehicle call command, the following exemplary description is given of the usage of the in-vehicle host for the out-of-vehicle sound collection device 130 and the panel sounder 140 .

[0056] In some embodiments of the present application, the vehicle 100 may be equipped with a plurality of panel sounders 140, each panel sounder 140 corresponding to at least one voice channel. Figure 1 As shown, the front side of the vehicle may be equipped with one panel sounder 140, the left side may be equipped with two panel sounders 140, the rear side may be equipped with one panel sounder 130, and the right side may be equipped with two panel sounders 140. The panel sounders on each side of the vehicle body may independently correspond to a voice channel, and their sound generation may be independently controlled.

[0057] In the above example, since panel speakers are installed on each side of the vehicle, the vehicle host can independently control each panel speaker to transmit the voice inside the vehicle to each side of the vehicle. In addition, by playing the voice signal inside the vehicle and the voice signal outside the vehicle through the same panel speaker, the additional vehicle speaker can be eliminated for the sound inside the vehicle, reducing the physical complexity of the sound path and the adverse effect of the poor latency caused by the complexity of the sound path on the sound output quality.

[0058] In some embodiments of the present application, the vehicle-mounted host determines the voice channel for in-vehicle and out-vehicle calls in response to detecting an in-vehicle and out-vehicle call command. Afterwards, the vehicle-mounted host can play the in-vehicle voice signal through the panel sounder corresponding to the voice channel, and play the out-vehicle voice signal through the panel sounder corresponding to the voice channel. In this example, a specific panel sounder can be used to make a sound so that the in-vehicle voice is transmitted to a specified direction outside the vehicle, which is conducive to in-vehicle and out-vehicle calls. Compared with turning on all panel sounders and out-vehicle sound collection devices, the above embodiment can reduce power consumption while ensuring in-vehicle and out-vehicle calls, and reduce the impact of multi-channel noise input from the outside environment on call quality.

[0059] Optionally, the vehicle host may determine the voice channel used for in-vehicle and out-vehicle calls in a variety of ways.

[0060] As an example, if the implementation method of the vehicle host triggering the in-vehicle and out-of-vehicle call command is designed according to the method 1 mentioned above, the vehicle host can determine the voice channel according to the selection signal transmitted by the selection button component.

[0061] For example, if a strobe button component is Figure 4aAs shown, if the vehicle-mounted host detects that the rotary button 181 is located at a1, it can be determined that the in-vehicle or out-vehicle call command is not triggered, and the in-vehicle sound collection device 120 is used for in-vehicle usage scenarios, such as in-vehicle voice recognition or in-vehicle and remote voice calls; if it is detected that the rotary button 181 is located at a2, the in-vehicle or out-vehicle call command is triggered, and the voice channel used for in-vehicle or out-vehicle calls is determined to be the voice channel corresponding to the panel sounder 140 on the left side of the vehicle; if it is detected that the rotary button 181 is located at a3, the in-vehicle or out-vehicle call command is triggered, and the voice channel used for in-vehicle or out-vehicle calls is determined to be the voice channel corresponding to the panel sounder 140 on the front side of the vehicle; if it is detected that the rotary button 181 is located at a4, the in-vehicle or out-vehicle call command is triggered, and the voice channel used for in-vehicle or out-vehicle calls is determined to be the voice channel corresponding to the panel sounder 140 on the right side of the vehicle; if it is detected that the rotary button 181 is located at a5, the in-vehicle or out-vehicle call command is triggered, and the voice channel used for in-vehicle or out-vehicle calls is determined to be the voice channel corresponding to the panel sounder 140 on the rear side of the vehicle.

[0062] For example, if the select button component is Figure 4b As shown, if the vehicle-mounted host detects that the outside-vehicle interaction button 183 is clicked once, the inside-outside-vehicle call command is triggered, and the voice channel used for the inside-outside-vehicle call is determined to be the voice channel corresponding to the panel sounder 140 on the left side of the vehicle; if the outside-vehicle interaction button 183 is detected to be clicked twice, the inside-outside-vehicle call command is triggered, and the voice channel used for the inside-outside-vehicle call is determined to be the voice channel corresponding to the panel sounder 140 in front of the vehicle; if the outside-vehicle interaction button 183 is detected to be clicked 3 times, the inside-outside-vehicle call command is triggered, and the voice channel used for the inside-outside-vehicle call is determined to be the voice channel corresponding to the panel sounder 140 on the right side of the vehicle; if the outside-vehicle interaction button 183 is detected to be clicked 4 times, the inside-outside-vehicle call command is triggered, and the voice channel used for the inside-outside-vehicle call is determined to be the voice channel corresponding to the panel sounder 140 on the rear side of the vehicle.

[0063] As another example, if the vehicle host triggers the vehicle-to-vehicle call command according to the above-mentioned method 2, the vehicle host can determine the voice channel by identifying the voice signal containing the preset keywords. For example, if it is detected that the person in the car says "turn on the vehicle-to-vehicle call", the vehicle host can trigger the vehicle-to-vehicle call command and play the voice "please say the direction of the vehicle-to-vehicle call" through any panel speaker 140 or the vehicle speaker; if it is detected that the person in the car says "front side", the vehicle host can determine that the voice channel for the vehicle-to-vehicle call is the voice channel corresponding to the panel speaker 140 on the front side of the vehicle.

[0064] As another example, if the vehicle host triggers the in-vehicle and out-of-vehicle call command according to the above-mentioned method 3, the vehicle host can obtain the touch data of the view control for selecting the voice channel in the vehicle computer operation interface, and determine the voice channel according to the touch data. Figure 5aand Figure 5b As shown, the view control 190 may include: a first component (such as Figure 5a and Figure 5b The component showing the words "left side outside the vehicle" in the example), the second component related to the voice channel corresponding to the panel sounder 140 on the front side of the vehicle (such as Figure 5a and Figure 5b The component showing the words "front side of the vehicle exterior" in the example), the third component related to the voice channel corresponding to the panel sounder 140 on the right side of the vehicle (such as Figure 5a and Figure 5b The fourth component (such as the component with the words "right side outside the vehicle" in the example) and the voice channel corresponding to the panel sounder 140 on the rear side of the vehicle Figure 5a and Figure 5b After the vehicle host detects that any displayed component is clicked, the voice channel corresponding to the component can be determined as the voice channel for calls inside and outside the vehicle.

[0065] It should be understood that without departing from the teachings of this application, the method of triggering the in-vehicle and out-vehicle call instructions and the method of determining the voice channel for in-vehicle and out-vehicle calls can be set as needed, and this application does not impose any restrictions on this.

[0066] In some embodiments of the present application, each side of the vehicle body may be respectively installed with an independent external sound collection device 130. For example, Figure 1 As shown, one vehicle exterior sound collection device 130 may be installed on the front side of the vehicle, two vehicle exterior sound collection devices 130 may be installed on the left side, one vehicle exterior sound collection device 130 may be installed on the rear side, and two vehicle exterior sound collection devices 130 may be installed on the right side. The vehicle exterior sound collection devices 130 on each side of the vehicle body may be independently controlled. The vehicle-mounted host may determine the voice channel for vehicle interior and exterior calls in response to the vehicle interior and exterior call command, and wake up the vehicle exterior sound collection device 130 corresponding to the voice channel. In this example, the vehicle exterior sound collection device 130 is usually in a dormant state and does not collect vehicle exterior sound to reduce power consumption. After determining that the vehicle-mounted host triggers the vehicle interior and exterior call command and determines the voice channel for vehicle interior and exterior calls, the vehicle exterior sound collection device 130 corresponding to the voice channel may be woken up so that the vehicle exterior sound is collected through the vehicle exterior sound collection device 130 to generate a vehicle exterior sound signal. Among them, the method for determining the voice channel for vehicle interior and exterior calls can refer to the relevant description above, which will not be repeated here.

[0067] Optional, such as Figure 1As shown, each side of the vehicle 100 is respectively installed with an outside sound collection device 130 and a panel sound generator 140. The vehicle host can determine the voice channel for inside and outside calls in response to the inside and outside call command, and generate an outside voice signal according to the outside sound signal generated by the outside sound collection device 130 corresponding to the determined voice channel, and play the outside voice signal through the panel sound generator 140 corresponding to the determined voice channel. Since the sound emitted by the panel sound generator 140 can be transmitted to the inside and outside of the vehicle, the people in the vehicle can hear the sound played by the panel sound generator 140 based on the outside voice signal. For example, when the vehicle is set to talk with the left side of the vehicle outside, the determined voice channel is the voice channel corresponding to the panel sound generator on the left side of the vehicle, and the sound channel of the inside sound collection device 120 is occupied as the left channel from the inside of the vehicle to the outside of the vehicle, and the sound collected by the inside sound collection device 120 will be played to the outside of the vehicle through the panel sound generator on the left side of the vehicle. At the same time, the outside sound collection device 130 on the left side outside the vehicle has been turned on to collect the voice of the person on the left side outside the vehicle and play it into the vehicle through the panel sounder on the left side of the vehicle.

[0068] After completing the exemplary description of the use of the vehicle-mounted host for the external sound collection device 130 and the panel sound generator 140, the following exemplary description is given of the process of the vehicle-mounted host determining the in-vehicle voice signal and the external voice signal.

[0069] In some embodiments of the present application, the process of determining the in-car voice signal based on the in-car sound signal by the in-car host may include: using a first audio processing algorithm to perform noise reduction processing and / or echo elimination processing on the in-car sound signal to obtain the in-car voice signal. In the above example, performing noise reduction processing and / or echo elimination processing on the collected in-car sound signal can improve the quality of in-car and out-car calls.

[0070] In some embodiments of the present application, the process of determining the external voice signal according to the external sound signal by the vehicle host may include: using the second audio processing algorithm to perform noise reduction processing and / or echo elimination processing on the external sound signal to obtain the external voice signal. In the above example, performing noise reduction processing and / or echo elimination processing on the collected external sound signal can improve the quality of calls inside and outside the vehicle.

[0071] For example, Figure 6 FIG. 1 is a schematic diagram of a system for implementing in-vehicle and out-of-vehicle communication according to some embodiments of the present application. Figure 6As shown, the in-vehicle sound collection device 120 and the out-vehicle sound collection device 130 can be connected to the vehicle-mounted host 200, and the sounds collected by them can be input into the digital signal processing chip (DSP) 210 of the vehicle-mounted host 200. The DSP 210 can use the first audio processing algorithm to perform noise reduction and echo elimination processing on the in-vehicle sound signal collected by the in-vehicle sound collection device 120 to obtain the in-vehicle voice signal, and after amplification by the power amplifier unit 220 of the vehicle-mounted host 200, the control panel sounder 140 plays it. The DSP 210 can use the second audio processing algorithm to perform noise reduction and echo elimination processing on the out-vehicle sound signal collected by the out-vehicle sound collection device 130 to obtain the out-vehicle voice signal, and after amplification by the power amplifier unit 220 of the vehicle-mounted host 200, the control panel sounder 140 plays it.

[0072] It should be understood that, without departing from the teaching of the present application, the algorithm for noise reduction processing and the algorithm for echo processing may be selected as needed, and the present application does not impose any limitation on this.

[0073] As an option, the vehicle host may determine the algorithm parameters of the first audio processing algorithm from a preset algorithm parameter set according to the determined voice channel for in-vehicle and out-vehicle calls, and may determine the algorithm parameters of the second audio processing algorithm from an algorithm parameter set according to the determined voice channel for in-vehicle and out-vehicle calls. In other words, after determining the voice channel for in-vehicle and out-vehicle calls, the vehicle host will correspondingly select the parameters of the first audio processing algorithm and the parameters of the second audio processing algorithm corresponding to the voice channel.

[0074] For example, the first audio processing algorithm stored in the vehicle host may be referred to as Set1, and the second audio processing algorithm may be referred to as Set2. Some parameters in Set1 and Set2 may be adjusted according to the voice channel currently in use. For example, the voice channel determined by the vehicle host is the first voice channel (for example, the left voice channel outside the vehicle), and the voice channel may include two voice paths, namely, the first in-vehicle voice path and the first out-vehicle voice path. Among them, the first in-vehicle voice path is used to play the in-vehicle voice through the panel sounder corresponding to the first voice channel, and the first out-vehicle voice path is used to play the out-vehicle voice through the panel sounder corresponding to the first voice channel. Among them, the vehicle host can bring the parameters corresponding to the first in-vehicle voice path in the algorithm parameter set into Set1 to obtain the first audio processing algorithm for the first in-vehicle voice path (for example, Set11), and can bring the parameters corresponding to the first out-vehicle voice path in the algorithm parameter set into the second audio processing algorithm to obtain the second audio processing algorithm (Set21) for the first out-vehicle voice path. The DSP 210 uses Set11 to perform noise reduction and / or echo cancellation processing on the sound signal inside the vehicle, and uses Set21 to perform noise reduction and / or echo cancellation processing on the sound signal outside the vehicle.

[0075] According to this implementation, the vehicle-mounted host can automatically adapt the parameters of the algorithm for processing the sound signal (ie, the first audio processing algorithm and the second audio processing algorithm) according to the determined voice channel, thereby improving the sound processing effect.

[0076] In some embodiments of the present application, the vehicle host can be provided with a function of suppressing mechanical sound in the vehicle in order to reduce the amount of media data such as music played in the vehicle being played externally through the vehicle sound collection device 120 and the panel sound generator 140. In other words, when the vehicle host detects that the sound played outside the vehicle includes the audio played by the vehicle host or other devices, the audio can be cut off so that the sound transmitted outside the vehicle does not include the audio.

[0077] As an example, to increase the suppression function, the process of the vehicle host determining the in-vehicle voice signal based on the in-vehicle sound signal may include: detecting the in-vehicle sound signal to determine whether the in-vehicle sound signal contains a machine sound signal, and if it is detected that the in-vehicle sound signal does not contain a machine sound signal, generating an in-vehicle voice signal based on the in-vehicle sound signal. For example, if the in-vehicle host does not detect a machine sound signal, the in-vehicle sound signal may be directly output as an in-vehicle voice signal, or the in-vehicle sound signal may be subjected to noise reduction and / or echo elimination processing before being output. No limitation is made here.

[0078] Optionally, if the vehicle host detects that the in-car sound signal contains a machine sound signal, it means that the media audio stream is being played in the car. The media audio stream can be stopped and the in-car sound signal can be determined as an in-car voice signal. The media audio stream can also be continued to be played, and the machine sound signal can be separated from the in-car sound signal, and the separated signal can be determined as an in-car voice signal.

[0079] According to this embodiment, the vehicle host detects whether the in-vehicle sound signal contains a machine sound signal, so as to cut out the sound of the audio stream played by the in-vehicle device, thereby reducing the risk of information leakage in the vehicle. In addition, cutting out the sound of the audio stream played by the in-vehicle device can also reduce the situation where the sound played by the in-vehicle device is played outward through the panel speaker and disturbs people.

[0080] It should be understood that, without departing from the teachings of this application, in addition to detecting whether the sound signal in the car contains a mechanical sound signal, other methods can be used to detect whether a media audio stream is being played in the car, and this application does not impose any restrictions on this.

[0081] In some embodiments of the present application, if the vehicle host detects a voice signal inside the vehicle and a voice signal outside the vehicle at the same time, the voice signal inside the vehicle and the voice signal outside the vehicle can be superimposed, and the superimposed voice signal can be played through the panel speaker. In this example, the panel speaker can play the voice signal inside the vehicle and the voice signal outside the vehicle at the same time, so that people inside and outside the vehicle can hear each other's voice.

[0082] It should be understood that, without departing from the teachings of this application, if the vehicle-mounted host detects the in-car voice signal and the out-car voice signal at the same time, other processing measures may be taken to process the two signals. For example, according to the priority of the in-car voice signal and the out-car voice signal, one of the signals is transmitted to the panel sounder, and the other signal is not transmitted. For another example, according to the priority of the in-car voice signal and the out-car voice signal, one of the signals can be amplified t1 times and the other signal can be amplified t2 times, t1>t2, to highlight the voice signal with a higher priority. For another example, the out-of-car voice signal collected by the out-of-car sound collection device and the voice signal collected by the in-car sound collection device can be fused in the DSP of the vehicle-mounted host, and then the panel sounder is driven by the power amplifier unit to play the out-of-car voice signal and the in-car voice signal at the same time. This application does not limit the processing measures.

[0083] Through the above implementation, the person in the car can say voice messages such as "You can go slowly" to the person in front of the vehicle, and say "Master, please let me go" and "Be careful when riding" to the person on the side of the vehicle, and communicate with the people on all sides of the vehicle. When the person in the car and the person outside the car need to talk directly, the person in the car can use the car sound collection device such as a microphone in the car to speak to the outside of the vehicle without opening the window, and the panel sounder will emit voice. The person outside the car can use the car sound collection device outside the car to speak to the owner, and the panel sounder will emit voice. This allows the person outside the car to directly ask the driver outside the car whether he can take a taxi in scenes such as taxi services. In addition, this allows the person outside the car to talk directly with the person outside the car when searching for items in the trunk to confirm whether the trunk needs to be opened or closed.

[0084] The step division of the above methods is only for the purpose of clear description. When implemented, they can be combined into one step or some steps can be split and decomposed into multiple steps. As long as they include the same logical relationship, they are all within the scope of protection of this patent; adding insignificant modifications to the algorithm or process or introducing insignificant designs without changing the core design of the algorithm and process are all within the scope of protection of this patent.

[0085] It is not difficult to find that the above system embodiment is a system implementation method corresponding to the above method embodiment, and the system embodiment can be implemented in conjunction with the method embodiment. The relevant technical details mentioned in the method embodiment are still valid in the system embodiment.

[0086] It is worth mentioning that all modules involved in the above embodiments are logic modules. In practical applications, a logic unit can be a physical unit, a part of a physical unit, or a combination of multiple physical units. In addition, in order to highlight the innovative part of the implementation methods of the present application, the above embodiments do not introduce units that are not closely related to solving the technical problems raised by the implementation methods of the present application, but this does not mean that there are no other units in the above embodiments.

[0087] The embodiment of the present application also provides an electronic device, such as Figure 7 As shown, the electronic device 700 may include: at least one processor and a memory, the memory is communicatively connected to the at least one processor and stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the in-vehicle and out-of-car call method 300 mentioned in the above embodiment.

[0088] For example, the electronic device 700 may be a vehicle-mounted host, or other device having control authority over an in-vehicle sound collection device, an out-of-vehicle sound collection device, and a panel sounder (such as a sound control panel), and no limitation is made here.

[0089] One embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the in-vehicle and out-of-car call method 300 mentioned in the above embodiment is implemented.

[0090] Figure 7 is a schematic block diagram of an electronic device 700 according to some embodiments of the present application. Figure 7 As shown, the electronic device 700 includes a processor 701, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 702 or a computer program loaded from a memory 708 into a random access memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the electronic device 700 can also be stored. The processor 701, the ROM 702, and the RAM 703 are connected to each other via a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0091] Multiple components in the electronic device 700 are connected to the I / O interface 705, including: an input unit 706, such as an in-vehicle sound collection device, etc.; an output unit 707, connected to, for example, various types of panel sound generators, etc., to output various forms of signals; a memory 708, including any medium for storing computer executable programs; and a communication unit 709, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 709 allows the electronic device 700 to exchange information / data with other devices through a local area network or other wireless communication network.

[0092] The processor 701 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 701 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The processor 701 performs the various methods and processes described above, such as the in-vehicle and out-vehicle call method 300 mentioned in the above embodiment. For example, in some embodiments, the in-vehicle and out-vehicle call method 300 mentioned in the above embodiment may be implemented as a computer software program, which is tangibly contained in a computer-readable storage medium, such as a memory 708. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 700 via the ROM 702 and / or the communication unit 709. When the computer program is loaded into the RAM 703 and executed by the processor 701, one or more steps of the in-vehicle and out-vehicle call method 300 mentioned in the above embodiment may be executed. Alternatively, in other embodiments, the processor 701 may be configured in any other appropriate manner (eg, by means of firmware) to execute the in-vehicle and out-of-car call method 300 mentioned in the above embodiment.

[0093] Various aspects of the present application are described herein with reference to the flowcharts and / or timing diagrams of the methods, devices (systems), and computer program products according to the exemplary embodiments of the present application. It should be understood that each step of the flowchart and / or timing diagram and the combination of the steps in the flowchart and / or timing diagram can be implemented by computer-readable program instructions.

[0094] These computer-readable program instructions can be provided to a processor, a general-purpose computer, a special-purpose computer, or a processing unit of other programmable data processing devices in the electronic device 700, thereby producing a machine, so that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device that implements the functions / steps specified in one or more steps in the flowchart and / or timing diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / steps specified in one or more steps in the flowchart and / or timing diagram.

[0095] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / steps specified in one or more steps in the flowchart and / or timing diagram.

[0096] The flowchart and timing diagram in the accompanying drawings show the possible architecture, functions and operations of the equipment, methods and computer program products according to multiple embodiments of the present application. In this regard, each step in the flowchart or timing diagram can represent a part of a module, a program segment or an instruction, and a part of the module, a program segment or an instruction contains one or more executable instructions for realizing the specified logical function. In some alternative embodiments, the functions marked in the steps can also occur in an order different from that marked in the accompanying drawings. For example, two consecutive steps can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each step in the timing diagram and / or the flowchart, and the combination of the steps in the timing diagram and / or the flowchart, can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.

[0097] The above description is only an implementation method of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of protection involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the technical concept. For example, the above features are replaced with (but not limited to) technical features with similar functions disclosed in this application.

Claims

1. A method for communicating inside and outside a vehicle. It is characterized in that The vehicle includes an in-vehicle sound collecting device, an out-vehicle sound collecting device, and at least one panel sound generator installed on the vehicle body, and the method includes: In response to detecting an in-vehicle or out-of-vehicle call command, determining an in-vehicle voice signal according to an in-vehicle sound signal generated by the in-vehicle sound collecting device, and playing the in-vehicle voice signal through the panel sounder; and An external vehicle voice signal is generated according to the external vehicle sound signal generated by the external vehicle sound collecting device, and the external vehicle voice signal is played through the panel sounder.

2. The method according to claim 1, in, The vehicle body is equipped with a plurality of panel sounders, each of which corresponds to at least one voice channel, and the method further includes: Before playing the in-vehicle voice signal or the out-vehicle voice signal through the panel sounder, determining a voice channel for in-vehicle and out-vehicle calls; Wherein, playing the in-vehicle voice signal through the panel sounder includes: Play the in-vehicle voice signal through the panel sounder corresponding to the voice channel; Playing the external vehicle voice signal by the panel sounder comprises: The external vehicle voice signal is played through the panel sounder corresponding to the voice channel.

3. The method according to claim 2, in, The method further comprises: Before generating an outside-vehicle voice signal according to the outside-vehicle sound signal generated by the outside-vehicle sound collecting device, the outside-vehicle sound collecting device corresponding to the voice channel is awakened.

4. The method according to claim 2, in, The determining of the voice channel for in-vehicle and out-vehicle calls includes: Determine the voice channel according to a selection signal transmitted by a selection button component; or, Determine the voice channel by identifying a voice signal containing a preset keyword; or, Acquire touch data of a view control in a vehicle computer operation interface of the vehicle for selecting the voice channel, and determine the voice channel according to the touch data.

5. The method according to claim 1, in, Determining the in-vehicle voice signal includes: Using a first audio processing algorithm to perform noise reduction processing and / or echo elimination processing on the in-vehicle sound signal to obtain the in-vehicle voice signal; Determining the external vehicle voice signal includes: A second audio processing algorithm is used to perform noise reduction processing and / or echo elimination processing on the external vehicle sound signal to obtain the external vehicle voice signal.

6. The method according to claim 5, in, The vehicle body is equipped with a plurality of panel sounders, each of which corresponds to at least one voice channel, and the method further includes: Determine the voice channel used for in-vehicle and out-of-car calls; Determining algorithm parameters in the first audio processing algorithm from a preset algorithm parameter set according to the voice channel; and The algorithm parameters in the second audio processing algorithm are determined from the algorithm parameter set according to the voice channel.

7. The method according to claim 1, in, Determining the in-vehicle voice signal includes: Detecting the in-vehicle sound signal to determine whether the in-vehicle sound signal contains a machine sound signal; and In response to detecting that the in-vehicle sound signal does not contain a machine sound signal, the in-vehicle voice signal is generated according to the in-vehicle sound signal.

8. The method according to claim 7, in, The method further comprises: In response to detecting that the in-vehicle sound signal contains a machine sound signal, the playing of the media audio stream is stopped, or the machine sound signal is separated from the in-vehicle sound signal.

9. An electronic device, It is characterized in that include: at least one processor; as well as, A memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor so that the at least one processor can execute the in-vehicle and out-of-vehicle communication method as described in any one of claims 1 to 8.

10. A computer-readable storage medium storing a computer program, It is characterized in that When the computer program is executed by a processor, the in-vehicle and out-of-vehicle communication method according to any one of claims 1 to 8 is implemented.

Images