Outside-vehicle sound virtualization method and apparatus, device and readable storage medium

Abstract

The present application relates to the technical field of voice processing, and provides an outside-vehicle sound virtualization method and apparatus, a device and a readable storage medium. A specific implementation solution is: when a vehicle is in a transparency mode, controlling an external microphone of the vehicle to enter an outside-vehicle sound collection state; when an outside-vehicle sound signal collected by the external microphone of the vehicle is received in real time, on the basis of a target outside-vehicle sound signal, generating an outside-vehicle sound virtualization instruction; and sending the outside-vehicle sound virtualization instruction to an in-vehicle speaker, so as to control the in-vehicle speaker to output a virtual sound signal corresponding to the target outside-vehicle sound signal. By means of the implementation of the present application, after the external microphone of the vehicle picks up sound, the in-vehicle speaker is controlled to simulate-output the outside-vehicle sound, such that important external sound information can be effectively received by an in-vehicle person in a sound insulation and noise reduction environment, thereby improving driving safety and the attainability of important voice information of outside-vehicle people.

Description

An out-of-vehicle sound virtualization method, device, equipment and readable storage medium TECHNICAL FIELD

[0001] The present application relates to the technical field of voice processing, and in particular to an out-of-vehicle sound virtualization method, device, equipment and readable storage medium. BACKGROUND

[0002] With the continuous development of the automobile industry, the performance of automobiles has been significantly improved, and the sound insulation and noise reduction performance as an important performance has attracted widespread attention from users. However, although the improvement of the sound insulation and noise reduction performance of automobiles can bring users a quiet driving and riding experience, blindly pursuing the sound insulation and noise reduction performance can also have certain negative effects, the most important of which is that it blocks the perception channel of the people in the vehicle to the external sound of the vehicle, and thus causes the people in the vehicle to be unable to effectively perceive important external sound information such as the sound of the vehicle horn and the speaking sound of the people outside the vehicle, so that the driving safety cannot be fully guaranteed, and important information required to be conveyed by the people outside the vehicle is easily missed.

[0003] It is noted that the technology described in this section need not be previously conceived or adopted by others. Unless otherwise indicated, nothing in this section should be assumed to be prior art merely because of its inclusion in this section. Similarly, nothing in this section should be assumed to have been known or used in the art before the date of this document, unless otherwise indicated. TECHNICAL PROBLEM

[0004] The present application provides an out-of-vehicle sound virtualization method, device, equipment and readable storage medium, which aims to at least solve one of the problems in the related art to some extent. TECHNICAL SOLUTION

[0005] To solve the above technical problems, the first aspect of the present application provides an out-of-vehicle sound virtualization method, comprising:

[0006] When the vehicle is in a transparent mode, controlling an out-of-vehicle microphone to enter an out-of-vehicle sound collection state;

[0007] When the out-of-vehicle sound signal collected by the out-of-vehicle microphone is received in real time, generating an out-of-vehicle sound virtualization instruction based on a target out-of-vehicle sound signal;

[0008] Sending the out-of-vehicle sound virtualization instruction to an in-vehicle loudspeaker; wherein the out-of-vehicle sound virtualization instruction is used to control the in-vehicle loudspeaker to output a virtual sound signal corresponding to the target out-of-vehicle sound signal.

[0009] The second aspect of the present application provides an out-of-vehicle sound virtualization device, comprising:

[0010] The sound collection module is configured to control the vehicle external microphone to enter a vehicle external sound collection state when the vehicle is in the permeable mode.

[0011] The instruction generation module is configured to generate a vehicle external sound virtual instruction based on the target vehicle external sound signal when the vehicle external sound signal collected by the vehicle external microphone is received in real time.

[0012] The instruction sending module is configured to send the vehicle external sound virtual instruction to an in-vehicle loudspeaker, wherein the vehicle external sound virtual instruction is used to control the in-vehicle loudspeaker to output a virtual sound signal corresponding to the target vehicle external sound signal.

[0013] The third aspect of the present application provides an electronic device, comprising a memory and a processor, wherein the processor is configured to execute a computer program stored in the memory; and the processor, when executing the computer program, implements each step of the vehicle external sound virtual method provided in the first aspect of the present application.

[0014] The fourth aspect of the present application provides a computer readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements each step of the vehicle external sound virtual method provided in the first aspect of the present application. Advantages

[0015] As can be seen from the above, according to the vehicle external sound virtual method, device, equipment and readable storage medium provided by the present application, when the vehicle is in the permeable mode, the vehicle external microphone is controlled to enter a vehicle external sound collection state; when the vehicle external sound signal collected by the vehicle external microphone is received in real time, a vehicle external sound virtual instruction is generated based on a target vehicle external sound signal; and the vehicle external sound virtual instruction is sent to an in-vehicle loudspeaker to control the in-vehicle loudspeaker to output a virtual sound signal corresponding to the target vehicle external sound signal. Through the implementation of the present application, the in-vehicle loudspeaker is controlled to output the simulated vehicle external sound after the vehicle external microphone is used to pick up the sound, so that the important external sound information can be effectively received by the in-vehicle personnel in the soundproof and noise reduction environment, and the driving safety and the accessibility of important voice information of the external personnel are improved.

[0016] It should be understood that the content described in this part is not intended to identify key or important features of the present application, nor is it used to limit the scope of the present application. Other features of the present application will become apparent through the following description. BRIEF DESCRIPTION OF DRAWINGS

[0017] The accompanying drawings illustrate exemplary embodiments and constitute a part of the specification. They serve to explain exemplary implementations of the embodiments together with the written description of the specification. The shown drawings are for exemplary purposes only and do not limit the scope of the claims. In all the drawings, the same reference signs refer to similar but not necessarily identical elements.

[0018] Fig. 1 is a schematic diagram of a basic flow of a method for virtualizing an outside sound according to an embodiment of the present application;

[0019] Fig. 2 is a schematic diagram of a hardware architecture of an acoustic system according to an embodiment of the present application;

[0020] Fig. 3 is a schematic diagram of a hardware architecture of another acoustic system according to an embodiment of the present application;

[0021] Fig. 4 is a schematic diagram of a detailed flow of a method for virtualizing an outside sound according to an embodiment of the present application;

[0022] Fig. 5 is a schematic diagram of functional modules of an apparatus for virtualizing an outside sound according to an embodiment of the present application;

[0023] Fig. 6 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application. Embodiments of the present application

[0024] In order to make the purposes, features and advantages of the present application more obvious and easy to understand, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work fall within the scope of protection of the present application.

[0025] In the description of the embodiments of the present application, the terms "first", "second" are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features with "first" and "second" can explicitly or implicitly include one or more of the features; the term "multiple" means two or more, unless otherwise specifically limited; the term "includes" indicates the presence of the described features, whole, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, whole, steps, operations, elements, components and / or sets thereof; the term "and / or" describes the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B can include three cases of A alone, A and B together, and B alone, and the character " / " generally represents the relationship between "or" of the associated objects.

[0026] In order to solve the problem that the sound insulation and noise reduction performance of the automobile cabin is excellent, which reduces the perception ability of the people in the vehicle to the outside sound, an embodiment of the present application provides a method for virtualizing an outside sound, which can be applied to a vehicle terminal or a mobile terminal of a driver. As shown in Fig. 1, the method for virtualizing an outside sound according to the embodiment includes the following steps:

[0027] Step 101, when the vehicle is in the transparent mode, controlling the vehicle external microphone to enter the vehicle external sound collection state.

[0028] Specifically, the transparent mode of the embodiment has certain triggering conditions, for example, manual triggering in response to user operation or automatic triggering based on certain detection data. In the transparent mode of the embodiment, the loudspeaker arranged inside the vehicle is allowed to simulate the output of the vehicle external sound signal, so that the vehicle external sound is played back in the vehicle. It should be noted that the vehicle external microphone of the embodiment refers to the microphone arranged outside the vehicle body, and the number of vehicle external microphones is greater than or equal to one, and the specific number and arrangement position can be determined according to actual use requirements.

[0029] In some embodiments of the embodiment, before the step of controlling the vehicle external microphone to enter the vehicle external sound collection state when the vehicle is in the transparent mode, the method further comprises: identifying the current scene of the vehicle according to the sensor data collected by the vehicle sensor in real time; and if the current scene of the vehicle meets the transparent mode opening condition, opening the transparent mode.

[0030] Specifically, as described above, the in-vehicle personnel (such as the driver and the passenger) can manually trigger the transparent mode through a specific operation. In order to improve the convenience, accuracy and timeliness of triggering, the embodiment can use the sensors arranged in the vehicle to collect data in real time or periodically, and then analyze the sensor data to identify the current scene of the vehicle. The transparent mode is only opened when the current scene meets a certain scene. It should be understood that the sensor data of the embodiment can include but is not limited to GPS data, environmental image data, vehicle speed data, etc. The specific scene defined by the transparent mode opening condition includes but is not limited to any one or more of the following: low-visibility environment, high-complexity driving scene (such as reversing, turning, multi-obstacle road section, etc.), low-speed driving scene, etc. It is worth mentioning that in the low-visibility environment and the high-complexity driving scene, the driving difficulty for the vehicle driver is relatively high, and paying full attention to the relevant information in the scene can effectively reduce the driving risk, so it is necessary to trigger the transparent mode in these scenes. In addition, in the high-speed driving state, the wind noise, tire noise and road noise outside the vehicle are particularly large, and the in-vehicle personnel has a strong demand for sound insulation and noise reduction. However, in the high-speed driving state, the signal-to-noise ratio of the vehicle external sound signal collected by the vehicle external microphone is low, so there is less effective information in the collected vehicle external sound signal, which is not enough to support effective vehicle external sound information to be played back in the vehicle. Therefore, the transparent mode opening condition of the embodiment is preferably limited to the low-speed driving scene.

[0031] Further, in some embodiments of the present embodiment, the step of starting the transparent mode includes: determining a target type of the transparent mode corresponding to the current scene of the vehicle from a plurality of pre-configured transparent modes; and starting the target type of the transparent mode.

[0032] Specifically, in the present embodiment, the plurality of pre-configured transparent modes are different in the out-of-vehicle sound collection mode and / or the out-of-vehicle sound virtual mode. The vehicle external microphone and the microphone operating state required to trigger different out-of-vehicle sound collection modes are different, which is specifically embodied in that the position and / or number of the vehicle external microphone entering the out-of-vehicle sound collection state are different, or the microphone continuous sampling time is different. The vehicle internal loudspeaker and the loudspeaker operating state required to trigger different out-of-vehicle sound virtual modes are different, which is specifically embodied in that the position and / or number of the vehicle internal loudspeaker entering the virtual sound signal output are different, or the loudspeaker playback volume and the number of loop playback times are different. The present embodiment intelligently identifies the scene of the vehicle and adaptively adjusts the type of the transparent mode accordingly, so that the user can be provided with the best experience in different scenes.

[0033] Step 102, when the out-of-vehicle sound signal collected by the vehicle external microphone is received in real time, the out-of-vehicle sound virtual instruction is generated based on the target out-of-vehicle sound signal.

[0034] Specifically, after receiving the microphone collection signal, the present embodiment can first preprocess the microphone collection signal, including but not limited to automatic gain control, noise reduction processing, amplification processing, etc., and then execute the operation of generating the out-of-vehicle sound virtual instruction based on the processed sound signal. It should be noted that the signal processing function of the present embodiment can be realized based on the main chip of the whole vehicle platform, or realized based on the audio DSP (Digital Signal Processor) commonly used in the whole vehicle, or realized based on an additional DSP processor, which is not uniquely limited in the present embodiment.

[0035] In some embodiments of the present embodiment, before the step of generating the out-of-vehicle sound virtual instruction based on the target out-of-vehicle sound signal, the step of obtaining the actual signal-to-noise ratio of the out-of-vehicle sound signal is further included. According to the signal-to-noise ratio level where the actual signal-to-noise ratio is located, a corresponding noise reduction processing level is determined. The out-of-vehicle sound signal is processed according to the noise reduction processing level to obtain the target out-of-vehicle sound signal.

[0036] Specifically, in actual application, when the environment where the vehicle is located is relatively noisy, there is a lot of noise in the vehicle exterior sound signal collected by the vehicle external microphone, which leads to the difficulty in restoring a relatively pure effective sound signal in the vehicle when the vehicle exterior sound signal is virtually processed. Based on this consideration, the embodiment performs noise reduction processing according to the signal-to-noise ratio of the vehicle exterior sound signal collected by the vehicle external microphone, so as to obtain the target vehicle exterior sound signal with enhanced effective sound signal.

[0037] In some embodiments of the present embodiment, before the step of generating the vehicle exterior sound virtual instruction based on the target vehicle exterior sound signal, the method further comprises: identifying sub-sound signals respectively belonging to different sound sources in the vehicle exterior sound signal based on the signal feature information; and selecting a target sub-sound signal from the plurality of sub-sound signals to determine the target vehicle exterior sound signal.

[0038] Specifically, there may be multiple sound sources in the environment around the vehicle, for example, there are relevant persons at the main driver's seat and the tail of the vehicle and the persons make sound at the same time, however, not all sound signals corresponding to the sound sources are sound signals meeting the receiving requirements of the vehicle occupants, that is, there are irrelevant sound signals, if all sound signals corresponding to the sound sources are played back in the vehicle, the irrelevant sound signals will cause unnecessary interference to the vehicle occupants. Based on this, after receiving the vehicle exterior sound signal collected by the vehicle external microphone, the embodiment identifies sub-sound signals corresponding to different sound sources based on the signal feature information, the signal feature information can include signal amplitude, signal associated microphone identifier, etc. For example, the signal amplitude can be used to identify sound sources with different distances from the vehicle occupants, and the signal associated microphone identifier can be used to identify sound sources with different directions relative to the vehicle. Finally, a specific sub-sound signal can be selected from the identified different sub-sound signals as the target vehicle exterior sound signal to be played back, and irrelevant sound signals are excluded, for example, only the sub-sound signal corresponding to the sound source closest to the vehicle occupants can be selected as the target vehicle exterior sound signal, or only the sub-sound signal corresponding to the sound source close to the main driver's seat can be selected as the target vehicle exterior sound signal.

[0039] Step 103, sending the vehicle exterior sound virtual instruction to the vehicle interior loudspeaker.

[0040] Specifically, the vehicle exterior sound virtual instruction of the embodiment is used to control the in-vehicle loudspeaker to output a virtual sound signal corresponding to the target vehicle exterior sound signal. It should be noted that the in-vehicle loudspeaker can directly output the target vehicle exterior sound signal, or output a processed virtual sound signal after processing the target vehicle exterior sound signal. The specific processing mode of the loudspeaker signal includes but is not limited to any one or more of equalization processing, dynamic control processing, gain control, and delay control. In this way, the vehicle exterior sound is accurately restored in the vehicle, so that the person in the vehicle can still perceive the relevant vehicle exterior sound in the soundproof and noise-reducing vehicle environment. It is worth mentioning that the number and position of the in-vehicle loudspeaker of the embodiment can be flexibly set according to the actual application scene or use demand. In addition, the in-vehicle loudspeaker can be a loudspeaker configured by the vehicle itself. The loudspeaker can be part of the loudspeaker reused by the in-vehicle audio system, or a dedicated loudspeaker additionally configured in the vehicle. Of course, the in-vehicle loudspeaker can also be a loudspeaker configured on a user terminal interconnected with the vehicle terminal / vehicle system.

[0041] As shown in FIG. 2, a hardware architecture schematic diagram of an acoustic system provided by the embodiment is shown. In the figure, 201 represents a microphone, and 202 represents a loudspeaker. In the hardware architecture, a single microphone is configured outside the vehicle, which can be arranged at any position of the vehicle body, roof, etc. In addition, a plurality of loudspeakers are configured inside the vehicle. In actual application, the vehicle exterior sound signal collected by the single vehicle exterior microphone is uploaded to the processor, the processor generates a vehicle exterior sound virtual instruction, and then sends the vehicle exterior sound virtual instruction to one or more of all loudspeakers to play back the vehicle exterior sound through the specific loudspeaker or all loudspeakers.

[0042] As shown in FIG. 3, another hardware architecture schematic diagram of an acoustic system provided by the embodiment is shown. In the figure, 301 represents a microphone, and 302 represents a loudspeaker. In the hardware architecture, a plurality of microphones are configured outside the vehicle, which can be arranged at a plurality of different positions of the vehicle body and / or roof, for example, one microphone is arranged at each of the front, back, left and right of the vehicle body to collect vehicle exterior sound signals in different directions. In addition, a plurality of loudspeakers are configured inside the vehicle. Similar to the hardware architecture shown in FIG. 2, the vehicle exterior sound can be played back through the specific loudspeaker or all loudspeakers.

[0043] In some embodiments of the present embodiment, the above-mentioned generation of the vehicle exterior sound virtual instruction based on the target vehicle exterior sound signal includes: determining a vehicle exterior actual sound source direction corresponding to the target vehicle exterior sound signal; and determining a corresponding in-vehicle virtual sound source direction according to the vehicle exterior actual sound source direction. Correspondingly, the above-mentioned sending of the vehicle exterior sound virtual instruction to the in-vehicle loudspeaker includes: sending the vehicle exterior sound virtual instruction to the in-vehicle loudspeaker corresponding to the in-vehicle virtual sound source direction.

[0044] Specifically, based on the hardware architecture shown in FIG. 3, in actual application, the actual sound source position of the target vehicle external sound signal can be determined based on the vehicle external sound signals collected by the multiple vehicle external microphones, and the corresponding virtual sound source position in the vehicle is controlled to replay the vehicle external sound, so that the person in the vehicle can perceive the vehicle external sound and know the position of the vehicle external sound source at the same time.

[0045] In some embodiments of the present embodiment, the above determining the actual sound source position of the target vehicle external sound signal comprises: acquiring vehicle external sound signals collected by multiple vehicle external microphones respectively; determining the target vehicle external sound signal and the target vehicle external microphone corresponding to the target vehicle external sound signal according to the signal attributes of the multiple vehicle external sound signals; wherein the signal attributes comprise at least one of the following: signal amplitude value, signal delay value; determining the actual sound source position of the target vehicle external sound signal based on the configuration position of the target vehicle external microphone.

[0046] Specifically, in actual application scenarios, the signal attributes of the sound signals collected by vehicle external microphones at different positions for the same sound source are different, and the signal amplitude value of the sound signal collected by the vehicle external microphone closest to the sound source position is the largest and the signal delay value is the smallest, so the position of the vehicle external microphone can be approximated as the actual sound source position. It should be understood that in a real scenario, all sound signals collected by multiple vehicle external microphones may come from multiple sound sources, that is, it cannot be guaranteed that all sound signals are valid sound signals, and the present embodiment can first filter out valid sound signals as target vehicle external sound signals that need to be restored in the vehicle based on the signal attributes of each sound signal.

[0047] In some embodiments of the present embodiment, the above sending the vehicle external sound virtual instruction to the vehicle internal loudspeaker corresponding to the virtual sound source position in the vehicle comprises: determining the vehicle internal space position to be covered by the virtual sound signal; determining the corresponding vehicle internal loudspeaker in combination with the vehicle internal space position and the virtual sound source position in the vehicle; and sending the vehicle external sound virtual instruction to the vehicle internal loudspeaker.

[0048] Specifically, a vehicle usually includes a driver's seat and multiple passenger seats, and the person in the vehicle who needs to perceive sound may be different in different scenarios, so in order to further improve the user's sound perception experience, the present embodiment determines a specific vehicle internal loudspeaker from multiple vehicle internal loudspeakers for simulating output of the vehicle external sound according to the specific vehicle internal space position where the vehicle external sound is restored and the previously determined virtual sound source position in the vehicle. It should be noted that when determining the specific vehicle internal loudspeaker according to the virtual sound source position in the vehicle, the present embodiment can take a single loudspeaker at the virtual sound source position in the vehicle as the specific vehicle internal loudspeaker to which the vehicle external sound virtual instruction is to be sent, or take two loudspeakers on both sides of the virtual sound source position in the vehicle as the specific vehicle internal loudspeaker to which the vehicle external sound virtual instruction is to be sent.

[0049] The method in FIG. 4 is a refined vehicle exterior sound virtual method provided by an embodiment of the present application, and specifically includes the following processes:

[0050] Step 401, identifying a current scene of the vehicle according to sensor data collected by vehicle sensors in real time;

[0051] Step 402, if the current scene of the vehicle meets the opening condition of the transparent mode, determining a target type of the transparent mode corresponding to the current scene of the vehicle from multiple pre-configured transparent modes;

[0052] Step 403, opening the target type of the transparent mode, and controlling the vehicle external microphone to enter a vehicle exterior sound collection state;

[0053] Step 404, when multiple multi-channel vehicle exterior sound signals collected by vehicle external microphones with different configuration positions are received in real time, determining a target vehicle exterior sound signal and a target vehicle external microphone corresponding to the target vehicle exterior sound signal according to signal attributes of the multiple vehicle exterior sound signals;

[0054] Step 405, determining a vehicle exterior actual sound source position corresponding to the target vehicle exterior sound signal based on a configuration direction of the target vehicle external microphone;

[0055] Step 406, determining a corresponding in-vehicle virtual sound source position with reference to the vehicle exterior actual sound source position;

[0056] Step 407, generating a vehicle exterior sound virtual instruction based on the target vehicle exterior sound signal, and sending the vehicle exterior sound virtual instruction to a target in-vehicle loudspeaker corresponding to the in-vehicle virtual sound source position, so as to control the target in-vehicle loudspeaker to output a virtual sound signal corresponding to the target vehicle exterior sound signal.

[0057] It should be understood that the size of the serial number of each step in the embodiment does not mean the sequence of the execution of the steps, and the execution sequence of each step should be determined according to its function and inherent logic, and should not constitute the only limitation on the implementation process of the embodiment of the present application.

[0058] FIG. 5 is a vehicle exterior sound virtual device provided by an embodiment of the present application, which can be used to implement the vehicle exterior sound virtual method in the foregoing embodiments, and mainly includes:

[0059] The sound collection module 501 is configured to control the vehicle external microphone to enter a vehicle exterior sound collection state when the vehicle is in the transparent mode;

[0060] The instruction generation module 502 is configured to generate a vehicle exterior sound virtual instruction based on a target vehicle exterior sound signal when a vehicle exterior sound signal collected by the vehicle external microphone is received in real time;

[0061] The instruction sending module 503 is configured to send the vehicle-outside-sound virtual instruction to the vehicle interior speaker; the vehicle-outside-sound virtual instruction is used to control the vehicle interior speaker to output a virtual sound signal corresponding to the target vehicle-outside-sound signal.

[0062] In an optional implementation of the embodiment, the vehicle-outside-sound virtual device further includes a mode starting module configured to identify a current scene of the vehicle according to sensor data collected by the vehicle sensor in real time; and start the permeable mode if the current scene of the vehicle meets the permeable mode starting condition.

[0063] In an optional implementation of the embodiment, the vehicle-outside-sound virtual device further includes a signal processing module configured to obtain an actual signal-to-noise ratio of the vehicle-outside-sound signal; determine a corresponding noise reduction processing level according to a signal-to-noise ratio level of the actual signal-to-noise ratio; and perform noise reduction processing on the vehicle-outside-sound signal according to the noise reduction processing level to obtain the target vehicle-outside-sound signal.

[0064] It should be noted that the vehicle-outside-sound virtual method in the foregoing method embodiments can be implemented based on the vehicle-outside-sound virtual device provided in the embodiment, and a person of ordinary skill in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the vehicle-outside-sound virtual device described in the embodiment can be implemented by referring to the corresponding working process in the foregoing method embodiments, which will not be described herein.

[0065] Based on the technical solutions of the foregoing embodiments of the application, when the vehicle is in the permeable mode, the vehicle external microphone is controlled to enter the vehicle-outside-sound collection state; when the vehicle-outside-sound signal collected by the vehicle external microphone is received in real time, the vehicle-outside-sound virtual instruction is generated based on the target vehicle-outside-sound signal; and the vehicle-outside-sound virtual instruction is sent to the vehicle interior speaker to control the vehicle interior speaker to output the virtual sound signal corresponding to the target vehicle-outside-sound signal. Through the implementation of the application, the vehicle interior speaker is controlled to output the simulated vehicle-outside-sound after the vehicle external microphone is used to pick up the sound, so that the important external sound information can be effectively received by the vehicle interior personnel in the soundproof and noise reduction environment, and the driving safety and the accessibility of the important voice information of the external personnel are improved.

[0066] Please refer to FIG. 6, which is an electronic device provided by an embodiment of the application. The electronic device can be used to implement the vehicle-outside-sound virtual method in the foregoing embodiments. As shown in FIG. 6, the electronic device mainly includes:

[0067] The memory 601, the processor 602, and the bus 603 are connected. The memory 601 and the processor 602 are connected through the bus 603. The memory 601 stores a computer program that can run on the processor 602. When the processor 602 executes the computer program, the vehicle-outside-sound virtual method in the foregoing embodiments is implemented. The number of processors can be one or more.

[0068] The memory 601 can be a high-speed random access memory (RAM) or a non-volatile memory such as a disk memory. The memory 601 is used to store executable program codes, and the processor 602 is coupled to the memory 601.

[0069] Further, the embodiment of the present application also provides a computer readable storage medium, which can be arranged in the electronic device in the above-mentioned embodiments, and the computer readable storage medium can be the memory in the embodiment shown in FIG. 6.

[0070] The computer readable storage medium stores a computer program, and the program is executed by the processor to implement the vehicle exterior sound virtualization method in the above-mentioned embodiments. Further, the computer readable storage medium can also be a U disk, a mobile hard disk, a read-only memory (ROM), a RAM, a magnetic disk or an optical disk, and various media that can store program codes.

[0071] In several embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented by other manners. For example, the apparatus embodiment described above is only schematic, for example, the division of the module is only a logical function division, and actual implementation can have another division manner, for example, a plurality of modules or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the displayed or discussed modules can be indirect coupling or communication connection through some interfaces, apparatuses or modules, and can be electrical, mechanical or other forms.

[0072] The module described as a separate component can be or can not be physically separated, and the component displayed as a module can be or can not be a physical module, that is, can be located in one place, or can be distributed to a plurality of network modules. According to actual needs, part or all of the modules can be selected to achieve the purpose of the embodiment scheme.

[0073] In addition, the function modules in each embodiment of the present application can be integrated in one processing module, or each module can be physically present alone, or two or more modules can be integrated in one module. The integrated module can be realized in the form of hardware or in the form of a software function module.

[0074] The integrated module, if implemented in the form of a software function module and sold or used as an independent product, can be stored in a computer readable storage medium. Based on such an understanding, the technical solutions of the present application can be embodied in the form of a software product in essence or in the form of all or part of the technical solutions that make contributions to the prior art. The computer software product is stored in a readable storage medium, includes a number of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods in the various embodiments of the present application. The aforementioned readable storage medium includes various media that can store program codes, such as a U disk, a mobile hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.

[0075] It should be noted that, for the foregoing method embodiments, in order to facilitate description, they are all described as a combination of a series of actions, but those skilled in the art should know that the present application is not limited to the order of the actions described, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should know that the embodiments described in the specification all belong to preferred embodiments, and the actions and modules involved are not necessarily essential to the present application.

[0076] In the above embodiments, the description of each embodiment has its own focus, and the parts not described in detail in a certain embodiment can be referred to the related description of other embodiments.

[0077] The above is the description of the off-board sound virtualization method, device, equipment and readable storage medium provided by the present application. For those skilled in the art, according to the idea of the embodiments of the present application, there will be changes in specific implementation manners and application ranges. In conclusion, the content of the specification should not be understood as a limitation of the present application.

Claims

1. A vehicle exterior sound virtualization method characterized by, The method comprises the following steps: When the vehicle is in the transparent mode, control the vehicle external microphone to enter the vehicle external sound collection state; When the vehicle external sound signal collected by the vehicle external microphone is received in real time, generate a vehicle external sound virtual instruction based on the target vehicle external sound signal; Send the vehicle external sound virtual instruction to the in-vehicle speaker; wherein the vehicle external sound virtual instruction is used to control the in-vehicle speaker to output a virtual sound signal corresponding to the target vehicle external sound signal.

2. The vehicle off sound virtualization method according to claim 1, characterized by, Further comprising: Identify the current scene of the vehicle according to the sensor data collected by the vehicle sensor in real time; If the current scene of the vehicle meets the transparent mode opening condition, open the transparent mode.

3. The vehicle off sound virtualization method according to claim 2, characterized by, The opening of the transparent mode comprises: Determine the target type of the transparent mode corresponding to the current scene of the vehicle from a plurality of preconfigured transparent modes; wherein the vehicle external sound collection mode and / or the vehicle external sound virtual mode of the plurality of preconfigured transparent modes are different; Open the target type of the transparent mode.

4. The vehicle off sound virtualization method of claim 1, wherein Before the target vehicle external sound signal is generated based on the target vehicle external sound signal, the method further comprises the following steps: Obtain the actual signal-to-noise ratio of the vehicle external sound signal; According to the signal-to-noise ratio level where the actual signal-to-noise ratio is located, determine the corresponding noise reduction processing level; According to the noise reduction processing level, the vehicle external sound signal is processed to obtain the target vehicle external sound signal.

5. The virtualizing method of claim 1, wherein, The target vehicle external sound signal is generated based on the target vehicle external sound signal, which comprises the following steps: Determine the vehicle external actual sound source direction corresponding to the target vehicle external sound signal; According to the vehicle external actual sound source direction, determine the corresponding in-vehicle virtual sound source direction; The vehicle external sound virtual instruction is sent to the in-vehicle speaker, which comprises the following steps: Send the vehicle external sound virtual instruction to the in-vehicle speaker corresponding to the in-vehicle virtual sound source direction.

6. The vehicle off sound virtualization method of claim 5, wherein The vehicle has a plurality of vehicle external microphones with different configuration positions; The target vehicle external sound signal and the target vehicle external microphone corresponding to the target vehicle external sound signal are determined according to the signal properties of the plurality of vehicle external sound signals; wherein the signal properties include at least one of the following: signal amplitude value, signal delay value; The target vehicle external sound signal corresponding to the target vehicle external sound signal is determined based on the configuration direction of the target vehicle external microphone. The vehicle has a plurality of in-vehicle speakers with different configuration positions; The vehicle external sound virtual instruction is sent to the in-vehicle speaker corresponding to the in-vehicle virtual sound source direction, which comprises the following steps:

7. The vehicle off sound virtualization method of claim 5, wherein, Determine the in-vehicle space position required to be covered by the virtual sound signal; Determine the corresponding in-vehicle speaker in combination with the in-vehicle space position and the in-vehicle virtual sound source direction; Send the vehicle external sound virtual instruction to the in-vehicle speaker. The method comprises the following steps: When the vehicle is in the transparent mode, control the vehicle external microphone to enter the vehicle external sound collection state; 8. An off-board sound virtualization apparatus characterized by comprising: When the vehicle external sound signal collected by the vehicle external microphone is received in real time, generate a vehicle external sound virtual instruction based on the target vehicle external sound signal; ​ ​ The instruction sending module is configured to send the out-of-vehicle sound virtual instruction to an in-vehicle speaker; wherein the out-of-vehicle sound virtual instruction is configured to control the in-vehicle speaker to output a virtual sound signal corresponding to the target out-of-vehicle sound signal.

9. An electronic device, comprising: The computer program product comprises: a memory and a processor; the processor is configured to execute a computer program stored in the memory; the processor, when executing the computer program, implements the steps in the out-of-vehicle sound virtual method according to any one of claims 1 to 7.

10. A computer-readable storage medium having stored thereon a computer program, characterized in that, the computer program, when executed by the processor, implements the steps in the out-of-vehicle sound virtual method according to any one of claims 1 to 7.

Images