In-vehicle user sub-area sound transmission method and device and electronic equipment

Abstract

The application discloses an in-vehicle user sub-area sound perception method and device and electronic equipment. The main idea of the application is as follows: obtaining a user subjective transmission intention according to a voice interaction of a plurality of sub-areas in a vehicle or triggering real-time sound pickup of a corresponding outside area based on automatic control logic, and outputting sound pickup data outside the vehicle to a speaker involved in the sub-area in the vehicle according to a preset mixing logic, so that users at different positions in the vehicle can independently perceive the sound of the outside environment, and the overall vehicle experience of passengers in the vehicle is improved. Compared with the prior art, the application effectively and directionally feeds back the sound pickup data outside the vehicle to the passengers in the corresponding area in the vehicle, so that the users in different spaces in the vehicle can independently perceive the sound information of the specific outside area required by the user, and the user intention is combined with intelligent decision-making to create a higher degree of freedom in the vehicle.

Description

Technical Field

[0001] This invention relates to the field of automotive audio technology, and in particular to a method, device, and electronic device for in-vehicle users to perceive external sounds in different zones. Background Technology

[0002] With the upgrading of automobile consumption, vehicles equipped with more diverse types of speakers and audio power amplifiers capable of handling complex mixing scenarios are becoming increasingly popular among users, allowing drivers and passengers to enjoy a feature-rich and immersive sound space equally within the vehicle. However, due to the physical isolation of the vehicle itself and the limitations of various environments, it is difficult for passengers inside the vehicle to obtain real-time ambient sounds from different directions. In addition to limiting daily convenience, the subjective purpose of acquiring audio from outside the vehicle also fails to meet the requirements of real-time and directional sound.

[0003] Currently, the main technical solutions for using microphones for in-vehicle and out-of-vehicle interaction and experience strategies can be summarized as follows:

[0004] (1) Simultaneously pick up audio from inside and outside the vehicle and compare them to determine the emergency system plan issued inside and outside the vehicle;

[0005] (2) A solution to further eliminate overall noise using external sound pickup data to improve the voice interaction experience;

[0006] (3) External unlocking strategy using external sound pickup for voiceprint matching;

[0007] (4) Intercom through the window and emergency call procedure;

[0008] (5) Use external audio pickup equipment to build a comprehensive and multi-dimensional dashcam system.

[0009] Most of the existing solutions mentioned above use microphones for sound pickup to facilitate conversations or security information verification inside and outside the vehicle. However, they cannot meet the needs of passengers in different positions inside the vehicle to independently perceive the sound field reproduction of the corresponding area outside the vehicle. Summary of the Invention

[0010] In view of the above, the present invention aims to provide a method, device and electronic device for in-vehicle users to perceive the transmission of external sound in different areas, so as to solve the problem of in-vehicle users independently perceiving the transmission of external sound in corresponding areas.

[0011] The technical solution adopted in this invention is as follows:

[0012] In a first aspect, the present invention provides a method for a vehicle-in-vehicle user to perceive external sound transmission in a segmented manner, comprising:

[0013] Based on the preset input signal, the pass-through function is triggered and it is determined whether the voice interaction command of the user in the vehicle is received.

[0014] When no voice command is received from the user inside the vehicle, based on preset conditions, the system controls different in-vehicle zones to output the corresponding external sounds picked up from the outside area.

[0015] After receiving a voice command from a user inside the vehicle, the system uses acoustic positioning to determine the target vehicle compartment where the user is located, and outputs the sound from the outside area into the target vehicle compartment according to the voice command.

[0016] In at least one possible implementation, the preset conditions include deciding whether to output external sounds based on the current vehicle speed, the in-vehicle sound environment, and the external sound pressure level.

[0017] In at least one of the possible implementations, if the current vehicle speed, in-vehicle sound environment, and external sound pressure level determine that the preset conditions are not met and the predetermined time has been exceeded, the pass-through function is automatically turned off.

[0018] In at least one possible implementation, outputting sound from the outside area within the target vehicle interior partition includes:

[0019] If other sound sources are detected in the target vehicle interior partition, the volume of the other sound sources in the target vehicle interior partition is reduced, and the sound from the outside area that needs to be transmitted is simultaneously isolated and output in the target vehicle interior partition.

[0020] In at least one possible implementation, the method for transmitting external sound further includes: dynamically adjusting the output volume of the speakers involved in the internal vehicle partition based on the sound pressure value of the external area to be transmitted.

[0021] In at least one possible implementation, the method for transmitting external sound further includes:

[0022] When the sound pressure level in any in-vehicle zone indicates that the external sound output from that in-vehicle zone exceeds a predetermined volume threshold, the output volume of that in-vehicle zone is corrected and a warning is issued.

[0023] If recovery fails, the pass-through function will be forcibly disabled.

[0024] Secondly, the present invention provides a vehicle-mounted user-regional sound transmission device for sensing external sounds, comprising:

[0025] The pass-through function activation module is used to trigger the pass-through function to be activated based on a preset input signal, and to determine whether a voice interaction command from a user inside the vehicle has been received.

[0026] The intelligent automatic transparent transmission module is used to control different in-vehicle zones to output corresponding external sounds picked up from the outside area based on preset conditions when no voice command is received from the user in the vehicle.

[0027] The user intervention pass-through module is used to determine the target in-vehicle zone where the user is located through acoustic positioning after receiving a voice command from a user in the vehicle, and output the sound from the outside area into the target in-vehicle zone according to the voice command.

[0028] In at least one of the possible implementations, the external sound transmission device further includes: a transmission mode switching module, used to switch to intelligent automatic transmission based on voice commands when the user intervenes in the transmission.

[0029] Thirdly, the present invention provides an electronic device, comprising:

[0030] One or more processors, a memory, and one or more computer programs, the memory being a non-volatile storage medium, wherein the one or more computer programs are stored in the memory, the one or more computer programs including instructions that, when executed by the device, cause the device to perform the method as described in the first aspect or any possible implementation thereof.

[0031] The main concept of this invention lies in acquiring the user's subjective intentions through voice interaction in several in-vehicle zones, or triggering real-time sound pickup in corresponding external areas based on automatic control logic. The external sound data is then processed and output to the speakers in the relevant in-vehicle zones according to a preset mixing logic. This allows users in different locations within the vehicle to independently perceive external ambient sounds, enhancing the overall user experience. Compared to existing technologies, this invention effectively and directionally feeds external sound data back to the driver and passengers in corresponding areas within the vehicle, enabling users in different spaces to independently perceive the specific external sound information they require. Furthermore, by combining user intentions with intelligent decision-making, it creates a more flexible in-vehicle sensory experience. Attached Figure Description

[0032] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described below with reference to the accompanying drawings, wherein:

[0033] Figure 1 A flowchart illustrating an embodiment of the in-vehicle user zoned perception and external sound transmission method provided by the present invention;

[0034] Figure 2 This is a schematic diagram of the vehicle interior partitions and exterior areas provided by the present invention;

[0035] Figure 3A schematic diagram of an embodiment of the in-vehicle user zoned perception and external sound transmission device provided by the present invention;

[0036] Figure 4 A schematic diagram of an embodiment of the electronic device provided by the present invention. Detailed Implementation

[0037] Embodiments of the present invention are described in detail below. Examples of these embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and should not be construed as limiting the present invention.

[0038] This invention proposes at least one embodiment of a method for in-vehicle user-regional perception of external sound transmission, such as... Figure 1 As shown, it can specifically include:

[0039] Step 1: Based on the preset input signal, trigger the pass-through function to start, and determine whether the voice interaction command of the user in the vehicle is received;

[0040] For example, in practical operation, a master switch (hardware and software) can be set to enable or disable the entire pass-through function. Typically, this master switch can be set to the off state by default. When the user needs or anticipates using the pass-through function, they can activate it by operating this master switch. Of course, in some preferred embodiments, after the pass-through function is enabled, existing devices such as the vehicle's infotainment system can proactively announce the available control modes, allowing the user to actively decide which mode to use, such as intelligent control mode or user intervention mode, while keeping the microphones inside and outside the vehicle in the active state accordingly.

[0041] The different control modes described here can be switched and implemented by detecting whether voice interaction commands issued by drivers and passengers in different positions inside the vehicle are obtained within a certain predetermined time after the pass-through function is turned on. That is, when no human intervention or interaction intention is detected, the intelligent control mode is adopted, and when a clear voice command from a driver or passenger is recognized, it switches to the user intervention mode. See the following steps for details.

[0042] Step 2: When no voice command is received from the user inside the vehicle, based on preset conditions, control different in-vehicle zones to output the corresponding external sounds picked up from the outside area.

[0043] The in-vehicle zones (multiple zones, i.e., multiple sound zones) mentioned here can be pre-defined. Taking a small car as an example, it can usually be divided into four in-vehicle zones: driver's zone S1, passenger's zone S2, rear left zone S3, and rear right zone S4. Each in-vehicle zone includes several speakers, such as headrest speakers, low, mid, and high speaker groups, etc. Of course, it is understandable that the common areas in the car can also be equipped with speakers such as a center midrange speaker at the front of the car and a rear subwoofer at the rear of the car. The audio output strategy of these speakers in the common areas can be configured into the aforementioned four specific in-vehicle zones as needed.

[0044] Regarding the aforementioned external areas, they can also be divided based on the vehicle model. Taking a small car as an example, they can usually be divided into the front area (F), the rear area (R), the left front area (left-hand drive vehicle, i.e., the outside of the driver's door) (FL), the right front area (left-hand drive vehicle, i.e., the outside of the passenger door) (FR), the left rear area (RL, the outside of the left rear door), and the right rear area (RR, the outside of the right rear door). In specific implementation, each external area can be equipped with its own sound pickup components, such as microphone arrays.

[0045] Therefore, it can also be mentioned here that the embodiments of the method of the present invention can be composed of hardware and software such as an in-vehicle audio control system, an in-vehicle power amplifier system, an in-vehicle infotainment system, an in-vehicle sound pickup system, and an in-vehicle speaker system.

[0046] Specifically, the vehicle audio control system, vehicle amplifier system, and vehicle infotainment system can use the original vehicle configuration, while the following are preferred hardware solutions for the vehicle's internal and external sound pickup systems and in-vehicle speaker systems:

[0047] The preferred in-vehicle speaker system includes headrest speakers, a combination of mid-high and low-frequency speakers in all four doors, a center speaker, and a subwoofer. The installation positions of all speakers can follow standard in-vehicle layouts. In practical application, this example can be adjusted as needed, but it is recommended to include headrest speakers whenever possible; otherwise, the zonal voice interaction feature may not be effectively implemented. The in-vehicle microphone array is arranged to meet the requirements of four-zone voice interaction, such as... Figure 2 As illustrated, microphones can be arranged in four areas inside the vehicle (or adjusted as needed). Four-zone sound pickup is not the focus of this invention. For the configuration of the external microphone array, preferably, the six preset pickup areas should have an array layout (the number of microphones in the array can be considered according to the actual vehicle configuration; understandably, each external pickup area should have at least one microphone. Of course, to ensure better sound pickup and noise reduction, it is preferable to install at least two microphone units in each external pickup area, with a spacing of approximately 30cm between them).

[0048] Regarding the six external pickup areas mentioned here, combined with the attached... Figure 2 This can be illustrated as follows:

[0049] F represents the area in front of the vehicle: for reference, the microphone is mounted near the front camera.

[0050] R (Rear area): For reference, the microphone is installed near the rear camera.

[0051] FL (Left Front Area): For reference, the microphone is mounted near the left rearview mirror camera.

[0052] FR (Right Front Area): For reference, the microphone is mounted near the right-side rearview mirror camera.

[0053] RL (Rear Left Area): For reference, the microphone is mounted on the left rear door handle.

[0054] RR (Right Rear Area): For reference, the microphone is mounted on the right rear door handle.

[0055] Therefore, the following example is provided: sound pickup from outside the vehicle is mixed by the vehicle's amplifier and then output inside the vehicle:

[0056] Sound pickup in the area outside the vehicle In-car zone mixing output F All speakers in S1 and S2, plus the center speaker FL S1 speaker assembly + headrest speakers FR S2 speaker assembly + headrest speakers R All speakers in S3 and S4 + rear speakers RL S3 speaker array + headrest speakers RR S4 speaker array + headrest speakers

[0057] In this way, passengers in different zones inside the vehicle can independently perceive the sounds of the corresponding areas outside the vehicle from their seats (and mature noise reduction technology can be used to make the independent perception effect even better). Of course, in other embodiments, the sound energy output by other zones can be adjusted so that passengers can hear the output audio of other zones while mainly perceiving the output audio of their own zone. Of course, this is an optional processing.

[0058] Furthermore, the aforementioned "based on preset conditions" can at least refer to deciding whether to output external sounds based on the current vehicle speed, the in-vehicle sound environment, and the external sound pressure level. That is, when the vehicle as a whole or a certain in-vehicle zone / external area meets the predetermined conditions mentioned above, the external sounds can be intelligently controlled in each zone and the common speaker mixing output to reconstruct the external sound field, as described above.

[0059] For example, the vehicle's infotainment system can periodically provide real-time vehicle speed feedback, and the microphone arrays in each external area can assess the external sound pressure level in real time. It can also determine the audio playback status of in-vehicle multimedia through in-vehicle sound pickup or the infotainment system and other in-vehicle terminals. The aforementioned conditions, in this specific implementation, can be as follows: vehicle speed ≤ 20 km / h (indicating parking or low speed), no multimedia being played in the vehicle (to avoid interference), and external sound pressure level ≤ 55 dB (mainly to avoid high-noise transmission). Only when these conditions are met will the speakers in different in-vehicle zones output the corresponding external sound picked up by the microphones in the external areas. Based on this concept, if the above requirements are not met—that is, when the current vehicle speed, in-vehicle sound environment, and external sound pressure level determine that the preset conditions are not met, and a predetermined timeout period (e.g., 5 seconds) is exceeded—the transmission function will be automatically turned off. This preferred embodiment can achieve a dynamic intelligent on / off function without requiring manual user intervention.

[0060] Following the previous text, in step 3, after receiving the voice command from the user inside the vehicle, the system uses acoustic positioning to determine the target vehicle compartment where the user is located, and outputs the sound from the outside area into the target vehicle compartment according to the voice command.

[0061] Specifically, based on the in-vehicle zoning mentioned earlier, microphones deployed inside the vehicle can pinpoint the zone where the user issuing the voice command (which, understandably, relates to the desired external sound transmission area) is located. This is to determine the target speaker that needs to respond. Furthermore, based on the intent parsing results of the voice command, microphone data from one external zone can be acquired individually, or multiple or even omnidirectional (ALL) fused audio data can be acquired (e.g., but not limited to, multi-zone audio data can be mixed and superimposed using channel mixing). For example, the driver in zone S1 can request the transmission of external sounds from FR and RR using a voice command. Based on this, the sound data collected by the external microphones from FR+RR is output by the speaker group in the target zone S1 plus the headrest speakers (and may also be combined with the center speaker).

[0062] This step can be further explained as follows:

[0063] Firstly, this step is to enter the user intervention mode mentioned earlier. In this mode, the main reliance is on the voice commands explicitly given by the user. As an extension, the user can give voice commands to switch modes in this mode. That is, the user intervention mode can be directly switched to the aforementioned intelligent control mode (the intelligent control mode can be preset as the default mode) by voice, without having to switch by detecting whether there are voice commands again.

[0064] Secondly, as mentioned above, we can also consider whether certain preset conditions are met when performing pass-through.

[0065] Thirdly, in some other preferred embodiments, in order to ensure that the user's intention to actively intervene is achieved, the present invention proposes the following preferred concepts:

[0066] Step 31: If it is detected that there are other sound sources in the target vehicle interior partition (here, "other" refers to the sound that is to be transmitted through, for example, the speaker in the S1 area is playing a multimedia sound source);

[0067] Step 32: Reduce the volume of other audio sources only within the target vehicle compartment (while maintaining the media volume of other vehicle compartments);

[0068] Step 33: Simultaneously isolate and output the sound from the outside area that needs to be transmitted within the target vehicle, for example, achieving an isolation of more than 10dB in the target zone sound field.

[0069] Finally, based on the aforementioned embodiments, it can be further explained that in actual operation, microphones inside and outside the vehicle can be used to obtain the corresponding noise level and adaptively adjust the audio output effect.

[0070] Specifically, the vehicle amplifier can dynamically adjust the output volume of the in-vehicle zone speakers based on the sound pressure level of the external sound to be transmitted, so that the user can obtain a stable transmitted sound volume (e.g., around 50dB, this range can be adjusted as needed). In other embodiments, if the sound pressure level in any in-vehicle zone indicates that the external sound output by that zone exceeds a predetermined volume threshold (e.g., the sound transmitted to zone S1, after being picked up by the microphone in S1, indicates that it is continuously greater than the set upper limit threshold of 65dB or less than the lower limit threshold of 35dB for 5 seconds), then the output volume of that in-vehicle zone is corrected and a warning is issued; if it cannot be recovered (of course, a timer can be added, for example, if it cannot be corrected to the threshold range within 3 seconds), then the transmission function is forcibly shut down (and a fault code can be recorded) to ensure that the user can independently perceive a safe and stable transmission effect.

[0071] In summary, the main concept of this invention lies in acquiring the user's subjective intentions through voice interaction in several in-vehicle zones, or triggering real-time sound pickup in corresponding external areas based on automatic control logic. The external sound data is then processed and output to the speakers in the relevant in-vehicle zones according to a preset mixing logic. This allows users in different locations within the vehicle to independently perceive external ambient sounds, enhancing the overall user experience. Compared to existing technologies, this invention effectively and directionally feeds external sound data back to the driver and passengers in corresponding areas within the vehicle, enabling users in different spaces to independently perceive the specific external sound information they require. Furthermore, by combining user intentions with intelligent decision-making, it creates a more flexible in-vehicle sensory experience.

[0072] Corresponding to the above embodiments and preferred solutions, the present invention also provides an embodiment of a vehicle-mounted user-regional sensing external sound transmission device, such as... Figure 3 As shown, it may specifically include the following components:

[0073] The pass-through function activation module 1 is used to trigger the pass-through function to be activated based on a preset input signal, and to determine whether a voice interaction command from a user inside the vehicle has been received.

[0074] The intelligent automatic transparent transmission module 2 is used to control different in-vehicle zones to output the corresponding external sounds picked up from the outside area based on preset conditions when no voice command is received from the user in the vehicle.

[0075] The user intervention pass-through module 3 is used to determine the target vehicle interior partition where the user is located through acoustic positioning after receiving the voice command from the user in the vehicle, and output the sound from the outside area in the target vehicle interior partition according to the voice command.

[0076] In at least one of the possible implementations, the external sound transmission device further includes: a transmission mode switching module 4, used to switch to intelligent automatic transmission based on voice commands when the user intervenes in the transmission.

[0077] The above should be understood Figure 3 The division of components in the in-vehicle user zoned perception and external sound transmission device shown is merely a logical functional division. In actual implementation, they can be fully or partially integrated into a single physical entity, or physically separated. These components can be implemented entirely in software via processing elements; entirely in hardware; or partially in software via processing elements and partially in hardware. For example, a particular module can be a separate processing element or integrated into a chip in an electronic device. The implementation of other components is similar. Furthermore, these components can be fully or partially integrated together or implemented independently. During implementation, each step of the above method or each of the above components can be completed through integrated logic circuits in the hardware of the processor element or through software instructions.

[0078] For example, these components can be one or more integrated circuits configured to implement the above methods, such as one or more Application Specific Integrated Circuits (ASICs), one or more Digital Signal Processors (DSPs), or one or more Field Programmable Gate Arrays (FPGAs). Alternatively, these components can be integrated together to form a System-On-a-Chip (SOC).

[0079] Based on the above embodiments and preferred solutions, those skilled in the art will understand that, in actual operation, the technical concept involved in this invention can be applied to various implementation methods. The following embodiments are used as illustrative examples:

[0080] (1) An electronic device. The device may specifically include: one or more processors, a memory, and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions that, when executed by the device, cause the device to perform the steps / functions of the foregoing embodiments or equivalent embodiments.

[0081] Specifically, the electronic device can be a computer-related electronic device, such as, but not limited to, various interactive terminals and electronic products, mobile terminals, etc.

[0082] Figure 4 The schematic diagram illustrates an embodiment of the electronic device provided by the present invention. Specifically, the electronic device 900 includes a processor 910 and a memory 930. The processor 910 and the memory 930 can communicate with each other via an internal connection to transmit control and / or data signals. The memory 930 stores computer programs, and the processor 910 retrieves and runs the computer programs from the memory 930. The processor 910 and the memory 930 can be combined into a single processing device, but more commonly they are independent components. The processor 910 executes the program code stored in the memory 930 to achieve the aforementioned functions. In specific implementations, the memory 930 can be integrated into the processor 910, or it can be independent of the processor 910.

[0083] In addition, to further enhance the functionality of the electronic device 900, the device 900 may also include one or more of the following: an input unit 960, a display unit 970, an audio circuit 980, a camera 990, and a sensor 901. The audio circuit may also include a speaker 982, a microphone 984, etc. The display unit 970 may include a display screen.

[0084] Furthermore, the aforementioned device 900 may also include a power supply 950 for providing electrical energy to various devices or circuits in the device 900.

[0085] It should be understood that the operation and / or function of the various components in the device 900 can be specifically referred to in the foregoing descriptions of the methods, systems, and other embodiments. To avoid repetition, detailed descriptions are appropriately omitted here.

[0086] It should be understood that Figure 4 The processor 910 in the illustrated electronic device 900 can be a system-on-a-chip (SoC). The processor 910 may include a central processing unit (CPU) and may further include other types of processors, such as a graphics processing unit (GPU), which will be described in detail below.

[0087] In summary, the various processors or processing units inside the processor 910 can work together to implement the previous method flow, and the corresponding software programs of each processor or processing unit can be stored in the memory 930.

[0088] (2) A computer data storage medium storing a computer program or the aforementioned device, which, when executed, causes a computer to perform the steps / functions of the foregoing embodiments or equivalent embodiments.

[0089] In several embodiments provided by this invention, any function, if implemented as a software functional unit and sold or used as an independent product, can be stored in a computer data storage medium. Based on this understanding, certain technical solutions of this invention, or the parts that contribute to the prior art, or parts of such technical solutions, can be embodied in the form of software products as described below.

[0090] It should be noted in particular that the storage medium may refer to a server or a similar computer device, specifically, that is, the aforementioned computer program or the aforementioned device is stored in the storage device of the server or similar computer device.

[0091] (3) A computer program product (which may include the above-mentioned device), which, when running on a terminal device, causes the terminal device to execute the in-vehicle user area perception method for transmitting external sound in the aforementioned embodiment or equivalent implementation.

[0092] As can be seen from the above description of the embodiments, those skilled in the art can clearly understand that all or part of the steps in the above implementation methods can be implemented by means of software plus necessary general-purpose hardware platforms. Based on this understanding, the above-mentioned computer program products may include, but are not limited to, APPs.

[0093] Continuing from the previous text, the aforementioned device / terminal can be a computer device, and the hardware structure of this computer device can specifically include: at least one processor, at least one communication interface, at least one memory, and at least one communication bus; the processor, communication interface, and memory can all communicate with each other through the communication bus. The processor may be a central processing unit (CPU), DSP, microcontroller, or digital signal processor, and may also include a GPU, an embedded neural network processing unit (NPU), and an image signal processor (ISP). The processor may also include a specific integrated circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present invention. Furthermore, the processor may have the function of operating one or more software programs, which can be stored in a storage medium such as memory. The aforementioned memory / storage medium may include: non-volatile memory, such as a non-removable disk, USB flash drive, portable hard drive, optical disc, etc., as well as read-only memory (ROM), random access memory (RAM), etc.

[0094] In this embodiment of the invention, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent the existence of A alone, A and B simultaneously, or B alone. A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects have an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of singular or plural items. For example, at least one of a, b, and c can represent: a, b, c, a and b, a and c, b and c, or a and b and c, where a, b, and c can be single or multiple.

[0095] Those skilled in the art will recognize that the modules, units, and method steps described in the embodiments disclosed in this specification can be implemented using electronic hardware, computer software, and a combination of electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this invention.

[0096] Furthermore, the modules and units described as separate components may or may not be physically separate; that is, they may be located in one place or distributed in multiple places, such as nodes in a system network. Specifically, some or all of the modules and units can be selected to achieve the purpose of the above-described embodiments, depending on actual needs. Those skilled in the art can understand and implement this without any inventive effort.

[0097] The above description of the structure, features, and effects of the present invention is based on the embodiments shown in the figures. However, the above are only preferred embodiments of the present invention. It should be noted that the technical features involved in the above embodiments and their preferred methods can be reasonably combined and matched by those skilled in the art to form a variety of equivalent solutions without departing from or changing the design concept and technical effects of the present invention. Therefore, the present invention is not limited to the scope of implementation shown in the figures. Any changes made in accordance with the concept of the present invention, or modifications to equivalent embodiments, that do not exceed the spirit covered by the specification and figures, should be within the protection scope of the present invention.

Claims

1. An in-vehicle user sub-area sound perception method for transmitting sound outside the vehicle, characterized by, The method comprises: based on a preset input signal, triggering the opening of the transparent function, and determining whether a voice interaction instruction of a user in the vehicle is received; when no voice instruction of a user in the vehicle is received, an intelligent control mode is executed, which is used for intelligently controlling the output of external sound by each partition and a public loudspeaker to reconstruct the sound field outside the vehicle, including: when the current vehicle speed, the sound environment in the vehicle and the sound pressure level outside the vehicle all meet the preset conditions, controlling different partitions in the vehicle to output the external sound picked up by the corresponding external area; after receiving the voice instruction of the user in the vehicle, a user intervention mode is executed, which is used for directing at least one external sound pickup data to the driver and passenger in the corresponding area in the vehicle according to the intention analysis result of the voice instruction: determining the target partition in the vehicle where the user is located through acoustic positioning, and outputting the sound of the external area in the target partition in the vehicle according to the voice instruction.

2. The in-vehicle user sub-area aware sound transmission method according to claim 1, wherein If it is determined that the current vehicle speed, the sound environment in the vehicle and the sound pressure level outside the vehicle do not meet the preset conditions and exceed the established timing time, the transparent function is automatically closed.

3. The in-vehicle user sub-area aware sound transparent method of claim 1, wherein, The output of the sound of the external area in the target partition in the vehicle includes: if it is detected that there is another sound source in the target partition in the vehicle, only the volume of the other sound source in the target partition in the vehicle is reduced, and the sound of the external area to be transmitted is isolated and output in the target partition in the vehicle.

4. The method according to any one of claims 1 to 3, wherein The external sound transmission method further comprises: dynamically adjusting the output volume of the loudspeaker involved in the partition in the vehicle according to the sound pressure value of the external area to be transmitted.

5. The method according to any one of claims 1 to 3, wherein The external sound transmission method further comprises: when the sound pressure value in any partition in the vehicle represents that the output of the external sound in the current partition in the vehicle exceeds the established volume threshold, the output volume of the current partition in the vehicle is corrected and a warning is issued; if it cannot be recovered, the transparent function is forcibly closed.

6. An in-vehicle user sub-area sound-perception device for transmitting sound outside a vehicle, characterized by comprising: The device comprises: a transparent function opening module, configured to trigger the opening of the transparent function based on a preset input signal, and determine whether a voice interaction instruction of a user in the vehicle is received; an intelligent automatic transparent module, configured to execute an intelligent control mode when no voice instruction of a user in the vehicle is received, which is used for intelligently controlling the output of external sound by each partition and a public loudspeaker to reconstruct the sound field outside the vehicle, including: when the current vehicle speed, the sound environment in the vehicle and the sound pressure level outside the vehicle all meet the preset conditions, controlling different partitions in the vehicle to output the external sound picked up by the corresponding external area; a user intervention transparent module, configured to execute a user intervention mode after receiving the voice instruction of the user in the vehicle, which is used for directing at least one external sound pickup data to the driver and passenger in the corresponding area in the vehicle according to the intention analysis result of the voice instruction: determining the target partition in the vehicle where the user is located through acoustic positioning, and outputting the sound of the external area in the target partition in the vehicle according to the voice instruction.

7. The in-vehicle user sub-area aware outside-sound transparent device according to claim 6, characterized by, The device further comprises a transparent mode switching module, configured to switch to intelligent automatic transmission based on the voice instruction when the user intervenes in the transmission.

8. An electronic device, comprising: The device comprises: One or more processors, memories, and one or more computer programs, wherein the one or more computer programs are stored in the memories, the one or more computer programs comprising instructions, when executed by the electronic device, causing the electronic device to perform the in-vehicle user sub-area sound-perception method according to any one of claims 1-5.

9. A computer data storage medium, characterized by The computer data storage medium has stored therein a computer program, when the computer program is run on a computer, causing the computer to perform the in-vehicle user sub-area sound-perception method according to any one of claims 1-5.

Images