Abnormal noise positioning processing method and related device

Abstract

The embodiment of the application discloses a kind of in-vehicle abnormal sound positioning processing method and related device, method includes: obtaining from the abnormal sound detection request of central control display, abnormal sound detection request is generated according to the selection operation of abnormal sound detection application provided by the central control display to driver and passenger;According to abnormal sound detection request, determine the abnormal sound position to be detected;In the process of target vehicle driving, the first audio data of pickup device is obtained for the abnormal sound position to be detected and the first image data of in-vehicle camera for the abnormal sound position to be detected;According to first audio data and first image data, determine first abnormal sound position;Second instruction is sent to central control display, second instruction is used to display first abnormal sound position.The application is conducive to improving the convenience and accuracy of vehicle abnormal sound detection.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of general data processing, in particular to an in-vehicle abnormal sound positioning processing method and related device. BACKGROUND

[0002] With the popularity of automobiles, the frequency of using automobiles in our daily life is also increasing. During the use of automobiles, the comfort and safety of the automobile are required by the driver and passengers.

[0003] Currently, when an abnormal sound occurs in the vehicle, the abnormal sound position cannot be accurately positioned, and the driver and passengers usually need to go to a repair shop or a 4S store for detection and repair. However, there are problems such as long detection time and complex abnormal sound positioning when going to a repair shop or a 4S store for detection and repair. Many repair shops and 4S stores are unwilling to take the repair task of abnormal sound positioning, which makes it difficult to meet the detection needs of the driver and passengers. SUMMARY

[0004] The embodiments of the present application provide an in-vehicle abnormal sound positioning processing method and related device to improve the convenience and accuracy of vehicle abnormal sound detection.

[0005] In a first aspect, the embodiments of the present application provide an in-vehicle abnormal sound positioning processing method applied to an intelligent cockpit domain controller in a domain controller system of a target vehicle. The domain controller system includes the intelligent cockpit domain controller, a vehicle body domain controller, a plurality of sound pickup devices, a plurality of in-vehicle cameras, and a central control display screen. The vehicle body domain controller, the central control display screen, the plurality of sound pickup devices, and the plurality of in-vehicle cameras are in communication connection with the intelligent cockpit domain controller. The method includes:

[0006] Obtaining an abnormal sound detection request from the central control display screen, the abnormal sound detection request being generated according to a selection operation of an abnormal sound detection application provided by the driver and passengers for the central control display screen;

[0007] Determining a to-be-detected abnormal sound position according to the abnormal sound detection request;

[0008] During driving of the target vehicle, obtaining first audio data of the sound pickup device for the to-be-detected abnormal sound position and first image data of the in-vehicle camera for the to-be-detected abnormal sound position;

[0009] Determining a first abnormal sound position according to the first audio data and the first image data;

[0010] The second instruction is sent to the central control display screen, and the second instruction is used to display the first abnormal sound position. In a second aspect, an embodiment of the present application provides an in-vehicle abnormal sound positioning processing device, which is applied to an intelligent cabin domain controller in a domain controller system of a target vehicle. The domain controller system includes the intelligent cabin domain controller, a vehicle body domain controller, a plurality of sound pickup devices, a plurality of in-vehicle cameras, and a central control display screen. The vehicle body domain controller, the central control display screen, the plurality of sound pickup devices, and the plurality of in-vehicle cameras are in communication connection with the intelligent cabin domain controller. The method includes the following steps.

[0011] A first acquisition unit is configured to acquire an abnormal sound detection request from the central control display screen. The abnormal sound detection request is generated according to a selection operation of a driver or a passenger on an abnormal sound detection application provided by the central control display screen.

[0012] A first determination unit is configured to determine a to-be-detected abnormal sound position according to the abnormal sound detection request.

[0013] A second acquisition unit is configured to acquire first audio data of the sound pickup device for the to-be-detected abnormal sound position and first image data of the in-vehicle camera for the to-be-detected abnormal sound position during driving of the target vehicle.

[0014] A second determination unit is configured to determine a first abnormal sound position according to the first audio data and the first image data.

[0015] A sending unit is configured to send a second instruction to the central control display screen. The second instruction is used to display the first abnormal sound position.

[0016] In a third aspect, an embodiment of the present application provides an electronic device, including a processor, a memory, a communication interface, and one or more programs. The one or more programs are stored in the memory and configured to be executed by the processor. The program includes instructions for performing the steps in the first aspect of the embodiments of the present application.

[0017] In a fourth aspect, an embodiment of the present application provides a computer storage medium, which stores a computer program for electronic data exchange. The computer program causes a computer to perform some or all of the steps described in the first aspect of the embodiments.

[0018] It can be seen that in the embodiment, the intelligent cockpit domain controller in the domain controller system can obtain the abnormal sound detection request sent by the user through the central control display screen, and determine the to-be-detected abnormal sound position according to the abnormal sound detection request; then, in the process of driving the target vehicle, the intelligent cockpit domain controller obtains the first audio data of the sound pickup device for the to-be-detected abnormal sound position and the first image data of the in-vehicle camera for the to-be-detected abnormal sound position, and analyzes and determines the first abnormal sound position in combination with the first audio data and the first image data, and sends a second instruction for displaying the first abnormal sound position to the central control display screen. In this way, the driver and the passenger can detect the abnormal sound position during driving. Moreover, the application first determines the to-be-detected abnormal sound position according to the user's perception, and then calls the sound pickup device and the in-vehicle camera to obtain the audio data and the image data for the to-be-detected abnormal sound position, which can reduce the influence of sound from other positions of the vehicle on the detection result, and is conducive to improving the accuracy of abnormal sound detection. BRIEF DESCRIPTION OF DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings needed to be used in the embodiments or the prior art description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0020] Figure 1A is an architecture schematic diagram of a domain controller system provided by an embodiment of the present application;

[0021] Figure 1B is a composition example diagram of an electronic device provided by an embodiment of the present application;

[0022] Figure 2 is a flow schematic diagram of an in-vehicle abnormal sound positioning processing method provided by an embodiment of the present application;

[0023] Figure 3 is a generation process schematic diagram of an abnormal sound detection request provided by an embodiment of the present application;

[0024] Figure 4A is a functional unit composition block diagram of an in-vehicle abnormal sound positioning processing device provided by an embodiment of the present application;

[0025] Figure 4B is a functional unit composition block diagram of another in-vehicle abnormal sound positioning processing device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0026] In the following, the technical solutions in the embodiments of the present application will be described clearly and completely in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all the other embodiments obtained by a person of ordinary skill in the art without creative work fall within the scope of protection of the present application.

[0027] The terms "first", "second", and the like in the specification of the present application and the above drawings are used to distinguish different objects, rather than to describe a particular order. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device including a series of steps or units is not limited to the listed steps or units, but can optionally include steps or units not listed or can optionally include other steps or units inherent to the process, method, product or device.

[0028] Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application. The appearance of the phrase in various places in the specification does not necessarily all refer to the same embodiment, nor is it necessarily mutually exclusive of other embodiments. It is explicitly and implicitly understood by those skilled in the art that embodiments described herein can be combined with other embodiments.

[0029] The embodiments of the present application will be described below in conjunction with the drawings.

[0030] The technical solutions of the present application can be applied to a domain controller system 10 as shown in Figure 1A The domain controller system 10 includes an intelligent cabin domain controller 100, a vehicle body domain controller, an automatic driving domain controller, a power domain controller, a chassis domain controller, and a central control display screen. The intelligent cabin domain controller, the vehicle body domain controller, the automatic driving domain controller, the power domain controller, and the chassis domain controller are in communication connection with the central control display screen, and any two of the intelligent cabin domain controller, the vehicle body domain controller, the automatic driving domain controller, the power domain controller, and the chassis domain controller are in communication connection.

[0031] Specifically, the central control display screen is an external device, which can be communicatively connected with each domain controller, so as to facilitate the driver and passenger to interact with each domain controller through the central control display screen. The central control display screen provides a control application related to the function of each domain controller. The driver and passenger can trigger the control application through the central control display screen to realize information interaction with the intelligent cockpit domain controller, the vehicle body domain controller, the automatic driving domain controller, the power domain controller, and the chassis domain controller, so as to control the corresponding domain controller to provide the driver and passenger with the functions of vehicle body structure (such as vehicle window, sunroof, etc.) control, chassis structure (chassis, tire, etc.) control, driving function control, power system control, etc.

[0032] The composition structure of the electronic device in the present application can be as shown in Figure 1B The electronic device can be an electronic device intelligent cockpit domain controller, a vehicle body domain controller, an automatic driving domain controller, a power domain controller, a chassis domain controller, or a central control display screen. The electronic device can include a processor 110, a memory 120, a communication interface 130, and one or more programs 121, wherein the one or more programs 121 are stored in the above-mentioned memory 120 and are configured to be executed by the above-mentioned processor 110, and the one or more programs 121 include instructions for executing any step of the above-mentioned method embodiments.

[0033] The communication interface 130 is used to support the communication between the electronic device and other devices. The processor 110 can be a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logical blocks, units and circuits described in combination with the disclosure of the embodiments of the present application. The processor can also be a combination of computing functions, such as one or more microprocessor combinations, combinations of DSP and microprocessor, etc.

[0034] The memory 120 can be a volatile memory or a nonvolatile memory, or can include both volatile and nonvolatile memory. Among them, the nonvolatile memory can be a read-only memory (ROM), a programmable ROM (PROM), an erasable PROM (EPROM), an electrically EPROM (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM) used as an external cache. By way of example, and not limitation, many forms of random access memory (RAM) are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchlink DRAM (SLDRAM), and direct rambus RAM (DRAM).

[0035] In a specific implementation, when the electronic device is a smart cockpit domain controller, the processor 110 is configured to perform any step in the following method performed by the smart cockpit domain controller, and when performing data transmission such as sending, the communication interface 130 can be selectively called to complete the corresponding operation.

[0036] It should be noted that the structural diagram of the electronic device described above is only an example, and the specific devices contained therein can be more or less, which is not uniquely limited here.

[0037] Please refer to Figure 2 , Figure 2 is a flowchart of a method for locating abnormal noise in a vehicle provided by an embodiment of the present application. The method can be applied to a smart cockpit domain controller in a domain controller system as shown in Figure 1A The domain controller system includes the smart cockpit domain controller, a body domain controller, a plurality of sound pickup devices, a plurality of in-vehicle cameras, and a central control display screen. The body domain controller, the central control display screen, the plurality of sound pickup devices, and the plurality of in-vehicle cameras are in communication connection with the smart cockpit domain controller. As shown in Figure 2As shown, the vehicle interior abnormal noise positioning processing method comprises:

[0038] Step S210, obtaining an abnormal noise detection request from the center control display screen.

[0039] The abnormal noise detection request is generated according to the selection operation of the abnormal noise detection application provided by the driver or passenger on the center control display screen.

[0040] In a specific implementation, the center control display screen can provide multiple applications to the driver or passenger, and the user can interact with each domain controller through each application. The multiple applications include functional applications and control applications. The functional applications include video function applications, audio function applications, call function applications, etc. The control applications include abnormal noise detection applications, chassis adjustment applications, sunroof opening and closing applications, etc. The functions corresponding to the functional applications can be processed and implemented by the intelligent cockpit domain controller, that is, when the driver or passenger triggers the functional application, the center control display screen will establish communication with the intelligent cockpit domain controller for interaction. The control corresponding to the control application can be processed and implemented by the intelligent cockpit domain controller, the vehicle body domain controller, the automatic driving domain controller, the power domain controller, or the chassis domain controller. That is, when the driver or passenger triggers the control application, the center control display screen can interact with the domain controller related to the control application. For example, when the driver or passenger triggers the above-mentioned chassis adjustment application through the center control display screen, the center control display screen can interact with the chassis domain controller. It can be understood that the multiple applications respectively establish a communication relationship with the corresponding controller, so that when the driver or passenger triggers the control application, the center control display screen interacts with the corresponding domain controller.

[0041] In a specific implementation, when the driver or passenger selects the abnormal noise detection application in the main interface of the center control display screen, the display interface will be updated to the target application interface corresponding to the abnormal noise detection application. If the driver or passenger triggers the "start detection" button in the target application interface, the intelligent cockpit domain controller will receive the abnormal noise detection request from the center control display screen.

[0042] Step S220, determining the abnormal noise position to be detected according to the abnormal noise detection request.

[0043] The abnormal noise position to be detected is the position selected by the driver or passenger through the center control display screen.

[0044] In a specific implementation, the intelligent cockpit domain controller can obtain the abnormal noise position to be detected selected by the driver or passenger according to the abnormal noise detection request. The abnormal noise position to be detected is the preliminary position of the abnormal noise positioned by the driver or passenger according to his own perception.

[0045] Specifically, referring to Figure 3 , Figure 3is a generation process schematic diagram of an abnormal sound detection request provided by an embodiment of the present application. The driver or passenger can select the icon of the abnormal sound detection application on the main interface of the center control display screen, so as to jump to the target application interface of the abnormal sound detection application. The target application interface displays a position option to the driver or passenger, and the position option includes a first position such as a window, a sunroof, a floor, a trunk, a seat, etc. The user can select the corresponding position option according to the actual situation, so as to take the position option as a to-be-detected abnormal sound position. When the user selects the “start detection” button of the target application interface, the intelligent cockpit domain controller receives the abnormal sound detection request from the center control display screen.

[0046] Further, the target application interface displaying the position option to the driver or passenger can also provide a second position option for the first position, so as to further improve the accuracy of the to-be-detected abnormal sound position and improve the abnormal sound recognition efficiency. For example, if the first position is a window, the second position can be a driver's seat window, a front passenger's seat window, a second-row left window, a second-row right window, etc.

[0047] Step S230, during driving of the target vehicle, acquiring first audio data of the sound pickup device for the to-be-detected abnormal sound position and first image data of the in-vehicle camera for the to-be-detected abnormal sound position.

[0048] In a specific implementation, the intelligent cockpit domain controller can call all sound pickup devices and in-vehicle cameras to collect first audio data and first image data according to the to-be-detected abnormal sound position, so as to improve the comprehensiveness of the collected data and ensure the accuracy of the structure judgment. Alternatively, the intelligent cockpit domain controller can call part of the sound pickup devices and in-vehicle cameras to collect first audio data and first image data according to the to-be-detected abnormal sound position. The part of the sound pickup devices and in-vehicle cameras are located near the to-be-detected abnormal sound position. In this way, the data collection is more targeted, the collection and processing efficiency is improved, and the data interference is reduced, and the data processing pressure is reduced.

[0049] For example, the target vehicle can be provided with multiple groups of sound pickup devices and in-vehicle cameras along the length direction of the vehicle body, and each group of sound pickup devices and in-vehicle cameras can be provided with multiple sound pickup devices and in-vehicle cameras along the width direction of the vehicle body, so as to ensure the clarity of the collected audio data and image data. The intelligent cockpit domain controller can call at least one sound pickup device and one in-vehicle camera adjacent to the to-be-detected abnormal sound position to collect first audio data and first image data of the to-be-detected abnormal sound position.

[0050] Step S240, determining a first abnormal sound position according to the first audio data and the first image data.

[0051] The position area of the first abnormal sound position is smaller than the position area of the to-be-detected abnormal sound position, that is, the first abnormal sound position can more accurately represent the abnormal sound position.

[0052] In specific implementation, the intelligent cockpit domain controller can determine the direction of the abnormal sound and the distance from the sound pickup device according to the abnormal sound information recorded in the first audio data, and calculate the first target position according to the direction and the distance. If the first target position does not change during the driving of the target vehicle, the position of the target vehicle corresponding to the first target position is determined as the first abnormal sound position. If the first target position is detected to change during the driving of the target vehicle, the intelligent cockpit domain controller can analyze whether the state of the to-be-detected abnormal sound position of the target vehicle changes (for example, if the to-be-detected abnormal sound position is a window, the state change means that the opening and closing state of the window changes) according to the first image data. If the state of the to-be-detected abnormal sound position changes, whether the changed abnormal sound position is the same position of the target vehicle is analyzed in combination with the first image data and the ground audio data. If yes, the position is determined as the first abnormal sound position. If no, all detected positions are determined as the first abnormal sound position.

[0053] In step S250, a second instruction is sent to the central control display screen, and the second instruction is used to instruct the central control display screen to display the first abnormal sound position.

[0054] In specific implementation, when the second instruction is used to instruct the central control display screen to display the first abnormal sound position, the display area of the central control display screen can mark the first abnormal sound position in a graphical display, a textual explanation, or a combination of the graphical display and the textual explanation. The graphical display means that a model of the target vehicle is displayed in the display area of the central control display screen, and the first abnormal sound position in the model is highlighted to intuitively present the first abnormal sound position to the driver and the passenger. The textual explanation means that an explanation of the first abnormal sound position is presented in the display area of the central control display screen. If the combination of the graphical display and the textual explanation is used to mark the first abnormal sound position, the textual explanation can be located in the area close to the first abnormal sound position of the model of the vehicle, so as to facilitate the driver and the passenger to view.

[0055] Further, the domain controller system further includes an in-vehicle audio, which is in communication connection with the intelligent cockpit domain controller. The intelligent cockpit domain controller can further send a broadcast instruction to the in-vehicle audio, and the broadcast instruction is used to instruct the in-vehicle audio to broadcast the content of the above-mentioned textual explanation.

[0056] It can be seen that in the embodiment, the intelligent cockpit domain controller in the domain controller system can obtain the abnormal sound detection request sent by the user through the central control display screen, and determine the to-be-detected abnormal sound position according to the abnormal sound detection request. Then, in the process of driving the target vehicle, the first audio data of the sound pickup device for the to-be-detected abnormal sound position and the first image data of the in-vehicle camera for the to-be-detected abnormal sound position are obtained, and the first abnormal sound position is determined by combining the first audio data and the first image data, and a second instruction for displaying the first abnormal sound position is sent to the central control display screen. In this way, the driver and the passenger can detect the abnormal sound position during driving. Moreover, the application first determines the to-be-detected abnormal sound position according to the user's perception, and then calls the sound pickup device and the in-vehicle camera to obtain the audio data and the image data for the to-be-detected abnormal sound position, which can reduce the influence of sound from other positions of the vehicle on the detection result, and is conducive to improving the accuracy of abnormal sound detection.

[0057] In one possible example, if the to-be-detected abnormal sound position is the floor area or the trunk area of the vehicle body, after the second instruction is sent to the central control display screen, the method further includes: obtaining an abnormal sound confirmation request from the central control display screen, the abnormal sound confirmation request being used to represent that the driver and the passenger have completed the article arrangement action on the first abnormal sound position; obtaining second audio data of the sound pickup device for the to-be-detected abnormal sound position; determining whether the abnormal sound disappears according to the second audio data; if yes, sending a first abnormal sound detection result to the vehicle display, the first abnormal sound detection result being used to represent that the abnormal sound is an occasional abnormal sound; if no, obtaining second image data of the in-vehicle camera for the to-be-detected abnormal sound position, and determining a second abnormal sound position according to the second audio information and the second image information; comparing the positional relationship between the first abnormal sound position and the second abnormal sound position; when the first abnormal sound position and the second abnormal sound position are the same, sending a second abnormal sound detection result to the central control display screen, the second abnormal sound detection result being used to represent that the abnormal sound is a vehicle body structure abnormal sound corresponding to the first abnormal sound position; and when the first abnormal sound position and the second abnormal sound position are different, sending a fifth instruction to the central control display screen, the fifth instruction being used to instruct the central control display screen to display the second abnormal sound position.

[0058] In actual application, the causes of abnormal sound are usually two situations: foreign object impact abnormal sound or vehicle body abnormal sound. Among them, foreign object impact abnormal sound usually occurs in the floor area and the trunk area.

[0059] In a specific implementation, after the driver or passenger knows the first abnormal sound position through the central control display screen, if the first abnormal sound position is placed with an article, the driver or passenger can arrange the article, and send an abnormal sound confirmation request to the intelligent cabin domain controller through the central control display screen after the arrangement. The intelligent cabin domain controller acquires audio information of the to-be-detected abnormal sound position again, i.e., second audio data, according to the abnormal sound confirmation request through the sound pickup device. Then, the intelligent cabin domain controller determines whether the to-be-detected abnormal sound position still has an abnormal sound according to the second audio data.

[0060] Specifically, when the intelligent cabin domain controller determines that the to-be-detected abnormal sound position still has an abnormal sound according to the second audio data, the intelligent cabin domain controller can determine a second target position according to the second audio data. If the second target position determined according to the second audio data changes during driving of the target vehicle, the intelligent cabin domain controller can acquire second image data again, and determine a second abnormal sound position according to the second audio data and the second image data. Then, the intelligent cabin domain controller compares the position relationship between the first abnormal sound position and the second abnormal sound position. If the first abnormal sound position and the second abnormal sound position are the same position, it indicates that the abnormal sound at this position is not caused by foreign object impact, and the intelligent cabin domain controller can send a second abnormal sound detection result to the central control display screen, where the second abnormal sound detection result represents that the abnormal sound position is a vehicle body structure corresponding to the first abnormal sound position. If the first abnormal sound position and the second abnormal sound position are different, it indicates that the abnormal sound at the to-be-detected abnormal sound position disappears after the previous detection, i.e., the abnormal sound problem of the first abnormal sound position disappears. At this time, the intelligent cabin domain controller can send a fifth instruction to the central control display screen, where the fifth instruction is used to instruct the central control display screen to display the second abnormal sound position, so that the driver or passenger can view the second abnormal sound position. For example, if the arrangement of the driver or passenger is to move the article at the first abnormal sound position to the second abnormal sound position, the first abnormal sound position and the second abnormal sound position can be different.

[0061] Specifically, when the intelligent cabin domain controller determines that the abnormal sound at the to-be-detected abnormal sound position disappears according to the second audio data, the intelligent cabin domain controller can determine that the cause of the abnormal sound corresponding to the abnormal sound detection request is foreign object impact, and send the first abnormal sound detection result to the central control display screen to inform the driver or passenger of the cause of the abnormal sound problem.

[0062] Further, the intelligent cabin domain controller can store the first abnormal sound detection result or the second abnormal sound detection result, and recommend vehicle maintenance skills to the driver or passenger according to the second abnormal sound detection result in the detection record within a preset time period, analyze the target vehicle according to the analysis result, and recommend vehicle maintenance skills to the driver or passenger according to the analysis result.

[0063] It can be seen that in the present example, by obtaining the second audio data according to the arrangement action of the driver or passenger after determining the first abnormal sound position, it can be determined whether the abnormal sound problem has been solved. If the abnormal sound problem still exists in the second audio data, the intelligent cockpit domain controller determines the second abnormal sound position according to the second audio data and the second image data, which can further identify whether the abnormal sound is caused by the vehicle body structure problem. If not, the second abnormal sound position can be sent to the central control display screen so that the driver or passenger can go to check the second abnormal sound position, which is conducive to improving the accuracy of the abnormal sound position detection.

[0064] In one possible example, if the abnormal sound position to be detected is a sunroof area or a window area of the vehicle body, the obtaining of the first audio data of the sound pickup device for the abnormal sound position to be detected and the first image data of the in-vehicle camera for the abnormal sound position to be detected includes: obtaining first state data when the sunroof or the window is in an open state; obtaining second state data when the sunroof or the window is in a closed state; and obtaining third state data when the sunroof or the window is in a state between the open state and the closed state.

[0065] The first state data includes audio data and image data collected when the window or the sunroof is in the open state. The second state data includes audio data and image data collected when the window or the sunroof is in the closed state. The third state data includes audio data and image data collected when the window or the sunroof is in a state between the open state and the closed state.

[0066] In a specific implementation, when the driver or passenger selects the abnormal sound position to be detected as the adjustable vehicle body structure such as the window or the sunroof, the intelligent cockpit domain controller can provide the corresponding collection of the first audio data and the first image data for the specific vehicle body structure, which is a pre-stored data collection process associated with the vehicle body structure.

[0067] Specifically, if it is detected that the window or sunroof is in a closed state, the intelligent cabin domain controller can first collect second state data through the sound pickup device. Then send an opening instruction to the central control display screen, the opening instruction is used to instruct to display the first content, the first content is used to instruct the driver to open the window or sunroof. In the process of opening the window or sunroof according to the first prompt, the intelligent cabin domain controller can collect third state data through the sound pickup device again, and when the window or sunroof is converted to an open state according to the operation of the driver, the first state data is collected through the sound pickup device again. Similarly, if it is detected that the window or sunroof is in an open state, the intelligent cabin domain controller can first collect first state data through the sound pickup device. Then send a closing instruction to the central control display screen, the closing instruction is used to instruct to display the second content, the second content is used to instruct the driver to close the window or sunroof. In the process of closing the window or sunroof according to the second prompt, the intelligent cabin domain controller can collect third state data through the sound pickup device again, and when the window or sunroof is converted to a closed state according to the operation of the driver, the second state data is collected through the sound pickup device again.

[0068] It can be seen that in the present example, when the position to be detected for abnormal sound is the sunroof area or the window area of the vehicle body, the intelligent cabin domain controller collects first state data that the sunroof or window is in an open state, second state data that the sunroof or window is in a closed state, and third state data in the conversion process of the open state and the closed state through the sound pickup device. The position of the abnormal sound when the window or sunroof is in each state can be determined, thereby combining the analysis to obtain the first abnormal sound position, which is beneficial to improve the accuracy and reliability of the abnormal sound detection result.

[0069] In one possible example, after determining the position to be detected for abnormal sound according to the abnormal sound detection request, the method further comprises: obtaining an abnormal sound detection condition; determining whether the target vehicle meets the abnormal sound detection condition; if yes, performing the obtaining of the first audio data for the position to be detected for abnormal sound and the first image data for the position to be detected for abnormal sound of the in-vehicle camera; if no, sending a third instruction to the central control display screen, the third instruction being used to instruct the central control display screen to display a first prompt, the first prompt being used to instruct the driver to adjust the driving state of the target vehicle to the abnormal sound detection condition.

[0070] Among them, the abnormal sound detection condition refers to the condition under which the intelligent cabin domain controller can collect abnormal sound conditions through the sound pickup device.

[0071] In a specific implementation, there are mainly two cases of abnormal sound occurrence, one of which occurs in daily driving, and the other of which occurs only in specific situations. For the case of abnormal sound occurrence in daily driving, the abnormal sound detection condition can be automatically detected and obtained by the intelligent cabin domain controller. For the case of abnormal sound occurrence in specific situations, the abnormal sound detection condition can be generated according to the parameters set by the driver and passengers, so as to ensure the accuracy of the abnormal sound detection condition.

[0072] For example, when the abnormal sound is a case that occurs in daily driving, the abnormal sound detection condition can be that the target vehicle is in a driving state. The intelligent cabin domain controller can determine whether the target vehicle meets the abnormal sound detection condition by judging whether the target vehicle is in a driving state. Whether the target vehicle is in a driving state can be determined by whether the target vehicle is started or whether the driving speed of the target vehicle is greater than zero. When the target vehicle meets the abnormal sound detection condition, the intelligent cabin domain controller can directly call the sound pickup device and the in-vehicle camera to collect the first audio data and the first image data, respectively. When the target vehicle does not meet the abnormal sound detection condition, the intelligent cabin domain controller can send a third instruction to the central control display screen to prompt the driver and passengers to start and drive the target vehicle to change the driving state of the vehicle to meet the abnormal sound detection condition.

[0073] It can be seen that, in this example, the intelligent cabin domain controller calls the sound pickup device and the in-vehicle camera to collect the first audio data and the first image data when the target vehicle meets the abnormal sound detection condition, which can reduce the collection and storage of data unrelated to the abnormal sound, reduce the use of storage space, and reduce energy consumption. At the same time, when the driving state of the target vehicle does not meet the abnormal sound detection condition, the first prompt can timely remind the driver and passengers to change the driving state of the target vehicle, which can avoid the driver and passengers being in a state that does not meet the abnormal sound detection condition for a long time after enabling the abnormal sound detection function, and can improve the efficiency of abnormal sound detection.

[0074] In one possible example, the abnormal sound detection condition is a parameter set by the driver and passengers for abnormal sound detection environment, and the parameter includes a target vehicle driving state and a road surface bumping level. The driving state includes a driving speed and a driving direction, and the road surface state includes a road surface bumping level and a road surface slope condition.

[0075] When the abnormal sound detection condition is a parameter set by the driver and passengers for abnormal sound detection environment, the abnormal sound detection condition is an abnormal sound detection environment parameter set by the driver and passengers according to the driving condition when the abnormal sound occurs. In actual application, the intelligent cabin domain controller can collect the abnormal sound problem that the driver and passengers want to detect through the sound pickup device only when the target vehicle meets the preset monitoring condition.

[0076] The driving speed refers to the driving speed of the target vehicle when the abnormal sound occurs. The driving direction refers to the driving direction of the target vehicle when the abnormal sound occurs. The road bump level refers to the bump condition of the road on which the target vehicle travels when the abnormal sound occurs. The road slope condition refers to the slope condition of the road on which the target vehicle travels when the abnormal sound occurs. Specifically, the slope condition can include uphill, downhill, and flat road.

[0077] In the implementation, when the abnormal sound detection condition is the parameter setting of the driver for the abnormal sound detection environment, the acquisition process of the abnormal sound detection condition can be as follows: after the intelligent cockpit domain controller receives the abnormal sound detection request, the intelligent cockpit domain controller can send an information collection instruction to the central control display screen. The information collection instruction is used to instruct the central control display screen to display an information collection interface. The content of the information collection interface includes two cases of abnormal sound in daily driving and abnormal sound in specific conditions. In the case of abnormal sound in specific conditions, the driver can be collected information such as driving speed, driving direction, road bump level, and road slope condition. For example, in the information collection interface, the driver can select the corresponding information according to the content by selecting the questions corresponding to the driving speed, driving direction, road bump level, and road slope condition under the category of abnormal sound in specific conditions. After the driver fills in the information, the central control display screen sends the information to the intelligent cockpit domain controller, and the intelligent cockpit domain controller generates the abnormal sound detection condition according to the information.

[0078] Specifically, the content of the information collection can include questions about driving speed, driving direction, road bump level, and road slope condition. For example, for the driving speed, a speed range selection question can be provided, such as “driving speed: A, 0 km / h to 60 km / h, B, 60 km / h to 120 km / h, C, 120 km / h to 180 km / h”, and the like. For the driving direction, a direction selection question can be provided, such as “driving direction: A, straight, B, left turn, C, right turn, D, reverse”, and the like. For the road bump level, a bump level selection question can be provided, such as “bump level: A, level one, B, level two, C, level three, D, level four, E, level five”, and the like. In addition, the display interface of the central control display screen can also display the explanation of each bump level to facilitate the driver to distinguish. For the road slope condition, a slope state selection question can be provided, such as “road slope condition: A, uphill, B, downhill, C, flat road”, and the like.

[0079] It can be seen that, in the example, when the abnormal sound detection condition is the parameter setting of the driver for the abnormal sound detection environment, the intelligent cockpit domain controller further analyzes the abnormal sound problem by using the parameters such as driving speed, driving direction, and road bump level, which can improve the reliability of the abnormal sound detection.

[0080] In one possible example, after the sending of the second instruction to the center control display screen, the method further includes: acquiring regular abnormal sound information under the abnormal sound detection condition, the regular abnormal sound information including a regular abnormal sound position, the regular abnormal sound information being used to represent a sound that normally occurs under the abnormal sound detection condition, and the regular abnormal sound position being a position corresponding to the sound that normally occurs under the abnormal sound detection condition; comparing the first abnormal sound position and the regular abnormal sound position; if the first abnormal sound position is the same as the regular abnormal sound position, sending a fourth instruction to the center control display screen, the fourth instruction being used to instruct the center control display screen to display a second prompt, the second prompt being used to prompt the driver and passenger that the abnormal sound is caused by a regular abnormal sound; and if the first abnormal sound position is not the same as the regular abnormal sound position, executing the sending of the second instruction to the center control display screen.

[0081] The regular abnormal sound information is abnormal sound information pre-stored by the intelligent cockpit domain controller for the abnormal sound detection function, and includes possible regular abnormal sound conditions corresponding to various driving speeds, driving directions, and road roughness levels. The regular abnormal sound conditions refer to sounds that normally occur when the driving state of the target vehicle meets the abnormal sound detection condition. For example, when the abnormal sound detection condition is that the target vehicle is turning left at a driving speed of 60 km / h to 120 km / h on a road with a road roughness level of five, the regular abnormal sound information can include an abnormal sound caused by the upper edge of the rear left window colliding with the window frame. The upper edge of the rear left window is the regular abnormal sound position.

[0082] In a specific implementation, when the driving state of the target vehicle meets the abnormal sound detection condition, the intelligent cockpit domain controller can collect first audio data and first image data to determine the first abnormal sound position, and then compare the first abnormal sound position with the regular abnormal sound position under the abnormal sound detection condition. If the comparison result is that the first abnormal sound position is the same as the regular abnormal sound position under the abnormal sound detection condition, it indicates that the abnormal sound problem that the driver and passenger want to detect is a regular abnormal sound. In this case, the intelligent cockpit domain controller can send a second prompt to the center control display screen to reflect the abnormal sound detection result to the driver and passenger. If the abnormal sound detection result is a regular abnormal sound, the driver and passenger do not need to take any action in response to the abnormal sound problem. If the comparison result is that the first abnormal sound position is not the same as the regular abnormal sound position under the abnormal sound detection condition, it indicates that the abnormal sound problem that the driver and passenger want to detect is not a regular abnormal sound. In this case, the intelligent cockpit domain controller can execute the sending of the second instruction to the center control display screen, and the driver and passenger can arrange items or perform vehicle maintenance according to the first abnormal sound position indicated by the second instruction.

[0083] It can be seen that in the present example, the intelligent cockpit domain controller can distinguish the normal abnormal sound situation for the driver and passenger by comparing the first abnormal sound position and the normal abnormal sound position, so as to ensure that the driver and passenger can deal with various abnormal sound problems.

[0084] In one possible example, after determining whether the target vehicle meets the abnormal sound detection condition, the method further includes: when it is detected that the vehicle is in the starting state but does not meet the abnormal sound detection condition, sending a standby instruction to the sound pickup device and the in-vehicle camera, the standby instruction being used to control the sound pickup device and the in-vehicle camera to switch from the unused state to the standby state; and when it is detected that the vehicle meets the abnormal sound detection condition, sending an activation instruction to the sound pickup device and the in-vehicle camera, the activation instruction being used to control the sound pickup device to switch from the standby state to the used state.

[0085] The sound pickup device and the in-vehicle camera receiving the standby instruction and the activation instruction can be all sound pickup devices and in-vehicle cameras in the target vehicle, or can be part of the sound pickup devices and in-vehicle cameras near the abnormal sound position to be detected.

[0086] In a specific implementation, when the abnormal sound occurs in a specific situation, the intelligent cockpit can activate the sound pickup device and the in-vehicle camera to the standby state when the target vehicle reaches the starting state. Then, when it is detected that the driving state of the target vehicle meets the abnormal sound detection condition, the sound pickup device and the in-vehicle camera are activated from the standby state to the used state for collecting the first audio data and the first image data.

[0087] It can be seen that in the present example, the intelligent cockpit domain controller activates the sound pickup device and the in-vehicle camera to the standby state when the vehicle is in the starting state, which is beneficial to switch the sound pickup device and the in-vehicle camera to the used state for collecting the first audio data and the first image data as soon as the driving state of the target vehicle meets the abnormal sound detection condition, thereby shortening the activation time of the sound pickup device and the in-vehicle camera, improving the data collection efficiency, and ensuring the comprehensiveness of the collected data.

[0088] The present application can divide the functional units of the electronic device according to the above-mentioned method examples. For example, each functional unit can be divided according to each function, or two or more functions can be integrated into one processing unit. The integrated unit can be realized in the form of hardware or software functional unit. It should be noted that the division of units in the present application is illustrative, and is only a logical function division. In actual implementation, there can be another division method.

[0089] Figure 4AIs a kind of in-vehicle abnormal sound positioning processing device functional unit composition block diagram provided in the embodiment of the application.The in-vehicle abnormal sound positioning processing device 30 can be applied in intelligent cockpit domain controller in the domain controller system as shown in the figure, the in-vehicle abnormal sound positioning processing device 30 includes: Figure 1A

[0090] First acquisition unit 310, the first acquisition unit 310 is used to obtain from the abnormal sound detection request of central control display, the abnormal sound detection request is generated according to the selection operation of the abnormal sound detection application provided by the driver and passenger for central control display;

[0091] First determining unit 320, the first determining unit 320 is used to determine the abnormal sound position to be detected according to the abnormal sound detection request;

[0092] Second acquisition unit 330, the second acquisition unit 330 is used to obtain the first audio data of the sound pickup device for the abnormal sound position to be detected and the first image data of the in-vehicle camera for the abnormal sound position to be detected in the process of the target vehicle driving;

[0093] Second determining unit 340, the second determining unit 340 is used to determine the first abnormal sound position according to the first audio data and the first image data;

[0094] Sending unit 350, sending unit 350 is used to send the second instruction to the central control display, and the second instruction is used to display the first abnormal sound position.

[0095] ​In a possible example, if the to-be-detected abnormal sound position is a floor area or a trunk area of the vehicle body, the in-vehicle abnormal sound positioning processing apparatus 30 further includes a third acquisition unit and a third determination unit. The third acquisition unit is configured to acquire an abnormal sound confirmation request from the center control display screen after the second instruction is sent to the center control display screen. The abnormal sound confirmation request is used to indicate that the driver or passenger has completed the object arrangement action on the first abnormal sound position. The third acquisition unit is further configured to acquire second audio data of the sound pickup device for the to-be-detected abnormal sound position. The third determination unit is configured to determine whether the abnormal sound disappears according to the second audio data. If yes, a first abnormal sound detection result is sent to the vehicle-mounted display. The first abnormal sound detection result is used to indicate that the abnormal sound is an occasional abnormal sound. If no, second image data of the in-vehicle camera for the to-be-detected abnormal sound position is acquired, and a second abnormal sound position is determined according to the second audio information and the second image information. The position relationship between the first abnormal sound position and the second abnormal sound position is compared. When the first abnormal sound position and the second abnormal sound position are the same, a second abnormal sound detection result is sent to the center control display screen. The second abnormal sound detection result is used to indicate that the abnormal sound is a vehicle body structure abnormal sound corresponding to the first abnormal sound position. When the first abnormal sound position and the second abnormal sound position are different, a fifth instruction is sent to the center control display screen. The fifth instruction is used to instruct the center control display screen to display the second abnormal sound position.

[0096] In a possible example, if the to-be-detected abnormal sound position is a sunroof area or a window area of the vehicle body, the second acquisition unit is specifically configured to acquire first state data when the sunroof or the window is in an open state, acquire second state data when the sunroof or the window is in a closed state, and acquire third state data when the sunroof or the window is switched between the open state and the closed state.

[0097] In a possible example, the apparatus includes an acquisition and judgment unit. The acquisition and judgment unit is specifically configured to acquire an abnormal sound detection condition after the to-be-detected abnormal sound position is determined according to the abnormal sound detection request. It is judged whether the target vehicle meets the abnormal sound detection condition. If yes, the first audio data for the to-be-detected abnormal sound position and the first image data of the in-vehicle camera for the to-be-detected abnormal sound position are acquired. If no, a third instruction is sent to the center control display screen. The third instruction is used to instruct the center control display screen to display a first prompt. The first prompt is used to instruct the driver or passenger to adjust the driving state of the target vehicle to the abnormal sound detection condition.

[0098] In a possible example, the abnormal sound detection condition is a parameter setting of the driver for the abnormal sound detection environment, and the parameter includes a driving state and a road surface state, the driving state includes a driving speed and a driving direction, and the road surface state includes a road surface bump level and a road surface slope condition.

[0099] In a possible example, the device further includes an acquisition and comparison unit, which is specifically configured to: after the second instruction is sent to the center control display screen, acquire regular abnormal sound information under the abnormal sound detection condition, the regular abnormal sound information including a regular abnormal sound position, the regular abnormal sound information being used to represent a sound that normally occurs in the target vehicle under the abnormal sound detection condition, and the regular abnormal sound position being a position corresponding to the sound that normally occurs in the target vehicle; compare the first abnormal sound position and the regular abnormal sound position; if the first abnormal sound position is the same as the regular abnormal sound position, send a fourth instruction to the center control display screen, the fourth instruction being used to instruct the center control display screen to display a second prompt, and the second prompt being used to prompt the driver that the abnormal sound reason is a regular abnormal sound; and if the first abnormal sound position is not the same as the regular abnormal sound position, execute the sending of the second instruction to the center control display screen.

[0100] In a possible example, the device further includes an activation unit, which is specifically configured to: after it is judged whether the target vehicle meets the abnormal sound detection condition, send a standby instruction to the target sound pickup device and the in-vehicle camera when it is detected that the target vehicle is in a starting state but does not meet the abnormal sound detection condition, the standby instruction being used to control the target sound pickup device and the in-vehicle camera to switch from an unused state to a standby state; and send an activation instruction to the target sound pickup device and the in-vehicle camera when it is detected that the target vehicle meets the abnormal sound detection condition, the activation instruction being used to control the sound pickup device to switch from the standby state to a used state.

[0101] In the case of an integrated unit, a functional unit composition block diagram of the in-vehicle abnormal sound positioning processing device 40 provided by the embodiments of the present application is shown in Figure 4B In Figure 4B particular, the in-vehicle abnormal sound positioning processing device 40 includes a processing module 420 and a communication module 410. The processing module 420 is used to control and manage the actions of the in-vehicle abnormal sound positioning processing device 40, for example, the steps performed by the first acquisition unit 310, the first determination unit 320, the second acquisition unit 330, the second determination unit 340, and the sending unit 350, and / or other processes for executing the technologies described herein. The communication module 410 is used to support the interaction between the in-vehicle abnormal sound positioning processing device 40 and other devices. As Figure 4BAs shown, the in-vehicle abnormal noise positioning processing apparatus 40 can further include a storage module 430, configured to store program codes and data of the in-vehicle abnormal noise positioning processing apparatus 40.

[0102] The processing module 420 can be a processor or a controller, for example, a Central Processing Unit (CPU), a general-purpose processor, a Digital Signal Processor (DSP), an ASIC, an FPGA, or other programmable logic device, transistor logic device, hardware component, or any combination thereof. The processing module 420 can implement or execute various exemplary logical blocks, modules, and circuits described in combination with the disclosure of the embodiments of the present application. The processing module 420 can also be a combination of computing functions, for example, a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like. The communication module 410 can be a transceiver, an RF circuit, a communication interface, or the like. The storage module 430 can be a memory.

[0103] The above method embodiments involve all related content of each scene, which can be cited to the function description of the corresponding function module, and will not be described here. The above in-vehicle abnormal noise positioning processing apparatus can execute the above method embodiments. Figure 2 The steps performed by the intelligent cockpit domain controller in the in-vehicle abnormal noise positioning processing method.

[0104] The embodiments of the present application also provide a computer storage medium, which stores a computer program for electronic data exchange, and the computer program causes a computer to execute some or all steps of any method described in the above method embodiments. The computer includes an electronic device.

[0105] It should be noted that, for the above method embodiments, in order to simply describe, they are all described as a series of action combinations, but those skilled in the art should know that the present application is not limited to the action sequence described, because according to the present application, some steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should know that the embodiments described in the specification all belong to preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0106] In the above embodiments, the description of each embodiment has its own focus, and the parts not described in detail in a certain embodiment can be referred to the related description of other embodiments.

[0107] In several embodiments provided in the present application, it should be understood that the disclosed apparatus can be implemented in other manners. For example, the division of the apparatus embodiments described above is merely illustrative, and the division of the units can be changed according to actual needs. For example, the units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed mutual couplings or direct couplings or communication connections can be indirect couplings or communication connections through some interfaces, devices or units, and can be in electrical, mechanical or other forms.

[0108] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, i.e., can be located in one place, or can be distributed on multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiments.

[0109] In addition, each functional unit in each embodiment of the present application can be integrated into a processing unit, or each unit can exist physically, or two or more units can be integrated into one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0110] When the integrated unit is realized in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application essentially or the part that contributes to the prior art or the whole or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium, and includes a number of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: a U disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a mobile hard disk, a magnetic disk or an optical disk, and various media that can store program codes.

[0111] Those of ordinary skill in the art can understand that all or part of the steps of the various methods in the above embodiments can be completed by a program instructing relevant hardware, and the program can be stored in a computer readable storage medium, which can include a flash disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, etc.

[0112] The above has introduced the embodiments of the present application in detail, and the principles and implementation manners of the present application are described by applying specific examples; the above embodiment description is only used for helping to understand the method of the present application and its core idea; meanwhile, for the general technical personnel in the art, according to the idea of the present application, the specific implementation manner and application range will have changes; and according to the above, the content of the specification should not be understood as the limitation of the present application.

Claims

1. An abnormal noise in-vehicle positioning processing method characterized by comprising: An intelligent cockpit domain controller applied to a domain controller system of a target vehicle, the domain controller system comprising the intelligent cockpit domain controller, a body domain controller, a plurality of sound pickup devices, a plurality of in-vehicle cameras, and a center display screen, the body domain controller, the center display screen, the plurality of sound pickup devices, and the plurality of in-vehicle cameras being in communication connection with the intelligent cockpit domain controller; the method comprising: obtaining an abnormal sound detection request from the center display screen, the abnormal sound detection request being generated according to a selection operation of an abnormal sound detection application provided by a driver or a passenger for the center display screen; determining a to-be-detected abnormal sound position according to the abnormal sound detection request; obtaining first audio data of the sound pickup device for the to-be-detected abnormal sound position and first image data of the in-vehicle camera for the to-be-detected abnormal sound position during driving of the target vehicle; determining a first abnormal sound position according to the first audio data and the first image data; sending a second instruction to the center display screen, the second instruction being used to instruct the center display screen to display the first abnormal sound position; wherein the determining of the first abnormal sound position according to the first audio data and the first image data comprises: determining a direction of the abnormal sound and a distance between the abnormal sound and the sound pickup device according to abnormal sound information recorded in the first audio data, and calculating a first target position according to the direction and the distance; if the first target position does not change during driving of the target vehicle, a position of the target vehicle corresponding to the first target position is determined as the first abnormal sound position; if a change of the first target position is detected during driving of the target vehicle, whether a state of the to-be-detected abnormal sound position changes is analyzed according to the first image data, if the state of the to-be-detected abnormal sound position changes, whether the changed abnormal sound position is a same position of the target vehicle is analyzed in combination with the first image data and the first audio data, if yes, the same position is determined as the first abnormal sound position, if no, all detected positions are determined as the first abnormal sound position.

2. The method of claim 1, wherein, After the determining of the to-be-detected abnormal sound position according to the abnormal sound detection request, the method further comprises: obtaining an abnormal sound detection condition; judging whether the target vehicle meets the abnormal sound detection condition; if yes, executing the obtaining of the first audio data for the to-be-detected abnormal sound position and the first image data of the in-vehicle camera for the to-be-detected abnormal sound position; if no, sending a third instruction to the center display screen, the third instruction being used to instruct the center display screen to display a first prompt, the first prompt being used to instruct the driver or the passenger to adjust a driving state of the target vehicle to the abnormal sound detection condition.

3. The method of claim 2, wherein, The abnormal sound detection condition is a parameter setting of a driver or a passenger for an abnormal sound detection environment, the parameter comprising a driving state and a road surface state, the driving state comprising a driving speed and a driving direction, and the road surface state comprising a road surface bumping level and a road surface slope condition.

4. The method of claim 3, wherein, After the sending of the second instruction to the center display screen, the method further comprises: acquire normal abnormal sound information under the abnormal sound detection condition, the normal abnormal sound information comprising a normal abnormal sound position, the normal abnormal sound information being used to represent a sound normally occurring in the target vehicle under the abnormal sound detection condition, the normal abnormal sound position being a position corresponding to the sound normally occurring in the target vehicle; compare the first abnormal sound position with the normal abnormal sound position; if the first abnormal sound position is the same as the normal abnormal sound position, send a fourth instruction to the center control display screen, the fourth instruction being used to instruct the center control display screen to display a second prompt, the second prompt being used to prompt the driver and passenger that the abnormal sound is caused by a normal abnormal sound; if the first abnormal sound position is not the same as the normal abnormal sound position, execute the sending of the second instruction to the center control display screen.

5. The method of claim 2, wherein, After judging whether the target vehicle meets the abnormal sound detection condition, the method further comprises: when it is detected that the target vehicle is in a starting state but does not meet the abnormal sound detection condition, send a standby instruction to the sound pickup device and the in-vehicle camera, the standby instruction being used to control the sound pickup device and the in-vehicle camera to switch from an unused state to a standby state; when it is detected that the target vehicle meets the abnormal sound detection condition, send an activation instruction to the sound pickup device and the in-vehicle camera, the activation instruction being used to control the sound pickup device to switch from a standby state to a used state.

6. The method of claim 1, wherein, After sending the second instruction to the center control display screen, if the to-be-detected abnormal sound position is a floor area or a trunk area of the vehicle body, the method further comprises: acquire an abnormal sound confirmation request from the center control display screen, the abnormal sound confirmation request being used to represent that the driver and passenger have completed an article arrangement action on the first abnormal sound position; acquire second audio data of the sound pickup device for the to-be-detected abnormal sound position; determine whether the abnormal sound disappears according to the second audio data; if yes, send a first abnormal sound detection result to the center control display screen, the first abnormal sound detection result being used to represent that the abnormal sound is an occasional abnormal sound; if no, acquire second image data of the in-vehicle camera for the to-be-detected abnormal sound position, and determine a second abnormal sound position according to the second audio data and the second image data; compare the first abnormal sound position with the second abnormal sound position; when the first abnormal sound position is the same as the second abnormal sound position, send a second abnormal sound detection result to the center control display screen, the second abnormal sound detection result being used to represent that the abnormal sound is a vehicle body structure abnormal sound corresponding to the first abnormal sound position; when the first abnormal sound position is not the same as the second abnormal sound position, send a fifth instruction to the center control display screen, the fifth instruction being used to instruct the center control display screen to display the second abnormal sound position.

7. The method of claim 1, wherein, If the to-be-detected abnormal sound position is a sunroof area or a window area of the vehicle body, the acquiring of the first audio data of the sound pickup device for the to-be-detected abnormal sound position and the first image data of the in-vehicle camera for the to-be-detected abnormal sound position comprises: acquire first state data when the sunroof or the window is in an open state; acquire second state data when the sunroof or the window is in a closed state; acquiring third data states of the moon roof or the vehicle window transitioning between an open state and a closed state.

8. A vehicle interior abnormal noise location and processing device, characterized in that, An intelligent cockpit domain controller applied to a domain controller system of a target vehicle, the domain controller system comprising the intelligent cockpit domain controller, a body domain controller, a plurality of sound pickup devices, a plurality of in-vehicle cameras, and a center display screen, the body domain controller, the center display screen, the plurality of sound pickup devices, and the plurality of in-vehicle cameras being in communication connection with the intelligent cockpit domain controller; the device comprises: A first acquisition unit, configured to acquire a abnormal sound detection request from the center display screen, the abnormal sound detection request being generated according to a selection operation of a driver or a passenger on an abnormal sound detection application provided by the center display screen; A first determination unit, configured to determine a to-be-detected abnormal sound position according to the abnormal sound detection request; A second acquisition unit, configured to acquire first audio data of the sound pickup device for the to-be-detected abnormal sound position and first image data of the in-vehicle camera for the to-be-detected abnormal sound position during driving of the target vehicle; A second determination unit, configured to determine a first abnormal sound position according to the first audio data and the first image data; A sending unit, configured to send a second instruction to the center display screen, the second instruction being used to instruct the center display screen to display the first abnormal sound position; The second determination unit is specifically configured to: determine a direction of the abnormal sound and a distance between the abnormal sound and the sound pickup device according to abnormal sound information recorded in the first audio data, and calculate a first target position according to the direction and the distance; if the first target position does not change during driving of the target vehicle, a position of the target vehicle corresponding to the first target position is determined as the first abnormal sound position; if a change of the first target position is detected during driving of the target vehicle, whether a state of the to-be-detected abnormal sound position changes is analyzed according to the first image data, if the state of the to-be-detected abnormal sound position changes, whether a changed abnormal sound position is a same position of the target vehicle is analyzed in combination with the first image data and the first audio data, if yes, the same position is determined as the first abnormal sound position, if no, all detected positions are determined as the first abnormal sound position.

9. An electronic device, comprising: A processor, a memory, a communication interface, and one or more programs, the one or more programs being stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing steps in the method of any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, A computer program for electronic data exchange, wherein the computer program causes a computer to perform steps in the method of any one of claims 1-7.

Images