Audio position indication method and device, equipment, storage medium and program product

Abstract

The invention relates to an audio position indication method and device, equipment, a storage medium and a program product. The method comprises the following steps: performing sound source localization on a to-be-detected audio to obtain sound source position information corresponding to the to-be-detected audio; determining a target indication device corresponding to the to-be-detected audio and a device display parameter corresponding to the target indication device from the at least one candidate indication device according to the sound source position information; and controlling the target indication equipment to carry out audio position indication on the to-be-detected audio through the equipment display parameters. By adopting the method, the accurate indication of the audio position can be realized.

Description

Technical Field

[0001] The present application relates to the field of sound acquisition technology, and in particular to an audio position indication method, device, equipment, storage medium and program product. Background Art

[0002] During daily operation, substations will make certain sounds, such as the sound of switches, the sound of knife switches, or the continuous sound of transformers. These sounds contain a huge amount of information, and the operating status of the equipment can be judged based on these sounds.

[0003] The digital transformation of power grids requires multi-dimensional data perception and intelligent judgment. Currently, the coverage of safety inspections of substation power equipment is not comprehensive, relying solely on video means. To carry out multi-dimensional data perception and intelligent judgment, sound data is one of the keys. After fully taking sound data into account, the accuracy of inspections can be significantly improved. Summary of the invention

[0004] Based on this, it is necessary to provide an audio position indication method, device, equipment, storage medium and program product to address the above technical problems, which can achieve accurate indication of the audio position.

[0005] In a first aspect, the present application provides an audio position indication method, the method comprising:

[0006] Perform sound source positioning on the audio to be detected to obtain the sound source position information corresponding to the audio to be detected;

[0007] Determine, according to the sound source location information, a target indicating device corresponding to the audio to be detected and a device display parameter corresponding to the target indicating device from at least one candidate indicating device;

[0008] The control target indication device indicates the audio position of the audio to be detected through the device display parameters.

[0009] In one embodiment, according to the sound source location information, determining a target indicating device corresponding to the audio to be detected and a device display parameter corresponding to the target indicating device from at least one candidate indicating device includes:

[0010] According to the audio azimuth and the device indication direction corresponding to each candidate indication device, determine the target indication device corresponding to the audio to be detected from at least one candidate indication device; obtain the mapping relationship between the candidate pitch angles and the candidate display parameters; and determine the device display parameters corresponding to the target indication device according to the mapping relationship and the audio pitch angle.

[0011] In one embodiment, determining the device display parameter corresponding to the target indication device according to the mapping relationship and the audio pitch angle includes:

[0012] A reference pitch angle matching the audio pitch angle is determined from at least one candidate pitch angle included in the mapping relationship; and a candidate presentation parameter corresponding to the reference pitch angle in the mapping relationship is used as a device presentation parameter corresponding to the target indication device.

[0013] In one embodiment, performing sound source localization on the audio to be detected to obtain sound source position information corresponding to the audio to be detected includes:

[0014] The audio to be detected is collected by at least one preset audio collection device to obtain the target audio corresponding to each audio collection device; audio analysis is performed on the target audio corresponding to each audio collection device to obtain audio parameters corresponding to the audio to be detected; and the sound source position information corresponding to the audio to be detected is determined based on the audio parameters collected by each audio collection device.

[0015] In one embodiment, determining the sound source position information corresponding to the audio to be detected according to the audio parameters collected by each audio collection device includes:

[0016] According to the audio parameters collected by each audio collection device, the audio delay corresponding to when each audio collection device collects the audio to be detected is determined; according to the audio delay, the sound source position information corresponding to the audio to be detected is determined.

[0017] In one embodiment, collecting the audio to be detected by at least one preset audio collection device to obtain the target audio corresponding to each audio collection device includes:

[0018] The audio to be detected is collected by at least one preset audio collection device to obtain the initial audio collected by each audio collection device; according to a preset intensity threshold, the initial audio collected by each audio collection device is screened for audio intensity to obtain the target audio corresponding to each audio collection device.

[0019] In a second aspect, the present application further provides an audio position indication device, the device comprising:

[0020] A sound source localization module is used to localize the sound source of the audio to be detected and obtain the sound source position information corresponding to the audio to be detected;

[0021] A device determination module, used to determine a target indicating device corresponding to the audio to be detected and a device display parameter corresponding to the target indicating device from at least one candidate indicating device according to the sound source location information;

[0022] The position indication module is used to control the target indication device to indicate the audio position of the audio to be detected through the device display parameters.

[0023] In a third aspect, the present application further provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the following steps are implemented:

[0024] Perform sound source positioning on the audio to be detected to obtain the sound source position information corresponding to the audio to be detected;

[0025] Determine, according to the sound source location information, a target indicating device corresponding to the audio to be detected and a device display parameter corresponding to the target indicating device from at least one candidate indicating device;

[0026] The control target indication device indicates the audio position of the audio to be detected through the device display parameters.

[0027] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the following steps are implemented:

[0028] Perform sound source positioning on the audio to be detected to obtain the sound source position information corresponding to the audio to be detected;

[0029] Determine, according to the sound source location information, a target indicating device corresponding to the audio to be detected and a device display parameter corresponding to the target indicating device from at least one candidate indicating device;

[0030] The control target indication device indicates the audio position of the audio to be detected through the device display parameters.

[0031] In a fifth aspect, the present application further provides a computer program product, including a computer program, which implements the following steps when executed by a processor:

[0032] Perform sound source positioning on the audio to be detected to obtain the sound source position information corresponding to the audio to be detected;

[0033] Determine, according to the sound source location information, a target indicating device corresponding to the audio to be detected and a device display parameter corresponding to the target indicating device from at least one candidate indicating device;

[0034] The control target indication device indicates the audio position of the audio to be detected through the device display parameters.

[0035] The above-mentioned audio position indication method, device, equipment, storage medium and program product, by locating the sound source of the audio to be detected and obtaining the sound source position information corresponding to the audio to be detected, lays the foundation for making accurate audio position indication; further, according to the sound source position information, the target indication device corresponding to the audio to be detected and the device display parameters corresponding to the target indication device are determined from at least one candidate indication device, providing specific indication details for making audio position indication; then, the target indication device is controlled to indicate the audio position of the audio to be detected through the device display parameters, thereby realizing accurate indication of the audio position. This scheme provides a data basis for making accurate audio position indication by determining the sound source position information; further, by determining the target indication device and the device display parameters corresponding to the target indication device, it provides implementation details for making detailed audio position indication, and finally realizes accurate indication of the audio position. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the related technologies, the drawings required for use in the embodiments or the related technical descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0037] FIG1 is a diagram showing an application environment of an audio position indication method provided in an embodiment of the present application;

[0038] FIG2 is a diagram of a terminal device for audio position indication provided in an embodiment of the present application;

[0039] FIG3 is a schematic diagram of a flow chart of an audio position indication provided in an embodiment of the present application;

[0040] FIG4 is a schematic diagram of a process for determining a target indication device provided in an embodiment of the present application;

[0041] FIG5 is a schematic diagram of a process for determining sound source location information provided in an embodiment of the present application;

[0042] FIG6 is a schematic flow chart of another audio position indication method provided in an embodiment of the present application;

[0043] FIG7 is a structural block diagram of an audio position indication device provided in an embodiment of the present application;

[0044] FIG8 is a structural block diagram of another audio position indication device provided in an embodiment of the present application;

[0045] FIG. 9 is an internal structure diagram of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0046] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0047] The audio position indication method provided in the embodiment of the present application can be applied in the application environment shown in Figure 1. Among them, the terminal 102 communicates with the server 104 through the network. The data storage system can store the data that the server 104 needs to process. The data storage system can be integrated on the server 104, or it can be placed on the cloud or other network servers. The terminal 102 can be used to collect audio to be detected and send the collected audio to the server 104; then, the server 104 can analyze and calculate based on the received audio, and obtain the sound source position information corresponding to the audio to be detected; further, the server 104 can determine the target indication device corresponding to the audio to be detected and the device display parameters corresponding to the target indication device according to the sound source position information, and send a control instruction to the target indication device to make the target indication device make an audio position indication. Among them, the terminal 102 can be but not limited to a sound collection device, etc. The terminal 102 can also be a combination device of a camera and a microphone in Figure 2, and the combination device includes two parts, the first part is the fisheye camera body, and the second part is the fisheye lens; wherein, the microphone hole can effectively transmit the external sound to the microphone inside the device, in order to improve the accuracy of audio collection, the microphone is evenly distributed in the upper and lower layers of the fisheye camera body in the combination device, and the number of microphones can be increased or decreased accordingly according to the requirements for accuracy. The second part of the combination device is also designed with a circle of three-color lights, which can be LED (Light-Emitting Diode Light, light-emitting diode) three-color lights; wherein, the three-color lights can be photographed by the fisheye camera, thereby providing a rough indication of the audio for the monitoring personnel, and the number of three-color lights can also be adjusted according to the accuracy requirements of the sound direction to be displayed. The server 104 can be implemented by an independent server or a server cluster composed of multiple servers.

[0048] In an exemplary embodiment, as shown in FIG. 3 , a method for indicating an audio position is provided. The method is described by taking the application of the method to the server 104 in FIG. 1 as an example, and the method may include the following steps:

[0049] S301, performing sound source positioning on the audio to be detected to obtain sound source position information corresponding to the audio to be detected.

[0050] The audio to be detected may represent valid audio collected by the terminal 102; the sound source position information may include but is not limited to the audio azimuth and the audio elevation.

[0051] Optionally, the audio azimuth angle can be represented by the connecting line between the center position of the fisheye lens in terminal 102 and each three-color light; wherein, the connecting line between the center position of the fisheye lens and a certain three-color light is the initial 0 angle, then the connecting lines between the center position of the fisheye lens and other three-color lights can form an azimuth angle; the audio pitch angle can refer to the pitch angle of the center position of the fisheye lens in terminal 102 relative to the sound source.

[0052] Exemplarily, the audio to be detected can be preprocessed, such as denoising, filtering, gain adjustment, and converting the audio signal into a form for subsequent processing, such as a time domain signal or a frequency domain signal; further, the preprocessed audio to be detected can be feature extracted, and features related to the sound source position (such as arrival time difference, intensity difference, and phase difference, etc.) can be extracted; then, the extracted features can be input into a sound source localization algorithm (such as a geometry-based method or a machine learning-based method), and finally the sound source position information corresponding to the audio to be detected can be obtained, such as the azimuth and elevation angles of the sound source relative to the terminal 102.

[0053] S302: Determine, according to the sound source position information, a target indicating device corresponding to the audio to be detected and a device display parameter corresponding to the target indicating device from at least one candidate indicating device.

[0054] Among them, the device display parameters can be used to indicate the specific form of the audio position indicated by the target indication device, which may include but is not limited to color, etc., and then the color of the target indication device can be determined according to different audio pitch angles. For example, if the audio pitch angle is between [0, 30), the corresponding color is yellow; if the audio pitch angle is between [30, 60), the corresponding color is red; if the audio pitch angle is between [60, 90], the corresponding color is green.

[0055] Optionally, each candidate indicating device may represent each three-color light in Fig. 2, and the target indicating device may be at least one three-color light in Fig. 2. The indicating directions corresponding to each candidate indicating device are different.

[0056] Exemplarily, the approximate orientation of the sound source can be determined based on the audio azimuth angle in the sound source location information, and the target indication device corresponding to the sound source can be determined from at least one candidate indication device; further, the height information of the sound source can be determined based on the audio pitch angle in the sound source location information, and then the device display parameters corresponding to the target indication device can be determined to provide prompts to the technician.

[0057] S303: Control the target indication device to indicate the audio position of the audio to be detected through device display parameters.

[0058] Exemplarily, a control instruction can be sent to the target indicating device, so that the target indicating device indicates the audio position according to the device display parameters. For example, if the color in the device display parameters is red, the target indicating device lights up red to indicate that the audio position is between the audio pitch angles [30, 60). The target indicating device, sound source location information and device display parameters can also be sent to the display device to realize real-time display of information.

[0059] The above-mentioned audio position indication method, by locating the sound source of the audio to be detected and obtaining the sound source position information corresponding to the audio to be detected, lays the foundation for making accurate audio position indication; further, according to the sound source position information, the target indication device corresponding to the audio to be detected and the device display parameters corresponding to the target indication device are determined from at least one candidate indication device, providing specific indication details for making audio position indication; then, the target indication device is controlled to indicate the audio position of the audio to be detected through the device display parameters, thereby realizing accurate indication of the audio position. This scheme provides a data basis for making accurate audio position indication by determining the sound source position information; further, by determining the target indication device and the device display parameters corresponding to the target indication device, it provides implementation details for making detailed audio position indication, and finally realizes accurate indication of the audio position.

[0060] Based on the above embodiment, the embodiment of the present application explains the above embodiment S202 in detail. Specifically, the embodiment of the present application involves a process of determining a target indication device corresponding to the audio to be detected and a device display parameter corresponding to the target indication device, as shown in FIG4 , specifically including the following steps:

[0061] S401: Determine a target indicating device corresponding to the audio to be detected from at least one candidate indicating device according to the audio azimuth and the device indicating direction corresponding to each candidate indicating device.

[0062] Optionally, the candidate indicating devices form a ring structure, a center point is determined in the middle of the ring formed by the candidate indicating devices, and the line connecting a candidate indicating device and the center point is determined as the initial line with an azimuth of 0 degrees, that is, the device indication direction corresponding to the candidate indicating device is 0 degrees. Then, the lines connecting the remaining candidate indicating devices and the center point can form an angle (in the same direction) with the initial line, that is, the device indication direction corresponding to each candidate indicating device.

[0063] It should be noted that each candidate indication device can collect corresponding audio, but there is a possibility that the audio collected by some candidate indication devices is noise. Therefore, it is necessary to filter the audio collected by each candidate indication device and only keep the candidate indication devices that ensure the presence of sound source related information in the audio to ensure the high quality of the audio information.

[0064] Exemplarily, the screened candidate indicating devices are candidate indicating device 1, candidate indicating device 2, candidate indicating device 3, and candidate indicating device 4 respectively; correspondingly, the device indicating directions corresponding to candidate indicating device 1 is S1, the device indicating direction corresponding to candidate indicating device 2 is S2, the device indicating direction corresponding to candidate indicating device 3 is S3, and the device indicating direction corresponding to candidate indicating device 4 is S4; further, the audio azimuth angle S0 can be compared with the device indicating directions corresponding to each candidate indicating device. If S2 < S0 < S3, it can be determined that the sound source is located between the azimuths of candidate indicating device 2 and candidate indicating device 3; furthermore, candidate indicating device 2 and candidate indicating device 3 can be directly determined as the target indicating devices corresponding to the audio to be detected.

[0065] S402, obtain the mapping relationship between the candidate pitch angles and the candidate display parameters.

[0066] Exemplarily, the mapping relationship between the candidate pitch angles and the candidate display parameters can be preset; for example, the candidate pitch angles can be preset as 30 degrees, 60 degrees, and 90 degrees, the candidate display parameters are red, yellow, and green. The candidate pitch angle of 30 degrees is mapped to the candidate display parameter "red", the candidate pitch angle of 60 degrees is mapped to the candidate display parameter "yellow", and the candidate pitch angle of 90 degrees is mapped to the candidate display parameter "green".

[0067] S403, determine the device display parameter corresponding to the target indicating device according to the mapping relationship and the audio pitch angle.

[0068] One implementation method is to determine a reference pitch angle that matches the audio pitch angle from at least one candidate pitch angle included in the mapping relationship; use the candidate display parameter corresponding to the reference pitch angle in the mapping relationship as the device display parameter corresponding to the target indicating device.

[0069] As in the above example, if the audio pitch angle is 40 degrees, a reference pitch angle that matches the audio pitch angle of 40 degrees can be selected from the candidate pitch angles of 30 degrees, 60 degrees, and 90 degrees. For example, if 30 degrees ≤ 40 degrees < 60 degrees, it can be determined that the reference pitch angle that matches the audio pitch angle of 40 degrees is 30 degrees; further, use the candidate display parameter "red" corresponding to 30 degrees in the mapping relationship as the device display parameter corresponding to the target indicating device.

[0070] Another implementation method is to directly input the mapping relationship and the audio pitch angle into a parameter determination model. The parameter determination model analyzes based on the mapping relationship and the audio pitch angle, and finally determines the device display parameter corresponding to the target indicating device.

[0071] In an embodiment of the present application, by pre-setting the device indication direction corresponding to each candidate indication device and the mapping relationship between the candidate pitch angles and the candidate display parameters, a basis is provided for determining the target indication device and the device display parameters corresponding to the target indication device according to the audio azimuth and the audio pitch angle.

[0072] Based on the above embodiment, the present embodiment of the present application explains the above embodiment S201 in detail. Specifically, the process of obtaining the sound source position information corresponding to the audio to be detected in the present embodiment of the present application, as shown in FIG5, specifically includes the following steps:

[0073] S501, collecting audio to be detected by at least one preset audio collection device to obtain target audio corresponding to each audio collection device.

[0074] The target audio may refer to the audio that meets the audio intensity requirement and is collected on-site by an audio collection device.

[0075] One implementable method is to collect the audio to be detected by at least one preset audio collection device to obtain the initial audio collected by each audio collection device; according to a preset intensity threshold, the initial audio collected by each audio collection device is screened for audio intensity to obtain the target audio corresponding to each audio collection device.

[0076] Exemplarily, the audio to be detected on site can be collected by pre-prepared audio collection devices (pre-arranged at a specific location), so that the initial audio collected by each audio collection device, which may include environmental noise and / or sound source audio, can be obtained; further, the collected initial audio can be compared with a preset intensity threshold, the initial audio with an audio intensity greater than the intensity threshold can be retained, and meaningless background noise can be filtered out, thereby obtaining the target audio corresponding to each audio collection device.

[0077] Another possible implementation method is to directly input the initial audio collected by each audio acquisition device into the audio screening model, and the audio screening model will screen the collected initial audio, eliminate useless information, and finally obtain the target audio corresponding to each audio acquisition device.

[0078] S502: Perform audio analysis on the target audio corresponding to each audio acquisition device to obtain audio parameters corresponding to the audio to be detected.

[0079] The audio parameters may represent parameters of the audio characteristics to be detected, such as sampling frequency, number of channels and number of quantization bits, bit rate and signal-to-noise ratio, etc.

[0080] For example, if the target audio corresponding to the audio acquisition device 1 is x1(t), and the target audio corresponding to the audio acquisition device 2 is x2(t), the target audio can be expressed as:

[0081]

[0082] Among them, s(t) is the sound source signal, n1(t) and n2(t) are both environmental noise, τ1 is the propagation delay of the sound source signal from the sound source to the audio acquisition device 1, τ2 is the propagation delay of the sound source signal from the sound source to the audio acquisition device 2, α1 is the propagation attenuation factor of the sound source signal from the sound source to the audio acquisition device 1, and α2 is the propagation attenuation factor of the sound source signal from the sound source to the audio acquisition device 2.

[0083] Furthermore, the target audio x1(t) and x2(t) can be analyzed through time domain analysis, frequency domain analysis, signal-to-noise ratio analysis, distortion analysis and other parameter analysis, and finally the audio parameters corresponding to the audio to be detected can be obtained.

[0084] S503: Determine the sound source position information corresponding to the audio to be detected according to the audio parameters collected by each audio collection device.

[0085] One implementable method is to determine the audio delay corresponding to when each audio acquisition device acquires the audio to be detected based on the audio parameters acquired by each audio acquisition device; and determine the sound source position information corresponding to the audio to be detected based on the audio delay.

[0086] As shown in the above example, the target audio x1(t) and x2(t) can be further analyzed based on the audio parameters collected by each audio collection device and through a cross-correlation algorithm; optionally, the cross-correlation algorithm between the target audio x1(t) and x2(t) can be expressed as:

[0087] )

[0088] Where E represents the expected value, t represents the time, It represents the time delay between the sound source signal propagating from the sound source S to the audio acquisition device 1 and to the audio acquisition device 2. Furthermore, the above formula can be substituted into the signal receiving model to obtain:

[0089] Since s(t) and n1(t) are independent of each other, the above formula can be simplified to:

[0090]

[0091] Among them, τ 12 =τ1-τ2, assuming that n1 and n2 are uncorrelated Gaussian white noise, the above formula can be further simplified as:

[0092] From the properties of the correlation function, we know that when τ 12=τ1-τ2, R x1x2 (τ) takes the maximum value and is the time delay between the two microphones.

[0093] Furthermore, based on the relationship between the cross-correlation function and the cross-power spectrum, the cross-correlation algorithm between the target audio x1(t) and x2(t) can be transformed as follows:

[0094]

[0095] in, It can represent the cross power spectral density between the target audio x1(t) and x2(t); It is obtained by Fourier transforming x1(t); It is obtained by Fourier transforming x2(t).

[0096] Finally, perform inverse Fourier transform to obtain the generalized cross-correlation function , as follows:

[0097]

[0098] in, represents the frequency domain weighting function.

[0099] It should be noted that the embodiment of the present application also performs windowing and framing on the target audio collected by each audio acquisition device, and performs Fourier transform to extract sub-band spectrum features for sound detection; if the data block is detected as a non-characteristic sound, the noise spectrum of the multi-channel data is updated separately, as shown in the following formula:

[0100]

[0101] in, are the noise spectrum of the ith data block of the nth audio acquisition device, It is the signal spectrum of the i-th data block of the n-th audio acquisition device.

[0102] If the data block is detected as a characteristic sound, the signal-to-noise ratio of each channel and each frequency point is calculated in the frequency domain as follows:

[0103]

[0104] in, is the signal-to-noise ratio of the i-th data block of the n-th audio acquisition device, and the amplitude spectrum is corrected according to the signal-to-noise ratio. The correction process is as follows:

[0105]

[0106] Furthermore, the azimuth angle can be divided into q regions, and these regions are searched to determine their geometric centers, thereby constructing the corresponding spatial spectrum. Furthermore, m maximum values ​​can be screened out from the spatial spectrum, and the m maximum spatial spectra and the geometric center angles corresponding to the m maximum spatial spectra are recorded. Furthermore, a more precise search is performed on the regions where the m geometric centers are located to form a more detailed spatial spectrum, and peak detection is performed, and the angles corresponding to the peaks are saved. Finally, the spatial spectra corresponding to these peaks are compared with the m maximum spatial spectra previously saved to determine the largest spatial spectrum; finally, based on the largest spatial spectrum, the audio azimuth angle in the final sound source position information is determined.

[0107] Accordingly, the pitch angle can be divided into p regions, and after obtaining the pitch angle data, these regions are searched to determine their geometric centers, thereby constructing the corresponding spatial spectrum. Subsequently, p maximum values ​​can be identified from the spatial spectrum, and these p maximum values ​​and their corresponding geometric center pitch angles are recorded and saved. Then, a more detailed search is performed on the regions where the p geometric centers are located to generate a more accurate spatial spectrum, and peak detection is performed, and the pitch angle corresponding to the peak is saved. Finally, the spatial spectra corresponding to these peaks are compared with the previously saved p spatial spectra to determine the largest spatial spectrum. Finally, based on the maximum spatial spectrum, the audio pitch angle in the final sound source position information is determined.

[0108] Another possible implementation method is to directly input the audio parameters collected by each audio collection device into the position determination model, and the position determination model analyzes them and finally determines the sound source position information corresponding to the audio to be detected.

[0109] In the embodiment of the present application, by determining the audio parameters of the target audio collected by the audio collection device, a multi-angle analysis is provided for determining the sound source position information, thereby ensuring the accuracy of the sound source position information.

[0110] Based on the above embodiment, this embodiment provides an optional example of an audio position indication method. As shown in FIG6 , the specific implementation process is as follows:

[0111] S601: collect audio to be detected by using at least one preset audio collection device to obtain initial audio collected by each audio collection device.

[0112] S602: Perform audio intensity screening on the initial audio collected by each audio collection device according to a preset intensity threshold, to obtain target audio corresponding to each audio collection device.

[0113] S603: Perform audio analysis on the target audio corresponding to each audio acquisition device to obtain audio parameters corresponding to the audio to be detected.

[0114] S604: Determine, according to the audio parameters collected by each audio collection device, the audio delay corresponding to when each audio collection device collects the audio to be detected.

[0115] S605: Determine the sound source position information corresponding to the audio to be detected according to the audio delay.

[0116] S606: Determine a target indicating device corresponding to the audio to be detected from at least one candidate indicating device according to the audio azimuth and the device indicating directions corresponding to the candidate indicating devices.

[0117] Among them, if the indication directions corresponding to the candidate indication devices are different, the sound source position information includes the audio azimuth and the audio pitch angle.

[0118] S607: Obtain a mapping relationship between candidate pitch angles and candidate display parameters.

[0119] S608: Determine a reference pitch angle that matches the audio pitch angle from at least one candidate pitch angle included in the mapping relationship.

[0120] S609: Use the candidate display parameter corresponding to the reference pitch angle in the mapping relationship as the device display parameter corresponding to the target indication device.

[0121] The specific process of the above S601-S609 can refer to the description of the above method embodiment, and its implementation principle and technical effect are similar, which will not be repeated here.

[0122] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0123] Based on the same inventive concept, the embodiment of the present application also provides an audio position indication device for implementing the audio position indication method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more audio position indication device embodiments provided below can refer to the limitations of the audio position indication method above, and will not be repeated here.

[0124] In an exemplary embodiment, as shown in FIG7 , an audio position indication device 1 is provided, comprising: a sound source localization module 10, a device determination module 20 and a position indication module 30, wherein:

[0125] The sound source localization module 10 is used to localize the sound source of the audio to be detected and obtain the sound source position information corresponding to the audio to be detected.

[0126] The device determination module 20 is used to determine the target indicating device corresponding to the audio to be detected and the device display parameters corresponding to the target indicating device from at least one candidate indicating device according to the sound source position information.

[0127] The position indication module 30 is used to control the target indication device to indicate the audio position of the audio to be detected through the device display parameters.

[0128] In one embodiment, the device determination module 20 is specifically configured to:

[0129] According to the audio azimuth and the device indication direction corresponding to each candidate indication device, determine the target indication device corresponding to the audio to be detected from at least one candidate indication device; obtain the mapping relationship between the candidate pitch angles and the candidate display parameters; and determine the device display parameters corresponding to the target indication device according to the mapping relationship and the audio pitch angle.

[0130] In one embodiment, the device determination module 20 is further configured to:

[0131] A reference pitch angle matching the audio pitch angle is determined from at least one candidate pitch angle included in the mapping relationship; and a candidate presentation parameter corresponding to the reference pitch angle in the mapping relationship is used as a device presentation parameter corresponding to the target indication device.

[0132] In one embodiment, as shown in FIG8 , the sound source localization module 10 specifically further includes:

[0133] The collection unit 11 is used to collect the audio to be detected through at least one preset audio collection device to obtain the target audio corresponding to each audio collection device.

[0134] The analysis unit 12 is used to perform audio analysis on the target audio corresponding to each audio acquisition device to obtain audio parameters corresponding to the audio to be detected.

[0135] The determination unit 13 is used to determine the sound source position information corresponding to the audio to be detected according to the audio parameters collected by each audio collection device.

[0136] In one embodiment, the determining unit 13 is further configured to:

[0137] According to the audio parameters collected by each audio collection device, the audio delay corresponding to when each audio collection device collects the audio to be detected is determined; according to the audio delay, the sound source position information corresponding to the audio to be detected is determined.

[0138] In one embodiment, the collection unit 11 is further configured to:

[0139] The audio to be detected is collected by at least one preset audio collection device to obtain the initial audio collected by each audio collection device; according to a preset intensity threshold, the initial audio collected by each audio collection device is screened for audio intensity to obtain the target audio corresponding to each audio collection device.

[0140] Each module in the above-mentioned audio position indication device can be implemented in whole or in part by software, hardware or a combination thereof. Each of the above-mentioned modules can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each of the above modules.

[0141] In an exemplary embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be shown in FIG9. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. The processor, the memory and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store audio data. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, an audio position indication method is implemented.

[0142] Those skilled in the art will understand that the structure shown in FIG. 9 is merely a block diagram of a partial structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0143] In an exemplary embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the following steps are implemented:

[0144] Perform sound source positioning on the audio to be detected to obtain the sound source position information corresponding to the audio to be detected;

[0145] Determine, according to the sound source location information, a target indicating device corresponding to the audio to be detected and a device display parameter corresponding to the target indicating device from at least one candidate indicating device;

[0146] The control target indication device indicates the audio position of the audio to be detected through the device display parameters.

[0147] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0148] According to the audio azimuth and the device indication direction corresponding to each candidate indication device, determine the target indication device corresponding to the audio to be detected from at least one candidate indication device; obtain the mapping relationship between the candidate pitch angles and the candidate display parameters; and determine the device display parameters corresponding to the target indication device according to the mapping relationship and the audio pitch angle.

[0149] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0150] A reference pitch angle matching the audio pitch angle is determined from at least one candidate pitch angle included in the mapping relationship; and a candidate presentation parameter corresponding to the reference pitch angle in the mapping relationship is used as a device presentation parameter corresponding to the target indication device.

[0151] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0152] The audio to be detected is collected by at least one preset audio collection device to obtain the target audio corresponding to each audio collection device; audio analysis is performed on the target audio corresponding to each audio collection device to obtain audio parameters corresponding to the audio to be detected; and the sound source position information corresponding to the audio to be detected is determined based on the audio parameters collected by each audio collection device.

[0153] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0154] According to the audio parameters collected by each audio collection device, the audio delay corresponding to when each audio collection device collects the audio to be detected is determined; according to the audio delay, the sound source position information corresponding to the audio to be detected is determined.

[0155] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0156] The audio to be detected is collected by at least one preset audio collection device to obtain the initial audio collected by each audio collection device; according to a preset intensity threshold, the initial audio collected by each audio collection device is screened for audio intensity to obtain the target audio corresponding to each audio collection device.

[0157] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

[0158] Perform sound source positioning on the audio to be detected to obtain the sound source position information corresponding to the audio to be detected;

[0159] Determine, according to the sound source location information, a target indicating device corresponding to the audio to be detected and a device display parameter corresponding to the target indicating device from at least one candidate indicating device;

[0160] The control target indication device indicates the audio position of the audio to be detected through the device display parameters.

[0161] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0162] According to the audio azimuth and the device indication direction corresponding to each candidate indication device, determine the target indication device corresponding to the audio to be detected from at least one candidate indication device; obtain the mapping relationship between the candidate pitch angles and the candidate display parameters; and determine the device display parameters corresponding to the target indication device according to the mapping relationship and the audio pitch angle.

[0163] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0164] A reference pitch angle matching the audio pitch angle is determined from at least one candidate pitch angle included in the mapping relationship; and a candidate presentation parameter corresponding to the reference pitch angle in the mapping relationship is used as a device presentation parameter corresponding to the target indication device.

[0165] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0166] The audio to be detected is collected by at least one preset audio collection device to obtain the target audio corresponding to each audio collection device; audio analysis is performed on the target audio corresponding to each audio collection device to obtain audio parameters corresponding to the audio to be detected; and the sound source position information corresponding to the audio to be detected is determined based on the audio parameters collected by each audio collection device.

[0167] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0168] According to the audio parameters collected by each audio collection device, the audio delay corresponding to when each audio collection device collects the audio to be detected is determined; according to the audio delay, the sound source position information corresponding to the audio to be detected is determined.

[0169] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0170] The audio to be detected is collected by at least one preset audio collection device to obtain the initial audio collected by each audio collection device; according to a preset intensity threshold, the initial audio collected by each audio collection device is screened for audio intensity to obtain the target audio corresponding to each audio collection device.

[0171] In one embodiment, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the following steps:

[0172] Perform sound source positioning on the audio to be detected to obtain the sound source position information corresponding to the audio to be detected;

[0173] Determine, according to the sound source location information, a target indicating device corresponding to the audio to be detected and a device display parameter corresponding to the target indicating device from at least one candidate indicating device;

[0174] The control target indication device indicates the audio position of the audio to be detected through the device display parameters.

[0175] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0176] According to the audio azimuth and the device indication direction corresponding to each candidate indication device, determine the target indication device corresponding to the audio to be detected from at least one candidate indication device; obtain the mapping relationship between the candidate pitch angles and the candidate display parameters; and determine the device display parameters corresponding to the target indication device according to the mapping relationship and the audio pitch angle.

[0177] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0178] A reference pitch angle matching the audio pitch angle is determined from at least one candidate pitch angle included in the mapping relationship; and a candidate presentation parameter corresponding to the reference pitch angle in the mapping relationship is used as a device presentation parameter corresponding to the target indication device.

[0179] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0180] The audio to be detected is collected by at least one preset audio collection device to obtain the target audio corresponding to each audio collection device; audio analysis is performed on the target audio corresponding to each audio collection device to obtain audio parameters corresponding to the audio to be detected; and the sound source position information corresponding to the audio to be detected is determined based on the audio parameters collected by each audio collection device.

[0181] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0182] According to the audio parameters collected by each audio collection device, the audio delay corresponding to when each audio collection device collects the audio to be detected is determined; according to the audio delay, the sound source position information corresponding to the audio to be detected is determined.

[0183] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0184] The audio to be detected is collected by at least one preset audio collection device to obtain the initial audio collected by each audio collection device; according to a preset intensity threshold, the initial audio collected by each audio collection device is screened for audio intensity to obtain the target audio corresponding to each audio collection device.

[0185] It should be noted that the information (including but not limited to device information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0186] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.

[0187] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0188] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. An audio position indication method, characterized in that: The method comprises: Performing sound source positioning on the audio to be detected to obtain the sound source position information corresponding to the audio to be detected; Determine, according to the sound source location information, a target indicating device corresponding to the audio to be detected and a device display parameter corresponding to the target indicating device from at least one candidate indicating device; The target indication device is controlled to indicate the audio position of the audio to be detected through the device display parameters.

2. The method according to claim 1, characterized in that If the indication directions corresponding to the candidate indication devices are different; the sound source position information includes an audio azimuth angle and an audio pitch angle; Correspondingly, determining the target indicating device corresponding to the audio to be detected and the device display parameter corresponding to the target indicating device from at least one candidate indicating device according to the sound source position information includes: Determine, from at least one candidate indicating device, a target indicating device corresponding to the audio to be detected; according to the audio azimuth and the device indicating direction corresponding to each of the candidate indicating devices; Obtaining a mapping relationship between candidate pitch angles and candidate display parameters; According to the mapping relationship and the audio pitch angle, a device display parameter corresponding to the target indication device is determined.

3. The method according to claim 2, characterized in that The determining, according to the mapping relationship and the audio pitch angle, a device display parameter corresponding to the target indication device includes: Determine a reference pitch angle matching the audio pitch angle from at least one candidate pitch angle included in the mapping relationship; The candidate display parameter corresponding to the reference pitch angle in the mapping relationship is used as the device display parameter corresponding to the target indication device.

4. The method according to claim 1, characterized in that: The method of performing sound source positioning on the audio to be detected to obtain the sound source position information corresponding to the audio to be detected includes: The audio to be detected is collected by at least one preset audio collection device to obtain target audio corresponding to each of the audio collection devices; Performing audio analysis on the target audio corresponding to each of the audio acquisition devices to obtain audio parameters corresponding to the audio to be detected; The sound source position information corresponding to the audio to be detected is determined according to the audio parameters collected by each of the audio collection devices.

5. The method according to claim 4, characterized in that The step of determining the sound source position information corresponding to the audio to be detected according to the audio parameters collected by each of the audio collection devices includes: Determine, according to the audio parameters collected by each of the audio collection devices, the audio delay corresponding to when each of the audio collection devices collects the audio to be detected; According to the audio delay, the sound source position information corresponding to the audio to be detected is determined.

6. The method according to claim 4, characterized in that The step of collecting the audio to be detected by at least one preset audio collection device to obtain target audio corresponding to each of the audio collection devices includes: The audio to be detected is collected by at least one preset audio collection device to obtain initial audio collected by each of the audio collection devices; According to a preset intensity threshold, the initial audio collected by each of the audio collection devices is screened for audio intensity to obtain the target audio corresponding to each of the audio collection devices.

7. An audio position indicating device, characterized in that: The device comprises: A sound source localization module, used to localize the sound source of the audio to be detected and obtain the sound source position information corresponding to the audio to be detected; A device determination module, configured to determine, from at least one candidate indicating device, a target indicating device corresponding to the audio to be detected and a device display parameter corresponding to the target indicating device according to the sound source location information; The position indication module is used to control the target indication device to indicate the audio position of the audio to be detected through the device display parameters.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Images