Method and apparatus for configuring microphone array system, computer device, storage medium and program product

Abstract

Disclosed in the present application are a method and apparatus for configuring a microphone array system, a computer device, a storage medium and a program product, the method comprising: generating a configuration interface, the configuration interface comprising a system configuration space matching a physical space where a microphone array system is installed, and the physical space comprising a target sound capture area; on the basis of a test audio that is produced by a sound source in the target sound capture area and detected by at least one microphone array apparatus, determining orientation information of the sound source; mapping the orientation information to the system configuration space, and generating a sound source identifier; and generating in the system configuration space a sound source area corresponding to the sound source identifier. The whole process of the method for configuring a microphone array system of the present application does not require precise measurement of exact coordinates of a target sound capture area in a physical space, thereby avoiding the problem of inaccurate delineation of sound pickup areas caused by measurement errors.

Description

Array microphone system configuration methods, apparatus, computer equipment, storage media and software products

[0001] Cross-references to related applications

[0002] This application is based on and claims priority to Chinese Patent Application No. 202411554182.7, filed on November 1, 2024, the entire contents of which are incorporated herein by reference. Technical Field

[0003] This application relates to the field of array microphone technology, and in particular to an array microphone system configuration method, apparatus, computer equipment, storage medium and program product. Background Technology

[0004] Array microphone devices are increasingly used in physical spaces such as conference rooms, lecture halls, and classrooms for sound pickup, amplification, and remote conferencing. Array microphone devices can be pre-configured to directionally pick up sound from specific locations (e.g., seats) within a conference room. However, the inventors have found that related technologies rely on two main issues during implementation. First, precise measurement of the coordinates of the specific locations requiring directional sound pickup within the physical space can lead to incorrect sound pickup zone division if measurement errors occur. Second, since speakers may be sitting, standing, or leaning to one side while speaking in a particular position (e.g., in a seat), experienced engineers are needed to map the spatial coordinates of the configuration tool to the physical spatial coordinates of the conference room to plan a reasonable pickup zone. Therefore, there is an urgent need for a solution that can accurately and efficiently configure the pickup area of ​​array microphone devices.

[0005] Summary of the Invention

[0006] This application provides an array microphone system configuration method, apparatus, computer device, storage medium, and program product to at least solve one of the above-mentioned technical problems.

[0007] In a first aspect, embodiments of this application provide a method for configuring an array microphone system, the array microphone system including at least one array microphone device, the method comprising:

[0008] A configuration interface is generated, which includes a system configuration space that matches the physical space where the array microphone system is installed; the physical space includes the target sound pickup area.

[0009] Based on the test audio emitted by the sound source in the target sound reception area detected by the at least one array microphone device, the directional information of the sound source is determined;

[0010] The location information is mapped to the system configuration space, and a sound source identifier is generated;

[0011] A sound source region corresponding to the sound source identifier is generated in the system configuration space.

[0012] In some embodiments, the test audio includes multiple test audio segments emitted by a sound source at different locations in the target reception area;

[0013] Determining the directional information of the sound source based on the test audio emitted by the sound source in the target sound reception area detected by the at least one array microphone device includes: determining multiple sub-directional information of the sound source based on the multiple test audio segments.

[0014] In some embodiments, mapping the azimuth information to the system configuration space and generating sound source identifiers includes: mapping the plurality of sub-azimuth information to the system configuration space and generating a plurality of sub-sound source identifiers;

[0015] Generating a sound source region corresponding to the sound source identifier in the system configuration space includes: generating a sound source region in the system configuration space that at least partially covers the plurality of sub-sound source identifiers.

[0016] In some embodiments, mapping the orientation information to the system configuration space and generating a sound source identifier includes:

[0017] Based on the azimuth information and the absolute coordinates of the array microphones of the at least one array microphone device in the physical space, the absolute coordinates of the sound source in the physical space are calculated.

[0018] Based on the mapping relationship between the physical space and the system configuration space, the absolute coordinates of the sound source are mapped to the system configuration space, and a sound source identifier is generated.

[0019] In some embodiments, at least one array microphone device includes a master array microphone device and a slave array microphone device; the azimuth information includes master azimuth information and slave azimuth information;

[0020] Mapping the location information to the system configuration space and generating a sound source identifier includes:

[0021] Based on the main orientation information and the absolute coordinates of the first array microphone of the main array microphone device in the physical space, the absolute coordinates of the first sound source in the physical space are calculated.

[0022] Based on the subordinate directional information and the absolute coordinates of the second array microphone of the subordinate array microphone device in the physical space, the absolute coordinates of the second sound source in the physical space are calculated.

[0023] The absolute coordinates of the first and second sound sources with the higher confidence level are taken as the absolute coordinates of the sound source.

[0024] Based on the mapping relationship between the physical space and the system configuration space, the absolute coordinates of the sound source are mapped to the system configuration space, and a sound source identifier is generated.

[0025] Secondly, this application also provides an array microphone system configuration device, characterized in that the array microphone system includes at least one array microphone device, the device comprising:

[0026] An interface generation module is used to generate a configuration interface, which includes a system configuration space that matches the physical space where the array microphone system is installed; the physical space includes a target sound pickup area.

[0027] A directional determination module is used to determine the directional information of the sound source based on the test audio emitted by the sound source in the target sound receiving area detected by the at least one array microphone device.

[0028] The identifier generation module is used to map the location information to the system configuration space and generate a sound source identifier;

[0029] The region generation module is used to generate a sound source region corresponding to the sound source identifier in the system configuration space.

[0030] In some embodiments, the test audio includes multiple test audio segments emitted by a sound source at different locations in the target reception area;

[0031] Determining the directional information of the sound source based on the test audio emitted by the sound source in the target sound reception area detected by the at least one array microphone device includes: determining multiple sub-directional information of the sound source based on the multiple test audio segments.

[0032] In some embodiments, mapping the azimuth information to the system configuration space and generating sound source identifiers includes: mapping the plurality of sub-azimuth information to the system configuration space and generating a plurality of sub-sound source identifiers;

[0033] Generating a sound source region corresponding to the sound source identifier in the system configuration space includes: generating a sound source region in the system configuration space that at least partially covers the plurality of sub-sound source identifiers.

[0034] In some embodiments, mapping the orientation information to the system configuration space and generating a sound source identifier includes:

[0035] Based on the azimuth information and the absolute coordinates of the array microphones of the at least one array microphone device in the physical space, the absolute coordinates of the sound source in the physical space are calculated.

[0036] Based on the mapping relationship between the physical space and the system configuration space, the absolute coordinates of the sound source are mapped to the system configuration space, and a sound source identifier is generated.

[0037] Thirdly, this application also provides a computer device, including a memory, a processor, and a computer program stored in the memory, characterized in that the processor executes the computer program to implement the steps of the configuration method described in any embodiment of this application.

[0038] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program / instructions thereon, characterized in that the computer program / instructions, when executed by a processor, implement the steps of the configuration method described in any embodiment of this application.

[0039] Fifthly, embodiments of this application provide a computer program product, including a computer program / instructions, characterized in that, when the computer program / instructions are executed by a processor, they implement the steps of the configuration method described in any embodiment of this application.

[0040] The beneficial effects of this application's embodiments are as follows: A test audio is emitted from a sound source in the target reception area, and the corresponding test audio is picked up by an array microphone device. Then (e.g., using a sound source localization method), the directional information of the sound source is determined based on this audio. This directional information is further mapped to the system configuration space to generate a sound source identifier. Finally, a sound source area corresponding to the sound source identifier is generated in the system configuration space as the pickup area. The entire process does not require precise measurement of the target reception area's exact coordinates in physical space, avoiding the problem of inaccurate pickup area division caused by measurement errors. Attached Figure Description

[0041] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0042] Figure 1 is a flowchart of an embodiment of the array microphone system configuration method of this application;

[0043] Figure 2 is a flowchart of another embodiment of the array microphone system configuration method of this application;

[0044] Figure 3 is a flowchart of another embodiment of the array microphone system configuration method of this application;

[0045] Figure 4 is a schematic diagram of an embodiment of the configuration interface in this application;

[0046] Figure 5 is a schematic block diagram of an embodiment of the array microphone system configuration device of this application;

[0047] Figure 6 is a schematic diagram of the structure of an embodiment of the computer device of this application. Detailed Implementation

[0048] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application. It should be noted that, unless otherwise specified, the embodiments and features in the embodiments of this application can be combined with each other.

[0049] It should also be noted that, in this document, the terms "comprising" or "including" include not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0050] This application is used in the configuration process of an array microphone system during installation to accurately divide the target sound receiving area in the physical space into the sound source area mapped in the system configuration space. Thus, during the operation of the array microphone system, when the corresponding sound source area is determined based on the picked-up sound, the corresponding target sound receiving area in the physical space can be accurately locked, thereby achieving high-quality sound pickup for the target sound receiving area.

[0051] As shown in Figure 1, an embodiment of this application provides a method for configuring an array microphone system, the array microphone system including at least one array microphone device, the method comprising:

[0052] S10. Generate a configuration interface, the configuration interface including a system configuration space that matches the physical space where the array microphone system is installed; the physical space includes the target sound receiving area.

[0053] The array microphone device includes multiple microphone units for picking up multiple microphone signals. The configuration interface can be displayed on the user's personal terminal (e.g., laptop, tablet, smartphone, etc.; this application does not limit the specific form) for the user to perform visual configuration operations.

[0054] For example, the configuration interface includes a system configuration space that matches the physical space (e.g., a conference room) where the array microphone system is located. This system configuration space can be a two-dimensional or three-dimensional space; this application does not limit its scope. The following explanation uses a two-dimensional space as an example, where the system configuration space can be a two-dimensional planar space scaled down proportionally to the length and width dimensions of the physical space.

[0055] S20. Determine the directional information of the sound source based on the test audio emitted by the sound source in the target sound receiving area detected by the at least one array microphone device.

[0056] The test audio includes multiple microphone audio signals collected by multiple microphone units of the array microphone device. Exemplarily, the array microphone signals are used to locate the sound source based on these multiple microphone audio signals, thereby determining the sound source's directional information. This directional information includes the incident angle of the test audio and the distance between the sound source and the array microphone device. Furthermore, the specific sound source localization algorithm used can refer to relevant prior art, and this application does not limit it.

[0057] S30. Map the location information to the system configuration space and generate a sound source identifier.

[0058] For example, firstly, the absolute coordinates of the sound source in the physical space are calculated based on the azimuth information and the absolute coordinates of the array microphones of the at least one array microphone device in the physical space; wherein the azimuth information is the relative position information between the sound source and the array microphone array calculated according to the sound source localization algorithm, so the absolute coordinates of the sound source in the physical space can be calculated based on the azimuth information and the absolute coordinates of the array microphones of the array microphone device.

[0059] Secondly, based on the mapping relationship between the physical space and the system configuration space (e.g., the proportional relationship between the two spaces), the absolute coordinates of the sound source are mapped to the system configuration space, and a sound source identifier is generated. The sound source identifier can be a static dot or a dynamically flashing dot. It should be noted that the circle in the above embodiment is merely an example, and the specific shape of the sound source identifier is not limited in this application.

[0060] S40. Generate a sound source region corresponding to the sound source identifier in the system configuration space.

[0061] For example, in response to a user's selection operation around a sound source identifier in the system configuration space (e.g., selection via touch, selection via mouse, selection via voice control, etc.), a sound source region covering the sound source identifier is generated in the system configuration space. The sound source region can be circular, upright, rectangular, triangular, or other regular or irregular polygons; this application does not limit the specific shape of the sound source region.

[0062] This application utilizes a sound source to emit test audio in a target reception area, and picks up the corresponding test audio using an array microphone device. Then (e.g., through a sound source localization method), the location information of the sound source is determined. This location information is further mapped to a system configuration space to generate a sound source identifier. Finally, a sound source area corresponding to the sound source identifier is generated in the system configuration space as the pickup area. The entire process does not require precise measurement of the exact coordinates of the target reception area in physical space, avoiding the problem of inaccurate pickup area division caused by measurement errors.

[0063] In some embodiments, the number of at least one array microphone device can be determined based on the size of the physical space; the larger the area of ​​the physical space, the greater the number of array microphone devices. In some embodiments, at least one array microphone device includes a master array microphone device and slave array microphone devices; correspondingly, the orientation information includes master orientation information and slave orientation information. The number of slave array microphone devices can be one or more, and this application does not limit this. In this application, one of the at least one array microphone devices is randomly selected as the master array microphone device, and the rest are slave array microphone devices. Each slave array microphone device is connected to the master array microphone device and sends the result calculated based on the multi-channel microphone signals to the master array microphone device.

[0064] Figure 2 illustrates another embodiment of the array microphone system configuration method in this application. In this embodiment, the azimuth information is mapped to the system configuration space, and a sound source identifier is generated, including:

[0065] S31. Based on the main orientation information and the absolute coordinates of the first array microphone of the main array microphone device in the physical space, calculate the absolute coordinates of the first sound source in the physical space.

[0066] Among them, the main azimuth information is the relative position information between the sound source and the main array microphone device calculated according to the sound source localization algorithm. Therefore, the first absolute coordinates of the sound source in the physical space can be calculated based on the azimuth information and the absolute coordinates of the array microphones of the main array microphone device.

[0067] S32. Based on the subordinate orientation information and the absolute coordinates of the second array microphone of the subordinate array microphone device in the physical space, calculate the absolute coordinates of the second sound source in the physical space.

[0068] Among them, the subordinate directional information is the relative position information between the sound source and the subordinate array microphone device calculated according to the sound source localization algorithm. Therefore, the second absolute coordinates of the sound source in the physical space can be calculated based on the directional information and the absolute coordinates of the array microphones of the subordinate array microphone device.

[0069] S33. The absolute coordinate of the first sound source with the higher confidence level is taken as the absolute coordinate of the sound source.

[0070] For example, a first confidence level corresponding to the absolute coordinates of a first sound source is calculated based on the test audio detected by the main array microphone device; a second confidence level corresponding to the absolute coordinates of a second sound source is calculated based on the test audio detected by the subordinate array microphone device. When the first confidence level is greater than the second confidence level, the absolute coordinates of the first sound source are determined as the absolute coordinates of the sound source; otherwise, the absolute coordinates of the second sound source are determined as the absolute coordinates of the sound source.

[0071] The first confidence level / second confidence level can be calculated based on at least one of the following: the volume of the corresponding test audio, the signal-to-noise ratio of the sound, the VAD (Voice Activity Detection) module's determination of whether it is a human voice based on sound characteristics, and the distance between the sound source and the pickup device. Specifically, the higher the volume and the higher the signal-to-noise ratio, the higher the corresponding confidence level. The higher the confidence level when the VAD module determines it is a human voice based on sound characteristics, and the closer the sound source is to the pickup device, the higher the corresponding confidence level.

[0072] S34. Based on the mapping relationship between the physical space and the system configuration space, map the absolute coordinates of the sound source to the system configuration space and generate a sound source identifier.

[0073] In this embodiment, when the array microphone system includes multiple array microphone devices, one is designated as the master array microphone device, and the rest are designated as slave array microphone devices. Each array microphone device calculates and determines the absolute coordinates of the sound source. Finally, the master array microphone device determines the absolute coordinates of the sound source with the highest confidence level based on the confidence values ​​corresponding to all the sound source absolute coordinates. This coordinate is then mapped to the system configuration space and a sound source identifier is generated. By cascading multiple array microphone devices and through mutual sensing and communication, the most accurate sound source coordinates are calculated, improving the accuracy of sound pickup area segmentation.

[0074] In some embodiments, the test audio includes multiple test audio segments emitted by a sound source at different locations in the target sound reception area; determining the location information of the sound source based on the test audio emitted by the sound source in the target sound reception area detected by the at least one array microphone device includes: determining multiple sub-location information of the sound source based on the multiple test audio segments.

[0075] Accordingly, mapping the azimuth information to the system configuration space and generating sound source identifiers includes: mapping the plurality of sub-azimuth information to the system configuration space and generating a plurality of sub-sound source identifiers; generating a sound source region corresponding to the sound source identifier in the system configuration space includes: generating a sound source region in the system configuration space that at least partially covers the plurality of sub-sound source identifiers.

[0076] In some embodiments, the target sound pickup area is, for example, a seat in a conference room, and multiple test audio segments are test audio emitted by staff from different positions in that seat (either by the staff speaking directly or by the staff playing pre-recorded audio via electronic devices; this application is not limited to this). The different positions are formed by actions such as the user standing, sitting, tilting to the left, and tilting to the right. By simulating different user actions in reality, the multiple sub-sound source identifiers detected and generated in the system configuration space are more consistent with reality, thereby making the final generated sound source area more consistent with the actual situation and improving the accuracy of sound pickup area division.

[0077] In some embodiments, the target sound pickup area is, for example, a corridor in a classroom (an area that the teacher can walk through). By dividing this area into target sound pickup areas, precise directional sound pickup can be achieved in this area when the teacher walks in the area to give a lesson, while blocking noise from other areas.

[0078] Figure 3 illustrates another embodiment of the array microphone system configuration method in this application. In this embodiment, the method includes the following steps:

[0079] Step 1: The array microphone device picks up multi-channel audio signals and calculates the sound incident angle and the distance between the sound source and the array microphone device;

[0080] Step 2: Calculate the absolute coordinates of the sound source relative to the room based on the absolute coordinates of the array microphone device in the room;

[0081] Step 3: Determine whether the array microphone device detects other array microphone devices in the room;

[0082] Step 4: If it exists, all array microphone devices in the room will elect a unique master device, and the other devices will be slave devices; if it does not exist, proceed directly to step 6.

[0083] Step 5: All slave devices send the calculated point coordinates to the master device in real time. The master device calculates the point coordinates with the highest confidence at the current moment according to the strategy and sends them out.

[0084] Step 6: Map the point with the highest confidence level to the coordinate point in the visualization interface of the configuration tool;

[0085] Step 7: Based on the visualization strategy, render the location visualization onto the UI interface (e.g., change the size or color of the location, or flash to emphasize the current speaker's position).

[0086] Figure 4 shows a schematic diagram of the configuration interface in this application. It includes a canvas (corresponding to the system configuration space in the aforementioned embodiments) and configurable areas located on the sides and bottom of the system. The left area can display the array microphone devices MC10 and MC10-A included in the current system; furthermore, the required width and height of the canvas can be entered through the width / height setting field (for example, a canvas with a width of 10cm and a height of 2.7cm is set according to the scale requirements). During the execution of the array microphone system configuration method of this application, sound source identifiers (e.g., dots on the canvas in Figure 4) can be generated and displayed on the canvas in real time.

[0087] Furthermore, a debug mode component is also provided in the left-hand area, which can be used to turn the system's debug mode on or off (for example, the debug mode needs to be turned on first when executing the array microphone system configuration method of this application). In some optional embodiments, a microphone-camera linkage component and a linkage device addition component are also provided in the left-hand area. By turning on the microphone-camera linkage component, the array microphone device and the camera can be linked (for example, the camera can be adjusted to capture the current pickup area of ​​the array microphone according to the current pickup area of ​​the array microphone); by clicking the linkage device addition component, a camera or microphone-camera linkage host that needs to be linked can be added.

[0088] In some optional implementations, the right-hand area is the microphone-camera linkage configuration area. This area includes a screen clearing component for spatial point display, which allows for one-click clearing of sound source markers on the canvas.

[0089] In addition, the right-hand area also includes:

[0090] The advanced configuration component for sound source coordinates allows you to specify the points emitted by a particular array microphone device, display only the points of real-time output, and filter out historical points, among other functions.

[0091] The full-screen switch component, when turned on, displays the sound source location across the entire canvas; when turned off, it displays the sound source location only within the pickup area.

[0092] The parameter configuration component for point selection is used to adjust the strategy for output sound source coordinates, such as: smoothing strategy for point mis-touch, frequency of output point, sensitivity of sound intensity, etc.

[0093] The linked area list area displays information such as the linked areas and their status.

[0094] Furthermore, the configurable area at the bottom of the canvas also includes:

[0095] Adaptive component, used to automatically adjust the canvas size to fit the screen size.

[0096] Add an image component to import the meeting room floor plan, making it easier to configure the sound pickup area.

[0097] The temporary configuration component is used to temporarily store the configurations that have been completed during the configuration process.

[0098] It is applied to device components to apply the configuration results to the array microphone system after the entire array microphone configuration process is completed.

[0099] As shown in Figure 4 (this figure is for illustrative purposes only, and this application is not limited to the form shown in the figure), the small circular dots within the sound pickup area represent the speaker's location as emitted by the array microphone device. If the speaker continues speaking from a fixed position, the color of the small circular dots will darken and / or the area of ​​the dots will increase. This intuitive method allows users to visually see the speaker's location and accurately delineate the sound pickup area. When multiple array microphone devices are cascaded, the cascaded array microphone devices elect a master device through an internal protocol. Information from the other devices is aggregated to the master device for decision-making. The master device calculates the absolute coordinates of the speaker's room based on the room coordinates (two-dimensional or three-dimensional coordinates) of the slave devices and the relative coordinates of the speaker's voice, and maps this to the configuration interface.

[0100] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of combined actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously according to this application. Secondly, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to this application. In the above embodiments, the descriptions of each embodiment have their own emphasis; for parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0101] As shown in Figure 5, an embodiment of this application also provides an array microphone system configuration device 500, characterized in that the array microphone system includes at least one array microphone device, the device comprising:

[0102] The interface generation module 510 is used to generate a configuration interface, which includes a system configuration space that matches the physical space where the array microphone system is installed; the physical space includes a target sound receiving area.

[0103] The azimuth determination module 520 is used to determine the azimuth information of the sound source based on the test audio emitted by the sound source in the target sound receiving area detected by the at least one array microphone device.

[0104] The identifier generation module 530 is used to map the orientation information to the system configuration space and generate a sound source identifier;

[0105] The region generation module 540 is used to generate a sound source region corresponding to the sound source identifier in the system configuration space.

[0106] This application utilizes a sound source to emit test audio in a target reception area, and picks up the corresponding test audio through an array microphone device. Based on this, the location information of the sound source is determined, and this location information is further mapped to the system configuration space to generate a sound source identifier. Finally, a sound source area corresponding to the sound source identifier is generated in the system configuration space as the pickup area. The entire process does not require precise measurement of the exact coordinates of the target reception area in physical space, avoiding the problem of inaccurate pickup area division caused by measurement errors.

[0107] In some embodiments, the test audio includes multiple test audio segments emitted by a sound source at different locations in the target reception area;

[0108] Determining the directional information of the sound source based on the test audio emitted by the sound source in the target sound reception area detected by the at least one array microphone device includes: determining multiple sub-directional information of the sound source based on the multiple test audio segments.

[0109] In some embodiments, mapping the azimuth information to the system configuration space and generating sound source identifiers includes: mapping the plurality of sub-azimuth information to the system configuration space and generating a plurality of sub-sound source identifiers;

[0110] Generating a sound source region corresponding to the sound source identifier in the system configuration space includes: generating a sound source region in the system configuration space that at least partially covers the plurality of sub-sound source identifiers.

[0111] In some embodiments, mapping the orientation information to the system configuration space and generating a sound source identifier includes:

[0112] Based on the azimuth information and the absolute coordinates of the array microphones of the at least one array microphone device in the physical space, the absolute coordinates of the sound source in the physical space are calculated.

[0113] Based on the mapping relationship between the physical space and the system configuration space, the absolute coordinates of the sound source are mapped to the system configuration space, and a sound source identifier is generated.

[0114] In some embodiments, this application also provides a computer device, including a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement the steps of the configuration method described in any embodiment of this application.

[0115] In some embodiments, this application provides a computer-readable storage medium storing a computer program / instructions thereon, characterized in that the computer program / instructions, when executed by a processor, implement the steps of the configuration method described in any embodiment of this application.

[0116] In some embodiments, this application provides a computer program product including a computer program / instructions, characterized in that the computer program / instructions, when executed by a processor, implement the steps of the configuration method described in any embodiment of this application.

[0117] The array microphone system configuration apparatus, computer equipment, storage medium, and program product described in the above embodiments of this application can be used to execute the array microphone system configuration method of the present application embodiments, and correspondingly achieve the technical effects achieved by the array microphone system configuration method of the present application embodiments, which will not be elaborated further here. In the embodiments of this application, the relevant functional modules can be implemented using a hardware processor.

[0118] Figure 6 is a schematic diagram of the hardware structure of a computer device for performing an array microphone system configuration method according to another embodiment of this application. As shown in Figure 6, the device includes:

[0119] One or more processors 610 and memory 620, with one processor 610 as an example in Figure 6.

[0120] The device for performing the array microphone system configuration method may further include an input device 630 and an output device 640.

[0121] The processor 610, memory 620, input device 630 and output device 640 can be connected by a bus or other means. Figure 6 shows an example of connection by bus.

[0122] The memory 620, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as the program instructions / modules corresponding to the array microphone system configuration method in the embodiments of this application. The processor 610 executes various functional applications and data processing of the server by running the non-volatile software programs, instructions, and modules stored in the memory 620, thereby implementing the array microphone system configuration method of the above-described method embodiments.

[0123] The memory 620 may include a program storage area and a data storage area. The program storage area may store the operating system and applications required for at least one function; the data storage area may store data created based on the use of the array microphone system configuration device. Furthermore, the memory 620 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state storage device. In some embodiments, the memory 620 may optionally include memory remotely located relative to the processor 610, and this remote memory may be connected to the array microphone system configuration device via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0124] Input device 630 can receive input digital or character information and generate signals related to user settings and function control of the array microphone system configuration device. Output device 640 may include a display device such as a display screen.

[0125] The one or more modules are stored in the memory 620, and when executed by the one or more processors 610, the array microphone system configuration method in any of the above method embodiments is executed.

[0126] The above-described product can perform the methods provided in the embodiments of this application, and has the corresponding functional modules and beneficial effects for performing the methods. Technical details not described in detail in this embodiment can be found in the methods provided in the embodiments of this application.

[0127] The computer device in this application embodiment exists in various forms, including but not limited to:

[0128] (1) Mobile communication devices: These devices are characterized by their mobile communication capabilities and primarily aim to provide voice and data communication. These terminals include smartphones, multimedia phones, feature phones, and low-end phones.

[0129] (2) Ultra-mobile personal computer devices: These devices fall under the category of personal computers, possessing computing and processing capabilities, and generally also have mobile internet access features. These terminals include: laptops, PDAs, MIDs, and UMPC devices, such as the iPad.

[0130] (3) Conference equipment: This type of equipment can realize functions such as sound recording and amplification at the conference site. This type of equipment includes: array microphone equipment, etc.

[0131] (4) Server: A device that provides computing services. The components of a server include a processor, hard disk, memory, system bus, etc. Servers are similar to general computer architectures, but because they need to provide highly reliable services, they have higher requirements in terms of processing power, stability, reliability, security, scalability, and manageability.

[0132] (5) Other electronic devices with data interaction functions.

[0133] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs.

[0134] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented using software plus a general-purpose hardware platform, or of course, using hardware. Based on this understanding, the above technical solutions, in essence or the parts that contribute to the related technology, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0135] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A method for configuring an array microphone system, characterized in that, The array microphone system includes at least one array microphone device, and the method includes: A configuration interface is generated, which includes a system configuration space that matches the physical space where the array microphone system is installed; the physical space includes the target sound pickup area. Based on the test audio emitted by the sound source in the target sound reception area detected by the at least one array microphone device, the directional information of the sound source is determined; The location information is mapped to the system configuration space, and a sound source identifier is generated; A sound source region corresponding to the sound source identifier is generated in the system configuration space.

2. The method according to claim 1, characterized in that, The test audio includes multiple test audio segments emitted by the sound source from different directions in the target sound receiving area; Determining the directional information of the sound source based on the test audio emitted by the sound source in the target sound reception area detected by the at least one array microphone device includes: determining multiple sub-directional information of the sound source based on the multiple test audio segments.

3. The method according to claim 2, characterized in that, Mapping the azimuth information to the system configuration space and generating sound source identifiers includes: mapping the multiple sub-azimuth information to the system configuration space and generating multiple sub-sound source identifiers; Generating a sound source region corresponding to the sound source identifier in the system configuration space includes: generating a sound source region in the system configuration space that at least partially covers the plurality of sub-sound source identifiers.

4. The method according to any one of claims 1-3, characterized in that, Mapping the location information to the system configuration space and generating a sound source identifier includes: Based on the azimuth information and the absolute coordinates of the array microphones of the at least one array microphone device in the physical space, the absolute coordinates of the sound source in the physical space are calculated. Based on the mapping relationship between the physical space and the system configuration space, the absolute coordinates of the sound source are mapped to the system configuration space, and a sound source identifier is generated.

5. The method according to any one of claims 1-3, characterized in that, The at least one array microphone device includes a master array microphone device and a slave array microphone device; The orientation information includes primary orientation information and subordinate orientation information; Mapping the location information to the system configuration space and generating a sound source identifier includes: Based on the main orientation information and the absolute coordinates of the first array microphone of the main array microphone device in the physical space, the absolute coordinates of the first sound source in the physical space are calculated. Based on the subordinate directional information and the absolute coordinates of the second array microphone of the subordinate array microphone device in the physical space, the absolute coordinates of the second sound source in the physical space are calculated. The absolute coordinates of the first and second sound sources with the higher confidence level are taken as the absolute coordinates of the sound source. Based on the mapping relationship between the physical space and the system configuration space, the absolute coordinates of the sound source are mapped to the system configuration space, and a sound source identifier is generated.

6. A configuration device for an array microphone system, characterized in that, The array microphone system includes at least one array microphone device, the device comprising: An interface generation module is used to generate a configuration interface, which includes a system configuration space that matches the physical space where the array microphone system is installed; the physical space includes a target sound pickup area. A directional determination module is used to determine the directional information of the sound source based on the test audio emitted by the sound source in the target sound receiving area detected by the at least one array microphone device. The identifier generation module is used to map the location information to the system configuration space and generate a sound source identifier; The region generation module is used to generate a sound source region corresponding to the sound source identifier in the system configuration space.

7. The apparatus according to claim 6, characterized in that, The test audio includes multiple test audio segments emitted by the sound source from different directions in the target sound receiving area; Determining the directional information of the sound source based on the test audio emitted by the sound source in the target sound reception area detected by the at least one array microphone device includes: determining multiple sub-directional information of the sound source based on the multiple test audio segments.

8. The apparatus according to claim 7, characterized in that, Mapping the azimuth information to the system configuration space and generating sound source identifiers includes: mapping the multiple sub-azimuth information to the system configuration space and generating multiple sub-sound source identifiers; Generating a sound source region corresponding to the sound source identifier in the system configuration space includes: generating a sound source region in the system configuration space that at least partially covers the plurality of sub-sound source identifiers.

9. The apparatus according to any one of claims 6-8, characterized in that, Mapping the location information to the system configuration space and generating a sound source identifier includes: Based on the azimuth information and the absolute coordinates of the array microphones of the at least one array microphone device in the physical space, the absolute coordinates of the sound source in the physical space are calculated. Based on the mapping relationship between the physical space and the system configuration space, the absolute coordinates of the sound source are mapped to the system configuration space, and a sound source identifier is generated.

10. A computer device, comprising a memory, a processor, and a computer program stored in the memory, characterized in that, The processor executes the computer program to implement the steps of the method according to any one of claims 1-5.

11. A computer-readable storage medium having a computer program / instructions stored thereon, characterized in that, When the computer program / instructions are executed by the processor, they implement the steps of the method described in any one of claims 1-5.

12. A computer program product comprising a computer program / instructions, characterized in that, When the computer program / instructions are executed by the processor, they implement the steps of the method described in any one of claims 1-5.

Images