Pickup area automatic configuration method and system, electronic equipment and storage medium

Abstract

The invention discloses a pickup area automatic configuration method and system, electronic equipment and a storage medium, and the method comprises the steps: responding to a user instruction, and entering an automatic configuration mode; in the automatic configuration mode, the audio collection device collects direction arrival angle point position information of a speaker; based on the collected point location information, automatically calculating and generating a pickup area range; and ending the automatic configuration mode and applying the generated pickup area range, the ending of the automatic configuration mode is realized by issuing an ending instruction through the configuration tool, and the ending instruction comprises an automatic configuration forbidding mark. According to the embodiment of the invention, the direction arrival angle point position information of the speaker is automatically collected, and the pickup area range is automatically calculated and generated based on the effective point position, so that the configuration efficiency and accuracy are improved; a pickup area is generated based on actual speaker point location information, and the method is more suitable for a real use scene; and multiple point location selection modes and boundary expansion are supported, so that the flexibility and the applicability are enhanced.

Description

Technical Field

[0001] This invention belongs to the field of audio processing technology, and particularly relates to an automatic pickup area configuration method, system, electronic device, and storage medium. Background Technology

[0002] In existing technologies, the configuration of the pickup area is typically achieved in two ways: one is by selecting a predefined lobe region, and the other is by manually drawing the range on the canvas of configuration software. However, these methods have significant drawbacks: selecting a predefined lobe region results in a large granularity of the pickup area, which cannot precisely adapt to the actual speaker's location; while the manual drawing method can achieve a relatively fine configuration, it requires multiple verifications and adjustments, is inefficient, and struggles to accurately correspond to the speaker's location in the real environment. Furthermore, existing methods cannot effectively distinguish between multiple adjacent pickup areas, leading to misjudgments or omissions in practical applications. Therefore, there is an urgent need in the field for a method that can automatically and accurately configure the pickup area to solve the above problems. Summary of the Invention

[0003] The embodiments of the present invention are intended to solve at least one of the above-mentioned technical problems.

[0004] In a first aspect, embodiments of the present invention provide an automatic pickup area configuration method, comprising: entering an automatic configuration mode in response to a user instruction; in the automatic configuration mode, an audio acquisition device collects information on the speaker's direction of arrival at corner points; automatically calculating and generating a pickup area range based on the collected point information; ending the automatic configuration mode and applying the generated pickup area range, wherein the ending of the automatic configuration mode is achieved by issuing an end command through a configuration tool, and the end command includes an automatic configuration disable flag.

[0005] Secondly, embodiments of the present invention provide an automatic pickup zone configuration system, which includes: a configuration tool and an audio acquisition device, wherein: the configuration tool is used to send automatic configuration instructions and parameters to the audio acquisition device; the audio acquisition device is used to respond to the instructions and perform point collection, pickup zone calculation and result reporting.

[0006] Thirdly, embodiments of the present invention provide an electronic device comprising: at least one processor, and a memory communicatively connected to the at least one processor, wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to execute any of the above-described automatic pickup zone configuration methods of the present invention.

[0007] Fourthly, embodiments of the present invention provide a storage medium storing one or more programs including execution instructions, the execution instructions being readable and executable by electronic devices (including but not limited to computers, servers, or network devices, etc.) to perform any of the above-described automatic pickup zone configuration methods of the present invention.

[0008] Fifthly, embodiments of the present invention also provide a computer program product, the computer program product including a computer program stored on a storage medium, the computer program including program instructions, which, when executed by a computer, cause the computer to execute any of the above-described automatic pickup area configuration methods.

[0009] This invention improves configuration efficiency and accuracy by automatically collecting speaker arrival angle information and automatically calculating and generating the pickup area range based on the effective points; it generates the pickup area based on the actual speaker location information, which is more in line with real-world usage scenarios; and it supports multiple point selection methods and boundary expansion, enhancing flexibility and applicability. Attached Figure Description

[0010] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0011] Figure 1 This is a flowchart of the automatic pickup area configuration method of the present invention; Figure 2 This is a schematic diagram illustrating the automatic configuration of the pickup area processing method of the present invention; Figure 3 This is a schematic diagram illustrating the automatic configuration at the end of the pickup area processing method of the present invention; Figure 4 This is a schematic diagram of the automatic pickup area definition in the pickup area processing method of the present invention. Figure 5 This is a schematic diagram of the structure of an embodiment of the electronic device of the present invention. Detailed Implementation

[0012] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0013] It should be noted that, unless otherwise specified, the embodiments and features described in this application can be combined with each other.

[0014] This invention can be described in the general context of computer-executable instructions, such as program modules, that are executed by a computer. Generally, program modules include routines, programs, objects, elements, data structures, etc., that perform a specific task or implement a specific abstract data type. This invention can also be practiced in distributed computing environments where tasks are performed by remote processing devices connected via a communication network. In distributed computing environments, program modules can reside in local and remote computer storage media, including storage devices.

[0015] In this invention, terms such as "module," "device," and "system" refer to relevant entities applied to a computer, such as hardware, combinations of hardware and software, software, or software in execution. More specifically, for example, an element can be, but is not limited to, a process running on a processor, a processor, an object, an executable element, an execution thread, a program, and / or a computer. Furthermore, an application program or script running on a server, and the server itself, can also be an element. One or more elements may be in an execution process and / or thread, and elements may be localized on a single computer and / or distributed across two or more computers, and may be run on various computer-readable media. Elements can also communicate via local and / or remote processes based on signals having one or more data packets, for example, signals from data interacting with another element in a local system, a distributed system, and / or interacting with other systems via signals over a network on the Internet.

[0016] Finally, it should be noted that in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising" or "including" include not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0017] This invention provides an automatic pickup zone configuration method, which can be applied to electronic devices. The electronic device can be a computer, server, or other electronic product, etc., and this invention does not limit this to any particular device.

[0018] Please refer to Figure 1This illustrates an automatic pickup zone configuration method provided by an embodiment of the present invention.

[0019] like Figure 1 As shown, in step 101, in response to a user command, the system enters automatic configuration mode; In step 102, in the automatic configuration mode, the audio acquisition device collects information on the speaker's direction of arrival at the corner point; In step 103, the pickup area range is automatically calculated and generated based on the collected location information; In step 104, the automatic configuration mode is ended and the generated pickup range is applied. The end of the automatic configuration mode is achieved by issuing an end command through the configuration tool, and the end command includes an automatic configuration disable flag.

[0020] In this embodiment, for step 101, in response to a user command, the device enters automatic configuration mode. The user issues an activation command through the configuration tool, and the audio acquisition device receives the command and enters automatic configuration mode. For example, upon entering automatic configuration, the PC's configuration tool issues an activation command. After receiving the command, the device calculates and selects, generates a pickup area selection box, and simultaneously reports it to the PC's configuration tool.

[0021] Next, in step 102, in automatic configuration mode, the audio acquisition device continuously collects speaker direction of arrival (DOA) information. DOA information includes the speaker's direction angle and position coordinates. The speaker positions reported by the audio acquisition device are highly accurate and stable.

[0022] Then, for step 103, based on the collected location information, the pickup area is automatically calculated and generated. The calculation process includes location validity judgment and final location selection. Combined with the configuration tool, after entering the automatic pickup area configuration mode, the device records the speaker's location information and automatically defines the pickup area. During the definition process, it can simulate and align with actual usage scenarios to collect sufficient and comprehensive location information, resulting in a more realistic and accurate pickup area with higher precision.

[0023] Finally, for step 104, the automatic configuration mode is ended, and the generated pickup area range is applied. The end command is issued by the configuration tool, including an automatic configuration disable flag. Upon receiving the command, the device exits the automatic configuration mode and enables the newly generated pickup area.

[0024] This application embodiment automatically collects speaker direction of arrival (DOA) point information and automatically calculates and generates the pickup area range based on the effective points, thereby achieving efficient and accurate fully automatic pickup area configuration, reducing manual operation, improving configuration efficiency and accuracy, and is especially suitable for scenarios that require rapid deployment.

[0025] In some optional embodiments, collecting location information includes recording the coordinates and frequency of each location, and determining the validity of the location based on a preset threshold. For example, a location is considered valid only when its frequency exceeds the threshold. Collecting DOA information involves saving the action, recording the coordinates and frequency of each valid DOA location. For example, the threshold is set to 200 times; a location is only included in subsequent calculations if it is detected more than 200 times. Determining valid locations using a threshold filters out noise and random locations, improving the accuracy and stability of the pickup area generation.

[0026] In some optional embodiments, automatically calculating and generating the pickup area range includes selecting a final location from valid locations according to a pre-configured selection method, which includes at least one of the following: the location with the most frequent occurrences, the center location of all valid locations, or the location farthest from the audio acquisition device. Users can set selection method parameters (e.g., align=0, 1, or 2) through a configuration tool, and the device performs the corresponding selection based on the parameters. Multiple location selection strategies are provided to adapt to different scenario requirements; for example, selecting the center location in a meeting scenario and selecting the farthest location in a lectern scenario, enhancing the flexibility of the method.

[0027] In some optional embodiments, generating the pickup area range includes generating a polygonal pickup frame based on the final points, where the number of sides of the polygon is determined by the number of final points. For example, a triangular pickup frame is generated for 3 points, and a quadrilateral pickup frame is generated for 4 points. Based on the generated pickup area range, a reserved boundary range is extended outwards, controlled by predefined boundary parameters. The boundary range is controlled by predefined boundary parameters (e.g., margin=10), indicating an outward extension of 10 centimeters. This boundary extension avoids missed pickups due to slight speaker movement, improving the system's fault tolerance and user experience.

[0028] In some optional embodiments, entering the automatic configuration mode is achieved by issuing an activation command through the configuration tool. The activation command includes at least one of the following parameters: an automatic configuration enable flag (en=1 indicates whether automatic configuration is enabled), a boundary parameter (margin represents the fuzzy space of the boundary, the number of centimeters extended outward from the automatically initially outlined area), a valid point threshold (threshold determines the validity of a DOA point; how many times the location must appear before it is considered valid), and a point selection method (align selects the final location information based on valid DOA points). Through parameterized configuration, users can flexibly adjust the automatic configuration process according to actual needs, enhancing the applicability and customizability of the method.

[0029] In some optional embodiments, after generating the pickup area range, the result information is reported to the configuration tool. The result information includes the calculated pickup area coordinates (calc_areas_xy) and the expanded boundary area coordinates (margin_areas_xy). By reporting the result information, users can intuitively view the generated pickup area in the configuration tool, which facilitates verification and further adjustments, improving the transparency and controllability of the configuration.

[0030] It should be noted that, for existing technologies, the equipment needs to have fine granularity in identifying the pickup area; at the same time, the equipment needs to have high accuracy in speaker location (DOA) information; and the additional time consumed by manual selection and multiple adjustments is acceptable in terms of the overall deployment cost, making it difficult to inspire similar demands for convenience. Existing technologies typically address these issues by: 1. Defining a pickup area much larger than the actual size, reserving a large boundary range; 2. Spending considerable time on multiple rounds of verification and adjustment during on-site deployment and debugging; 3. For microphone-camera linkage, it cannot accurately divide and identify several nearby points, but can only judge them as a large point, sacrificing the actual user experience.

[0031] Existing solutions require high accuracy and granularity for pickup area recognition. The speaker location (DOA) reported by the device is also highly accurate and stable. By combining a configuration tool with an automatic pickup area configuration mode, the device records the speaker location information (DOA) and automatically defines the pickup area. During the definition process, it can simulate and align with real-world usage scenarios to collect sufficient and comprehensive location information, resulting in a more realistic and accurate pickup area with higher precision.

[0032] This invention achieves rapid and precise configuration of the pickup area by automatically collecting and processing speaker direction angle information, effectively solving problems such as large granularity and difficulty in adjustment in existing technologies. Those skilled in the art can make changes and modifications to the above embodiments without departing from the spirit of this invention, and all such changes and modifications fall within the protection scope of this invention.

[0033] This embodiment provides an automatic pickup zone configuration system, including a configuration tool and an audio acquisition device. The configuration tool is used to send automatic configuration commands and parameters to the audio acquisition device; the audio acquisition device is used to respond to commands, perform point collection, pickup zone calculation, and result reporting. The system realizes an end-to-end automatic configuration process, simplifies deployment steps, and improves overall efficiency.

[0034] Please refer to Figure 2 This illustrates a schematic diagram of automatic configuration provided by the present invention. Figure 2As shown, there are multiple settings and selection methods in the configuration: 1. Button Switch: Enters / Ends Automatic Configuration (Enters automatic configuration via PC's configuration tool, which issues a command to start the configuration. After receiving the command, the device calculates and selects, generates a pickup area selection box, and simultaneously reports it to the PC's configuration tool. Command: {"request":"dev.region.auto.set","data":{"en":1,"margin":10,"threshold":200,"align":2}}) 2. Reserved boundary range: The range extended outwards from the existing location information. Please refer to this again. Figure 3 This illustrates a schematic diagram of the end-of-automatic configuration provided by the present invention. For example... Figure 3 As shown, the configuration parameters issued by the PC's configuration tool are: 1. Enable and enter the automatic configuration command delivery mode, similar to {"request":"dev.region.auto.set","data":{"en":1,"margin":10,"threshold":200,"align":2}} en: Indicates whether automatic configuration is enabled; margin: Represents the fuzzy space of the boundary, the number of centimeters to extend outward from the automatically initially outlined area; threshold: The threshold for determining the validity of a DOA point; how many times the point must appear before it is considered valid. align: The method for selecting the final location information based on valid DOA points.

[0035] 0: The position that appears most frequently 1: Central position 2: The location furthest from the equipment 2. End automatic configuration {"request":"dev.region.auto.set","data":{"en":0}} 3. After the device completes the selection of the pickup area, it reports the result information. {"response":"dev.region.auto.set","data":{"calc_areas_xy":[[[6.06,0.49],[9.94,0.49],[9.4 4,4.24],[5.74,3.43]]],"margin_areas_xy":[[[5.6,0.04],[10.41,0],[9.8,4.79],[5.15,3.8]]]}} Please refer to this again. Figure 4 It shows a schematic diagram of the automatic pickup area definition provided by the present invention, such as Figure 4 As shown, collecting DOA information involves saving actions, recording the coordinates of each valid DOA point, and the number of times it appears.

[0036] Processing flow: Calculate the action: 1. After the current speaker switches to another position through DOA, calculate the position of the previous speaker. 2. Based on the previously saved coordinates and count information, select the final DOA point according to the align configuration.

[0037] Framing effect: similar Figure 3 Four points will generate a corresponding quadrilateral pickup frame. If there are 3 or 5 points, a triangular or pentagonal pickup frame will be generated respectively.

[0038] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of combined actions. However, those skilled in the art should understand that the present invention is not limited to the described order of actions, as some steps can be performed in other orders or simultaneously according to the present invention. Secondly, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to the present invention. In the above embodiments, the descriptions of each embodiment have their own emphasis; for parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0039] In some embodiments, the present invention provides a non-volatile computer-readable storage medium storing one or more programs including execution instructions, which can be read and executed by electronic devices (including but not limited to computers, servers, or network devices, etc.) to perform any of the above-described automatic pickup zone configuration methods of the present invention.

[0040] In some embodiments, the present invention also provides a computer program product, the computer program product including a computer program stored on a non-volatile computer-readable storage medium, the computer program including program instructions, which, when executed by a computer, cause the computer to perform any of the above-described automatic pickup zone configuration methods.

[0041] In some embodiments, the present invention also provides an electronic device comprising: at least one processor, and a memory communicatively connected to the at least one processor, wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform an automatic pickup zone configuration method.

[0042] Figure 5 This is a schematic diagram of the hardware structure of an electronic device for performing an automatic pickup area configuration method according to another embodiment of this application, as shown below. Figure 5 As shown, the device includes: One or more processors 510 and memory 520, Figure 5 Take the 510 processor as an example.

[0043] The device that performs the automatic pickup zone configuration method may also include an input device 530 and an output device 540.

[0044] The processor 510, memory 520, input device 530, and output device 540 can be connected via a bus or other means. Figure 5 Taking the example of a connection between China and Israel via a bus.

[0045] The memory 520, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as the program instructions / modules corresponding to the automatic pickup area configuration method in the embodiments of this application. The processor 510 executes various functional applications and data processing of the server by running the non-volatile software programs, instructions, and modules stored in the memory 520, thereby implementing the automatic pickup area configuration method in the above-described method embodiments.

[0046] The memory 520 may include a program storage area and a data storage area. The program storage area may store the operating system and applications required for at least one function; the data storage area may store data created based on the use of the microphone auto-configuration device. Furthermore, the memory 520 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state storage device. In some embodiments, the memory 520 may optionally include memory remotely located relative to the processor 510, and these remote memories can be connected to the microphone auto-configuration device via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0047] Input device 530 can receive input digital or character information, and generate signals related to user settings and function control of the pickup area automatic configuration device. Output device 540 may include display devices such as a display screen.

[0048] The one or more modules are stored in the memory 520, and when executed by the one or more processors 510, the automatic pickup area configuration method in any of the above method embodiments is executed.

[0049] The above-described product can perform the methods provided in the embodiments of this application, and has the corresponding functional modules and beneficial effects for performing the methods. Technical details not described in detail in this embodiment can be found in the methods provided in the embodiments of this application.

[0050] The electronic devices in this application embodiments exist in various forms, including but not limited to: (1) Mobile communication devices: These devices are characterized by their mobile communication capabilities and primarily aim to provide voice and data communication. These terminals include smartphones, multimedia phones, feature phones, and low-end phones.

[0051] (2) Ultra-mobile personal computer devices: These devices fall under the category of personal computers, possessing computing and processing capabilities, and generally also have mobile internet access features. These terminals include: PDAs, MIDs, and UMPCs, etc.

[0052] (3) Portable entertainment devices: These devices can display and play multimedia content. This category includes audio and video players, handheld game consoles, e-book readers, as well as smart toys and portable car navigation devices.

[0053] (4) Other airborne electronic devices with data interaction capabilities, such as vehicle-mounted systems installed on vehicles.

[0054] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs.

[0055] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented using software plus a general-purpose hardware platform, or of course, using hardware. Based on this understanding, the above technical solutions, in essence or the parts that contribute to the related technology, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0056] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A method for automatically configuring a pickup area, comprising: In response to user commands, enter automatic configuration mode; In the automatic configuration mode, the audio acquisition device collects information on the speaker's direction of arrival at the corner point; Based on the collected location information, the pickup area range is automatically calculated and generated; End the automatic configuration mode and apply the generated pickup area range. The end of the automatic configuration mode is achieved by issuing an end command through the configuration tool. The end command includes an automatic configuration disable flag.

2. The method according to claim 1, characterized in that, The collected location information includes recording the coordinates and frequency of each location, and determining the validity of the location based on a preset threshold.

3. The method according to claim 2, characterized in that, The automatic calculation and generation of the pickup area range includes: The final location is selected from the valid locations according to a pre-configured selection method, which includes at least one of the following: the location that appears most frequently, the center location of all valid locations, or the location farthest from the audio acquisition device.

4. The method according to claim 1, characterized in that, The generated pickup area range includes generating a polygonal pickup frame based on the final location, wherein the number of sides of the polygon is determined by the number of final locations.

5. The method according to claim 1, characterized in that, It also includes extending the generated pickup area outwards by a reserved boundary range, which is controlled by predefined boundary parameters.

6. The method according to claim 1, characterized in that, Entering the automatic configuration mode is achieved by issuing an activation command through the configuration tool. The activation command includes at least one of the following parameters: automatic configuration enable flag, boundary parameters, effective threshold of point location, and point location selection method.

7. The method according to claim 1, characterized in that, After generating the pickup area range, the system reports the result information to the configuration tool. The result information includes the calculated pickup area coordinates and the expanded boundary area coordinates.

8. An automatic pickup zone configuration system, characterized in that, Includes configuration tools and audio capture devices, among which: The configuration tool is used to send automatic configuration instructions and parameters to the audio acquisition device; The audio acquisition device is used to respond to the command, perform point collection, pickup area calculation and result reporting.

9. An electronic device comprising: At least one processor, and a memory communicatively connected to the at least one processor, wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the steps of the method according to any one of claims 1 to 7.

10. A storage medium having a computer program stored thereon, characterized in that, When the program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 7.

Images