Audio equipment control method, equipment and storage medium

Abstract

The invention provides an audio equipment control method, equipment and a storage medium, the audio equipment control method is applied to audio management equipment in an audio equipment management system, the audio equipment management system comprises the audio management equipment, pickup equipment and broadcasting equipment, and the method comprises the following steps: receiving a first external control instruction, the first external control instruction is an external control instruction generated when an external system detects that a sounding behavior exists in an environment space where the audio equipment management system is located, and the external control instruction is a control instruction sent to the audio management equipment by the external system calling an application program interface of the audio management equipment; in response to the first external control instruction, controlling the pickup device to pick up; converting the audio data picked up by the pickup device into an audio conversion text; the audio converted text is transmitted to an external system, the audio converted text being used by the external system to generate an audio associated text related to a system function of the external system. According to the technical scheme, the control modes of the audio equipment are enriched, and integration and linkage of a plurality of systems are facilitated.

Description

Technical Field

[0001] This application relates to the field of device control, and more particularly to audio device control methods, devices, and storage media. Background Technology

[0002] Microphones, amplifiers, and speakers are typically the core components of an audio transmission link. With the improvement of people's living standards, the demand for high-quality audio is increasingly strong. Audio equipment management systems have emerged to meet this need. These systems integrate microphones, amplifiers, and speakers, playing a crucial role in numerous practical scenarios. For example, in large conference rooms, the audio equipment management system uses multiple microphones to capture the speaker's voice from all directions. After these sound signals are efficiently amplified by the amplifier, they are accurately transmitted to every corner of the conference room with the help of well-placed speakers, promoting efficient meetings. Similarly, in school classrooms, the audio equipment management system helps teachers easily and clearly transmit sound to every student, ensuring accurate sound transmission and greatly improving teaching effectiveness; and so on.

[0003] The audio device management system is deployed as an independent hardware system in a specific environment. Users install audio device management software on their computer devices and use the software to manage and control the audio devices in the audio device management system, such as controlling the devices to turn on or off, or controlling the operation of a specific audio device; the control method is singular. Summary of the Invention

[0004] This application provides audio device control methods, devices, and storage media, aiming to enrich the control methods of audio devices in audio device management systems.

[0005] In a first aspect, an audio device control method is provided, applied to an audio management device in an audio device management system, the audio device management system including the audio management device, a pickup device, and a broadcasting device, the method comprising:

[0006] The system receives a first external control instruction, which is an external control instruction generated by an external system when it detects sound activity in the environment where the audio device management system is located. The external control instruction is an instruction sent by the external system to the audio management device by calling the application programming interface of the audio management device. The first external control instruction is used to instruct the pickup device to pick up sound.

[0007] In response to the first external control command, control the sound pickup device to pick up sound;

[0008] The audio data picked up by the sound pickup device is converted into audio-to-text.

[0009] The audio-converted text is sent to the external system, and the external system uses the audio-converted text to generate audio-related text associated with the system functions of the external system.

[0010] In this technical solution, when the audio management device in the audio equipment management system receives a first external control command instructing the pickup device to pick up sound, it responds to the first external control command, controls the pickup device to pick up sound, and converts the audio data picked up by the pickup device into audio-converted text, which is then sent to the external system. The audio-converted text is used by the external system to generate audio-related text associated with the system functions of the external system. Since the first external command is an external control command generated when the external system detects sound activity in the environment where the audio equipment management system is located, and the external control command is a control command sent to the audio management device by the external system calling the application of the audio management device, it is equivalent to automatically controlling the pickup device in the audio equipment management system to pick up sound when the external control system detects sound activity. This enriches the control methods of the audio device, facilitates the integration and linkage of multiple systems, and realizes intelligent control of the audio device. In addition, converting the audio data picked up by the pickup device into audio-converted text and sending it to the external system helps to generate intelligent text and enriches the system functions of the external system.

[0011] In conjunction with the first aspect, in one possible implementation, there are multiple sound pickup devices and multiple sound broadcasting devices, which are distributed and arranged at different locations in the environmental space; the first external control command is used to instruct a target sound pickup device to pick up sound, and the target sound pickup device includes some of the multiple sound pickup devices; the step of responding to the first external control command and controlling the sound pickup device to pick up sound includes: responding to the first external control command, controlling the target sound pickup device to pick up sound, and controlling a target sound broadcasting device associated with the target sound pickup device to play the audio data picked up by the target sound pickup device.

[0012] By responding to the first external control command, the target microphone can be controlled to pick up sound, thus enabling targeted control of the microphone and avoiding the picking up of irrelevant sounds. The target broadcasting device associated with the target microphone can be controlled to play the audio data picked up by the target microphone, and the audio data picked up by multiple microphones can be combined into one output, thereby preventing feedback caused by multiple people speaking at the same time.

[0013] In conjunction with the first aspect, in one possible implementation, the association between the target broadcasting device and the target pickup device is configured through an audio device management page. The audio device management page for configuring the association includes an audio input device list and an audio output device list. The target pickup device is an audio input device in the audio input device list, and the target broadcasting device is an audio output device in the audio output device list. The audio device management page for configuring the association also includes a routing arrow, which indicates the association between the target broadcasting device and the target pickup device.

[0014] The audio device management page allows you to configure the relationship between the pickup and broadcast devices, and the routing arrows on the audio device management page indicate the relationship between the broadcast and pickup devices. This helps to flexibly configure the transmission link between the broadcast and pickup devices and to intuitively display the relationship between them.

[0015] In conjunction with the first aspect, in one possible implementation, the environmental space is a classroom space, the external system is a classroom observation system, and the first external control command is an external control command generated by the classroom observation system upon recognizing the presence of a target student in the classroom image. The target student is a student in a standing position, and the target microphone is the microphone closest to the target student. Alternatively, the environmental space is a conference space, the external system is a conference system, and the first external control command is an external control command generated by the conference system upon recognizing the presence of a target participant in the conference image. The target participant is a participant in a speaking position, and the target microphone is the microphone closest to the target participant.

[0016] Choosing the nearest sound pickup device helps it capture clear and effective sound.

[0017] In conjunction with the first aspect, in one possible implementation, after converting the audio data picked up by the microphone into audio-converted text, the method further includes: sending the device identifier of the target microphone to the external system, wherein the device identifier of the target microphone is used by the external system to generate the speaker identity corresponding to the audio-converted text.

[0018] Sending the device identifier of the sound pickup device to an external system helps the external system distinguish the speaker's identity information based on the device.

[0019] In conjunction with the first aspect, in one possible implementation, the method further includes: receiving a second external control instruction, the second external control instruction being an external control instruction generated when the external system detects the start of a preset event, the second external control instruction being used to instruct the audio management device and / or the pickup device and / or the broadcasting device to be turned on; the preset event including classroom teaching or a meeting; and responding to the second external control instruction by turning on the audio management device and / or the pickup device and / or the broadcasting device.

[0020] When a second external control command is received from an external system that detects the start of a preset event such as a classroom teaching session or meeting, the system responds to the second external control command and turns on the devices in the audio device management system. This helps to realize the intelligent turn-on of audio devices and thus achieves linkage control between systems.

[0021] In conjunction with the first aspect, in one possible implementation, after receiving the second external control instruction, the method further includes: receiving a third external control instruction, wherein the third external control instruction is an external control instruction generated by the external system upon detecting the end of the preset event, and the third external control instruction is used to instruct the audio management device and / or the pickup device and / or the broadcasting device to be turned off; and responding to the third external control instruction, turning off the audio management device and / or the pickup device and / or the broadcasting device.

[0022] When a third external control command is received from an external system that indicates the end of a preset event such as a classroom teaching session or meeting, the system responds to the third external control command and shuts down the devices in the audio device management system. This helps to achieve intelligent shutdown of audio devices and thus realizes linkage control between systems.

[0023] In conjunction with the first aspect, in one possible implementation, the method further includes: receiving a fourth external control instruction, the fourth external control instruction being used to instruct the adjustment of device parameters of the audio management device and / or the pickup device and / or the broadcasting device; and responding to the fourth external control instruction to adjust the device parameters of the pickup device and / or the broadcasting device.

[0024] When a fourth external control command is received from an external system to instruct the adjustment of device parameters of devices in the audio device management system, the device responds to the fourth external control command, adjusts the device parameters, and realizes linkage control and adjustment between systems.

[0025] In conjunction with the first aspect, in one possible implementation, the audio device management system further includes an audio management server connected to the audio management device; the method further includes: receiving an internal management instruction, the internal management instruction being an instruction sent by the audio management server to the audio management device; the internal management instruction being used to instruct the configuration of device parameters for the audio management device and / or the pickup device and / or the broadcasting device; the internal management instruction being generated by the audio management server based on audio device management operations performed by a user on an audio device management page, the audio device management page being a webpage; and responding to the internal management instruction by configuring the device parameters for the audio management device and / or the pickup device and / or the broadcasting device.

[0026] When an internal management instruction is received from the audio management server to instruct on configuring device parameters, the device parameters are adjusted in response to the internal control instruction. Since the audio device management page is a web page, users can adjust the device parameters through a browser without installing audio device management software, which is beneficial for remote configuration and management.

[0027] Secondly, an audio device control apparatus is provided, applied to an audio management device in an audio device management system, the audio device management system including the audio management device, a pickup device, and a broadcasting device, the apparatus comprising:

[0028] An external command receiving module is used to receive a first external control command. The first external control command is an external control command generated by an external system when it detects sound-emitting behavior in the environmental space where the audio device management system is located. The external control command is a command sent by the external system to the audio management device by calling the application programming interface of the audio management device. The first external control command is used to instruct the pickup device to pick up sound.

[0029] The pickup control module is used to respond to the first external control command and control the pickup device to pick up sound.

[0030] The data conversion module is used to convert the audio data picked up by the sound pickup device into audio-to-text.

[0031] The text sending module is used to send the audio-converted text to the external system, and the audio-converted text is used by the external system to generate audio-related text associated with the system functions of the external system.

[0032] Thirdly, a computer device is provided, including a memory and a processor, the memory being connected to the processor, the processor being configured to execute one or more computer programs stored in the memory, wherein when the processor executes the one or more computer programs, the computer device performs the audio device control method of the first aspect described above.

[0033] Fourthly, a computer-readable storage medium is provided, which stores a computer program, the computer program including program instructions, which, when executed by a processor, cause the processor to perform the audio device control method of the first aspect.

[0034] This application can achieve the following technical effects: Since the first external instruction is an external control instruction generated by the external system when it detects sound activity in the environment space where the audio device management system is located, and the external control instruction is the control instruction sent to the audio management device by the application of the external system calling the audio management device, it is equivalent to automatically controlling the sound pickup device in the audio device management system to pick up sound when the external control system detects sound activity, enriching the control methods of the audio device, facilitating the integration and linkage of multiple systems, and realizing intelligent control of the audio device; in addition, converting the audio data picked up by the sound pickup device into audio-converted text and sending it to the external system helps to generate intelligent text and enriches the system functions of the external system. Attached Figure Description

[0035] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments of this application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0036] Figure 1 A schematic diagram of the system architecture of an audio device management system provided in this application embodiment;

[0037] Figure 2 A schematic diagram of an audio device management page provided in an embodiment of this application;

[0038] Figure 3 A flowchart illustrating an audio device control method provided in an embodiment of this application;

[0039] Figure 4 A schematic diagram of an audio device management page provided in an embodiment of this application;

[0040] Figure 5 A flowchart illustrating another audio device control method provided in an embodiment of this application;

[0041] Figure 6 This is a schematic diagram of the structure of an audio device control device provided in an embodiment of this application;

[0042] Figure 7 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. Detailed Implementation

[0043] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application. All other embodiments obtained by those skilled in the art based on the embodiments in this application without inventive effort are within the scope of protection of this application.

[0044] It should be noted that, unless there is a conflict, the various features in the embodiments of this application can be combined with each other, all of which are within the protection scope of this application. Furthermore, although functional modules are divided in the device schematic diagram and a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in a different order than the module division in the device or the order in the flowchart. Moreover, the terms "first," "second," and "third" used in this application do not limit the data or execution order, but only distinguish identical or similar items with essentially the same function and effect.

[0045] An audio device management system is a management system that integrates audio devices with audio-related functions, such as microphones, amplifiers, and speakers. All audio devices in an audio device management system are usually deployed in a specific space to work together to complete functions such as audio acquisition and audio output.

[0046] To manage audio devices in an audio device management system, users need to obtain the installation package of the audio device management software and install it on their computer. Then, the computer and audio devices need to be connected to the same local area network. The installed audio device management software is then launched, and the system searches for audio devices in the system space. The computer displays a list of audio devices to the user. Based on this list, the user selects the desired audio device for management and control, such as configuring parameters, upgrading firmware, or turning the audio device on or off. This control and management method is simplistic, and the process of downloading and installing the audio device management software is relatively cumbersome. Furthermore, the installation package of the audio device management software may be incompatible with the computer device.

[0047] In view of this, this application proposes a control scheme for audio devices. Firstly, it presents an audio device management page presented in web page format. Users access the audio management server via a network address to enter the audio device management page and manage and control the audio devices, eliminating the need to download and install audio device management software, thus solving the problems of cumbersome operation and incompatibility with computer equipment. Secondly, this application adds an audio management device to the audio device management system for managing audio devices. The audio management device receives control commands issued by the audio management server based on user input on the audio device management page and control operations, and performs corresponding control on the audio devices. The audio management device also provides an application programming interface (API) for external systems to call. The system completes audio acquisition and output through an audio device management system. External systems, based on system functional requirements, call the application programming interface (API) of the audio management device to send control commands to the audio management device. These commands are used to control the pickup device's sound pickup, enable or disable it, and adjust its parameters, thus enabling the external system to control the audio device. This enriches the control methods for the audio device, facilitates the integration and linkage of multiple systems, and achieves intelligent control of the audio device. Furthermore, the audio management device of this application also converts the audio data picked up by the pickup device into audio-to-text and sends it to the external system, contributing to the generation of intelligent text and enriching the system functionality of the external system.

[0048] The technical solution of this application is described in detail below. For ease of understanding, the audio device management system of this application will be introduced first.

[0049] See Figure 1 , Figure 1 This application provides a schematic diagram of the system architecture of an audio device management system, as shown in the embodiments below. Figure 1As shown, the audio equipment management system 10 includes an audio management device 101, a microphone 102, and a broadcasting device 103. The audio management device 101 is connected to the microphone 102 and the broadcasting device 103, and is used to uniformly manage the microphone 102 and the broadcasting device 103, sending control commands to them. The audio management device 101 includes a digital audio processor for processing audio signals such as mixing, compression, limiting, and equalization. It also includes an automatic speech recognition (ASR) module for converting audio data into text. The connection between the audio management device 101 and the microphone 102 and the broadcasting device 103 can be wired or wireless. The sound pickup device 102 is used to collect sound signals, and includes, but is not limited to, microphones and microphones. The audio playback device 103 is used to process audio signals and then transmit them in a specific way to achieve sound playback, and includes loudspeakers and power amplifiers. There can be multiple sound pickup devices 102 and multiple audio playback devices 103, distributed and installed in different locations within the environment of the audio equipment management system 10. The environment of the audio equipment management system 10 refers to the space where the audio equipment management system 10 is deployed. For example, if the audio equipment management system 10 is deployed in a classroom, then the environment is the classroom space, and multiple sound pickup devices 102 and multiple audio playback devices 103 are distributed and installed in different locations within the classroom space. Similarly, if the audio equipment management system 10 is deployed in a conference space, then the environment is the conference space, and multiple sound pickup devices 102 and multiple audio playback devices 103 are distributed and installed in different locations within the conference space. These examples are not limited to those described here.

[0050] The audio device management system 10 also includes an audio management server 104, which is connected to the audio management device 101. The audio management server 104 provides various service resources required to access the audio device management page. The audio device management page refers to the page used to manage and control the audio management device 101, the pickup device 102, and the broadcasting device 103 in the audio device management system. For example, the audio device management page is as follows: Figure 2As shown. The audio management server 104 receives page access requests from user devices. These requests carry the network address of the audio management device 101 and are used to request access to the audio device management page. Based on the network address of the audio management device 101, the audio management server 104 returns the page resources required to display the audio device management page to the user device. The user device displays the audio device management page, which is a webpage. It receives audio device management operations performed by the user on the audio device management page. These operations include, but are not limited to, viewing the device list, configuring audio parameters, upgrading firmware, and configuring routing between the pickup and playback devices. The audio management server 104 also receives management control requests sent by the user device based on the various audio device management operations performed by the user on the audio device management page. Based on these management control requests, it sends corresponding management instructions to the audio management device 101 to instruct the audio management device 101 to perform corresponding control and processing. The audio management device 101 also includes a management service module, which receives management instructions sent by the audio management server 104, parses and executes these instructions to control and process the corresponding audio devices.

[0051] based on Figure 1 The audio device management system 10 shown can implement the technical solution of this application, and the technical solution of this application is applied to the audio management device 101 in the audio device management system. The technical solution of this application is described in detail below.

[0052] See Figure 3 , Figure 3 This is a flowchart illustrating an audio device control method provided in an embodiment of this application, as shown below. Figure 3 As shown, the method includes:

[0053] S201, Receive the first external control command.

[0054] Here, the first external control command is generated by the external system upon detecting sound activity in the environment in which the audio device management system is located. Sound activity in the environment in which the audio device management system is located means that someone in the environment is about to speak or is currently speaking.

[0055] An external system refers to a functional system designed for the environment in which the audio equipment management system operates, capable of combining with other data acquisition hardware (such as cameras, temperature sensors, etc.) to achieve data acquisition, data analysis, and data application. The definition of the external system varies depending on the environment in which the audio equipment management system operates. In a specific embodiment, the environment in which the audio equipment management system operates is a classroom space, and the external system is a classroom observation system. The classroom observation system is used for real-time observation and analysis of the classroom teaching process. It collects classroom sounds through the sound pickup devices in the audio equipment management system, captures classroom behavior of teachers and students through cameras, and combines audio processing software and behavior analysis software to achieve functions such as remote teaching management and teaching evaluation. The external system detecting sound activity in the environment in which the audio equipment management system operates means that the classroom observation system detects that a student / teacher in the classroom space is about to speak or is currently speaking. In another specific embodiment, the environment in which the audio device management system is located is a conference space, and the external system is a conference system. The conference system is a system used to organize and manage conferences. The conference system collects the voices of participants through the sound pickup devices in the audio device management system, plays conference audio through the broadcasting devices in the audio device management system, captures conference images through cameras, and displays conference content through displays. It also integrates with conference management software, video conferencing software, etc., to realize conference booking functions, conference recording functions, etc. The external system detects the presence of sound activity in the environment in which the audio device management system is located, which means that the conference system detects that there are participants in the conference space who are about to speak or are speaking.

[0056] External control commands are control commands sent from external systems to the audio management device via its application programming interface.

[0057] The first external control command is used to instruct the pickup device to pick up sound.

[0058] In some embodiments, the audio device management system has multiple pickup devices and multiple broadcasting devices, which are distributed in different locations in the environmental space. A first external control command is used to instruct a target pickup device among the multiple pickup devices to pick up sound. The target pickup device includes some of the multiple pickup devices.

[0059] In a classroom setting where the audio device management system operates, an external system captures classroom images via cameras. The system identifies whether a target student (a standing student) is present in the images. If the target student is detected, indicating a tendency to speak, the external system determines the closest microphone to the student as the target microphone based on the location information of multiple microphones and the target student. This target microphone is then sent to the audio management device with a first external control command. This command includes the target microphone's identifier, which uniquely identifies the target microphone among multiple microphones, thus directing it to pick up sound. Alternatively, the external system can send the target student's location information along with the first external control command to the audio management device. The audio management device then determines the closest microphone to the student as the target microphone based on this information. In this case, the external system uses behavioral analysis software to identify the target student in the classroom images.

[0060] In a meeting space where the audio device management system operates, an external system captures meeting images via cameras within the meeting space. The external system identifies whether a target participant (in a speaking position) is present in the meeting images. If the target participant is detected, the external system, based on the location information of multiple microphones and the target participant within the meeting space, determines the microphone closest to the target participant as the target microphone and sends a first external control command to the audio management device. This first external control command carries the device identifier of the target microphone. Alternatively, the external system sends the target participant's location information within the first external control command to the audio management device, which then determines the microphone closest to the target participant based on the location information of both the target participant and the multiple microphones. The external system uses meeting management software to identify the target participant in the meeting images.

[0061] Choosing the nearest sound pickup device helps to capture clear and effective sound.

[0062] S202, responding to the first external control command, controls the pickup device to pick up sound.

[0063] The audio management device sends a pickup command to the pickup device according to a first external control command, thereby controlling the pickup device to pick up sound. After receiving the pickup command, the pickup device picks up the sound in the ambient space to form audio data, and sends the audio data to the audio management device.

[0064] When a first external control command instructs a target microphone among multiple microphones to pick up sound, the audio management device sends a pickup command to the target microphone according to the first external control command to control the target microphone to pick up sound. After receiving the pickup command, the target microphone picks up sound from the ambient space to form audio data and sends the audio data to the audio management device.

[0065] In some embodiments, when a first external control instruction is used to instruct a target pickup device among a plurality of pickup devices to pick up sound, responding to the first external control instruction to control the pickup device to pick up sound includes: responding to the first external control instruction to control the target pickup device to pick up sound, and controlling a target broadcasting device associated with the target pickup device to play the audio data picked up by the target pickup device.

[0066] Among them, the target audio-visual device associated with the target audio-visual device refers to the target audio-visual device that uses the audio data picked up by the target audio-visual device as the input source, and transmits the audio data picked up by the target audio-visual device to the target audio-visual device for playback.

[0067] The association between the target broadcasting device and the target pickup device is pre-configured, allowing for the pre-configuration of associations between multiple pickup devices and one broadcasting device. Thus, when there are multiple target pickup devices, the audio data picked up by these devices is processed by the audio management device and then output to the same broadcasting device for playback.

[0068] By responding to the first external control command, the target microphone can be controlled to pick up sound, thus enabling targeted control of the microphone and avoiding the picking up of irrelevant sounds. The target broadcasting device associated with the target microphone can be controlled to play the audio data picked up by the target microphone, and the audio data picked up by multiple microphones can be combined into one output, thereby preventing feedback caused by multiple people speaking at the same time.

[0069] In some cases, the association between the target broadcasting device and the target pickup device is configured through the audio device management page. For an introduction to the audio device management page, please refer to the previous section. Figure 1The corresponding description is as follows. The audio device management page for configuring associations includes an audio input device list and an audio output device list. The audio input device list is obtained by the user adding audio input devices on the audio device management page. This list includes one or more audio input devices used to input audio signals to the audio management device. The audio input devices in this list include target pickup devices. The audio output device list is obtained by the user adding audio output devices on the audio device management page. This list includes one or more audio output devices used to receive audio signals output by the audio management device. The audio output devices in this list include target broadcasting devices. The audio device management page for configuring associations also includes routing arrows to indicate the association between target broadcasting devices and target pickup devices. For example, the audio device management page for configuring associations can be as follows: Figure 4 As shown, Figure 4 L1 in the text represents the list of audio input devices. Figure 4 L2 in the text represents the list of audio output devices. Figure 4 In the diagram, J1 represents the routing arrow. J1 indicates that the audio signals input from the audio input devices in the audio input device list L1 are processed and transmitted by the audio management device and then output by the audio output devices in the audio output device list L2.

[0070] The audio device management page allows you to configure the relationship between the pickup and broadcast devices, and the routing arrows on the audio device management page indicate the relationship between the broadcast and pickup devices. This helps to flexibly configure the transmission link between the broadcast and pickup devices and to intuitively display the relationship between them.

[0071] S203 converts the audio data picked up by the sound pickup device into audio-to-text.

[0072] The audio management device processes the audio data picked up by the sound pickup device through the ASR module, and converts it into audio-to-text.

[0073] S204, Send audio-to-text conversion to an external system.

[0074] Here, the audio-to-text conversion is used by an external system to generate audio-related text associated with the system functions of that external system. The definition of the audio-related text differs depending on the specific functions of the external system. In one specific embodiment, the external system is a classroom observation system with the function of generating speaking records, and the audio-related text is the classroom dialogue text. In another specific embodiment, the external system is a conference system with the function of generating meeting minutes, and the audio-related text is the meeting minutes. This application does not limit the scope of this application.

[0075] In some embodiments, after converting the audio data picked up by the pickup device into audio-to-text, the method further includes sending the device identifier of the target pickup device to an external system.

[0076] The device identifier of the target audio pickup device is used by an external system to generate the speaker identity corresponding to the audio-to-text conversion.

[0077] After receiving the device identifier of the target microphone from the audio management device, the external system generates a speaker identity identifier corresponding to the device identifier of the target microphone and binds the generated speaker identity identifier to the audio-to-text conversion.

[0078] Taking n microphones as an example, assuming the device identifiers of the n microphones are device1, device2, ..., device, and the device identifier of the target microphone is device2, and the audio-to-text is "What I want to say is...", after receiving the device identifier device2 of the target microphone, the external system generates a speaker identity identifier "speaker 2" corresponding to the device identifier of the target microphone. The external system binds the generated speaker identity identifier with the audio-to-text to generate the text "speaker 2: What I want to say is..." carrying the speaker identity.

[0079] In the above Figure 3In the corresponding technical solution, when the audio management device in the audio equipment management system receives a first external control command instructing the pickup device to pick up sound, it responds to the first external control command, controls the pickup device to pick up sound, and converts the audio data picked up by the pickup device into audio-converted text, which is then sent to the external system. The audio-converted text is used by the external system to generate audio-related text associated with the system functions of the external system. Since the first external command is an external control command generated by the external system when it detects sound activity in the environment where the audio equipment management system is located, and the external control command is a control command sent to the audio management device by the external system calling the application of the audio management device, it is equivalent to automatically controlling the pickup device in the audio equipment management system to pick up sound when the external control system detects sound activity. This enriches the control methods of the audio device, facilitates the integration and linkage of multiple systems, and realizes intelligent control of the audio device. In addition, converting the audio data picked up by the pickup device into audio-converted text and sending it to the external system helps to generate intelligent text and enriches the system functions of the external system.

[0080] In some embodiments, the above Figure 3 The corresponding technical solutions also include Figure 5 The corresponding process steps include the following steps S301-S304:

[0081] S301 receives a second external control command.

[0082] Here, the second external control command is the external control command generated when the external system detects the start of a preset event. The preset event is classroom teaching or a meeting.

[0083] The second external control command is used to instruct the activation of the audio management device and / or the pickup device and / or the broadcasting device.

[0084] The pre-set event is a classroom teaching session or a meeting.

[0085] When the external system is a classroom observation system, the preset event is classroom teaching. In one feasible implementation, the external system obtains an electronic timetable corresponding to the environment space where the audio device management system is located. The electronic timetable records the course name, start time, and end time. The external system determines whether the course start time has been reached based on the electronic timetable. If the start time has been reached, the preset event is determined to begin, and the external system sends a second external control command to the audio management device. Optionally, the external system can also determine whether classroom teaching has started based on changes in the classroom image to determine whether the preset event has started.

[0086] When the external system is a conferencing system, the preset event is a meeting. In one feasible implementation, the external system obtains meeting reservation records, which include meeting time and location. Based on the meeting location in the reservation records, the external system determines the meeting time corresponding to the environment space where the audio equipment management system is located. Based on the meeting time corresponding to the environment space where the audio equipment management system is located, the external system determines whether the meeting has started, thereby determining whether the preset event has started. If the preset event has started, the external system sends a second external control command to the audio management device. Optionally, the external system can also determine whether the meeting has started based on changes in the meeting image, thereby determining whether the preset event has started.

[0087] S302, in response to a second external control command, activate the audio management device and / or the pickup device and / or the broadcasting device.

[0088] In steps S301-S302 above, when a second external control command is received from an external system that detects the start of a preset event such as classroom teaching or a meeting, the system responds to the second external control command and turns on the devices in the audio device management system. This helps to realize the intelligent turning on of audio devices and thus achieves linkage control between systems.

[0089] S303 receives a third external control command.

[0090] Here, the third external control instruction is an external control instruction generated by the external system when it detects the end of a preset event. The third external control instruction is used to instruct the audio management device and / or the pickup device and / or the broadcasting device to be turned off.

[0091] Similar to the aforementioned method for determining whether a preset event has started, the external system can determine whether a preset event has ended based on the electronic timetable or meeting reservation records corresponding to the environment space where the audio equipment management system is located; or, it can determine whether a preset event has ended based on changes in the classroom or meeting images. If the preset event has ended, the external system sends a third external control command to the audio management device.

[0092] S304, in response to a third external control command, shut down the audio management device and / or the pickup device and / or the broadcasting device.

[0093] In steps S303-S304 above, when a third external control command is received from an external system that detects the end of a preset event such as a classroom teaching or meeting, the system responds to the third external control command and shuts down the devices in the audio device management system. This helps to realize the intelligent shutdown of audio devices and thus achieves linkage control between systems.

[0094] In some embodiments, the above Figure 3 The corresponding technical solution also includes the following steps A1-A2:

[0095] A1. Receive the fourth external control command.

[0096] Here, the fourth external control command is used to instruct the adjustment of the device parameters of the audio management device and / or the pickup device and / or the broadcasting device. The device parameters include network connection status, audio parameters, etc. The audio parameters of the audio management device include equalizer, reverb, noise suppression, etc. The pickup device includes the volume of the picked-up sound, etc. The audio parameters of the broadcasting device include the effect of the played sound, etc.

[0097] A2. Respond to the fourth external control command and adjust the equipment parameters of the pickup device and / or broadcasting device.

[0098] In steps A1-A2 above, when a fourth external control command is received from an external system to instruct the adjustment of device parameters of devices in the audio device management system, the device parameters are adjusted in response to the fourth external control command, thereby realizing the linkage control and adjustment between systems.

[0099] In some embodiments, the above Figure 3 The corresponding technical solution also includes the following steps B1-B2:

[0100] A1. Receive internal management instructions.

[0101] Here, internal management commands are commands sent from the audio management server to the audio management devices. For an introduction to the audio management server, please refer to the previous section. Figure 1 The corresponding description.

[0102] Internal management instructions are used to instruct on the device parameters for configuring audio management devices and / or pickup devices and / or broadcasting devices.

[0103] Internal management commands are generated by the audio management server based on audio device management operations performed by the user on the audio device management page. For an introduction to the audio device management page and its operations, please refer to the aforementioned... Figure 1 The corresponding description.

[0104] In some embodiments, the audio device management page is displayed in the user's device browser after the user has been authenticated by the audio management server. The audio management server verifies the user's identity by verifying the authentication information sent by the user's device browser.

[0105] Specifically, the user enters the network address of the audio management device (e.g., http: / / 192.168.1.100) in the user's device browser. The user's device browser sends an access request to the audio management server, and a login page is displayed in the user's device browser. The user enters a pre-set username and password on the login page, and the user's device browser submits the username and password to the audio management server. After the audio management server successfully verifies the username and password, it sends the page resources of the audio device management page to the user's device browser. The user's device browser loads the page resources of the audio device management page to display the audio device management page.

[0106] A2. Respond to internal management instructions and configure the device parameters of audio management devices and / or pickup devices and / or broadcasting devices.

[0107] The audio management device parses internal management instructions through the management service module and configures the device parameters of the audio management device and / or the pickup device and / or the broadcasting device according to the parsed instructions.

[0108] In steps A1-A2 above, when an internal management instruction for configuring device parameters is received from the audio management server, the device parameters are adjusted in response to the internal control instruction. Since the audio device management page is a web page, users can adjust the device parameters through a browser without installing audio device management software, which is beneficial for remote configuration and management.

[0109] The method of this application has been described above; the apparatus of this application will be described below.

[0110] See Figure 6 , Figure 6 This is a schematic diagram of the structure of an audio device control device provided in an embodiment of this application, as shown below. Figure 6 As shown, an audio management device is used in an audio device management system, such as... Figure 1 As shown, the audio device control device 40 includes:

[0111] The external instruction receiving module 401 is used to receive a first external control instruction. The first external control instruction is an external control instruction generated by an external system when it detects sound-emitting behavior in the environmental space where the audio device management system is located. The external control instruction is an instruction sent by the external system to the audio management device by calling the application programming interface of the audio management device. The first external control instruction is used to instruct the pickup device to pick up sound.

[0112] The sound pickup control module 402 is used to respond to the first external control command and control the sound pickup device to pick up sound;

[0113] Data conversion module 403 is used to convert the audio data picked up by the sound pickup device into audio-to-text;

[0114] The text sending module 404 is used to send the audio-converted text to the external system, and the audio-converted text is used by the external system to generate audio-related text related to the system functions of the external system.

[0115] It should be noted that the audio device control device 40 described above can execute the audio device control method provided in the embodiments of this application, and has the corresponding functional modules and beneficial effects for executing the method. Technical details not described in detail in the embodiments can be found in the audio device control method provided in the embodiments of this application.

[0116] See Figure 7 , Figure 7 This is a schematic diagram of the structure of a computer device 50 provided in an embodiment of this application. The computer device 50 includes a processor 501 and a memory 502. The memory 502 is connected to the processor 501, for example, via a bus.

[0117] Processor 501 is configured to support the computer device 50 in performing the corresponding functions in the methods described in the above method embodiments. Processor 501 may be a central processing unit (CPU), a network processor (NP), a hardware chip, or any combination thereof. The aforementioned hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a combination thereof. The aforementioned PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL), or any combination thereof.

[0118] Memory 502 is used to store program code, etc. Memory 502 may include volatile memory (VM), such as random access memory (RAM); memory 502 may also include non-volatile memory (NVM), such as read-only memory (ROM), flash memory, hard disk drive (HDD), or solid-state drive (SSD); memory 502 may also include combinations of the above types of memory.

[0119] The memory 502 is used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as the program instructions / modules corresponding to the audio device control method in the embodiments of this application. The processor executes various functional applications and data processing of the audio device control method by running the non-volatile software programs, instructions, and modules stored in the memory, thereby realizing the functions of the audio device control method provided in the above method embodiments.

[0120] Memory 502 may include a program storage area and a data storage area, wherein the program storage area may store the operating system and applications required for at least one function. The data storage area may store data created based on the use of the audio device control device, etc. In some embodiments, the memory may include memory remotely located relative to the processor, and such remote memory may be connected to the audio device control device via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0121] The one or more modules are stored in the memory. When executed by the one or more processors, they perform the audio device control method in any of the above method embodiments. For example, they perform the method steps described in the above method embodiments to realize the functions of the modules described in the above device embodiments.

[0122] This application also provides a computer-readable storage medium storing a computer program, the computer program including program instructions, which, when executed by a computer, cause the computer to perform the method described in the foregoing embodiments.

[0123] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. The storage medium can be a magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM), etc.

[0124] The above-disclosed embodiments are merely preferred embodiments of this application and should not be construed as limiting the scope of this application. Therefore, any equivalent variations made in accordance with the claims of this application shall still fall within the scope of this application.

Claims

1. A method for controlling an audio device, characterized in that, An audio management device is used in an audio device management system, the audio device management system including the audio management device, a pickup device, and a broadcasting device, the method comprising: The system receives a first external control instruction, which is an external control instruction generated by an external system when it detects sound activity in the environment where the audio device management system is located. The external control instruction is an instruction sent by the external system to the audio management device by calling the application programming interface of the audio management device. The first external control instruction is used to instruct the pickup device to pick up sound. In response to the first external control command, control the sound pickup device to pick up sound; The audio data picked up by the sound pickup device is converted into audio-to-text. The audio-converted text is sent to the external system, and the external system uses the audio-converted text to generate audio-related text associated with the system functions of the external system.

2. The method according to claim 1, characterized in that, There are multiple sound pickup devices and multiple sound broadcasting devices, which are distributed and arranged in different positions in the environmental space; the first external control command is used to instruct the target sound pickup device to pick up sound, and the target sound pickup device includes some of the multiple sound pickup devices; The step of responding to the first external control command and controlling the pickup device to pick up sound includes: In response to the first external control command, the target audio pickup device is controlled to pick up audio, and the target broadcasting device associated with the target audio pickup device is controlled to play the audio data picked up by the target audio pickup device.

3. The method according to claim 2, characterized in that, The association between the target broadcasting device and the target pickup device is configured through an audio device management page. The audio device management page for configuring the association includes an audio input device list and an audio output device list. The target pickup device is an audio input device in the audio input device list, and the target broadcasting device is an audio output device in the audio output device list. The audio device management page for configuring the association also includes a routing arrow, which is used to indicate the association between the target broadcasting device and the target pickup device.

4. The method according to claim 2, characterized in that, The environmental space is a classroom space, the external system is a classroom observation system, and the first external control command is generated by the classroom observation system upon detecting the presence of a target student in the classroom image. The target student is a student in a standing position, and the target microphone is the microphone closest to the target student; or... The environmental space is a conference space, the external system is a conference system, the first external control command is an external control command generated by the conference system when it recognizes the presence of a target participant in the conference image, the target participant is a participant in a speaking state, and the target sound pickup device is the sound pickup device closest to the target participant.

5. The method according to claim 2, characterized in that, After converting the audio data picked up by the sound pickup device into audio-to-text, the method further includes: The device identifier of the target microphone is sent to the external system, and the device identifier of the target microphone is used by the external system to generate the speaker identity corresponding to the audio-to-text conversion.

6. The method according to claim 1, characterized in that, The method further includes: Receive a second external control command, which is an external control command generated by the external system when it detects the start of a preset event. The second external control command is used to instruct the audio management device and / or the pickup device and / or the broadcasting device to be turned on; the preset event is classroom teaching or a meeting. In response to the second external control command, the audio management device and / or the pickup device and / or the broadcasting device are turned on.

7. The method according to claim 6, characterized in that, After receiving the second external control command, the method further includes: Receive a third external control instruction, which is an external control instruction generated by the external system when it detects that the preset event has ended, and the third external control instruction is used to instruct the audio management device and / or the pickup device and / or the broadcasting device to be turned off; In response to the third external control command, shut down the audio management device and / or the pickup device and / or the broadcasting device.

8. The method according to claim 1, characterized in that, The method further includes: Receive a fourth external control command, the fourth external control command being used to instruct the adjustment of the device parameters of the audio management device and / or the pickup device and / or the broadcasting device; In response to the fourth external control command, adjust the device parameters of the pickup device and / or the broadcasting device.

9. The method according to any one of claims 1-8, characterized in that, The audio device management system further includes an audio management server, which is connected to the audio management device. The method further includes: The system receives internal management instructions, which are instructions sent by the audio management server to the audio management device. The internal management instructions are used to instruct the configuration of device parameters for the audio management device and / or the pickup device and / or the broadcasting device. The internal management instructions are generated by the audio management server based on audio device management operations performed by the user on the audio device management page, which is a webpage. In response to the internal management instructions, configure the device parameters of the audio management device and / or the pickup device and / or the broadcasting device.

10. A computer device, characterized in that, The device includes a memory and a processor, the memory being connected to the processor, the processor being configured to execute one or more computer programs stored in the memory, and the processor, when executing the one or more computer programs, causing the computer device to perform the method as described in any one of claims 1-9.

11. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, the computer program including program instructions that, when executed by a processor, cause the processor to perform the method as described in any one of claims 1-9.

Images