Monitoring and early warning system, method and equipment and storage medium

Abstract

The invention relates to a monitoring and early warning system, method and device and a storage medium, and particularly relates to the field of security and protection monitoring. The monitoring and early warning system comprises a monitoring field device, a monitoring center and a security terminal. The monitoring field equipment is used for collecting audio information of a monitoring field in real time and sending audio data to the monitoring center when identifying that the audio information at the current time point triggers a preset value, and the audio data is data formed by combining the audio information near the current time point; the monitoring center is used for carrying out secondary audio analysis and processing on the audio data to obtain early warning information and pushing the early warning information to the security terminal; the security terminal is used for pushing the early warning information; wherein the preset value comprises at least one of a keyword, an emotion recognition result and a sound energy value. Based on the technical scheme, the accuracy of early warning identification can be effectively improved, and the false alarm possibility of monitoring early warning is reduced.

Description

Technical Field

[0001] The present invention relates to the field of security monitoring, and in particular to a monitoring early warning system, method, equipment and storage medium. Background Art

[0003] In order to solve the problem of limited camera monitoring scenes, monitoring microphones are generally used. However, due to the size, power supply and other characteristics of the terminal device, monitoring microphones cannot generally integrate high-computing power cards. Therefore, when monitoring early warning identification is performed on the monitoring microphone end, the results often have a high false alarm rate.

[0004] Therefore, how to reduce the possibility of false alarms in monitoring and early warning is an issue that needs to be addressed urgently. Summary of the invention

[0005] The present application provides a monitoring and early warning system, method, device and storage medium, and the technical solution is as follows.

[0006] On the one hand, a monitoring and early warning system is provided, the monitoring and early warning system comprising monitoring field equipment, a monitoring center and a security terminal;

[0007] The monitoring site equipment is used to collect audio information of the monitoring site in real time, and when it is recognized that the audio information at the current time point triggers a preset value, the audio data is sent to the monitoring center, and the audio data is the data composed of the audio information near the current time point;

[0008] The monitoring center is used to perform secondary audio analysis on the audio data, process to obtain warning information, and push the warning information to the security terminal;

[0009] The security terminal is used to push the warning information;

[0010] The preset value includes at least one of the following: a keyword, an emotion recognition result, and a sound energy value.

[0011] In a possible implementation, the monitoring field device is used to send a registration request to the monitoring center after being powered on;

[0012] The monitoring center is used to add the monitoring field device to the device management interface of the monitoring center based on the registration request.

[0013] In a possible implementation, partition information is set in the device management interface;

[0014] The monitoring center is used to set partition information for the monitoring field equipment according to the geographical location of the monitoring field equipment.

[0015] In a possible implementation, the monitoring center is used to initiate communication negotiation with the monitoring field device when receiving an active monitoring operation;

[0016] The monitoring field device is used to establish a communication connection with the monitoring center in response to the communication negotiation, wherein the communication connection includes one of the following: a point-to-point direct connection and a transit connection established through a data transit service;

[0017] The monitoring field device is used to transmit the audio data corresponding to the current time point to the monitoring center based on the communication connection.

[0018] In a possible implementation, the monitoring center is used to initiate communication negotiation with the monitoring field device when receiving a dialogue indication operation;

[0019] The monitoring field device is used to establish a communication connection with the monitoring center in response to the communication negotiation, wherein the communication connection includes one of the following: a point-to-point direct connection and a transit connection established through a data transit service;

[0020] The monitoring field device is used to transmit the audio data corresponding to the current time point to the monitoring center based on the communication connection;

[0021] The monitoring center is used to transmit the conversation voice data to the monitoring field device based on the communication connection, and the monitoring field device plays it.

[0022] In a possible implementation, the monitoring center is used to push a device adjustment message corresponding to the device adjustment operation to the message middleware when receiving the device adjustment operation;

[0023] The monitoring field device is used to respond to the topic message corresponding to the device adjustment message subscribed in the message middleware, and adjust the device under the triggering of the device adjustment message.

[0024] In a possible implementation manner, the device adjustment message includes any one of the following:

[0025] Preset value adjustment message, device upgrade message.

[0026] In a possible implementation, the monitoring center is also connected to a monitoring screen;

[0027] The monitoring screen is used to display the statistical analysis results corresponding to the warning information.

[0028] In another aspect, a monitoring and early warning method is provided, the method being applied to the monitoring center as described in the above aspect, the method comprising:

[0029] Receiving audio data sent by a monitoring site device, the audio data is data composed of audio information collected by the monitoring site device in real time near the current time point at the monitoring site, and the audio data is sent when the monitoring site device recognizes that the audio information at the current time point triggers a preset value;

[0030] Performing secondary audio analysis on the audio data to obtain warning information;

[0031] Pushing the warning information to the security terminal;

[0032] The preset value includes at least one of the following: a keyword, an emotion recognition result, and a sound energy value.

[0033] On the other hand, a computer device is provided, which includes a processor and a memory, wherein the memory stores at least one instruction, at least one program, code set or instruction set, and the at least one instruction, at least one program, code set or instruction set is loaded and executed by the processor to implement the above-mentioned monitoring and early warning method.

[0034] On the other hand, a computer-readable storage medium is provided, in which at least one instruction, at least one program, code set or instruction set is stored, and the at least one instruction, at least one program, code set or instruction set is loaded and executed by a processor to implement the above-mentioned monitoring and early warning method.

[0035] In another aspect, a computer program product or computer program is provided, the computer program product or computer program comprising computer instructions, the computer instructions being stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the above-mentioned monitoring and early warning method.

[0036] The technical solution provided by this application may have the following beneficial effects:

[0037] A monitoring and early warning system is provided. In this monitoring and early warning system, monitoring site equipment collects audio information of the monitoring site in real time. When it is recognized that the audio information at the current time point triggers a preset value, the audio data is sent to a monitoring center. The audio data is data composed of audio information near the current time point, and the preset value includes at least one of the following: keywords, emotion recognition results, and sound energy values. The monitoring center then performs secondary audio analysis on the audio data, processes it to obtain early warning information, and pushes the early warning information to a security terminal. By transmitting the audio data of the monitoring site equipment after the initial judgment by the preset value to the monitoring center, the high computing power model of the back-end monitoring center is used to perform secondary judgment and verification on the audio data, thereby avoiding the situation where the computing power on the monitoring site equipment side is insufficient, the accuracy of early warning recognition can be effectively improved, and the possibility of false alarm of monitoring early warning can be reduced. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] In order to more clearly illustrate the specific implementation methods of the present application or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0039] Figure 1 It is a schematic diagram of a monitoring and early warning system according to an exemplary embodiment.

[0040] Figure 2 The diagram is a schematic diagram of a device management interface according to an exemplary embodiment.

[0041] Figure 3 The figure is a schematic diagram of a partition management interface according to an exemplary embodiment.

[0042] Figure 4 The figure is a schematic diagram of an interface of a monitoring screen according to an exemplary embodiment.

[0043] Figure 5 The present invention is a method flow chart showing a monitoring and early warning method according to an exemplary embodiment.

[0044] Figure 6 is a schematic diagram of a computer device provided according to an exemplary embodiment. DETAILED DESCRIPTION

[0045] The technical solution of the present application will be described clearly and completely below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present application.

[0046] It should be understood that the "indication" mentioned in the embodiments of the present application can be a direct indication, an indirect indication, or an indication of an association relationship. For example, A indicates B, which can mean that A directly indicates B, for example, B can be obtained through A; it can also mean that A indirectly indicates B, for example, A indicates C, and B can be obtained through C; it can also mean that there is an association relationship between A and B.

[0047] In the description of the embodiments of the present application, the term "corresponding" may indicate a direct or indirect correspondence between two items, or an association relationship between the two items, or a relationship between indication and being indicated, configuration and being configured, and the like.

[0048] In an embodiment of the present application, "predefinition" can be achieved by pre-saving corresponding codes, tables or other methods that can be used to indicate relevant information in a device (for example, including a terminal device and a network device). The present application does not limit its specific implementation method.

[0049] In response to the problem that the monitoring and early warning in the relevant technology is not accurate and is prone to false alarms, in an embodiment of the present application, a monitoring system is provided, which has notification and early warning, automatic device registration, device monitoring, device dialogue, device preset value configuration, remote device upgrade, device partition management, and large-screen monitoring functions. Please see the embodiments below for details.

[0050] Combined with reference Figure 1 , which shows a monitoring and early warning system, which includes a monitoring field device 10, a monitoring center 20 and a security terminal 30.

[0051] Among them, the monitoring site device 10 is a device placed at the monitoring site for monitoring the monitoring site. The monitoring site device 10 can specifically collect and monitor the audio information of the monitoring site. The monitoring site device 10 is specifically an audio collection device such as a microphone 11. Further, in order to increase the function of the monitoring site device 10, the monitoring site device 10 can also integrate devices such as a speaker 12 and an early warning integrated machine 13 to realize functions such as early warning sound. The monitoring site device 10 can be connected to the campus network through a switch, so as to communicate with the monitoring center 20.

[0052] Among them, the monitoring center 20 is a device with high computing power, which supports processing audio data, analyzing the warning situation corresponding to the audio data, and outputting warning information. The computing power of the monitoring center 20 is specifically realized by a server cluster 21 composed of multiple computer devices. Further, in order to increase the functions of the monitoring center 20, the monitoring center 20 can also integrate monitoring screens 22, intercom systems and other equipment to realize functions such as device dialogue and monitoring large screens.

[0053] The security terminal 30 is a mobile terminal device owned by the security personnel, and the security terminal 30 can receive warning messages. The security terminal 30 can be specifically a terminal device such as a mobile phone, a tablet computer, or a headset.

[0054] In this early warning system, the monitoring site equipment is used to collect audio information of the monitoring site in real time. When it is recognized that the audio information at the current time point triggers the preset value, the audio data is sent to the monitoring center. The audio data is the data composed of the audio information near the current time point; the monitoring center is used to perform secondary audio analysis on the audio data, process it to obtain early warning information, and push the early warning information to the security terminal; the security terminal is used to push the early warning information; wherein the preset value includes at least one of the following: keywords, emotion recognition results, sound energy values.

[0055] That is, the monitoring and early warning system has the function of notification and early warning. It performs on-site monitoring through on-site monitoring equipment at the monitoring site, and collects audio content that triggers preset values ​​through network switches in each area to form audio data, which is transmitted to the monitoring center through the campus network. The monitoring center will perform secondary verification on the received audio content, issue an early warning message, and transmit it to the security terminal through the campus network.

[0056] Exemplarily, the monitoring and early warning function is specifically implemented as the following method flow:

[0057] (1) Monitoring equipment is installed in blind spots such as toilets, dormitories, and corridors according to different monitoring scenarios;

[0058] (2) The monitoring field equipment is started up through Power Over Ethernet (POE) or a combination of Ethernet cable and power supply;

[0059] (3) The monitoring equipment on site listens to the audio in real time during operation, and triggers the audio data transmission when the preset value is obtained. The audio data can be transmitted to the monitoring center through the message protocol of the Message Queuing Telemetry Transport (MQTT) publish-subscribe paradigm;

[0060] (4) After receiving the audio data transmitted by the monitoring site equipment, the back-end model located in the monitoring center performs a secondary verification and judgment to obtain more accurate warning information;

[0061] (5) When the monitoring center passes the judgment, it pushes the warning information to the security terminal to remind the security personnel to deal with it.

[0062] Among them, the preset value can be a keyword preset in advance. When the voice recognition detects this keyword, it is considered that the preset value is triggered, and the audio data is transmitted immediately; the preset value can be an emotion recognition result. When the voice recognition finds that the emotion corresponding to the current voice belongs to a certain category of emotion recognition results, it is considered that the preset value is triggered, and the audio data is transmitted immediately; the preset value can be a sound energy value. When the sound energy value meets a certain threshold, it is considered that the preset value is triggered, and the audio data is transmitted immediately.

[0063] It is understandable that the audio data is only the audio information within a period of time near the current time point, so it can effectively avoid the privacy issues of global monitoring and the problem of large audio storage space. In addition, at the monitoring site equipment end, the initial recognition verification is performed by whether the preset value is triggered, and then the verified audio information is composed of audio data and transmitted to the monitoring center. The high-computing power model of the back-end monitoring center is used to perform secondary audio analysis or secondary judgment verification, which can effectively improve the recognition accuracy, and this application does not limit the specific method of secondary audio analysis or secondary judgment verification adopted by the monitoring center.

[0064] In a possible implementation, the monitoring field device is used to send a registration request to the monitoring center after being powered on; the monitoring center is used to add the monitoring field device to the device management interface of the monitoring center based on the registration request.

[0065] In this implementation, the monitoring and early warning system has the function of automatic equipment registration. The monitoring field equipment can actively register with the monitoring center after being powered on, thereby simplifying the deployment of the monitoring and early warning system.

[0066] Exemplarily, the automatic registration function is specifically implemented as the following method flow:

[0067] (1) Monitoring equipment is installed in blind spots such as toilets, dormitories, and corridors according to different monitoring scenarios;

[0068] (2) The monitoring equipment on site is started up through POE or network cable combined with power supply;

[0069] (3) After the monitoring site equipment is powered on and started, a preset time interval is required, and then a pre-configured HTTP request is called to the server at the monitoring center to set up registration and maintain the heartbeat mechanism. The preset time can be 50ms to 1s;

[0070] (4) The server program at the monitoring center provides an HTTP interface. After receiving the registration request, the HTTP interface registers the device and keeps the interface channel unblocked;

[0071] (5) After the monitoring site equipment is registered, the server program located in the monitoring center should store the equipment and provide a management interface.

[0072] Exemplary, with reference to Figure 2 , Figure 2 This is a schematic diagram of the interface for managing monitoring field devices after automatic registration. In the figure, the monitoring field devices are presented in a list format, and an operation button is suspended on the information display line corresponding to each monitoring field device, including monitoring operation and dialogue operation, and the device management and upgrade operations after the selected operation are provided above the list in the figure.

[0073] In a possible implementation, partition information is set in the device management interface; the monitoring center is used to set the partition information for the monitoring field device according to the geographical location of the monitoring field device.

[0074] In this implementation, the monitoring and early warning system has the function of equipment zoning management. The monitoring center performs zoning management on the monitoring site equipment to quickly locate each monitoring site equipment and improve the efficiency of monitoring and early warning.

[0075] Exemplarily, the device partition management function is specifically implemented as the following method flow:

[0076] (1) The monitoring center backend control program enters the device management interface;

[0077] (2) Add and modify partitions based on the geographical location of the monitoring site equipment, and store the partition information in the database of the monitoring center;

[0078] (3) According to the geographical location of the monitoring site equipment, the equipment is moved or placed into the corresponding partition for association, and the partition information and equipment association information are stored in the database where the monitoring center is located;

[0079] Exemplary, with reference to Figure 3 , Figure 3 It is a schematic diagram of the interface for the partition management operation of the monitoring field equipment. The controls such as adding partitions, adding devices, and moving devices in the diagram are all for the logical partition management of the monitoring field equipment.

[0080] In one possible implementation, the monitoring center is used to initiate communication negotiation with the monitoring field device when an active monitoring operation is received; the monitoring field device is used to establish a communication connection with the monitoring center in response to the communication negotiation, and the communication connection includes one of the following: a point-to-point direct connection, a transit connection established through a data transit service; the monitoring field device is used to transmit the audio data corresponding to the current time point to the monitoring center based on the communication connection.

[0081] In this implementation, the monitoring and early warning system has the function of equipment monitoring, and the monitoring center can actively instruct the monitoring site equipment to report the monitored audio data, so that the monitoring-related situation can be obtained in time as needed.

[0082] Exemplarily, the device monitoring function is specifically implemented as the following method flow:

[0083] (1) The monitoring center receives a manual trigger operation to perform active monitoring on a certain monitoring field device;

[0084] (2) After manual triggering, a communication connection is established through the Web Real-Time Communications (WebRTC) technology, and a communication connection is established between the communication destination and the monitoring center operation end through the Signal service in the monitoring center;

[0085] (3) Determine whether a peer-to-peer (P2P) connection can be established;

[0086] (4) When it is determined that a P2P connection can be established, the communication connection is directly established in this manner, and the audio data transmitted by the monitoring site equipment is received to perform audio monitoring;

[0087] (5) When it is determined that communication cannot be carried out through P2P, the audio data transmitted by the monitoring site equipment is received after being transferred through a data transfer service (such as STUN or TURN) to perform audio monitoring.

[0088] In one possible implementation, the monitoring center is used to initiate communication negotiation with the monitoring field device upon receiving a dialogue indication operation; the monitoring field device is used to establish a communication connection with the monitoring center in response to the communication negotiation, and the communication connection includes one of the following: a point-to-point direct connection, a transfer established through a data transfer service; the monitoring field device is used to transmit the audio data corresponding to the current time point to the monitoring center based on the communication connection; the monitoring center is used to transmit the dialogue voice data to the monitoring field device based on the communication connection, and the monitoring field device plays it.

[0089] In this implementation, the monitoring and early warning system has the function of equipment dialogue. The monitoring center can take the initiative to dialogue with the monitoring site equipment. When there is an early warning, the dialogue can be manually intervened in time through real-time monitoring, and remote shouting deterrence can be achieved by transmitting the dialogue voice data to the monitoring site equipment.

[0090] Exemplarily, the device dialogue function is specifically implemented as the following method flow:

[0091] (1) The monitoring center receives a manual trigger operation to execute a dialogue instruction for a certain monitoring field device;

[0092] (2) After manual triggering, a communication connection is established through WebRTC technology, and a communication connection is established between the communication destination and the monitoring center operation end through the Signal service in the monitoring center;

[0093] (3) Determine whether a P2P connection can be established;

[0094] (4) When it is determined that a P2P connection can be established, the communication connection is directly established in this manner, and the audio data transmitted by the monitoring site equipment is received to perform audio monitoring; and the background control terminal of the monitoring center communicates with the monitoring site equipment and transmits the conversation voice data collected by the monitoring center to the monitoring site equipment in the above communication manner for real-time playback;

[0095] (5) When it is determined that communication cannot be carried out through P2P, the audio data transmitted by the monitoring site equipment is received after being transferred through a data transfer service (such as STUN or TURN) to carry out audio monitoring; and the background control end of the monitoring center communicates with the monitoring site equipment and transmits the conversation voice data collected by the monitoring center to the monitoring site equipment for real-time playback using the above communication method.

[0096] In one possible implementation, the monitoring center is used to push the device adjustment message corresponding to the device adjustment operation to the message middleware when receiving the device adjustment operation; the monitoring field equipment is used to respond to the topic message corresponding to the device adjustment message subscribed in the message middleware, and adjust the device when triggered by the device adjustment message.

[0097] The device adjustment message includes any one of the following: a preset value adjustment message and a device upgrade message.

[0098] In this implementation, the monitoring and early warning system has the functions of equipment preset value configuration and equipment remote upgrade. The monitoring center can adopt a dynamic adjustment strategy for the monitored on-site equipment, realize dynamic adjustment of preset values ​​and remote upgrade of firmware programs, thereby avoiding the situation where the original settings cannot match the current situation, increasing the robustness of the entire method and system.

[0099] Exemplarily, the device preset value configuration and device remote upgrade functions are specifically implemented as the following method flow:

[0100] (1) The backend control terminal of the monitoring center initiates the device adjustment operation on the monitoring field equipment in the device management interface, and pushes the preset value adjustment message or device upgrade message to the specified message middleware using the MQTT protocol.

[0101] (2) The message middleware specified by MQTT receives and stores the corresponding preset value adjustment message or device upgrade message for subsequent devices to consume and process;

[0102] (3) After the monitoring field equipment subscribes to the specified topic message, it triggers the change of preset values ​​and firmware upgrade according to the corresponding instructions.

[0103] In a possible implementation, the monitoring center is also connected to a monitoring screen; the monitoring screen is used to display the statistical analysis results corresponding to the warning information.

[0104] In this implementation, the monitoring and early warning system has the function of monitoring a large screen. When the monitoring center determines that an early warning message has occurred, a real-time early warning is broadcast on the monitoring screen to facilitate security personnel to handle the early warning information in a timely manner.

[0105] Exemplarily, the monitoring large screen function is specifically implemented as the following method flow:

[0106] (1) The monitoring screen will remain in this monitoring interface for a long time to obtain real-time warning broadcast notifications;

[0107] (2) The corresponding program of the monitoring screen performs polling at a predetermined interval to obtain the warning data and statistical information of the monitoring center background. The predetermined time can be 50ms-1s;

[0108] (3) When the warning information is obtained through polling, the warning information will be displayed in the center of the corresponding program on the monitoring screen;

[0109] (4) In the warning information obtained, security personnel can mark the warning and perform other processing.

[0110] Exemplary, with reference to Figure 4 , Figure 4It is an interface diagram of the monitoring screen. The left part of the interface diagram displays the online status of the terminals corresponding to the monitoring field equipment in the monitoring and early warning system, the alarm terminal statistics and the alarm location statistics; the middle part displays the notifications of the monitoring and early warning system and rotates them in real time; the right part displays the alarm type analysis, time period alarm statistics and alarm trend analysis.

[0111] To summarize, the technical solution provided by the present application provides a monitoring and early warning system. In this monitoring and early warning system, the monitoring site equipment collects audio information of the monitoring site in real time. When it is identified that the audio information at the current time point triggers the preset value, the audio data is sent to the monitoring center. The audio data is a combination of audio information near the current time point, and the preset value includes at least one of the following: keywords, emotion recognition results, sound energy values. The monitoring center then performs a secondary audio analysis on the audio data, processes it to obtain early warning information, and pushes the early warning information to the security terminal; by transmitting the audio data of the monitoring site equipment after the initial judgment by the preset value to the monitoring center, and using the high computing power model of the back-end monitoring center to perform a secondary judgment and verification on the audio data, the situation of insufficient computing power on the monitoring site equipment side can be avoided, which can effectively improve the accuracy of early warning recognition and reduce the possibility of false alarm of monitoring early warning.

[0112] Furthermore, the preset values ​​set for the monitoring field equipment can be remotely controlled through the back-end program, and the remote firmware upgrade can be performed on the monitoring field equipment, thereby improving the robustness of the monitoring and early warning system.

[0113] Figure 5 1 is a method flow chart of a monitoring and early warning method according to an exemplary embodiment. The method can be applied to the monitoring center in the early warning system as described in the above embodiment, and the method includes:

[0114] Step 51: Receive audio data sent by the monitoring field device.

[0115] The audio data is data composed of audio information collected by the monitoring site equipment in real time near the current time point at the monitoring site. The audio data is sent when the monitoring site equipment recognizes that the audio information at the current time point triggers a preset value.

[0116] Among them, the preset value includes at least one of the following: keywords, emotion recognition results, and sound energy values.

[0117] Step 52: Perform secondary audio analysis on the audio data to obtain warning information.

[0118] Step 53: Push the warning information to the security terminal.

[0119] It should be noted that the method provided in the above embodiment and the system embodiment corresponding to the above monitoring and early warning system belong to the same concept, and the specific implementation process is detailed in the system embodiment, which will not be repeated here.

[0120] To summarize, the technical solution provided by the present application provides a monitoring and early warning method, in which the monitoring site equipment collects audio information of the monitoring site in real time, and when it is identified that the audio information at the current time point triggers the preset value, the audio data is sent to the monitoring center. The audio data is a combination of audio information near the current time point, and the preset value includes at least one of the following: keywords, emotion recognition results, and sound energy values. The monitoring center then performs a secondary audio analysis on the audio data, processes it to obtain early warning information, and pushes the early warning information to the security terminal; by transmitting the audio data of the monitoring site equipment after the initial judgment by the preset value to the monitoring center, and using the high computing power model of the back-end monitoring center to perform a secondary judgment and verification on the audio data, the situation of insufficient computing power on the monitoring site equipment side can be avoided, which can effectively improve the accuracy of early warning recognition and reduce the possibility of false alarms in monitoring early warnings.

[0121] See also Figure 6 , which is a schematic diagram of a computer device provided according to an exemplary embodiment of the present application. The computer device can be specifically implemented as a monitoring center. The computer device includes a memory and a processor. The memory is used to store a computer program. When the computer program is executed by the processor, the above-mentioned monitoring and early warning method is implemented.

[0122] The processor may be a central processing unit (CPU). The processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or a combination of the above chips.

[0123] As a non-transitory computer-readable storage medium, the memory can be used to store non-transitory software programs, non-transitory computer executable programs and modules, such as program instructions / modules corresponding to the method in the embodiment of the present invention. The processor executes various functional applications and data processing of the processor by running the non-transitory software programs, instructions and modules stored in the memory, that is, implementing the method in the above method embodiment.

[0124] The memory may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created by the processor, etc. In addition, the memory may include a high-speed random access memory, and may also include a non-transitory memory, such as at least one disk storage device, a flash memory device, or other non-transitory solid-state storage device. In some embodiments, the memory may optionally include a memory remotely disposed relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0125] In an exemplary embodiment, a computer-readable storage medium is also provided, which is used to store at least one computer program, and the at least one computer program is loaded and executed by a processor to implement all or part of the steps in the above method. For example, the computer-readable storage medium can be a read-only memory (ROM), a random access memory (RAM), a compact disc read-only memory (CD-ROM), a magnetic tape, a floppy disk, an optical data storage device, etc.

[0126] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. The present application is intended to cover any variations, uses or adaptations of the present application, which follow the general principles of the present application and include common knowledge or customary techniques in the art that are not disclosed in the present application. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present application are indicated by the following claims.

[0127] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

Claims

1. A monitoring and early warning system, characterized in that: The monitoring and early warning system includes monitoring on-site equipment, a monitoring center and a security terminal; The monitoring site equipment is used to collect audio information of the monitoring site in real time, and when it is recognized that the audio information at the current time point triggers a preset value, the audio data is sent to the monitoring center, and the audio data is the data composed of the audio information near the current time point; The monitoring center is used to perform secondary audio analysis on the audio data, process to obtain warning information, and push the warning information to the security terminal; The security terminal is used to push the warning information; The preset value includes at least one of the following: a keyword, an emotion recognition result, and a sound energy value.

2. The system according to claim 1, characterized in that The monitoring field device is used to send a registration request to the monitoring center after being powered on; The monitoring center is used to add the monitoring field device to the device management interface of the monitoring center based on the registration request.

3. The system according to claim 2, characterized in that Partition information is set in the device management interface; The monitoring center is used to set partition information for the monitoring field equipment according to the geographical location of the monitoring field equipment.

4. The system according to claim 1, characterized in that The monitoring center is used to initiate communication negotiation with the monitoring field device when receiving an active monitoring operation; The monitoring field device is used to establish a communication connection with the monitoring center in response to the communication negotiation, wherein the communication connection includes one of the following: a point-to-point direct connection and a transit connection established through a data transit service; The monitoring field device is used to transmit the audio data corresponding to the current time point to the monitoring center based on the communication connection.

5. The system according to claim 1, characterized in that The monitoring center is used to initiate communication negotiation with the monitoring field device when receiving a dialogue indication operation; The monitoring field device is used to establish a communication connection with the monitoring center in response to the communication negotiation, wherein the communication connection includes one of the following: a point-to-point direct connection and a transit connection established through a data transit service; The monitoring field device is used to transmit the audio data corresponding to the current time point to the monitoring center based on the communication connection; The monitoring center is used to transmit the conversation voice data to the monitoring field device based on the communication connection, and the monitoring field device plays it.

6. The system according to claim 1, characterized in that The monitoring center is used to push a device adjustment message corresponding to the device adjustment operation to the message middleware when receiving the device adjustment operation; The monitoring field device is used to respond to the topic message corresponding to the device adjustment message subscribed in the message middleware, and adjust the device under the triggering of the device adjustment message.

7. The system according to claim 6, characterized in that The device adjustment message includes any one of the following: Preset value adjustment message, device upgrade message.

8. The system according to claim 1, characterized in that The monitoring center is also connected to a monitoring screen; The monitoring screen is used to display the statistical analysis results corresponding to the warning information.

9. A monitoring and early warning method, characterized in that: The method is applied in the monitoring center according to any one of claims 1 to 8, and the method comprises: Receiving audio data sent by a monitoring site device, the audio data is data composed of audio information collected by the monitoring site device in real time near the current time point at the monitoring site, and the audio data is sent when the monitoring site device recognizes that the audio information at the current time point triggers a preset value; Performing secondary audio analysis on the audio data to obtain warning information; Pushing the warning information to the security terminal; The preset value includes at least one of the following: a keyword, an emotion recognition result, and a sound energy value.

10. A computer device, characterized in that: The computer device includes a processor and a memory, and the memory stores at least one instruction, at least one program, code set or instruction set. The at least one instruction, at least one program, code set or instruction set is loaded and executed by the processor to implement the monitoring and early warning method as described in claim 9.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores at least one instruction, at least one program, code set or instruction set, and the at least one instruction, at least one program, code set or instruction set is loaded and executed by the processor to implement the monitoring and early warning method as described in claim 9.

Images