Emergency situation processing method and device, alarm equipment and storage medium

Abstract

The embodiment of the invention discloses an emergency processing method and device, alarm equipment and a storage medium, the method is applied to the alarm equipment, the alarm equipment comprises a camera and a sound acquisition device, and the alarm equipment is placed in a first area. The alarm device obtains a first image collected by the camera for the first area, obtains a first environment audio collected by the sound collection device for the first area, and sends the first image and the first environment audio to the monitoring device. Under the condition that the alarm equipment detects that a preset alarm condition is met, the alarm equipment sends a first control signal to the monitoring equipment so as to indicate the monitoring equipment to highlight a first image on a first interface of the monitoring equipment and play a first environment audio, therefore, the monitoring personnel can timely and comprehensively know the condition of the first area where the alarm equipment is located, so that the monitoring personnel can timely process the condition of the first area, and the monitoring reliability is improved.

Description

Technical Field

[0001] The present application relates to the field of monitoring technology, and in particular to an emergency handling method, device, alarm equipment and storage medium. Background Art

[0002] The monitoring system is one of the most widely used systems in the security system. Among them, image monitoring (or video monitoring) is one of the important components of the monitoring system. Image monitoring is intuitive, accurate, timely and rich in content and is widely used in many occasions. For example, the security of public areas such as schools, parks, residential areas, office buildings, etc. mainly uses image monitoring.

[0003] For large public areas, there are many surveillance cameras installed and a large number of video surveillance videos are collected, making it difficult for security personnel to monitor them in place, resulting in low reliability of surveillance. Summary of the invention

[0004] The embodiments of the present application disclose an emergency handling method, apparatus, alarm device and storage medium, so that the alarm device can control the monitoring device to display the situation of the area where the alarm device is located, thereby improving the reliability of monitoring.

[0005] The embodiment of the present application discloses an emergency handling method, which is applied to an alarm device, wherein the alarm device includes a camera and a sound collection device, and the alarm device is placed in a first area. The method includes:

[0006] Acquire a first image of the first area captured by the camera, and acquire a first ambient audio of the first area captured by the sound acquisition device;

[0007] Sending the first image and the first environmental audio to a monitoring device;

[0008] When the alarm device detects that a preset alarm condition is met, a first control signal is sent to the monitoring device, where the first control signal is used to instruct the monitoring device to highlight the first image and play the first environmental audio on the first interface of the monitoring device.

[0009] As an optional implementation manner, before the alarm device sends the first control signal to the monitoring device when the alarm device detects that the preset alarm condition is met, the method further includes:

[0010] Performing personnel recognition on the first image captured by the camera to obtain the number of personnel contained in the first image, and if the number of personnel is greater than or equal to a threshold number of personnel, determining that a preset alarm condition is met; and / or,

[0011] The alarm device detects that the alarm button is triggered, and determines that the preset alarm condition is met; and / or,

[0012] detecting the volume of the first ambient audio collected by the sound collection device, and if the volume is greater than a volume threshold, determining that a preset alarm condition is met; and / or,

[0013] The first ambient audio collected by the sound collection device is subjected to speech recognition, and if it is detected that the first ambient audio contains a preset help keyword, it is determined that a preset alarm condition is met.

[0014] As an optional implementation, the method further includes:

[0015] When the alarm device detects that the preset alarm condition is met, determining the target broadcasting device and target audio information corresponding to the preset alarm condition;

[0016] A second control signal and the target audio information are sent to the target broadcasting device to control the target broadcasting device to play the target audio matching the target audio information.

[0017] As an optional implementation manner, the preset alarm condition includes that the first ambient audio contains a preset help keyword;

[0018] When the alarm device detects that the preset alarm condition is met, determining the target broadcast device and target audio information corresponding to the preset alarm condition includes:

[0019] When the first ambient audio includes a preset help keyword, determining a crowd density corresponding to the first area according to the first image;

[0020] If the crowd density corresponding to the first area is less than or equal to the crowd density threshold, the broadcasting device set in the second area is determined as the target broadcasting device, and the preset rescue audio information corresponding to the first area is obtained as the target audio information; the second area is an area where the crowd density is greater than the crowd density threshold and the distance from the first area is less than the distance threshold.

[0021] As an optional implementation, the method further includes:

[0022] Performing speech recognition on the first ambient audio collected by the sound collection device;

[0023] If it is detected that the first ambient audio contains a preset consultation keyword, controlling the alarm device to enter an emergency consultation mode;

[0024] Acquire the second ambient audio collected by the sound collection device;

[0025] Extracting a first voiceprint feature corresponding to the second ambient audio, and matching the first voiceprint feature with a plurality of second voiceprint features pre-stored in a database to determine the person identity information corresponding to the first voiceprint feature;

[0026] Performing speech recognition on the second environment audio to obtain target consultation information;

[0027] Query the target processing solution corresponding to the target consulting information;

[0028] The target processing solution is displayed, and the target consultation information and the personnel identity information are stored in correspondence.

[0029] As an optional implementation, the method further includes:

[0030] Performing personnel injury recognition on the first image captured by the camera to obtain an injury recognition result;

[0031] If it is determined according to the injury identification result that there is an injured person in the first area, controlling the alarm device to enter an emergency consultation mode;

[0032] Acquire a second image captured by the camera, and perform injury part detection on the second image to determine the injury part and injury degree corresponding to the injured person;

[0033] According to the injured part and the degree of injury, query the target emergency plan;

[0034] The target emergency plan is displayed, and the injured part and the degree of injury are stored in correspondence with the second image.

[0035] As an optional implementation manner, the preset alarm condition includes that the number of people included in the first image is greater than or equal to a number threshold, and the method further includes:

[0036] When the number of people included in the first image is greater than or equal to the number threshold, if a dismissal audio signal sent by the monitoring device is received, the dismissal audio signal is played through the sound playing device;

[0037] After playing the dismissal audio for a preset time interval, obtaining a third image captured by the camera, and performing personnel recognition on the third image to determine the number of personnel included in the third image;

[0038] If the difference between the number of people included in the first image and the number of people included in the third image is less than the number change threshold, the disbanding audio is played again through the sound playing device, and the volume of the disbanding audio is increased.

[0039] The embodiment of the present application discloses an emergency handling device, which is applied to an alarm device, wherein the alarm device includes a camera and a sound collection device, and the alarm device is placed in a first area. The device includes:

[0040] An acquisition module, used to acquire a first image of the first area acquired by the camera, and to acquire a first ambient audio of the first area acquired by the sound acquisition device;

[0041] A first sending module, used for sending the first image and the first environmental audio to a monitoring device;

[0042] The second sending module is used to send a first control signal to the monitoring device when the alarm device detects that a preset alarm condition is met, and the first control signal is used to instruct the monitoring device to highlight the first image and play the first environmental audio on the first interface of the monitoring device.

[0043] An embodiment of the present application discloses an alarm device, including a camera, a sound collection device, a memory and a processor, wherein the camera and the sound collection device are connected to the processor, and a computer program is stored in the memory. When the computer program is executed by the processor, the processor implements any one of the emergency handling methods disclosed in the embodiment of the present application.

[0044] An embodiment of the present application discloses a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, any one of the emergency handling methods disclosed in the embodiment of the present application is implemented.

[0045] Compared with the related art, the embodiments of the present application have the following beneficial effects:

[0046] The embodiment of the present application provides an emergency handling method, device, alarm device and storage medium, the method is applied to an alarm device, the alarm device includes a camera and a sound collection device, and the alarm device is placed in a first area. The alarm device obtains a first image collected by the camera of the first area, and obtains a first environmental audio collected by the sound collection device of the first area, and sends the first image and the first environmental audio to the monitoring device. When the alarm device detects that a preset alarm condition is met, the alarm device sends a first control signal to the monitoring device to instruct the monitoring device to highlight the first image and play the first environmental audio on the first interface of the monitoring device, so that the monitoring personnel using the monitoring device can quickly find the image sent by the alarm device that detects that the preset alarm condition is met, and hear the environmental audio sent by the alarm device, so that the monitoring personnel can timely and comprehensively understand the situation of the first area where the alarm device is located, so that the monitoring personnel can promptly deal with the situation in the first area, thereby improving the reliability of monitoring. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0048] Figure 1 This is an application scenario diagram of an emergency handling method disclosed in an embodiment of the present application;

[0049] Figure 2 It is a flowchart of an emergency situation handling method disclosed in an embodiment of the present application;

[0050] Figure 3 is a schematic diagram of a first interface disclosed in an embodiment of the present application;

[0051] Figure 4 is an interface schematic diagram of another first interface disclosed in an embodiment of the present application;

[0052] Figure 5 It is a triggering schematic diagram of triggering monitoring equipment display and playback disclosed in an embodiment of the present application;

[0053] Figure 6 It is a flowchart of another emergency handling method disclosed in an embodiment of the present application;

[0054] Figure 7 It is a flowchart of a consultation process disclosed in an embodiment of the present application;

[0055] Figure 8 It is a flowchart of an injury treatment process disclosed in an embodiment of the present application;

[0056] Fig. 9 It is a structural schematic diagram of an emergency handling device disclosed in an embodiment of the present application;

[0057] Fig.10 It is a structural schematic diagram of an alarm device disclosed in an embodiment of the present application. DETAILED DESCRIPTION

[0058] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0059] It should be noted that the terms "including" and "having" and any variations thereof in the embodiments of the present application and the accompanying drawings are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device including a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products or devices.

[0060] The embodiment of the present application discloses an emergency handling method, device, alarm device and storage medium, so that the alarm device can control the monitoring device to display the situation of the area where the alarm device is located, thereby improving the reliability of monitoring. Detailed descriptions are given below.

[0061] Please refer to Figure 1 , Figure 1 This is an application scenario diagram of an emergency handling method provided by an embodiment of the present application. Figure 1As shown, the monitoring system may include multiple alarm devices 110, multiple monitoring devices 120 and multiple broadcasting devices 130. Each alarm device 110 may be connected to at least one monitoring device 120 in communication, each alarm device 110 may be connected to at least some of the broadcasting devices 130 in communication, and each monitoring device 120 may be connected to at least some of the broadcasting devices 130 in communication. The alarm device 110 may be placed indoors or outdoors, such as in a school or street, and the monitoring device 120 is generally placed in the monitoring room. Exemplarily, the monitoring device 120 may include a personal computer and a laptop computer. The broadcasting device 130 may store multiple audios, and under the control of the alarm device 110, the broadcasting device 130 may play at least one of the stored multiple audios. The broadcasting device 130 may also receive the audio sent by the alarm device 110, and under the control of the alarm device 110, play the audio. Optionally, the broadcasting device 130 may include a sound column, a speaker, etc.

[0062] The alarm device 110 can be set in a suitable area according to monitoring needs. The alarm device 110 may include a camera 111 and a sound collection device 112. Taking the alarm device 110 being set in the first area as an example, the camera 111 of the alarm device 110 is used to collect the first image of the first area, and the sound collection device 112 of the alarm device 110 is used to collect the first environmental audio of the first area. The camera 111 can collect the first area according to a preset rule, such as collecting the first area according to a preset interval duration, and obtain images corresponding to each collection time. Optionally, the camera 111 can be a built-in camera or an external camera. It is understandable that the built-in camera is a camera integrated in the alarm device 110, and the external camera is a camera connected to an interface such as USB (Universal Serial Bus) and HDMI (High Definition Multimedia Interface) of the alarm device 110. Optionally, the sound collection device 112 may include a microphone. The alarm device 110 can send a first image and a first ambient audio to the monitoring device 120, and when the alarm device 110 detects that a preset alarm condition is met, it sends a first control signal to the monitoring device 120 to control the monitoring device 120 to highlight the first image and play the first ambient audio on the first interface of the monitoring device 120.

[0063] Optionally, the alarm device 110 may further include an alarm button 113 , which may be pressed. When the alarm button 113 is pressed, it may be considered that the alarm button 113 is triggered.

[0064] Optionally, the alarm device 110 may also include a sound playing device ( Figure 1The alarm device 110 may receive the audio sent by the monitoring device 120, and play the audio sent by the alarm device 110 through the sound playing device (not shown), such as a speaker. It is understandable that the monitoring device 120 may also include a sound collecting device to collect the sound emitted by the monitoring personnel using the monitoring device 120, and send the sound collected by the sound collecting device of the monitoring device 120 to the alarm device 110, and play it through the sound playing device of the alarm device 110, and realize the voice interaction between the personnel located in the first area and the monitoring personnel using the monitoring device 120 through the sound collecting device 112 and the sound playing device of the alarm device 110, the sound collecting device and the sound playing device of the monitoring device 120.

[0065] Please refer to Figure 2 , which shows a flow chart of an emergency handling method disclosed in an embodiment of the present application. Figure 2 The emergency response method described can be applied to Figure 1 In the alarm device shown. Figure 2 As shown, the emergency handling method may include steps 202 to 206 .

[0066] Step 202: Acquire a first image of a first area captured by a camera, and acquire a first ambient audio of the first area captured by a sound collection device.

[0067] Step 204: Send the first image and the first ambient audio to the monitoring device.

[0068] It should be noted that the camera of the alarm device can capture the first area at a preset time interval to obtain a first image corresponding to the first area. The alarm device can send the first image and the first ambient audio to the monitoring device when the first image and the first ambient audio are obtained. The monitoring device can store the first image and the first ambient audio to facilitate monitoring personnel and other personnel to search for the situation of the first area; or, the alarm device may send the first image and the first ambient audio image to the monitoring device only when it detects that the alarm condition is met; or, the alarm device may send the first image to the monitoring device when the first image is obtained, and send the first ambient audio to the monitoring device only when the alarm device detects that the preset alarm condition is met. This embodiment does not limit the timing of sending the first image and the first ambient audio to the monitoring device, and can be selected according to actual needs.

[0069] Optionally, when the alarm device sends the first image and the first ambient audio to the monitoring device, it may also send a device identifier corresponding to the alarm device to the monitoring device, so that the monitoring device determines which alarm device sent the received first image and the first ambient audio. It is understandable that the device identifier corresponds to the alarm device, and different alarm devices have different device identifiers.

[0070] Step 206: When the alarm device detects that a preset alarm condition is met, a first control signal is sent to the monitoring device, where the first control signal is used to instruct the monitoring device to highlight the first image and play the first ambient audio on the first interface of the monitoring device.

[0071] It should be noted that highlighting the first image on the first interface of the monitoring device may refer to displaying the first image on the first interface of the monitoring device, and the first image can be focused on by the monitoring personnel. Exemplarily, highlighting the first image on the first interface of the monitoring device may include: increasing the size of the first image displayed on the first interface of the monitoring device. Figure 3 As shown, when the alarm device does not detect that the preset alarm condition is met, the size of the first image 320 displayed on the first interface 310 is smaller than that of the first image 320 displayed on the first interface 310. Exemplarily, highlighting the first image on the first interface of the monitoring device may include: adding the first image to the first interface of the monitoring device. Figure 4As shown, when the alarm device does not detect that the preset alarm condition is met, the first interface 410 does not display the first image 420. When the alarm device detects that the preset alarm condition is met, the first image 420 is displayed on the first interface 410, so that the monitoring personnel can know the image data of the area where the alarm device that meets the preset alarm condition is located by observing the first interface 410. When the alarm device does not detect that the preset alarm condition is met, the alarm device can send a third control signal to the monitoring device, and the third control signal is used to instruct the monitoring device to display the first image 420 on the second interface 430 of the monitoring device. When the alarm device does not detect that the preset alarm condition is met, the first image 420 can be displayed through the second interface 430 of the monitoring device, so that when the alarm device does not detect that the preset alarm condition is met, the monitoring personnel can also understand the situation of the area where the alarm device is located through the second interface 430. Exemplarily, the size of the first image 420 displayed on the second interface 430 is smaller than the size of the first image 420 displayed on the first interface 410, so as to display as many images collected by the alarm device as possible in the second interface 430. For example, the monitoring device may include a display and a sound playing device, and the display may be used to display the first interface 410 and the second interface 430. The monitoring device may play the first ambient audio through the sound playing device of the monitoring device, and the monitoring device does not play the first ambient audio when the alarm device does not detect that the preset alarm condition is met. Figure 4 As shown, the first interface 410 may also display the area where the alarm device is located, such as "Room 901, 9th Floor, Building B", so that monitoring personnel can quickly determine the area where the alarm device is located.

[0072] In an optional embodiment, before the alarm device detects that a preset alarm condition is met and sends a first control signal to the monitoring device, the emergency handling method may further include, the alarm device detecting whether the preset alarm condition is met. The preset alarm condition may include, but is not limited to, the number of people included in the first image is greater than or equal to the number threshold, the alarm button of the alarm device is triggered, the first ambient audio contains a preset help keyword, and the volume of the first ambient audio is greater than the volume threshold. It should be noted that the number threshold can be used to measure whether there is a gathering phenomenon in the first area. If the number of people included in the first image is greater than or equal to the number threshold, it can be considered that there are a large number of people in the first area and there is a gathering phenomenon. If the number of people included in the first image is less than the number threshold, it is considered that there is no gathering phenomenon in the first area. The alarm button of the alarm device is triggered, which may mean that the alarm button of the alarm device is pressed, indicating that there are people in need of help in the first area. The first ambient audio contains a preset help keyword, which may mean that there are people in the first area calling for help. Exemplarily, the preset help keywords are, but are not limited to, "alarm", "help" and "someone hit me". The volume threshold can be used to measure whether there is noise in the first area. If the volume of the first ambient audio is greater than the volume threshold, it indicates that there is noise in the first area. If the volume of the first ambient audio is less than or equal to the volume threshold, it indicates that there is no noise in the first area. When the alarm device detects that the preset alarm conditions are met, it indicates that an emergency has occurred in the first area and needs to be handled by the monitoring personnel. By highlighting the first image on the first interface of the monitoring device and playing the first ambient audio through the monitoring device, the monitoring personnel can obtain the image and sound information of the first area to fully understand the situation in the first area, so that the monitoring personnel can promptly and reliably handle the situation in the first area, thereby improving the comprehensiveness of the monitoring.

[0073] Optionally, when the alarm device detects that a preset alarm condition is met, before sending a first control signal to the monitoring device, the emergency handling method may also include: the alarm device identifies people in the first image captured by the camera, and obtains the number of people contained in the first image; if the number of people is greater than or equal to a number threshold, it is determined that the preset alarm condition is met, and the alarm device detects that the preset alarm condition is met.

[0074] Optionally, when the alarm device detects that a preset alarm condition is met, before sending a first control signal to the monitoring device, the emergency handling method may also include: the alarm device detects that the alarm button is triggered, then determines that the preset alarm condition is met, and the alarm device detects that the preset alarm condition is met.

[0075] Optionally, when the alarm device detects that a preset alarm condition is met, before sending a first control signal to the monitoring device, the emergency handling method may also include: the alarm device detects the volume of the first ambient audio collected by the sound collection device, and if the volume is greater than a volume threshold, it is determined that the preset alarm condition is met, and the alarm device detects that the preset alarm condition is met.

[0076] Optionally, when the alarm device detects that a preset alarm condition is met, before sending a first control signal to the monitoring device, the emergency handling method may also include: the alarm device performs voice recognition on the first ambient audio collected by the sound collection device, and if it is detected that the first ambient audio contains preset distress keywords, it is determined that the preset alarm condition is met, and the alarm device detects that the preset alarm condition is met.

[0077] For example, Figure 5 As shown, multiple preset alarm conditions can be preset. When any one of them is met, the alarm device can trigger the monitoring device to highlight the first image and play the first ambient audio on the first interface of the monitoring device.

[0078] Optionally, the monitoring system may also include an audible and visual alarm. When the alarm device detects that a preset alarm condition is met, the alarm device may send a fourth control signal to the audible and visual alarm to control the audible and visual alarm to make a sound or light up to remind the monitoring personnel that an emergency has occurred in the area.

[0079] Optionally, when the alarm device detects that a preset alarm condition is met, the alarm device may send the first ambient audio collected by the sound collection device of the alarm device to the monitoring device, and play it through the sound playback device of the monitoring device. The monitoring device may also collect the audio corresponding to the monitoring personnel through the sound collection device of the monitoring device, and send the audio corresponding to the monitoring personnel to the alarm device, and play it through the sound playback device of the alarm device, so as to realize the intercom between the monitoring personnel and the personnel in the first area.

[0080] In an optional embodiment, the preset alarm condition may include that the number of people included in the first image is greater than or equal to the number threshold, and the emergency handling method may further include: when the alarm device detects that the number of people included in the first image is greater than or equal to the number threshold, if the disbanding audio sent by the monitoring device is received, the disbanding audio is played through the sound playing device. After the preset time interval of playing the disbanding audio, the third image captured by the camera is obtained, and the third image is identified to determine the number of people included in the third image. If the difference between the number of people included in the first image and the number of people included in the third image is less than the number change threshold, the disbanding audio is played again through the sound playing device, and the volume of the disbanding audio is increased. Among them, the disbanding audio can be used to instruct people in the first area not to gather. It should be noted that when the monitoring personnel sees that people gather in the first area through the first interface, they can issue words such as "don't gather", and the sound collection device of the monitoring device collects the words, generates disbanding audio, and sends the disbanding audio to the alarm device to be played through the sound playing device of the alarm device. The preset duration can be set based on experience. Since it takes time for people to disband, the third image is identified after the preset duration to determine the number of people included in the third image, thereby determining the change in the number of people in the first area after the disbanding audio is played. If the difference in the number of people included in the third image is less than the number change threshold, it means that the disbanding audio played last time is invalid. The disbanding audio is played again through the sound playing device, and the volume of the disbanding audio is increased to remind the people in the first area not to gather again and guide the people to evacuate. At the same time, it is avoided that the volume of the disbanding audio played is too low, resulting in the phenomenon that the people in the first area cannot hear the release audio. In this embodiment, when the monitoring personnel sends a disbanding audio, the alarm device can automatically determine whether the disbanding audio needs to be played again based on the image of the first area. The monitoring personnel does not need to continue to pay attention to the first area and send out the disbanding audio multiple times, so that the monitoring personnel can deal with other emergencies.

[0081] Exemplarily, if the difference between the number of people included in the first image and the number of people included in the third image is greater than the number change threshold, the alarm device may no longer play the disbanding audio. In the case where the difference between the number of people included in the first image and the number of people included in the third image is greater than the number change threshold, it can be considered that the people in the first area are disbanding, and the disbanding audio played last time has taken effect, and the disbanding audio may no longer be played after a preset interval. The alarm device can determine that the people in the first area have disbanded based on the images captured by the camera to determine whether to play the disbanding audio, thereby improving the intelligence of the alarm device.

[0082] In an embodiment of the present application, the alarm device can obtain a first image of the first area collected by a camera, and obtain a first ambient audio of the first area collected by a sound collection device, and send the first image and the first ambient audio to the monitoring device. When the alarm device detects that a preset alarm condition is met, the alarm device sends a first control signal to the monitoring device to instruct the monitoring device to highlight the first image and play the first ambient audio on the first interface of the monitoring device, so that the monitoring personnel using the monitoring device can quickly find the image displayed on the monitoring device and the image sent by the alarm device that detects that the preset alarm condition is met, and hear the ambient audio sent by the alarm device, so that the monitoring personnel can timely and comprehensively understand the situation of the first area where the alarm device is located, so that the monitoring personnel can promptly deal with the situation in the first area, thereby improving the reliability of monitoring.

[0083] Please refer to Figure 6 , which shows a flow chart of another emergency handling method provided by an embodiment of the present application, such as Figure 6 As shown, the emergency handling method may include steps 602 to 612 .

[0084] Step 602: Acquire a first image of a first area captured by a camera, and acquire a first ambient audio of the first area captured by a sound collection device.

[0085] Step 604: Send the first image and the first ambient audio to the monitoring device.

[0086] Step 606, check whether the preset alarm condition is met. If yes, execute steps 608 to 612, if not, return to step 602.

[0087] Step 608: Send a first control signal to the monitoring device, where the first control signal is used to instruct the monitoring device to highlight the first image and play the first ambient audio on the first interface of the monitoring device.

[0088] It should be noted that for the description of steps 602 to 608, please refer to the above embodiment and will not be repeated here.

[0089] Step 610, determining the target broadcasting device and target audio information corresponding to the preset alarm condition.

[0090] It should be noted that the preset alarm conditions may include but are not limited to the number of people included in the first image being greater than or equal to the number threshold, the alarm button of the alarm device being triggered, the first ambient audio containing a preset help keyword, and the volume of the first ambient audio being greater than the volume threshold. The alarm device pre-stores the correspondence between the preset alarm conditions and the broadcasting device and audio information. When the alarm device detects that the preset alarm conditions are met, the target broadcasting device and target audio information corresponding to the preset alarm conditions are determined according to the correspondence.

[0091] In an optional embodiment, the preset alarm condition may include that the first ambient audio contains a preset rescue keyword. When the alarm device detects that the preset alarm condition is met, determining the target broadcasting device and target audio information corresponding to the preset alarm condition may include: when the first ambient audio contains the preset rescue keyword, the alarm device determines the crowd density corresponding to the first area according to the first image, and if the crowd density corresponding to the first area is less than or equal to the crowd density threshold, the broadcasting device set in the second area is determined to be the target broadcasting device, and the preset rescue audio information corresponding to the first area is obtained as the target audio information. Among them, the second area is an area where the crowd density is greater than the crowd density threshold and the distance from the first area is less than the distance threshold. It should be noted that the crowd density threshold is used to measure whether the current crowd density of the first area is large enough, and the distance threshold is used to measure whether the distance between the area and the first area is close. When the first ambient audio contains a preset rescue keyword, the alarm device determines the crowd density corresponding to the first area according to the first image. If the crowd density corresponding to the first area is less than or equal to the crowd density threshold, that is, the crowd density of the first area is small, then the broadcasting device set in the area where the crowd density is greater than the crowd density threshold and the distance from the first area is less than the distance threshold is determined as the target broadcasting device, so that the personnel in the second area can perceive the situation in the first area in time, and can quickly rush to the first area to help the personnel in the first area. Exemplarily, the first area can be a reservoir, and the second area is a village near the reservoir. When a person drowns in the reservoir and makes a "help" sound, or the partner of the drowning person makes a "help" sound, the alarm device in the first area is triggered to control the broadcasting device in the second area to play "Someone is drowning, please go to the first area for help", thereby reducing the time for the partner of the drowning person to go to the village to find someone to help, and helping the drowning person in time. In this embodiment, when the first environmental audio contains preset rescue keywords, the alarm device can control the broadcasting equipment in the second area with a large crowd density and closer to the first area to play the preset rescue audio, so that even if the monitoring personnel are far away from the first area, the people in the area with lower crowd density can get timely help.

[0092] Optionally, if the crowd density corresponding to the first area is greater than the crowd density threshold, the broadcasting device set in the first area is determined to be the target broadcasting device, and the preset rescue audio information corresponding to the first area is obtained as the target audio information. It should be noted that when the crowd density corresponding to the first area is greater than the crowd density threshold, the broadcasting device set in the first area is directly used as the target broadcasting device, and the preset rescue audio corresponding to the first area is played to remind the people in the first area to help the people in need. In this embodiment, when there are people in need of help in the first area, the alarm device can determine the appropriate broadcasting device to play the preset rescue audio according to the crowd density in the first area, so that the people in need of help can be helped in time.

[0093] Step 612: Send a second control signal and target audio information to the target broadcasting device to control the target broadcasting device to play the target audio matching the target audio information.

[0094] It should be noted that the target audio information may include the target audio or identification information corresponding to the target audio. Optionally, the target audio information includes identification information corresponding to the target audio, and the target broadcasting device may pre-store multiple audios and a mapping relationship, and the mapping relationship is used to indicate the corresponding relationship between the identification information and the audio storage location. When the target broadcasting device receives the target audio information, it may determine the storage location for storing the target audio according to the target audio information, extract the target audio from the storage location, and play the target audio under the instruction of the second control signal. Optionally, the target audio information may include the target audio, and the alarm device may store multiple audios. The alarm device extracts the target audio that meets the preset alarm condition, and sends the target audio to the target broadcasting device, and instructs the target broadcasting device to play the target audio through the second control signal.

[0095] Optionally, the audio information may include preset disbanding audio information, preset disbanding audio, preset rescue audio information, preset rescue audio, preset noise reduction audio information or preset noise reduction audio, etc. Among them, the preset disbanding audio information and the preset disbanding audio both correspond to the number of people contained in the first image being greater than or equal to the number threshold, the preset disbanding audio is used to instruct people not to gather, and the preset disbanding audio information is used to enable the broadcasting device to obtain the preset disbanding audio from multiple pre-stored audios. Exemplarily, the preset disbanding audio may be "Don't gather", "Leave quickly", etc. The preset rescue audio information and the preset rescue audio both correspond to the alarm button of the alarm device being triggered and the first ambient audio containing preset help keywords, the preset rescue audio is used to instruct to help the people in the first area, and the preset rescue audio information is used to enable the broadcasting device to obtain the preset rescue audio from multiple pre-stored audios. Exemplarily, the preset rescue audio may be "Someone in the first area is in danger, please go to help", etc. The preset noise reduction audio information and the preset noise reduction audio both correspond to the volume of the first ambient audio being greater than the volume threshold, and the preset noise reduction audio is used to instruct the people in the first area to lower the volume. The preset noise reduction audio information is used to enable the broadcasting device to obtain the preset noise reduction audio from a plurality of pre-stored audios. For example, the preset noise reduction audio may be "Please keep quiet" or the like.

[0096] In this embodiment, if Figure 5 As shown, the alarm device can also control the target broadcasting device corresponding to the preset alarm condition that is satisfied, and play the target audio that matches the target audio information corresponding to the preset alarm condition that is satisfied, when the alarm device detects that the preset alarm condition is satisfied, so that people around the target broadcasting device can perceive the emergency situation occurring in the first area, so that even if the monitoring personnel are far away from the first area, the emergency situation occurring in the first area can be handled by the surrounding personnel, thereby improving the reliability of monitoring.

[0097] In daily life, people often need help, such as psychological counseling, problem consultation, and first aid knowledge acquisition, etc. The following embodiments will provide a solution for the alarm device to provide help to people.

[0098] Please refer to Figure 7 , which shows a flowchart of a consultation process provided by an embodiment of the present application, such as Figure 7 As shown, the emergency handling method may further include steps 702 to 714 .

[0099] Step 702: Perform voice recognition on the first ambient audio collected by the sound collection device.

[0100] Step 704: If it is detected that the first ambient audio contains a preset consultation keyword, the alarm device is controlled to enter an emergency consultation mode.

[0101] It should be noted that when a person needs to consult about related issues, the alarm device can be put into emergency consultation mode by using preset consultation keywords. Exemplarily, preset consultation keywords may include but are not limited to "power on", "Little A, Little A", etc. The alarm device can perform isolated word recognition on the first ambient audio collected by the sound collection device to identify whether the first ambient audio contains the preset consultation keywords. Since the preset consultation keywords are pre-designed, it is possible to determine whether the first ambient audio contains the preset consultation keywords by using isolated word recognition, and when the preset consultation keywords are detected in the first ambient audio, it can be considered that there are people who need to consult about related issues in the first area, and the alarm device is controlled to enter the emergency consultation mode to respond to the questions that the person wants to consult. Exemplarily, if the alarm device does not detect that the preset consultation keywords are contained in the first ambient audio, the alarm device is not controlled to enter the emergency consultation mode. In this embodiment, it is possible to determine whether to enter the emergency consultation mode by using isolated word recognition, and only when it is determined that the emergency consultation mode is entered, voiceprint feature extraction, voiceprint feature matching and other processing are performed, so that the alarm device can realize the function of problem feedback while reducing the processing amount of the alarm device.

[0102] Step 706: Acquire the second ambient audio collected by the sound collection device.

[0103] Step 708: extract the first voiceprint feature corresponding to the second ambient audio, and match the first voiceprint feature with a plurality of second voiceprint features pre-stored in the database to determine the person identity information corresponding to the first voiceprint feature.

[0104] It should be noted that the second ambient audio may refer to the audio collected by the sound collection device after collecting the first ambient audio. The first voiceprint feature is a voiceprint feature extracted from the second ambient audio, and the second voiceprint feature is a voiceprint feature pre-stored in the database. The database may store voiceprint features of people corresponding to the first area. For example, for a school, the database may store voiceprint features corresponding to students or teachers of the school. For example, for a nursing home, the database may store voiceprint features corresponding to the elderly living in the nursing home. Voiceprint features may include the number of resonance peaks, the direction of resonance peaks, the frequency of resonance peaks, sound intensity, etc. The alarm device extracts and selects voiceprint features with strong separability and high stability, that is, different people have different voiceprint features. The alarm device compares the extracted first voiceprint feature with the second voiceprint feature pre-stored in the database, determines the matching degree of the first voiceprint feature with each second voiceprint feature pre-stored in the database, and if it is determined that the first voiceprint feature has the highest matching degree with the target second voiceprint feature, the person identity information corresponding to the target second voiceprint feature can be determined as the person identity information corresponding to the first voiceprint feature. Among them, the target second voiceprint feature is any one of the multiple second voiceprint features pre-stored in the database. It should be noted that the database stores multiple second voiceprint features and the personal identity information corresponding to each second voiceprint feature, so that after the alarm device determines the target second voiceprint feature, it can obtain the personal identity information corresponding to the target second voiceprint feature, and then determine the personal identity information corresponding to the first voiceprint feature. Optionally, the determination of the matching degree between the first voiceprint feature and each second voiceprint feature pre-stored in the database can be completed using different algorithms and models, such as distance-based matching algorithms, probability-based classification algorithms, and neural networks. This embodiment does not limit the matching process of the first voiceprint feature and the second voiceprint feature, as long as the second voiceprint feature matching the first voiceprint feature can be determined.

[0105] Step 710: Perform voice recognition on the second environment audio to obtain target consultation information.

[0106] It should be noted that the target consultation information may include language text content corresponding to the second ambient audio. The target consultation information may refer to the question that the consultant (the person corresponding to the first voiceprint feature) wants to consult. The alarm device may perform semantic recognition operations on the language text content based on the language processing algorithm to obtain the question that the consultant wants to consult.

[0107] Step 712, query the target processing solution corresponding to the target consulting information.

[0108] Step 714, display the target processing solution, and store the target consultation information and personnel identity information in correspondence.

[0109] It should be noted that after the alarm device obtains the target consulting information, it can query the target treatment plan corresponding to the target consulting information. If the question consulted by the consultant is "how to relieve anxiety", the alarm device can query methods to relieve anxiety, and display the methods to relieve anxiety obtained from the query, so that the consultant can get feedback on the question. Optionally, the alarm device displaying the target treatment plan may include the alarm device playing the target treatment plan through a sound playing device, or the alarm device displaying the target treatment plan, so that the consultant located in the first area can obtain the target treatment plan. Exemplarily, the alarm device may include a display to display the target treatment plan.

[0110] Exemplarily, the alarm device can be placed in a school, and the database stores multiple second voiceprint features corresponding to multiple students. The alarm device first determines the student seeking consultation based on the second environment audio data, and associates and stores the target consultation information with the personal identity information corresponding to the student. School administrators, such as teachers and principals, can determine the student's psychological state based on the stored information to provide assistance to the student.

[0111] In this embodiment, the alarm device can perform voice recognition on the first ambient audio, and when detecting that the first ambient audio contains a preset consultation keyword, enter the emergency consultation mode, obtain the second ambient audio collected by the sound collection device, extract the first voiceprint feature corresponding to the second ambient audio, and match the first voiceprint feature with multiple second voiceprint features pre-stored in the database to determine the person identity information corresponding to the first voiceprint feature, and perform voice recognition on the second ambient audio to obtain the target consultation information, thereby determining the target processing solution corresponding to the target consultation information based on the target consultation information, and displaying the target processing solution obtained by the query to provide feedback to the consultant. At the same time, the target consultation information is stored in correspondence with the person identity information, so that the monitoring personnel can understand the psychological condition of the person in the first area and provide help to the person.

[0112] Please refer to Figure 8 , which shows a schematic diagram of an injury treatment process provided by an embodiment of the present application, such as Figure 8 As shown, the emergency handling method may further include steps 802 to 810 .

[0113] Step 802: Perform personnel injury recognition on the first image captured by the camera to obtain an injury recognition result.

[0114] It should be noted that the injury identification results may include, but are not limited to, the presence of a violent incident (such as a beating) in the first area, the absence of a violent incident in the first area, the presence of a person with a painful expression in the first area, the absence of a person with a painful expression in the first area, a person falling in the first area, or no person falling in the first area. Exemplarily, the alarm device may identify the facial expressions of each person in the first image based on the first image captured by the camera to determine whether there is a person with a painful expression. Exemplarily, the alarm device may identify the behavior of the person in the first image based on the first image captured by the camera to determine whether there is a person falling or a violent incident in the first area. This embodiment does not specifically limit the method for identifying injuries to persons, as long as it can determine whether there are injured persons in the first area.

[0115] Step 804: If it is determined that there is an injured person in the first area according to the injury identification result, the alarm device is controlled to enter an emergency consultation mode.

[0116] It should be noted that when the injury recognition result obtained by the alarm device is that there is a violent incident in the first area, there is a person with a painful expression in the first area, or there is a person falling in the first area, it can be determined that there are injured persons in the first area. When the injury recognition result obtained by the alarm device is that there is no violent incident in the first area, there is no person with a painful expression in the first area, and there is no person falling in the first area, it can be determined that there are no injured persons in the first area. When the alarm device determines that there are injured persons in the first area based on the injury recognition result, the alarm device controls the alarm device to enter the emergency consultation mode to provide a target emergency plan for treating the injured person. This embodiment does not specifically limit the method for identifying personal injuries, as long as it can determine whether there are injured persons in the first area.

[0117] Step 806, obtaining a second image captured by the camera, and performing injury part detection on the second image to determine the injury part and injury degree corresponding to the injured person.

[0118] Step 808, query the target emergency plan according to the injured part and the degree of injury.

[0119] It should be noted that the second image may refer to an image captured by the camera after the first image is captured. When the alarm device determines that there is an injured person in the first area, it can obtain the second image captured by the camera, and implement wound detection and wound classification based on the second image. Exemplarily, the alarm device can analyze the color, texture and edge information of the second image to determine the injured part of the injured person. For example, the edge of the wound is generally irregular and the color is red or pink. The alarm device can identify the area that meets the wound characteristics and determine the location of the area that meets the wound characteristics, and then determine the corresponding injured part of the injured person. The degree of injury may include the area of ​​injury and the depth of injury. The alarm device can estimate the area of ​​the area that meets the wound characteristics, and the estimated area can be used as the injured area. Optionally, the depth of injury can be determined based on the area of ​​injury and the degree of bleeding.

[0120] Step 810, display the target emergency plan, and store the injured part and the degree of injury in correspondence with the second image.

[0121] It should be noted that the alarm device displaying the target handling solution may include the alarm device playing the target emergency solution through a sound playing device, or the alarm device displaying the target emergency solution, so that people in the first area can obtain the target emergency solution to rescue the injured person. Exemplarily, the alarm device may include a display to display the target emergency solution.

[0122] Optionally, after determining the injured part and the degree of injury corresponding to the injured person, the emergency handling method may further include extracting the first facial feature corresponding to the injured person in the second image, and matching the first facial feature with a plurality of second facial features pre-stored in the database to determine the person identity information corresponding to the first facial feature. The person identity information may include, but is not limited to, class, name, and contact information of the guardian. Storing the injured part and the degree of injury in correspondence with the second image may include: storing the injured part, the degree of injury, and the person identity information in correspondence with the second image, so that the monitoring personnel can quickly locate the person identity information of the injured person.

[0123] In this embodiment, the alarm device can determine whether there is an injured person in the first area based on the first image captured by the camera, and when it is determined that there is an injured person, obtain the second image captured by the camera, perform injury part detection on the second image to determine the corresponding injury part and injury degree of the injured person, and query the target emergency plan based on the injury part and injury degree, and automatically display the target emergency plan to the personnel in the first area to guide the rescue of the injured person. At the same time, the injury part and injury degree are stored in correspondence with the second image. The second image contains the image of the injured person, so that the monitoring personnel can determine the injured person and it is convenient for the monitoring personnel to understand the injury condition of the injured person.

[0124] It is understandable that the emergency consultation mode of the alarm device can be triggered by the ambient audio or the camera, and the alarm device can also determine the injured part and the degree of injury of the injured person based on the second image captured by the camera and the ambient audio. For example, if the content corresponding to the second ambient audio is "My foot hurts so much", it can be determined that the injured part of the injured person is the leg. By combining the second image and the ambient audio to jointly determine the injured part and the degree of injury of the injured person, the accuracy of the determined injured part and the degree of injury can be improved.

[0125] Please refer to Fig. 9 , which shows a schematic diagram of the structure of an emergency handling device provided in an embodiment of the present application. The device can be applied to Figure 1 Alarm equipment as shown. Fig. 9 As shown, the emergency handling device 900 may include an acquisition module 910, a first sending module 920 and a second sending module 930. The acquisition module 910 is used to acquire a first image of a first area acquired by a camera, and acquire a first ambient audio of the first area acquired by a sound acquisition device. The first sending module 920 is used to send the first image and the first ambient audio to the monitoring device. The second sending module 930 is used to send a first control signal to the monitoring device when the alarm device detects that a preset alarm condition is met, and the first control signal is used to instruct the monitoring device to highlight the first image and play the first ambient audio on the first interface of the monitoring device.

[0126] In an optional embodiment, the emergency handling device 900 may also include a detection module, which can be used to identify people in the first image captured by the camera to obtain the number of people contained in the first image. If the number of people is greater than or equal to a number threshold, it is determined that a preset alarm condition is met; and / or, the detection module can be used to detect through an alarm device that an alarm button is triggered, and then determine that the preset alarm condition is met; and / or, the detection module can be used to detect the volume of the first ambient audio collected by the sound collection device. If the volume is greater than the volume threshold, it is determined that the preset alarm condition is met; and / or, the detection module can be used to perform voice recognition on the first ambient audio collected by the sound collection device. If it is detected that the first ambient audio contains preset help keywords, it is determined that the preset alarm condition is met.

[0127] In an optional embodiment, the emergency handling device 900 may further include a first determination module and a third sending module. The first determination module is used to determine the target broadcasting device and the target audio information corresponding to the preset alarm condition when the alarm device detects that the preset alarm condition is met. The third sending module is used to send the second control signal and the target audio information to the target broadcasting device to control the target broadcasting device to play the target audio matching the target audio information.

[0128] In an optional embodiment, the preset alarm condition includes that the first ambient audio contains a preset rescue keyword. The first determination module may include a first determination unit and a second determination unit. The first determination unit is used to determine the crowd density corresponding to the first area according to the first image when the first ambient audio contains the preset rescue keyword. The second determination unit is used to determine that the broadcasting device set in the second area is the target broadcasting device if the crowd density corresponding to the first area is less than or equal to the crowd density threshold, and obtain the preset rescue audio information corresponding to the first area as the target audio information. The second area is an area where the crowd density is greater than the crowd density threshold and the distance from the first area is less than the distance threshold.

[0129] In an optional embodiment, the emergency handling device 900 may also include a first recognition module, a first control module, an audio acquisition module, an extraction module, a second recognition module, a first query module and a first display module. Among them, the first recognition module is used to perform voice recognition on the first environmental audio collected by the sound collection device. The first control module is used to control the alarm device to enter the emergency consultation mode if it is detected that the first environmental audio contains preset consultation keywords. The audio acquisition module is used to obtain the second environmental audio collected by the sound collection device. The extraction module is used to extract the first voiceprint feature corresponding to the second environmental audio, and match the first voiceprint feature with multiple second voiceprint features pre-stored in the database to determine the personnel identity information corresponding to the first voiceprint feature. The second recognition module is used to perform voice recognition on the second environmental audio to obtain target consultation information. The first query module is used to query the target processing solution corresponding to the target consultation information. The first display module is used to display the target processing solution and store the target consultation information and the personnel identity information in correspondence.

[0130] In an optional embodiment, the emergency handling device 900 may also include a third identification module, a second control module, a second determination module, a second query module and a second display module. The third identification module is used to identify the injured person in the first image captured by the camera to obtain an injury identification result. The second control module is used to control the alarm device to enter the emergency consultation mode if it is determined that there is an injured person in the first area according to the injury identification result. The second determination module is used to obtain the second image captured by the camera, and perform injury site detection on the second image to determine the injured part and injury degree corresponding to the injured person. The second query module is used to query the target emergency plan based on the injured part and injury degree. The second display module is used to display the target emergency plan, and store the injured part and injury degree in correspondence with the second image.

[0131] In an optional embodiment, the preset alarm condition includes that the number of people included in the first image is greater than or equal to the number threshold. The emergency handling device 900 may also include a first playback module, a third determination module, and a second playback module. Among them, the first playback module is used to play the disbanding audio through the sound playback device if the number of people included in the first image is greater than or equal to the number threshold, if the disbanding audio sent by the monitoring device is received. The third determination module is used to obtain the third image captured by the camera after playing the disbanding audio interval for a preset time, and perform personnel recognition on the third image to determine the number of people included in the third image. The second playback module is used to play the disbanding audio again through the sound playback device if the difference between the number of people included in the first image and the number of people included in the third image is less than the number change threshold, and increase the volume of the disbanding audio.

[0132] See also Fig.10 , Fig.10 Schematic diagram of the structure of an alarm device disclosed in the embodiment of the present application. Fig.10 As shown, the electronic device 1000 may include:

[0133] Camera 1010 and sound collection device 1020;

[0134] A memory 1030 storing executable program codes;

[0135] A processor 1040 coupled to the memory 1030, the processor 1040 is also connected to the camera 1010 and the sound collection device 1020;

[0136] The processor 1040 calls the executable program code stored in the memory 1030 to execute any emergency situation handling method disclosed in the embodiments of the present application.

[0137] An embodiment of the present application discloses a computer-readable storage medium storing a computer program, wherein when the computer program is executed by the processor, the processor implements any one of the emergency handling methods disclosed in the embodiment of the present application.

[0138] It should be understood that the "one embodiment" or "an embodiment" mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. Those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily required for the present application.

[0139] In the various embodiments of the present application, it should be understood that the size of the serial numbers of the above-mentioned processes does not necessarily mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0140] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0141] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0142] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-accessible memory. Based on this understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product, which is stored in a memory and includes several requests for a computer device (which can be a personal computer, a server or a network device, etc., specifically a processor in a computer device) to perform some or all of the steps of the above-mentioned methods of various embodiments of the present application.

[0143] Those skilled in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, and the storage medium includes a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a one-time programmable read-only memory (OTPROM), an electronically erasable rewritable read-only memory (EEPROM), a compact disc (CD-ROM) or other optical disc storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

[0144] The above is a detailed introduction to an emergency handling method, device, alarm device and storage medium disclosed in the embodiment of the present application. The principle and implementation method of the present application are described in detail using specific examples. The description of the above embodiments is only used to help understand the method and core idea of ​​the present application. At the same time, for those of ordinary skill in the art, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. An emergency handling method, characterized in that: Applied to an alarm device, the alarm device includes a camera and a sound collection device, the alarm device is placed in a first area, and the method includes: Acquire a first image of the first area captured by the camera, and acquire a first ambient audio of the first area captured by the sound acquisition device; Sending the first image and the first environmental audio to a monitoring device; When the alarm device detects that a preset alarm condition is met, a first control signal is sent to the monitoring device, where the first control signal is used to instruct the monitoring device to highlight the first image and play the first environmental audio on the first interface of the monitoring device.

2. The method according to claim 1, characterized in that: Before sending the first control signal to the monitoring device when the alarm device detects that the preset alarm condition is met, the method further includes: Performing personnel recognition on the first image captured by the camera to obtain the number of personnel contained in the first image, and if the number of personnel is greater than or equal to a threshold number of personnel, determining that a preset alarm condition is met; and / or, The alarm device detects that the alarm button is triggered, and determines that the preset alarm condition is met; and / or, detecting the volume of the first ambient audio collected by the sound collection device, and if the volume is greater than a volume threshold, determining that a preset alarm condition is met; and / or, The first ambient audio collected by the sound collection device is subjected to speech recognition, and if it is detected that the first ambient audio contains a preset help keyword, it is determined that a preset alarm condition is met.

3. The method according to claim 1, characterized in that The method further comprises: When the alarm device detects that the preset alarm condition is met, determining the target broadcasting device and target audio information corresponding to the preset alarm condition; A second control signal and the target audio information are sent to the target broadcasting device to control the target broadcasting device to play the target audio matching the target audio information.

4. The method according to claim 3, characterized in that: The preset alarm condition includes the first ambient audio including a preset help keyword; When the alarm device detects that the preset alarm condition is met, determining the target broadcast device and target audio information corresponding to the preset alarm condition includes: When the first ambient audio includes a preset help keyword, determining a crowd density corresponding to the first area according to the first image; If the crowd density corresponding to the first area is less than or equal to the crowd density threshold, the broadcasting device set in the second area is determined as the target broadcasting device, and the preset rescue audio information corresponding to the first area is obtained as the target audio information; the second area is an area where the crowd density is greater than the crowd density threshold and the distance from the first area is less than the distance threshold.

5. The method according to claim 1, characterized in that: The method further comprises: Performing speech recognition on the first ambient audio collected by the sound collection device; If it is detected that the first ambient audio contains a preset consultation keyword, controlling the alarm device to enter an emergency consultation mode; Acquire the second ambient audio collected by the sound collection device; Extracting a first voiceprint feature corresponding to the second ambient audio, and matching the first voiceprint feature with a plurality of second voiceprint features pre-stored in a database to determine the person identity information corresponding to the first voiceprint feature; Performing speech recognition on the second environment audio to obtain target consultation information; Query the target processing solution corresponding to the target consulting information; The target processing solution is displayed, and the target consultation information and the personnel identity information are stored in correspondence.

6. The method according to claim 1, characterized in that The method further comprises: Performing personnel injury recognition on the first image captured by the camera to obtain an injury recognition result; If it is determined according to the injury identification result that there is an injured person in the first area, controlling the alarm device to enter an emergency consultation mode; Acquire a second image captured by the camera, and perform injury part detection on the second image to determine the injury part and injury degree corresponding to the injured person; According to the injured part and the degree of injury, query the target emergency plan; The target emergency plan is displayed, and the injured part and the degree of injury are stored in correspondence with the second image.

7. The method according to claim 1, characterized in that The preset alarm condition includes that the number of people included in the first image is greater than or equal to a threshold number of people, and the method further includes: When the number of people included in the first image is greater than or equal to the number threshold, if a dismissal audio signal sent by the monitoring device is received, the dismissal audio signal is played through the sound playing device; After playing the dismissal audio for a preset time interval, obtaining a third image captured by the camera, and performing personnel recognition on the third image to determine the number of personnel included in the third image; If the difference between the number of people included in the first image and the number of people included in the third image is less than the number change threshold, the disbanding audio is played again through the sound playing device, and the volume of the disbanding audio is increased.

8. An emergency handling device, characterized in that: Applied to an alarm device, the alarm device includes a camera and a sound collection device, the alarm device is placed in a first area, and the device includes: An acquisition module, used to acquire a first image of the first area acquired by the camera, and to acquire a first ambient audio of the first area acquired by the sound acquisition device; A first sending module, used for sending the first image and the first environmental audio to a monitoring device; The second sending module is used to send a first control signal to the monitoring device when the alarm device detects that a preset alarm condition is met, and the first control signal is used to instruct the monitoring device to highlight the first image and play the first environmental audio on the first interface of the monitoring device.

9. An alarm device, characterized in that: The method comprises a camera, a sound collection device, a memory and a processor, wherein the camera and the sound collection device are connected to the processor, and a computer program is stored in the memory. When the computer program is executed by the processor, the processor implements the method according to any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images