Sound source alarm method and device, storage medium and electronic device

Abstract

The present application discloses a sound source alarm method and device, a storage medium and an electronic device. The method includes: controlling a sound source input device to obtain sound source data in a target area; determining first sound source data and second sound source data from the sound source data, wherein the first sound source data and the second sound source data represent sound source data collected by the first sound source input device and the second sound source input device for a target sound source in the same time period, and the first sound source input device is different from the second sound source input device; analyzing the frequency components of the first sound source data and the second sound source data to determine the target coordinates of the target sound source; determining the behavior state of the target sound source based on the change of the target coordinates within a preset time period, and generating an alarm message when the behavior state is the target behavior state. The present application solves the technical problem of low accuracy of regional alarms due to low real-time and accuracy in detecting the behavior of objects in the area.

Description

Technical Field

[0001] The present application relates to the field of computers, and in particular to a sound source alarm method and device, a storage medium, and an electronic device. Background Art

[0002] In the related art, static prompting methods such as deploying warning signs or cordons in specific areas are usually used to remind people to pay attention to the safety regulations or potential risks in specific areas, so as to prevent accidents or violations. On the one hand, considering the restrictions on the deployment location and number of warning signs or cordons, on the other hand, when people are active in the area, they may not be able to notice the warning signs or cordons. In addition, this static prompting method cannot monitor the behavior changes of people in the area in real time, nor can it provide immediate feedback or record the violations of people, which reduces the real-time and accuracy of regional alarms.

[0003] Therefore, there is a technical problem in the related technology that the accuracy of regional alarm is low due to the low real-time and accuracy of detecting the behavior of objects in the region.

[0004] To address the above-mentioned problems, no effective solution has been proposed yet. Summary of the invention

[0005] The embodiments of the present application provide a sound source alarm method and device, a storage medium and an electronic device to at least solve the technical problem of low accuracy of regional alarm due to low real-time and accuracy in detecting the behavior of objects in the area.

[0006] According to one aspect of an embodiment of the present application, a sound source alarm method is provided, including: controlling a sound source input device to obtain sound source data, wherein the sound source input device is used to collect sound from a target area; determining first sound source data and second sound source data from the sound source data, wherein the first sound source data and the second sound source data represent sound source data collected by the first sound source input device and the second sound source input device for a target sound source within the same time period, and the first sound source input device is different from the second sound source input device; analyzing the frequency components of the first sound source data and the second sound source data to determine target coordinates of the target sound source; determining a behavior state of the target sound source based on changes in the target coordinates within a preset time period, and generating an alarm message when the behavior state is a target behavior state.

[0007] According to another aspect of an embodiment of the present application, a sound source alarm device is also provided, including: an acquisition module, used to control a sound source input device to acquire sound source data, wherein the sound source input device is used to collect sound for a target area; a determination module, used to determine first sound source data and second sound source data from the sound source data, wherein the first sound source data and the second sound source data represent sound source data collected by the first sound source input device and the second sound source input device for a target sound source within the same time period, and the first sound source input device is different from the second sound source input device; an analysis module, used to analyze the frequency components of the first sound source data and the second sound source data to determine the target coordinates of the target sound source; a generation module, used to determine the behavior state of the target sound source based on the change of the target coordinates within a preset time period, and generate an alarm message when the behavior state is the target behavior state.

[0008] Optionally, the device is used to analyze the frequency components of the first sound source data and the second sound source data to determine the target coordinates of the target sound source in the following manner: analyze the frequency components of the first sound source data and the second sound source data to determine the first distance between the target sound source and the first sound source input device and the second distance between the target sound source and the second sound source input device, respectively; determine the target coordinates of the target sound source based on the first distance, the second distance, the first coordinates of the first sound source input device, and the second coordinates of the second sound source input device.

[0009] Optionally, the device is used to analyze the frequency components of the first sound source data and the second sound source data to determine the first distance between the target sound source and the first sound source input device and the second distance between the target sound source and the second sound source input device, respectively, in the following manner: analyze the frequency components of the first sound source data and the second sound source data to determine a first simple harmonic wave corresponding to the first sound source data and a second simple harmonic wave corresponding to the second sound source data; determine the first distance based on a first phase value of the first simple harmonic wave, and determine the second distance based on a second phase value of the second simple harmonic wave.

[0010] Optionally, the device is used to determine the target coordinates of the target sound source based on the first distance, the second distance, the first coordinates of the first sound source input device, and the second coordinates of the second sound source input device in the following manner: determine a target triangle based on the first distance, the second distance, the first coordinates, and the second coordinates, wherein the three vertices of the target triangle are the target sound source, the first sound source input device, and the second sound source input device, respectively; determine the target coordinates based on Heron's formula and the target triangle.

[0011] Optionally, the device is used to determine the behavior state of the target sound source based on the change of the target coordinates within a preset time period in the following manner, and generate an alarm message when the behavior state is the target behavior state: when the target coordinates are in a dangerous area within the preset time period, determine whether the behavior state of the target sound source is a static state; when the behavior state is the static state, determine whether the behavior state of the target sound source is a distress state based on the first sound source data, the second sound source data and the sample sound source data; when the behavior state of the target sound source includes the static state and the distress state, generate the alarm message to indicate that the target object associated with the target sound source is in an emergency state.

[0012] Optionally, the device is used to determine the behavior state of the target sound source based on the change of the target coordinates within a preset time period in the following manner, and generate an alarm message when the behavior state is the target behavior state: when the target coordinates are in a dangerous area within the preset time period, determine whether the behavior state of the target sound source is an emergency state based on the first sound source data and the sample sound source data; when the behavior state of the target sound source is the emergency state, generate the alarm message and control the second sound source input device to play the alarm message, wherein the first sound source input device and the second sound source input device are configured to collect sounds from different areas, and the second sound source input device allows audio to be played.

[0013] Optionally, the device is used to determine the behavior state of the target sound source based on the change of the target coordinates within a preset time period in the following manner, and generate an alarm message when the behavior state is the target behavior state: based on the change of the target coordinates within a preset time period, determine whether the target sound source moves toward a dangerous area; when the target sound source moves toward the dangerous area, determine that the behavior state of the target sound source is the target behavior state, and generate an alarm message.

[0014] Optionally, the device is used to determine the behavior state of the target sound source based on the change of the target coordinates within a preset time period in the following manner, and generate an alarm message when the behavior state is the target behavior state: determine the behavior state of the target sound source based on the change of the target coordinates within a preset time period; generate a first alarm message when the behavior state of the target sound source is staying at the edge of the dangerous area, wherein the first alarm message is used to prompt the target sound source to stay away from the dangerous area; generate a second alarm message when the behavior state of the target sound source is moving in the dangerous area, wherein the second alarm message is used to send a notification message to the server to prompt the server to execute a rescue strategy; the rescue strategy includes at least one of the following: the server sends the second alarm message to the rescue device, and the server sends a third alarm message to the sound source input device, wherein the third alarm message includes a rescue plan generated based on the second alarm message.

[0015] According to another aspect of the embodiments of the present application, a computer-readable storage medium is provided, in which a computer program is stored, wherein the computer program is configured to execute the above-mentioned sound source alarm method when running.

[0016] According to another aspect of the embodiments of the present application, a computer program product or a computer program is provided, the computer program product or the computer program including computer instructions, the computer instructions being stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the above sound source alarm method.

[0017] According to another aspect of the embodiments of the present application, there is further provided an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to execute the sound source alarm method through the computer program.

[0018] In an embodiment of the present application, a sound source input device is controlled to obtain sound source data, wherein the sound source input device is used to collect sound for a target area; first sound source data and second sound source data are determined from the sound source data, wherein the first sound source data and the second sound source data represent sound source data collected by the first sound source input device and the second sound source input device for the target sound source in the same time period, and the first sound source input device is different from the second sound source input device; the frequency components of the first sound source data and the second sound source data are analyzed to determine the target coordinates of the target sound source; based on the change of the target coordinates within a preset time period, the behavior state of the target sound source is determined, and when the behavior state is the target behavior state, an alarm message is generated. Through the collaborative work of multiple sound source input devices, the frequency components are analyzed, and the purpose of real-time and accurate detection of the behavior of objects in the area is achieved, thereby achieving the technical effect of improving the accuracy of regional alarms, and further solving the technical problem of low accuracy of regional alarms due to low real-time and accuracy in detecting the behavior of objects in the area. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0020] Figure 1 is a schematic diagram of an application environment of an optional sound source alarm method according to an embodiment of the present application;

[0021] Figure 2 is a flow chart of an optional sound source alarm method according to an embodiment of the present application;

[0022] Figure 3 is a schematic diagram of an optional sound source alarm method according to an embodiment of the present application;

[0023] Figure 4 is a schematic diagram of another optional sound source alarm method according to an embodiment of the present application;

[0024] Figure 5 is a schematic diagram of another optional sound source alarm method according to an embodiment of the present application;

[0025] Figure 6 is a schematic diagram of another optional sound source alarm method according to an embodiment of the present application;

[0026] Figure 7 is a structural schematic diagram of an optional sound source alarm device according to an embodiment of the present application;

[0027] Figure 8 is a structural diagram of an optional sound source alarm product according to an embodiment of the present application;

[0028] Fig. 9 It is a schematic diagram of the structure of an optional electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0029] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.

[0030] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0031] The present application is described below in conjunction with embodiments:

[0032] According to one aspect of an embodiment of the present application, a sound source alarm method is provided. Optionally, in this embodiment, the sound source alarm method can be applied to Figure 1 In the hardware environment composed of the server 101 and the terminal device 103 shown in FIG. Figure 1As shown, the server 101 is connected to the terminal 103 via a network, and can be used to provide services for the terminal device or an application 107 installed on the terminal device. The application can be a video application, an instant messaging application, a browser application, an educational application, a game application, etc. A database 105 may be set up on the server or independently of the server to provide data storage services for the server 101, for example, a game data storage server. The above-mentioned network may include, but is not limited to, a wired network and a wireless network, wherein the wired network includes, a local area network, a metropolitan area network and a wide area network; the wireless network includes, Bluetooth, WIFI and other networks that implement wireless communication; the terminal device 103 may be a terminal configured with an application, and may include, but is not limited to, at least one of the following: a mobile phone (such as an Android phone, an iOS phone, etc.), a laptop computer, a tablet computer, a PDA, a MID (Mobile Internet Devices), a PAD, a desktop computer, a smart TV, an intelligent voice interaction device, a smart home appliance, a vehicle-mounted terminal, an aircraft, a virtual reality (VR) terminal, an augmented reality (AR) terminal, a mixed reality (MR) terminal and other computer devices; the above-mentioned server may be a single server, a server cluster consisting of multiple servers, or a cloud server.

[0033] Combination Figure 1 As shown, the above-mentioned sound source alarm method can be executed by an electronic device, and the electronic device can be a terminal device or a server. The above-mentioned sound source alarm method can be implemented by the terminal device or the server respectively, or by the terminal device and the server together.

[0034] The above is only an example and is not specifically limited in this embodiment.

[0035] Optionally, as an optional implementation, as Figure 2 As shown, the above-mentioned sound source alarm method includes:

[0036] S202, controlling a sound source input device to obtain sound source data, wherein the sound source input device is used to collect sound from a target area;

[0037] Optionally, in an embodiment of the present application, the above-mentioned sound source input device may include but is not limited to a microphone array, a single microphone, a voice recorder, a built-in microphone of a mobile phone, a camera (with a recording function), a smart speaker and other devices, which can convert sound signals into electrical signals, and then convert them into audio data that can be processed by a computer. The above-mentioned audio data can be understood as the audio digital representation obtained by processing the collected sound by the sound source input device. Specifically, it can be obtained by sampling and quantizing an analog signal. The audio data can be a waveform audio file (such as WAV, AIFF or AU format), a compressed audio file (such as MP3, AAC or OGG format), or audio stream data (such as real-time audio stream in network transmission), and can also include mono or multi-channel information, as well as parameters such as sampling frequency and bit depth. The above-mentioned target area can be determined based on the business environment in which the present application is applied.

[0038] For example, assuming that the technical solution proposed in the present application is applied to an intelligent conference system, the target area is the entire conference room; or, the technical solution proposed in the present application is applied to a smart home system, and the target area is a room specified by the user; or, the technical solution proposed in the present application is applied to an outdoor scene, for example, in a personnel detection system in a river area, the target area is the river area.

[0039] Furthermore, taking the application of the technical solution proposed in the present application to a smart home system, where the target area is a room specified by a user as an example, the above-mentioned sound source input device can be deployed in the room, or on the floor where the room is located; or, taking the application of the technical solution proposed in the present application to an outdoor scene, where the target area is a river area as an example, the above-mentioned sound source input device can be deployed at any position in the river area, and it can be understood that the number of the above-mentioned sound source input devices is not limited.

[0040] S204, determining first sound source data and second sound source data from the sound source data, wherein the first sound source data and the second sound source data represent sound source data collected by the first sound source input device and the second sound source input device for the target sound source in the same time period, and the first sound source input device and the second sound source input device are different;

[0041] Optionally, in an embodiment of the present application, the first sound source data and the second sound source data are sound source data collected by different sound source input devices, and the first sound source input device and the second sound source input device are different sound source input devices.

[0042] Exemplarily, assume that the above-mentioned sound source input device includes device A (the above-mentioned first sound source input device) and device B (the second sound source input device); device A is deployed on the upstream bank of the river, and device B is deployed on the upstream bank of the river. In the same time period, the audio data collected by device A (the above-mentioned first sound source data) includes the audio generated by the river and the audio generated by person A fishing upstream of the river; while device B only collects the audio generated by the river (the above-mentioned second sound source data). That is to say, the above-mentioned audio data may include but is not limited to the audio of the target area collected by more than one device. To put it another way, it may also include audio emitted by different objects in the target area.

[0043] S206, analyzing the frequency components of the first sound source data and the second sound source data to determine the target coordinates of the target sound source;

[0044] Optionally, in an embodiment of the present application, the frequency components of the first sound source data and the second sound source data refer to the sound wave frequency distribution of the target sound source obtained by spectral analysis, which may include the fundamental frequency, harmonic frequencies and other characteristic frequencies in the spectrum of the sound source. The target sound source refers to a specific sound source that needs to be located or identified in advance, such as a person speaking, a specific musical instrument being played, or a specific environmental sound, etc. The target coordinates refer to the specific position of the target sound source in space, which may be represented by three-dimensional coordinates (X, Y, Z), where X and Y represent horizontal and vertical positions, and Z represents height or depth.

[0045] In an exemplary embodiment, assuming that within a time period, first sound source data is collected through a first sound source input device, and second sound source data is collected through a second sound source input device, then, the frequency components of the first sound source data and the second sound source data may be analyzed using, but not limited to, an NVR (network video storage device that can capture sounds in a specific area and convert them into digital signals for analysis) system to obtain the target coordinates of the target sound source. Figure 3 is a schematic diagram of an optional sound source alarm method according to an embodiment of the present application, wherein the sound source input device deployed in the target area is as follows Figure 3 As shown, specifically:

[0046] S1, determine the target sound source: after obtaining the sound source, the NVR performs Fourier transform on the above-mentioned first sound source data and the second sound source data respectively, and converts the sound waves of the audio data into at least one of sine waves or cosine waves, and judges whether the target sound source appears by comparing and analyzing the waveform type of at least one of the sine waves or cosine waves (there are one or more audio data in the audio data that are audio data corresponding to the target sound source), which may include but is not limited to pre-recording in the database the waveform type corresponding to the target sound source obtained in the test or training stage, and by comparing the waveform type corresponding to each sound wave with the waveform type corresponding to the target sound source, determine whether the target sound source exists according to the waveform similarity. For example, the similarity threshold is set to 99%. When the similarity between a certain waveform and the waveform corresponding to the target sound source is greater than or equal to 99%, it is considered that the waveform type is the same as the waveform type corresponding to the target sound source, and the sound source corresponding to the waveform is determined to be the target sound source, wherein the similarity threshold can be flexibly set, and this application is not limited thereto. The Fourier transform formula is as follows:

[0047] , where F(w) refers to the frequency domain representation of the audio data, f(t) refers to the original first sound source data and the second sound source data, (t) here represents time, i is an imaginary unit, w is the angular frequency, which describes the rotation speed of a certain frequency component in the audio data, and dt is a small increment of time, which represents the differentiation of time during the integration process.

[0048] S2, determine the target coordinates: In the NVR, construct an indicator coordinate system with the three speakers arranged to construct the regional situation. Then, import the location information of the dangerous area into the NVR and set the monitored sound source behavior (the above target behavior state). Assuming that two speakers collect the monitored sound source respectively within a period of time, the NVR will determine the sound source location based on the speaker that can collect the sound source:

[0049] Assume that the sound source is received at a distance D from the speaker. After the target sound source is detected in step S2, the sound volume is determined by one of the analyzed sine phases, and then the distance of the sound source from the speaker is determined to be d. After multiple speakers receive the sound source, the same analyzed sine wave is used to determine the distance. Assume that the coordinates of the two speakers are:

[0050] (0,0), (0,D);

[0051] The distance of the sound source received by NVR from speaker_1 (the first distance mentioned above) is d1, and the distance from speaker_2 (the second distance mentioned above) is d2. At this time, the sound source and the two speakers form a triangle, and the lengths of the three sides are known. The Heron's formula (a formula for calculating the area of ​​a triangle with three known sides. Let the three sides of the triangle be a, b, and c, and the semi-perimeter (half of the three sides) be s) can be used to obtain the area of ​​the triangle, and then determine the ordinate of the sound source to obtain the complete target coordinates of the target sound source. The above Heron's formula is expressed as:

[0052] p=(a+b+c) / 2;

[0053] S = sqrt[p(pa)(pb)(pc)];

[0054] It is understandable that the target coordinates of the target sound source can also be calculated by comparing the time difference or intensity difference between the sounds received by different audio input devices.

[0055] S208, determining the behavior state of the target sound source based on the change of the target coordinates within a preset time period, and generating an alarm message when the behavior state is the target behavior state.

[0056] Optionally, in an embodiment of the present application, the above-mentioned behavior state can be determined based on the business environment in which the present application is applied, the above-mentioned target behavior state can be a predetermined behavior state, and the above-mentioned alarm message can include but is not limited to prompts through voice, video, images, etc.

[0057] Exemplarily, assuming that the technical solution proposed in the present application is applied to an intelligent conference system, the target area is the entire conference room, and the behavior status may include but is not limited to standing, opening the door, explaining, etc.; or, the technical solution proposed in the present application is applied to a smart home system, the target area is a room designated by the user, and the behavior status may include but is not limited to entering or leaving, being still for a long time, abnormal activity, etc.; or, the technical solution proposed in the present application is applied to an outdoor scene, for example, in a personnel detection system in a river area, the target area is the river area, and the behavior status may include but is not limited to being close to water, abnormal sounds, fast movement, illegal entry, etc.

[0058] In an exemplary embodiment, in a smart home system, the target behavior state may include but is not limited to the following:

[0059] (1) Entering or leaving: When the coordinates of the target sound source (such as footsteps or the sound of a door opening) change within a preset time period, indicating that it enters the target room from another room, or leaves the target room, the system may generate an alarm message to prompt the user that someone has entered or left the designated room; (2) Long-term stillness: If the system detects that the target sound source stays in a fixed position for a long time, this may mean that someone has not moved in the room for a long time, and an alarm message is generated to prompt the user to check whether help is needed or whether there is any abnormal situation; (3) Abnormal activity: For example, if the target sound source suddenly moves in the room at night, or if the target sound source is detected in the room during a preset time period (such as when the user is not at home), an alarm message may also be generated to prompt the user that there may be danger.

[0060] In another exemplary embodiment, in an outdoor scene, such as a personnel detection system in a river area, the target behavior state may include but is not limited to the following:

[0061] (1) Approaching water: If the coordinates of the target sound source change and show that it is approaching the river area, the system will generate an alarm message to alert the river detection management personnel that someone is approaching dangerous waters; (2) Abnormal sound: For example, if the system detects a sound similar to a cry for help or falling into the water, it will generate an alarm message to indicate that someone may have fallen into the water or other dangerous situations; (3) Rapid movement: If the coordinates of the target sound source change significantly in a short period of time, an alarm message will be generated to indicate that someone is moving quickly, which may be a rescue, escape or other emergency situation; (4) Illegal entry: If the system detects that the target sound source enters the river area at a non-preset time (such as at night), an alarm message will be generated to indicate that there may be illegal activities.

[0062] In an exemplary embodiment, Figure 4 is a schematic diagram of an optional sound source alarm method according to an embodiment of the present application. In the river area safety detection scenario, the embodiment of the present application can be as follows Figure 4 As shown:

[0063] S402, start acquiring audio data through an audio source input device;

[0064] S404, analyzing the sound source corresponding to the audio data;

[0065] S406, determining whether the target sound source appears, if it appears, execute S408, otherwise execute S418;

[0066] S408, determining a target behavior of the target sound source by using the change of the target coordinates of the target sound source within a preset time period;

[0067] S410, determining the behavior of the target sound source, including the following behavior states:

[0068] S412-1, if it is phishing behavior, no operation is performed and no warning is given;

[0069] S412-2: If you are close to the rapids area, a voice warning will be given (do not approach, there is danger);

[0070] S412-3, swimming behavior, voice warning prompt (this is an undercurrent area, please pay attention to safety);

[0071] S412-4, drowning behavior, timely feedback of the location of the target sound source and other information to the rescue system, and execution of S414;

[0072] S414, the rescue system determines whether rescue is needed, if so, execute S416, otherwise execute S418;

[0073] S416, linking various audio input devices in the target area to broadcast distress information to multiple devices, and promptly notifying rescue personnel to rush to the scene for rescue;

[0074] S418, end.

[0075] Through the embodiments of the present application, a sound source input device is controlled to obtain sound source data, wherein the sound source input device is used to collect sound for a target area; first sound source data and second sound source data are determined from the sound source data, wherein the first sound source data and the second sound source data represent sound source data collected by the first sound source input device and the second sound source input device for the target sound source in the same time period, and the first sound source input device is different from the second sound source input device; the frequency components of the first sound source data and the second sound source data are analyzed to determine the target coordinates of the target sound source; based on the change of the target coordinates within a preset time period, the behavior state of the target sound source is determined, and when the behavior state is the target behavior state, an alarm message is generated. Through the collaborative work of multiple sound source input devices, the frequency components are analyzed, and the purpose of real-time and accurate detection of the behavior of objects in the area is achieved, thereby achieving the technical effect of improving the accuracy of regional alarms, and further solving the technical problem of low accuracy of regional alarms due to low real-time and accuracy of detection of object behaviors in the area in related technologies.

[0076] As an optional scheme, the above-mentioned analysis of the frequency components of the first sound source data and the second sound source data to determine the target coordinates of the target sound source includes: analyzing the frequency components of the first sound source data and the second sound source data to determine the first distance between the target sound source and the first sound source input device and the second distance between the target sound source and the second sound source input device; determining the target coordinates of the target sound source based on the first distance, the second distance, the first coordinates of the first sound source input device and the second coordinates of the second sound source input device.

[0077] Optionally, in an embodiment of the present application, the first distance refers to the distance between the target sound source and the first sound source input device, and the second distance refers to the distance between the target sound source and the second sound source input device.

[0078] Exemplarily, once the distance between the target sound source and two fixed-position devices is determined, the mathematical method of trilateration or triangulation can be used to calculate the precise position of the target sound source. If the first coordinates of the first sound source input device and the second coordinates of the second sound source input device are known, and the distance between the target sound source and the two devices has been measured, the three-dimensional coordinates of the target sound source can be determined by geometric calculation.

[0079] As an optional scheme, the above-mentioned analysis of the frequency components of the above-mentioned first sound source data and the above-mentioned second sound source data to determine the first distance between the above-mentioned target sound source and the above-mentioned first sound source input device and the second distance between the above-mentioned target sound source and the above-mentioned second sound source input device, includes: analyzing the frequency components of the above-mentioned first sound source data and the above-mentioned second sound source data to determine the first simple harmonic wave corresponding to the above-mentioned first sound source data and the second simple harmonic wave corresponding to the above-mentioned second sound source data; determining the above-mentioned first distance based on the first phase value of the above-mentioned first simple harmonic wave, and determining the above-mentioned second distance based on the second phase value of the above-mentioned second simple harmonic wave.

[0080] Optionally, in an embodiment of the present application, the above-mentioned first simple harmonic wave can be understood as the frequency domain representation of the above-mentioned first sound source data, the above-mentioned second simple harmonic wave can be understood as the frequency domain representation of the above-mentioned second sound source data, the above-mentioned first phase value refers to the phase information of the first simple harmonic wave in the first audio input device, and the above-mentioned second phase value refers to the phase information of the second simple harmonic wave in the second audio input device.

[0081] Furthermore, since the phase of a sound wave changes as the distance increases during the propagation from the sound source to the receiver, it can be understood that in physics, the phase of a simple harmonic wave has a direct relationship with the propagation distance of the wave. The "first distance" refers to the position where the first simple harmonic wave propagates from the sound source corresponding to the first audio data to the first audio input device. Based on this, the waveform function (phase expression) of the simple harmonic wave can be directly used to determine the first distance:

[0082] [y(x,t)=A\sin(kx-\omegat+\phi)];

[0083] Where: A is the amplitude of the first simple harmonic wave, k is the wave number, defined as (2\pi / \lambda), \lambda is the wavelength, \omega is the angular frequency, defined as (2\pif), f is the frequency, \phi is the initial phase, and x and t are the position (first distance) and time, respectively.

[0084] Through the embodiments of the present application, the purpose of determining the above-mentioned first distance by using the first phase value and determining the above-mentioned second distance by using the second phase value is achieved, thereby ensuring the accuracy of the first distance and the second distance, thereby facilitating the subsequent acquisition of the above-mentioned target coordinates based on the first distance and the second distance, thereby achieving the technical effect of improving the positioning accuracy and reliability of the target sound source and ensuring that the target position information is accurate.

[0085] As an optional scheme, the above-mentioned determination of the target coordinates of the target sound source based on the above-mentioned first distance, the above-mentioned second distance, the first coordinates of the above-mentioned first sound source input device and the second coordinates of the above-mentioned second sound source input device includes: determining a target triangle based on the above-mentioned first distance, the above-mentioned second distance, the above-mentioned first coordinates and the above-mentioned second coordinates, wherein the three vertices of the above-mentioned target triangle are the above-mentioned target sound source, the above-mentioned first sound source input device and the above-mentioned second sound source input device, respectively; determining the above-mentioned target coordinates based on Heron's formula and the above-mentioned target triangle.

[0086] Optionally, in the embodiment of the present application, the target triangle refers to a triangle formed by the target sound source position, the first sound source input device position, and the second sound source input device position. Specifically, assume that the target sound source position is point A, whose coordinates are the first coordinates; the first sound source input device position is point B, whose coordinates are the second coordinates; the second sound source input device position is point C, whose coordinates are known (assuming fixed coordinates). By measuring the first distance from point A to point B and the second distance from point A to point C, the target triangle ABC can be determined based on this information.

[0087] For example, when the distance of the sound source from speaker_1 (the first distance mentioned above) is d1 and the distance from speaker_2 (the second distance mentioned above) is d2, the sound source and the two speakers form a triangle, and the lengths of the three sides are known, Heron's formula (a formula for calculating the area of ​​a triangle with three known sides, assuming that the three sides of the triangle are a, b, and c, and the semi-perimeter (i.e., half of the three sides) is s) can be used to obtain the area of ​​the triangle, and then determine the ordinate of the sound source, and obtain the complete target coordinates of the target sound source. The above Heron's formula is expressed as:

[0088] p=(a+b+c) / 2;

[0089] S = sqrt[p(pa)(pb)(pc)];

[0090] In an exemplary embodiment, the area of ​​the target triangle is first obtained using Heron's formula. Next, assuming that speaker_1 is located at (0, 0) (the first coordinate mentioned above), speaker_2 is located at (10, 0) (the second coordinate mentioned above), the first distance d1 from the target sound source to speaker_1 is 12, the second distance d2 from the target sound source to speaker_2 is 15, and the distance between AB is dAB = 10; the ordinate y3 of the sound source is y = (2 S) / dAB; then, substitute the y3 value into the Pythagorean theorem equation to solve for x3, and finally obtain the target coordinates (x3, y3).

[0091] Through the embodiments of the present application, the purpose of effectively reducing the error in the target position measurement process of the target sound source is achieved, the measurement robustness is enhanced, the target coordinates can be accurately obtained, and the measurement stability can be guaranteed in complex environments.

[0092] As an optional scheme, the above-mentioned determination of the behavior state of the above-mentioned target sound source is based on the change of the above-mentioned target coordinates within a preset time period, and generation of an alarm message when the above-mentioned behavior state is the target behavior state, including: when the above-mentioned target coordinates are in a dangerous area within the above-mentioned preset time period, determining whether the behavior state of the above-mentioned target sound source is a static state; when the above-mentioned behavior state is the above-mentioned static state, determining whether the behavior state of the above-mentioned target sound source is a distress state based on the above-mentioned first sound source data, the above-mentioned second sound source data and the sample sound source data; when the behavior state of the above-mentioned target sound source includes the above-mentioned static state and the above-mentioned distress state, generating the above-mentioned alarm message to indicate that the target object associated with the above-mentioned target sound source is in an emergency state.

[0093] Optionally, in an embodiment of the present application, the preset time period may be a period of time that continues after the first audio data is acquired, the danger zone refers to a partial area within the target area, the distress state and static state are two behavioral states of the target sound source, and the sample sound source data refers to audio data collected or set in advance for comparison and identification of whether the target sound source is in a specific state (such as a distress state).

[0094] Specifically, the sample sound source data can be an audio file containing specific distress sounds, keywords or patterns, such as recordings of distress words such as "help", "help", "help", or static background sounds in a specific environment. By comparing and analyzing the first sound source data and the second sound source data of the target sound source with the sample sound source data, it is possible to timely and effectively determine whether the target sound source is in a static state or in a distress state.

[0095] Exemplarily, the position of the target sound source is determined according to the target coordinates, and the change of the target coordinates is continuously monitored within the above-mentioned preset time period, so as to determine the behavior state of the target sound source.

[0096] In an exemplary embodiment, if the coordinates of the target sound source are continuously located in the dangerous area within the target area within a preset time period (e.g., 5 minutes), the behavior state of the target sound source will be further analyzed. The analysis of the behavior state is based on the first sound source data (such as volume, pitch, duration, etc.), the second sound source data (which may include background noise, ambient sound, etc.), and the sample sound source data (known distress sound patterns);

[0097] In another exemplary embodiment, if the behavior state of the target sound source in the danger zone appears to be static (for example, the position of the sound source has not changed, but the sound emitted by the sound source continues to exist), a sound analysis algorithm can be used to combine the first sound source data and the sample sound source data to determine whether the behavior of the target sound source meets the characteristics of a distress call state, which may include but is not limited to identifying specific distress call words, urgent changes in tone, and a high degree of match with the sample distress call sound pattern.

[0098] Furthermore, if the analysis result indicates that the behavior state of the target sound source is consistent with both a static state and a distress call state, an alarm message will be generated, indicating that the target object (e.g., a person or an animal) associated with the target sound source may be in an emergency state and requires immediate attention and rescue.

[0099] It can be understood that the application scenarios of the embodiments of the present application may include but are not limited to monitoring the sound activities of people during outdoor adventure activities; monitoring the behavior of operators in high-risk areas in industrial safety monitoring; or monitoring the activities of the elderly or children in specific areas in smart home security systems, etc. By combining location information, behavioral status and sound analysis, the system can provide more accurate and timely emergency warnings, thereby achieving the purpose of improving the accuracy of sound source alarms.

[0100] As an optional scheme, the above-mentioned determination of the behavior state of the target sound source is based on the change of the target coordinates within a preset time period, and generation of an alarm message when the behavior state is the target behavior state, including: when the target coordinates are in a dangerous area within the preset time period, determining whether the behavior state of the target sound source is an emergency state based on the first sound source data and the sample sound source data; when the behavior state of the target sound source is the emergency state, generating the alarm message, and controlling the second sound source input device to play the alarm message, wherein the first sound source input device and the second sound source input device are configured to collect sounds from different areas, and the second sound source input device allows audio to be played.

[0101] In an exemplary embodiment, the first sound source data and the sample sound source data from the target sound source are analyzed to determine the behavior state of the target sound source. If the analysis result shows that the sound source is in an emergency state (such as making a cry for help or making an abnormal sound in a dangerous area), it will be further checked whether the sound source is indeed located in the dangerous area. If confirmed to be correct, the above-mentioned alarm message will be generated, which may include but is not limited to a preset voice message, or a real-time transcription and analysis result of the sound of the target sound source.

[0102] Furthermore, the alarm message can be played by a second sound source input device (different from the first sound source input device mentioned above), ensuring that the alarm message can cover a wider area and notify more people or systems. In addition, the setting of the second sound source input device also takes into account the movement of the sound source, ensuring that the alarm message can be effectively played and received no matter where the target sound source moves.

[0103] Through the embodiments of the present application, the accuracy of judging emergency situations and the speed of response are effectively improved. The present application can also be applied to a variety of scenarios, such as caring for children or the elderly, workplace safety monitoring, natural disaster warning, etc., to achieve the technical effect of improving the efficiency and safety of response to potential emergencies.

[0104] As an optional scheme, the above-mentioned determining the behavior state of the target sound source based on the change of the target coordinates within a preset time period, and generating an alarm message when the behavior state is the target behavior state, includes: determining whether the target sound source moves toward the dangerous area based on the change of the target coordinates within a preset time period; when the target sound source moves toward the dangerous area, determining that the behavior state of the target sound source is the target behavior state, and generating an alarm message.

[0105] In an exemplary embodiment, the movement trend of the sound source can be analyzed based on the change of the target coordinates within a preset time period. For example, if the coordinates of the sound source continuously move in a certain direction over a period of time, it can be determined that the sound source is moving in that direction, and if the direction is towards a predetermined dangerous area, it can be further determined whether the target sound source is moving towards the dangerous area.

[0106] Furthermore, after determining the moving direction of the target sound source, if it is found that the target sound source is moving towards a predefined danger zone, or has entered the danger zone, the behavior state of the target sound source will be determined as the target behavior state, and an alarm message will be automatically generated to send an alarm to the management personnel of the target area, or to warn people near the sound source through audio and visual signals to take necessary safety measures.

[0107] It is understandable that the embodiments of the present application can be performed in real time to achieve the purpose of continuously monitoring the location changes of the sound source. Once the target behavior state is found, an alarm message is immediately generated, thereby improving the timeliness and effectiveness of the warning.

[0108] As an optional scheme, the above-mentioned determining the behavior state of the target sound source based on the change of the target coordinates within a preset time period, and generating an alarm message when the behavior state is the target behavior state, includes: determining the behavior state of the target sound source based on the change of the target coordinates within a preset time period; generating a first alarm message when the behavior state of the target sound source is staying at the edge of the dangerous area, wherein the first alarm message is used to prompt the target sound source to stay away from the dangerous area; generating a second alarm message when the behavior state of the target sound source is moving in the dangerous area, wherein the second alarm message is used to send a notification message to the server to prompt the server to execute a rescue strategy; the rescue strategy includes at least one of the following: the server sends the second alarm message to the rescue device, and the server sends a third alarm message to the sound source input device, wherein the third alarm message includes a rescue plan generated based on the second alarm message.

[0109] Optionally, in an embodiment of the present application, the first warning message, the second warning message, and the third warning message may be displayed in a manner including but not limited to voice, video, image, text, etc.

[0110] In an exemplary embodiment, if the sound source stays at the edge of the danger zone, the system will generate a first warning message, which can warn the user through voice, vibration, image or text of the sound source input device (such as a mobile phone, wearable device), prompting the user to leave the danger zone and avoid potential threats;

[0111] In another exemplary embodiment, if the target sound source not only stays at the edge of the danger zone but starts to move within the danger zone, it can be determined that its behavior state is a more serious security threat, and a second warning message is generated at this time, specifically:

[0112] The second alarm message is different from the first alarm message. It not only sends a warning to the sound source input device, but can also be sent to the server synchronously to trigger the server to execute a rescue strategy, where the rescue strategy may include: sending an emergency notification to rescue equipment (such as drones, police cars, ambulances); or sending a third alarm message to the sound source input device, which contains specific rescue plans, such as evacuation routes, the location of the nearest safe shelter, etc. Through this multi-level alarm and response mechanism, the response speed and efficiency in emergency situations can be effectively improved to ensure the safety of the sound source (ie, the user).

[0113] It should also be noted that the embodiments of the present application can support multiple message display methods, including but not limited to voice, video, image, text, etc., so that even in different environments and conditions, users can receive alarm information clearly and promptly, increasing the practicality and user-friendliness of the system.

[0114] For example, in a noisy environment, vibration or image alarms can be used first; at night or in conditions of poor visibility, image or voice alarms with brightness adjustment can be used to ensure the accuracy of information transmission.

[0115] Through the embodiments of the present application, real-time monitoring and intelligent analysis of the behavior status of the target sound source within a preset time period can be achieved. First, by collecting and processing the location information of the sound source, such as GPS data, image recognition results or other sensor information, it is determined whether the sound source is approaching or entering a predefined danger zone. An alarm message can also be generated, and the person corresponding to the target sound source can be further warned through voice, vibration, image or text of the sound source input device (such as a mobile phone, wearable device), prompting them to leave the danger zone and avoid potential threats.

[0116] In an exemplary embodiment, the sound source alarm method proposed in the present application can be applied to the detection scenario of the river area. Specifically, there are often some areas in the river where there are dangerous areas such as undercurrents, which are prone to drowning. Assuming that the above-mentioned target area is a river, through the present application, audio monitoring of the river can be realized, and some monitored objects approaching dangerous areas can be warned. At the same time, objects that are already in danger can be rescued. The Speaker is linked to the NVR (network video storage device that can capture the sound in a specific area and convert it into a digital signal for analysis) system, and the division of dangerous areas, the judgment of dangerous behaviors, and the judgment of target states are realized in the NVR (the above-mentioned analysis module), thereby solving the monitoring area and rescuing drowning behaviors.

[0117] In other words, the multi-channel audio data of riverside objects and events obtained by multiple IPSepaker devices (the above-mentioned sound source input devices) are accurately classified and intelligently monitored, so that dangerous behaviors such as drowning can be quickly detected, and warnings or online rescue can be issued.

[0118] For example, NVR defines a series of standard protocols for communication between network video devices (such as cameras, recorders, etc.) through ONVIF protocol (Open Network Video Interface Forum, Open Network Video Interface Forum protocol), so that devices produced by different manufacturers can be compatible and work together), and IPC (network video device) is linked to the channel of NVR. At this time, the link of IPC is directly connected to the speaker through the same protocol multiplexing, and the original video stream is replaced with an audio stream; at the same time, considering that the data of the audio stream is much smaller than the video stream data, the NVR can use one channel to link to more speakers and process more audio data streams (the above-mentioned sound source data). The NVR also realizes speaker intercom and plays and manages all speaker configurations and audio files through the HTTP protocol. NVR uses one channel to display the status of all speaker events to monitor the river area.

[0119] Further, Figure 5 is a schematic diagram of another optional sound source alarm method according to an embodiment of the present application, such as Figure 5 As shown, in the initial state, the NVR is connected to multiple speakers, and each speaker can obtain audio. When the target behavior is close to the river or swimming in the river through sound source analysis, only the alarm system is triggered, the custom voice in the speaker (the above alarm message) is played, and the voice alarm is executed to drive away the behavior through voice. If it is drowning, the rescue system is started, and the rescue team is notified through the network. If the rescue team has difficulty in rescue, the speaker can be linked to broadcast help to the nearby area to achieve rescue. In different business scenarios, close to the river, swimming in the river, and drowning here can all be understood as the above target behavior status.

[0120] In another exemplary embodiment, assuming that the target area is a river area, the moving direction of the target sound source can be obtained by recording the coordinate position of the target sound source in real time, and the behavior state corresponding to the target sound source can be determined. For example, the coordinate position of the target sound source indicates that the target sound source has been moving downstream of the river, and the target sound source has been in the river, and the waveform type is the same as that of the target sound source corresponding to drowning, then it is considered that the behavior state corresponding to the target sound source may be drowning.

[0121] In yet another exemplary embodiment, Figure 6 is a schematic diagram of another optional sound source alarm method according to an embodiment of the present application, such as Figure 6As shown, the NVR control strategy may include but is not limited to: after obtaining that the target sound source is a drowning target source, the NVR channel will display that a drowning incident has occurred in the area, and alert the monitoring personnel. The monitoring personnel will rush to the drowning area for rescue. If the monitoring personnel need support, the speaker in this area can be used to shout for help to the speakers or NVRs in other areas through the NVR, explaining the required rescue conditions to increase the success rate of the rescue; after obtaining that the audio target source is a normal target source, monitoring will continue, and the NVR channel will display the target appearance area. When the target source approaches the dangerous area, the NVR will automatically trigger the warning sound source in the audio to drive the target source away from the dangerous area. If the warning sound source does not work, the monitoring personnel can also shout to drive away.

[0122] Through the embodiments of the present application, different scenarios can be adapted and different processing solutions can be made, and the processing solutions are more timely. The IPspeaker and NVR solutions are fully connected to the Internet, so that supervisors can immediately learn about dangerous events and implement rescue plans in time. After the target sound source drowns, other speakers can implement rescue plans such as calling for help under the control of the NVR.

[0123] It is understandable that in the specific implementation of this application, related data such as user information is involved. When the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0124] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0125] According to another aspect of the embodiment of the present application, a sound source alarm device for implementing the above-mentioned sound source alarm method is also provided. Figure 7 As shown, the device comprises:

[0126] An acquisition module 702 is used to control a sound source input device to acquire sound source data, wherein the sound source input device is used to collect sound from a target area;

[0127] A determination module 704 is used to determine first sound source data and second sound source data from the sound source data, wherein the first sound source data and the second sound source data represent sound source data collected by a first sound source input device and a second sound source input device for a target sound source in the same time period, and the first sound source input device and the second sound source input device are different;

[0128] An analysis module 706 is used to analyze the frequency components of the first sound source data and the second sound source data to determine the target coordinates of the target sound source;

[0129] The generating module 708 is used to determine the behavior state of the target sound source based on the change of the target coordinates within a preset time period, and generate an alarm message when the behavior state is the target behavior state.

[0130] As an optional solution, the above-mentioned device is used to analyze the frequency components of the first sound source data and the second sound source data to determine the target coordinates of the target sound source in the following manner: analyze the frequency components of the first sound source data and the second sound source data to determine the first distance between the target sound source and the first sound source input device and the second distance between the target sound source and the second sound source input device; determine the target coordinates of the target sound source based on the first distance, the second distance, the first coordinates of the first sound source input device and the second coordinates of the second sound source input device.

[0131] As an optional solution, the above-mentioned device is used to analyze the frequency components of the first sound source data and the second sound source data in the following manner to determine the first distance between the target sound source and the first sound source input device and the second distance between the target sound source and the second sound source input device, respectively: analyze the frequency components of the first sound source data and the second sound source data to determine the first simple harmonic wave corresponding to the first sound source data and the second simple harmonic wave corresponding to the second sound source data; determine the first distance based on the first phase value of the first simple harmonic wave, and determine the second distance based on the second phase value of the second simple harmonic wave.

[0132] As an optional solution, the above-mentioned device is used to determine the target coordinates of the target sound source based on the first distance, the second distance, the first coordinates of the first sound source input device and the second coordinates of the second sound source input device in the following manner: determine the target triangle based on the first distance, the second distance, the first coordinate and the second coordinate, wherein the three vertices of the target triangle are the target sound source, the first sound source input device and the second sound source input device, respectively; determine the target coordinates based on Heron's formula and the target triangle.

[0133] As an optional solution, the above-mentioned device is used to determine the behavior state of the target sound source based on the change of the target coordinates within a preset time period in the following manner, and generate an alarm message when the behavior state is the target behavior state: when the target coordinates are in a dangerous area within a preset time period, determine whether the behavior state of the target sound source is a static state; when the behavior state is a static state, determine whether the behavior state of the target sound source is a distress state based on the first sound source data, the second sound source data and the sample sound source data; when the behavior state of the target sound source includes a static state and a distress state, generate an alarm message to indicate that the target object associated with the target sound source is in an emergency state.

[0134] As an optional scheme, the above-mentioned device is used to determine the behavior state of the target sound source based on the change of the target coordinates within a preset time period in the following manner, and generate an alarm message when the behavior state is the target behavior state: when the target coordinates are in a dangerous area within a preset time period, determine whether the behavior state of the target sound source is an emergency state based on the first sound source data and the sample sound source data; when the behavior state of the target sound source is an emergency state, generate an alarm message and control the second sound source input device to play the alarm message, wherein the first sound source input device and the second sound source input device are configured to collect sounds from different areas, and the second sound source input device allows audio to be played.

[0135] As an optional solution, the above-mentioned device is used to determine the behavior state of the target sound source based on the changes of the target coordinates within a preset time period in the following manner, and generate an alarm message when the behavior state is the target behavior state: based on the changes of the target coordinates within a preset time period, determine whether the target sound source moves toward the dangerous area; when the target sound source moves toward the dangerous area, determine that the behavior state of the target sound source is the target behavior state, and generate an alarm message.

[0136] As an optional scheme, the above-mentioned device is used to determine the behavior state of the target sound source based on the change of the target coordinates within a preset time period in the following manner, and generate an alarm message when the behavior state is the target behavior state: determine the behavior state of the target sound source based on the change of the target coordinates within a preset time period; when the behavior state of the target sound source is staying at the edge of the dangerous area, generate a first alarm message, wherein the first alarm message is used to prompt the target sound source to stay away from the dangerous area; when the behavior state of the target sound source is moving in the dangerous area, generate a second alarm message, wherein the second alarm message is used to send a notification message to the server to prompt the server to execute a rescue strategy; the rescue strategy includes at least one of the following: the server sends a second alarm message to the rescue device, and the server sends a third alarm message to the sound source input device, wherein the third alarm message includes a rescue plan generated based on the second alarm message.

[0137] In the embodiments of the present application, the term "module" or "unit" refers to a computer program or a part of a computer program that has a predetermined function and works together with other related parts to achieve a predetermined goal, and can be implemented in whole or in part by using software, hardware (such as processing circuits or memories), or a combination thereof. Similarly, a processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be part of an overall module or unit that includes the function of the module or unit.

[0138] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0139] According to one aspect of the present application, a computer program product is provided. The computer program product includes a computer program.

[0140] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0141] Figure 8 The structure block diagram of a computer system for implementing an electronic device according to an embodiment of the present application is schematically shown.

[0142] It should be noted that Figure 8 The computer system 800 of the electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0143] like Figure 8As shown, the computer system 800 includes a central processing unit 801 (CPU), which can perform various appropriate actions and processes according to the program stored in the read-only memory 802 (ROM) or the program loaded from the storage part 808 to the random access memory 803 (RAM). Various programs and data required for system operation are also stored in the random access memory 803. The central processing unit 801, the read-only memory 802 and the random access memory 803 are connected to each other through a bus 804. The input / output interface 805 (Input / Output interface, i.e., I / O interface) is also connected to the bus 804.

[0144] The following components are connected to the input / output interface 805: an input section 806 including a keyboard, a mouse, etc.; an output section 807 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; a storage section 808 including a hard disk, etc.; and a communication section 809 including a network interface card such as a LAN card, a modem, etc. The communication section 809 performs communication processing via a network such as the Internet. A drive 810 is also connected to the input / output interface 805 as needed. A removable medium 811, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 810 as needed so that a computer program read therefrom is installed into the storage section 808 as needed.

[0145] In particular, according to an embodiment of the present application, the process described in each method flow chart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer readable medium, and the computer program contains a program code for executing the method shown in the flow chart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 809, and / or installed from the removable medium 811. When the computer program is executed by the central processor 801, various functions defined in the system of the present application are executed.

[0146] In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 809, and / or installed from the removable medium 811. When the computer program is executed by the central processor 801, various functions provided by the embodiment of the present application are performed.

[0147] According to another aspect of the embodiment of the present application, an electronic device for implementing the above-mentioned sound source alarm method is also provided. The electronic device may be Figure 1 The terminal device or server shown in the figure. This embodiment is described by taking the electronic device as a terminal device as an example. Fig. 9 As shown, the electronic device includes a memory 902 and a processor 904. The memory 902 stores a computer program, and the processor 904 is configured to execute the steps in any of the above method embodiments through the computer program.

[0148] Optionally, in this embodiment, the electronic device may be located in at least one network device among a plurality of network devices of a computer network.

[0149] Optionally, in this embodiment, the above-mentioned processor can be configured to execute the methods in each embodiment of the present application through a computer program.

[0150] Alternatively, a person skilled in the art may understand that: Fig. 9 The structure shown is for illustration only. Fig. 9 The structure of the electronic device is not limited. Fig. 9 More or fewer components (such as network interfaces, etc.) as shown in, or with Fig. 9 Different configurations are shown.

[0151] Among them, the memory 902 can be used to store software programs and modules, such as the program instructions / modules corresponding to the sound source alarm method and device in the embodiments of the present application. The processor 904 executes various functional applications and data processing by running the software programs and modules stored in the memory 902, that is, to implement the above-mentioned sound source alarm method. The memory 902 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 902 may further include a memory remotely located relative to the processor 904, and these remote memories may be connected to the terminal via a network. Examples of the above-mentioned networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof. Among them, the memory 902 can be specifically, but not limited to, used to store information such as audio data. As an example, such as Fig. 9 As shown, the memory 902 may include but is not limited to the acquisition module 702, determination module 704, analysis module 706 and generation module 708 in the sound source alarm device. In addition, it may also include but is not limited to other module units in the sound source alarm device, which will not be repeated in this example.

[0152] Optionally, the transmission device 906 is used to receive or send data via a network. Specific examples of the network may include a wired network and a wireless network. In one example, the transmission device 906 includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices and routers via a network cable so as to communicate with the Internet or a local area network. In one example, the transmission device 906 is a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0153] In addition, the electronic device further includes: a display 908 for displaying the alarm message; and a connection bus 910 for connecting various module components in the electronic device.

[0154] In other embodiments, the terminal device or server may be a node in a distributed system, wherein the distributed system may be a blockchain system, and the blockchain system may be a distributed system formed by connecting the multiple nodes through network communication. The nodes may form a peer-to-peer network, and any form of computing device, such as a server, terminal or other electronic device, may become a node in the blockchain system by joining the peer-to-peer network.

[0155] According to one aspect of the present application, a computer-readable storage medium is provided, and a processor of an electronic device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the electronic device executes the sound source alarm method provided in various optional implementations of the above-mentioned sound source alarm.

[0156] Optionally, in this embodiment, the above-mentioned computer-readable storage medium can be configured to store data for executing the methods in various embodiments of the present application.

[0157] Optionally, in this embodiment, a person of ordinary skill in the art may understand that all or part of the steps in the various methods of the above embodiments may be completed by instructing hardware related to the terminal device through a program, and the program may be stored in a computer-readable storage medium, and the storage medium may include: a flash drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0158] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0159] If the integrated units in the above embodiments are implemented in the form of software functional units and sold or used as independent products, they can be stored in the above computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for one or more electronic devices to execute all or part of the steps of the methods described in each embodiment of the present application.

[0160] In the above embodiments of the present application, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the relevant description of other embodiments.

[0161] In the several embodiments provided in the present application, it should be understood that the disclosed application can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0162] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0163] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0164] The above is only a preferred implementation of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. A sound source alarm method, characterized in that: include: Controlling a sound source input device to obtain sound source data, wherein the sound source input device is used to collect sound from a target area; Determining first sound source data and second sound source data from the sound source data, wherein the first sound source data and the second sound source data represent sound source data collected by a first sound source input device and a second sound source input device for a target sound source in the same time period, and the first sound source input device is different from the second sound source input device; Analyze the frequency components of the first sound source data and the second sound source data, respectively compare the waveform type corresponding to each sound wave in the first sound source data, the waveform type corresponding to each sound wave in the second sound source data, and the waveform type corresponding to the target sound source, determine whether the target sound source exists according to the waveform similarity, and determine the target coordinates of the target sound source if the target sound source exists; Determine the behavior state of the target sound source based on the change of the target coordinates within a preset time period, and generate an alarm message when the behavior state is a target behavior state; The method also includes: analyzing the frequency components of the first sound source data and the second sound source data to determine a first distance between the target sound source and the first sound source input device and a second distance between the target sound source and the second sound source input device; and determining a target coordinate of the target sound source based on the first distance, the second distance, a first coordinate of the first sound source input device, and a second coordinate of the second sound source input device.

2. The method according to claim 1, characterized in that The analyzing the frequency components of the first sound source data and the second sound source data to determine a first distance between the target sound source and the first sound source input device and a second distance between the target sound source and the second sound source input device, respectively, comprises: Analyze the frequency components of the first sound source data and the second sound source data to determine a first simple harmonic wave corresponding to the first sound source data and a second simple harmonic wave corresponding to the second sound source data; The first distance is determined based on a first phase value of the first simple harmonic wave, and the second distance is determined based on a second phase value of the second simple harmonic wave.

3. The method according to claim 1, characterized in that The determining the target coordinates of the target sound source based on the first distance, the second distance, the first coordinates of the first sound source input device, and the second coordinates of the second sound source input device includes: Determine a target triangle based on the first distance, the second distance, the first coordinate, and the second coordinate, wherein three vertices of the target triangle are the target sound source, the first sound source input device, and the second sound source input device, respectively; The target coordinates are determined based on Heron's formula and the target triangle.

4. The method according to claim 1, characterized in that: The determining the behavior state of the target sound source based on the change of the target coordinates within a preset time period, and generating an alarm message when the behavior state is a target behavior state, includes: In the case where the target coordinates are within the dangerous area within the preset time period, determining whether the behavior state of the target sound source is a static state; In the case where the behavior state is the static state, determining whether the behavior state of the target sound source is a distress state based on the first sound source data, the second sound source data, and the sample sound source data; In a case where the behavior state of the target sound source includes the static state and the distress state, the alarm message is generated to indicate that the target object associated with the target sound source is in an emergency state.

5. The method according to claim 1, characterized in that The determining the behavior state of the target sound source based on the change of the target coordinates within a preset time period, and generating an alarm message when the behavior state is a target behavior state, includes: When the target coordinates are within the dangerous area within the preset time period, determining whether the behavior state of the target sound source is an emergency state based on the first sound source data and the sample sound source data; When the behavior state of the target sound source is the emergency state, the alarm message is generated, and the second sound source input device is controlled to play the alarm message, wherein the first sound source input device and the second sound source input device are configured to collect sounds from different areas, and the second sound source input device allows audio to be played.

6. The method according to claim 1, characterized in that The determining the behavior state of the target sound source based on the change of the target coordinates within a preset time period, and generating an alarm message when the behavior state is a target behavior state, includes: Determining whether the target sound source moves toward a dangerous area based on changes in the target coordinates within a preset time period; When the target sound source moves toward the dangerous area, the behavior state of the target sound source is determined to be the target behavior state, and an alarm message is generated.

7. The method according to any one of claims 1 to 6, characterized in that The determining the behavior state of the target sound source based on the change of the target coordinates within a preset time period, and generating an alarm message when the behavior state is a target behavior state, includes: Determining the behavior state of the target sound source based on the change of the target coordinates within a preset time period; When the behavior state of the target sound source is staying at the edge of the danger zone, generating a first warning message, wherein the first warning message is used to prompt the target sound source to stay away from the danger zone; When the behavior state of the target sound source is moving in the dangerous area, generating a second alarm message, wherein the second alarm message is used to send a notification message to the server to prompt the server to execute a rescue strategy; The rescue strategy includes at least one of the following: the server sends the second alarm message to the rescue device, and the server sends a third alarm message to the sound source input device, wherein the third alarm message includes a rescue plan generated based on the second alarm message.

8. A sound source alarm device, characterized in that: include: An acquisition module, used to control a sound source input device to acquire sound source data, wherein the sound source input device is used to collect sound from a target area; a determination module, configured to determine first sound source data and second sound source data from the sound source data, wherein the first sound source data and the second sound source data represent sound source data collected by a first sound source input device and a second sound source input device for a target sound source in the same time period, and the first sound source input device is different from the second sound source input device; an analysis module, configured to analyze the frequency components of the first sound source data and the second sound source data, respectively compare the waveform type corresponding to each sound wave in the first sound source data, the waveform type corresponding to each sound wave in the second sound source data, and the waveform type corresponding to the target sound source, determine whether the target sound source exists according to waveform similarity, and determine the target coordinates of the target sound source if the target sound source exists; A generating module, configured to determine the behavior state of the target sound source based on the change of the target coordinates within a preset time period, and to generate an alarm message when the behavior state is a target behavior state; The device is also used to: analyze the frequency components of the first sound source data and the second sound source data to determine the first distance between the target sound source and the first sound source input device and the second distance between the target sound source and the second sound source input device; and determine the target coordinates of the target sound source based on the first distance, the second distance, the first coordinates of the first sound source input device and the second coordinates of the second sound source input device.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored computer program, wherein the computer program can be executed by an electronic device to perform the method described in any one of claims 1 to 7.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method described in any one of claims 1 to 7 are implemented.

11. An electronic device comprising a memory and a processor, characterized in that: A computer program is stored in the memory, and the processor is configured to execute the method according to any one of claims 1 to 7 through the computer program.

Images