A millimeter wave-based target scene behavior monitoring method and related device

Abstract

The application discloses a target scene behavior monitoring method based on millimeter waves and related equipment, and the method comprises the following steps: acquiring a virtual space structure of a target scene, configuring a millimeter wave sensor, a high-sensitivity pickup and an edge server in the virtual space structure, and synchronously configuring the target scene according to the configuration of the virtual space structure; when the millimeter wave sensor detects a person in a preset range, receiving an analysis result obtained by performing data analysis on sound data by the high-sensitivity pickup or the edge server; if the analysis result comprises a preset sensitive word, receiving recording data of the high-sensitivity pickup, reminding a supervisor to handle an event through message pushing, and receiving feedback results uploaded by the supervisor. When the millimeter wave sensor detects a person in a range, the monitoring equipment is started, and when there is no person, the monitoring equipment is turned off, so that accurate triggering is achieved, the recognition degree is improved, and energy saving and emission reduction are realized.

Description

Technical Field

[0001] This invention relates to the field of information monitoring technology, and in particular to a target scene behavior monitoring method, system, terminal, and computer-readable storage medium based on millimeter waves. Background Technology

[0002] "Monitoring loopholes" provide opportunities for security incidents to occur. These loopholes blind regulators and make security incidents more frequent. Therefore, adopting an intelligent IoT monitoring system to achieve real-time monitoring of security incidents and prevent and curb them in the early stages, with campus regulators intervening in advance to preserve sufficient on-site evidence, is an effective measure to efficiently reduce the occurrence of security incidents.

[0003] As security incidents receive increasing attention from society, campus administrators are constantly strengthening prevention and control measures. Campus security incident monitoring systems play a crucial role in this process, effectively filling regulatory loopholes. However, these systems still have serious shortcomings, namely, they are not intelligent enough. Current monitoring systems on the market are always powered on and ready to go. Continuous operation of monitoring equipment for extended periods not only consumes a lot of power but also accelerates the equipment's lifespan. Furthermore, the uninterrupted data collection can lead to insufficient storage space, resulting in situations where no data is available at critical moments, leading to serious consequences such as missing evidence. Additionally, there are monitoring systems on the market that use infrared sensors, but these solutions are limited by the characteristics of infrared sensors, such as low recognition accuracy and susceptibility to environmental factors, thus significantly limiting their applicability. Therefore, how to monitor behavior in various scenarios with energy efficiency, high performance, and higher recognition rates is a pressing issue that needs to be addressed in the current environment.

[0004] Therefore, existing technologies still need to be improved and developed. Summary of the Invention

[0005] The main objective of this invention is to provide a target scene behavior monitoring method and related equipment based on millimeter waves, aiming to solve the problems of limited effective information, low recognition rate, and susceptibility to environmental factors when monitoring behavior in a scene in the prior art.

[0006] To achieve the above objectives, the present invention provides a target scene behavior monitoring method based on millimeter waves, the target scene behavior monitoring method based on millimeter waves comprising the following steps:

[0007] The virtual space structure of the target scene is obtained, and millimeter-wave sensors, high-sensitivity microphones and edge servers are configured in the virtual space structure. The target scene is also synchronously configured according to the configuration of the virtual space structure.

[0008] When the millimeter-wave sensor detects a person within a preset range, it receives the analysis results obtained by the high-sensitivity microphone or the edge server from the sound data analysis, wherein the sound data is collected by the high-sensitivity microphone or transmitted to the edge server by the high-sensitivity microphone.

[0009] If the analysis results include preset sensitive words, the system receives the recording data from the high-sensitivity microphone, alerts the supervisor to handle the incident via message push, and receives the feedback results uploaded by the supervisor.

[0010] Optionally, the millimeter-wave-based target scene behavior monitoring method, wherein acquiring the virtual space structure of the target scene, configuring a millimeter-wave sensor, a high-sensitivity microphone, and an edge server in the virtual space structure, and synchronously configuring the target scene according to the configuration of the virtual space structure, specifically includes:

[0011] Based on the spatial structure of the target scene, a virtual spatial structure is created, and millimeter-wave sensors, high-sensitivity microphones, and edge servers are configured at selected locations based on the virtual spatial structure.

[0012] After the virtual space structure is configured, the configuration result is obtained, and the target scene is synchronously configured with the millimeter-wave sensor, the high-sensitivity microphone and the edge server according to the configuration of the virtual space structure.

[0013] Optionally, the millimeter-wave-based target scene behavior monitoring method further includes, after acquiring the virtual space structure of the target scene, configuring a millimeter-wave sensor, a high-sensitivity microphone, and an edge server in the virtual space structure, and synchronously configuring the target scene according to the configuration of the virtual space structure, the method further includes:

[0014] Configure the designated supervisory personnel for the target scenario, and configure the sensitive words that trigger the high-sensitivity microphone to record.

[0015] Optionally, the millimeter-wave-based target scene behavior monitoring method, wherein when the millimeter-wave sensor detects a person within a preset range, receives the analysis result obtained by the high-sensitivity microphone or the edge server from the sound data analysis, wherein the sound data is collected by the high-sensitivity microphone or the sound data is transmitted to the edge server, specifically includes:

[0016] The detection range of the millimeter-wave sensor is preset, a start command to activate the millimeter-wave sensor is received, and the millimeter-wave sensor is activated based on the start command to detect whether there is a person in the detection range;

[0017] When a person is detected within the detection range, an activation command is sent to the high-sensitivity microphone to activate it and collect sound data. The high-sensitivity microphone is then received as an analysis result after it identifies and analyzes the sound data for sensitive words.

[0018] Alternatively, when a person is detected within the detection range, an activation command is sent to the high-sensitivity microphone to activate it and collect sound data. The high-sensitivity microphone is then controlled to send the sound data to the edge server, and the edge server receives the analysis results after recognizing and analyzing the sound data for sensitive words.

[0019] Optionally, the millimeter-wave-based target scene behavior monitoring method, wherein the target scene is synchronously configured according to the configuration of the virtual space structure, further includes:

[0020] When the millimeter-wave sensor does not detect a person within a preset range, it will not send an activation command to the high-sensitivity microphone.

[0021] Optionally, in the millimeter-wave-based target scene behavior monitoring method, if the analysis result includes preset sensitive words, the method receives recording data from the high-sensitivity microphone, alerts supervisory personnel to handle the event via message push, and receives feedback results uploaded by the supervisory personnel, specifically including:

[0022] If the analysis results include the sensitive words, a recording command is sent to the high-sensitivity microphone to start recording, the recording data sent by the high-sensitivity microphone is received, and the supervisory personnel are reminded to handle the incident via message push.

[0023] When the supervisor receives an alert about an incident and conducts an on-site investigation, the system receives the feedback results uploaded by the supervisor and controls the edge server to copy the audio recording for archiving.

[0024] Optionally, the millimeter-wave-based target scene behavior monitoring method further includes, after receiving the analysis results obtained by the high-sensitivity microphone or the edge server from the sound data analysis, the method further includes:

[0025] If the analysis results do not include the sensitive words, no recording command will be sent to the high-sensitivity microphone, and no message will be pushed to remind the supervisor.

[0026] Optionally, the millimeter-wave-based target scene behavior monitoring method, wherein the millimeter-wave-based target scene behavior monitoring system includes:

[0027] The device configuration module is used to obtain the virtual space structure of the target scene, configure millimeter-wave sensors, high-sensitivity microphones and edge servers in the virtual space structure, and the target scene is synchronously configured according to the configuration of the virtual space structure.

[0028] The data analysis module is used to receive the analysis results obtained by the high-sensitivity microphone or the edge server from the sound data when the millimeter-wave sensor detects a person within a preset range. The sound data is collected by the high-sensitivity microphone or the sound data is transmitted to the edge server.

[0029] The result processing module is used to receive the recording data from the high-sensitivity microphone if the analysis result includes preset sensitive words, and to remind the supervisor to handle the event through message push, and to receive the feedback results uploaded by the supervisor.

[0030] In addition, to achieve the above objectives, the present invention also provides a terminal, wherein the terminal includes: a memory, a processor, and a millimeter-wave-based target scene behavior monitoring program stored in the memory and executable on the processor, wherein when the millimeter-wave-based target scene behavior monitoring program is executed by the processor, it implements the steps of the millimeter-wave-based target scene behavior monitoring method as described above.

[0031] In addition, to achieve the above objectives, the present invention also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a millimeter-wave-based target scene behavior monitoring program, which, when executed by a processor, implements the steps of the millimeter-wave-based target scene behavior monitoring method as described above.

[0032] This invention acquires the virtual spatial structure of a target scene, configures a millimeter-wave sensor, a high-sensitivity microphone, and an edge server within this virtual spatial structure, and synchronizes the target scene configuration according to the virtual spatial structure. When the millimeter-wave sensor detects a person within a preset range, it receives the analysis results obtained from the high-sensitivity microphone or the edge server's data analysis of the sound data. The sound data is either collected by the high-sensitivity microphone or transmitted by the high-sensitivity microphone to the edge server. If the analysis results include preset sensitive words, it receives the recording data from the high-sensitivity microphone and alerts supervisory personnel to handle the event via message push, and also receives feedback results uploaded by the supervisory personnel. This invention utilizes the characteristics of millimeter waves and can be widely deployed in various locations. By activating the monitoring device when a person is detected within the range and deactivating it when no one is present, it achieves precise triggering, leaving no monitoring gaps. Simultaneously, dynamic start / stop allows for strict control of device operating time, resulting in energy conservation and emission reduction. Attached Figure Description

[0033] Figure 1 This is a flowchart of a preferred embodiment of the target scene behavior monitoring method based on millimeter waves of the present invention;

[0034] Figure 2 This is a flowchart of step S10 in a preferred embodiment of the target scene behavior monitoring method based on millimeter waves of the present invention;

[0035] Figure 3 This is a flowchart of step S20 in a preferred embodiment of the target scene behavior monitoring method based on millimeter waves of the present invention;

[0036] Figure 4 This is a flowchart of step S30 in a preferred embodiment of the target scene behavior monitoring method based on millimeter waves of the present invention;

[0037] Figure 5 This is a topological schematic diagram of the target scene behavior monitoring method based on millimeter waves according to the present invention;

[0038] Figure 6 This is a schematic diagram of the overall process of a preferred embodiment of the target scene behavior monitoring method based on millimeter waves of the present invention;

[0039] Figure 7 This is a schematic diagram of a preferred embodiment of the target scene behavior monitoring system based on millimeter waves of the present invention;

[0040] Figure 8 This is a schematic diagram of the operating environment of a preferred embodiment of the terminal of the present invention. Detailed Implementation

[0041] To make the objectives, technical solutions, and advantages of this invention clearer and more explicit, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

[0042] The preferred embodiment of the target scene behavior monitoring method based on millimeter waves described in this invention, such as... Figure 1 As shown, the target scene behavior monitoring method based on millimeter waves includes the following steps:

[0043] Step S10: Obtain the virtual space structure of the target scene, configure millimeter-wave sensors, high-sensitivity microphones and edge servers in the virtual space structure, and synchronize the configuration of the target scene according to the configuration of the virtual space structure.

[0044] Please refer to the detailed process. Figure 2 This is a flowchart of step S10 in the millimeter-wave-based target scene behavior monitoring method provided by the present invention.

[0045] like Figure 2 As shown, step S10 includes:

[0046] Step S11: Based on the spatial structure of the target scene, create a virtual spatial structure, and configure millimeter-wave sensors, high-sensitivity microphones, and edge servers at selected locations based on the virtual spatial structure;

[0047] Step S12: After the configuration of the virtual space structure is completed, the configuration result is obtained, and the target scene is synchronously configured with the millimeter-wave sensor, the high-sensitivity microphone and the edge server according to the configuration of the virtual space structure.

[0048] Specifically, in this embodiment of the invention, taking campus security incident monitoring as an example, a virtual campus space is created based on the actual campus spatial structure. Then, millimeter-wave sensors, high-sensitivity microphones, and edge servers are created, and these components are configured in the virtual space at selected locations. After configuration in the virtual space, a configuration result is obtained. Based on this result, the millimeter-wave sensors, high-sensitivity microphones, and edge servers are simultaneously installed in the real space. The installation location depends on the specific usage scenario. Typically, one edge server is configured per campus, and it can be bound to the campus (campus level). The millimeter-wave sensors and high-sensitivity microphones, as on-site information collection devices, are usually used as a whole (as a set) and can be bound to locations such as campus restrooms, dormitories, and stairwells (i.e., places where security incidents may occur).

[0049] Furthermore, designated supervisors are configured within the real-world campus space. The purpose of configuring these supervisors is to handle incidents when they occur, and to configure sensitive words that trigger the high-sensitivity microphone to record audio.

[0050] Step S20: When the millimeter-wave sensor detects a person within a preset range, it receives the analysis result obtained by the high-sensitivity microphone or the edge server from the sound data analysis, wherein the sound data is collected by the high-sensitivity microphone or transmitted to the edge server by the high-sensitivity microphone.

[0051] Please refer to the detailed process. Figure 3 This is a flowchart of step S20 in the millimeter-wave-based target scene behavior monitoring method provided by the present invention.

[0052] like Figure 3 As shown, step S20 includes:

[0053] Step S21: Pre-set the detection range of the millimeter-wave sensor, receive a start command to start the millimeter-wave sensor, and start the millimeter-wave sensor to detect whether there is a person in the detection range based on the start command;

[0054] Step S22: When a person is detected in the detection range, an activation command is sent to the high-sensitivity microphone to activate the high-sensitivity microphone to collect sound data, and the analysis results sent by the high-sensitivity microphone after recognizing and analyzing the sound data are received.

[0055] Step S23, or when a person is detected within the detection range, an activation command is sent to the high-sensitivity microphone to activate the high-sensitivity microphone to collect sound data, control the high-sensitivity microphone to send the sound data to the edge server, and receive the analysis results sent by the edge server after recognizing and analyzing the sound data for sensitive words.

[0056] Specifically, the detection range of the millimeter-wave sensor is preset. For example, the reference values ​​for the detection range of the millimeter-wave sensor are: when the height is 2.6 meters, the radiation coverage range is 2.6-3 meters in radius (the actual radar angle is greater than 90°); when the height is 3 meters, the radiation coverage range is 3-3.5 meters in radius; and when the height is 3.5 meters, the coverage radius is 4-4.5 meters. To ensure the accuracy of the detection values, it is recommended that the module coverage distance be within 5 meters. The system receives a start command to activate the millimeter-wave sensor and, based on the start command, activates the millimeter-wave sensor to detect whether there is a person within the detection range.

[0057] When a person is detected within the detection range, an activation command is sent to the high-sensitivity microphone to activate it and collect sound data. The high-sensitivity microphone identifies and analyzes the sound data for sensitive words, and then sends the analysis results. If the high-sensitivity microphone has AI recognition capabilities, it can independently convert and recognize the collected sound information using its built-in intelligent chip processor to obtain recognition results, and perform sensitive word analysis on the recognition results to obtain analysis results, without needing to upload the sound information to a server for analysis and processing.

[0058] Alternatively, when a person is detected within the detection range, an activation command is sent to the high-sensitivity microphone to activate it and collect sound data. If the high-sensitivity microphone does not have AI recognition capabilities, it sends the collected sound data to an edge server. Upon receiving the sound data, the edge server uses its built-in algorithm to convert the sound into text or other system-recognizable information and performs sensitive word analysis on the information to obtain the analysis results.

[0059] Furthermore, when a person is detected within the detection range, an activation command is sent to the high-sensitivity microphone; if the high-sensitivity microphone does not activate after receiving the activation command, the device is reported for maintenance and the relevant maintenance personnel are notified to handle the issue.

[0060] Furthermore, when the millimeter-wave sensor does not detect a person within a preset range, it does not send an activation command to the high-sensitivity microphone, thus keeping the high-sensitivity microphone in a closed state, which extends the life of the device and saves energy.

[0061] Step S30: If the analysis result includes preset sensitive words, then receive the recording data from the high-sensitivity microphone, remind the supervisor to handle the event via message push, and receive the feedback result uploaded by the supervisor.

[0062] Please refer to the detailed process. Figure 4 This is a flowchart of step S30 in the millimeter-wave-based target scene behavior monitoring method provided by the present invention.

[0063] like Figure 4 As shown, step S30 includes:

[0064] Step S31: If the analysis result includes the sensitive words, a recording command is sent to the high-sensitivity microphone to start recording, the recording data sent by the high-sensitivity microphone is received, and the supervisor is reminded to handle the event through message push.

[0065] Step S32: After the supervisor receives the event notification and conducts on-site verification, the system receives the feedback results uploaded by the supervisor and controls the edge server to copy the audio recording for archiving.

[0066] Specifically, if the analysis results include the sensitive words, a recording command is sent to the high-sensitivity microphone to start recording and obtain the recording data. The recording data is then stored, and a message push notification is sent to remind the supervisor to handle the incident (e.g., a campus security incident). After receiving the security incident notification, the supervisor can go to the location where the incident occurred (taking the millimeter wave installation address) to verify and report the results. The recording data can be copied to the edge server or downloaded and archived from the cloud.

[0067] Furthermore, if the analysis results do not include the sensitive words, no recording command will be issued to the high-sensitivity microphone, the high-sensitivity microphone will not perform any recording storage, reducing unnecessary recording consumption of limited storage space, and will not push messages to remind the supervisory personnel.

[0068] Furthermore, the topology diagram of the target scene behavior monitoring method solution based on millimeter waves in this invention is as follows: Figure 5 As shown, it includes an information terminal, a cloud, a remote server, and n monitoring terminals. Through the interconnection between the information terminal and the cloud, the edge server controls the n monitoring terminals to send instructions, making the whole system a general solution for certain scenarios.

[0069] Furthermore, such as Figure 6 As shown, taking campus security incident monitoring as an example in this invention, the entire process of the millimeter-wave-based campus security incident monitoring method is as follows:

[0070] Step S1: Begin;

[0071] Step S2: Create the campus space structure;

[0072] Step S3: Create the edge server, millimeter-wave sensor, and high-sensitivity microphone;

[0073] Step S4: Bind the edge server, the millimeter-wave sensor and the high-sensitivity microphone to a designated space in the campus space structure. After binding is completed, proceed to step S5 or step S7.

[0074] Step S5: Assign designated supervisors to the campus space;

[0075] Step S6: Configure the sensitive words that trigger the high-sensitivity microphone to record;

[0076] Step S7: The devices configured in the virtual campus space will be synchronously installed in designated spaces within the real campus space structure.

[0077] Step S8: Activate the millimeter-wave sensor to perform detection within a preset range;

[0078] Step S9: Determine whether a person is detected within the preset range. If no person is detected within the preset range, proceed to step S10. If a person is detected within the preset range, proceed to step S11.

[0079] Step S10: If no person is detected within the preset range, no instruction is sent to the high-sensitivity microphone.

[0080] Step S11: If a person is detected within the preset range, a command is sent to the high-sensitivity microphone to start working;

[0081] Step S12: After the high-sensitivity microphone receives the instruction, determine whether the high-sensitivity microphone is turned on; if the high-sensitivity microphone is not turned on, proceed to step S13; if the high-sensitivity microphone is turned on, proceed to step S15.

[0082] Step S13: If the high-sensitivity microphone is not turned on, report the equipment for repair.

[0083] Step S14: Based on the reported equipment repair, notify the relevant maintenance personnel to handle the issue;

[0084] Step S15: If the high-sensitivity microphone is turned on, the high-sensitivity microphone will collect sound data.

[0085] Step S16: Determine whether the high-sensitivity microphone has AI recognition function. If it has AI recognition function, proceed to step S17; if it does not have AI recognition function, proceed to step S18.

[0086] Step S17: If the high-sensitivity microphone has an AI recognition function, the high-sensitivity microphone, through its built-in intelligent chip processor, independently converts and recognizes the collected sound information to obtain a recognition result, and performs sensitive word analysis on the recognition result to obtain an analysis result.

[0087] Step S18: If the high-sensitivity microphone does not have AI recognition function, the high-sensitivity microphone will send the collected sound data to the edge server; after receiving the sound data, the edge server will convert the sound into information that the system can recognize, such as text, through its built-in algorithm, and perform sensitive word analysis on the information to obtain the analysis result.

[0088] Step S19: Determine whether the analysis result contains sensitive words. If it does not contain them, proceed to step S20; if it does contain them, proceed to step S21.

[0089] Step S20: If the analysis result does not contain sensitive words, then no recording command will be sent to the high-sensitivity microphone, and no message will be pushed to remind the supervisory personnel.

[0090] Step S21: If the analysis result contains sensitive words, a recording command is sent to the high-sensitivity microphone to start recording and obtain the recording data. The recording data is then stored, and a message push is sent to remind the supervisor to handle the security incident.

[0091] Step S22: After receiving a notification of a security incident, the supervisor can go to the location where the incident occurred to verify the information and report the results.

[0092] Step S23: Copy the audio recording data via the edge server or download and archive it from the cloud;

[0093] Step S24, End.

[0094] The millimeter-wave-based campus security incident monitoring solution adopted in this embodiment of the invention features higher recognition rate and higher performance, playing a more intelligent role in the entire security incident monitoring system. With the assistance of this monitoring system, the occurrence of security incidents on campus can be effectively reduced, thus building a harmonious campus.

[0095] Furthermore, such as Figure 7 As shown, based on the above-described millimeter-wave-based target scene behavior monitoring method, the present invention also provides a millimeter-wave-based target scene behavior monitoring system, the millimeter-wave-based target scene behavior monitoring system comprising:

[0096] The device configuration module 51 is used to obtain the virtual space structure of the target scene, configure millimeter-wave sensors, high-sensitivity microphones and edge servers in the virtual space structure, and the target scene is synchronously configured according to the configuration of the virtual space structure.

[0097] Data analysis module 52 is used to receive the analysis results obtained by the high-sensitivity microphone or the edge server from the sound data when the millimeter-wave sensor detects a person within a preset range. The sound data is collected by the high-sensitivity microphone or the sound data is transmitted to the edge server.

[0098] The result processing module 53 is used to receive the recording data from the high-sensitivity microphone if the analysis result includes preset sensitive words, and to remind the supervisor to handle the event through message push, and to receive the feedback result uploaded by the supervisor.

[0099] Furthermore, such as Figure 8 As shown, based on the above-mentioned millimeter-wave-based target scene behavior monitoring method, the present invention also provides a terminal, which includes a processor 10, a memory 20 and a display 30. Figure 8 Only some of the terminal components are shown; however, it should be understood that it is not required to implement all of the components shown, and more or fewer components may be implemented instead.

[0100] In some embodiments, the memory 20 may be an internal storage unit of the terminal, such as a hard disk or memory. In other embodiments, the memory 20 may be an external storage device of the terminal, such as a plug-in hard disk, smart media card (SMC), secure digital card (SD), flash card, etc. Further, the memory 20 may include both internal and external storage devices. The memory 20 is used to store application software and various types of data installed on the terminal, such as program code installed on the terminal. The memory 20 can also be used to temporarily store data that has been output or will be output. In one embodiment, the memory 20 stores a millimeter-wave-based target scene behavior monitoring program 40, which can be executed by the processor 10 to implement the millimeter-wave-based target scene behavior monitoring method of this application.

[0101] In some embodiments, the processor 10 may be a central processing unit (CPU), a microprocessor, or other data processing chip, used to run program code stored in the memory 20 or process data, such as executing the millimeter-wave-based target scene behavior monitoring method.

[0102] In some embodiments, the display 30 may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, or an OLED (Organic Light-Emitting Diode) touchscreen. The display 30 is used to display information on the terminal and to display a visual user interface. The components 10-30 of the terminal communicate with each other via a system bus.

[0103] In one embodiment, when the processor 10 executes the millimeter-wave-based target scene behavior monitoring program 40 in the memory 20, the following steps are performed:

[0104] The virtual space structure of the target scene is obtained, and millimeter-wave sensors, high-sensitivity microphones and edge servers are configured in the virtual space structure. The target scene is also synchronously configured according to the configuration of the virtual space structure.

[0105] When the millimeter-wave sensor detects a person within a preset range, it receives the analysis results obtained by the high-sensitivity microphone or the edge server from the sound data analysis, wherein the sound data is collected by the high-sensitivity microphone or transmitted to the edge server by the high-sensitivity microphone.

[0106] If the analysis results include preset sensitive words, the system receives the recording data from the high-sensitivity microphone, alerts the supervisor to handle the incident via message push, and receives the feedback results uploaded by the supervisor.

[0107] Specifically, the acquisition of the virtual space structure of the target scene, the configuration of millimeter-wave sensors, high-sensitivity microphones, and edge servers within the virtual space structure, and the synchronous configuration of the target scene based on the virtual space structure configuration, include:

[0108] Based on the spatial structure of the target scene, a virtual spatial structure is created, and millimeter-wave sensors, high-sensitivity microphones, and edge servers are configured at selected locations based on the virtual spatial structure.

[0109] After the virtual space structure is configured, the configuration result is obtained, and the target scene is synchronously configured with the millimeter-wave sensor, the high-sensitivity microphone and the edge server according to the configuration of the virtual space structure.

[0110] The process includes acquiring the virtual space structure of the target scene, configuring millimeter-wave sensors, high-sensitivity microphones, and edge servers within the virtual space structure, and synchronously configuring the target scene according to the configuration of the virtual space structure. The process further includes:

[0111] Configure the designated supervisory personnel for the target scenario, and configure the sensitive words that trigger the high-sensitivity microphone to record.

[0112] Specifically, when the millimeter-wave sensor detects a person within a preset range, it receives the analysis results obtained from the high-sensitivity microphone or the edge server performing sound data analysis. The sound data is collected by the high-sensitivity microphone, or the sound data is transmitted to the edge server. This specifically includes:

[0113] The detection range of the millimeter-wave sensor is preset, a start command to activate the millimeter-wave sensor is received, and the millimeter-wave sensor is activated based on the start command to detect whether there is a person in the detection range;

[0114] When a person is detected within the detection range, an activation command is sent to the high-sensitivity microphone to activate it and collect sound data. The high-sensitivity microphone is then received as an analysis result after it identifies and analyzes the sound data for sensitive words.

[0115] Alternatively, when a person is detected within the detection range, an activation command is sent to the high-sensitivity microphone to activate it and collect sound data. The high-sensitivity microphone is then controlled to send the sound data to the edge server, and the edge server receives the analysis results after recognizing and analyzing the sound data for sensitive words.

[0116] The target scene is synchronously configured according to the configuration of the virtual space structure, and then the following is also included:

[0117] When the millimeter-wave sensor does not detect a person within a preset range, it will not send an activation command to the high-sensitivity microphone.

[0118] Specifically, if the analysis result includes preset sensitive words, the system receives the recording data from the high-sensitivity microphone, alerts the supervisory personnel to handle the incident via message push, and receives feedback results uploaded by the supervisory personnel, including:

[0119] If the analysis results include the sensitive words, a recording command is sent to the high-sensitivity microphone to start recording, the recording data sent by the high-sensitivity microphone is received, and the supervisory personnel are reminded to handle the incident via message push.

[0120] When the supervisor receives an alert about an incident and conducts an on-site investigation, the system receives the feedback results uploaded by the supervisor and controls the edge server to copy the audio recording for archiving.

[0121] The step of receiving the analysis results obtained from the data analysis of the sound data by the high-sensitivity microphone or the edge server further includes:

[0122] If the analysis results do not include the sensitive words, no recording command will be sent to the high-sensitivity microphone, and no message will be pushed to remind the supervisor.

[0123] The present invention also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a millimeter-wave-based target scene behavior monitoring program, which, when executed by a processor, implements the steps of the millimeter-wave-based target scene behavior monitoring method described above.

[0124] In summary, this invention provides a target scene behavior monitoring method and related equipment based on millimeter waves. The method includes: acquiring the virtual space structure of the target scene; configuring a millimeter wave sensor, a high-sensitivity microphone, and an edge server within the virtual space structure, with the target scene synchronously configured according to the virtual space structure; when the millimeter wave sensor detects a person within a preset range, receiving the analysis results obtained from the high-sensitivity microphone or the edge server performing data analysis on the sound data, wherein the sound data is collected by the high-sensitivity microphone or transmitted by the high-sensitivity microphone to the edge server; if the analysis results include preset sensitive words, receiving the recording data from the high-sensitivity microphone, and alerting supervisory personnel to handle the event via message push, and receiving feedback results uploaded by the supervisory personnel. This invention utilizes the characteristics of millimeter waves and can be widely deployed in different locations. By activating the monitoring equipment when a person is detected within the range and deactivating it when no one is present, it achieves precise triggering, leaving no monitoring gaps, while dynamically starting and stopping the equipment, strictly controlling the operating time, and saving energy and reducing emissions.

[0125] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0126] Of course, those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware (such as a processor, controller, etc.). The program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The computer-readable storage medium can be a memory, magnetic disk, optical disk, etc.

[0127] It should be understood that the application of the present invention is not limited to the examples above. Those skilled in the art can make improvements or modifications based on the above description, and all such improvements and modifications should fall within the protection scope of the appended claims.

Claims

1. A millimeter wave-based target scene behavior monitoring method, characterized in that, The millimeter-wave-based target scene behavior monitoring method includes: The virtual space structure of the target scene is obtained, and millimeter-wave sensors, high-sensitivity microphones and edge servers are configured in the virtual space structure. The target scene is also synchronously configured according to the configuration of the virtual space structure. When the millimeter-wave sensor detects a person within a preset range, it receives the analysis results obtained by the high-sensitivity microphone or the edge server from the sound data analysis, wherein the sound data is collected by the high-sensitivity microphone or transmitted to the edge server by the high-sensitivity microphone. When the millimeter-wave sensor detects a person within a preset range, it receives the analysis results obtained from the high-sensitivity microphone or the edge server through data analysis of the sound data. Specifically, the sound data is collected by the high-sensitivity microphone, or the sound data is transmitted to the edge server. The detection range of the millimeter-wave sensor is preset, a start command to activate the millimeter-wave sensor is received, and the millimeter-wave sensor is activated based on the start command to detect whether there is a person in the detection range; When a person is detected within the detection range, an activation command is sent to the high-sensitivity microphone to activate it and collect sound data. The high-sensitivity microphone is then received as an analysis result after it identifies and analyzes the sound data for sensitive words. Alternatively, when a person is detected within the detection range, an activation command is sent to the high-sensitivity microphone to activate it and collect sound data. The high-sensitivity microphone is then controlled to send the sound data to the edge server, and the edge server is received with the analysis results after identifying and analyzing the sound data for sensitive words. If the analysis results include preset sensitive words, the system receives the recording data from the high-sensitivity microphone, alerts the supervisor to handle the incident via message push, and receives the feedback results uploaded by the supervisor. 2.The millimeter-wave based target scene behavior monitoring method of claim 1, wherein, The process of acquiring the virtual space structure of the target scene, configuring millimeter-wave sensors, high-sensitivity microphones, and edge servers within the virtual space structure, and synchronously configuring the target scene according to the configuration of the virtual space structure, specifically includes: Based on the spatial structure of the target scene, a virtual spatial structure is created, and millimeter-wave sensors, high-sensitivity microphones, and edge servers are configured at selected locations based on the virtual spatial structure. After the virtual space structure is configured, the configuration result is obtained, and the target scene is synchronously configured with the millimeter-wave sensor, the high-sensitivity microphone and the edge server according to the configuration of the virtual space structure. 3.The millimeter-wave based target scene behavior monitoring method of claim 1, wherein, The acquisition A virtual space structure for the target scene, in which millimeter-wave sensors, high-sensitivity microphones, and edge servers are configured, and the target scene is synchronously configured according to the configuration of the virtual space structure, and then includes: Configure the designated supervisory personnel for the target scenario, and configure the sensitive words that trigger the high-sensitivity microphone to record. 4.The millimeter-wave based target scene behavior monitoring method of claim 1, wherein, The target scene is synchronously configured according to the configuration of the virtual space structure, and then includes: When the millimeter-wave sensor does not detect a person within a preset range, it will not send an activation command to the high-sensitivity microphone.

5. The millimeter wave based target scene behavior monitoring method of claim 3, wherein, If the analysis result includes preset sensitive words, then the system receives the recording data from the high-sensitivity microphone, alerts the supervisory personnel to handle the incident via message push, and receives the feedback results uploaded by the supervisory personnel, specifically including: If the analysis results include the sensitive words, a recording command is sent to the high-sensitivity microphone to start recording, the recording data sent by the high-sensitivity microphone is received, and the supervisory personnel are reminded to handle the incident via message push. When the supervisor receives an alert about an incident and conducts an on-site investigation, the system receives the feedback results uploaded by the supervisor and controls the edge server to copy the audio recording for archiving.

6. The target scene behavior monitoring method based on millimeter waves according to claim 1, characterized in that, The process of receiving the analysis results obtained from the data analysis of the sound data by the high-sensitivity microphone or the edge server further includes: If the analysis results do not include the sensitive words, no recording command will be sent to the high-sensitivity microphone, and no message will be pushed to remind the supervisor.

7. A target scene behavior monitoring system based on millimeter waves, characterized in that, The millimeter-wave-based target scene behavior monitoring system is used to implement the millimeter-wave-based target scene behavior monitoring method according to any one of claims 1-6, wherein the millimeter-wave-based target scene behavior monitoring system comprises: The device configuration module is used to obtain the virtual space structure of the target scene, configure millimeter-wave sensors, high-sensitivity microphones and edge servers in the virtual space structure, and the target scene is synchronously configured according to the configuration of the virtual space structure. The data analysis module is used to receive the analysis results obtained by the high-sensitivity microphone or the edge server from the sound data when the millimeter-wave sensor detects a person within a preset range. The sound data is collected by the high-sensitivity microphone or the sound data is transmitted to the edge server. The result processing module is used to receive the recording data from the high-sensitivity microphone if the analysis result includes preset sensitive words, and to remind the supervisor to handle the event through message push, and to receive the feedback results uploaded by the supervisor.

8. A terminal, characterized in that, The terminal includes: a memory, a processor, and a program stored in the memory and executable on the processor, wherein when the program is executed by the processor, it implements the steps of the millimeter-wave-based target scene behavior monitoring method as described in any one of claims 1-6.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a millimeter-wave-based target scene behavior monitoring program, which, when executed by a processor, implements the steps of the millimeter-wave-based target scene behavior monitoring method as described in any one of claims 1-6.

Images