An information monitoring method, device, and storage medium

Abstract

This application provides an information monitoring method, apparatus, and storage medium, relating to the field of video surveillance technology, to solve the technical problem of inaccurate monitoring of the loitering status of a target object. The method includes: after acquiring target feature information of the target object at a first moment, and when the target feature information is feature information in a first feature information set, after acquiring the feature information of the target object for the first time from the first feature information set at a second moment, the loitering status of the target object can be determined based on the first moment and the second moment. The first feature information set includes feature information of objects other than those on a whitelist and the acquisition time of the first acquisition of feature information of other objects. The whitelist includes objects allowed to loiter. This application improves the accuracy of determining the loitering status of a target object.

Description

Technical Field

[0001] This application belongs to the field of video surveillance technology, and in particular relates to an information monitoring method, device and storage medium. Background Technology

[0002] Monitoring abnormal lingering of people in large public places such as major transportation hubs, shopping malls, business parks, gas stations, and schools is extremely difficult and poses a security risk of unauthorized intrusions and other emergencies.

[0003] To enhance security, most public places have deployed surveillance cameras, allowing staff to monitor in real time for situations such as people loitering abnormally.

[0004] However, this monitoring method, which combines manual and video surveillance, is prone to missed or false reports of situations such as abnormal personnel staying in the area, and its accuracy cannot be guaranteed. Summary of the Invention

[0005] This application provides an information monitoring method, apparatus, and storage medium to solve the problem of the inability to accurately monitor the stagnation status of a target object.

[0006] To achieve the above objectives, this application adopts the following technical solution:

[0007] Firstly, an information monitoring method is provided, comprising: after acquiring target feature information of a target object at a first moment, and when the target feature information is feature information in a first feature information set, after acquiring the feature information of the target object for the first time from the first feature information set at a second moment, the method can determine the dwell status of the target object based on the first moment and the second moment. The first feature information set includes feature information of objects other than those on a whitelist and the acquisition time when the feature information of other objects was first acquired. The whitelist includes objects permitted to remain in the whitelist.

[0008] Optionally, the method for determining the dwell state of the target object based on the first time and the second time includes: when the difference between the first time and the second time is greater than a first threshold, the dwell state of the target object is determined to be an abnormal state; when the difference between the first time and the second time is less than or equal to the first threshold, the dwell state of the target object is determined to be a normal state.

[0009] Optionally, the information monitoring method further includes: when the target feature information is the feature information in the second feature information set, determining that the retention state of the target object is a normal state; the second feature information set includes the feature information of whitelisted objects.

[0010] Optionally, the information monitoring method further includes: when the target feature information is not feature information in the first feature information set and the target feature information is not feature information in the second feature information set, adding the target feature information and the corresponding first time moment to the first feature information set.

[0011] Optionally, the information monitoring method further includes: clearing feature information corresponding to collection times in the first feature information set where the difference between the collection time and the current time is greater than a second threshold.

[0012] Optionally, the information monitoring method also includes: periodically clearing the feature information in the first feature information set.

[0013] Optionally, after determining that the stagnation state of the target object is an abnormal state, the information monitoring method further includes: outputting alarm information corresponding to the abnormal state.

[0014] Secondly, an information monitoring device is provided, comprising: an acquisition unit and a processing unit; the acquisition unit is configured to acquire target feature information of a target object at a first moment; the acquisition unit is further configured to acquire, when the target feature information is feature information in a first feature information set, the second moment when the target feature information is first collected from the first feature information set; the first feature information set includes feature information of other objects (excluding whitelisted objects) collected at the acquisition moment and the acquisition moment when the feature information of other objects is first collected; the whitelisted objects include objects that are allowed to remain; the processing unit is configured to determine the dwelling state of the target object based on the first moment and the second moment acquired by the acquisition unit.

[0015] Optionally, the processing unit is specifically used to: determine the retention state of the target object as an abnormal state when the difference between the first time and the second time is greater than a first threshold; and determine the retention state of the target object as a normal state when the difference between the first time and the second time is less than or equal to the first threshold.

[0016] Optionally, the processing unit is further configured to determine that the dwell state of the target object is normal when the target feature information is the feature information in the second feature information set; the second feature information set includes the feature information of whitelisted objects.

[0017] Optionally, the information monitoring device further includes: a storage unit; the storage unit is used to add the target feature information and the first time point corresponding to it to the first feature information set when the target feature information is not feature information in the first feature information set and the target feature information is not feature information in the second feature information set.

[0018] Optionally, the processing unit is also used to remove feature information corresponding to acquisition times in the first feature information set where the difference between the acquisition time and the current time is greater than a second threshold.

[0019] Optionally, the processing unit is also used to periodically clear the feature information in the first feature information set.

[0020] Optionally, the information monitoring device further includes: an alarm unit; the alarm unit is used to output alarm information corresponding to the abnormal state.

[0021] Thirdly, an information monitoring device is provided, including a memory and a processor; the memory is used to store computer execution instructions, and the processor is connected to the memory via a bus; when the information monitoring device is running, the processor executes the computer execution instructions stored in the memory, so that the information monitoring device performs the information monitoring method as described in the first aspect.

[0022] The information monitoring device can be a network device or a component of a network device, such as a chip system within the network device. This chip system supports the network device in implementing the functions involved in the first aspect and any of its possible implementations, such as receiving, determining, and distributing the data and / or information involved in the aforementioned data processing method. The chip system includes a chip, but may also include other discrete devices or circuit structures.

[0023] Fourthly, a computer-readable storage medium is provided, characterized in that the computer-readable storage medium includes computer-executable instructions, which, when executed on a computer, cause the computer to perform the information monitoring method as described in the first aspect.

[0024] It should be noted that the aforementioned computer instructions may be stored, in whole or in part, on the first computer-readable storage medium. The first computer-readable storage medium may be packaged together with the processor of the information monitoring device, or it may be packaged separately from the processor of the information monitoring device; this application does not impose any limitations on this.

[0025] In this application, the names of the aforementioned information monitoring devices do not limit the devices or functional modules themselves. In actual implementation, these devices or functional modules may appear under other names. As long as the functions of each device or functional module are similar to those in this application, they fall within the scope of the claims of this application and their equivalents.

[0026] These or other aspects of this application will become more readily apparent in the following description.

[0027] The technical solution provided in this application brings at least the following beneficial effects:

[0028] Based on any of the above aspects, in this application, when acquiring the target feature information of the target object at a first moment and determining that the target feature information is feature information in the first feature information set, since the first feature information set includes feature information of other objects besides whitelisted objects and the collection time of the first collection of feature information of other objects, and since whitelisted objects are objects allowed to stay, the second moment of the first collection of feature information of the target object can be obtained from the first feature information set. Therefore, the staying status of the target object can be determined based on the first moment and the second moment. In this way, compared with the method of manual judgment in the prior art, this application can accurately determine the staying status of the target object based on the times when the feature information of the target object is collected multiple times. Attached Figure Description

[0029] Figure 1A This is a schematic diagram of the structure of an information monitoring system provided in an embodiment of this application;

[0030] Figure 1B This is a schematic diagram of the structure of an information monitoring device provided in an embodiment of this application;

[0031] Figure 2 A schematic diagram of a hardware structure of a communication device provided in an embodiment of this application;

[0032] Figure 3 A schematic diagram of another hardware structure of the communication device provided in the embodiments of this application;

[0033] Figure 4 A flowchart illustrating an information monitoring method provided in this application embodiment is shown below;

[0034] Figure 5 A flowchart illustrating an information monitoring method provided in this application embodiment. Figure 2 ;

[0035] Figure 6 A flowchart illustrating an information monitoring method provided in this application embodiment. Figure 3 ;

[0036] Figure 7 A flowchart illustrating an information monitoring method provided in this application embodiment. Figure 4 ;

[0037] Figure 8 A flowchart illustrating an information monitoring method provided in this application embodiment. Figure 5 ;

[0038] Figure 9 This is a schematic diagram of the structure of another information monitoring device provided in the embodiments of this application. Detailed Implementation

[0039] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0040] It should be noted that in the embodiments of this application, the words "exemplary" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design scheme described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of the words "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0041] To facilitate a clear description of the technical solutions of the embodiments of this application, the terms "first" and "second" are used in the embodiments of this application to distinguish the same or similar items with essentially the same function and effect. Those skilled in the art can understand that the terms "first" and "second" are not intended to limit the quantity or execution order.

[0042] Furthermore, the terms "comprising" and "having" in the embodiments, claims, and drawings of this application are not exclusive. For example, a process, method, system, product, or device that includes a series of steps or modules is not limited to the listed steps or modules, but may also include steps or modules not listed.

[0043] As described in the background section, in order to enhance security capabilities, most public places have deployed surveillance cameras, and staff can use video surveillance to monitor situations such as abnormal lingering of people in real time.

[0044] However, this monitoring method, which combines manual and video surveillance, is prone to missed or false reports of situations such as abnormal personnel staying in the area, and its accuracy cannot be guaranteed.

[0045] To address the aforementioned problems, this application provides an information monitoring method. When acquiring target feature information of a target object at a first moment and determining that the target feature information is feature information from a first feature information set, since the first feature information set includes feature information of objects other than those on a whitelist and the collection time when the feature information of other objects was first collected, and since whitelisted objects are allowed to remain, the second moment when the feature information of the target object was first collected can be obtained from the first feature information set. Therefore, the dwelling state of the target object can be determined based on the first and second moments. In this way, compared to the manual judgment method in the prior art, this application can accurately determine the dwelling state of the target object based on the times when the feature information of the target object is collected multiple times.

[0046] This information monitoring method is applicable to information monitoring systems. Figure 1A One structure of the information monitoring system 100 is shown. For example... Figure 1A As shown, the information monitoring system 100 includes an information monitoring device 101 and a data acquisition device 102. The information monitoring device 101 and the data acquisition device 102 are connected in communication.

[0047] Optionally, the communication between the information monitoring device 101 and the data acquisition device 102 can be based on a wired network transmission method, a fourth-generation mobile communication technology (4G) network transmission method, a fifth-generation mobile communication technology (5G) network transmission method, or other network transmission methods. This application embodiment does not impose any restrictions on this.

[0048] Optional, Figure 1A The information monitoring device 101 can communicate with multiple data acquisition devices simultaneously.

[0049] For ease of understanding, this application mainly uses the communication connection between the information monitoring device 101 and a data acquisition device (i.e., data acquisition device 102) as an example for illustration.

[0050] Optional, Figure 1A The information monitoring device 101 can be a server, a terminal, or other electronic devices used for monitoring information.

[0051] Optionally, when the information monitoring device 101 is a server, it can be a single server (e.g., a rack-mounted high-performance server, a vertical server), or it can be a server cluster consisting of multiple servers. In some embodiments, the server cluster can also be a distributed cluster. This application embodiment does not impose any limitations in this regard.

[0052] Optionally, when the information monitoring device 101 is a terminal, the terminal is a device that provides voice and / or data connectivity to the user, a handheld device with wireless connectivity, or other processing devices connected to a wireless modem. The wireless terminal can communicate with one or more core networks via a radio access network (RAN). The wireless terminal can be a mobile terminal, such as a computer with a mobile terminal, or a portable, pocket-sized, handheld, or computer-embedded mobile device that exchanges voice and / or data with the radio access network, such as a mobile phone, tablet computer, laptop computer, netbook, or personal digital assistant (PDA). This application embodiment does not impose any limitations on this.

[0053] Optional, Figure 1A The information monitoring device 101 can be deployed at locations such as the site where the data acquisition device 102 is deployed, the edge data center, and the cloud. This application embodiment does not impose any limitations on this.

[0054] Optional, combined Figure 1B , Figure 1A The information monitoring device 101 may include a data acquisition module 201, an artificial intelligence (AI) detection module 202, a database module 203, a storage module 204, and an alarm module 205.

[0055] The data acquisition module 201 can be used to acquire video and / or image data collected by the acquisition device 102.

[0056] The AI ​​detection module 202 can be used to perform AI detection on video and / or image data acquired by the data acquisition module 201 to determine the feature information of objects in the video and / or image data, and to perform comparison, scheduling and result display on the detected feature information.

[0057] The database module 203 can be used to store feature information detected by the AI ​​detection module 202, such as feature information of whitelisted objects (e.g., staff) and feature information of other objects besides whitelisted objects, so that the AI ​​detection module 202 can retrieve them when needed.

[0058] The storage module 204 can be used to store the operating data of the data acquisition module 201, AI detection module 202, database module 203 and alarm module 205 in the information monitoring device 101, as well as the video and / or image data acquired by the data acquisition module 201 and the operating program of the AI ​​detection module 202.

[0059] The alarm module 205 can be used to output alarm information corresponding to the lingering status of the target object detected by the AI ​​detection module 202. The alarm information can be output in the form of notifying staff via email, SMS, or other means such as voice reminders or web pop-up reminders.

[0060] Optional, Figure 1A The acquisition device 102 can be a surveillance camera, used to collect and provide video and / or image data within the deployment area of ​​the acquisition device 102 to the information monitoring device 101.

[0061] The basic hardware structures of the information monitoring device 101 and the data acquisition device 102 in the information monitoring system 100 are similar, both including Figure 2 or Figure 3 The components included in the communication device shown. The following are examples... Figure 2 and Figure 3 Taking the communication device shown as an example, the hardware structure of the information monitoring device 101 and the data acquisition device 102 will be introduced.

[0062] like Figure 2 The diagram shown is a hardware structure schematic of a communication device provided in an embodiment of this application. The communication device includes a processor 21, a memory 22, a communication interface 23, and a bus 24. The processor 21, the memory 22, and the communication interface 23 are connected via the bus 24.

[0063] Processor 21 is the control center of the communication device. It can be a single processor or a collective term for multiple processing elements. For example, processor 21 can be a general-purpose central processing unit (CPU) or other general-purpose processors. Among them, the general-purpose processor can be a microprocessor, a graphics processing unit (GPU), or any conventional processor.

[0064] As one embodiment, processor 21 may include one or more CPUs, for example Figure 2 CPU0 and CPU1 are shown in the diagram.

[0065] The memory 22 may be a read-only memory (ROM) or other type of static storage device capable of storing static information and instructions, random access memory (RAM) or other type of dynamic storage device capable of storing information and instructions, or electrically erasable programmable read-only memory (EEPROM), disk storage media or other magnetic storage devices, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but is not limited thereto.

[0066] In one possible implementation, the memory 22 can exist independently of the processor 21. The memory 22 can be connected to the processor 21 via a bus 24 and is used to store instructions or program code. When the processor 21 calls and executes the instructions or program code stored in the memory 22, it can implement the information monitoring method provided in the following embodiments of this application.

[0067] In this embodiment, the software programs stored in the memory 22 are different for the information monitoring device 101 and the data acquisition device 102, therefore the functions implemented by the information monitoring device 101 and the data acquisition device 102 are different. The functions performed by each device will be described in conjunction with the following flowchart.

[0068] In another possible implementation, the memory 22 can also be integrated with the processor 21.

[0069] Communication interface 23 is used for connecting the communication device to other devices via a communication network, such as Ethernet, wireless access network, wireless local area network (WLAN), etc. Communication interface 23 may include a receiving unit for receiving data and a transmitting unit for sending data.

[0070] Bus 24 can be an industry standard architecture (ISA) bus, a peripheral component interconnect (PCI) bus, or an extended industry standard architecture (EISA) bus, etc. This bus can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 2 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0071] It should be pointed out that, Figure 2 The structure shown does not constitute a limitation on the communication device, except Figure 2 In addition to the components shown, the communication device may include more or fewer components than illustrated, or combine certain components, or have different component arrangements.

[0072] Figure 3 Another hardware structure of the communication device in an embodiment of this application is shown. For example... Figure 3 As shown, the communication device may include a processor 31 and a communication interface 32. The processor 31 is coupled to the communication interface 32.

[0073] The functions of processor 31 can be referred to in the description of processor 21 above. In addition, processor 31 also has a storage function, and can perform the functions of memory 22 mentioned above.

[0074] The communication interface 32 is used to provide data to the processor 31. The communication interface 32 can be an internal interface of the communication device or an external interface of the communication device (equivalent to communication interface 23).

[0075] It should be pointed out that, Figure 2 (or Figure 3 The structure shown in the diagram does not constitute a limitation on the communication device, except... Figure 2 (or Figure 3 In addition to the components shown in the diagram, the communication device may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0076] like Figure 4 The diagram shown is a flowchart illustrating an information monitoring method provided in an embodiment of this application. This information monitoring method is applied to an information monitoring device, which belongs to... Figure 1A The information monitoring system consists of the information monitoring device and data acquisition equipment shown. The information monitoring method includes: S401-S403.

[0077] S401, The information monitoring device acquires the target feature information of the target object at the first moment.

[0078] Specifically, when a target object appears within the area where the acquisition device is deployed at the first moment, the acquisition device can collect and generate video and / or image data containing the target feature information of the target object collected at the first moment, and send it to the information monitoring device. Correspondingly, the information monitoring device can receive the video and / or image data from the acquisition device, and, based on a pre-configured AI detection module, obtain the target feature information of the target object from the video and / or image data at the first moment.

[0079] Optionally, the target objects can be people and animals within the area where the data collection equipment is deployed, or vehicles, etc.

[0080] Optionally, when the target object is a person, the target feature information can be facial information or other feature information used to uniquely identify the target object.

[0081] Optionally, the first moment can be the moment when the acquisition device acquires the target object when the target object appears in the area where the acquisition device is deployed.

[0082] Optionally, the data collection equipment can be deployed in public places with high traffic, such as large transportation hubs, shopping malls, business parks, gas stations, and schools, to achieve more accurate judgment of abnormal situations and eliminate potential safety hazards.

[0083] Optionally, the data acquisition device can send the acquired video and / or image data to the information monitoring device in real time.

[0084] Optionally, the information monitoring device may be equipped with an AI detection module to perform AI detection on the acquired video and / or image data to determine the feature information and acquisition time of objects in the video and / or image data, and to perform processing such as comparison, scheduling and result display on the detected feature information.

[0085] S402. When the target feature information is the feature information in the first feature information set, the information monitoring device obtains the second moment when the feature information of the target object is first collected from the first feature information set.

[0086] Specifically, after acquiring the target feature information of the target object at the first moment, when the target feature information is the feature information in the first feature information set, the information monitoring device can acquire the feature information of the target object collected for the first time from the first feature information set at the second moment.

[0087] The first set of feature information includes feature information of objects other than those on the whitelist and the time when feature information of other objects was first collected. The whitelist includes objects that are allowed to remain in the whitelist.

[0088] Optionally, those allowed to remain can be staff members within the area where the data collection equipment is deployed, or other trusted personnel.

[0089] Understandably, when the target feature information matches the features in the first feature information set, the target object is an object other than those on the whitelist, and it has already entered the deployment area of ​​the data collection device before the first moment. In this case, to determine the target object's loitering status within the deployment area, the information monitoring device can obtain the second moment from the first feature information set where the target object's feature information was first collected. Subsequently, the information monitoring device can accurately determine the target object's loitering status within the deployment area based on the first and second moments.

[0090] S403. The information monitoring device determines the stationary status of the target object based on the first and second time points.

[0091] Specifically, after obtaining the first collection of the target object's feature information from the first feature information set at the second moment, the information monitoring device can determine the target object's loitering state based on the first moment and the second moment.

[0092] Optionally, the information monitoring device may determine the dwelling status of the target object based on the first time and the second time in the following ways, including but not limited to the following two methods.

[0093] The first method;

[0094] The information monitoring device can be configured with a storage module for storing a dwell time threshold. The dwell time threshold indicates the maximum duration for which a target object is allowed to remain within the deployment area of ​​the data collection device.

[0095] When the difference between the first and second moments is greater than the dwell time threshold, the information monitoring device can determine that the dwell status of the target object is abnormal. When the difference between the first and second moments is less than or equal to the dwell time threshold, the information monitoring device can determine that the dwell status of the target object is normal.

[0096] The second method;

[0097] The information monitoring device can be configured with a storage module for storing prohibited entry time periods. Prohibited entry time periods indicate the time periods during which target objects are not allowed to enter the deployment area of ​​the data collection device.

[0098] If either the first or second moment falls within the prohibited entry period, the information monitoring device can determine that the target object's stay status is abnormal. If both the first and second moments fall outside the prohibited entry period, the information monitoring device can determine that the target object's stay status is normal.

[0099] In one feasible way, combining Figure 4 ,like Figure 5As shown, in the above S403, the method by which the information monitoring device determines the dwelling state of the target object based on the first time and the second time specifically includes: S501-S502.

[0100] S501. When the difference between the first moment and the second moment is greater than the first threshold, the information monitoring device determines that the stagnation state of the target object is an abnormal state.

[0101] Specifically, when the difference between the first moment and the second moment is greater than the first threshold, the information monitoring device can determine that the lingering state of the target object is an abnormal state.

[0102] Optionally, the first threshold can be a dwell time threshold set manually according to the actual application scenario, and the unit can be a minute or an hour or other time unit.

[0103] S502. When the difference between the first moment and the second moment is less than or equal to the first threshold, the information monitoring device determines that the lingering state of the target object is normal.

[0104] Specifically, when the difference between the first moment and the second moment is less than or equal to the first threshold, the information monitoring device can determine that the target object's dwell state is normal.

[0105] For example, the first threshold is preset to 12 hours, and target object A appears in the area where the data collection device is deployed at the first moment (22:00 on January 10, 2020). At this time, the information monitoring device can obtain the target feature information of target object A collected at 22:00 on January 10, 2020.

[0106] Next, the information monitoring device determines that the target feature information of target object A is the feature information in the first feature information set, and obtains the second time of collecting the feature information of target object A from the first feature information set as 13:00 on January 10, 2020.

[0107] Next, the information monitoring device can determine, based on the first moment of 22:00 on January 10, 2020 and the second moment of 13:00 on January 10, 2020, that the difference between the first moment and the second moment is less than a first threshold (i.e., 9 hours less than 12 hours). In this case, the information monitoring device can determine that the retention status of target object A is normal.

[0108] In one feasible way, combining Figure 4 ,like Figure 6 As shown, the information monitoring method also includes: S601.

[0109] S601. When the target feature information is the feature information in the second feature information set, the information monitoring device determines that the stagnation state of the target object is a normal state.

[0110] Specifically, after acquiring the target feature information of the target object at the first moment, when the target feature information is the feature information in the second feature information set, the information monitoring device can determine that the lingering state of the target object is a normal state.

[0111] The second set of feature information includes the feature information of the whitelisted objects.

[0112] It is understandable that staff or other trusted personnel will be present within the area where the data collection equipment is deployed. To avoid consuming system resources due to judging these personnel, staff within the deployment area can be pre-listed as trusted whitelisted individuals, and their characteristic information can be stored in a second characteristic information set.

[0113] After acquiring the target feature information of the target object at the first moment, the information monitoring device can first determine whether the target feature information is feature information in the second feature information set. If the target feature information is feature information in the second feature information set, the information monitoring device can determine that the target object is a whitelisted object, and thus determine that the target object's dwell state is a normal state. If the target feature information is not feature information in the second feature information set, then it determines whether the target feature information is feature information in the first feature information set, and performs the corresponding operation.

[0114] For example, the preset information monitoring device acquires the target feature information of target object A at a first moment. At this time, if the information monitoring device determines that the target feature information is the feature information in the second feature information set, then it can determine that target object A is a whitelisted object and determine that the dwell state of target object A is a normal state.

[0115] In one feasible way, combining Figure 4 ,like Figure 7 As shown, this information monitoring method also includes: S701.

[0116] S701. When the target feature information is not a feature information in the first feature information set and the target feature information is not a feature information in the second feature information set, the information monitoring device adds the target feature information and the corresponding first time moment to the first feature information set.

[0117] Specifically, when the target feature information is neither in the first feature information set nor in the second feature information set, the target object is any object other than those on the whitelist that is entering the deployment area of ​​the data collection device for the first time. In this case, the information monitoring device can add the target feature information and its corresponding first-time value to the first feature information set.

[0118] For example, the preset information monitoring device acquires the target feature information of target object A at a first moment. At this time, if the information monitoring device determines that the target feature information is not the feature information in the first feature information set and is not the feature information in the second feature information set, then the target feature information and the first moment corresponding to it are added to the first feature information set.

[0119] In one possible implementation, the information monitoring method also includes: S801.

[0120] S801. The information monitoring device removes feature information collected at the first feature information set whose difference between the collection time and the current time is greater than the second threshold.

[0121] Specifically, the information monitoring device can clear the feature information collected at the first feature information set where the difference between the collection time and the current time is greater than the second threshold, thereby freeing up the storage space of the information monitoring device and ensuring normal operation.

[0122] Optionally, the second threshold can be a storage duration threshold set manually according to the actual application scenario, and the unit can be a minute or an hour or other time unit.

[0123] Understandably, the duration of the second threshold is greater than that of the first threshold. If the difference between the acquisition time and the current time is greater than the second threshold, the information monitoring device can determine that the feature information acquired at the acquisition time in the first feature information set is invalid feature information that has exceeded the storage duration threshold, and clear the feature information.

[0124] For example, the current time is preset to 15:00 on January 10, 2020, and the second threshold is 24 hours. At this time, the information monitoring device determines that the second time when the feature information of target object A was collected in the first feature information set is 12:00 on January 9, 2020. At this time, the information monitoring device can determine that the difference between the collection time and the current time (i.e., 27 hours) is greater than the second threshold (i.e., 24 hours), and then clear the feature information of target object A from the first feature information set.

[0125] In one feasible manner, the information monitoring method further includes: S901.

[0126] S901, The information monitoring device periodically clears the feature information in the first feature information set.

[0127] Specifically, the information monitoring device can periodically clear the feature information in the first feature information set to free up the storage space of the information monitoring device.

[0128] Optionally, the period for the information monitoring device to clear the feature information in the first feature information set can be set manually according to the actual application scenario; it can be one week or one month, etc.

[0129] In one feasible way, combining Figure 5 ,like Figure 8 As shown, after determining that the stagnation state of the target object is an abnormal state, the information monitoring method further includes: S1001.

[0130] S1001, The information monitoring device outputs alarm information corresponding to the abnormal state.

[0131] Specifically, after determining that the target object's stay status is abnormal, the information monitoring device can output alarm information corresponding to the abnormal status so that staff can handle it in a timely manner.

[0132] Optionally, the information monitoring device can be equipped with an alarm module. When it is determined that the stagnation status of the target object is abnormal, the alarm module can output alarm information corresponding to the abnormal status of the target object.

[0133] Optionally, the alarm information can be output in the form of notifying staff via email, SMS, or other means, or in other forms such as voice reminders or web pop-up reminders. This application embodiment does not limit this.

[0134] In this embodiment, after acquiring the target feature information of a target object at a first moment and determining that the target feature information is feature information from a first feature information set, the information monitoring device can acquire the feature information of other objects (excluding those on the whitelist) collected at the acquisition time, since the first feature information set includes feature information of other objects collected at the acquisition time. Therefore, it can acquire the feature information of the target object collected from the first feature information set at a second moment, and thus determine the dwell state of the target object based on the first and second moments. In this way, compared to the manual judgment method in the prior art, in this embodiment, the information monitoring device can accurately determine the dwell state of the target object based on the times when the feature information of the target object is collected multiple times.

[0135] The foregoing mainly describes the solutions provided by the embodiments of this application from a methodological perspective. To achieve the above functions, it includes corresponding hardware structures and / or software modules for executing each function. Those skilled in the art should readily recognize that, based on the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0136] This application embodiment can divide the information monitoring device into functional modules according to the above method example. For example, each function can be divided into its own functional module, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware or as a software functional module. Optionally, the module division in this application embodiment is illustrative and only represents one logical functional division; other division methods may be used in actual implementation.

[0137] like Figure 9 The diagram shown is a structural schematic of an information monitoring device provided in an embodiment of this application. This information monitoring device can be used to perform tasks such as... Figures 4 to 8 The information monitoring method shown. Figure 9 The information monitoring device shown includes: an acquisition unit 901 and a processing unit 902.

[0138] The acquisition unit 901 is used to acquire the target feature information of the target object at the first moment. For example, combined with Figure 4 The acquisition unit 901 can be used to execute S401.

[0139] The acquisition unit 901 is further configured to, when the target feature information is feature information in the first feature information set, acquire the second moment when the feature information of the target object is first collected from the first feature information set. The first feature information set includes feature information of objects other than those in the whitelist and the acquisition time when the feature information of other objects is first collected. The whitelist objects are objects allowed to remain in the whitelist. For example, combined with... Figure 4 The acquisition unit 901 can be used to execute S402.

[0140] Processing unit 902 is used to determine the dwell state of the target object based on the first time and the second time obtained by acquisition unit 901. For example, combined with Figure 4 The processing unit 902 can be used to execute S403.

[0141] Optional processing unit 902, specifically used for:

[0142] When the difference between the first and second time points exceeds a first threshold, the target object's state of stagnation is determined to be abnormal. For example, combined with... Figure 5 The processing unit 902 can be used to execute S501.

[0143] When the difference between the first and second time points is less than or equal to the first threshold, the target object's dwell state is determined to be normal. For example, combined with... Figure 5 The processing unit 902 can be used to execute S502.

[0144] Optionally, the processing unit 902 is further configured to determine that the dwell state of the target object is normal when the target feature information is feature information in the second feature information set. The second feature information set includes feature information of whitelisted objects. For example, combined with... Figure 6 The processing unit 902 can be used to execute S601.

[0145] Optionally, the information monitoring device may also include a storage unit 903.

[0146] Storage unit 903 is used to add the target feature information and its corresponding first time step to the first feature information set when the target feature information is not in the first feature information set and is not in the second feature information set. For example, combined with Figure 7 Storage unit 903 can be used to execute S701.

[0147] Optionally, the processing unit 902 is further configured to clear the feature information corresponding to the acquisition time in the first feature information set where the difference between the acquisition time and the current time is greater than a second threshold. For example, the processing unit 902 can be configured to execute S901.

[0148] Optionally, the processing unit 902 is also configured to periodically clear the feature information in the first feature information set. For example, the processing unit 902 may be configured to execute S901.

[0149] Optionally, the information monitoring device may also include an alarm unit 904.

[0150] Alarm unit 904 is used to output alarm information corresponding to abnormal states. For example, combined with... Figure 8 The alarm unit 904 can be used to execute S1001.

[0151] Those skilled in the art will recognize that, in one or more of the examples above, the functions described in this application can be implemented using hardware, software, firmware, or any combination thereof. When implemented in software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or code on a computer-readable medium. Computer-readable media include computer-readable storage media and communication media, wherein communication media include any medium that facilitates the transmission of a computer program from one place to another. Storage media can be any available medium accessible to a general-purpose or special-purpose computer.

[0152] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0153] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and other division methods may exist in actual implementation. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the shown or discussed mutual couplings, direct couplings, or communication connections may be through some interfaces; indirect couplings or communication connections between devices or units may be electrical, mechanical, or other forms. Units described as separate components may or may not be physically separate; components shown as units may be one physical unit or multiple physical units, i.e., they may be located in one place or distributed in multiple different places. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0154] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. An information monitoring method, characterized in that, include: Based on the pre-configured AI detection module, the target feature information of the target object at the first moment is obtained from the received image information; The image information includes videos and pictures; When the target feature information is a feature information in the second feature information set, the dwelling status of the target object is determined to be a normal state; the second feature information set includes feature information of whitelisted objects; the whitelisted objects include objects that are allowed to stay. When the target feature information is feature information in the first feature information set, the second moment when the feature information of the target object is first collected is obtained from the first feature information set; the first feature information set includes feature information of other objects besides the whitelisted objects and the collection moment when the feature information of the other objects is first collected; When the target feature information is not a feature information in the first feature information set and the target feature information is not a feature information in the second feature information set, the target feature information and the first time point are added to the first feature information set accordingly; The dwelling state of the target object is determined based on the first time and the second time. Determining the dwelling state of the target object based on the first time point and the second time point includes: If the target object is in a prohibited entry period at either the first or the second time, its state of stay is determined to be abnormal.

2. The information monitoring method according to claim 1, characterized in that, Determining the dwelling state of the target object based on the first time point and the second time point includes: When the difference between the first time point and the second time point is greater than the first threshold, the stagnation state of the target object is determined to be an abnormal state. When the difference between the first time point and the second time point is less than or equal to the first threshold, the lingering state of the target object is determined to be a normal state.

3. The information monitoring method according to claim 1, characterized in that, The information monitoring method further includes: Remove the feature information corresponding to the acquisition time in the first feature information set where the difference between the acquisition time and the current time is greater than the second threshold.

4. The information monitoring method according to claim 1, characterized in that, The information monitoring method further includes: The feature information in the first feature information set is periodically cleared.

5. The information monitoring method according to claim 1 or 2, characterized in that, After determining that the retention state of the target object is an abnormal state, the information monitoring method further includes: Output alarm information corresponding to the abnormal state.

6. An information monitoring device, characterized in that, include: Acquisition unit and processing unit; The acquisition unit is used to acquire target feature information of the target object at a first moment from the received image information according to the pre-configured AI detection module; the image information includes videos and pictures; The processing unit is configured to determine that the dwelling status of the target object is normal when the target feature information is feature information in the second feature information set; the second feature information set includes feature information of whitelisted objects; the whitelisted objects include objects that are allowed to stay. The acquisition unit is further configured to, when the target feature information is feature information in the first feature information set, acquire the second moment when the feature information of the target object is first collected from the first feature information set; the first feature information set includes feature information of other objects besides the whitelisted objects collected at the collection time and the collection time when the feature information of the other objects is first collected; the storage unit is configured to, when the target feature information is not feature information in the first feature information set and the target feature information is not feature information in the second feature information set, add the target feature information and the first moment correspondingly to the first feature information set; The processing unit is further configured to determine the dwell state of the target object based on the first time and the second time obtained by the acquisition unit; The step of determining the dwelling state of the target object based on the first time and the second time obtained by the acquisition unit includes: when the target object is in a prohibited entry period at either the first time or the second time, the dwelling state of the target object is determined to be an abnormal state.

7. The information monitoring device according to claim 6, characterized in that, The processing unit is specifically used for: When the difference between the first time point and the second time point is greater than the first threshold, the stagnation state of the target object is determined to be an abnormal state. When the difference between the first time point and the second time point is less than or equal to the first threshold, the lingering state of the target object is determined to be a normal state.

8. The information monitoring device according to claim 6, characterized in that, The processing unit is further configured to remove feature information from the first feature information set that corresponds to the acquisition time when the difference between the acquisition time and the current time is greater than a second threshold.

9. The information monitoring device according to claim 6, characterized in that, The processing unit is also used to periodically clear the feature information in the first feature information set.

10. The information monitoring device according to claim 6 or 7, characterized in that, The information monitoring device further includes: an alarm unit; The alarm unit is used to output alarm information corresponding to the abnormal state.

11. An information monitoring device, characterized in that, It includes a memory and a processor; the memory is used to store computer execution instructions, and the processor is connected to the memory via a bus; when the information monitoring device is running, the processor executes the computer execution instructions stored in the memory, so that the information monitoring device performs the information monitoring method as described in any one of claims 1-5.

12. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes computer-executable instructions that, when executed on a computer, cause the computer to perform the information monitoring method as described in any one of claims 1-5.

Images