Data processing method, storage system and computing device

Abstract

The data processing method comprises the following steps: acquiring a video stream; processing a first image frame sequence contained in the video stream to obtain a first event recorded by the first image frame sequence; determining the risk level of the first event based on the event risk level configuration information; and storing the first image frame sequence under the condition that the risk level of the first event is matched with the risk level indicated by the first storage mode. Therefore, the image frame sequence can be stored only when the risk level of the event recorded by the image frame sequence in the video stream is matched with the risk level indicated by the pre-configured storage mode, otherwise, the image frame sequence is not stored, so that the image frame sequence can be selectively stored according to the pre-configured storage mode; and the technical problem that the video data occupies too large storage space can be solved.

Description

Technical Field

[0001] The present application relates to the field of information technology (IT), and in particular to a data processing method, a storage system and a computing device. Background Art

[0002] Video surveillance system is one of the most widely used systems in security systems. Generally, video surveillance systems often use cameras to collect video data of a specific area and store the video data in a storage device so that it can be called from the storage device when the video needs to be viewed later. However, as the clarity of video data collected by cameras becomes higher and higher, the storage space required for video data per unit time is increasing, which increases the storage cost. Therefore, how to reduce the storage space occupied by video data is a technical problem that needs to be solved urgently. Summary of the invention

[0003] The present application provides a data processing method, a storage system, a computing device, a computer-readable storage medium, and a computer program product, which can store the image frame sequence only when the risk level of an event recorded by the image frame sequence in the video stream matches the risk level indicated by a pre-configured storage mode, and not store it otherwise. Thus, the image frame sequence can be selectively stored according to the pre-configured storage mode, thereby solving the technical problem of excessive storage space occupied by video data.

[0004] In a first aspect, the present application provides a data processing method, comprising: acquiring a video stream, the video stream comprising at least one image frame; processing a first image frame sequence contained in the video stream to obtain a first event recorded by the first image frame sequence; determining a risk level of the first event based on event risk level configuration information; and storing the first image frame sequence when the risk level of the first event matches the risk level indicated by a first storage mode, wherein the first storage mode is a pre-configured storage mode.

[0005] In this way, after receiving the video stream transmitted by the camera, the image frame sequence contained in the video stream can be processed to obtain the events recorded by the image frame sequence. When the risk level of the event recorded by the image frame sequence matches the risk level indicated by the pre-configured storage mode, the image frame sequence is stored, otherwise it is not stored. In this way, the image frame sequence can be selectively stored according to the pre-configured storage mode, thereby solving the technical problem of video data occupying too much storage space.

[0006] In a possible implementation, before determining the risk level of the first event based on the event risk level configuration information, the data processing method further includes: obtaining the event risk level configuration information configured by the user. In this way, the event risk level configuration information configured by the user can be obtained, so that the risk level of the event can be determined according to the event risk level configuration information in a subsequent process.

[0007] In a possible implementation, the first storage mode is used to indicate at least one risk level. Thus, when configuring the storage mode, the user can select one or more risk levels according to their actual needs.

[0008] In a possible implementation, the data processing method further includes: processing a second image frame sequence included in the video stream to obtain a second event recorded by the second image frame sequence; wherein the second image frame sequence is adjacent to the first image frame sequence, and the second image frame sequence and the first image frame sequence include the same image frames; determining the risk level of the second event based on the event risk level configuration information; and storing the second image frame sequence when the risk level of the second event matches the risk level indicated by the first storage mode. In this way, the event recorded in the image frame sequence can be more accurately identified.

[0009] In a possible implementation, the video stream is obtained by shooting with a camera. In this way, the present application can process the video stream obtained by shooting with a camera.

[0010] In a possible implementation, the data processing method further includes: if the risk level of the first event does not match the risk level indicated by the first storage mode, not storing the first image frame sequence. In this way, the present application can not store image frame sequences whose risk levels do not match the risk levels indicated by the first storage mode, thereby saving storage space occupied by video data.

[0011] In a second aspect, the present application provides a storage system, comprising: at least one memory for storing programs; at least one processor for executing the programs stored in the memory; wherein, when the program stored in the memory is executed, the processor is used to: obtain a video stream, the video stream containing at least one image frame; process a first image frame sequence contained in the video stream to obtain a first event recorded by the first image frame sequence; determine the risk level of the first event based on event risk level configuration information; the memory is used to store the first image frame sequence when the risk level of the first event matches the risk level indicated by the first storage mode.

[0012] In a possible implementation manner, before determining the risk level of the first event based on the event risk level configuration information, the processor is further configured to: obtain the event risk level configuration information configured by a user.

[0013] In a possible implementation manner, the first storage mode is used to indicate at least one risk level.

[0014] In one possible implementation, the processor is further used to: process a second image frame sequence contained in the video stream to obtain a second event recorded by the second image frame sequence; wherein the second image frame sequence is adjacent to the first image frame sequence, and the second image frame sequence and the first image frame sequence contain the same image frames; determine the risk level of the second event based on the event risk level configuration information; and store the second image frame sequence when the risk level of the second event matches the risk level indicated by the first storage mode.

[0015] In a possible implementation manner, the video stream is obtained by capturing with a camera.

[0016] In a possible implementation manner, the memory is further configured to: if a risk level of the first event does not match a risk level indicated by a first storage mode, not store the first image frame sequence.

[0017] In a third aspect, the present application provides a computing device, comprising: at least one memory for storing programs; at least one processor for executing the programs stored in the memory; wherein, when the program stored in the memory is executed, the processor is used to: obtain a video stream, the video stream containing at least one image frame; process a first image frame sequence contained in the video stream to obtain a first event recorded by the first image frame sequence; determine the risk level of the first event based on event risk level configuration information; and, when the risk level of the first event matches the risk level indicated by a first storage mode, send the first image frame sequence to a storage device, wherein the first storage mode is a pre-configured storage mode.

[0018] In a fourth aspect, the present application provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a processor, the processor executes the method described in the first aspect or any possible implementation of the first aspect.

[0019] In a fifth aspect, the present application provides a computer program product. When the computer program product runs on a processor, the processor executes the method described in the first aspect or any possible implementation of the first aspect.

[0020] It can be understood that the beneficial effects of the second to sixth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 It is a schematic diagram of the architecture of a video surveillance system provided by an embodiment of the present application;

[0022] Figure 2 It is a schematic diagram of the architecture of a storage system provided in an embodiment of the present application;

[0023] Figure 3 is a schematic diagram of the architecture of another storage system provided in an embodiment of the present application;

[0024] Figure 4 It is a flowchart of a data processing method provided in an embodiment of the present application;

[0025] Figure 5 This is a schematic diagram of a process for configuring event risk levels provided in an embodiment of the present application;

[0026] Figure 6 This is a schematic diagram of a process for configuring a storage mode provided in an embodiment of the present application; DETAILED DESCRIPTION

[0027] The term "and / or" in this article is a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The symbol " / " in this article indicates that the associated objects are in an or relationship, for example, A / B means A or B.

[0028] The terms "first" and "second" in the specification and claims herein are used to distinguish different objects rather than to describe a specific order of the objects. For example, a first response message and a second response message are used to distinguish different response messages rather than to describe a specific order of the response messages.

[0029] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0030] In the description of the embodiments of the present application, unless otherwise specified, "multiple" means two or more than two. For example, multiple processing units refer to two or more processing units, etc.; multiple elements refer to two or more elements, etc.

[0031] For example, Figure 1 FIG. 1 is a schematic diagram showing the architecture of a video surveillance system provided by an embodiment of the present application. Figure 1 As shown, the video surveillance system 100 may include at least one camera 110 , a terminal device 120 , and a storage system 130 .

[0032] The camera 110 is mainly used to collect video data of a specific area. The deployment location of the camera 110 can be selected according to actual conditions and is not limited here. For example, when there are multiple cameras 110, different cameras 110 can be responsible for collecting video data of different areas.

[0033] The terminal device 120 is mainly responsible for obtaining the risk level configuration of different events by the user, and transmitting the risk level of the event configured by the user to the storage system 130. In addition, the terminal device 120 can also be responsible for obtaining the storage mode configured by the user, and transmitting the storage mode configured by the user to the storage system 130. For example, the user can log in to the management interface of the video surveillance system 100 through the terminal device 120, and configure the risk level, storage mode, etc. of the event in the management interface. Exemplarily, the terminal device 120 can be an electronic device such as a mobile phone, a computer, etc.

[0034] The storage system 130 is mainly used to obtain the video captured by the camera 110 and store the video captured by the camera 110. Before storing the video, the storage system 130 can receive the event risk level configuration information and storage mode configuration information sent by the terminal device 120, receive the video stream sent by the camera 110, and obtain the image frame sequence containing a preset number of image frames from the video stream, and then process the image frame sequence to obtain the event recorded by the image frame sequence. Then, the storage system 130 can obtain the risk level of the event recorded by the image frame sequence by querying the event risk level configuration information. In addition, the storage system 130 is also used to determine whether the risk level of the event recorded by the image frame sequence in the video stream matches the risk level indicated by the storage mode configured by the user. If it matches, the image frame sequence is stored in the storage system 130.

[0035] In some embodiments, the storage system 130 may be a centralized storage system or a distributed storage system.

[0036] For example, Figure 2FIG. 1 shows a schematic diagram of the structure of a storage system 130 shown in an embodiment of the present application. Figure 2 As shown, the storage system 130 may be a centralized storage system. The centralized storage system is characterized by having a unified entrance through which all data from external devices must pass. This entrance is the engine 131 of the centralized storage system. The engine 131 is the core component of the centralized storage system, and many advanced functions of the storage system are implemented in it. Figure 2 As shown, the engine 131 includes a controller, which will be described in detail below.

[0037] The engine 131 also includes a front-end interface 13113 and a back-end interface 13114, wherein the front-end interface 13113 is used to communicate with the camera 110 to receive the video stream transmitted by the camera 110, and is used to communicate with the terminal device 120 to receive the event risk level configuration information and the storage mode configured by the user sent by the terminal device 120. The back-end interface 13114 is used to communicate with the hard disk in the hard disk frame 132 to expand the capacity of the storage system. Through the back-end interface 13114, the engine 131 can connect more hard disks 1322, thereby forming a very large storage resource pool. Through this storage resource pool, the image frame sequence contained in the video stream can be stored.

[0038] In hardware, such as Figure 2As shown, the controller 1311 includes at least a processor 13115 and a memory 13112. The processor 13115 is a central processing unit (CPU), and the memory 13112 refers to an internal memory that directly exchanges data with the processor 13115. It can read and write data at any time, and the speed is very fast, and it can be used as a temporary data storage. Computer program instructions are stored in the memory 13112, and the processor 13115 runs the computer program instructions in the memory 13112 to perform some steps in the data processing method provided in the embodiment of the present application. Specifically, the processor 13115 can receive the event risk level configuration information sent by the terminal device 120 and the storage mode configured by the user, and temporarily store it in the memory 13112. Exemplarily, the processor 13115 can receive the event risk level configuration information sent by the terminal device 120 and the storage mode information configured by the user through the front-end port 13113, and temporarily store it in the memory 13112. Then, the processor 13115 can receive the video stream transmitted by the camera 110 and temporarily store it in the memory 13112. Exemplarily, the processor 13115 can receive the video stream transmitted by the camera 110 through the front-end port 13113 and temporarily store it in the memory 13112. Then, the processor 13115 can obtain an image frame sequence containing a preset number of image frames from the video stream, process the image frame sequence, and thus identify the event recorded by the image frame sequence. The processor 13115 obtains the risk level of the event recorded by the image frame sequence in the video stream by querying the event risk level configuration information. In addition, the processor 13115 can also determine whether the risk level of the event recorded by the image frame sequence in the video stream matches the risk level indicated by the storage mode configured by the user. If it matches, the processor 13115 sends the image frame sequence to the hard disk frame 132 through the back-end interface 13114, so that the control unit 1321 can persistently store the image frame sequence in the hard disk 1322.

[0039] Specifically, the memory can be a random access memory or a read only memory (ROM). The random access memory is a dynamic random access memory (DRAM) or a storage class memory (SCM). DRAM is a semiconductor memory, and like most random access memories (RAM), it is a volatile memory device. The memory 13112 can also be a module composed of a dual in-line memory module or a dual in-line memory module (DIMM, DRAM), or a solid state disk (SSD).

[0040] The engine 131 may not have a hard disk slot, and the hard disk 1322 needs to be placed in the hard disk frame 132, and the back-end interface 13114 communicates with the hard disk frame 132. The back-end interface 13114 exists in the engine 131 in the form of an adapter card, and two or more back-end interfaces 13114 can be used simultaneously on one engine 131 to connect multiple hard disk frames. Alternatively, the adapter card can also be integrated on the motherboard, in which case the adapter card can communicate with the processor 13115 via a peripheral component interconnect express (PCIE) bus.

[0041] It should be noted that Figure 2 Only one engine 131 is shown in the figure. However, in actual applications, the storage system 130 may include two or more engines 131, and redundancy or load balancing is performed between the multiple engines 131.

[0042] The hard disk frame 132 includes a control unit 1321 and a plurality of hard disks 1322. The control unit 1321 may have various forms. In one case, the hard disk frame 132 is an intelligent disk frame, and the control unit 1321 may include a central processing unit CPU and a memory. In another case, the control unit 1321 is a programmable electronic component, such as a data processing unit (DPU). Optionally, the DPU here may also be replaced with a processing chip such as a graphics processing unit (GPU), an embedded neural network processor (NPU), etc.

[0043] For example, Figure 3FIG. 1 is a schematic diagram showing the structure of another storage system 130 provided in an embodiment of the present application. Figure 3 As shown, the storage system 130 may be a distributed storage system, which includes a computing device 133 and a storage device 134. The computing device 133 may be a server, a desktop computer, or a controller of a storage array, etc. The number of computing devices 133 may be one or more, and the number of storage devices 134 is also the same. The following detailed description assumes that the number of computing devices 133 and storage devices 134 is one.

[0044] The computing device 133 can receive the event risk level configuration information and the storage mode configuration information sent by the terminal device 120, and then the computing device 133 can receive the video stream sent by the camera 110. The computing device 133 can also obtain an image frame sequence containing a preset number of image frames from the video stream, and then process the image frame sequence to obtain the event recorded by the image frame sequence. Then, the computing device 133 can obtain the risk level of the event recorded by the image frame sequence by querying the event risk level configuration information. In addition, the computing device 133 can also determine whether the risk level of the event recorded by the image frame sequence in the video stream matches the risk level indicated by the storage mode configured by the user. If it matches, the computing device 133 sends the image frame sequence to the storage device 134 and sends a data write instruction to the storage device 134. After receiving the data write instruction, the storage device 134 can store the above-mentioned image frame sequence persistently in the hard disk.

[0045] In hardware, such as Figure 3 As shown, the computing device 133 includes at least a processor 1331, a memory 1332 and a network card 1333. The processor 1331 is a central processing unit (CPU) or other processing chip with processing functions, and the type of the memory 1332 can be similar to the memory 13112 mentioned in the above content, and the details can be referred to the above description, which will not be repeated here.

[0046] Specifically, the processor 1331 may receive the event risk level configuration information and the storage mode information configured by the user sent by the terminal device 120, and temporarily store them in the memory 1332. Then, the processor 1331 may receive the video stream transmitted by the camera 110, and temporarily store them in the memory 1332. Thereafter, the processor 1331 may obtain an image frame sequence including a preset number of image frames from the video stream, identify the event recorded in the image frame sequence, and then obtain the risk level of the event recorded in the image frame sequence in the video stream by querying the event risk level configuration information.

[0047] Next, as a possible implementation, the processor 1331 can determine whether the risk level of the event recorded by the image frame sequence in the video stream matches the risk level indicated by the storage mode pre-configured by the user. If it matches, the processor 1331 sends the image frame sequence to the storage device, so that the storage device 134 can persistently store the image frame sequence after receiving the image frame sequence. As another possible implementation, after determining the event recorded by the image frame sequence, the processor 1331 can query the event risk level configuration information pre-configured by the user based on the event recorded by the image frame sequence to obtain the risk level of the event recorded by the image frame sequence, and transmit the image frame sequence and the risk level of the event recorded by the image frame sequence to the storage device 134.

[0048] Figure 3 Only one processor 1331 is shown in the figure. In actual applications, there are often multiple processors 1331, wherein one processor 1331 has one or more processor cores. This embodiment does not limit the number of processors and the number of processor cores.

[0049] In terms of function, due to Figure 3 The main function of the computing device 133 in the example is computing services. When storing data, it can use remote storage to achieve persistent storage. Therefore, it has less local storage than a conventional server, thereby saving costs and space. However, this does not mean that the computing device 133 cannot have local storage. In actual implementation, the computing device 133 can also have a small number of hard disks built in or externally connected. When there are multiple computing devices 133 and storage devices 134, any computing device 133 can access any storage device 134 of the multiple storage devices through the network.

[0050] In one implementation, when the computing device 133 sends the image frame sequence to the storage device 134, the storage device 134 may receive the image frame sequence sent by the computing device 133, and under the instruction of the data write instruction sent by the computing device 133, the image frame sequence is persistently stored in the hard disk 1345. In another implementation, when the computing device 133 sends the image frame sequence and the risk level of the event recorded by the image frame sequence to the storage device 134, the storage device 134 may receive the image frame sequence sent by the computing device 133 and the risk level of the event recorded by the image frame sequence, and compare the risk level of the event recorded by the image frame sequence with the risk level indicated by the storage mode configured by the user to determine whether the two match. If they match, the storage device 134 will persistently store the image frame sequence. If they do not match, the storage device 134 will not persistently store the image frame sequence.

[0051] From the hardware point of view, a storage device 134 includes a processor 1341, a memory 1342, a network card 1343 and multiple hard disks 1345. The network card 1343 is used to communicate with the computing device 133. The hard disk 1345 is used to store the image frame sequence, and can be a disk or other types of storage media, such as a solid state drive or a shingled magnetic recording hard disk. The type of the processor 1341 is similar to the type of the aforementioned processor, and the details can be referred to the aforementioned description, which will not be repeated here.

[0052] In an embodiment of the present application, in one implementation, when the computing device 133 sends an image frame sequence to the processor 1341, the processor 1341, as the main core unit of the storage device 1340, can receive the image frame sequence sent by the computing device 133 through the network card 1343, and temporarily store the image frame sequence in the memory 1342, and after receiving the data write instruction sent by the computing device 133, the processor 1341 persistently stores the above image frame sequence in the hard disk 1345. In another implementation, the processor 1341, as the main core unit of the storage device 1340, can receive the image frame sequence sent by the computing device 133 and the risk level of the event recorded by the image frame sequence through the network card 1343 when the computing device 133 sends the image frame sequence and the risk level of the event recorded by the image frame sequence to the storage device 134, and temporarily store it in the memory 1342. The storage device 134 can compare the risk level of the event recorded by the image frame sequence with the risk level indicated by the storage mode configured by the user to determine whether the two match. If they match, the processor 1341 will persistently store the image frame sequence in the hard disk 1345. If they do not match, the processor 1341 will not persistently store the image frame sequence in the hard disk 1345, thereby achieving selective storage of the image frame sequence.

[0053] In another embodiment, the network card 1343 is a smart network card, which may include a CPU and a memory processor ( Figure 3 (not shown in the figure), based on this, some functions of 1341 can be offloaded to the network card 1343. The memory in the network card 1343 is used to temporarily store the image frame sequence to be written to the hard disk 1345. The CPU can also be a programmable electronic component, such as a DPU. Optionally, the DPU here can also be a processing chip such as a GPU or NPU. There is no ownership relationship between the network card 1343 and the hard disk 1345 in the storage device 1340, and the network card 1343 can access any hard disk 1345 in the storage device 134.

[0054] It is to be understood that the structure of the storage system 130 illustrated in the embodiment of the present application does not constitute a specific limitation on the storage system 130. In other embodiments of the present application, the storage system 130 may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0055] The above is an introduction to the video monitoring system 100 provided in the embodiment of the present application. Next, based on the above content, a data processing method provided in the embodiment of the present application is introduced.

[0056] For example, Figure 4 1 shows a flow chart of a data processing method provided by an embodiment of the present application. The data processing method provided by an embodiment of the present application can be applied to the above-mentioned video surveillance system 100, and is specifically executed by the camera 110, the terminal device 120 and the storage system 130 in the video surveillance system 100. Figure 4 As shown, the data processing method may include the following steps:

[0057] S201. The terminal device 120 obtains event risk level configuration information input by a user.

[0058] In this embodiment, the user can log in to the management interface of the video surveillance system 100 through the client configured on the terminal device 120. Then, the user can define the risk level of each event on the management interface through the terminal device 120. For example: Figure 5 As shown in (A), the user can log in to the management interface on the terminal device 120. In the management interface, the user can select the button 31 for configuring the event risk level in the "Settings" option. Figure 5 As shown in (B), the terminal device 120 may display an event risk level configuration interface. In the event risk level configuration interface, the user may choose to configure the risk level of events corresponding to some behaviors. Figure 5 In (B), the user can define the events corresponding to the stationary behavior and walking behavior of the person as low risk level, the events corresponding to the fast running behavior and jumping behavior of the person as medium risk level, and the events corresponding to the falling behavior and fast falling behavior of the person as high risk level. After the user completes the configuration, the user can click the "Confirm" button 32. In this way, the user has completed the configuration of the event risk level. It should be understood that for the risk level configuration of events corresponding to other behaviors, you can refer to Figure 5The configuration method of the event risk level is shown, which will not be described in detail here. In some embodiments, in addition to configuring the risk level of events corresponding to some pre-set behaviors, on the terminal device 120, the user can also customize some behaviors based on their own needs, and set the risk level of events corresponding to these behaviors. For example, the risk level of the event corresponding to a person changing from a static state to a moving state can be defined, the risk level of the event corresponding to a specific gesture of a person can be defined, and the risk level of the event corresponding to a specific object changing from presence to absence in the video can be defined. The specific risk level can be determined according to the actual situation and is not limited here.

[0059] After the user completes the configuration of the risk level of the event, the terminal device 120 can obtain the event risk level configuration information input by the user. The event risk level configuration information may include the risk level of at least one event.

[0060] In addition, before the user inputs event risk level configuration information on the terminal device 120 , the terminal device 120 may push a configuration prompt message to the user on the display interface to remind the user to configure the risk level of each event in the management interface of the video surveillance system 100 in a timely manner.

[0061] S202 . The terminal device 120 sends event risk level configuration information to the storage system 130 .

[0062] In this embodiment, after acquiring the event risk level configuration information input by the user, the terminal device 120 may forward the information to the storage system 130 through the network.

[0063] S203: The terminal device 120 obtains storage mode configuration information input by the user.

[0064] In this embodiment, the video surveillance system 100 has multiple storage modes. Among them, different storage modes can be used to indicate different risk levels. For example, storage mode A can be used to indicate a high risk level, storage mode B can be used to indicate a medium risk level, storage mode C can be used to indicate a low risk level, storage mode D can be used to indicate a high risk level and a medium risk level, storage mode E can be used to indicate a medium risk level and a low risk level, and so on. In this way, the user can flexibly choose to store video data corresponding to events of different risk levels by selecting different storage modes.

[0065] As in S201 above, the user can log in to the management interface of the video surveillance system 100 and configure the storage mode of the video surveillance system 100 in the management interface. Figure 6As shown in (A), the user can log in to the management interface on the terminal device 120. In the management interface, the user can select the button 41 for configuring the storage mode in the "Settings" option. Figure 6 As shown in (B), the terminal device 120 can display a storage mode configuration interface. In the storage mode configuration interface, multiple storage modes can be displayed. Further, the user can select the storage mode he needs from the multiple storage modes, for example, select storage mode A, and click the "OK" button 42, so that the user completes the configuration of the storage mode.

[0066] After the user completes the configuration of the storage mode, the terminal device 120 can obtain the storage mode configuration information input by the user. The storage mode configuration information may include the storage mode selected by the user.

[0067] S204 . The terminal device 120 sends storage mode configuration information to the storage system 130 .

[0068] In this embodiment, after acquiring the storage mode configuration information input by the user, the terminal device 120 may forward the information to the storage system 130 through the network.

[0069] After the user completes the configuration of the event risk level and storage mode, the video surveillance system 100 can work according to the user's configuration. At this time, the subsequent steps can be executed. In some embodiments, the user may not configure the event risk level and / or storage mode. At this time, the video surveillance system 100 can work based on the default event risk level configuration and / or storage mode.

[0070] S205 : The camera 110 acquires an image of a specific area.

[0071] In this embodiment, after the user has debugged the video monitoring system, the camera 110 can perform video monitoring on a specific area set by the user to obtain an image of the specific area.

[0072] S206 : The camera 110 transmits a video stream to the storage system 130 , where the video stream includes at least one image frame.

[0073] In this embodiment, after the camera 110 captures the image, it can directly or indirectly transmit the captured image to the storage system 130 in the form of a video stream. The video stream contains at least one image frame. Exemplarily, when the camera 110 directly transmits the video stream to the storage system 130, the camera 110 can transmit the real-time captured image to the storage system 130 in the form of a video stream. When the camera 110 indirectly transmits the video stream to the storage system 130, the camera 110 can first store the captured image in a storage device, and then, when the storage system 130 needs to process the image captured by the camera 110, the image captured by the camera 110 can be transmitted from the storage device to the storage system 130 in the form of a video stream.

[0074] S207 : The storage system 130 processes the image frame sequence included in the video stream to obtain events recorded by the image frame sequence.

[0075] In this embodiment, after acquiring the video stream transmitted by the camera 110, the storage system 130 can process the image frame sequence contained in the video stream to obtain the events recorded by the image frame sequence. Figure 2 In the structure shown in FIG. 1 , the storage system 130 can process the image frame sequence contained in the video stream through the controller 1311 to obtain the events recorded by the image frame sequence. In another specific implementation, when the structure of the storage system 130 is Figure 3 In the structure shown, the storage system 130 can process the image frame sequence included in the video stream through the computing device 133 to obtain the events recorded by the image frame sequence. Exemplarily, an image frame sequence can be understood as a video segment, and the number of image frames included in the image frame sequence can be preset.

[0076] In some embodiments, the storage system 130 may utilize a neural network and process each image frame sequence in sequence according to the time sequence of the image frames contained in the acquired video stream to obtain the events recorded by the image frame sequence. Among them, adjacent image frame sequences may contain the same image frames, so that the events recorded in the image frame sequences can be more accurately identified. For example, if the first image frame sequence contains image frames from the 1st image frame to the 10th image frame, the second image frame sequence may contain image frames from the 2nd image frame to the 11th image frame. In addition, adjacent image frame sequences may not contain the same image frames. For example: if the first image frame sequence contains image frames from the 1st image frame to the 10th image frame, the second image frame sequence may contain image frames from the 11th image frame to the 20th image frame.

[0077] S208 . The storage system 130 queries event risk level configuration information pre-configured by the user based on the event recorded by the image frame sequence, and obtains the risk level of the event recorded by the image frame sequence.

[0078] In this embodiment, after determining the event recorded by the image frame sequence, the storage system may query the event risk level configuration information pre-configured by the user based on the event recorded by the image frame sequence to obtain the risk level of the event recorded by the image frame sequence. Figure 2 As shown, the storage system 130 includes a controller 1311, and the controller 1311 can execute step S208. In another specific implementation, the storage system 130 can be as follows Figure 3 As shown, the storage system 130 includes a computing device 133, and the computing device 133 can execute step S208. In another specific implementation, the storage system 130 can be as follows Figure 3 As shown, it includes a computing device 133 and a storage device 134 . The computing device 133 can execute step S208 and transmit the image frame sequence and the risk level of the event recorded by the image frame sequence to the storage device 134 .

[0079] For example, if in the event risk level configuration information, the user configures the event corresponding to the fall behavior as a high risk level, when the storage system 130 determines that the behavior corresponding to the event recorded by the image frame sequence is a fall behavior, the storage system 130 can determine that the event recorded by the image frame sequence is a high risk level. Exemplarily, the event recorded by the image frame sequence can be one or more.

[0080] S209: The storage system 130 determines whether the risk level of the event recorded in the image frame sequence matches the risk level indicated by the storage mode configured by the user.

[0081] In this embodiment, the storage system 130 may compare the risk level of the event recorded by the image frame sequence with the risk level indicated by the storage mode configured by the user to determine whether the two match.

[0082] When the two do not match, it indicates that the risk level corresponding to the event recorded by the image frame sequence does not meet the needs of the user, so there is no need to store the image frame sequence, and S210 is executed; when the two match, it indicates that the risk level corresponding to the event recorded by the image frame sequence meets the needs of the user, so the image frame sequence needs to be stored, and S211 is executed. For example, if the storage mode configured by the user is storage mode A, and the risk level indicated by storage mode A is above the medium risk level, if the risk level of the event recorded by the image frame sequence (for example, the event corresponding to the walking behavior) determined by the storage system 130 is a low risk level, the storage system 130 can learn through comparison that the risk level of the event recorded by the image frame sequence does not match the risk level indicated by the storage mode configured by the user.

[0083] In a specific implementation, the storage system 130 may be as follows: Figure 2 As shown, the storage system 130 includes a controller 1311, and the controller 1311 can execute step S209. In another specific implementation, the storage system 130 can be as follows Figure 3 As shown, the computing device 133 and the storage device 134 are included. The computing device 133 can execute step S209. If the computing device 133 matches, the computing device 133 sends the image frame sequence to the storage device 134. If the computing device 133 does not match, the image frame sequence is not sent to the storage device 134. In another specific implementation, the storage system 130 can be as follows: Figure 3 As shown, the computing device 133 and the storage device 134 are included. After receiving the image frame sequence sent by the computing device 133 and the risk level of the event recorded in the image frame sequence, the storage device 134 may execute step S209.

[0084] In some embodiments, when multiple events are recorded in an image frame sequence, as long as the risk level of any one of the events matches the risk level indicated by the storage mode configured by the user, it can be determined that the risk level of the event recorded in the image frame sequence matches the risk level indicated by the storage mode configured by the user. For example, the storage system recognizes that there are two events recorded in the image frame sequence, and one event is a low risk level and the other event is a high risk level. If the risk levels indicated by the storage mode configured by the user are a medium risk level and a high risk level, the storage system can determine that the risk level of one event recorded in the image frame sequence matches the risk level indicated by the storage mode configured by the user, and the risk level of another event does not match the risk level indicated by the storage mode configured by the user, then it can be determined that the risk level of the event recorded in the image frame sequence matches the risk level indicated by the storage mode configured by the user.

[0085] S210: The storage system 130 does not store the image frame sequence, and processes an event recorded by the next image frame sequence included in the video stream.

[0086] In this embodiment, when the storage system 130 determines that the risk level of the event recorded by the image frame sequence does not match the risk level indicated by the storage mode configured by the user, it may not store the image frame sequence, obtain the next image frame sequence contained in the video stream, and use the same method as the above steps to process the next image frame sequence in the video stream.

[0087] In a specific implementation, the storage system 130 may be as follows: Figure 2 As shown, the storage system 130 includes a controller 1311. When the controller 1311 executes step S209 and determines that the risk level of the event recorded by the image frame sequence does not match the risk level indicated by the storage mode configured by the user, the image frame sequence may not be stored, and the next image frame sequence may be processed in the same manner as in the above steps. In another specific implementation, the storage system 130 may be as follows: Figure 3 As shown, the computing device 133 and the storage device 134 are included. When the computing device 133 executes step S209 and determines that the risk level of the event recorded by the image frame sequence does not match the risk level indicated by the storage mode configured by the user, the image frame sequence may not be transmitted to the storage device 134, and the next image frame sequence may be processed in the same manner as in the above steps. Therefore, the storage device 134 cannot receive the image frame sequence from the computing device 133, and cannot store the image frame sequence persistently. In another specific implementation, the storage system 130 may be as follows Figure 3 As shown, the computing device 133 and the storage device 134 are included. When the storage device 134 executes step S209 and determines that the risk level of the event recorded by the image frame sequence does not match the risk level indicated by the storage mode configured by the user, the image frame sequence may not be persistently stored, and the computing device 133 is notified. Next, the computing device 133 may process the next image frame sequence using the same method as the above steps.

[0088] S211. The storage system 130 stores the image frame sequence.

[0089] In this embodiment, when the storage system 130 executes step S209 and determines that the risk level of the event recorded by the image frame sequence matches the risk level indicated by the storage mode configured by the user, the image frame sequence can be stored to facilitate the user to read the image frame sequence later.

[0090] In a specific implementation, the storage system 130 may be as follows: Figure 2As shown, the storage system 130 includes a controller 1311 and a hard disk frame 132. When the controller 1311 executes step S209 and determines that the risk level of the event recorded by the image frame sequence matches the risk level indicated by the storage mode configured by the user, the image frame sequence can be sent to the hard disk frame 132 so that the hard disk frame 132 can store the image frame sequence persistently, thereby enabling the user to read the image frame sequence in a subsequent process. In another specific implementation, the storage system 130 can be as follows Figure 3 As shown, the computing device 133 and the storage device 134 are included. When the computing device 133 executes step S209 and determines that the risk level of the event recorded by the image frame sequence matches the risk level indicated by the storage mode configured by the user, the computing device 133 can send the image frame sequence to the storage device 134. The storage device 134 can receive the image frame sequence sent by the computing device 133 and store the image frame sequence persistently in the storage device 134. In another specific implementation, the storage system 130 can be as follows: Figure 3 As shown, it includes a computing device 133 and a storage device 134. When the storage device 134 executes step S209 and determines that the risk level of the event recorded by the image frame sequence matches the risk level indicated by the storage mode configured by the user, the image frame sequence can be persistently stored.

[0091] Further, in a specific implementation, if the risk level of the event recorded by the image frame sequence is a high risk level, the storage system 130 can store the image frame sequence in a high-resolution format; if the risk level of the event recorded by the image frame sequence is a medium risk level, the storage system 130 can store the image frame sequence in a medium resolution format; if the risk level of the event recorded by the image frame sequence is a low risk level, the storage system 130 can store the image frame sequence in a low-resolution format, thereby storing image frame sequences of lower importance at a lower resolution, thereby reducing the storage space occupied by the video. In another specific implementation, if the risk level of the event recorded by the image frame sequence is a high risk level, the storage system 130 can directly store it. If the risk level of the event recorded by the image frame sequence is a medium risk level or a low risk level, the storage system 130 can first perform frame extraction processing on the image frame sequence, and then store the image frame sequence after the frame extraction processing.

[0092] It can be seen from this that users can flexibly configure the storage mode and the risk level of the event according to their actual needs. The image frame sequence is stored only when the risk level of the event recorded by the image frame sequence matches the risk level indicated by the storage mode configured by the user, otherwise it is not stored. In this way, image frame sequences that meet user needs can be selectively stored, thereby solving the technical problem of video data occupying too much storage space.

[0093] It is understandable that the size of the sequence number of each step in the above embodiment does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application. In addition, in some possible implementations, each step in the above embodiment can be selectively executed according to actual conditions, and can be partially executed or fully executed, which is not limited here.

[0094] Based on the method in the above embodiment, the present application embodiment provides a storage system. Figure 2 , Figure 2 1 is a schematic diagram of the structure of a storage system 130 provided in an embodiment of the present application. Figure 2 As shown, the storage system 130 includes: at least one memory, which may include Figure 2 The memory 13112 and hard disk frame 132 shown in the figure, the memory 13112 is used to store programs; at least one processor, which may be the processor 13115 in the engine 131, is used to execute the programs stored in the memory; wherein, when the program stored in the memory is executed, the processor is used to: obtain a video stream, the video stream containing at least one image frame; process a first image frame sequence contained in the video stream to obtain a first event recorded by the first image frame sequence; determine the risk level of the first event based on event risk level configuration information; the hard disk frame 132 shown is used to store the first image frame sequence when the risk level of the first event matches the risk level indicated by the first storage mode.

[0095] Based on the method in the above embodiment, the present application embodiment provides another storage system. Figure 3 , Figure 3 1 is a schematic diagram of the structure of another storage system 130 provided in an embodiment of the present application. Figure 3 As shown, the storage system 130 includes: at least one memory, which may include Figure 3 The memory 1332 and storage device 134 shown in the figure, the memory 1332 is used to store programs; at least one processor, which may be the processor 1331, is used to execute the programs stored in the memory; wherein, when the program stored in the memory is executed, the processor is used to: obtain a video stream, the video stream containing at least one image frame; process a first image frame sequence contained in the video stream to obtain a first event recorded by the first image frame sequence; determine the risk level of the first event based on event risk level configuration information; the storage device 134 is used to store the first image frame sequence when the risk level of the first event matches the risk level indicated by the first storage mode.

[0096] In some embodiments, before determining the risk level of the first event based on the event risk level configuration information, the processor 1331 is further configured to: obtain the event risk level configuration information configured by a user.

[0097] In some embodiments, the first storage mode is used to indicate at least one risk level.

[0098] In some embodiments, the processor 1331 is further used to process a second image frame sequence contained in the video stream to obtain a second event recorded by the second image frame sequence; wherein the second image frame sequence is adjacent to the first image frame sequence, and the second image frame sequence and the first image frame sequence contain the same image frames; based on the event risk level configuration information, the risk level of the second event is determined; and the storage device 134 is also used to store the second image frame sequence when the risk level of the second event matches the risk level indicated by the first storage mode.

[0099] In some embodiments, the video stream is captured by a camera.

[0100] In some embodiments, the storage device 134 is further configured to: not store the first image frame sequence if the risk level of the first event does not match the risk level indicated by the first storage mode.

[0101] Based on the method in the above embodiment, the present application embodiment provides a computing device. Figure 3 , Figure 3 1 is a schematic diagram of the structure of a computing device 133 provided in an embodiment of the present application. Figure 3 As shown, the computing device 133 includes: at least one memory, the memory is the memory 132, for storing programs; at least one processor, the processor is Figure 3 The processor 1331 is used to execute the program stored in the memory; wherein, when the program stored in the memory is executed, the processor 1331 is used to: obtain a video stream, wherein the video stream includes at least one image frame; process a first image frame sequence included in the video stream to obtain a first event recorded by the first image frame sequence; determine the risk level of the first event based on event risk level configuration information; and, when the risk level of the first event matches the risk level indicated by the first storage mode, send the first image frame sequence to a storage device, wherein the first storage mode is a pre-configured storage mode, and the storage device is Figure 3 The storage device 134 in.

[0102] In some embodiments, before determining the risk level of the first event based on the event risk level configuration information, the processor 1331 is further configured to: obtain the event risk level configuration information configured by a user.

[0103] In some embodiments, the first storage mode is used to indicate at least one risk level.

[0104] In some embodiments, the processor 1331 is also used to: process a second image frame sequence contained in the video stream to obtain a second event recorded by the second image frame sequence; wherein the second image frame sequence is adjacent to the first image frame sequence, and the second image frame sequence and the first image frame sequence contain the same image frames; based on the event risk level configuration information, determine the risk level of the second event; the storage device 134 is also used to store the second image frame sequence when the risk level of the second event matches the risk level indicated by the first storage mode.

[0105] In some embodiments, the video stream is captured by a camera.

[0106] In some embodiments, the processor 1331 is further configured to: if the risk level of the first event does not match the risk level indicated by the first storage mode, not send the first image frame sequence to the storage device 134 .

[0107] Based on the method in the above embodiment, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a processor, the processor executes the method in the above embodiment.

[0108] Based on the method in the above embodiment, an embodiment of the present application provides a computer program product. When the computer program product runs on a processor, the processor executes the method in the above embodiment.

[0109] It is understood that the processor in the embodiments of the present application may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. The general-purpose processor may be a microprocessor or any conventional processor.

[0110] The method steps in the embodiments of the present application can be implemented by hardware or by a processor executing software instructions. The software instructions can be composed of corresponding software modules, and the software modules can be stored in random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, mobile hard disks, CD-ROMs, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an ASIC.

[0111] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions may be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state disk (SSD)), etc.

[0112] It should be understood that the various numerical numbers involved in the embodiments of the present application are only used for the convenience of description and are not used to limit the scope of the embodiments of the present application.

Claims

1. A data processing method, characterized in that: include: Acquire a video stream, wherein the video stream includes at least one image frame; Processing a first image frame sequence included in the video stream to obtain a first event recorded by the first image frame sequence; Determining a risk level of the first event based on the event risk level configuration information; The first sequence of image frames is stored when the risk level of the first event matches the risk level indicated by a first storage mode, wherein the first storage mode is a preconfigured storage mode.

2. The method according to claim 1, characterized in that Before determining the risk level of the first event based on the event risk level configuration information, the method further includes: Obtain the event risk level configuration information configured by the user.

3. The method according to claim 1 or 2, characterized in that: The first storage mode is used to indicate at least one risk level.

4. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: Processing a second image frame sequence included in the video stream to obtain a second event recorded by the second image frame sequence; wherein the second image frame sequence is adjacent to the first image frame sequence, and the second image frame sequence and the first image frame sequence include the same image frames; Determining a risk level of the second event based on the event risk level configuration information; In case the risk level of the second event matches the risk level indicated by the first storage mode, the second sequence of image frames is stored.

5. The method according to any one of claims 1 to 4, characterized in that: The video stream is captured by a camera.

6. The method according to any one of claims 1 to 5, characterized in that: The method further includes not storing the first sequence of image frames if the risk level of the first event does not match the risk level indicated by the first storage mode.

7. A storage system, characterized in that: include: at least one memory for storing a program; at least one processor, configured to execute the program stored in the memory; Wherein, when the program stored in the memory is executed, the processor is used to: obtain a video stream, wherein the video stream includes at least one image frame; process a first image frame sequence included in the video stream to obtain a first event recorded by the first image frame sequence; and determine a risk level of the first event based on event risk level configuration information; The memory is used to store the first sequence of image frames when the risk level of the first event matches the risk level indicated by the first storage mode.

8. The storage system according to claim 7, characterized in that: Before determining the risk level of the first event based on the event risk level configuration information, the processor is further configured to: Obtain the event risk level configuration information configured by the user.

9. The storage system according to claim 7 or 8, characterized in that: The first storage mode is used to indicate at least one risk level.

10. The storage system according to any one of claims 7 to 9, characterized in that: The processor is further configured to: Processing a second image frame sequence included in the video stream to obtain a second event recorded by the second image frame sequence; wherein the second image frame sequence is adjacent to the first image frame sequence, and the second image frame sequence and the first image frame sequence include the same image frames; Determining a risk level of the second event based on the event risk level configuration information; In case the risk level of the second event matches the risk level indicated by the first storage mode, the second sequence of image frames is stored.

11. The storage system according to any one of claims 7 to 10, characterized in that: The video stream is captured by a camera.

12. The storage system according to any one of claims 7 to 11, characterized in that: The memory is further configured to: not store the first image frame sequence if the risk level of the first event does not match the risk level indicated by the first storage mode.

13. A computing device, characterized in that ,include: at least one memory for storing a program; at least one processor, configured to execute the program stored in the memory; Wherein, when the program stored in the memory is executed, the processor is used to: obtain a video stream, the video stream containing at least one image frame; process a first image frame sequence contained in the video stream to obtain a first event recorded by the first image frame sequence; determine the risk level of the first event based on event risk level configuration information; and, when the risk level of the first event matches the risk level indicated by a first storage mode, send the first image frame sequence to a storage device, wherein the first storage mode is a pre-configured storage mode.

14. A computer-readable storage medium storing a computer program, wherein when the computer program is executed on a processor, the processor is caused to execute the method according to any one of claims 1 to 6.

15. A computer program product, characterized in that When the computer program product runs on a processor, the processor is caused to execute the method according to any one of claims 1 to 6.

Images