A method for storing and displaying intelligent event video retrieval data

Abstract

The present application relates to a method for intelligent event video retrieval, data storage and display, comprising obtaining video data from various video sources, inserting the track area number of the track area where the target appears in the video frame where the target is identified; obtaining and storing track data based on the target identifier, time information and track area number of the target; retrieving the target identifier of the corresponding target from the track data based on the retrieval conditions of the track area number and time information; and obtaining the corresponding target video data based on the target identifier integration; playing the target video data corresponding to the target identifier in a display window, and displaying the corresponding target attributes. Through the present application, the track area number of the target can be inserted into the video frame where the target exists, and the track data can be formed and stored. During retrieval, the target video data of the desired target can be quickly obtained and played based on the track area number and time information, thereby solving the problem of low video retrieval efficiency.

Description

Technical Field

[0001] The present application relates to the field of video surveillance technology, and in particular to a method for storing and displaying intelligent event video retrieval data. Background Art

[0002] In the field of video surveillance, intelligent applications are becoming increasingly popular. Video analysis can be used to locate targets appearing in video footage, such as vehicles and pedestrians invading perimeters, lost items, etc.

[0003] Currently, after analyzing and finding the target, only the image of the target or a related video can be displayed. For users, it is difficult to quickly retrieve and present the required video footage, resulting in low video retrieval efficiency.

[0004] With regard to the problem of low video retrieval efficiency in related technologies, no effective solution has been proposed so far. Summary of the Invention

[0005] Based on this, it is necessary to provide a method for storing and displaying intelligent event video retrieval data that can improve video retrieval efficiency in response to the above technical problems.

[0006] In a first aspect, this embodiment provides a method for storing and displaying intelligent event video retrieval data, including:

[0007] Obtaining video data from each video source, and inserting the track area number of the track area where the target appears in the video frame where the target is identified;

[0008] Obtaining and storing trajectory data according to the target identification, time information, and trajectory area number of the target;

[0009] Based on the search conditions of the trajectory area number and time information, a target identifier of the corresponding target is retrieved from the trajectory data; and corresponding target video data is obtained based on the target identifier.

[0010] The target video data corresponding to the target identifier is played in the display window, and the corresponding target attributes are displayed.

[0011] In some embodiments, the method further comprises:

[0012] The video data screen is divided into different track areas in advance, and corresponding track area numbers are set; the track areas adopt a multi-level structure.

[0013] In some embodiments, inserting the track area number of the track area where the target appears in the video frame in which the target is identified includes:

[0014] Identifying a video frame containing a target in the video data;

[0015] The position where the target appears is compared with the pre-divided track area, the track area number corresponding to the target is determined, and the track area number is inserted into the video frame.

[0016] In some embodiments, the method further comprises:

[0017] Inserting a target entry mark into the video frame in which the target is identified to have entered the picture;

[0018] Inserting a target leaving mark into the video frame where it is recognized that the target has left the screen.

[0019] In some embodiments, the trajectory data includes frame description information and trajectory area numbers, target identifiers, target entry flags, or target exit flags of different targets in each time information.

[0020] In some embodiments, the method further comprises:

[0021] When the target is identified to enter the screen and / or leave the screen, a target event is reported, and time information of the target event and the target identifier and target attributes of the target are stored as event data;

[0022] When the target identifier of the corresponding target is retrieved from the trajectory data, the target attribute is retrieved from the event data based on the target identifier.

[0023] In some embodiments, the method further comprises:

[0024] When playing the video data of each video source in the display window, synchronously detecting the track area number and the target entry mark or the target exit mark in the video data;

[0025] When the track area number and the target entry mark are detected, the video data is played in a first playback configuration and corresponding target attributes are displayed;

[0026] When the track area number and the target leaving mark are detected, or when the track area number is not detected, playing the video data in a second playback configuration;

[0027] The first playback configuration includes: playing the video data at a first preset speed; the second playback configuration includes: playing the video data at a second preset speed, or skipping the video data; the first preset speed is smaller than the second preset speed.

[0028] In a second aspect, this embodiment provides an apparatus for storing and displaying intelligent event video retrieval data, including:

[0029] A storage module is configured to obtain video data from each video source, insert a track area number of a track area where a target appears in a video frame where a target is identified, obtain track data based on the target identifier, time information, and track area number, and store the track data;

[0030] A retrieval module, configured to retrieve a target identifier of a corresponding target from the trajectory data based on a retrieval condition of the trajectory area number and time information; and to integrate the target video data corresponding to the target based on the target identifier;

[0031] The display module is used to play the target video data corresponding to the target identifier in a display window and display corresponding target attributes.

[0032] In a third aspect, a computer device is provided in this embodiment, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the method for intelligent event video recording retrieval data storage and display described in the first aspect above is implemented.

[0033] In a fourth aspect, a storage medium is provided in this embodiment, on which a computer program is stored. When the program is executed by a processor, the method for storing and displaying intelligent event video retrieval data as described in the first aspect above is implemented.

[0034] Compared with related technologies, the method for intelligent event video retrieval, data storage, and display provided in this embodiment obtains video data from each video source, inserts the track area number of the track area where the target appears in the video frame where the target is identified; obtains and stores track data based on the target identifier, time information, and the track area number of the target; retrieves the target identifier of the corresponding target from the track data based on the retrieval conditions of the track area number and time information; and obtains the corresponding target video data based on the target identifier; plays the target video data corresponding to the target identifier in the display window, and displays the corresponding target attributes. Through this embodiment, the target's track area number can be inserted into the video frame where the target exists, and the track data can be formed and stored. During retrieval, the target video data of the required target can be quickly obtained and played based on the track area number and time information, solving the problem of low video retrieval efficiency.

[0035] The details of one or more embodiments of the present application are set forth in the following drawings and description to make other features, objects, and advantages of the present application more readily apparent. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0037] Figure 1 This is a hardware structure block diagram of a terminal for a method for storing and displaying intelligent event video recording, retrieval, data, and display in one embodiment;

[0038] Figure 2 is a flow chart of a method for intelligent event video retrieval, data storage and display in one embodiment;

[0039] Figure 3 is a flow chart of a method for storing and displaying intelligent event video retrieval data in another embodiment;

[0040] Figure 4 is a flow chart of storing trajectory data and corresponding video data in one embodiment;

[0041] Figure 5 is a flowchart of video playback in one embodiment;

[0042] Figure 6 The present invention is a structural block diagram of a device for storing and displaying intelligent event video recording, retrieval data, and the like in one embodiment.

[0043] In the figure: 102, processor; 104, memory; 106, transmission device; 108, input and output device; 10, storage module; 20, retrieval module; 30, display module. DETAILED DESCRIPTION

[0044] In order to more clearly understand the purpose, technical solutions and advantages of the present application, the present application is described and illustrated below in conjunction with the accompanying drawings and embodiments.

[0045] Unless otherwise defined, technical or scientific terms used in this application shall have the ordinary meanings as understood by persons of ordinary skill in the art to which this application belongs. The terms "a," "an," "the," "these," and similar expressions in this application do not denote limitations on quantity and may be singular or plural. The terms "comprise," "include," "have," and any variations thereof, as used in this application, are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or device comprising a series of steps or modules (units) is not limited to the listed steps or modules (units) but may include unlisted steps or modules (units) or other steps or modules (units) inherent to the process, method, product, or device. The terms "connected," "connected," "coupled," and similar expressions used in this application are not limited to physical or mechanical connections but may include electrical connections, whether direct or indirect. As used in this application, "plurality" means two or more. "And / or" describes an association between associated objects, indicating that three possible relationships exist. For example, "A and / or B" can mean: A exists alone; A and B exist simultaneously; or B exists alone. Generally, the character " / " indicates that the objects in the preceding and following relationship are in an "or" relationship. The terms "first", "second", "third", etc. involved in this application are only used to distinguish similar objects and do not represent a specific ordering of the objects.

[0046] The method embodiment provided in this embodiment can be executed in a terminal, a computer or a similar computing device. For example, running on a terminal, Figure 1 This is a hardware block diagram of the terminal of the method for storing and displaying intelligent event video retrieval data in this embodiment. Figure 1 As shown, the terminal may include one or more ( Figure 1 The processor 102 (only one is shown) and a memory 104 for storing data, wherein the processor 102 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA. The terminal may also include a transmission device 106 for communication functions and an input / output device 108. It will be understood by those skilled in the art that Figure 1 The structure shown is only for illustration and does not limit the structure of the above terminal. Figure 1 More or fewer components than shown, or with Figure 1 Different configurations shown.

[0047] The memory 104 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the method for intelligent event video retrieval data storage and display in this embodiment. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, that is, implementing the above-mentioned method. The memory 104 may include a high-speed random access memory and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include a memory remotely located relative to the processor 102, and these remote memories may be connected to the terminal via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0048] Transmission device 106 is used to receive or transmit data via a network. This network may include a wireless network provided by the terminal's communications provider. In one embodiment, transmission device 106 includes a network interface controller (NIC), which can be connected to other network devices via a base station to enable communication with the Internet. In another embodiment, transmission device 106 may be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0049] This embodiment provides a method for storing and displaying intelligent event video retrieval data. Figure 2 This is a flow chart of the method for storing and displaying intelligent event video retrieval data in this embodiment. Figure 2 As shown, the method includes the following steps:

[0050] Step S201 : obtaining video data of each video source, and inserting the track area number of the track area where the target appears into the video frame where the target is identified.

[0051] Specifically, the system accesses video data from video sources such as IPC (IP Camera) and performs intelligent analysis on the video data frame by frame. Target detection models such as YOLO and CNN (Convolutional Neural Networks) can be used to analyze whether there is a target in the video frame, identify the target's target identifier and position in the picture, and output the target frame coordinates.

[0052] For example, in the scenario of perimeter protection, the target may be vehicles, pedestrians, animals, etc.; in the scenario of monitoring the leftover key items, the target may be items, etc.

[0053] For video frames where an object is identified, if the object is located within a pre-defined track area within the frame, the track area number is inserted into the video frame. Track areas are pre-defined by dividing the video data into different track areas, each with a unique track area number. There are no specific restrictions on the size or shape of track areas.

[0054] Step S202: Obtain and store trajectory data according to the target identifier, time information, and trajectory area number of the target.

[0055] Specifically, through intelligent analysis of the video data of each video source, the video frame where the target exists, the target identification and the track area number of the target are obtained, and the time point when the target appears can be obtained as time information based on the video frame.

[0056] The target identification, time information and track area number are stored in a specific data structure to obtain track data, which can form an independent linked list structure. In addition, the track data and the relevant video data of the target are stored in the hard disk respectively.

[0057] Step S203 : Based on the search conditions of the trajectory area number and time information, the target identifier of the corresponding target is retrieved from the trajectory data; and the corresponding target video data is obtained based on the target identifier.

[0058] Specifically, when performing a track area video search, the search conditions for the track area number and time information are set. The track data is searched for targets and target identifiers that meet the search conditions, indicating that the target appeared in the specified track area at the specified time. The corresponding target video data is integrated based on the target identifier, that is, all video data of the target appearing in the specified track area at the specified time. The track area set in the search conditions can be one or more combinations; when multiple track areas are combined, they can be different track areas in the same picture or track areas in different video source pictures.

[0059] In some embodiments, the video data of the target passing through the preset track area can also be automatically saved, reducing the storage of invalid videos, saving hard disk space, and increasing the number of days of hard disk video storage.

[0060] Furthermore, the track area number in the above search condition can be directly set by the user, or the user can draw a rule frame in the picture, compare the rule frame with the pre-divided track area, and determine the track area number corresponding to the rule frame.

[0061] Step S204: play the target video data corresponding to the target identifier in the display window and display the corresponding target attributes.

[0062] Specifically, when playing the target video data in the display window, the corresponding target identifier, time information, and track area number, as well as target attributes, can also be displayed next to the target box (e.g., in the upper right corner), allowing users to intuitively obtain relevant information about the target. If the target is a person, the target attributes can include age, expression, clothing, etc.

[0063] Furthermore, the display window also includes a time progress bar and playback controls, which can control the start, pause, speed, forward, and reverse of the video. In addition, the display window also includes configuration controls, which allow users to configure search conditions and select video sources. Search conditions include but are not limited to target identification, time information, track area number, etc., allowing users to choose to play video data of any target, any time, and any track area.

[0064] Through the above steps, the target's trajectory area number can be inserted into the video frame where the target exists, and trajectory data can be formed for storage. During retrieval, the target video data of the required target can be quickly obtained and played based on the trajectory area number and time information, and invalid video data can be filtered out, thereby improving the video retrieval efficiency and reducing the size of the code stream data, thereby reducing the corresponding network bandwidth data during the transmission process.

[0065] In addition, the storage method of track area number is adopted, so that the track data only records the corresponding track area number, and there is no need to store the video data again, which can save hard disk space and increase the number of days of hard disk video storage. At the same time, retrieval based on the track area number in the track data can also improve the video retrieval speed.

[0066] In some embodiments, the method further comprises:

[0067] The video data screen is divided into different track areas in advance, and corresponding track area numbers are set; the track areas adopt a multi-level structure.

[0068] Specifically, users can segment the recorded data from each video source into different track areas based on custom rules, assign a unique track area number to each track area, and then pair the track area coordinates with the corresponding track area number to save the configuration. The size and shape of the track areas are not limited; each track area can be the same or different in size, and can be rectangular, polygonal, or other shapes. A hash algorithm can also be used to generate a unique track area number for each track area.

[0069] Furthermore, the track area can be divided into a multi-level structure, including a primary track area, a secondary track area, a tertiary track area, etc., and the track area numbers are multi-level numbers corresponding to the multi-level structure of the track area. For example, the screen is first divided into different primary track areas (numbered 1, 2, 3, etc.), and then the primary track area is further divided into different secondary track areas (the primary track area numbered 1 is divided into 1.1, 1.2, 1.3, etc.).

[0070] In some embodiments, statistical clustering can be performed based on the target's motion trajectory in the image to automatically divide the trajectory areas into different levels. Specifically, the location coordinate data of the target's appearance in historical video footage is collected, and clustering analysis is performed on the target's high-frequency appearance areas using a clustering algorithm (such as K-means). The boundaries of the dense areas formed by clustering are automatically mapped into trajectory areas (such as first-level trajectory areas, second-level trajectory areas, third-level trajectory areas, etc.), and hierarchical trajectory area numbers are assigned. The user is also supported to manually modify or merge the automatically generated sub-areas. Furthermore, it is conceivable that the user-defined division of trajectory areas is combined with the statistical clustering automatic division method to divide the trajectory areas into different levels. For example, the user first divides the image into different first-level trajectory areas according to customized rules, and then automatically divides one or more of the first-level trajectory areas into second-level trajectory areas using statistical clustering.

[0071] By pre-dividing the track areas and assigning numbers in this embodiment, a search method based on the track area numbers can be provided in subsequent steps, while also reducing storage space. Furthermore, by dividing the track areas into a multi-level structure, more refined target tracks can be provided, providing a more accurate search method and avoiding the impact of overly large track areas. Statistical clustering can also be used to automatically divide the track areas to assist in optimizing the configuration of the track areas.

[0072] In some embodiments, corresponding search conditions can be set based on multi-level track areas. The search conditions can include track areas of the same level or a combination of track areas of different levels. This allows for coarse and fine searches based on user needs, more accurately locating targets and improving search efficiency. Taking first-level track areas (numbered 1, 2, 3, etc.) and second-level track areas (1.1, 1.2, 1.3, 2.1, 2.2, 2.3, 3.1, 3.2, 3.3, etc.) as examples, the track areas set in the search conditions can be of the same level (e.g., 1 and 2) or a combination of different levels (e.g., 1 and 3.2).

[0073] In some embodiments, the step S201 of inserting the track area number of the track area where the target appears into the video frame where the target is identified includes the following steps:

[0074] Identify the video frames in which the target exists in the video data; compare the position where the target appears with the pre-divided track area, determine the track area number corresponding to the target, and insert the track area number into the video frame.

[0075] Specifically, a target recognition algorithm is used to identify targets in video frames, as well as target identifiers, locations where targets appear, etc., to determine video frames in which targets exist.

[0076] The target's location is compared with the pre-divided trajectory area. Specifically, it is determined whether the target's location coordinates (e.g., the center point of the location coordinates) are within the trajectory area. If the target is within the pre-divided trajectory area, the trajectory area number corresponding to the target is determined.

[0077] Furthermore, a target entry mark is inserted into the video frame in which it is recognized that the target enters the screen; and a target exit mark is inserted into the video frame in which it is recognized that the target leaves the screen.

[0078] Specifically, when intelligently analyzing video data frame by frame, it is possible to determine whether a target has entered or left the frame based on changes in the target in adjacent video frames. For example, if the target was not present in the previous video frame but is in the current video frame, it is determined that the target has entered the frame and a target entry indicator is inserted in the corresponding video frame. If the target was present in the previous video frame but is not in the current video frame, it is determined that the target has left the frame and a target exit indicator is inserted in the corresponding video frame.

[0079] By correspondingly inserting the target entry mark, the target exit mark, and the track area number into the video frame according to this embodiment, the video retrieval efficiency can be improved, and the video data of interest to the user can be quickly located.

[0080] In some embodiments, the trajectory data includes frame description information and trajectory area numbers, target identifiers, target entry flags, or target exit flags of different targets in each time information.

[0081] Specifically, the target identifier, time information, and trajectory region number are stored in a specific data structure to obtain trajectory data. The trajectory data can form an independent linked list structure. As shown in Table 1, the linked list structure formed by the trajectory data forms a linked list structure. In this linked list structure, the relative offset of the next trajectory data from the current trajectory data is specified by the frame content, thereby determining the storage location of the next trajectory data.

[0082] Table 1

[0083]

[0084] Table 2 shows the hierarchical structure of trajectory data. In addition to the frame header and footer, it also includes a frame description and data for each time point. The frame description records the number of time points and the location of the next trajectory data point. For example, a trajectory data set records 30 seconds of trajectory data (2024-05-20 00:00:00 to 00:00:30). The data at time point 1 records the trajectory data at 2024-05-20 00:00:00, and the data at time point 2 records the trajectory data at 2024-05-20 00:00:01.

[0085] Table 2

[0086]

[0087] The data structure of the time point data is shown in Table 3, which records the trajectory data of different targets at each time point. The trajectory data includes the trajectory area number, time, target identification, target entry flag, and target exit flag.

[0088] Table 3

[0089]

[0090] Through the trajectory data and data structure provided in this embodiment, a storage method of trajectory area numbers can be adopted. In this way, the trajectory data only records the corresponding trajectory area numbers, and there is no need to store the video data secondary. This can save hard disk space and increase the number of days of hard disk video storage. At the same time, retrieval based on the trajectory area numbers in the trajectory data can also improve the video retrieval speed.

[0091] In some embodiments, the method further comprises the following steps:

[0092] When a target is identified as entering and / or leaving the screen, a target event is reported, and the time information of the target event, the target identifier, and the target attributes of the target are stored as event data; when the target identifier of the corresponding target is retrieved from the trajectory data, the target attributes are retrieved from the event data based on the target identifier.

[0093] Specifically, during the frame-by-frame intelligent analysis of video data, when a structured event is identified, the target event is reported. For example, the target event could be the target entering and / or leaving the frame. Furthermore, the time information (e.g., the time the target enters and / or leaves the frame), target identification, and target attributes are stored as event data.

[0094] When the target identifier of the corresponding target is retrieved from the trajectory data based on the retrieval conditions of the trajectory area number and time information, the corresponding target attributes are further retrieved from the event data based on the target identifier and displayed synchronously when the relevant video data is played in the display window.

[0095] By reporting the target time and storing the event data in this embodiment, relevant information of the target can be provided when playing the video data, thereby improving the user experience.

[0096] In some embodiments, the method further comprises the following steps:

[0097] When playing the video data of each video source in the display window, the video area number and the target entry mark or the target exit mark in the video data are detected; when the track area number and the target entry mark are detected, the video data is played with the first playback configuration and the corresponding target attributes are displayed; when the track area number and the target exit mark are detected, or when the track area number is not detected, the video data is played with the second playback configuration; the first playback configuration includes: playing the video data at a first preset speed; the second playback configuration includes: playing the video data at a second preset speed, or skipping the video data; the first preset speed is less than the second preset speed.

[0098] Specifically, because the video data of each video source includes many invalid videos, such as videos without the target, when track area video retrieval is not performed, that is, when the user has not specified a track area of ​​interest, in order to improve the user experience and enable the user to locate the desired scene more quickly, two playback configurations can be provided to accommodate different video data.

[0099] When the video data of each video source is played in the display window, the track area number and the target entry mark or target exit mark inserted in the video data are synchronously detected according to the time period of the video data.

[0100] When a track area number and a target entry mark are detected, the video data is played in a first playback configuration and the corresponding target attributes of the target on the screen are displayed. When a track area number and a target exit mark are detected, or when no track area number is detected, the video data is played in a second playback configuration. The first playback configuration includes: playing the video data at a first preset speed; the second playback configuration includes: playing the video data at a second preset speed, or skipping the video data; the first preset speed is less than the second preset speed.

[0101] For example, when a target appears in the picture and there is a track area number, the video data is played at 1x speed, so that the user has sufficient time to track and observe the target; when the track area number is not detected, it means that there is no target in the picture, or the target is not in the track area divided by the user, so it can be played at multiple speeds, for example, the video data can be played at 4x speed or 8x speed, and the video data of this time period can be skipped to improve playback efficiency; when the target leaves the picture and there is a track area number, it means that there is a target in the picture but the target is about to leave the picture, and at this time it can be switched from 1x playback to multiple speed playback.

[0102] At the same time, users can also use the controls in the display window to start, pause, speed up, forward, and reverse when playing the video data.

[0103] By detecting the track area number and the target entry mark or the target exit mark in this embodiment, the playback configuration can be automatically switched, the playback time of some invalid videos can be reduced, and the playback speed can be improved.

[0104] The present embodiment is described and illustrated below through preferred embodiments.

[0105] Figure 3 This is a flow chart of the method for storing and displaying intelligent event video retrieval data in this embodiment. Figure 3 As shown, the method includes the following steps:

[0106] Step S301: obtaining video data of each video source; dividing the video data into different track areas in advance, and setting corresponding track area numbers.

[0107] Step S302 : identifying a target in a video frame of the video data, comparing the position where the target appears with the pre-divided track area, and determining the track area number corresponding to the target.

[0108] Step S303: insert the track area number and the target entry mark or target exit mark into the video frame where the target exists, and obtain and store track data based on the target identifier, time information, track area number, and target entry mark or target exit mark of the target.

[0109] Step S304: When it is recognized that a target enters and / or leaves the screen, a target event is reported, and time information of the target event, the target identifier, and the target attributes of the target are stored as event data.

[0110] Step S305 , based on the search conditions of the trajectory area number and time information, retrieve the target identifier of the corresponding target from the trajectory data; integrate and obtain the corresponding target video data based on the target identifier; and retrieve the target attribute from the event data based on the target identifier.

[0111] Step S306: Play the target video data corresponding to the target identifier in the display window and display the corresponding target attributes.

[0112] Step S307, when playing the video data of each video source in the display window, synchronously detect the track area number and the target entry mark or the target exit mark in the video data; when the track area number and the target entry mark are detected, play the video data in the first playback configuration and display the corresponding target attributes.

[0113] Step S308: When the track area number and the target leaving mark are detected, or when the track area number is not detected, the video data is played in the second playback configuration.

[0114] Figure 4 This is a flow chart of storing trajectory data and corresponding video data in this embodiment. Figure 4 As shown in the figure, after receiving the video data from the video source, the screen is divided into different track areas according to the rules. The intelligent server uses its own intelligent capabilities to perform intelligent frame-by-frame analysis on the video data of the video source to determine whether there is a target or target event in the video frame.

[0115] When a target is detected, its location is compared with a pre-set track area. If the target is within the track area, the corresponding track area number is inserted between video frames, indicating the target has entered the frame. If the target is within the frame, the corresponding track area number is inserted between video frames. If the target has left the frame, the corresponding track area number is inserted between video frames, indicating the target has left the frame. Finally, the track area number and other track data, along with the corresponding video data, are saved to the hard drive.

[0116] When a target event is identified, the information of the target event (such as time information, target identification, target attributes, etc.) is stored in the event database.

[0117] Figure 5 This is a flowchart of video playback in this embodiment. Figure 5 As shown, based on the user-entered search criteria, a decision is made as to whether to perform a track area video search. When performing a track area video search, the corresponding track data is found based on the user-set search criteria and the corresponding video is integrated based on the time of the track data recording. Furthermore, based on the information recorded in the track data (such as the target identifier), the corresponding target attributes are retrieved from the event data. Finally, the integrated video data is played in the client's display window, and the corresponding target attributes are displayed simultaneously.

[0118] When no track area recording retrieval is performed, the code stream frame is analyzed to see whether there is a track area number. When the target appears in the picture and the track area number exists, the recording data is played at 1x speed; when the target leaves the picture and the track area number exists, or when the track area number is not detected, multi-speed playback is performed.

[0119] It should be noted that the steps shown in the above process or the flowcharts in the accompanying drawings can be executed in a computer system, such as a set of computer-executable instructions, and although a logical order is shown in the flowcharts, in some cases, the steps shown or described can be executed in a different order than shown. For example, step S306 and step S307 are playback modes with and without trajectory data retrieval, respectively.

[0120] In this embodiment, a device for intelligent event video retrieval data storage and display is also provided. The device is used to implement the above-mentioned embodiments and preferred embodiments, and the details that have been described will not be repeated. The terms "module", "unit", "sub-unit", etc. used below can be a combination of software and / or hardware that implements the predetermined functions. Although the devices described in the following embodiments are preferably implemented in software, implementation by hardware, or a combination of software and hardware, is also possible and conceivable.

[0121] Figure 6 This is a block diagram of the structure of the device for storing and displaying intelligent event video retrieval data in this embodiment. Figure 6 As shown, the device includes:

[0122] The storage module 10 is used to obtain the video data of each video source, insert the track area number of the target's track area in the video frame where the target is identified, and obtain and store the track data based on the target identification, time information and track area number of the target;

[0123] The retrieval module 20 is used to retrieve the target identifier of the corresponding target from the trajectory data based on the retrieval conditions of the trajectory area number and time information; and to obtain the corresponding target video data based on the target identifier;

[0124] The display module 30 is used to play the target video data corresponding to the target identifier in the display window and display the corresponding target attributes.

[0125] Through the device provided in this embodiment, the target's trajectory area number can be inserted into the video frame where the target exists, and trajectory data can be formed for storage. During retrieval, the target video data of the required target can be quickly obtained and played based on the trajectory area number and time information, and invalid video data can be filtered out, thereby improving the video retrieval efficiency and reducing the size of the code stream data, thereby reducing the corresponding network bandwidth data during the transmission process.

[0126] In addition, the storage method of track area number is adopted, so that the track data only records the corresponding track area number, and there is no need to store the video data again, which can save hard disk space and increase the number of days of hard disk video storage. At the same time, retrieval based on the track area number in the track data can also improve the video retrieval speed.

[0127] It should be noted that the above modules can be functional modules or program modules, and can be implemented through software or hardware. For modules implemented through hardware, the above modules can be located in the same processor; or the above modules can be located in different processors in any combination.

[0128] This embodiment further provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

[0129] Optionally, the computer device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.

[0130] It should be noted that, for specific examples in this embodiment, reference may be made to the examples described in the above embodiments and optional implementation modes, and will not be repeated in this embodiment.

[0131] In addition, in conjunction with the intelligent event video recording, retrieval, data storage, and display methods provided in the above embodiments, this embodiment may also provide a storage medium for implementation. The storage medium stores a computer program; when executed by a processor, the computer program implements any of the intelligent event video recording, retrieval, data storage, and display methods provided in the above embodiments.

[0132] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties.

[0133] It should be understood that the specific embodiments described herein are only used to explain this application and are not used to limit it. Based on the embodiments provided in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0134] Obviously, the accompanying drawings are merely examples or embodiments of the present application. A person skilled in the art can also apply the present application to other similar situations based on these drawings without inventive effort. Furthermore, it is understandable that, although the work involved in this development process may be complex and lengthy, certain design, manufacturing, or production changes based on the technical content disclosed in this application are merely routine technical means for a person skilled in the art and should not be considered to constitute a deficiency in the disclosure of the present application.

[0135] The term "embodiment" as used in this application refers to specific features, structures, or characteristics described in conjunction with the embodiment that can be included in at least one embodiment of this application. The appearance of this phrase in various places in the specification does not necessarily mean the same embodiment, nor does it mean that it is mutually exclusive with other embodiments and is independent or optional. It is understood, either explicitly or implicitly, by those skilled in the art that the embodiments described in this application can be combined with other embodiments when there is no conflict.

[0136] The above-described embodiments merely represent several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of patent protection. It should be noted that a person of ordinary skill in the art may make various modifications and improvements without departing from the spirit of the present application, and these modifications and improvements fall within the scope of protection of the present application. Therefore, the scope of protection of the present application shall be determined by the appended claims.

Claims

1. A method for storing and displaying intelligent event video retrieval data, characterized in that: include: Acquire video data from each video source, and insert a track area number of a track area where the target appears into a video frame where the target is identified; wherein the video data is pre-divided into different track areas, and corresponding track area numbers are assigned; the track areas adopt a multi-level structure, and the track area numbers are multi-level numbers corresponding to the multi-level structure of the track areas; Obtaining and storing trajectory data according to the target identification, time information, and trajectory area number of the target; Based on the search conditions of the trajectory area number and time information, a target identifier of the corresponding target is retrieved from the trajectory data; and corresponding target video data is obtained based on the target identifier. The target video data corresponding to the target identifier is played in the display window, and the corresponding target attributes are displayed.

2. The method for storing and displaying intelligent event video retrieval data according to claim 1, characterized in that: The step of inserting the track area number of the track area where the target appears into the video frame where the target is identified includes: Identifying a video frame containing a target in the video data; The position where the target appears is compared with the pre-divided track area, the track area number corresponding to the target is determined, and the track area number is inserted into the video frame.

3. The method for storing and displaying intelligent event video retrieval data according to claim 2, characterized in that: The method further comprises: Inserting a target entry mark into the video frame in which the target is identified to have entered the picture; Inserting a target leaving mark into the video frame where it is recognized that the target has left the screen.

4. The method for storing and displaying intelligent event video retrieval data according to claim 1, characterized in that: The trajectory data includes frame description information and trajectory area numbers, target identifiers, target entry flags or target exit flags of different targets in each time information.

5. The method for storing and displaying intelligent event video retrieval data according to claim 1, characterized in that: The method further comprises: When the target is identified to enter the screen and / or leave the screen, a target event is reported, and time information of the target event and the target identifier and target attributes of the target are stored as event data; When the target identifier of the corresponding target is retrieved from the trajectory data, the target attribute is retrieved from the event data based on the target identifier.

6. The method for storing and displaying intelligent event video retrieval data according to claim 1, characterized in that: The method further comprises: When playing the video data of each video source in the display window, synchronously detecting the track area number and the target entry mark or the target exit mark in the video data; When the track area number and the target entry mark are detected, the video data is played in a first playback configuration and corresponding target attributes are displayed; When the track area number and the target leaving mark are detected, or when the track area number is not detected, playing the video data in a second playback configuration; The first playback configuration includes: playing the video data at a first preset speed; the second playback configuration includes: playing the video data at a second preset speed, or skipping the video data; the first preset speed is smaller than the second preset speed.

7. An intelligent event video retrieval data storage and display device, characterized in that: include: A storage module is configured to obtain recording data from each video source, insert a track area number of a track area where a target appears in a video frame in which the target is identified, obtain track data based on the target identifier, time information, and track area number, and store the track data; wherein the recording data is pre-divided into different track areas and corresponding track area numbers are assigned; the track areas adopt a multi-level structure, and the track area numbers are multi-level numbers corresponding to the multi-level structure of the track areas; A retrieval module, configured to retrieve a target identifier of a corresponding target from the trajectory data based on a retrieval condition of the trajectory area number and time information; and to integrate the target video data corresponding to the target based on the target identifier; The display module is used to play the target video data corresponding to the target identifier in a display window and display corresponding target attributes.

8. A computer device comprising a memory and a processor, characterized in that: The memory stores a computer program, and the processor is configured to run the computer program to execute the method for storing and displaying intelligent event video recording retrieval data according to any one of claims 1 to 6.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method for storing and displaying intelligent event video recording retrieval data are implemented as described in any one of claims 1 to 6.

Images