Video playback method and system for monitoring device
By statically and dynamically dividing the camera data in the video playback system of the surveillance device, and comparing the initial picture and the monitoring picture, intelligently extracting and visualizing abnormal events, the problem of the inability to intelligently extract abnormal events in the existing technology is solved, and the user experience of video playback is improved.
Patent Information
- Application Number
- PCT/CN2024/092989
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-09-21
- Filing Date
- 2024-05-14
- Publication Date
- 2025-03-27
AI Technical Summary
Existing video playback solutions of monitoring equipment cannot intelligently extract abnormal events in video data, and usually require manual viewing of monitoring video frame by frame to extract abnormal events.
By obtaining the initial picture of the camera at different rotation angles, dividing static and dynamic data, dividing time points according to the camera environment and the probability of abnormal events, comparing the initial picture and monitoring picture, intelligently extracting and visualizing abnormal events.
It realizes intelligent extraction and visual display of abnormal events in surveillance videos, improves the user experience of video playback function, and reduces the time and energy of manual analysis.
Smart Images

Figure CN2024092989_27032025_PF_FP_ABST
Abstract
Description
Video playback method and system for monitoring equipment Technical Field
[0001] The present invention relates to the field of video playback of monitoring equipment, and in particular to a video playback method and system of monitoring equipment. Background Art
[0002] Surveillance equipment is a type of technical equipment used to monitor, record, and protect a specific area or target. They are typically used in security, monitoring, and management applications, and can be used to protect property, provide real-time information and warnings, and support emergency response.
[0003] Surveillance device video playback refers to the process of playing back recorded or stored video data through a surveillance device. Surveillance devices, such as cameras, security cameras, and closed-circuit television (CCTV) systems, monitor and record video information from a specific area or location. Video playback allows users to review previously recorded video on demand for analysis, investigation, or evidence collection related to accidents, security incidents, and intrusions. Through video playback, users can select specific time periods based on a timeline or other search criteria and use playback controls (such as pause, fast forward, slow play, and reverse) to analyze or locate content of interest in greater detail.
[0004] Existing video playback solutions can only view video data and cannot intelligently extract abnormal events from video data. It is often necessary to manually watch the surveillance video frame by frame to extract abnormal events.
[0005] Summary of the Invention
[0006] In view of this, the present invention proposes a video playback method and system for a monitoring device, the specific scheme of which is as follows:
[0007] In the first part, the present invention proposes a video playback method for a monitoring device, the method comprising:
[0008] Obtaining a data list recording videos shot by a preset camera at various time periods, selecting a playback time period from the data list and defining the data of the playback time period as monitoring data;
[0009] Pre-acquiring monitoring images of the camera at different rotation angles to obtain initial images, and dividing static data captured when the camera is stationary from the monitoring data according to the rotation of the camera;
[0010] Classifying the static data according to the rotation angle of the camera to obtain at least one group of sub-static data, so that each group of sub-static data is captured by the camera at the same rotation angle;
[0011] Dividing each set of sub-static data into multiple first time points based on the environment in which the camera is located and the probability of an abnormal event occurring during the playback period, so that the first time point in each set of sub-static data corresponds to the same rotation angle and one monitoring screen in the sub-static data;
[0012] Compare the monitoring images at each first time point with the initial images at the corresponding rotation angle to see if there are any differences, and include the first time points and their monitoring images with differences into the abnormal point set;
[0013] The data in the abnormal point set are classified according to the differences to obtain one or more abnormal events, and when the monitoring data is played back, the abnormal events occurring in the playback period are visually displayed.
[0014] In a specific embodiment, it also includes:
[0015] According to the rotation of the camera, dynamic data captured when the camera rotates is divided from the monitoring data;
[0016] Dividing the dynamic data into a plurality of second time points according to the rotation of the camera during the process of capturing the dynamic data, so that each second time point corresponds to a rotation angle of the camera and a monitoring screen in the dynamic data;
[0017] Compare the monitoring images at each second time point with the initial images at the corresponding rotation angle to see if there are any differences, and include the second time points and their monitoring images with differences into the abnormal point set.
[0018] In a specific embodiment, when there is only one abnormal event within the playback period, a monitoring screen is selected from the abnormal event as an event picture based on a preset rule, so that the user can play the monitoring screen of the abnormal event by clicking on the event picture;
[0019] When there are multiple abnormal events within the playback period, they are displayed in the form of a group.
[0020] Furthermore, the visualization shows that the abnormal events that occurred during the playback period include:
[0021] Pre-built display screens that can compare monitoring data and abnormal events;
[0022] In the display screen, a first progress bar is constructed in advance according to the duration of the monitoring data, and the first progress bar is used as a dividing line, so that one side of the first progress bar displays the monitoring data, and the other side displays the abnormal event and related information. The time when the abnormal event occurs is presented in the form of a rectangular mark in the first progress bar, so that the user can intuitively view the abnormal event when viewing the monitoring data.
[0023] Specifically, the first progress bar includes a time progress view, an event entry container list, and an interface for displaying progress time;
[0024] The time progress view dynamically draws a progress bar according to the duration of the monitoring data;
[0025] Enable the event entry container to list abnormal events and related information;
[0026] The progress time display interface displays the current time progress in text form;
[0027] The start time and end time of each abnormal event are converted to obtain the length of the rectangle, and the width of the first progress bar is used as the width of the rectangle. The rectangle is drawn and marked.
[0028] In a specific embodiment, when playing back monitoring data, if there is a time point without monitoring images within the playback period, the current playback time point is calculated based on the sliding offset of the progress bar;
[0029] If there is a monitoring screen at the current playback time point, read the current monitoring screen;
[0030] If there is no monitoring picture at the current playback time point, read the monitoring picture at the next playback time point;
[0031] If there is no monitoring screen at the current playback time point and there is no next playback time point, "No data" will be displayed on the playback page.
[0032] In a specific embodiment, when constructing the data list, a buffer area is created for recording the timestamp of the monitoring data;
[0033] Whenever a new timestamp is received, first check whether the same timestamp already exists in the buffer;
[0034] If duplication occurs, correction is performed; if no duplication occurs, the video clips to be downloaded can be cached in the data list.
[0035] In the second part, the present invention proposes a video playback system for a monitoring device, the video playback system for the monitoring device comprising:
[0036] The video playback management component obtains a data list recording videos shot by a preset camera at various time periods, selects a pre-playback period from the data list, and defines the data of the playback period as monitoring data;
[0037] A key frame extraction component is used to obtain the monitoring images of the camera at different rotation angles in advance to obtain an initial image, and to separate static data captured when the camera is stationary from the monitoring data according to the rotation of the camera;
[0038] a static data classification component, classifying the static data according to the rotation angle of the camera to obtain at least one group of sub-static data, so that each group of sub-static data is captured by the camera at the same rotation angle;
[0039] a static data management component that divides each set of sub-static data into multiple first time points based on the camera environment and the probability of an abnormal event occurring during the playback period, so that the first time point in each set of sub-static data corresponds to the same rotation angle and one monitoring screen in the sub-static data;
[0040] The static abnormal event detection component compares the monitoring images at each first time point with the initial images at the corresponding rotation angle to see if there are any differences, and includes the first time points and their monitoring images with differences into the abnormal point set;
[0041] The abnormal event classification component classifies the data in the abnormal point set according to the differences to obtain one or more abnormal events, and when replaying the monitoring data, visually displays the abnormal events that occurred in the playback period.
[0042] In a specific embodiment, it also includes:
[0043] a dynamic data classification component for classifying the dynamic data captured by the camera when the camera rotates from the monitoring data according to the rotation of the camera;
[0044] a dynamic data management component, which divides the dynamic data into a plurality of second time points according to the rotation of the camera during the process of capturing the dynamic data, so that each second time point corresponds to a rotation angle of the camera and a monitoring screen in the dynamic data;
[0045] The dynamic abnormal event detection component compares whether there are differences between the monitoring images at each second time point and the initial images at the corresponding rotation angle, and includes the second time points and their monitoring images with differences into the abnormal point set.
[0046] In a specific embodiment, it also includes:
[0047] Pre-built display screens that can compare monitoring data and abnormal events;
[0048] In the display screen, a first progress bar is constructed in advance according to the duration of the monitoring data, and the first progress bar is used as a dividing line, so that one side of the first progress bar displays the monitoring data, and the other side displays the abnormal event and related information. The time when the abnormal event occurs is presented in the form of a rectangular mark in the first progress bar, so that the user can intuitively view the abnormal event when viewing the monitoring data. Beneficial effects:
[0049] The present invention provides a video playback method and system for monitoring equipment. The present invention compares the initial images of the camera when it is still and in motion with the monitoring images, intelligently extracts abnormal events and displays them visually, allowing users to intuitively view abnormal events and related information in the playback video, thereby improving the user experience of the video playback function. BRIEF DESCRIPTION OF THE DRAWINGS
[0050] 1 is a flow chart of a video playback method of a monitoring device according to an embodiment of the present invention;
[0051] FIG2 is a flowchart illustrating a technical solution implementation of an embodiment of the present invention;
[0052] 3 is a schematic diagram of a video playback system module of a monitoring device according to an embodiment of the present invention;
[0053] FIG4 is a schematic diagram of a video playback interface according to an embodiment of the present invention.
[0054] Figure numbers: 1-video playback management component; 2-key frame extraction component; 3-static data classification component; 4-static data management component; 5-static abnormal event detection component; 6-abnormal event classification component; 7-dynamic data classification component; 8-dynamic data management component; 9-dynamic abnormal event detection component. DETAILED DESCRIPTION
[0055] Hereinafter, various embodiments of the present disclosure will be described more fully. The present disclosure may have various embodiments, and modifications and variations may be made therein. However, it should be understood that there is no intention to limit the various embodiments of the present disclosure to the specific embodiments disclosed herein, but rather that the present disclosure should be construed to encompass all modifications, equivalents, and / or alternatives falling within the spirit and scope of the various embodiments of the present disclosure.
[0056] The terms used in the various embodiments disclosed in the present invention are only used to describe the purpose of specific embodiments and are not intended to limit the various embodiments disclosed in the present invention. As used herein, the singular form is intended to also include the plural form, unless the context clearly indicates otherwise. Unless otherwise specified, all terms used herein (including technical terms and scientific terms) have the same meaning as those generally understood by those skilled in the art of the various embodiments disclosed in the present invention. The terms (such as those defined in generally used dictionaries) will be interpreted as having the same meaning as the contextual meaning in the relevant technical field and will not be interpreted as having an idealized meaning or an overly formal meaning, unless clearly specified in the various embodiments disclosed in the present invention.
[0057] Example 1
[0058] Embodiment 1 of the present invention discloses a video playback method for a monitoring device. By visually displaying abnormal events in the monitoring image using a progress bar, users can slide the progress bar to intuitively view abnormal events in the playback information and quickly locate the playback location, thus providing a user-friendly experience for the video playback function. Video filtering rules are added to automatically play to the next most recent segment, and a timestamp duplication detection mechanism is included, achieving a user-friendly experience of continuous video playback without duplicate frames. The specific process is shown in Figures 1 and 2 of the specification. The specific solution is as follows:
[0059] A video playback method for a monitoring device, as shown in Figure 1 of the specification, includes:
[0060] 101. Obtain a data list recording videos shot by a preset camera at various time periods, select a playback time period from the data list, and define the data of the playback time period as monitoring data;
[0061] 102. Pre-acquire monitoring images of the camera at different rotation angles to obtain initial images, and divide the static data captured by the camera when it is stationary from the monitoring data according to the rotation of the camera;
[0062] 103. Classify the static data according to the rotation angle of the camera to obtain at least one group of sub-static data, so that each group of sub-static data is captured by the camera at the same rotation angle;
[0063] 104. Based on the camera environment and the probability of abnormal events occurring during the playback period, each set of sub-static data is divided into multiple first time points, so that the first time point in each set of sub-static data corresponds to the same rotation angle and one monitoring screen in the sub-static data;
[0064] 105. Compare the monitoring images at each first time point with the initial images at the corresponding rotation angle to see if there are any differences, and include the first time points and their monitoring images with differences into the abnormal point set.
[0065] 106. Classify the data in the abnormal point set according to the differences to obtain one or more abnormal events, and when replaying the monitoring data, visualize the abnormal events that occurred during the playback period.
[0066] The video playback method for monitoring equipment in this embodiment is applicable to a variety of scenarios, including but not limited to security monitoring, traffic monitoring, production monitoring, or fire monitoring. For example, the video playback method of this embodiment can be applied to traffic monitoring systems in transportation facilities such as roads, bridges, or tunnels to monitor, investigate, and handle traffic accidents and illegal activities.
[0067] 101. Obtain a data list recording videos captured by a preset camera during various time periods, select a pre-playback period from the data list, and define the data for the playback period as monitoring data. The data list contains all surveillance images of the camera during different time periods, and a predetermined playback period can be selected as needed. The selected playback period will be included in the total monitoring data and can be defined and processed as needed. When defining the data for a playback period as monitoring data, certain parameters or labels can be set for the period. For example, the start time, end time, camera number, or location information can be used. By defining these parameters, the scope of the playback period can be more accurately determined and distinguished from data from other time periods.
[0068] 102. Pre-acquire monitoring images of the camera at different rotation angles to obtain initial images, and divide the static data captured by the camera when it is stationary from the monitoring data based on the rotation of the camera. Static data refers to monitoring images captured by the camera when it is stationary. In the process of pre-acquiring monitoring images, the camera can be rotated at different angles and the monitoring images at each angle can be recorded to obtain as many initial images as possible, which can provide more viewing angles in the subsequent monitoring process. When the camera starts running and performs actual monitoring, the rotation of the camera can be monitored. By analyzing the data on the camera rotation, it can be determined which time periods the camera is stationary, that is, not rotating. These stationary time periods can be regarded as time periods when the camera captures static data.
[0069] 103. The static data is classified according to the rotation angle of the camera to obtain at least one group of sub-static data, so that each group of sub-static data is taken by the camera at the same rotation angle. In practical applications, the static data can be grouped into multiple subsets according to the different rotation angles of the camera. Specifically, for each rotation angle, all static data taken at this angle are selected and classified into an independent sub-static data group. Finally, multiple sub-static data groups can be obtained, each of which represents the data taken by the camera at the same rotation angle. Through this classification method, each group of sub-static data can be processed and analyzed independently more conveniently. For example, specific target detection, behavior analysis, or scene analysis tasks can be performed for each group according to different rotation angles.
[0070] 104. Based on the environment in which the camera is located and the probability of abnormal events occurring during the playback period, multiple first time points are divided for each group of sub-static data, so that the first time point under each group of sub-static data corresponds to the same rotation angle and a monitoring screen in the sub-static data. Specifically, multiple first time points can be selected for each group of sub-static data based on the characteristics of the environment in which the camera is located and the known probability of abnormal events. These time points represent the judgment moments when abnormal events may occur during the playback period. When dividing the first time points, different factors can be weighed according to the probability of abnormal events occurring. For example, if the probability of abnormal events under the rotation angle corresponding to a certain sub-static data group is high, we can select more first time points to increase the possibility of capturing abnormal events.
[0071] 105. Compare the surveillance footage at each first time point with the initial footage at the corresponding rotation angle to determine if there are any differences, and include the first time points and their surveillance footage with any differences in the anomaly point set. When performing image comparison and difference calculation, various image features and visual information can be comprehensively considered to obtain a more comprehensive difference assessment. These features can include aspects such as color, texture, shape, structure, and motion. In addition to simple image comparison, machine learning or deep learning methods can be used to automatically learn the differences between the surveillance footage and the initial footage. By training a model, a difference evaluator can be established based on existing abnormal and normal samples to determine whether a new first time point is an anomaly. After including the first time points and their surveillance footage with any differences in the anomaly point set, the anomaly point set can be further analyzed and processed. For example, spatiotemporal correlation analysis of abnormal events can be performed to determine the occurrence pattern and propagation path of abnormal events.
[0072] 106. Classify the data in the abnormal point set according to the differences to obtain one or more abnormal events, and when replaying the monitoring data, visualize the abnormal events that occurred during the playback period.
[0073] Specifically, the visualization shows that abnormal events that occurred during the playback period include:
[0074] Pre-built display screens that can compare monitoring data and abnormal events;
[0075] In the display screen, a first progress bar is constructed in advance according to the duration of the monitoring data, and the first progress bar is used as a dividing line, so that one side of the first progress bar displays the monitoring data, and the other side displays the abnormal event and related information. The time when the abnormal event occurs is presented in the form of a rectangular mark in the first progress bar, so that the user can intuitively view the abnormal event when viewing the monitoring data, as shown in Figure 4.
[0076] In a specific embodiment, a Flutter ScrollView can be used to implement a vertical display of an event progress bar. In actual applications, the progress bar display scheme can be set to display upward or downward as needed. When data is available, the progress bar display scheme of this embodiment adopts downward display, and a space is reserved on the right for displaying the event picture and event count statistics of the day. Specifically, when there is only one abnormal event during the playback period, a monitoring screen is selected from the abnormal event based on the preset rules as the event picture, so that the user can play the monitoring screen of the abnormal event by clicking the event picture; when there are multiple abnormal events during the playback period, they are displayed in the form of a group. The preset rule is to select the event picture according to the main characteristics of the abnormal event. For example, if the abnormal event is a traffic accident, the picture of the traffic accident is used as the event picture of the abnormal event.
[0077] In a specific embodiment, when there is only one event in a certain time period, the user can play the video of the related event by clicking the event picture; if there are many video events in a certain time period, they will be displayed as a count, and a list will be displayed when the user clicks, and the user is supported to click on the related event to play.
[0078] Furthermore, the first progress bar includes a time progress view, an event entry container list and a progress time display interface; the time progress view dynamically draws a progress bar according to the duration of the monitoring data; the event entry container list displays abnormal events and related information; the progress time display interface displays the current time progress in text form; the start time and end time of each abnormal event are converted to obtain the length of the rectangle, and the width of the first progress bar is used as the width of the rectangle, and the rectangle is drawn and marked.
[0079] Exemplarily, a combined view component is created, including a vertical sliding ScrollView and a TimeProgressView defined by CustomPainter, an event entry Container list, and a progress time display Container. From the above video data list, the video data is traversed to obtain the startTime and endTime of each segment and convert them into hours, minutes, and seconds through the time tool, and then the data in milliseconds is calculated. A specific value of msStep (step length per millisecond) is defined, and a rectangle is drawn with a width of endTime*msStep-startTime*msStep, and the rectangle is colored.
[0080] Taking into account that in actual applications, the camera may rotate, and for the dynamic situation of the camera, the dynamic data captured when the camera rotates is divided from the monitoring data according to the rotation situation of the camera;
[0081] Dividing the dynamic data into a plurality of second time points according to the rotation of the camera during the process of capturing the dynamic data, so that each second time point corresponds to a rotation angle of the camera and a monitoring screen in the dynamic data;
[0082] Compare the monitoring images at each second time point with the initial images at the corresponding rotation angle to see if there are any differences, and include the second time points and their monitoring images with differences into the abnormal point set.
[0083] When replaying monitoring data, if there is a time point without monitoring images within the playback period, the current playback time point is calculated based on the sliding offset of the progress bar;
[0084] If there is a monitoring screen at the current playback time point, read the current monitoring screen;
[0085] If there is no monitoring picture at the current playback time point, read the monitoring picture at the next playback time point;
[0086] If there is no monitoring screen at the current playback time point and there is no next playback time point, "No data" will be displayed on the playback page.
[0087] For example, when sliding the progress bar, the sliding offset is obtained through the ScrollView controller, and the offset is converted to the current playback time point in milliseconds using the formula offset / msStep (offset / millisecond step). Based on the above playback time points, the video data list is polled. If there is no data at the playback time point, the next most recent playback time point is detected; if there is data at the playback time point, the current fragment data is read; if there is no data at the playback time point and there is no next most recent playback time point, Not Record is displayed on the playback page.
[0088] Furthermore, when constructing the data list, a buffer area is created for recording the timestamp of the monitoring data;
[0089] Whenever a new timestamp is received, first check whether the same timestamp already exists in the buffer;
[0090] If duplication occurs, correction is performed; if no duplication occurs, the video clips to be downloaded can be cached in the data list.
[0091] For example, the playback segment data is obtained from the above, the index / i-index interface is called to obtain the m3u8 data, and the ts data is parsed. The parsing process is as follows:
[0092] 1. EXTM3U header detection: Determine whether the data contains #EXTM3U content. If yes, proceed to the next step. If not, skip.
[0093] 2. ts list splitting: perform slip splitting operation according to the \n line break in the content, and get a string list;
[0094] 3. TS information format detection: If the header information contains #EXTINF: content, it is in TS format. Then the content is further split according to "," characters to obtain a TS format character list. Then determine whether the list length is 3. If so, proceed to the next step, otherwise skip this step.
[0095] 4. Read ts data: read the ts format character list, subscript 0 is the ts time length, subscript 1 is the file name, and subscript 2 is the ts video timestamp.
[0096] 5. Finally, define an m3u8Entities queue. The list data type is M3U8Entity, which contains time, name, timestamp, filePath, and tsUrl data information. This queue is used to cache the ts segment information to be downloaded. When the ts has been downloaded and sent to the bottom layer through instructions, the M3U8Entity entry needs to be removed from the queue. At this time, the next M3U8Entity in m3u8Entities is read and downloaded and sent.
[0097] Saving data to the m3u8Entities queue requires adding a timestamp duplication detection mechanism: define a loadedCache queue to cache the timestamps that have been saved in the m3u8Entities queue, and determine if there is no duplicate time before adding m3u8Entities.
[0098] This embodiment proposes a video playback method for a monitoring device. By comparing the initial images of the camera when it is still and in motion with the monitoring images, abnormal events are intelligently extracted and visualized. This allows users to intuitively view abnormal events and related information in the playback video, thereby improving the user experience of the video playback function.
[0099] Example 2
[0100] Embodiment 2 of the present invention discloses a video playback system for a monitoring device. This systematizes the video playback method for a monitoring device in Embodiment 1, making it more practical. The overall structure of the video playback system for a monitoring device is shown in Figure 3 of the specification. The specific scheme is as follows:
[0101] A video playback system for monitoring equipment, the system comprising:
[0102] The video playback management component 1 obtains a data list recording videos shot by a preset camera at various time periods, selects a pre-playback period from the data list, and defines the data of the playback period as monitoring data;
[0103] A key frame extraction component 2 pre-acquires monitoring images of the camera at different rotation angles to obtain an initial image, and divides the static data captured by the camera when it is stationary from the monitoring data according to the rotation of the camera;
[0104] A static data classification component 3 classifies the static data according to the rotation angle of the camera to obtain at least one group of sub-static data, so that each group of sub-static data is captured by the camera at the same rotation angle;
[0105] The static data management component 4 divides each set of sub-static data into multiple first time points based on the environment of the camera and the probability of abnormal events occurring during the playback period, so that the first time point of each set of sub-static data corresponds to the same rotation angle and one monitoring screen in the sub-static data;
[0106] The static abnormal event detection component 5 compares the monitoring images at each first time point with the initial images at the corresponding rotation angle to see if there are any differences, and includes the first time points and their monitoring images with differences into the abnormal point set;
[0107] The abnormal event classification component 6 classifies the data in the abnormal point set according to the differences to obtain one or more abnormal events, and visually displays the abnormal events that occur within the playback period when replaying the monitoring data.
[0108] In a specific embodiment, it also includes:
[0109] A dynamic data classification component 7, which classifies the dynamic data captured by the camera when the camera rotates from the monitoring data according to the rotation of the camera;
[0110] a dynamic data management component 8, which divides the dynamic data into a plurality of second time points according to the rotation of the camera during the process of capturing the dynamic data, so that each second time point corresponds to a rotation angle of the camera and a monitoring screen in the dynamic data;
[0111] The dynamic abnormal event detection component 9 compares whether there are differences between the monitoring images at each second time point and the initial images at the corresponding rotation angles, and includes the second time points and monitoring images with differences into the abnormal point set.
[0112] In a specific embodiment, it also includes:
[0113] Pre-built display screens that can compare monitoring data and abnormal events;
[0114] In the display screen, a first progress bar is constructed in advance according to the duration of the monitoring data, and the first progress bar is used as a dividing line, so that one side of the first progress bar displays the monitoring data, and the other side displays the abnormal event and related information. The time when the abnormal event occurs is presented in the form of a rectangular mark in the first progress bar, so that the user can intuitively view the abnormal event when viewing the monitoring data.
[0115] This embodiment proposes a video playback system for a monitoring device, which systematizes the video playback method for the monitoring device in Embodiment 1 to make it more practical.
Claims
1. A video playback method for a monitoring device, characterized in that: These include: Obtaining a data list recording videos shot by a preset camera at various time periods, selecting a playback time period from the data list and defining the data of the playback time period as monitoring data; Acquire monitoring images of the camera at different rotation angles in advance to obtain an initial image, and divide static data captured when the camera is stationary from the monitoring data according to the rotation of the camera; Classifying the static data according to the rotation angle of the camera to obtain at least one group of sub-static data, so that each group of sub-static data is taken by the camera at the same rotation angle; Based on the environment where the camera is located and the probability of abnormal events occurring during the playback period, each group of sub-static data is divided into multiple first time points, so that the first time point under each group of sub-static data corresponds to the same rotation angle and a monitoring screen in the sub-static data; Compare the monitoring images at each first time point with the initial images at the corresponding rotation angle to see if there are any differences, and include the first time points and their monitoring images with differences into the abnormal point set; The data in the abnormal point set are classified according to the differences to obtain one or more abnormal events, and when the monitoring data is played back, the abnormal events occurring in the playback period are visually displayed.
2. The video playback method of a monitoring device according to claim 1, characterized in that: Also includes: According to the rotation of the camera, the dynamic data captured when the camera rotates is divided from the monitoring data; Divide the dynamic data into a plurality of second time points according to the rotation of the camera during the process of shooting the dynamic data, so that each second time point corresponds to a rotation angle of the camera and a monitoring screen in the dynamic data; Compare whether there are differences between the monitoring images at each second time point and the initial images at the corresponding rotation angle, and include the second time points and monitoring images with differences into the abnormal point set.
3. The video playback method of a monitoring device according to claim 1, characterized in that: When there is only one abnormal event in the playback period, a monitoring screen is selected from the abnormal event as the event picture based on a preset rule, so that the user can play the monitoring screen of the abnormal event by clicking the event picture; When there are multiple abnormal events within the playback period, they are displayed in the form of a group.
4. The video playback method of a monitoring device according to claim 1, characterized in that: The visualization shows that the abnormal events that occurred during the playback period include: Pre-built display screens that can compare monitoring data and abnormal events; In the display screen, a first progress bar is constructed in advance according to the duration of the monitoring data, and the first progress bar is used as a dividing line, so that one side of the first progress bar displays the monitoring data, and the other side displays the abnormal event and related information. The time when the abnormal event occurs is presented in the first progress bar in the form of a rectangular annotation, so that the user can intuitively view the abnormal event when viewing the monitoring data.
5. The video playback method of a monitoring device according to claim 4, characterized in that: The first progress bar includes a time progress view, an event entry container list and an interface for displaying progress time; Enable the time progress view to dynamically draw a progress bar according to the duration of the monitoring data; Enable the event entry container to list abnormal events and related information; The progress display interface displays the current time progress in text form; The length of the rectangle is obtained by converting the start time and the end time of each abnormal event, and the width of the first progress bar is used as the width of the rectangle. The rectangle is drawn and marked.
6. The video playback method of a monitoring device according to claim 4, characterized in that: When playing back the monitoring data, if there is a time point without monitoring images during the playback period, the current playback time point is calculated based on the sliding offset of the progress bar; If there is a monitoring screen at the current playback time point, read the current monitoring screen; If there is no monitoring picture at the current playback time point, read the monitoring picture at the next playback time point; If there is no monitoring screen at the current playback time point and there is no next playback time point, "No data" will be displayed on the playback page.
7. The video playback method of a monitoring device according to claim 1, characterized in that: When constructing the data list, a buffer area is created for recording the timestamp of the monitoring data; Whenever a new timestamp is received, first check whether the same timestamp already exists in the buffer; If duplication occurs, correction is performed; if no duplication occurs, the video clips to be downloaded can be cached in the data list.
8. A video playback system for monitoring equipment, characterized in that: The system includes: The video playback management component obtains a data list recording videos shot by a preset camera at various time periods, selects a pre-playback time period from the data list, and defines the data of the playback time period as monitoring data; A key frame extraction component is used to obtain the monitoring images of the camera at different rotation angles in advance to obtain an initial image, and to divide the static data taken when the camera is stationary from the monitoring data according to the rotation of the camera; A static data classification component is used to classify the static data according to the rotation angle of the camera. The class obtains at least one set of sub-static data, so that each set of sub-static data is taken by the camera at the same rotation angle; The static data management component divides each group of sub-static data into a plurality of first time points based on the environment of the camera and the probability of abnormal events occurring during the playback period, so that the first time point under each group of sub-static data corresponds to the same rotation angle and a monitoring screen in the sub-static data; The static abnormal event detection component compares the monitoring images at each first time point with the initial images at the corresponding rotation angle to see if there are any differences, and includes the first time points and their monitoring images with differences into the abnormal point set; The abnormal event classification component classifies the data in the abnormal point set according to the difference to obtain one or more abnormal events, and when playing back the monitoring data, visually displays the abnormal events that occurred in the playback period.
9. The video playback system of a monitoring device according to claim 8, characterized in that: Also includes: A dynamic data classification component, which classifies the dynamic data captured when the camera rotates from the monitoring data according to the rotation of the camera; A dynamic data management component, which divides the dynamic data into a plurality of second time points according to the rotation of the camera during the process of shooting the dynamic data, so that each second time point corresponds to a rotation angle of the camera and a monitoring screen in the dynamic data; The dynamic abnormal event detection component compares whether there are differences between the monitoring images at each second time point and the initial images at the corresponding rotation angle, and includes the second time points and their monitoring images with differences into the abnormal point set.
10. The video playback system of a monitoring device according to claim 9, characterized in that: Also includes: Pre-built display screens that can compare monitoring data and abnormal events; In the display screen, a first progress bar is constructed in advance according to the duration of the monitoring data, and the first progress bar is used as a dividing line, so that one side of the first progress bar displays the monitoring data, and the other side displays the abnormal event and related information. The time when the abnormal event occurs is presented in the first progress bar in the form of a rectangular annotation, so that the user can intuitively view the abnormal event when viewing the monitoring data.
Citation Information
Patent Citations
Intelligent video monitoring method and system capable of exploring abnormal events
CN102164270A
Video viewing method and device for video monitoring system
CN105227930A
An intelligent building video monitoring alarm system
CN107123242A
Intelligent video monitoring method and system thereof
CN109389794A
Video playback method and system of monitoring equipment
CN116962650A