Operation and maintenance audit video storage and playback method, medium, equipment and product

Abstract

The invention relates to the technical field of video processing, and particularly provides an operation and maintenance audit video storage and playback method, a medium, equipment and a product, and the method can comprise the steps: obtaining a visual feature value corresponding to any one pixel block in a plurality of pixel blocks in an operation and maintenance video frame; marking reference information of any pixel block in an index file of an index database under the condition of confirming that the visual feature value exists in the index database; and under the condition of confirming that the visual characteristic value does not exist in the index database, storing the pixel data corresponding to the any pixel block to a video data file, and updating the corresponding relationship between the visual characteristic value and the any pixel block to the index database. The storage efficiency of the operation and maintenance video can be improved.

Description

Technical Field

[0001] This application relates to the field of video processing technology, and more specifically, to a method, medium, device, and product for storing and playing back operation and maintenance audit videos. Background Technology

[0002] With the widespread adoption of enterprise informatization and remote operation and maintenance, remote desktop protocol (such as RDP and VNC) operation and maintenance systems have become the primary means of daily operation and maintenance. To ensure the security and traceability of operation and maintenance, many enterprises need to conduct complete video recording and auditing of the operation and maintenance process.

[0003] Currently, compression is commonly used when storing large amounts of video data generated by remote operations and maintenance. However, even with efficient compression, text-intensive operations still generate a large amount of redundant data, resulting in low storage efficiency and high storage costs.

[0004] Therefore, how to provide a technical solution for a highly efficient method of storing operation and maintenance audit videos has become a technical problem that needs to be solved. Summary of the Invention

[0005] The purpose of some embodiments of this application is to provide a method, medium, device and product for storing and playing back operation and maintenance audit videos. The technical solutions of the embodiments of this application can improve the storage efficiency of operation and maintenance videos and reduce storage costs.

[0006] In a first aspect, some embodiments of this application provide a method for storing operation and maintenance audit videos, including: obtaining a visual feature value corresponding to any pixel block among multiple pixel blocks in an operation and maintenance video frame; if it is confirmed that the visual feature value exists in an index database, marking the reference information of the any pixel block in an index file of the index database; if it is confirmed that the visual feature value does not exist in the index database, storing the pixel data corresponding to the any pixel block in a video data file, and updating the correspondence between the visual feature value and the any pixel block in the index database.

[0007] Some embodiments of this application retrieve the visual feature value of any pixel block in the video frame from the index database. If the pixel block exists in the index database, it is labeled or stored in the video data file. This avoids the repeated storage of any pixel block, improves storage efficiency, and reduces storage costs.

[0008] In some embodiments, before obtaining the visual feature value corresponding to any pixel block among multiple pixel blocks in the maintenance video frame, the method further includes: obtaining maintenance video frames during the maintenance session; segmenting the maintenance video frames to obtain the multiple pixel blocks; and obtaining the visual feature value of each pixel block among the multiple pixel blocks.

[0009] Some embodiments of this application divide the operation and maintenance video frames obtained during the operation and maintenance session into multiple pixel blocks, and then calculate the visual feature value corresponding to each pixel block to provide support for subsequent queries in the index database.

[0010] In some embodiments, obtaining the visual feature value of each pixel block among the plurality of pixel blocks includes: extracting the visual features of each pixel block; and calculating the visual feature value by using a perceptual hash algorithm on the visual features of each pixel block.

[0011] Some embodiments of this application extract the visual features of each pixel block and then use a perceptual hash algorithm to calculate the visual feature values, providing support for subsequent storage.

[0012] In some embodiments, obtaining the operation and maintenance video frames during the operation and maintenance session includes: obtaining video data corresponding to the remote desktop protocol data during the operation and maintenance session through a protocol proxy program in the bastion host; and generating consecutive operation and maintenance video frames corresponding to the video data.

[0013] Some embodiments of this application obtain remote video data through a protocol proxy program in a bastion host, thereby generating operation and maintenance video frames and achieving effective acquisition of video frames.

[0014] In some embodiments, segmenting the maintenance video frame to obtain the plurality of pixel blocks includes: segmenting the maintenance video frame according to a preset pixel block size to obtain the plurality of pixel blocks.

[0015] Some embodiments of this application divide the operation and maintenance video frame into multiple pixel blocks by preset pixel block size, thereby achieving effective video segmentation.

[0016] In some embodiments, the method further includes: counting the usage frequency of all pixel blocks in the index database; filtering all pixel blocks based on the usage frequency to obtain an updated index database.

[0017] Some embodiments of this application filter pixel blocks by statistically analyzing their usage frequency to obtain an updated index database, thereby enabling the periodic cleaning of cold data and freeing up storage space.

[0018] In some embodiments, the step of filtering all pixel blocks based on the usage frequency includes: if the usage frequency is greater than a preset frequency threshold, then retain the corresponding pixel block; if the usage frequency is not greater than the preset frequency threshold, then delete the corresponding pixel block.

[0019] Some embodiments of this application determine the processing method for pixel blocks by comparing the frequency with a preset frequency threshold, thereby achieving periodic cleaning of cold data.

[0020] Secondly, some embodiments of this application provide a method for playing back operation and maintenance audit videos, including: reading an index file; wherein the index file includes pixel block information of frame images, the pixel block information including pixel block timestamp, pixel block position and pixel block identifier; reading pixel data corresponding to the pixel block based on the pixel block information; wherein the pixel block is stored according to any method embodiment of the first aspect; and splicing the pixel data to obtain an operation and maintenance video frame.

[0021] Some embodiments of this application obtain pixel block information of multiple pixel blocks in the index file, read the corresponding multiple pixel blocks from the index database, and finally stitch them together to obtain the operation and maintenance video of the index file, thereby realizing effective video playback.

[0022] In some embodiments, reading the pixel data corresponding to the pixel block based on the pixel block information includes: if the pixel block location is in the index database, then reading the pixel data from the global pixel block database of the index database; if the pixel block location is in the video data file, then reading the pixel data from the video data file.

[0023] Some embodiments of this application determine the method of obtaining pixel blocks by confirming whether the pixel block position is in the index database, thereby achieving effective acquisition of pixel blocks.

[0024] Thirdly, some embodiments of this application provide an apparatus for storing operation and maintenance audit videos, comprising: an acquisition module, configured to acquire a visual feature value corresponding to any pixel block among multiple pixel blocks in an operation and maintenance video frame; a first storage module, configured to, if it is confirmed that the visual feature value exists in an index database, mark the reference information of the any pixel block in an index file of the index database; and a second storage module, configured to, if it is confirmed that the visual feature value does not exist in the index database, store the pixel data corresponding to the any pixel block in a video data file, and update the correspondence between the visual feature value and the any pixel block in the index database.

[0025] Fourthly, some embodiments of this application provide an apparatus for playing back operation and maintenance audit videos, including: a file reading module for reading an index file; wherein the index file includes pixel block information of a frame image, and the pixel block information includes a pixel block timestamp, a pixel block position, and a pixel block identifier; a data reading module for reading pixel data corresponding to the pixel block based on the pixel block information; and a stitching module for stitching the pixel data to obtain an operation and maintenance video frame.

[0026] Fifthly, some embodiments of this application provide a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, can implement the method described in any embodiment of the first aspect.

[0027] In a sixth aspect, some embodiments of this application provide an electronic device including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor, when executing the program, can implement the method as described in any embodiment of the first aspect.

[0028] In a seventh aspect, some embodiments of this application provide a computer program product comprising a computer program, wherein the computer program, when executed by a processor, can implement the method described in any embodiment of the first aspect. Attached Figure Description

[0029] To more clearly illustrate the technical solutions of some embodiments of this application, the accompanying drawings used in some embodiments of this application will be briefly described below. It should be understood that the following drawings only show some embodiments of this application and should not be regarded as a limitation of the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0030] Figure 1 System diagrams for operation and maintenance audit video storage provided for some embodiments of this application; Figure 2 Flowchart of a method for storing operation and maintenance audit videos provided for some embodiments of this application; Figure 3 Flowchart of a method for playing back operation and maintenance audit videos provided for some embodiments of this application; Figure 4 Flowcharts of methods for storing and playing back operation and maintenance audit videos provided for some embodiments of this application; Figure 5 Block diagrams of an apparatus for storing operation and maintenance audit videos provided for some embodiments of this application; Figure 6 Block diagram of an apparatus for playing back operation and maintenance audit videos provided for some embodiments of this application; Figure 7 A schematic diagram of an electronic device provided for some embodiments of this application. Detailed Implementation

[0031] The technical solutions of some embodiments of this application will now be described with reference to the accompanying drawings.

[0032] It should be noted that similar reference numerals and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures. Furthermore, in the description of this application, terms such as "first," "second," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0033] In related technologies, remote operation and maintenance recording technology faces challenges due to the large volume of video data generated during remote operation and maintenance, resulting in significant storage pressure. Even with efficient compression, text-intensive operations still generate a large amount of redundant data, leading to high storage costs. Furthermore, the interface of the same asset is highly repetitive in different operation and maintenance sessions, but existing technologies cannot reuse screen blocks across sessions, resulting in repeated storage and a large memory footprint.

[0034] In view of this, some embodiments of this application provide a method for storing operation and maintenance audit videos. This method involves segmenting the operation and maintenance video frames and determining the visual feature value of each pixel block. When storing any pixel block, the method first searches the index database to determine if it exists. If it exists, the pixel block is marked with reference information for subsequent reuse. If it does not exist, it is stored in the video data file, and the index database is updated. These embodiments of the application can improve the efficiency of operation and maintenance video storage, reduce storage costs and pressure, and increase the utilization rate of storage space, making them highly practical.

[0035] The following is in conjunction with the appendix Figure 1 The overall structure of the operation and maintenance audit video storage system provided by some embodiments of this application is illustrated by way of example.

[0036] like Figure 1 As shown in the figure, some embodiments of this application provide a system diagram for storing operation and maintenance audit videos. This operation and maintenance audit video storage may include a terminal 100 and a storage server 200. The storage server 200 can obtain operation and maintenance video frames generated by the operation and maintenance session from the terminal 100. The storage server 200 segments the operation and maintenance video frames and calculates the visual feature value of each pixel block; when storing any pixel block, it first determines whether there is identical or similar content in the index database based on the visual feature value. If so, it marks the pixel block with reference information; otherwise, it stores the pixel block to the video data file and updates the index database.

[0037] In some embodiments of this application, the terminal 100 can be a mobile terminal or a non-portable computer terminal; this application does not specifically limit the embodiments thereto. In other embodiments of this application, if the terminal 100 has the function of segmenting, calculating, and storing operation and maintenance video frames as provided in the storage server 200, then the storage server 200 may not be required. Specifically, the choice can be made according to the actual usage scenario; this application is not limited to this.

[0038] The following is in conjunction with the appendix Figure 2 The present application provides an exemplary embodiment of the implementation process of operation and maintenance audit video storage performed by storage server 200.

[0039] Please see the appendix Figure 2 , Figure 2 A flowchart illustrating a method for storing operation and maintenance audit videos is provided for some embodiments of this application. This method for storing operation and maintenance audit videos may include: S210: Obtain the visual feature value corresponding to any pixel block among multiple pixel blocks in the maintenance video frame.

[0040] For example, in a specific embodiment of this application, a visual feature value is obtained by calculating each pixel block among multiple pixel blocks in the maintenance video frame. When storing any pixel block, the visual feature value corresponding to that pixel block is obtained.

[0041] In some embodiments of this application, the method for operating and auditing video storage before executing S210 may further include: S201, Obtain operation and maintenance video frames during the operation and maintenance session.

[0042] For example, in a specific embodiment of this application, when using graphical protocols (RDP, VNC) for operation and maintenance, video data is generated in real time. The video file passes through a bastion host agent program, which parses the video data into different operation and maintenance video frames and transfers the operation and maintenance video frames to the pixel splitting module.

[0043] In some embodiments of this application, S201 may include: obtaining video data corresponding to the remote desktop protocol data during the operation and maintenance session through a protocol proxy program in the bastion host; and generating continuous operation and maintenance video frames corresponding to the video data.

[0044] For example, in a specific embodiment of this application, after the operation and maintenance session begins, the operation and maintenance personnel log in to the target server through the bastion host. The bastion host starts the screen recording module and obtains video data of remote desktop protocol data (such as RDP and VNC) during the operation and maintenance process through the protocol proxy program, and then generates continuous operation and maintenance video frames.

[0045] S202, the maintenance video frame is segmented to obtain the multiple pixel blocks.

[0046] In some embodiments of this application, S202 may include: dividing the maintenance video frame according to a preset pixel block size to obtain the plurality of pixel blocks.

[0047] For example, in a specific embodiment of this application, each frame in the maintenance video is divided into multiple pixel blocks of a fixed size (such as 8×8px or 16×16px, as a specific example of a preset pixel block size), and a unique coordinate identifier is generated for each pixel block. Each frame is divided into multiple pixel blocks, and each pixel block can serve as a reusable minimum storage unit.

[0048] S203, obtain the visual feature value of each pixel block among the plurality of pixel blocks.

[0049] For example, in a specific embodiment of this application, the corresponding visual feature value is calculated for each pixel block.

[0050] In some embodiments of this application, S203 may include: extracting the visual features of each pixel block; and calculating the visual features of each pixel block using a perceptual hash algorithm to obtain the visual feature value.

[0051] For example, in a specific embodiment of this application, low-frequency visual features in each pixel block are extracted by grayscale conversion and Discrete Cosine Transform (DCT), and each pixel block is converted into a fixed-length hash value (as a specific example of a visual feature value) for subsequent fast similarity comparison. Specifically, for each pixel block, the perceptual hash algorithm (pHash) is used to calculate the visual feature value corresponding to its visual features.

[0052] It should be noted that visual feature values ​​can be used as an index for subsequent pixel block retrieval, thereby enabling an effective search for whether a pixel block exists in the index database.

[0053] After calculating the visual feature values, it is necessary to store and manage each pixel block and its corresponding feature value. Using the visual feature value as an index, queries are performed in the global pixel block hash database (as a specific example of an index database). The query scope covers all historical operation and maintenance sessions, not just the current session.

[0054] S220, if it is confirmed that the visual feature value exists in the index database, the reference information of any pixel block is marked in the index file of the index database.

[0055] For example, in a specific embodiment of this application, if the visual feature value exists in the global pixel block hash database (i.e., there exists a hash value in the global pixel block hash database that is the same as or similar to the visual feature value), then the lifecycle calculator for any corresponding pixel block is incremented by one. This indicates that the pixel block has been stored in a previous session, so this time only the reference information of the pixel block is recorded in the index file; the reference information includes the block position (X,Y), timestamp (T), and block ID (as a specific example of a unique coordinate identifier) ​​of any pixel block, etc., without needing to write the pixel data again.

[0056] S230, if it is confirmed that the visual feature value does not exist in the index database, the pixel data corresponding to any pixel block is stored in the video data file, and the correspondence between the visual feature value and the pixel block is updated in the index database.

[0057] For example, in a specific embodiment of this application, if the visual feature value does not exist in the global pixel block hash database, the pixel data of any pixel block is written to the video data file, and the correspondence between the visual feature value and any pixel block is stored in the global pixel block hash database for reuse in subsequent session videos. The index file of the global pixel block hash database records the pixel block information of the pixel data of any pixel block. This pixel block information includes: FrameID (frame number), Timestamp, Width, Height (resolution), X, Y (block coordinates), LocationFlag (storage location flag), HashID (pHash or 64-bit id, as a specific example of a visual feature value), DataOffset (file offset), and Size (data length). For example, FrameID (frame number): 4 B; Timestamp: 8 B; Width, Height (resolution): 2 + 2 = 4 B; X, Y (block coordinates): 2 + 2 = 4 B; LocationFlag (storage location flag): 1 B; HashID (pHash or 64-bit id): 8 B; DataOffset (file offset): 8 B; Size (data length): 4 B.

[0058] As can be seen, in this application, repeated pixel blocks only store pixel data once, while the remaining positions record indices. In practical applications, a 16×16 pixel block has an original RGB24 size of 16×16×3 = 768B. After optimization, the actual video data can be pointed to simply by the index in the index file, thus reducing the optimized size of a 16×16 pixel block to 41B. This reduces the storage overhead of a single block by approximately 94.7%, lowering storage costs and reducing pressure.

[0059] In some embodiments of this application, the method for operation and maintenance auditing video storage further includes: statistically analyzing the usage frequency of all pixel blocks in the index database; filtering all pixel blocks based on the usage frequency to obtain an updated index database.

[0060] For example, in a specific embodiment of this application, the usage frequency of all pixel blocks is statistically analyzed. When a cold pixel block does not reappear for a long period of time (e.g., not hit for N days), it can be cleaned up in a background task. This ensures the integrity of the playback while avoiding the unlimited expansion of the database and improving the efficiency of comparison and retrieval.

[0061] In some embodiments of this application, filtering all pixel blocks based on the usage frequency includes: if the usage frequency is greater than a preset frequency threshold, retaining the corresponding pixel block; if the usage frequency is not greater than the preset frequency threshold, deleting the corresponding pixel block.

[0062] For example, in a specific embodiment of this application, high-frequency pixel blocks (such as fixed desktop backgrounds and command prompt areas) with a usage frequency greater than a preset frequency threshold are retained in the global pixel block hash database. Low-frequency pixel blocks with a usage frequency less than or equal to the preset frequency threshold are cleaned up and only retained in the maintenance video file where they first appear, thereby avoiding the database from growing indefinitely and improving retrieval efficiency.

[0063] After segmenting and storing the operation and maintenance video frames as described above, the corresponding pixel data can be retrieved during subsequent playback of the operation and maintenance video. The following section, in conjunction with the appendix... Figure 3 The present application provides an exemplary description of the specific process of operation and maintenance audit video playback provided in some embodiments.

[0064] Please see the appendix Figure 3 , Figure 3 A flowchart illustrating a method for playing back operation and maintenance audit videos is provided for some embodiments of this application. This method for playing back operation and maintenance audit videos may include: S310, Read the index file; wherein, the index file includes pixel block information of the frame image, and the pixel block information includes pixel block timestamp, pixel block position and pixel block identifier.

[0065] For example, in a specific embodiment of this application, the player first reads an index file, which records which pixel blocks make up each frame (i.e., frame image) and the pixel block information containing the pixel blocks, such as timestamp, location, block ID, etc.

[0066] S320, based on the pixel block information, read the pixel data corresponding to the pixel block.

[0067] For example, in a specific embodiment of this application, the player reads all pixel block information of a frame from the index file in chronological order. For each pixel block, its storage location is checked to retrieve the pixel block.

[0068] In some embodiments of this application, S320 may include: if the pixel block location is in the index database, then reading the pixel data from the global pixel block database of the index database; if the pixel block location is in the video data file, then reading the pixel data from the video data file.

[0069] For example, in a specific embodiment of this application, if the pixel block position in the pixel block information is stored in a global pixel block hash database, then the corresponding pixel block is read from the global pixel block hash database. Alternatively, if the pixel block position is marked as "database reuse", the player directly loads the pixel data corresponding to the corresponding pixel block from the global pixel block hash database.

[0070] If the pixel block location is stored in the video data file, the corresponding pixel data is read from the video data file. Alternatively, if the pixel block location is marked as "new storage block," the player reads the pixel data from the video data file.

[0071] S330, the pixel data is stitched together to obtain maintenance video frames.

[0072] For example, in a specific embodiment of this application, the extracted pixel data is stitched together according to the X, Y coordinates in the pixel block information to the corresponding positions to synthesize a complete frame (as a specific example of an operation and maintenance video frame). The player sends the stitched frame to the display module and controls the playback rhythm (e.g., 10fps, 30fps) according to the timestamp to ensure smooth playback.

[0073] The following is in conjunction with the appendix Figure 4 This application provides illustrative examples of the specific processes for storing and playing back operation and maintenance audit videos provided by some embodiments. The following embodiments use a corporate bastion host for centralized remote operation and maintenance auditing of a large number of servers / network devices as an application scenario. Typical operation and maintenance sessions are mainly conducted through a command-line interface (CLI) or management console, with few changes in the screen but requiring complete playback and long-term compliant storage. Support for real-time recording, fast playback, cross-session pixel block reuse, and long-term archiving is required.

[0074] Please see the appendix Figure 4 , Figure 4 A flowchart illustrating a method for storing and playing back operation and maintenance audit videos, provided for some embodiments of this application.

[0075] The above process is illustrated below by example.

[0076] The S410 obtains video data corresponding to the remote desktop protocol data during the operation and maintenance session through the protocol proxy program in the bastion host.

[0077] S420 generates continuous maintenance video frames corresponding to the video data.

[0078] The S430 divides the maintenance video frames into multiple pixel blocks according to the preset pixel block size.

[0079] S440, obtain the visual feature value of each pixel block in a plurality of pixel blocks.

[0080] S450: Determine if the visual feature value exists in the index database. If it does, execute S451; otherwise, execute S452.

[0081] S451, Mark the reference information for each pixel block in the index file of the index database.

[0082] S452, store the pixel data corresponding to each pixel block in the video data file, and update the correspondence between the visual feature values ​​and each pixel block in the index database.

[0083] S460, read the index file.

[0084] S470 reads the pixel data corresponding to the pixel block based on the pixel block information in the index file.

[0085] The S480 stitches together pixel data to obtain maintenance video frames.

[0086] It is understood that the specific implementation process of S410~S480 can refer to the method implementation examples provided above. To avoid repetition, detailed descriptions are omitted here.

[0087] In actual bastion host operation and maintenance scenarios, the interface of the same asset is highly repetitive across different maintenance sessions. Consequently, the video data pixel blocks generated by different sessions also highly overlap. This application addresses this by reusing data across sessions, requiring only one copy of the same pixel block data to be stored, which can then be shared during video playback across different sessions, thereby significantly reducing video storage requirements.

[0088] Please refer to Figure 5 , Figure 5The diagram illustrates a block diagram of an apparatus for storing operation and maintenance audit videos according to some embodiments of this application. It should be understood that this apparatus corresponds to the method embodiments described above and is capable of performing the various steps involved in the method embodiments. The specific functions of this apparatus can be found in the description above; detailed descriptions are omitted here to avoid repetition.

[0089] Figure 5 The device for storing operation and maintenance audit videos includes at least one software function module that can be stored in a memory or embedded in the device in the form of software or firmware. The device includes: an acquisition module 510, used to acquire the visual feature value corresponding to any pixel block among multiple pixel blocks in the operation and maintenance video frame; a first storage module 520, used to mark the reference information of the pixel block in the index file of the index database when it is confirmed that the visual feature value exists in the index database; and a second storage module 530, used to store the pixel data corresponding to the pixel block to a video data file and update the correspondence between the visual feature value and the pixel block in the index database when it is confirmed that the visual feature value does not exist in the index database.

[0090] Please refer to Figure 6 , Figure 6 The diagram illustrates the composition of an apparatus for playing back operation and maintenance audit videos according to some embodiments of this application. It should be understood that this apparatus corresponds to the method embodiments described above and is capable of performing the various steps involved in the method embodiments. The specific functions of this apparatus can be found in the description above; detailed descriptions are omitted here to avoid repetition.

[0091] Figure 6 The device for playing back operation and maintenance audit videos includes at least one software function module that can be stored in a memory or embedded in the device in the form of software or firmware. The device includes: a file reading module 610 for reading an index file; wherein the index file includes pixel block information of frame images, and the pixel block information includes pixel block timestamps, pixel block positions, and pixel block identifiers; a data reading module 620 for reading pixel data corresponding to the pixel blocks based on the pixel block information; and a stitching module 630 for stitching the pixel data to obtain operation and maintenance video frames.

[0092] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working process of the device described above can be referred to the corresponding process in the aforementioned method, and will not be elaborated further here.

[0093] Some embodiments of this application also provide a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, can perform the operation of any of the methods corresponding to the methods provided in the above embodiments.

[0094] Some embodiments of this application also provide a computer program product, which includes a computer program, wherein when the computer program is executed by a processor, it can implement the operation of any of the methods corresponding to the above embodiments provided in the above embodiments.

[0095] like Figure 7 As shown, some embodiments of this application provide an electronic device 700, which includes a memory 710, a processor 720, and a computer program stored in the memory 710 and executable on the processor 720. When the processor 720 reads the program from the memory 710 via a bus 730 and executes the program, it can implement the methods of any of the above embodiments.

[0096] Processor 720 can process digital signals and can include various computing architectures. For example, it can be a complex instruction set computer architecture, a reduced instruction set computer architecture, or an architecture that implements multiple instruction set combinations. In some examples, processor 720 can be a microprocessor.

[0097] The memory 710 can be used to store instructions executed by the processor 720 or data related to the execution of instructions. These instructions and / or data may include code for implementing some or all of the functions of one or more modules described in the embodiments of this application. The processor 720 of this disclosure embodiment can be used to execute the instructions in the memory 710 to implement the methods shown above. The memory 710 includes dynamic random access memory, static random access memory, flash memory, optical memory, or other memories well known to those skilled in the art.

[0098] The above description is merely an embodiment of this application and is not intended to limit the scope of protection of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of protection of this application. It should be noted that similar reference numerals and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures.

[0099] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

[0100] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

Claims

1. A method for storing operation and maintenance audit videos, characterized in that, include: Obtain the visual feature value corresponding to any pixel block among multiple pixel blocks in the maintenance video frame; If it is confirmed that the visual feature value exists in the index database, the reference information of any pixel block is marked in the index file of the index database; If it is confirmed that the visual feature value does not exist in the index database, the pixel data corresponding to any pixel block is stored in the video data file, and the correspondence between the visual feature value and the pixel block is updated in the index database.

2. The method as described in claim 1, characterized in that, Before obtaining the visual feature value corresponding to any pixel block among multiple pixel blocks in the maintenance video frame, the method further includes: Acquire operation and maintenance video frames during the operation and maintenance session; The maintenance video frame is segmented to obtain the plurality of pixel blocks; Obtain the visual feature value of each pixel block among the plurality of pixel blocks.

3. The method as described in claim 2, characterized in that, The step of obtaining the visual feature value of each pixel block in the plurality of pixel blocks includes: Extract the visual features of each pixel block; The visual features of each pixel block are calculated using a perceptual hash algorithm to obtain the visual feature value.

4. The method as described in claim 2 or 3, characterized in that, The acquisition of operation and maintenance video frames during the operation and maintenance session includes: The video data corresponding to the remote desktop protocol data during the operation and maintenance session is obtained through the protocol proxy program in the bastion host; Generate a series of maintenance video frames corresponding to the video data.

5. The method as described in claim 2 or 3, characterized in that, The process of segmenting the maintenance video frame to obtain the plurality of pixel blocks includes: The maintenance video frame is segmented according to a preset pixel block size to obtain the multiple pixel blocks.

6. The method according to any one of claims 1-3, characterized in that, The method further includes: Statistically analyze the usage frequency of all pixel blocks in the index database; Based on the usage frequency, all pixel blocks are filtered to obtain an updated index database.

7. The method as described in claim 6, characterized in that, The filtering of all pixel blocks based on the usage frequency includes: If the usage frequency is confirmed to be greater than a preset frequency threshold, the corresponding pixel block is retained. If the usage frequency is confirmed to be no greater than the preset frequency threshold, then the corresponding pixel block is deleted.

8. A method for playing back operation and maintenance audit videos, characterized in that, include: Read the index file; wherein the index file includes pixel block information of the frame image, and the pixel block information includes pixel block timestamp, pixel block position and pixel block identifier; Based on the pixel block information, the pixel data corresponding to the pixel block is read; wherein the pixel block is stored according to the method described in any one of claims 1-7; The pixel data is stitched together to obtain maintenance video frames.

9. The method as described in claim 8, characterized in that, The step of reading pixel data corresponding to the pixel block based on the pixel block information includes: If the pixel block location is in the index database, then the pixel data is read from the global pixel block database of the index database; If the pixel block is located in the video data file, then the pixel data is read from the video data file.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, wherein the computer program is executed by a processor to perform the method as described in any one of claims 1-9.

11. An electronic device, characterized in that, The method includes a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the computer program is executed by the processor to perform the method as described in any one of claims 1-9.

12. A computer program product, characterized in that, The computer program product includes a computer program, wherein the computer program is executed by a processor to perform the method as described in any one of claims 1-9.

Images