Video Processing Method, Apparatus, Device, and Medium

Abstract

The present invention relates to a video processing method, apparatus, device and medium, and relates to the technical field of data processing. The method includes: obtaining a video stream of a terminal acquisition system as a data stream; storing the data stream into a delay module; performing concurrent processing on the data in the delay module according to a preset detection algorithm to obtain a plurality of key features; and packing the key features to obtain feature data. It realizes multi-threaded concurrent processing based on a queue, adds a delay module to the basic edge computing video processing, the delay module designs a buffer queue to temporarily store congested video data, and the data processing adopts a multi-threaded mode combined with a queue to achieve multi-channel processing, improves the throughput rate of the entire system, and enhances the real-time effect of the system.

Description

Technical Field

[0001] The present invention relates to the technical field of data processing, and particularly to a video processing method, apparatus, device, and medium. Background Art

[0002] In the era of big data, in the face of massive data and high-definition videos, the traditional video surveillance system has the following problems:

[0003] Most of the data in the current video surveillance system is stored in the corresponding local systems. There may be no communication between the locals, the transmission distance is limited, and it is impossible to further process and perform full-scale analysis on all the monitored video content. Moreover, the devices in the early stage do not perform any processing on the collected data, and directly transmit the original data stream after collection to the cloud for processing, resulting in low computing efficiency.

[0004] In the face of the impact of massive high-resolution data, the traditional video surveillance system has weak transmission and processing capabilities, which in turn leads to problems such as byte overlength when UDP transmits data to the cloud for processing, resulting in frame loss, freezing, and other issues. Summary of the Invention

[0005] The present invention provides a video processing method to solve the problems of byte overlength when UDP transmits data to the cloud for processing, resulting in frame loss and freezing.

[0006] In a first aspect, the present invention provides a video processing method, the method comprising:

[0007] Obtain a video stream from the terminal acquisition system as a data stream;

[0008] Store the data stream into a delay module;

[0009] Perform concurrent processing on the data in the delay module according to a preset detection algorithm to obtain multiple key features;

[0010] Package the key features to obtain feature data.

[0011] In a second aspect, the present invention provides a video processing apparatus, comprising:

[0012] An obtaining unit, configured to obtain a video stream from the terminal acquisition system as a data stream;

[0013] A storage unit, configured to store the data stream into a delay module;

[0014] A processing unit, configured to perform concurrent processing on the data in the delay module according to a preset detection algorithm to obtain multiple key features;

[0015] A packaging unit, configured to package the key features to obtain feature data.

[0016] In a third aspect, an electronic device is provided, including a processor, a communication interface, a memory, and a communication bus. Among them, the processor, the communication interface, and the memory complete communication with each other through the communication bus;

[0017] The memory is used to store a computer program;

[0018] When the processor is used to execute the program stored on the memory, the steps of the video processing method described in any embodiment of the first aspect are implemented.

[0019] In a fourth aspect, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of the video processing method described in any embodiment of the first aspect are implemented.

[0020] The above technical solutions provided by the embodiments of the present invention have the following advantages compared with the prior art:

[0021] The embodiments of the present invention are applied to edge devices. Through the cloud server and edge devices, effective shunting of the data center is achieved, improving the processing ability and real-time performance of the data center for video monitoring. Each edge device can be connected to multiple terminals as a node to form a terminal. At the same time, the cloud server can also be connected to the terminal to provide services for the terminal. Based on queue-based multi-threaded concurrent processing, a delay module is added to the basic edge computing video processing. The delay module designs a buffer queue to temporarily store congested video data. The data processing adopts a multi-threaded mode combined with a queue to achieve multi-channel processing, improving the throughput rate of the entire system and enhancing the real-time performance of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The drawings here are incorporated into the description and form a part of this description, showing embodiments consistent with the present invention and used together with the description to explain the principles of the present invention.

[0023] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0024] Figure 1 It is a schematic flowchart of a video processing method provided by an embodiment of the present invention;

[0025] Figure 2 It is a schematic sub-flowchart of a video processing method provided by an embodiment of the present invention;

[0026] Figure 3Schematic diagram of a sub - process of a video processing method provided by an embodiment of the present invention;

[0027] Figure 4 Schematic diagram of a sub - process of a video processing method provided by an embodiment of the present invention;

[0028] Figure 5 Schematic diagram of the structure of a video processing device provided by an embodiment of the present invention;

[0029] Figure 6 Schematic diagram of the structure of a computer device provided by an embodiment of the present invention;

[0030] Figure 7 Schematic diagram of a segmentation example according to an image segmentation algorithm provided by an embodiment of the present application;

[0031] Figure 8 Schematic diagram of the overall structure of a system provided by an embodiment of the present invention;

[0032] Figure 9 Schematic diagram of the change of the reception rate of video transmission at different resolutions provided by an embodiment of the present invention;

[0033] Figure 10 Schematic diagram of the change of the processing time of video transmission at different resolutions provided by an embodiment of the present invention;

[0034] Figure 11 Schematic diagram of the change of the memory usage rate of video transmission at different resolutions provided by an embodiment of the present invention. Detailed implementation manners

[0035] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0036] Embodiment 1

[0037] See Figure 8 , Figure 8 , which is a schematic diagram of the overall structure of a system provided by an embodiment of the present invention. The embodiments of the present invention are applied to edge devices. The edge server is wired / wirelessly connected to the terminal acquisition system and the cloud server respectively. The terminal acquisition system is used to acquire videos, and the edge server receives the videos acquired by the terminal acquisition system and extracts feature data based on the detection algorithm.

[0038] Figure 1 The flowchart of a video processing method provided by an embodiment of the present invention. An embodiment of the present invention proposes a video processing method. Specifically, refer to Figure 1 , the video processing method includes the following steps S101 - S105.

[0039] S101, Obtain a video stream of the terminal acquisition system as a data stream.

[0040] In specific implementation, the terminal acquisition system includes an acquisition module, such as a camera, for acquiring video data information. Generally, the terminal acquisition system includes multiple acquisition modules, and the multiple acquisition modules are respectively used to monitor the corresponding areas. The video data information acquired by each acquisition module is called a video stream. Understandably, multiple video streams are the video data information acquired by multiple acquisition modules.

[0041] In this embodiment, the data stream is the video stream acquired by any acquisition module in the terminal acquisition system.

[0042] In an embodiment, the data stream can also be obtained by the acquisition module of the terminal acquisition system acquiring video data and sending the video data according to the UDP protocol.

[0043] In specific implementation, the video stream acquired by the acquisition module is video data, and the video data is sent to the edge device through the UDP protocol to realize the wireless connection between the edge server and the terminal acquisition system. The UDP protocol is a broadcast, connectionless service, with the advantages of relatively small resource overhead and high transmission efficiency. In some other embodiments, network transmission can also be performed through TCP, UDP, HTTP, etc.

[0044] Further, the sending the video data according to the UDP protocol includes:

[0045] Judge whether the data volume of the frame image of the video data is greater than a preset data volume threshold through the terminal acquisition system;

[0046] If so, segment the frame image according to a preset picture segmentation algorithm through the terminal acquisition system, and use the segmented image and its segmentation identifier as the video data.

[0047] In specific implementation, the terminal acquisition system obtains data, shards the data, and uses JPEG intra-frame encoding compression to generate the final data format to be transmitted. Finally, a communication with the server is established and the data is sent to the server. In this embodiment, the video data is transmitted through the UDP network transmission protocol, and when the data volume of a frame image transmitted by UDP is too large, a picture horizontal segmentation algorithm is set. The picture horizontal segmentation algorithm is to horizontally segment the picture, as Figure 7 shown, Figure 7This is a segmentation example diagram provided by an embodiment of the present application according to an image segmentation algorithm. The picture is segmented into three regions, and each region is provided with a corresponding number and position information. Each region image, its number, and position information are used as video data. By segmenting the frame image through the image segmentation algorithm, the problem of failure to send the frame image due to overlong bytes can be avoided.

[0048] See Figures 9 - 11 , Figures 9 - 11 For an experiment on monitoring video data with 30 seconds of 30fps frame rate at 8 different resolutions (256×144, 512×288, 640x360, 854x480, 1280×720, 1920×1080, 2560×1440, 3840×2160) of the same video, explore the changes in 4 video performance indicators as the resolution changes. In the figure, Owner shows the change in the reception rate, processing time, and memory usage rate of the video processing method for transmitting various resolutions. In the figure, UDP shows the change in the reception rate, processing time, and memory usage rate of traditional UDP for transmitting various resolutions. It can be seen that with the traditional UDP transmission method, the maximum number of bytes transmitted at one time cannot be higher than 65536. In this experiment, the video sender with a resolution higher than 1280*720 will report an error due to overlong bytes. As the resolution increases, the frame reception rate of the ordinary video data transmission system shows an obvious decreasing trend with the data volume, while the frame reception rate of the queue-based multi-threaded video system remains unchanged, and there is no problem of frame loss. Through the UDP transmission protocol, delay module, and multi-threaded concurrent data processing, the processing speed of high-resolution videos is significantly improved compared with the traditional UDP transmission processing method.

[0049] Furthermore, the concurrent processing of the data of the delay module according to a preset detection algorithm to obtain multiple key features further includes:

[0050] Obtain the third picture frame of the delay module and its segmentation identifier;

[0051] Determine a combined image according to the third picture frame and the segmentation identifier;

[0052] Select a thread from a preset data processing module to analyze the combined image according to the detection algorithm to obtain the key features.

[0053] In specific implementation, before processing the segmented images, according to the segmentation identifier, a plurality of segmented images are spliced and combined to restore the state before image segmentation, and the restored image is used as a combined image, and then the key features are obtained by analyzing the combined image through a detection algorithm. In one embodiment, the segmented image has a segmentation identifier, and the segmentation identifier includes the unique serial number of the image before segmentation, the number of segmented images, and the position of the segmented images. After a thread recognizes the segmentation identifier, it continues to obtain the next image of the image and splices it according to a preset splicing order. For example: an image is equally divided from left to right, and image 1 (the segmentation identifier is recorded as "unique serial number of the image before segmentation: 111, number of segmented images: 3, position of segmented image: 1"), image 2 (the segmentation identifier is recorded as "unique serial number of the image before segmentation: 111, number of segmented images: 3, position of segmented image: 2"), and image 3 (the segmentation identifier is recorded as "unique serial number of the image before segmentation: 111, number of segmented images: 3, position of segmented image: 3") are obtained in sequence. The thread obtains the segmented image 1, and according to the unique serial number of the image before segmentation of the segmented image 1 and the number of segmented images, it further obtains the segmented image 2 and image 3, and combines images 1, 2, and 3 from left to right in sequence according to the position of the segmented images to obtain a combined image; if a thread a obtains image 1 and another thread obtains image 2, and image 1 cannot obtain image 2 and enters a waiting state, ultimately resulting in a deadlock where images 1, 2, and 3 cannot be combined within the same thread. In this embodiment, all threads are preset according to the priority gradient. For example, the priority of thread a is greater than the priority of thread b, that is, after thread a cannot obtain image 2 from the memory queue, it obtains image 2 from thread b with a lower priority, and then completes the combination of images 1, 2, and 3 in thread a, which can effectively avoid the occurrence of a deadlock affecting the operation.

[0054] S102, store the data stream in the delay module.

[0055] In specific implementation, the delay module is a preset storage area for temporarily storing the data stream, usually a storage structure of a queue. There are "openings" at both ends of the queue-type storage structure, and it is required that data can only enter from one end and exit from the other end, following the principle of "first in, first out". By temporarily storing the congested video data through the delay module, the execution times of data reception, data analysis, and data transmission overlap, thereby improving the throughput rate of the entire system, enhancing the real-time performance of the system, and achieving an increase in the reception speed of video data.

[0056] In one embodiment, refer to Figure 2 , Figure 2 which is a schematic sub-process diagram of a video processing method provided by an embodiment of the present invention. The delay module includes a memory queue, and the above step S102 includes steps S201 - S202:

[0057] S201, Obtain the first picture frame of the data stream.

[0058] In specific implementation, the data stream includes multiple frame images, and one frame image of the data stream is intercepted in chronological order as the first picture frame.

[0059] In one embodiment, refer to Figure 3 , Figure 3 which is a schematic diagram of a sub - process of a video processing method provided by an embodiment of the present invention. The above step S201 includes steps S301 - S302:

[0060] S301, Decompress and decode the data stream to obtain a target image.

[0061] In specific implementation, after the terminal acquisition system acquires data, the JPEG compression algorithm is used to reduce the video data volume and improve the data transmission speed. Decompression refers to the step of restoring the video data volume corresponding to the JPEG compression algorithm, and decoding refers to parsing the received data packet content, checking data integrity, etc.

[0062] S302, Pre - process the target image to obtain the first picture frame.

[0063] In specific implementation, pre - processing is used to eliminate irrelevant information in the image and restore useful real information. In some other embodiments, it also includes performing behavior detection, data analysis, etc. on the target image.

[0064] S202, Store the first picture frame into the memory queue in chronological order.

[0065] In specific implementation, the memory queue includes a sequential queue and a linked queue. The first picture frame is stored in the memory queue in chronological order, and the processing unit of the edge server obtains the first first picture frame in the memory queue for processing. By temporarily storing the first picture frame in the memory queue, the first picture frames are queued in sequence to achieve the buffering effect of the data stream.

[0066] S103, Perform concurrent processing on the data of the delay module according to a preset detection algorithm to obtain multiple key features.

[0067] In specific implementation, the detection algorithm includes a face detection algorithm, and concurrent processing is performed through multi - threading. One video stream is processed by multiple threads to improve the video reception and processing speed.

[0068] In one embodiment, refer to Figure 4 , Figure 4 which is a schematic diagram of a sub - process of a video processing method provided by an embodiment of the present invention. The above step S103 includes steps S401 - S402:

[0069] S401, obtain the second picture frame of the delay module.

[0070] In specific implementation, multiple frame images are stored in the delay module. In this embodiment, the delay module is a queue storage structure, and the first frame image on the delay module is selected for further processing as the second picture frame.

[0071] S402, select a thread from a preset data processing module to analyze the second picture frame according to the detection algorithm to obtain the key features.

[0072] In specific implementation, any thread is selected from the data processing module to call the detection algorithm to analyze the second picture frame, and the key features of the video are extracted to reduce the redundant information of the video, so as to alleviate the demand of the video information for network bandwidth and other resources. Taking the recognition of human faces in the video as an example: the data stream includes multiple segments of videos (denoted as video 1, video 2, and video 3 respectively), the data stream (video 1) is stored in the delay module, the first thread analyzes the frame images of the data stream (video 1) through the face detection algorithm, and eliminates the second picture frame with blurred human faces in video 1. The second thread analyzes the frame images of the data stream (video 1) through the face detection algorithm, extracts the face features of the second picture frame with clear human faces, and extracts the human face data in the second picture frame. The obtained human face data is the key feature. Among them, the first thread and the second thread operate concurrently.

[0073] S104, package the key features to obtain feature data.

[0074] In specific implementation, the key features obtained by all threads' data processing of the delay module are packaged in chronological order. The packaged data is feature data, and the feature data can be sent to the cloud server through communication.

[0075] The embodiments of the present invention can achieve the following advantages:

[0076] The embodiments of the present invention are applied to edge devices, and effectively divert the data center through the cloud server and edge devices, improving the processing ability and real-time performance of the data center for video monitoring. Each edge device can be connected to multiple terminals as a node to form a terminal. At the same time, the cloud server can also be connected to the terminal to provide services for the terminal. Based on the multi-threaded concurrent processing of the queue, a delay module is added to the basic edge computing video processing, and a buffer queue is designed to temporarily store congested video data. The data processing adopts a multi-threaded mode combined with the queue to divert the edge-end frame receiving video and achieve multi-channel processing, improving the throughput rate of the entire system and enhancing the real-time performance of the system.

[0077] See Figure 5An embodiment of the present invention further provides a video processing apparatus 500, which includes an acquisition unit 501, a storage unit 502, a processing unit 503, and a packaging unit 504.

[0078] The acquisition unit 501 is configured to acquire a video stream of a terminal acquisition system as a data stream;

[0079] In one embodiment, the data stream may also collect video data through a collection module of the terminal acquisition system and send the video data according to the UDP protocol.

[0080] In one embodiment, the sending the video data according to the UDP protocol includes:

[0081] Judging, by the terminal acquisition system, whether the data volume of the frame image of the video data is greater than a preset data volume threshold;

[0082] If so, segmenting the frame image by the terminal acquisition system according to a preset picture segmentation algorithm, and using the segmented image and its segmentation identifier as the video data.

[0083] In one embodiment, the concurrent processing of the data of the delay module according to a preset detection algorithm to obtain multiple key features further includes:

[0084] Obtaining a third picture frame of the delay module and its segmentation identifier;

[0085] Determining a combined image according to the third picture frame and the segmentation identifier;

[0086] Selecting a thread from a preset data processing module to analyze the combined image according to the detection algorithm to obtain the key features.

[0087] The storage unit 502 is configured to store the data stream in a delay module;

[0088] In one embodiment, the storing the data stream in the delay module specifically includes:

[0089] Obtaining a first picture frame of the data stream;

[0090] Sequentially storing the first picture frame into the memory queue in chronological order.

[0091] In one embodiment, the obtaining the first picture frame of the data stream specifically includes:

[0092] Decompressing and decoding the data stream to obtain a target image;

[0093] Performing preprocessing on the target image to obtain the first picture frame.

[0094] A processing unit 503 is configured to perform concurrent processing on the data of the delay module according to a preset detection algorithm to obtain multiple key features;

[0095] In one embodiment, the performing concurrent processing on the data of the delay module according to a preset detection algorithm to obtain multiple key features specifically includes:

[0096] Obtain a second picture frame of the delay module;

[0097] Select a thread from a preset data processing module to analyze the second picture frame according to the detection algorithm to obtain the key features.

[0098] A packaging unit 504 is configured to package the key features to obtain feature data.

[0099] In one embodiment, the data stream can also collect video data through the acquisition module of the terminal acquisition system and send the video data according to the UDP protocol.

[0100] In one embodiment, the sending the video data according to the UDP protocol includes:

[0101] Determine whether the data volume of the frame image of the video data is greater than a preset data volume threshold through the terminal acquisition system;

[0102] If so, segment the frame image through the terminal acquisition system according to a preset picture segmentation algorithm, and use the segmented image and its segmentation identifier as the video data.

[0103] In one embodiment, the performing concurrent processing on the data of the delay module according to a preset detection algorithm to obtain multiple key features further includes:

[0104] Obtain a third picture frame of the delay module and its segmentation identifier;

[0105] Determine a combined image according to the third picture frame and the segmentation identifier;

[0106] Select a thread from a preset data processing module to analyze the combined image according to the detection algorithm to obtain the key features.

[0107] As Figure 6 shown, Figure 6It is a schematic block diagram of a computer device provided by an embodiment of the present application. The computer device 600 can be a terminal or a server. Among them, the terminal can be an electronic device with communication functions such as a smart phone, a tablet computer, a notebook computer, a desktop computer, a personal digital assistant, and a wearable device. The server can be an independent server or a server cluster composed of multiple servers.

[0108] The computer device 600 includes a processor 602, a memory, and a network interface 605 connected through a system bus 601. Among them, the memory can include a non-volatile storage medium 603 and an internal memory 604.

[0109] The non-volatile storage medium 603 can store an operating system 6031 and a computer program 6032. When the computer program 6032 is executed, the processor 602 can be made to execute a video processing method.

[0110] The processor 602 is used to provide computing and control capabilities to support the operation of the entire computer device 600.

[0111] The internal memory 604 provides an environment for the operation of the computer program 6032 in the non-volatile storage medium 603. When the computer program 6032 is executed by the processor 602, the processor 602 can be made to execute a video processing method.

[0112] The network interface 605 is used for network communication with other devices. Those skilled in the art can understand that the above structure is only a block diagram of some structures related to the solution of the present application, and does not constitute a limitation on the computer device 600 to which the solution of the present application is applied. The specific computer device 600 may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0113] It should be understood that in the embodiment of the present application, the processor 602 can be a central processing unit (CPU), and the processor 602 can also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), off-the-shelf programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc.

[0114] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a storage medium, and the storage medium is a computer-readable storage medium. The computer program is executed by at least one processor in the computer system to implement the process steps of the embodiments of the above methods.

[0115] Therefore, the present invention also provides a storage medium. The storage medium can be a computer-readable storage medium. The storage medium stores a computer program.

[0116] The storage medium is a physical, non-transitory storage medium. For example, it can be various physical storage media such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a magnetic disk, or an optical disc that can store program codes. The computer-readable storage medium can be non-volatile or volatile.

[0117] Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of the two. To clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described according to functions in the above description. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present invention.

[0118] In several embodiments provided by the present invention, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of each unit is only a logical function division, and there can be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed.

[0119] The steps in the methods of the embodiments of the present invention can be adjusted, combined, and deleted according to actual needs. The units in the device embodiments of the present invention can be combined, divided, and deleted according to actual needs. In addition, the functional units in each embodiment of the present invention can be integrated into a processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit.

[0120] When the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a terminal, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention.

[0121] In the above embodiments, the descriptions of the various embodiments have their own emphases. For the parts not detailed in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0122] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, provided that these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalent technologies, the present invention is also intended to include these changes and modifications.

[0123] As described above, the above are only specific embodiments of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present invention can easily think of various equivalent modifications or substitutions, and these modifications or substitutions should all be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. A video processing method, characterized in that, The method includes: Obtaining a video stream of the terminal acquisition system as a data stream; Storing the data stream into a delay module; Performing concurrent processing on the data in the delay module according to a preset detection algorithm to obtain multiple key features; Packing the key features to obtain feature data; Wherein, the data stream collects video data through the acquisition module of the terminal acquisition system and sends the video data according to the UDP protocol; The sending of the video data according to the UDP protocol includes: Judging by the terminal acquisition system whether the data volume of the frame image of the video data is greater than a preset data volume threshold; if so, segmenting the frame image by the terminal acquisition system according to a preset picture segmentation algorithm, and taking the segmented image and its segmentation identifier as the video data; The performing concurrent processing on the data in the delay module according to a preset detection algorithm to obtain multiple key features further includes: Obtaining a third picture frame of the delay module and its segmentation identifier; determining a combined image according to the third picture frame and the segmentation identifier; selecting a thread from a preset data processing module to analyze the combined image according to the detection algorithm to obtain the key features, and all the threads are preset according to a priority gradient, and the thread with a higher priority obtains the combined image from the thread with a lower priority according to the segmentation identifier.

2. The method according to claim 1, wherein The delay module includes a memory queue, and the storing the data stream into the delay module includes: Obtaining a first picture frame of the data stream; Sequentially storing the first picture frame into the memory queue in chronological order.

3. The method according to claim 2, wherein The obtaining the first picture frame of the data stream includes: Decompressing and decoding the data stream to obtain a target image; Performing preprocessing on the target image to obtain the first picture frame.

4. The method according to claim 1, characterized in that, The performing concurrent processing on the data in the delay module according to a preset detection algorithm to obtain multiple key features includes: Obtaining a second picture frame of the delay module; Selecting a thread from a preset data processing module to analyze the second picture frame according to the detection algorithm to obtain the key features.

5. A video processing device, characterized in that, It includes: An obtaining unit, configured to obtain a video stream of the terminal acquisition system as a data stream; A storing unit, configured to store the data stream into a delay module; A processing unit, configured to perform concurrent processing on the data in the delay module according to a preset detection algorithm to obtain multiple key features; A packing unit, configured to pack the key features to obtain feature data; Wherein, the data stream collects video data through the acquisition module of the terminal acquisition system and sends the video data according to the UDP protocol; The sending of the video data according to the UDP protocol includes: Judging by the terminal acquisition system whether the data volume of the frame image of the video data is greater than a preset data volume threshold; if so, segmenting the frame image by the terminal acquisition system according to a preset picture segmentation algorithm, and taking the segmented image and its segmentation identifier as the video data; The performing concurrent processing on the data in the delay module according to a preset detection algorithm to obtain multiple key features further includes: Obtain the third picture frame of the delay module and its segmentation identifier; determine a combined image according to the third picture frame and the segmentation identifier; select a thread from a preset data processing module to analyze the combined image according to the detection algorithm to obtain the key features, and all the threads are preset according to a priority gradient, and the thread with a higher priority obtains the combined image from the thread with a lower priority according to the segmentation identifier.

6. A computer device, characterized in that, It includes a processor, a communication interface, a memory, and a communication bus. Among them, the processor, the communication interface, and the memory complete mutual communication through the communication bus; The memory is used to store computer programs; The processor is used to implement the steps of the method described in any one of claims 1-4 when executing the program stored on the memory.

7. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, the steps of the method described in any one of claims 1-4 are implemented.

Images