A display control method based on a video stream, a terminal and a storage medium

Abstract

The application discloses a display control method based on a video stream, a terminal and a storage medium, obtains a display picture of a target device based on a video output interface of the target device; converts the display picture into a video stream, establishes a unique transmission identifier for the video stream, binds the video stream with the corresponding target device according to the transmission identifier; scores the picture of the video stream according to a preset judgment rule, and selects a picture with a score greater than a first preset threshold; performs shielding processing on the picture with the score greater than the first preset threshold, generates a final video stream, and transmits the final video stream to the target device for display according to the transmission identifier. The application can analyze and control the display content without interfering with the internal software terminal and running process of the target device.

Description

Technical Field

[0001] This invention relates to the field of remote monitoring technology, and in particular to a display control method, terminal and storage medium based on video stream. Background Technology

[0002] With the widespread application of information technology in office work and terminal devices, enterprises, institutions, and various application scenarios are increasingly demanding management of the content displayed on target devices. For example, in scenarios such as office management, information security, data leakage prevention, and centralized operation and maintenance, it is often necessary to uniformly monitor, analyze, or control the display screens of multiple target devices to ensure that the displayed content meets preset specifications or security requirements.

[0003] In existing technologies, managing displayed content typically involves installing monitoring software, plugins, or agent programs within the target device. This is achieved by intercepting and parsing data at the operating terminal layer, application process layer, or application data, thereby enabling the identification and control of the displayed content. However, this type of technical solution generally suffers from the following shortcomings: Firstly, it requires adaptation and configuration of the target device's operating terminal or application, resulting in a complex deployment process and high maintenance costs. Secondly, the monitoring program often needs to run continuously within the target device, which can easily affect the device's performance, stability, and normal user operation. Furthermore, in practical applications, it may be affected by operating terminal permission restrictions, software encryption mechanisms, or application updates, leading to insufficient compatibility and reliability. Summary of the Invention

[0004] The technical problem to be solved by the present invention is to provide a video stream-based display control method, terminal and storage medium that can centrally analyze and control the display content without interfering with the internal software terminal and running process of the target device.

[0005] To solve the above-mentioned technical problems, the technical solution adopted by the present invention is as follows: A display control method based on video stream, comprising the following steps: S1. Based on the video output interface of the target device, obtain the display screen of the target device; S2. Convert the displayed image into a video stream, and establish a unique transmission identifier for the video stream. Bind the video stream to the corresponding target device according to the transmission identifier. S3. The video stream is scored according to a preset judgment rule, and the video stream with a score greater than a first preset threshold is selected. S4. Block the images whose scores are greater than the first preset threshold, generate the final video stream, and transmit the final video stream to the target device for display according to the transmission identifier.

[0006] To solve the above-mentioned technical problems, another technical solution adopted by the present invention is as follows: A video stream-based display control terminal includes a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that the processor executes the computer program to implement the steps of a video stream-based display control method.

[0007] A storage medium storing a computer program that, when executed by a processor, implements steps in a video stream-based display control method.

[0008] The beneficial effects of this invention are as follows: It provides a video stream-based display control method, terminal, and storage medium. By acquiring the display screen through the video output interface of the target device and converting the display screen into a video stream for unified processing, it achieves centralized analysis and display control of the displayed content without interfering with the internal software system and operating process of the target device. Compared with existing technologies that require installing monitoring programs or parsing application data on the target device, this invention avoids intrusion into the target device's operating environment, reduces system deployment and maintenance costs, and improves applicability and stability. Furthermore, by establishing a unique transmission identifier for the video stream and binding it to the corresponding target device, the video stream can be accurately transmitted back to the corresponding device for display in multi-device parallel processing scenarios, avoiding screen mismatch problems. Based on this, by scoring the video stream images and only blocking images exceeding a preset threshold, it is possible to ensure continuous display of normal images while selectively controlling abnormal or non-compliant display content, thereby achieving controllable management of the display content and improving the overall reliability and security of the display system. Attached Figure Description

[0009] Figure 1 This is a flowchart of a video stream-based display control method according to an embodiment of the present invention; Figure 2 This is a flowchart illustrating a video stream-based display control method according to an embodiment of the present invention. Figure 3 This is a flowchart illustrating the scoring process of a video stream-based display control method according to an embodiment of the present invention. Figure 4 This is a schematic diagram of a video stream-based display control terminal according to an embodiment of the present invention; Label Explanation: 1. A video stream-based display control terminal; 2. A memory; 3. A processor. Detailed Implementation

[0010] To explain in detail the technical content, objectives, and effects of the present invention, the following description is provided in conjunction with the embodiments and accompanying drawings.

[0011] Before detailing the embodiments of this application, some related concepts will first be explained: OCR (Optical Character Recognition): Optical character recognition refers to the process by which electronic devices (such as scanners or digital cameras) examine characters printed on paper, determine their shapes by detecting dark and light patterns, and then translate the shapes into computer text using character recognition methods.

[0012] In existing technologies, the management and control of displayed content on target devices are typically applied in areas such as office management, information security, data leakage prevention, and centralized operation and maintenance. Most existing technologies rely on installing monitoring software, plugins, or agent programs within the target device to collect and analyze data at the operating system layer, application process layer, or application data, thereby enabling the identification and processing of displayed content. This type of solution is suitable for fixed terminal environments and is feasible when the number of devices is small and the operating environment is relatively simple.

[0013] To at least solve the above problems, please refer to Figure 1 This invention provides a display control method based on a video stream, comprising the following steps: S1. Based on the video output interface of the target device, obtain the display screen of the target device; S2. Convert the displayed image into a video stream, and establish a unique transmission identifier for the video stream. Bind the video stream to the corresponding target device according to the transmission identifier. S3. The video stream is scored according to a preset judgment rule, and the video stream with a score greater than a first preset threshold is selected. S4. Block the images whose scores are greater than the first preset threshold, generate the final video stream, and transmit the final video stream to the target device for display according to the transmission identifier.

[0014] As described above, the beneficial effects of this invention are as follows: By directly acquiring the display screen from the video output interface of the target device and converting the display screen into a video stream for subsequent processing, unified analysis and control of the display content is achieved. Since this method does not interfere with the internal software system or running processes of the target device, but rather processes the content at the video output level, it avoids installing monitoring programs or modifying system configurations on the target device, fundamentally reducing system invasiveness and deployment complexity. Simultaneously, by establishing a unique transmission identifier for the video stream and binding it to the corresponding target device, the video content can always accurately correspond to the original device during subsequent processing and transmission, avoiding video mismatch issues in multi-device environments. Furthermore, by scoring the video stream and blocking images exceeding a preset threshold, the continuity of normal image display can be ensured while targeted control of abnormal or non-compliant images can be implemented, thereby achieving intelligent management and secure, controllable display of the display content and improving the overall reliability and controllability of the display system.

[0015] The video stream refers to the display image data stream output by the video output interface of the target device. During normal operation, regardless of the operating system or application running internally, the target device's display content ultimately needs to be converted into a display signal via the video output interface to drive the external display terminal for display. This invention is based on this display output characteristic, obtaining the display image from the target device's video output interface, rather than obtaining information from the target device's internal software system, application processes, or data interfaces.

[0016] Since the video stream originates from the display output layer of the target device, its acquisition process does not involve calling the target device's internal operating system, nor does it require intercepting, parsing, or modifying running application processes. Therefore, it is unnecessary to install any monitoring programs, plugins, or proxy components within the target device. The target device simply outputs the display screen according to its original operating mode. This invention can achieve analysis and control of the displayed content by externally processing the video stream formed by the displayed screen.

[0017] Furthermore, the scoring, filtering, and masking of the video stream in this invention are all completed outside the video output link. The processing results are re-output to the corresponding display terminal in the form of the final video stream for display, without affecting the program execution logic, data processing flow, or terminal resource allocation of the target device. Therefore, the display control solution based on video streams in this invention inherently possesses the characteristic of decoupling from the internal software system and running processes of the target device, ensuring, in principle, centralized analysis and display control of the displayed content without interfering with the internal operating state of the target device.

[0018] In some implementations, step S2 specifically includes: When the number of target devices is greater than one, the display screens of multiple target devices are converted into video streams, and the video streams are transmitted to a preset splitter station for splitting processing; A unique transmission identifier is established for each video stream, and each video stream is bound to the corresponding target device based on the transmission identifier.

[0019] As described above, for application scenarios with multiple target devices simultaneously, a distribution station is introduced to centrally process the display images of multiple target devices. By uniformly converting the display images of multiple target devices into video streams and transmitting them to a preset distribution station for distribution processing, the transmission and processing pressure on a single processing node in high-concurrency scenarios can be effectively reduced, improving the overall stability and scalability of the terminal. Furthermore, a unique transmission identifier is established for each video stream, and this identifier is bound to the corresponding target device. This ensures that even when multiple video streams are processed in parallel, the terminal can clearly distinguish video streams from different sources, thereby guaranteeing the accuracy of subsequent scoring, processing, and display feedback. This design allows for flexible expansion of the terminal when the number of target devices changes dynamically, enhancing the adaptability of the method in real-world large-scale application scenarios.

[0020] In some implementations, step S3 specifically includes: The system receives the video stream transmitted from the preset splitter station and detects the image category of the video stream. When the video stream has static images, it uses OCR to extract the data features of the video stream. When the video stream has dynamic images, a preset algorithm is used to perform behavior stripping on the video stream and obtain data features; When the image category of the video stream cannot be determined, data analysis is performed on the video stream to obtain data features; Based on the preset judgment rules, the video stream frames are scored according to the data features, and the frames with scores greater than a first preset threshold are selected.

[0021] As described above, differentiating video stream image categories allows for more suitable methods of data feature extraction for different types of images. When the video stream contains static images, extracting data features using OCR is beneficial for accurately identifying relatively stable information content within the image. When the video stream contains dynamic images, obtaining data features through behavior stripping avoids interference from dynamic changes on overall recognition accuracy. When image categories are difficult to assess directly, obtaining features through data analysis improves the terminal's ability to handle complex or unconventional images. This classification approach ensures comprehensive analysis while improving the targeting of data feature extraction, making the subsequent scoring process based on preset judgment rules more reasonable and stable. This design of differentiating processing by image type effectively reduces the risk of misjudgment that may arise from a single analysis method, improving the reliability of video stream image scoring results.

[0022] In some implementations, step S3, based on the preset judgment rule, scores the video stream frames according to the data features and filters out the frames whose scores exceed a first preset threshold, specifically includes: According to the preset judgment rule, the video stream is scored based on the data features. When the total score of the video stream is less than or equal to the second preset threshold, the corresponding video stream is directly transmitted to the target device for display according to the transmission identifier. When the total score of the video stream is greater than the second preset threshold and less than or equal to the first preset threshold, the video stream is saved and marked, and the corresponding video stream is directly transmitted to the target device for display according to the transmission identifier; When the total score of the video stream is greater than the first preset threshold, the video stream with a score greater than the first preset threshold is filtered out and the process proceeds to the next step.

[0023] As described above, by setting different scoring threshold ranges, a differentiated processing strategy is adopted for the video stream. When the total score of the video stream is less than or equal to the second preset threshold, the video stream is directly transmitted to the target device for display, which helps to ensure the real-time performance and smoothness of normal images. When the total score of the video stream is in the middle range (greater than the second preset threshold and less than or equal to the first preset threshold), the video stream is saved and marked, while still allowing its display, thus providing a basis for subsequent analysis or manual judgment. When the total score of the video stream exceeds the first preset threshold, only the corresponding high-scoring images are selected for subsequent processing steps, rather than processing the entire video stream uniformly, which helps to narrow the processing scope and reduce unnecessary image intervention. This hierarchical processing method allows the terminal to ensure security while also considering display efficiency and resource utilization.

[0024] In some implementations, step S4 specifically includes: Identify the target image region in the image where the score is greater than a first preset threshold, and perform a masking process on the target image region; The final video stream is generated based on the image after the masking process, and the final video stream is transmitted to the corresponding target device for display according to the transmission identifier.

[0025] As described above, images exceeding a first preset threshold are further defined as target image areas, and only these target image areas are masked, rather than the entire image being replaced. This localized processing method effectively controls abnormal display content while preserving the remaining normal display areas of the original image to the greatest extent possible, thereby minimizing the impact on the user's viewing experience. By generating a final video stream based on the masked image and accurately transmitting it to the corresponding target device for display according to the transmission identifier, consistency and traceability between the processing result and the original video source are ensured. This design makes the display control process more refined, which is beneficial for maintaining image continuity and display stability while meeting display management requirements.

[0026] In step S4, the target image area is subjected to a masking process, which specifically includes: The target image is replaced, obscured, or pixelated using at least one of the following methods:

[0027] As described above, the masking process offers three options: using custom graphics for occlusion, replacing custom graphics, or generating a mosaic effect on the target image. One or more of these options can be adaptively selected based on the display size of the target graphic. Furthermore, these three methods can be combined to mask the target image. For example, if the target image is an irregular graphic, partial replacement and partial mosaic effects may be used to mask the target image area, improving the flexibility of the masking process and preventing situations where the masked area is too large or the masking is incomplete.

[0028] Please refer to Figure 4 A video stream-based display control terminal 1 includes a memory 2, a processor 3, and a computer program stored in the memory 2 and running on the processor 3. When the processor 3 executes the computer program, it implements the steps of a video stream-based display control method.

[0029] A storage medium storing a computer program, which, when executed by a processor, constitutes a step in a video stream-based display control method.

[0030] Please refer to Figure 1 and Figure 2Embodiment 1 of the present invention is as follows: A video stream-based display control method is provided, applicable to scenarios involving centralized analysis and control of the display screen of a target device. The target device can be a computer, a work terminal, or other display device with a video output interface. This embodiment does not impose any limitations on the internal system structure or operating program of the target device.

[0031] The method includes the following steps.

[0032] First, step S1 is executed to acquire the display screen of the target device based on its video output interface. Specifically, during normal operation, the target device outputs a real-time display screen through its video output interface. This invention directly acquires the display screen at this video output level without installing any monitoring software or modifying its operating system configuration inside the target device, thus ensuring low intrusion into the target device's operating environment.

[0033] Subsequently, step S2 is executed, converting the displayed image into a video stream and establishing a unique transmission identifier for each video stream. The video stream is then bound to its corresponding target device based on the transmission identifier. In some embodiments, when the number of target devices is greater than one, the displayed images of multiple target devices are converted into video streams separately and transmitted uniformly to a preset distribution station for distribution processing. The distribution station is used to aggregate and distribute multiple video streams to reduce the transmission and processing pressure on a single processing node in a multi-device concurrent scenario. Simultaneously, by establishing a unique transmission identifier for each video stream and binding the transmission identifier to its corresponding target device, each video stream maintains its correspondence with its original target device during subsequent processing and return transmission, thereby avoiding video mismatch or display confusion.

[0034] Please refer to Figure 3 Step S3 is executed, where the video stream is scored according to preset judgment rules, and frames with scores greater than a first preset threshold are selected. In specific implementation, the terminal receives the video stream from the distribution station and first detects the frame category of the video stream for classification processing. When the video stream is detected to have static frame characteristics, OCR is used to extract data features from the video stream to obtain relatively stable text or image information in the frame; when the video stream is detected to have dynamic frame characteristics, a preset algorithm is used to strip the video stream of behavior and obtain corresponding data features to reduce the interference of dynamic changes in the frame on the recognition results; when the frame category of the video stream cannot be clearly evaluated, data analysis is performed on the video stream to obtain data features, thereby enhancing the processing capability for complex or unconventional frames. Optionally, a relay station can be established to receive the video stream transmitted by the distribution station, and the video stream is processed at the relay station according to step S3.

[0035] After acquiring data features, the video stream is scored based on preset judgment rules, and a tiered processing strategy is executed according to the scoring results. When the total score of the video stream is less than or equal to a second preset threshold (set 2 in the preset judgment rules), the video stream is considered to be within the normal range, and the terminal directly transmits the corresponding video stream to the target device for display according to the transmission identifier. When the total score of the video stream is greater than the second preset threshold and less than or equal to a first preset threshold (between set 1 and set 2 in the preset judgment rules), the video stream is saved and marked, while still transmitting the corresponding video stream to the target device for display according to the transmission identifier for subsequent analysis or manual judgment. When the total score of the video stream is greater than the first preset threshold (set 1 in the preset judgment rules), the frames with scores greater than the first preset threshold are filtered out and proceed to the next processing step. Through the above tiered processing method, targeted management of abnormal frames is achieved while ensuring real-time display.

[0036] The video stream is scored according to preset judgment rules, as follows: First, content tagging processing is performed on the acquired video stream to conduct an initial analysis of the video stream's content to determine whether the content is static.

[0037] When it is determined that the content of the video stream is static, the video stream is processed using OCR recognition to extract text information or image features from the video, and the corresponding static content score (VO) is calculated based on the extracted static content features.

[0038] When it is determined that the content of the video stream is not static, it is further determined whether the content of the video stream is dynamic.

[0039] When it is determined that the content of the video stream is dynamic content, behavior pattern recognition processing is performed on the video stream to extract and analyze the behavioral features that change over time in the picture, and the corresponding dynamic content score VS is calculated based on the dynamic behavioral features.

[0040] When the video stream's content does not meet either static or dynamic content characteristics, the video stream's content is identified as data pattern content. Data pattern analysis is then performed on the video stream to extract unconventional or difficult-to-classify data features, and the corresponding data content score (VD) is calculated based on these data features.

[0041] After calculating the static content score VO, dynamic content score VS, and data content score VD, the scores are summarized to obtain the total score S of the video stream, where: S = VO + VS + VD Subsequently, based on the comparison result between the total score S and the preset threshold, the video content is judged and processed.

[0042] When the total score S is greater than the first preset threshold, the video stream content is determined to be content that needs to be processed, and subsequent content processing steps are performed to replace, occlude, or perform other display control operations on the corresponding screen.

[0043] When the total score S is greater than the second preset threshold and less than or equal to the first preset threshold, the video stream content is determined to be savable content. The video stream is then saved and marked, and the video stream is allowed to continue to be transmitted and displayed for subsequent analysis or manual judgment.

[0044] When the total score S is less than or equal to the second preset threshold, the video stream content is determined to be normal, and the video stream is allowed to continue to be transmitted and displayed on the target device.

[0045] In addition, step S3 also includes the following steps: Obtain the current frame data or current time segment data in the video stream; determine the data type of the current frame data or current time segment data; when the data type is image data, convert the data into a static image and perform target recognition processing to obtain data features; When the data type is not image data, the time segment data is marked and stored, and video feature processing is performed to obtain data features; Based on the video feature processing results, determine whether depth processing is required, and perform depth analysis processing if depth processing is required.

[0046] Finally, step S4 is executed to mask the images with scores greater than a first preset threshold, generating a final video stream, which is then transmitted to the target device for display according to the transmission identifier. In specific implementation, the terminal identifies the target image region corresponding to the high-scoring image and only performs masking on that region, rather than replacing the entire image. The masking process can include methods such as occlusion, replacement, or mosaic, thereby effectively controlling abnormal display content while preserving the remaining normal display areas of the original image to the greatest extent possible. Subsequently, the final video stream is generated based on the masked image and accurately transmitted back to the corresponding target device for display via the transmission identifier, ensuring consistency and traceability between the processing result and the original video source.

[0047] Please refer to Figure 4 Embodiment two of the present invention is as follows: A video stream-based display control terminal 1 includes a memory 2, a processor 3, and a computer program stored in the memory 2 and running on the processor 3. When the processor 3 executes the computer program, it implements the steps of a video stream-based display control method.

[0048] The above description is merely an embodiment of the present invention and does not limit the patent scope of the present invention. Any equivalent modifications made based on the content of the present invention specification and drawings, or direct or indirect applications in related technical fields, are similarly included within the patent protection scope of the present invention.

Claims

1. A display control method based on video stream, characterized in that, Including the following steps: S1. Based on the video output interface of the target device, obtain the display screen of the target device; S2. Convert the displayed image into a video stream, and establish a unique transmission identifier for the video stream. Bind the video stream to the corresponding target device according to the transmission identifier. S3. The video stream is scored according to a preset judgment rule, and the video stream with a score greater than a first preset threshold is selected. S4. Block the images whose scores are greater than the first preset threshold, generate the final video stream, and transmit the final video stream to the target device for display according to the transmission identifier.

2. The display control method based on video stream according to claim 1, characterized in that, Step S2 specifically includes: When the number of target devices is greater than one, the display screens of multiple target devices are converted into video streams, and the video streams are transmitted to a preset splitter station for splitting processing; A unique transmission identifier is established for each video stream, and each video stream is bound to the corresponding target device based on the transmission identifier.

3. The display control method based on video stream according to claim 2, characterized in that, Step S3 specifically includes: The system receives the video stream transmitted from the preset splitter station and detects the image category of the video stream. When the video stream has static images, it uses OCR to extract the data features of the video stream. Based on the preset judgment rules, the video stream is scored according to the data features, and the video stream with scores greater than a first preset threshold is selected.

4. The display control method based on video stream according to claim 3, characterized in that, Step S3 specifically includes: When the video stream has dynamic images, a preset algorithm is used to perform behavior stripping on the video stream and obtain data features; Based on the preset judgment rules, the video stream is scored according to the data features, and the video stream with scores greater than a first preset threshold is selected.

5. The display control method based on video stream according to claim 3, characterized in that, Step S3 specifically includes: When the image category of the video stream cannot be determined, data analysis is performed on the video stream to obtain data features; Based on the preset judgment rules, the video stream is scored according to the data features, and the video stream with scores greater than a first preset threshold is selected.

6. A display control method based on video stream according to any one of claims 3-5, characterized in that, In step S3, based on the preset judgment rule, the video stream frames are scored according to the data features, and frames with scores exceeding a first preset threshold are selected. Specifically, this includes: According to the preset judgment rule, the video stream is scored based on the data features. When the total score of the video stream is less than or equal to the second preset threshold, the corresponding video stream is directly transmitted to the target device for display according to the transmission identifier. When the total score of the video stream is greater than the second preset threshold and less than or equal to the first preset threshold, the video stream is saved and marked, and the corresponding video stream is directly transmitted to the target device for display according to the transmission identifier; When the total score of the video stream is greater than the first preset threshold, the video stream with a score greater than the first preset threshold is filtered out and the process proceeds to the next step.

7. The display control method based on video stream according to claim 1, characterized in that, Step S4 specifically includes: Identify the target image region in the image where the score is greater than a first preset threshold, and perform a masking process on the target image region; The final video stream is generated based on the image after the masking process, and the final video stream is transmitted to the corresponding target device for display according to the transmission identifier.

8. The display control method based on video stream according to claim 7, characterized in that, In step S4, the target image area is subjected to a masking process, which specifically includes: The target image is replaced, obscured, or pixelated using at least one of the following methods:

9. A video stream-based display control terminal, comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the video stream-based display control method according to any one of claims 1-8.

10. A storage medium, characterized in that, The storage medium stores a computer program, which, when executed by a processor, implements the steps of the video stream-based display control method according to any one of claims 1-8.

Images