Information display method and device and electronic equipment

Abstract

The embodiment of the invention discloses an information display method and device and electronic equipment. An original image needing to be displayed is split into a plurality of first sub-images, each sub-image displays part of content in the original image, a noise image is generated at the same time, the noise image is split into a plurality of second sub-images, and the first sub-images and the corresponding second sub-images are fused to obtain a plurality of middle sub-images. And alternately displaying the plurality of intermediate sub-images to display the content of the original image. Therefore, on the premise that the visual experience of a user is not affected, the screen capture prevention and photographing prevention functions can be achieved, the user experience is improved, meanwhile, the method can be achieved on universal display equipment, and the universality of the display method is improved.

Description

Technical Field

[0001] This invention relates to the field of computer technology, and in particular to an information display method, apparatus, and electronic device. Background Technology

[0002] With the development of information technology, video conferencing and remote collaboration have brought convenience to work, but they have also increased the risk of sensitive information being leaked through photography or screenshots, posing a threat to information security.

[0003] In existing technologies, by adjusting the duty cycle of the PWM (Pulse Width Modulation) signal of the screen backlight, brightness fluctuations at a specific frequency are introduced. By taking advantage of the difference between the persistence of vision in the human eye and the imaging mechanism of a camera, it is difficult for the shooting device to obtain a clear image.

[0004] However, this technology relies on precise control of the screen's PWM dimming, which typically requires customized OLED (Organic Light-Emitting Diode) or LCD (Liquid Crystal Display) driver circuits, making it difficult to implement on general-purpose display devices. Furthermore, this method only affects optical photography and cannot prevent information leakage by directly reading video memory data through screenshot tools. In addition, improper PWM signal modulation may lead to display problems such as uneven screen brightness and flickering, affecting the normal visual experience. Summary of the Invention

[0005] In view of this, the purpose of this invention is to provide an information display method, apparatus, and electronic device that can achieve anti-screenshot and anti-photography functions without affecting the user's visual experience, thereby improving the user experience. At the same time, it can be implemented on general display devices, thereby improving the versatility of the display method.

[0006] In a first aspect, embodiments of the present invention provide an information display method, the method comprising: Obtain the original image that needs to be displayed; The original image is split into multiple first sub-images, and each first sub-image displays a portion of the content of the original image; Generate noisy images; The noisy image is split into multiple second sub-images, the number of which is the same as the number of first sub-images, and the display content of the noisy image is assigned to different second sub-images; Each first sub-image is fused with its corresponding second sub-image to obtain multiple intermediate sub-images; The plurality of intermediate sub-images are displayed alternately.

[0007] In some embodiments, obtaining the original image to be displayed includes: Receive the compressed stream sent by the sending end; The compressed stream is decoded to obtain a video stream; Convert the video stream into image frames of a predetermined format; The image frames are adjusted according to the screen resolution of the receiving end, and the timestamps of each image frame are calibrated to obtain the original image.

[0008] In some embodiments, splitting the original image into a plurality of first sub-images includes: Determine the region of interest in the original image, the region of interest including at least one of a text region and an icon region; The original image is divided into multiple first sub-images based on the regions of interest, wherein each region of interest is divided into multiple sub-regions, and each sub-region is assigned to a different first sub-image.

[0009] In some embodiments, determining the region of interest in the original image includes: The original image is identified based on a pre-trained recognition model to obtain candidate regions, which are text regions or icon regions. Obtain the text information in the candidate region; The text information is matched with predetermined keywords; Candidate regions that match the keywords are identified as regions of interest.

[0010] In some embodiments, splitting the original image into a plurality of first sub-images according to the region of interest includes: The number of segments for the first sub-image is determined based on the upper limit of the screen refresh rate at the receiving end and the predetermined frequency that the human eye can recognize. The original image is split into multiple first sub-images based on the number of splits.

[0011] In some embodiments, splitting the original image according to the number of splits to obtain a plurality of first sub-images includes at least one of the following: The region of interest is divided into multiple sub-regions by pixel column group splitting. The region of interest is divided into multiple sub-regions using a checkerboard pattern. The region of interest is divided into multiple sub-regions by random partitioning. The region of interest is divided into multiple sub-regions according to the character splitting method; The region of interest is split into multiple sub-regions according to the row segmentation method; The region of interest is divided into multiple sub-regions according to the frequency domain filtering method.

[0012] In some embodiments, splitting the original image into a plurality of first sub-images according to the region of interest includes: Obtain the display brightness at the receiving end; The size of the missing area is adjusted according to the display brightness, wherein the missing area is the missing part of the region of interest.

[0013] In some embodiments, the method further includes: The multiple first sub-images are verified based on whether they have been synthesized into a complete original image.

[0014] In some embodiments, generating a noisy image includes: A single-cycle noise matrix is ​​generated based on the preset minimum periodic cell size and noise type; The number of repetitions is determined based on a single-period noise matrix and a target size, wherein the number of repetitions includes horizontal repetitions and vertical repetitions, and the target size is determined based on a first sub-image. An intermediate matrix is ​​generated based on the single-cycle noise matrix and the number of repetitions. The noise image is generated based on the intermediate matrix and the target size.

[0015] In some embodiments, the noise type is solid color or texture.

[0016] In some embodiments, fusing each of the first sub-images with the corresponding second sub-image to obtain a plurality of intermediate sub-images includes: Each first sub-image is merged with its corresponding second sub-image according to a preset transparency to obtain multiple intermediate sub-images, wherein the transparency of the second sub-image is less than that of the first sub-image.

[0017] In some embodiments, the alternating display of the plurality of intermediate sub-images includes: Get the upper limit of the screen refresh rate of the receiving end; In response to the screen refresh rate upper limit being greater than or equal to a preset threshold, the plurality of intermediate sub-images are displayed alternately.

[0018] Secondly, embodiments of the present invention provide an information display device, the device comprising: The original image acquisition unit is used to acquire the original image that needs to be displayed. The first splitting unit is used to split the original image into multiple first sub-images, each of which displays a portion of the content in the original image. A noise image generation unit is used to generate noise images; The second splitting unit is used to split the noise image into multiple second sub-images, the number of which is the same as the number of the first sub-images, and the display content of the noise image is assigned to different second sub-images; A fusion unit is used to fuse each of the first sub-images with the corresponding second sub-images to obtain multiple intermediate sub-images; The display unit is used to alternately display the plurality of intermediate sub-images.

[0019] Thirdly, embodiments of the present invention provide an electronic device, including a memory and a processor, wherein the memory is used to store one or more computer program instructions, wherein the one or more computer program instructions are executed by the processor to implement the method as described in the first aspect.

[0020] The technical solution of this invention splits the original image to be displayed into multiple first sub-images, each sub-image displaying a portion of the original image. Simultaneously, a noisy image is generated and split into multiple second sub-images. Each first sub-image is merged with its corresponding second sub-image to obtain multiple intermediate sub-images. These intermediate sub-images are then displayed alternately to show the content of the original image. Therefore, anti-screenshot and anti-photography functions can be achieved without affecting the user's visual experience, improving the user experience. Furthermore, it can be implemented on general-purpose display devices, enhancing the versatility of the display method. Attached Figure Description

[0021] The above and other objects, features and advantages of the present invention will become clearer from the following description of embodiments of the invention with reference to the accompanying drawings, in which: Figure 1 This is a schematic diagram of an information display system according to an embodiment of the present invention; Figure 2 This is a flowchart of the information display method according to an embodiment of the present invention; Figure 3 This is a flowchart of the process of acquiring the original image according to an embodiment of the present invention; Figure 4 This is a flowchart of obtaining the first sub-image according to an embodiment of the present invention; Figure 5 This is a flowchart of obtaining the region of interest according to an embodiment of the present invention; Figure 6 This is a flowchart of how the original image is split into a first sub-image according to an embodiment of the present invention; Figure 7This is a schematic diagram of the splitting process according to an embodiment of the present invention; Figure 8 This is a flowchart illustrating the generation of a noisy image according to an embodiment of the present invention; Figure 9 This is a schematic diagram of splitting a noisy image according to an embodiment of the present invention; Figure 10 This is a schematic diagram of the fused image according to an embodiment of the present invention; Figure 11 This is a schematic diagram showing alternating embodiments of the present invention; Figure 12 This is a schematic diagram of an information display device according to an embodiment of the present invention; Figure 13 This is a schematic diagram of an electronic device according to an embodiment of the present invention. Detailed Implementation

[0022] The present application is described below based on embodiments, but it is not limited to these embodiments. In the detailed description of the present application below, certain specific details are described in detail. Those skilled in the art can fully understand the present application without these details. To avoid obscuring the substance of the present application, well-known methods, processes, flows, elements, and circuits are not described in detail.

[0023] Furthermore, those skilled in the art should understand that the accompanying drawings provided herein are for illustrative purposes only and are not necessarily drawn to scale.

[0024] Unless the context explicitly requires it, words such as "including" or "contains" throughout the application should be interpreted as including rather than exclusive or exhaustive; that is, meaning "including but not limited to".

[0025] In the description of this application, it should be understood that the terms "first," "second," etc., are used for descriptive purposes only and should not be construed as indicating or implying relative importance. Furthermore, in the description of this application, unless otherwise stated, "a plurality of" means two or more.

[0026] The solutions described in this specification and embodiments, if involving the processing of personal information, will be processed only on the premise of having a legal basis (such as obtaining the consent of the personal information subject, or being necessary for the performance of a contract), and will only be processed within the scope stipulated or agreed upon. A user's refusal to process personal information beyond what is necessary for basic functions will not affect the user's use of basic functions.

[0027] With the development of information technology and the deepening of digital transformation, new work models such as remote work, online collaboration, and cloud conferencing have become an important part of modern society. In many application scenarios, document review involving sensitive information, remote reporting of classified materials, and technical exchanges of trade secrets often require real-time collaborative processing through screen sharing. However, while this convenient information interaction method improves work efficiency, it also brings serious information security challenges. When users use public equipment, remote conferencing systems, or shared office environments, the confidential content displayed on their screens may be at risk of being illegally obtained. One of the most common and difficult-to-prevent methods is through external shooting devices (such as smartphones and digital cameras) or through system-level or application-level screenshot / screen recording tools.

[0028] To address these security threats, the industry has proposed various technologies to enhance screen content's ability to prevent screenshots and photographs. One such technology is based on Pulse Width Modulation (PWM). The basic principle of PWM is to dynamically adjust the duty cycle of the screen backlight or pixel drive signal, introducing high-frequency brightness fluctuations over time. Because the human eye has a persistence of vision and a certain integral response characteristic, it can smoothly perceive these rapidly changing light intensities, thus maintaining a normal visual experience. However, most digital cameras, due to their rolling shutter or global shutter mechanisms, are extremely sensitive to brightness changes during exposure. Therefore, during shooting, a mismatch between the camera's shutter frequency and the PWM signal frequency can cause stripes, flickering, or content loss, thus damaging the captured content.

[0029] However, this technology heavily relies on the display device's underlying driver circuitry's ability to precisely control PWM signals. Especially for OLED or LCD screens, customized display driver ICs are required to support multi-region, high-precision, and programmable PWM output. However, most current terminal devices (such as laptops, tablets, and mobile phones) use standardized, integrated driver solutions, lacking open control interfaces for PWM parameters, making it difficult to deploy and promote this technology on general-purpose devices. Secondly, this method primarily targets external shooting based on optical imaging, and is ineffective for screen capture and recording software that directly extracts image data from the system's framebuffer or GPU output stream. Since these tools bypass the physical display process and directly obtain raw pixel information, they can obtain a complete and clear image copy regardless of screen brightness fluctuations. Furthermore, frequent or drastic PWM modulation can negatively impact the screen's visual quality, causing perceptible flicker, uneven brightness, and color distortion. Prolonged use may lead to user eye fatigue and reduce the human-computer interaction experience.

[0030] Therefore, this invention proposes an information display method to solve the above-mentioned technical problems.

[0031] Figure 1 This is a schematic diagram of an information display system according to an embodiment of the present invention. Figure 1 As shown, the information display system of this embodiment includes a transmitting end 1, a receiving end 2, and a network 3. Data transmission between the transmitting end 1 and the receiving end 2 is conducted via the network 3.

[0032] This embodiment of the invention uses a screen sharing scenario as an example for illustration. Sending end 1 refers to the terminal device actively sharing screen content, responsible for capturing the local screen (including the desktop, application windows, cursor movement, etc.), encoding and compressing this video data, and sending it out via network 3. Receiving end 2 refers to the device that receives and displays the screen content shared by others. Specifically, it receives the encoded video stream from sending end 1, decodes it, and displays it on the screen, allowing the user to see the shared content from the sending end.

[0033] Among them, Network 3 can be implemented through a local area network (LAN), a wide area network (WAN), the Internet, a wireless local area network (Wi-Fi), a cellular mobile communication network (such as 4G, 5G), a Bluetooth network, or any combination thereof.

[0034] For ease of understanding and description, this embodiment of the invention uses the direct data transmission between the sending end 1 and the receiving end 2 via network 3 as an example to illustrate the process of sending, receiving, and displaying screen data. However, it should be understood that this simplified description is only used to clarify the core technical principles of the invention and does not limit its actual deployment architecture. For example, in practical application scenarios, especially in implementations based on applications or lightweight operating environments (such as mini-programs or web applications), the sending end 1 and the receiving end 2 typically do not establish a direct point-to-point connection, but rather rely on a server system deployed in the cloud for relay or collaboration.

[0035] It should be noted that the technical solutions of this invention are not limited to screen sharing applications. The method and apparatus for receiving, decoding, and displaying remote screen content proposed herein are also applicable to other scenarios that require the presentation of a remote graphical interface. For example, they can be applied to screen rendering for remote desktop access, graphics output display in virtual machine or container environments, client-side screen playback in video systems, and result display for cloud-based graphics-intensive applications (such as CAD and 3D rendering).

[0036] Figure 2 This is a flowchart of an information display method according to an embodiment of the present invention. For example... Figure 2 As shown, the information display method of this invention is applicable to the receiving end and specifically includes the following steps: Step S100: Obtain the original image to be displayed.

[0037] In this embodiment, a shared screen scenario is used as an example for illustration. The original image to be displayed is a video frame obtained after processing the received video stream.

[0038] Specifically, Figure 3 This is a flowchart illustrating the acquisition of the original image according to an embodiment of the present invention. Figure 3 As shown, obtaining the original image to be displayed includes the following steps: Step S110: Receive the compressed stream sent by the sending end.

[0039] In this embodiment, the sending end captures screen content according to user needs, obtaining a sequence of raw image frames. Screen capture can be performed on the entire desktop, a specified application window, a browser tab, or a user-selected area, depending on the sharing mode and user configuration. Then, the sending end encodes the captured raw image frames to generate a compressed video data stream. The encoding process can employ standard video compression algorithms, such as H.264 (AVC), H.265 (HEVC), VP8, VP9, ​​or AV1. After encoding, the sending end encapsulates the compressed video data into data packets suitable for network transmission, i.e., a compressed stream, and sends it to one or more receiving devices via the communication network. In a server-based relay architecture, the compressed stream can first be uploaded to a signaling or media server, and then forwarded by the server to the receiving end. The compressed stream is sent to the receiving end in the form of data packets.

[0040] Step S120: Decode the compressed stream to obtain a video stream.

[0041] In this embodiment, the receiving end receives data packets sent by the sending end. These data packets encapsulate a compressed stream generated by a video encoder. The receiving end decapsulates the received data packets to obtain the compressed stream, which is compressed video data. This allows fragments transmitted over the network to be organized into a standard format recognizable by the decoder. Then, decoding restores the compressed video data to its original pixel values, yielding the original uncompressed video stream.

[0042] Step S130: Convert the video stream into image frames of a predetermined format.

[0043] In this embodiment, each video frame in the video stream is generally in YUV (luminance and chrominance) format obtained by decoding. The YUV format is converted into an image frame of a predetermined format, wherein the predetermined format can be RGB (Red Green Blue, the three primary color space).

[0044] Step S140: Adjust the image frames according to the screen resolution of the receiving end, and calibrate the timestamps of each image frame to obtain the original image.

[0045] In this embodiment, adjusting the resolution aims to adapt the decoded image frames to the target display area, ensuring a complete, proportionally correct, and distortion-free image. The target display area is the local display area, which may be the full-screen or application window size. Based on the image frame resolution and the target display window size, a target size that "maintains the aspect ratio while filling the window as much as possible" is calculated. Then, an image scaling algorithm is used to shrink or enlarge the original image to this target size.

[0046] For example, assuming the image resolution is 1920×1080 and the target display area size is 800×600, we adapt the image by width and height respectively, taking the smaller result to avoid overflow. Specifically, for width adaptation, the target height is 800 / (16 / 9) = 450, so the scaled size is 800×450; for height adaptation, the target width is 600×(16 / 9) ≈ 1067, so the scaled size is 1067×600. However, 1067 is greater than 800, exceeding the window width and therefore not feasible. Thus, the smaller 800×450 is chosen as the target size. After obtaining the target size, the 1920×1080 image frame is scaled down to 800×450 using a resampling algorithm to obtain the original image.

[0047] In some embodiments, to ensure that each original image plays at the correct pace and avoids stuttering, frame skipping, or audio-visual desynchronization, timestamp calibration is required. Specifically, each decoded image frame carries a Presentation Time Stamp (PTS), generated by the sending end, indicating when this frame should be displayed. Different devices have different clock frequencies, so the received PTS needs to be converted to the receiver's local clock reference. The receiver maintains a local playback clock, setting a reference time offset for the initial frame, and subsequent frames calculate their actual playback time based on this offset.

[0048] Step S200: Divide the original image into multiple first sub-images.

[0049] In this embodiment, the original image is split into multiple first sub-images, and each first sub-image displays a portion of the content in the original image.

[0050] Figure 4 This is a flowchart illustrating the acquisition of the first sub-image according to an embodiment of the present invention. For example... Figure 4 As shown, splitting the original image into multiple first sub-images includes the following steps: Step S210: Determine the region of interest in the original image.

[0051] In this embodiment, the original image is identified based on a pre-trained recognition model to obtain the region of interest (ROI) in the original image, wherein the ROI is the region that needs to be segmented. The ROI includes at least one of text regions and icon regions.

[0052] Figure 5 This is a flowchart illustrating the process of obtaining the region of interest according to an embodiment of the present invention. For example... Figure 5 As shown, determining the region of interest in the original image includes the following steps: Step S211: Recognize the original image based on the pre-trained recognition model to obtain candidate regions.

[0053] In this embodiment, a pre-trained recognition model is obtained, and the original image is input into the recognition model. The recognition model is used to locate and classify content regions with specific attributes from the original image, such as text regions or chart regions. The content regions can be set according to the specific application scenario. After training, the recognition model can output the category confidence and geometric position parameters of each content region, such as bounding box coordinates. The recognized content regions are used as candidate regions.

[0054] The recognition model can be implemented using YOLO (You Only Look Once) series, Faster R-CNN (Region-based Convolutional Neural Network), or Transformer-based models. YOLO series models directly regress bounding box coordinates and class probabilities through a single forward propagation, offering advantages such as fast inference speed and low computational cost, making them suitable for scenarios with high real-time requirements. The Faster R-CNN model first generates intermediate regions through a Region Proposal Network (RPN), then classifies and refines the positions of these intermediate regions to obtain candidate regions. Transformer-based models introduce a self-attention mechanism to model global contextual relationships, eliminating reliance on post-processing steps such as Non-Maximum Suppression (NMS), and possess stronger long-range dependency modeling capabilities, making them suitable for detecting content regions in complex backgrounds or densely packed areas. By employing the above recognition models, this step can automatically, accurately, and efficiently identify content regions in images without manual intervention, significantly improving the accuracy and robustness of subsequent processing (such as OCR, image segmentation, content moderation, and defect detection).

[0055] Step S212: Obtain the text information in the candidate region.

[0056] In this embodiment, text information in each candidate region is extracted using OCR (Optical Character Recognition).

[0057] Step S213: Match the text information with predetermined keywords.

[0058] In this embodiment, keywords are set according to actual application requirements. These keywords are used to indicate information in the original image that needs to be protected against being photographed / screenshotted. The keywords can be precise keywords, regular expression patterns, fuzzy keywords, semantically expanded words, etc. The extracted text information in the candidate regions is matched with the keywords.

[0059] Step S214: Determine the candidate regions that match the keywords as the regions of interest.

[0060] In this embodiment, the extracted text information in the candidate regions is matched with the keywords. When a match is successful, the corresponding candidate region is considered a region of interest.

[0061] Step S220: Divide the original image into multiple first sub-images according to the region of interest.

[0062] In this embodiment, after obtaining the region of interest, the original image is divided into multiple first sub-images based on the region of interest. Each region of interest is further divided into multiple sub-regions, and each sub-region is assigned to a different first sub-image.

[0063] Figure 6 This is a flowchart illustrating how an original image is split into a first sub-image according to an embodiment of the present invention. For example... Figure 6 As shown, splitting the original image into multiple first sub-images based on the region of interest includes the following steps: Step S221: Determine the number of segments for the first sub-image based on the upper limit of the screen refresh rate of the receiving end and the predetermined human eye-recognizable frequency.

[0064] In this embodiment, based on the persistence of vision phenomenon, the human eye has a limited ability to perceive flicker, with a persistence of vision time of approximately 1 / 16 to 1 / 25 of a second. This means that when the screen refreshes at a rate of 16 to 25 frames per second (fps) or higher, the human eye perceives the image as continuous, rather than as discrete flickering. To achieve a smoother, flicker-free visual effect, this invention sets a predetermined frequency that is perceptible to the human eye, such as 30 fps. Simultaneously, the upper limit of the receiving end's screen refresh rate is obtained, i.e., the maximum refresh rate of the receiving end's screen, which refers to the maximum number of times the screen can update the image per second. For example, if the receiving end's screen is nominally rated at 120Hz, it means its maximum refresh rate is 120 frames per second. The number of segments for the first sub-image is determined based on the upper limit of the receiving end's screen refresh rate and the predetermined frequency that is perceptible to the human eye.

[0065] The process of determining the number of segments for the first sub-image based on the upper limit of the screen refresh rate at the receiving end and a predetermined human eye-recognizable frequency includes: obtaining a minimum number of segments, which is set to 2 in this embodiment; and rounding down the ratio of the upper limit of the screen refresh rate at the receiving end to the predetermined human eye-recognizable frequency to obtain a maximum number of segments. The number of segments for the first sub-image can be set to any positive integer greater than or equal to the minimum number of segments and less than or equal to the maximum number of segments. For example, assuming the predetermined human eye-recognizable frequency is 30fps and the upper limit of the screen refresh rate is 120Hz, the maximum number of segments is 4. Therefore, the number of segments for the first sub-image can be set to any value among 2, 3, and 4.

[0066] Step S222: Divide the original image into multiple first sub-images according to the number of divisions.

[0067] In this embodiment, the original image is split into multiple first sub-images based on the number of splits and the region of interest (ROI). Specifically, the ROI is split into multiple sub-regions according to a predetermined splitting rule, and the number of sub-regions is the number of splits. Then, multiple sub-images are generated based on the multiple sub-regions. Each sub-image contains one sub-region of the ROI, and the sub-regions of all sub-images can be seamlessly stitched together to form a complete ROI. Except for the sensitive region, the remaining pixels of all sub-images are consistent with the original image and are identical to each other.

[0068] The predetermined splitting rules include one or more combinations of pixel column group splitting, checkerboard splitting, random splitting, character splitting, row segmentation splitting, and frequency domain filtering splitting.

[0069] That is, splitting the original image according to the number of splits to obtain multiple first sub-images includes at least one of the following steps S2221-S2226: Step S2221: Divide the region of interest into multiple sub-regions by pixel column group splitting.

[0070] In this embodiment, a vertical baseline is established at the left boundary of the region of interest, marked as the starting column, and a vertical baseline is established at the right boundary of the region of interest, marked as the ending column. Starting from the starting column, consecutive pixel columns are sequentially extracted according to a fixed width (or a preset rule width) to form several pixel column groups. If the last group is insufficient in width, all remaining columns are included in that group. Pixel column groups are assigned to each sub-region according to the number of divisions. For example, assuming the number of divisions is 2, the first sub-region contains only odd-numbered column groups, and the second sub-region contains only even-numbered column groups.

[0071] Step S2222: Divide the region of interest into multiple sub-regions using a checkerboard pattern.

[0072] In this embodiment, the bounding rectangle of the region of interest is determined, and a virtual chessboard is built within this rectangle. For example, a fixed width and height (e.g., 8×8 pixels) is set for each individual cell. Based on the splitting requirements, the cells are allocated to obtain cell groups equal to the number of splits, and a sub-region is generated for each cell group.

[0073] Step S2223: Divide the region of interest into multiple sub-regions by random splitting.

[0074] In this embodiment, a local coordinate system is established at the pixel level, using the bounding rectangle of the region of interest as the boundary. If the width and height of the outer rectangle are W×H, then W×H pixels are obtained. A pseudo-random number generator is initialized using a preset seed (or key) to generate a non-repeating integer permutation of length W×H, i.e., from 0 to... The random result is then divided into N segments (N being the number of segments). Each segment is a pixel group. The index of each pixel group is converted back to (x, y) coordinates to obtain the corresponding real pixel set. The pixels within this pixel set are retained to obtain the sub-region.

[0075] Step S2224: Divide the region of interest into multiple sub-regions according to the character splitting method.

[0076] In this embodiment, after determining the boundaries of the characters, the system is divided into multiple sub-regions based on the characters themselves.

[0077] Step S2225: Divide the region of interest into multiple sub-regions according to the row segmentation method.

[0078] In this embodiment, after determining the boundaries of the rows, the system is divided into multiple sub-regions based on the row units.

[0079] Step S2226: Divide the region of interest into multiple sub-regions according to the frequency domain filtering method.

[0080] In this embodiment, the region of interest is transformed from the spatial domain to the frequency domain, resulting in a complex spectrum. Low-frequency components are shifted to the center of the spectrum, constructing multiple bandpass filters, each corresponding to a different frequency band. Each filter is multiplied by the spectrum to extract components of a specific frequency band. An inverse Fourier transform (IFFT) is performed on each filtered spectrum to obtain a sub-region of the corresponding frequency band.

[0081] Figure 7 This is a schematic diagram of the splitting process according to an embodiment of the present invention. Figure 7 In the embodiment shown, the number of splits is 2, and the splitting method is checkerboard splitting, specifically: for the original image P O The region of interest is identified and extracted. Figure 7 In the embodiment shown, the original image P O The content area consists of two parts: the numbers "123" and the letters "abc". Through keyword matching, the region containing the numbers "123" is identified as the region of interest (ROI). Extracting the ROI yields image P. R Then, based on the checkerboard pattern segmentation method, the image P of the region of interest is processed. R The region is split to obtain sub-region P. SR1 and P SR2 Keeping all regions except the region of interest unchanged, replace the region of interest with a sub-region to obtain sub-region P. SR1 and P SR2 The corresponding first sub-image P SO1 and P SO2 .

[0082] In some embodiments, to further optimize eye comfort, the area of ​​the missing region can be adjusted. Specifically, the display brightness of the receiving end is obtained, and the size of the missing region is adjusted according to the display brightness, wherein the missing region is the missing part of the region of interest. As described above, after splitting, the region of interest in the first sub-image is a part of the original, and the missing part is white. If the connected area of ​​the missing region is too large, the screen brightness will be higher than the original image during alternating display. Therefore, the area of ​​the missing region can be automatically adjusted according to the current screen brightness of the receiving end, for example, by adjusting the width of the pixel column group or the size of the checkerboard. The specific adjustment principle is that the higher the current screen brightness of the receiving end, the smaller the area of ​​the missing region. Taking the pixel column group splitting method as an example, when the brightness is greater than 400 cd / m², the pixel column width is ≤ 5 pixels, and when the brightness is ≤ 400 cd / m², the width is ≤ 8 pixels to avoid flickering effects.

[0083] In some embodiments, after splitting into multiple first sub-images, integrity can be verified to ensure complete subsequent display. Specifically, the multiple first sub-images are verified based on whether they can be synthesized into a complete original image. If they can, the verification passes; otherwise, the verification fails.

[0084] Step S300: Generate a noisy image.

[0085] In this embodiment, in order to further improve the effect of preventing photos from being taken and screenshots from being captured, a periodic noise matrix can be superimposed on each first sub-image.

[0086] Figure 8 This is a flowchart of generating a noisy image according to an embodiment of the present invention, such as... Figure 8 As shown, generating a noisy image includes the following steps: Step S310: Generate a single-cycle noise matrix based on the preset minimum periodic unit size and noise type.

[0087] In this embodiment, the idea behind generating a noisy image is to first generate a small noise matrix, called a single-period noise matrix, and then continuously copy the single-period noise matrix to obtain a noise matrix of the same size as the first sub-image, thus obtaining the noisy image. Therefore, a minimum periodic unit size can be preset, which is the size of the single-period noise matrix, denoted as pH × pW, where pH is the height and pW is the width. pH and pW can be the same or different. In some embodiments, pH and pW are less than or equal to 14. The noise type represents the display effect of the noisy image, which can be a solid color or a texture.

[0088] Create a blank canvas of pH×pW×C, where C is the color channel. If a grayscale image is desired, C=1; if a color image is desired, C=3, corresponding to the R, G, and B components, respectively. This embodiment uses a grayscale image as an example. The target grayscale value V is determined according to the noise type, with V ranging from 0 to 255. V is then filled into the blank canvas to obtain a single-cycle noise matrix M. In some embodiments, the value of V is set around 128.

[0089] Step S320: Determine the number of repetitions based on the single-period noise matrix and the target size. The number of repetitions includes the number of horizontal repetitions and the number of vertical repetitions. The target size is determined based on the first sub-image.

[0090] In this embodiment, the size of the first sub-image is determined as the target size, denoted as (H, W), and the size of the single-period noise matrix M is (pH, pW). The number of lateral repetitions is determined. ; number of vertical repetitions , This indicates that X is rounded up.

[0091] Step S330: Generate an intermediate matrix based on the single-cycle noise matrix and the number of repetitions.

[0092] In this embodiment, the single-cycle noise matrix M is copied rx times horizontally and ry times vertically to obtain an intermediate matrix T. The size of the intermediate matrix T may be equal to or larger than the target size.

[0093] Step S340: Generate the noise image based on the intermediate matrix and the target size.

[0094] In this embodiment, the first H rows and the first W columns are cropped from the intermediate matrix T to obtain the final noisy image, which has the same shape as the first sub-image.

[0095] Step S400: Divide the noisy image into multiple second sub-images.

[0096] In this embodiment, the noisy image is split into multiple second sub-images, the number of which is the same as the number of the first sub-images, and the display content of the noisy image is assigned to different second sub-images.

[0097] Figure 9 This is a schematic diagram of a split noise image according to an embodiment of the present invention. Figure 9 As shown, the noisy image P Z The image is a grayscale image, which is then split into multiple second sub-images P according to a predetermined splitting rule. SZ1 and P SZ2 ,exist Figure 9 In the illustrated embodiment, the pixel row group splitting method is used as an example for explanation.

[0098] The predetermined splitting rules include one or more combinations of pixel column group splitting, checkerboard splitting, random splitting, character splitting, row segmentation splitting, and frequency domain filtering splitting.

[0099] It should be noted that, Figure 9 The illustrated embodiment uses the complete splitting of a noisy image as an example, but the embodiments of the present invention do not limit the splitting region. For example, in some embodiments, only a portion of it may be split. Specifically, based on the location of the region of interest in the original image, the same region in the noisy image is determined as the splitting region, and then the splitting region is split. The splitting method can be based on one or more of the following combinations: pixel column group splitting, checkerboard splitting, random splitting, character splitting, row segmentation splitting, and frequency domain filtering splitting.

[0100] Step S500: Merge each of the first sub-images with the corresponding second sub-images to obtain multiple intermediate sub-images.

[0101] In this embodiment, each first sub-image is fused with its corresponding second sub-image according to a preset transparency level to obtain multiple intermediate sub-images, wherein the transparency of the second sub-image is less than that of the first sub-image. That is, the second sub-image is superimposed on the first sub-image with low transparency.

[0102] Specifically, for transparency α, the value range is [0, 1]. When α=0 for the second sub-image, the second sub-image is completely transparent and the first sub-image is completely visible; when α=1 for the second sub-image, the second sub-image is completely opaque and the first sub-image is completely invisible.

[0103] Assuming the transparency of the second sub-image is α, then .

[0104] Figure 10 This is a schematic diagram of the fused image according to an embodiment of the present invention. Figure 10 As shown, each first sub-image is fused with its corresponding second sub-image to obtain the corresponding intermediate sub-image. Figure 10 In the embodiment shown, the first sub-image P SO1 With the second sub-image P SZ1 The images are fused together to obtain the intermediate image P. SM1 The first sub-image P SO2 With the second sub-image P SZ2 The images are fused together to obtain the intermediate image P. SM2 .

[0105] Step S600: Alternately display the plurality of intermediate sub-images.

[0106] In this embodiment, the intermediate sub-images are displayed alternately to achieve image display.

[0107] Specifically, the upper limit of the screen refresh rate of the receiving end is obtained, and in response to the upper limit of the screen refresh rate being greater than or equal to a preset threshold (such as 60fps), the plurality of intermediate sub-images are displayed alternately. That is, when the upper limit of the screen refresh rate is greater than the predetermined threshold, the high refresh rate required by the embodiments of the present invention can be met.

[0108] Furthermore, a lightweight plugin is overlaid at the forefront of the screen, which independently controls the switching of intermediate sub-images. In some embodiments, the lightweight plugin controls the intermediate sub-images to be output alternately at the highest refresh rate and displayed in the plugin at the forefront of the screen.

[0109] Figure 11 This is a schematic diagram showing alternating embodiments of the present invention. For example... Figure 11 As shown, the plurality of intermediate sub-images P are displayed alternately. SM1 and P SM2Due to the persistence of vision, the image perceived by the human eye is P. F In the final display, the content shown is completely identical to the original image. The effect is equivalent to overlaying a nearly transparent layer of noise onto the original image. By adjusting the transparency appropriately, the impact on user perception is minimal. However, when the user takes a photo or screenshot, only the intermediate sub-image P is captured. SM1 and P SM2 However, it cannot capture the complete image.

[0110] In summary, this invention utilizes the persistence of vision to prevent photos from being taken or screenshots from being captured. By employing a dynamic segmentation strategy, the original image is divided into multiple complementary first sub-images, which are then displayed alternately at a high refresh rate. This causes the human eye to perceive the complete image due to persistence of vision, while the camera shutter, with its fixed exposure time, can only capture a single incomplete frame. Similarly, a screenshot can only capture a single incomplete frame, thus achieving content protection. Simultaneously, a periodic noise matrix is ​​superimposed when processing each first sub-image, enhancing the moiré effect generated by the camera sensor and amplifying temporal defocusing. This results in interference fringes and dynamic blurring due to focusing difficulties, further compromising image integrity and clarity.

[0111] This invention, in its embodiments, splits the original image to be displayed into multiple first sub-images, each sub-image displaying a portion of the original image. Simultaneously, a noisy image is generated and split into multiple second sub-images. Each first sub-image is merged with its corresponding second sub-image to obtain multiple intermediate sub-images. These intermediate sub-images are then displayed alternately to show the content of the original image. Therefore, anti-screenshot and anti-photography functions can be achieved without affecting the user's visual experience, improving the user experience. Furthermore, it can be implemented on general-purpose display devices, enhancing the versatility of the display method.

[0112] Figure 12 This is a schematic diagram of an information display device according to an embodiment of the present invention. Figure 12As shown, the information display device includes an original image acquisition unit 121, a first splitting unit 122, a noisy image generation unit 123, a second splitting unit 124, a fusion unit 125, and a display unit 126. The original image acquisition unit 121 acquires the original image to be displayed. The first splitting unit 122 splits the original image into multiple first sub-images, each first sub-image displaying a portion of the original image. The noisy image generation unit 123 generates a noisy image. The second splitting unit 124 splits the noisy image into multiple second sub-images, the number of which is the same as the number of first sub-images, and the content to be displayed in the noisy image is allocated to different second sub-images. The fusion unit 125 fuses each first sub-image with its corresponding second sub-image to obtain multiple intermediate sub-images. The display unit 126 alternately displays the multiple intermediate sub-images.

[0113] This invention, in its embodiments, splits the original image to be displayed into multiple first sub-images, each sub-image displaying a portion of the original image. Simultaneously, a noisy image is generated and split into multiple second sub-images. Each first sub-image is merged with its corresponding second sub-image to obtain multiple intermediate sub-images. These intermediate sub-images are then displayed alternately to show the content of the original image. Therefore, anti-screenshot and anti-photography functions can be achieved without affecting the user's visual experience, improving the user experience. Furthermore, it can be implemented on general-purpose display devices, enhancing the versatility of the display method.

[0114] Figure 13 This is a schematic diagram of an electronic device according to an embodiment of the present invention. In this embodiment, the electronic device 13 includes a server, a terminal, etc. Figure 13 As shown, the electronic device 13 includes at least one processor 131; a memory 132 communicatively connected to at least one processor 131; and a communication component 133 communicatively connected to a scanning device, wherein the communication component 133 receives and transmits data under the control of the processor 131; wherein the memory 132 stores instructions executable by at least one processor 131, the instructions being executed by at least one processor 131 to implement an information display method.

[0115] Specifically, the electronic device includes: one or more processors 131 and a memory 132. Figure 13 Taking a processor 131 as an example, the processor 131 and the memory 132 can be connected via a bus or other means. Figure 13Taking a bus connection as an example, memory 132, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer-executable programs, and modules. Processor 131 executes various functional applications and data processing of the device by running the non-volatile software programs, instructions, and modules stored in memory 132, thereby realizing the above-mentioned information display method.

[0116] Memory 132 may include a program storage area and a data storage area, wherein the program storage area may store the operating system and applications required for at least one function; the data storage area may store an option list, etc. Furthermore, memory 132 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state storage device. In some embodiments, memory 132 may optionally include memory remotely located relative to processor 131, and these remote memories may be connected to external devices via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0117] One or more modules are stored in memory 132, and when executed by one or more processors 131, they perform the information display method in any of the above method embodiments.

[0118] The above-mentioned products can perform the methods provided in the embodiments of this application, and have the corresponding functional modules and beneficial effects of performing the methods. For technical details not described in detail in this embodiment, please refer to the methods provided in the embodiments of this application.

[0119] This invention, in its embodiments, splits the original image to be displayed into multiple first sub-images, each sub-image displaying a portion of the original image. Simultaneously, a noisy image is generated and split into multiple second sub-images. Each first sub-image is merged with its corresponding second sub-image to obtain multiple intermediate sub-images. These intermediate sub-images are then displayed alternately to show the content of the original image. Therefore, anti-screenshot and anti-photography functions can be achieved without affecting the user's visual experience, improving the user experience. Furthermore, it can be implemented on general-purpose display devices, enhancing the versatility of the display method.

[0120] Another embodiment of the present invention relates to a non-volatile storage medium for storing a computer-readable program for use by a computer to execute some or all of the above-described method embodiments.

[0121] That is, those skilled in the art will understand that all or part of the steps in the methods of the above embodiments can be implemented by a program instructing related hardware. This program is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods described in the embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as a USB flash drive, a portable hard drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0122] The above description is merely a preferred embodiment of this application and is not intended to limit this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. An information display method, characterized in that, The method includes: Obtain the original image that needs to be displayed; The original image is split into multiple first sub-images, and each first sub-image displays a portion of the content of the original image; Generate noisy images; The noisy image is split into multiple second sub-images, the number of which is the same as the number of first sub-images, and the display content of the noisy image is assigned to different second sub-images; Each first sub-image is fused with its corresponding second sub-image to obtain multiple intermediate sub-images; The plurality of intermediate sub-images are displayed alternately.

2. The method according to claim 1, characterized in that, The process of obtaining the original image to be displayed includes: Receive the compressed stream sent by the sending end; The compressed stream is decoded to obtain a video stream; Convert the video stream into image frames of a predetermined format; The image frames are adjusted according to the screen resolution of the receiving end, and the timestamps of each image frame are calibrated to obtain the original image.

3. The method according to claim 1, characterized in that, The step of splitting the original image into multiple first sub-images includes: Determine the region of interest in the original image, the region of interest including at least one of a text region and an icon region; The original image is divided into multiple first sub-images based on the regions of interest, wherein each region of interest is divided into multiple sub-regions, and each sub-region is assigned to a different first sub-image.

4. The method according to claim 3, characterized in that, Determining the region of interest in the original image includes: The original image is identified based on a pre-trained recognition model to obtain candidate regions, which are text regions or icon regions. Obtain the text information in the candidate region; The text information is matched with predetermined keywords; Candidate regions that match the keywords are identified as regions of interest.

5. The method according to claim 3, characterized in that, The step of splitting the original image into multiple first sub-images based on the region of interest includes: The number of segments for the first sub-image is determined based on the upper limit of the screen refresh rate at the receiving end and the predetermined frequency that the human eye can recognize. The original image is split into multiple first sub-images based on the number of splits.

6. The method according to claim 5, characterized in that, The step of splitting the original image according to the number of splits to obtain multiple first sub-images includes at least one of the following: The region of interest is divided into multiple sub-regions by pixel column group splitting. The region of interest is divided into multiple sub-regions using a checkerboard pattern. The region of interest is divided into multiple sub-regions by random partitioning. The region of interest is divided into multiple sub-regions according to the character splitting method; The region of interest is split into multiple sub-regions according to the row segmentation method; The region of interest is divided into multiple sub-regions according to the frequency domain filtering method.

7. The method according to claim 3, characterized in that, The step of splitting the original image into multiple first sub-images based on the region of interest includes: Obtain the display brightness at the receiving end; The size of the missing area is adjusted according to the display brightness, wherein the missing area is the missing part of the region of interest.

8. The method according to claim 1, characterized in that, The method further includes: The multiple first sub-images are verified based on whether they have been synthesized into a complete original image.

9. The method according to claim 1, characterized in that, The generated noisy image includes: A single-cycle noise matrix is ​​generated based on the preset minimum periodic cell size and noise type; The number of repetitions is determined based on a single-period noise matrix and a target size, wherein the number of repetitions includes horizontal repetitions and vertical repetitions, and the target size is determined based on a first sub-image. An intermediate matrix is ​​generated based on the single-cycle noise matrix and the number of repetitions. The noise image is generated based on the intermediate matrix and the target size.

10. The method according to claim 9, characterized in that, The noise type is either solid color or texture.

11. The method according to claim 1, characterized in that, The step of fusing each first sub-image with its corresponding second sub-image to obtain multiple intermediate sub-images includes: Each first sub-image is merged with its corresponding second sub-image according to a preset transparency to obtain multiple intermediate sub-images, wherein the transparency of the second sub-image is less than that of the first sub-image.

12. The method according to claim 1, characterized in that, The alternating display of the plurality of intermediate sub-images includes: Get the upper limit of the screen refresh rate of the receiving end; In response to the screen refresh rate upper limit being greater than or equal to a preset threshold, the plurality of intermediate sub-images are displayed alternately.

13. An information display device, characterized in that, The device includes: The original image acquisition unit is used to acquire the original image that needs to be displayed. The first splitting unit is used to split the original image into multiple first sub-images, each of which displays a portion of the content in the original image. A noise image generation unit is used to generate noise images; The second splitting unit is used to split the noise image into multiple second sub-images, the number of which is the same as the number of the first sub-images, and the display content of the noise image is assigned to different second sub-images; A fusion unit is used to fuse each of the first sub-images with the corresponding second sub-images to obtain multiple intermediate sub-images; The display unit is used to alternately display the plurality of intermediate sub-images.

14. An electronic device comprising a memory and a processor, characterized in that, The memory is used to store one or more computer program instructions, wherein the one or more computer program instructions are executed by the processor to implement the method as described in any one of claims 1-12.

Images