Information display method and device and electronic equipment

Abstract

The invention discloses an information display method and device and electronic equipment. To-be-displayed information is converted into a first image, the first image is a to-be-displayed information image with a white background, interference information is converted into a second image, the second image is an interference information image with a white background, and a fusion image is obtained according to the first image and the second image. And acquiring a first complementary image and a second complementary image according to the fused image, and alternately displaying the first complementary image and the second complementary image so as to display the to-be-displayed information. Therefore, complete and clear information of the screenshot is difficult to capture on the premise of not influencing the vision of a user, the capability of data anti-screenshot optical character recognition can be enhanced, and the application scene of data anti-screenshot optical character recognition is improved.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to an information display method, device and electronic equipment. Background Art

[0002] With the development and widespread application of computer technology, information needs to be displayed in many scenarios. On information display platforms, information, as the core element of content presentation, frequently becomes the target of data collectors due to its standardized and easy-to-identify characteristics. Among them, collecting information through screenshots and OCR (Optical Character Recognition) technology is a common means of information collection.

[0003] In order to address data security issues in screenshot OCR scenarios, a feasible solution in the existing technology is to add subtle noise perturbations, or to learn subtle features of information images and make subtle changes based on generative adversarial network technology, thereby generating more complex and imperceptible adversarial samples. These adversarial samples can affect machine recognition systems, making it impossible to accurately recognize the information in the image. However, simple noise addition is not enough to cause significant recognition errors, and generative adversarial network technology is too focused on affecting specific OCR systems and cannot be generalized to other systems or models. Summary of the invention

[0004] In view of this, the purpose of the embodiments of the present invention is to provide an information display method, device and electronic device, which can make it difficult for screenshots to capture complete and clear information without affecting the user's vision, enhance the ability of data anti-screenshot optical character recognition, and improve the applicable scenarios of data anti-screenshot optical character recognition.

[0005] In a first aspect, an embodiment of the present invention provides an information display method, the method comprising:

[0006] Converting the information to be displayed into a first image, wherein the first image is an image of the information to be displayed with a white background;

[0007] Converting the interference information into a second image, where the second image is an interference information image with a white background;

[0008] Acquire a fused image according to the first image and the second image;

[0009] Acquire a first complementary image and a second complementary image according to the fused image;

[0010] The first complementary image and the second complementary image are displayed alternately.

[0011] In some embodiments, the color value of the pixel of the white background of the first image is 255, and the transparency is 255;

[0012] The color value of the pixel of the white background of the second image is 255, and the transparency is greater than or equal to 0 and less than or equal to 255.

[0013] In some embodiments, acquiring a fused image according to the first image and the second image comprises:

[0014] Determining each fused pixel point of the fused image;

[0015] Determine a first pixel point in the first image and a second pixel point in the second image corresponding to the fused pixel point;

[0016] If a first pixel in the first image corresponding to the fused pixel is not in the background area of ​​the first image, determining the color value and transparency of the fused pixel to be the color value and transparency of the first pixel;

[0017] If a first pixel in the first image corresponding to the fused pixel is in the background area of ​​the first image, determining that the color value of the fused pixel is the color value of the second pixel;

[0018] If a first pixel in the first image corresponding to the fused pixel is in the background area of ​​the first image and not in the background area of ​​the second image, determining the transparency of the fused pixel to be the transparency of the second pixel;

[0019] If a first pixel in the first image corresponding to the fused pixel is in the background area of ​​the first image and in the background area of ​​the second image, the transparency of the fused pixel is determined to be a predetermined value.

[0020] In some embodiments, the fused image is obtained by the following formula:

[0021]

[0022] Among them, R1, G1, B1, A1 are the RGB values ​​of the first image, R2, G2, B2, A2 are the RGB values ​​of the second image, and R3, G3, B3, A3 are the RGB values ​​of the fused image.

[0023] In some embodiments, acquiring the first complementary image and the second complementary image according to the fused image comprises:

[0024] Acquire a blurred image according to the fused image;

[0025] The first complementary image and the second complementary image are acquired according to the fused image and the blurred image.

[0026] In some embodiments, acquiring a blurred image according to the fused image comprises:

[0027] Determine the Gaussian kernel through the Gaussian function;

[0028] The blurred image is determined according to the pixel values ​​of each fused pixel point of the fused image and the Gaussian kernel.

[0029] In some embodiments, acquiring the first complementary image and the second complementary image according to the fused image and the blurred image comprises:

[0030] Get a black and white chessboard image;

[0031] The fused image and the blurred image are separated according to the color value of the chessboard image to obtain the first complementary image and the second complementary image.

[0032] In some embodiments, the splitting of the fused image and the blurred image according to the color value of the chessboard image to obtain the first complementary image and the second complementary image comprises:

[0033] Determining each first complementary pixel point of the first complementary image;

[0034] Determine a chessboard pixel point in the chessboard image, a blurred pixel point in the blurred image, and a fused pixel point in the fused image corresponding to the first complementary pixel point;

[0035] If the chessboard pixel is white, determine the color value and transparency of the first complementary pixel as the color value and transparency of the fused pixel in the fused image;

[0036] If the chessboard pixel is black, the color value and transparency of the first complementary pixel are determined to be the color value and transparency of the blurred pixel in the blurred image.

[0037] In some embodiments, the splitting of the fused image and the blurred image according to the color value of the chessboard image to obtain the first complementary image and the second complementary image comprises:

[0038] Determining each second complementary pixel point of the second complementary image;

[0039] Determine a chessboard pixel point in the chessboard image, a blurred pixel point in the blurred image, and a fused pixel point in the fused image corresponding to the second complementary pixel point;

[0040] If the chessboard pixel is white, determine the color value and transparency of the second complementary pixel as the color value and transparency of the blurred pixel in the blurred image;

[0041] If the chessboard pixel is black, the color value and transparency of the second complementary pixel are determined to be the color value and transparency of the fused pixel in the fused image.

[0042] In some embodiments, the formula for generating the first complementary image is as follows:

[0043]

[0044] Among them, R5, G5, B5, A5 are the RGBA values ​​of the first complementary image, R4, G4, B4, A4 are the RGBA values ​​of the blurred image, R3, G3, B3, A3 are the RGBA values ​​of the fused image, and X is the color value of the chessboard image.

[0045] In some embodiments, the formula for generating the second complementary image is as follows:

[0046]

[0047] Among them, R6, G6, B6, A6 are the RGB values ​​of the second complementary image, R4, G4, B4, A4 are the RGB values ​​of the blurred image, R3, G3, B3, A3 are the RGB values ​​of the fused image, and X is the color value of the chessboard image.

[0048] In some embodiments, the alternating display of the first complementary image and the second complementary image comprises at least one of the following:

[0049] Generate and display a video that alternately displays the first complementary image and the second complementary image;

[0050] generating and displaying a dynamic image that alternately displays the first complementary image and the second complementary image;

[0051] The first complementary image and the second complementary image are displayed iteratively through a program loop.

[0052] In a second aspect, an embodiment of the present invention provides an information display device, the device comprising:

[0053] A first conversion unit, used for converting the information to be displayed into a first image, wherein the first image is an image of the information to be displayed with a white background;

[0054] A second conversion unit, used to convert the interference information into a second image, where the second image is an interference information image with a white background;

[0055] an image fusion unit, configured to obtain a fused image according to the first image and the second image;

[0056] An image splitting unit, configured to obtain a first complementary image and a second complementary image according to the fused image;

[0057] The image display unit is used to alternately display the first complementary image and the second complementary image.

[0058] In a third aspect, an embodiment of the present invention provides an electronic device, comprising a memory and a processor, wherein the memory is used to store one or more computer program instructions, wherein the one or more computer program instructions are executed by the processor to implement the method described in the first aspect.

[0059] The technical solution of the embodiment of the present invention converts the information to be displayed into a first image, the first image is the image of the information to be displayed with a white background, converts the interference information into a second image, the second image is the image of the interference information with a white background, obtains a fused image based on the first image and the second image, obtains a first complementary image and a second complementary image based on the fused image, and alternately displays the first complementary image and the second complementary image to display the information to be displayed. In this way, it is possible to make it difficult for screenshots to capture complete and clear information without affecting the user's vision, enhance the ability of data to resist screenshot optical character recognition, and improve the applicable scenarios of data to resist screenshot optical character recognition. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] The above and other objects, features and advantages of the present invention will become more apparent through the following description of the embodiments of the present invention with reference to the accompanying drawings, in which:

[0061] Figure 1 is a flow chart of an information display method according to an embodiment of the present invention;

[0062] Figure 2 is a flow chart of acquiring a fused image according to an embodiment of the present invention;

[0063] Figure 3 is a flow chart of acquiring complementary images according to an embodiment of the present invention;

[0064] Figure 4 is a flow chart of acquiring a first complementary image according to an embodiment of the present invention;

[0065] Figure 5 is a flow chart of acquiring a second complementary image according to an embodiment of the present invention;

[0066] Figure 6 is a schematic diagram of an image according to an embodiment of the present invention;

[0067] Figure 7 is a flow chart of an information display method according to another embodiment of the present invention;

[0068] Figure 8 is a schematic diagram of an information display device according to an embodiment of the present invention;

[0069] Fig. 9 is a schematic diagram of an electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0070] The present invention is described below based on embodiments, but the present invention is not limited to these embodiments. In the detailed description of the present invention below, some specific details are described in detail. It is possible for a person skilled in the art to fully understand the present invention without the description of these details. In order to avoid confusing the essence of the present invention, known methods, processes, flows, components and circuits are not described in detail.

[0071] In addition, persons of ordinary skill in the art will appreciate that the drawings provided herein are for illustration purposes and are not necessarily drawn to scale.

[0072] Unless the context clearly requires otherwise, the words "include", "comprising" and the like throughout this application should be interpreted as including rather than exclusive or exhaustive; that is, as meaning "including but not limited to".

[0073] In the description of the present invention, it should be understood that the terms "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. In addition, in the description of the present invention, unless otherwise specified, "plurality" means two or more.

[0074] With the vigorous development of Internet technology, e-commerce has become an indispensable part of the global economy. Its convenience and efficiency have greatly promoted the globalization of commodity transactions. However, with the continuous expansion of the scale of transactions, data security issues have become increasingly prominent, especially the protection of sensitive information such as commodity prices, preferential policies and transaction data, which has become a major challenge that the e-commerce industry must face. Among them, Arabic numerals, as the core element of price display, are frequently collected to obtain price information. In addition, after merchants take anti-collection measures, data thieves can further obtain price information through technical means such as screenshots and OCR. Therefore, data protection measures for screenshot OCR scenarios need to be taken to protect the interests of merchants and the fair competition environment of the market.

[0075] In order to deal with data security issues in screenshot OCR scenarios, researchers have begun to explore more advanced data protection measures. Among them, the commonly used method is to add subtle noise perturbations or use generative adversarial network (GAN) technology to subtly change the subtle features of digital text images, thereby generating adversarial samples that are difficult to be accurately recognized by machine recognition systems. This method aims to protect sensitive information by interfering with the recognition process of the OCR system.

[0076] However, this approach also faces certain challenges. First, with the continuous advancement of OCR technology, especially the widespread application of large model systems, simple noise addition may no longer pose a sufficient challenge to the recognition ability of OCR systems. Second, adversarial examples based on generative models are often too focused on deceiving specific white-box OCR systems, and their generalization ability is limited, and they may not be able to achieve the same effect on other systems or models.

[0077] Therefore, in the context of global information display and exchange, the e-commerce industry needs to continuously explore and innovate more advanced and effective data protection measures to cope with increasingly severe data security issues. This is not only necessary to protect the interests of merchants and maintain a fair competition environment in the market, but also an inevitable requirement to promote the healthy and sustainable development of e-commerce.

[0078] Figure 1 It is a flow chart of an information display method according to an embodiment of the present invention. Figure 1 The information display method shown can be applied to various data processing devices or servers, and specifically includes the following steps:

[0079] Step S100: converting the information to be displayed into a first image.

[0080] In this embodiment, information to be displayed is obtained, and the information to be displayed may be various text information, such as various characters, letters, symbols, numbers, etc. The embodiment of the present invention is described by taking Arabic numerals as an example of the information to be displayed.

[0081] Furthermore, after obtaining the information to be displayed, the information to be displayed is converted into a first image using a text-to-image tool, wherein the first image is an image of the information to be displayed with a white background. That is, the first image is an actual display image with a white background. The first image includes a background area and an information area to be displayed.

[0082] The text-to-image tool is a type of software or online platform that can convert text content into an image file. The embodiment of the present invention does not limit the specific method of the text-to-image tool, and can be implemented based on various existing methods. The first image can be a file in various image formats, such as JPEG, PNG, BMP, etc.

[0083] Step S200: convert the interference information into a second image, where the second image is an interference information image with a white background.

[0084] In this embodiment, interference information is obtained, and the interference information can be various text information, such as various words, letters, symbols, numbers, etc. The embodiment of the present invention takes Arabic numerals as an example for explanation. The content of the interference information is different from the content of the information to be displayed, and the different means partially different or completely different.

[0085] Further, after obtaining the interference information, the interference information is converted into a second image using a text-to-image tool, and the second image is an interference information image with a white background. That is, the second image is an interference image with a white background. The second image includes a background area and an interference information area. The second image can be a file in various image formats, such as JPEG, PNG, BMP, etc.

[0086] Furthermore, the color value of the pixel point of the white background of the first image is 255, and the transparency is 255. The color value is an RGB color value, which is composed of the color intensity values ​​of the three color channels of red, green, and blue. The RGB color value is an integer between 0 and 255, which is used to represent the color intensity of each color channel. 0 represents the minimum color intensity (that is, the color channel is completely closed), and 255 represents the maximum color intensity (that is, the color channel is completely open). The color value of the pixel point of the white background of the first image is 255, which specifically refers to r1=255, g1=255, and b1=255 of the pixel point of the white background, and the transparency of 255 refers to the transparency of the first image a1=255.

[0087] The color value of the pixel of the white background of the second image is 255, and the transparency is greater than or equal to 0 and less than or equal to 255. The color value of the pixel of the white background of the second image is 255, which specifically means that r2=255, g2=255, b2=255 of the pixel of the white background, and the transparency is greater than or equal to 0 and less than or equal to 255, which means the transparency a2 of the second image, 0≤a2≤255.

[0088] The embodiment of the present invention does not limit the color value of the information area to be displayed in the first image and the interference information area of ​​the second image, wherein the color value of the information area to be displayed in the first image can be determined according to the actual color to be displayed, and the color value of the interference information area in the second image can be set according to actual needs.

[0089] In some embodiments, the pixels of the first image and the second image are the same, that is, if the first image is 800 pixels wide and 600 pixels high, the second image is also 800 pixels wide and 600 pixels high.

[0090] Step S300: Acquire a fused image according to the first image and the second image.

[0091] In this embodiment, the first image and the second image are fused to obtain a fused image.

[0092] Figure 2 FIG. 1 is a flow chart of obtaining a fused image according to an embodiment of the present invention. Figure 2 As shown, obtaining a fused image according to the first image and the second image includes the following steps:

[0093] Step S310: Determine each fused pixel point of the fused image.

[0094] In this embodiment, the process of generating a fused image is actually the process of obtaining the color value and transparency of each pixel in the fused image, and the corresponding fused image can be generated based on the color value and transparency of each pixel in the fused image. Thus, each fused pixel of the fused image is determined.

[0095] Step S320: Determine a first pixel point in the first image and a second pixel point in the second image corresponding to the fused pixel point.

[0096] In this embodiment, the pixels of the fused image, the first image and the second image are the same, that is, the pixels of the three images are one-to-one corresponding, thereby determining the first pixel in the first image and the second pixel in the second image corresponding to each fused pixel.

[0097] Step S330: If the first pixel in the first image corresponding to the fused pixel is not in the background area of ​​the first image, determine the color value and transparency of the fused pixel to be the color value and transparency of the first pixel.

[0098] In this embodiment, if the first pixel point in the first image corresponding to the fused pixel point is not in the background area of ​​the first image, that is, the first pixel point in the first image corresponding to the fused pixel point is in the information area to be displayed in the first image, then the color value and transparency of the fused pixel point are determined to be the color value and transparency of the first pixel point.

[0099] Step S340: If the first pixel in the first image corresponding to the fused pixel is in the background area of ​​the first image, determine that the color value of the fused pixel is the color value of the second pixel.

[0100] Step S350: If the first pixel in the first image corresponding to the fused pixel is in the background area of ​​the first image but not in the background area of ​​the second image, determine the transparency of the fused pixel to be the transparency of the second pixel.

[0101] Step S360: If the first pixel in the first image corresponding to the fused pixel is in the background area of ​​the first image and in the background area of ​​the second image, determine that the transparency of the fused pixel is a predetermined value.

[0102] For steps S340-S360, if the first pixel in the first image corresponding to the fused pixel is in the background area of ​​the first image, the color value of the fused pixel is determined to be the color value of the second pixel. If the first pixel in the first image corresponding to the fused pixel is in the background area of ​​the first image and not in the background area of ​​the second image, the transparency of the fused pixel is determined to be the transparency of the second pixel. If the first pixel in the first image corresponding to the fused pixel is in the background area of ​​the first image and in the background area of ​​the second image, the transparency of the fused pixel is determined to be a predetermined value.

[0103] That is, if the first pixel in the first image corresponding to the fused pixel is in the background area of ​​the first image, the color value and transparency of the fused pixel are determined differently. The color value of the fused pixel is determined based on the color value of the pixel in the second image corresponding to the fused pixel. For the color value of the fused pixel, if the second pixel in the second image corresponding to the fused pixel is not in the background area of ​​the second image, the transparency of the fused pixel is determined to be the transparency of the second pixel; if the second pixel in the second image corresponding to the fused pixel is in the background area of ​​the second image, the transparency of the fused pixel is determined to be a predetermined value.

[0104] Furthermore, the fused image is obtained by the following formula:

[0105]

[0106] Among them, r1, g1, b1, a1 are the RGB values ​​of the first image, r2, g2, b2, a2 ​​are the RGB values ​​of the second image, and r3, g3, b3, a3 are the RGB values ​​of the fused image. Among them, the RGB value includes the color value RGB and the transparency a.

[0107] Step S400: Acquire a first complementary image and a second complementary image according to the fused image.

[0108] in, Figure 3 FIG. 1 is a flow chart of obtaining complementary images according to an embodiment of the present invention. Figure 3 As shown, obtaining the first complementary image and the second complementary image according to the fused image includes the following steps:

[0109] Step S410: Obtain a blurred image according to the fused image.

[0110] In this embodiment, a Gaussian kernel is determined by a Gaussian function, and the blurred image is determined according to the pixel values ​​of each fused pixel point of the fused image and the Gaussian kernel.

[0111] Among them, Gaussian function has a wide range of applications in the field of image processing, especially in image smoothing, edge detection and noise removal. In image processing, two-dimensional Gaussian function is widely used to generate Gaussian filter to achieve Gaussian blur. The formula of two-dimensional Gaussian function is:

[0112]

[0113] Among them, (x, y) represents the coordinates of the pixel point and σ is the standard deviation.

[0114] The Gaussian kernel of (2k+1)*(2k+1) can be calculated by the formula of the above two-dimensional Gaussian function, and the calculated Gaussian kernel is normalized so that the sum of all its elements is 1, and the weight value of each pixel is obtained. The generated Gaussian kernel is convolved with the image. For each pixel in the fused image, the weighted sum of the pixel values ​​of the surrounding adjacent pixels and the corresponding elements of the Gaussian kernel is calculated, and the calculated weighted average is taken to obtain a new pixel value, and the new pixel value replaces the pixel value of the original pixel to obtain the blurred image. Among them, the above pixel value includes color value RGB and transparency.

[0115] Step S420: Acquire the first complementary image and the second complementary image according to the fused image and the blurred image.

[0116] In this embodiment, a black and white chessboard image is acquired, and the fused image and the blurred image are separated according to the color value of the chessboard image to obtain the first complementary image and the second complementary image.

[0117] The step of obtaining the black and white chessboard image is as follows: randomly generating a black and white alternate binary chessboard image, wherein the color value of each pixel in the chessboard image is 0 or 255. The fused image and the blurred image are split according to the color value of each pixel of the chessboard image to obtain the first complementary image and the second complementary image.

[0118] in, Figure 4 FIG. 4 is a flowchart of obtaining a first complementary image according to an embodiment of the present invention. Figure 4 As shown, obtaining the first complementary image includes the following steps:

[0119] Step S421: determine each first complementary pixel point of the first complementary image.

[0120] In this embodiment, the process of generating the first complementary image is actually the process of obtaining the color value and transparency of each pixel in the first complementary image, thereby determining each first complementary pixel of the first complementary image.

[0121] Step S422: Determine the chessboard pixel points in the chessboard image, the blurred pixel points in the blurred image, and the fused pixel points in the fused image corresponding to the first complementary pixel points.

[0122] In this embodiment, the pixels of the first complementary image, the chessboard image, the blurred image, and the fused image are the same, so the pixel points of the four images are one-to-one corresponding, thereby determining the chessboard pixel points in the chessboard image, the blurred pixel points in the blurred image, and the fused pixel points in the fused image corresponding to the first complementary pixel points.

[0123] Step S423: If the chessboard pixel is white, determine the color value and transparency of the first complementary pixel as the color value and transparency of the fused pixel in the fused image.

[0124] Step S424: If the chessboard pixel is black, determine the color value and transparency of the first complementary pixel as the color value and transparency of the blurred pixel in the blurred image.

[0125] Among them, the formula for generating the first complementary image is as follows:

[0126]

[0127] Among them, R5, G5, B5, A5 are the RGBA values ​​of the first complementary image, R4, G4, B4, A4 are the RGBA values ​​of the blurred image, R3, G3, B3, A3 are the RGBA values ​​of the fused image, and X is the color value of the chessboard image.

[0128] in, Figure 5 FIG. 1 is a flow chart of obtaining a second complementary image according to an embodiment of the present invention. Figure 5 As shown, obtaining the second complementary image includes the following steps:

[0129] Step S425: Determine each second complementary pixel point of the second complementary image.

[0130] In this embodiment, the process of generating the second complementary image is actually the process of obtaining the color value and transparency of each pixel in the second complementary image, thereby determining each second complementary pixel of the second complementary image.

[0131] Step S426: Determine the chessboard pixel points in the chessboard image, the blurred pixel points in the blurred image, and the fused pixel points in the fused image corresponding to the second complementary pixel points.

[0132] In this embodiment, the pixels of the second complementary image, the chessboard image, the blurred image, and the fused image are the same, so the pixel points of the four images are one-to-one corresponding, thereby determining the chessboard pixel points in the chessboard image, the blurred pixel points in the blurred image, and the fused pixel points in the fused image corresponding to the second complementary pixel points.

[0133] Step S427: If the chessboard pixel is white, determine the color value and transparency of the second complementary pixel as the color value and transparency of the blurred pixel in the blurred image.

[0134] Step S428: If the chessboard pixel is black, determine the color value and transparency of the second complementary pixel as the color value and transparency of the fused pixel in the fused image.

[0135] Among them, the formula for generating the second complementary image is as follows:

[0136]

[0137] Among them, R5, G5, B5, A5 are the RGBA values ​​of the first complementary image, R4, G4, B4, A4 are the RGBA values ​​of the blurred image, R3, G3, B3, A3 are the RGBA values ​​of the fused image, and X is the color value of the chessboard image.

[0138] Step S500: alternately displaying the first complementary image and the second complementary image.

[0139] In this embodiment, the first complementary image and the second complementary image are displayed alternately to display the information to be displayed.

[0140] In an optional implementation, alternately displaying the first complementary image and the second complementary image includes: generating and displaying a video that alternately displays the first complementary image and the second complementary image.

[0141] In another optional implementation, alternately displaying the first complementary image and the second complementary image includes: generating and displaying a dynamic image that alternately displays the first complementary image and the second complementary image.

[0142] In yet another optional implementation, alternately displaying the first complementary image and the second complementary image includes: displaying the first complementary image and the second complementary image through a program loop iteration.

[0143] It should be noted that, when the data processing device of the embodiment of the present invention has a display function, alternately displaying the first complementary image and the second complementary image is to control the display device to alternately display. When the data processing device of the embodiment of the present invention does not have a display function, alternately displaying the first complementary image and the second complementary image is to send the first complementary image and the second complementary image to other display devices for alternate display. In addition, the above-obtained video, dynamic image or image may be sent.

[0144] Further, Figure 6 is a schematic diagram of an image according to an embodiment of the present invention. Figure 6 In the illustrated embodiment, P1 is a first complementary image, P2 is a second complementary image, and P3 is a visual effect diagram when the first complementary image and the second complementary image are displayed alternately.

[0145] Thus, by alternately displaying the first complementary image and the second complementary image, the visual persistence effect of the human eye is utilized to enable the observer to perceive continuous and complete information to be displayed. At the same time, when taking a screenshot, the screenshot effect is the first complementary image and the second complementary image, making it difficult for the screenshot to capture complete and clear information, which can enhance the ability of data to resist screenshot optical character recognition and improve the applicable scenarios of data to resist screenshot optical character recognition.

[0146] The embodiment of the present invention converts the information to be displayed into a first image, the first image is the image of the information to be displayed with a white background, converts the interference information into a second image, the second image is the image of the interference information with a white background, obtains a fused image based on the first image and the second image, obtains a first complementary image and a second complementary image based on the fused image, and alternately displays the first complementary image and the second complementary image to display the information to be displayed. In this way, it is possible to make it difficult for screenshots to capture complete and clear information without affecting the user's vision, enhance the ability of data to resist screenshot optical character recognition, and improve the applicable scenarios of data to resist screenshot optical character recognition.

[0147] Figure 7 It is a flowchart of an information display method according to another embodiment of the present invention. Figure 7 The information display method shown can be applied to various data processing devices or servers, and specifically includes the following steps:

[0148] Step S610: Acquire a first image.

[0149] In this embodiment, according to the information to be displayed, a text-to-image tool is used to convert the information to be displayed into a first image.

[0150] Step S620: Acquire a second image.

[0151] In this embodiment, according to the interference information, a text-to-image tool is used to convert the interference information into a second image.

[0152] Step S630: Acquire a fused image according to the first image and the second image.

[0153] In this embodiment, the first image and the second image are fused to obtain a fused image. The specific implementation method is the same as the above step S300, and the embodiment of the present invention will not be repeated here.

[0154] Step S640: Obtain a blurred image based on the fused image.

[0155] In this embodiment, a Gaussian kernel is determined by a Gaussian function, and the blurred image is determined according to the pixel values ​​of each fused pixel point of the fused image and the Gaussian kernel. The specific implementation method is the same as the above step S410, and the embodiment of the present invention will not be repeated here.

[0156] Step S650: Acquire a chessboard image.

[0157] In this embodiment, a binary chessboard image with black and white alternations is randomly generated, and the color value of each pixel in the chessboard image is 0 or 255.

[0158] Step S660: Acquire the first complementary image and the second complementary image.

[0159] In this embodiment, if the chessboard pixel is white, the color value and transparency of the first complementary pixel are determined to be the color value and transparency of the fused pixel in the fused image; if the chessboard pixel is black, the color value and transparency of the first complementary pixel are determined to be the color value and transparency of the blurred pixel in the blurred image.

[0160] If the chessboard pixel is white, the color value and transparency of the second complementary pixel are determined to be the color value and transparency of the blurred pixel in the blurred image; if the chessboard pixel is black, the color value and transparency of the second complementary pixel are determined to be the color value and transparency of the fused pixel in the fused image.

[0161] Step S670, alternate display.

[0162] In this embodiment, the first complementary image and the second complementary image are displayed alternately to display the information to be displayed.

[0163] In an optional implementation, alternately displaying the first complementary image and the second complementary image includes: generating and displaying a video that alternately displays the first complementary image and the second complementary image.

[0164] In another optional implementation, alternately displaying the first complementary image and the second complementary image includes: generating and displaying a dynamic image that alternately displays the first complementary image and the second complementary image.

[0165] In yet another optional implementation, alternately displaying the first complementary image and the second complementary image includes: displaying the first complementary image and the second complementary image through a program loop iteration.

[0166] That is, the two complementary images are switched quickly, for example, the two complementary images are used as two frames of composite video. According to the flicker fusion frequency principle and the visual persistence principle, when the image switching rate exceeds the flicker fusion threshold of the human eye, the visual system cannot distinguish a single flicker, but perceives the continuously changing image sequence as a stable, fused whole. Therefore, under this high-speed switching, although two different images are actually displayed alternately, the human eye will regard them as a continuous picture. When a screenshot operation is performed, a first complementary image or a second complementary image with blurred content, part of the actual displayed image content, and part of the interference image content is captured, which greatly reduces the recognition accuracy of the OCR tool for such digital text images.

[0167] The embodiment of the present invention can generate digital text images of any color through a generation method combining interference overlap and complementary splitting. At the same time, an image superposition technology and a transparency adjustment mechanism are proposed. By adjusting the transparency of the superimposed image, interference features are introduced while maintaining the visual integrity of the original digital text image. This adaptive adjustment makes the image design style more diverse and dynamic, and has stronger recognition resistance against the OCR system. The generalization ability can be improved to avoid overfitting. The generation model has the problem of insufficient generalization ability due to over-optimization in deceiving a specific OCR system. The information display method of the embodiment of the present invention is not limited to optimizing a specific recognition model, thereby improving the generalization ability between different OCR systems. The visual persistence effect is used to enhance the anti-screenshot characteristics. The dual-image alternating display strategy is an innovative display mode. It makes full use of the visual persistence effect of the human eye, allowing the observer to perceive continuous and complete digital information, but only one of the incomplete digital text images can be captured when taking a screenshot. This mechanism significantly enhances the security of data in terms of anti-screenshot. Even if the screenshot is obtained, the OCR system cannot effectively extract sensitive digital information from it.

[0168] At the same time, the pixel-level overlay strategy of the actual display image and the interference image is combined. By accurately and adaptively modulating the transparency of the overlay area, it is achieved to maintain the integrity of the visual information while introducing interference characteristics to counter the OCR system, forming the first layer of anti-OCR defense. In addition, the image is split into two incomplete and complementary digital images. After the screenshot, the content of the single image is incomplete, forming the second layer of anti-OCR protection. More importantly, even if the two complementary images are merged, the preset interference features can still make the merged image appear as meaningless or erroneous digital information to the OCR tool. At the same time, in order to achieve the second layer of anti-OCR defense, an image display mode is proposed, that is, based on the visual persistence effect, two incomplete and complementary digital images are displayed alternately at a high frequency. The complete numbers are visible to the human eye, but it is difficult for the screenshot to capture the complete and clear numbers, which enhances the data's ability to resist screenshot OCR.

[0169] The embodiment of the present invention converts the information to be displayed into a first image, the first image is the image of the information to be displayed with a white background, converts the interference information into a second image, the second image is the image of the interference information with a white background, obtains a fused image based on the first image and the second image, obtains a first complementary image and a second complementary image based on the fused image, and alternately displays the first complementary image and the second complementary image to display the information to be displayed. In this way, it is possible to make it difficult for screenshots to capture complete and clear information without affecting the user's vision, enhance the ability of data to resist screenshot optical character recognition, and improve the applicable scenarios of data to resist screenshot optical character recognition.

[0170] Figure 8 Schematic diagram of an information display device according to an embodiment of the present invention. Figure 8 As shown, the information device of the embodiment of the present invention includes a first conversion unit 81, a second conversion unit 82, an image fusion unit 83, an image splitting unit 84 and an image display unit 85. The first conversion unit 81 is used to convert the information to be displayed into a first image, and the first image is an image of the information to be displayed with a white background. The second conversion unit 82 is used to convert the interference information into a second image, and the second image is an image of the interference information with a white background. The image fusion unit 83 is used to obtain a fused image according to the first image and the second image. The image splitting unit 84 is used to obtain a first complementary image and a second complementary image according to the fused image. The image display unit 85 is used to alternately display the first complementary image and the second complementary image.

[0171] In some embodiments, the color value of the pixel of the white background of the first image is 255, and the transparency is 255;

[0172] The color value of the pixel of the white background of the second image is 255, and the transparency is greater than or equal to 0 and less than or equal to 255.

[0173] In some embodiments, the image fusion unit includes:

[0174] A first determining subunit, used to determine each fused pixel point of the fused image;

[0175] A second determining subunit, configured to determine a first pixel point in the first image and a second pixel point in the second image corresponding to the fused pixel point;

[0176] A third determining subunit is used to determine the color value and transparency of the fused pixel point as the color value and transparency of the first pixel point if the first pixel point in the first image corresponding to the fused pixel point is not in the background area of ​​the first image;

[0177] A fourth determining subunit is configured to determine that a color value of a first pixel in the first image corresponding to the fused pixel is a color value of a second pixel if the first pixel in the first image corresponding to the fused pixel is in a background area of ​​the first image;

[0178] a fifth determining subunit, configured to determine the transparency of the fused pixel point to be the transparency of the second pixel point if a first pixel point in the first image corresponding to the fused pixel point is in the background area of ​​the first image and is not in the background area of ​​the second image;

[0179] The sixth determining subunit is used to determine that the transparency of the fused pixel point is a predetermined value if the first pixel point in the first image corresponding to the fused pixel point is in the background area of ​​the first image and in the background area of ​​the second image.

[0180] In some embodiments, the fused image is obtained by the following formula:

[0181]

[0182] Among them, R1, G1, B1, A1 are the RGB values ​​of the first image, R2, G2, B2, A2 are the RGB values ​​of the second image, and R3, G3, B3, A3 are the RGB values ​​of the fused image.

[0183] In some embodiments, the image splitting unit includes:

[0184] A blurred image acquisition subunit, used for acquiring a blurred image according to the fused image;

[0185] The complementary image acquisition subunit is used to acquire the first complementary image and the second complementary image according to the fused image and the blurred image.

[0186] In some embodiments, the blurred image acquisition subunit includes:

[0187] A Gaussian kernel acquisition module, used for determining the Gaussian kernel through a Gaussian function;

[0188] The blurred image acquisition module is used to determine the blurred image according to the pixel value of each fused pixel point of the fused image and the Gaussian kernel.

[0189] In some embodiments, the complementary image acquisition subunit comprises:

[0190] A chessboard image acquisition module, used to acquire a black and white chessboard image;

[0191] A splitting module is used to split the fused image and the blurred image according to the color value of the chessboard image to obtain the first complementary image and the second complementary image.

[0192] In some embodiments, the splitting module is used to:

[0193] Determining each first complementary pixel point of the first complementary image;

[0194] Determine a chessboard pixel point in the chessboard image, a blurred pixel point in the blurred image, and a fused pixel point in the fused image corresponding to the first complementary pixel point;

[0195] If the chessboard pixel is white, determine the color value and transparency of the first complementary pixel as the color value and transparency of the fused pixel in the fused image;

[0196] If the chessboard pixel is black, the color value and transparency of the first complementary pixel are determined to be the color value and transparency of the blurred pixel in the blurred image.

[0197] In some embodiments, the splitting module is used to:

[0198] Determining each second complementary pixel point of the second complementary image;

[0199] Determine a chessboard pixel point in the chessboard image, a blurred pixel point in the blurred image, and a fused pixel point in the fused image corresponding to the second complementary pixel point;

[0200] If the chessboard pixel is white, determine the color value and transparency of the second complementary pixel as the color value and transparency of the blurred pixel in the blurred image;

[0201] If the chessboard pixel is black, the color value and transparency of the second complementary pixel are determined to be the color value and transparency of the fused pixel in the fused image.

[0202] In some embodiments, the formula for generating the first complementary image is as follows:

[0203]

[0204] Among them, R5, G5, B5, A5 are the RGBA values ​​of the first complementary image, R4, G4, B4, A4 are the RGBA values ​​of the blurred image, R3, G3, B3, A3 are the RGBA values ​​of the fused image, and X is the color value of the chessboard image.

[0205] In some embodiments, the formula for generating the second complementary image is as follows:

[0206]

[0207] Among them, R6, G6, B6, A6 are the RGB values ​​of the second complementary image, R4, G4, B4, A4 are the RGB values ​​of the blurred image, R3, G3, B3, A3 are the RGB values ​​of the fused image, and X is the color value of the chessboard image.

[0208] In some embodiments, the image display unit includes at least one of the following:

[0209] A first display subunit, configured to generate and display a video that alternately displays the first complementary image and the second complementary image;

[0210] A second display subunit, used for generating and displaying a dynamic image that alternately displays the first complementary image and the second complementary image;

[0211] The third display subunit is configured to display the first complementary image and the second complementary image through program loop iteration.

[0212] The embodiment of the present invention converts the information to be displayed into a first image, the first image is the image of the information to be displayed with a white background, converts the interference information into a second image, the second image is the image of the interference information with a white background, obtains a fused image based on the first image and the second image, obtains a first complementary image and a second complementary image based on the fused image, and alternately displays the first complementary image and the second complementary image to display the information to be displayed. In this way, it is possible to make it difficult for screenshots to capture complete and clear information without affecting the user's vision, enhance the ability of data to resist screenshot optical character recognition, and improve the applicable scenarios of data to resist screenshot optical character recognition.

[0213] Fig. 9 Schematic diagram of an electronic device according to an embodiment of the present invention. In this embodiment, the electronic device 9 includes a server, a terminal, etc. Fig. 9As shown, the electronic device 9 includes: at least one processor 91; a memory 92 connected to the at least one processor 91 for communication; and a communication component 93 connected to the scanning device for communication, the communication component 93 receives and sends data under the control of the processor 91; wherein the memory 92 stores instructions executable by at least one processor 91, and the instructions are executed by at least one processor 91 to implement the above-mentioned information display method.

[0214] Specifically, the electronic device includes: one or more processors 91 and a memory 92, Fig. 9 A processor 91 is taken as an example. The processor 91 and the memory 92 may be connected via a bus or other means. Fig. 9 In the example, the bus connection is used. The memory 92 is a non-volatile computer-readable storage medium that can be used to store non-volatile software programs, non-volatile computer executable programs and modules. The processor 91 executes various functional applications and data processing of the device by running the non-volatile software programs, instructions and modules stored in the memory 92, that is, realizing the above-mentioned information display method.

[0215] The memory 92 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and applications required for at least one function; the data storage area may store a list of options, etc. In addition, the memory 92 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some embodiments, the memory 92 may optionally include a memory remotely arranged relative to the processor 91, and these remote memories may be connected to an external device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0216] One or more modules are stored in the memory 92, and when executed by one or more processors 91, the information display method in any of the above method embodiments is executed.

[0217] The above-mentioned product can execute the method provided in the embodiment of the present application, and has the functional modules and beneficial effects corresponding to the execution method. For technical details not fully described in this embodiment, please refer to the method provided in the embodiment of the present application.

[0218] The embodiment of the present invention converts the information to be displayed into a first image, the first image is the image of the information to be displayed with a white background, converts the interference information into a second image, the second image is the image of the interference information with a white background, obtains a fused image based on the first image and the second image, obtains a first complementary image and a second complementary image based on the fused image, and alternately displays the first complementary image and the second complementary image to display the information to be displayed. In this way, it is possible to make it difficult for screenshots to capture complete and clear information without affecting the user's vision, enhance the ability of data to resist screenshot optical character recognition, and improve the applicable scenarios of data to resist screenshot optical character recognition.

[0219] Another embodiment of the present invention relates to a non-volatile storage medium for storing a computer-readable program, wherein the computer-readable program is used for a computer to execute part or all of the above method embodiments.

[0220] That is, those skilled in the art can understand that all or part of the steps in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a program, and the program is stored in a storage medium, including a number of instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.

[0221] The above description is only a preferred embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. An information display method, characterized in that: The method comprises: Converting the information to be displayed into a first image, wherein the first image is an image of the information to be displayed with a white background; Converting the interference information into a second image, where the second image is an interference information image with a white background; Acquire a fused image according to the first image and the second image; Acquire a first complementary image and a second complementary image according to the fused image; The first complementary image and the second complementary image are displayed alternately.

2. The method according to claim 1, characterized in that The color value of the pixel of the white background of the first image is 255, and the transparency is 255; The color value of the pixel of the white background of the second image is 255, and the transparency is greater than or equal to 0 and less than or equal to 255.

3. The method according to claim 1, characterized in that The acquiring of a fused image according to the first image and the second image comprises: Determining each fused pixel point of the fused image; Determine a first pixel point in the first image and a second pixel point in the second image corresponding to the fused pixel point; If a first pixel in the first image corresponding to the fused pixel is not in the background area of ​​the first image, determining the color value and transparency of the fused pixel to be the color value and transparency of the first pixel; If a first pixel in the first image corresponding to the fused pixel is in the background area of ​​the first image, determining that the color value of the fused pixel is the color value of the second pixel; If a first pixel in the first image corresponding to the fused pixel is in the background area of ​​the first image and not in the background area of ​​the second image, determining the transparency of the fused pixel to be the transparency of the second pixel; If a first pixel in the first image corresponding to the fused pixel is in the background area of ​​the first image and in the background area of ​​the second image, the transparency of the fused pixel is determined to be a predetermined value.

4. The method according to claim 3, characterized in that The fused image is obtained by the following formula: Among them, R1, G1, B1, A1 are the RGB values ​​of the first image, R2, G2, B2, A2 are the RGB values ​​of the second image, and R3, G3, B3, A3 are the RGB values ​​of the fused image.

5. The method according to claim 1, characterized in that The acquiring of the first complementary image and the second complementary image according to the fused image comprises: Acquire a blurred image according to the fused image; The first complementary image and the second complementary image are acquired according to the fused image and the blurred image.

6. The method according to claim 5, characterized in that The acquiring of a blurred image according to the fused image comprises: Determine the Gaussian kernel through the Gaussian function; The blurred image is determined according to the pixel values ​​of each fused pixel point of the fused image and the Gaussian kernel.

7. The method according to claim 5, characterized in that The acquiring the first complementary image and the second complementary image according to the fused image and the blurred image comprises: Get a black and white chessboard image; The fused image and the blurred image are separated according to the color value of the chessboard image to obtain the first complementary image and the second complementary image.

8. The method according to claim 7, characterized in that The step of splitting the fused image and the blurred image according to the color value of the chessboard image to obtain the first complementary image and the second complementary image comprises: Determining each first complementary pixel point of the first complementary image; Determine a chessboard pixel point in the chessboard image, a blurred pixel point in the blurred image, and a fused pixel point in the fused image corresponding to the first complementary pixel point; If the chessboard pixel is white, determine the color value and transparency of the first complementary pixel as the color value and transparency of the fused pixel in the fused image; If the chessboard pixel is black, the color value and transparency of the first complementary pixel are determined to be the color value and transparency of the blurred pixel in the blurred image.

9. The method according to claim 7, characterized in that: The step of splitting the fused image and the blurred image according to the color value of the chessboard image to obtain the first complementary image and the second complementary image comprises: Determining each second complementary pixel point of the second complementary image; Determine a chessboard pixel point in the chessboard image, a blurred pixel point in the blurred image, and a fused pixel point in the fused image corresponding to the second complementary pixel point; If the chessboard pixel is white, determine the color value and transparency of the second complementary pixel as the color value and transparency of the blurred pixel in the blurred image; If the chessboard pixel is black, the color value and transparency of the second complementary pixel are determined to be the color value and transparency of the fused pixel in the fused image.

10. The method according to claim 8, characterized in that The formula for generating the first complementary image is as follows: Among them, R5, G5, B5, A5 are the RGBA values ​​of the first complementary image, R4, G4, B4, A4 are the RGBA values ​​of the blurred image, R3, G3, B3, A3 are the RGBA values ​​of the fused image, and X is the color value of the chessboard image.

11. The method according to claim 9, characterized in that The formula for generating the second complementary image is as follows: Among them, R6, G6, B6, A6 are the RGB values ​​of the second complementary image, R4, G4, B4, A4 are the RGB values ​​of the blurred image, R3, G3, B3, A3 are the RGB values ​​of the fused image, and X is the color value of the chessboard image.

12. The method according to claim 1, characterized in that The alternately displaying the first complementary image and the second complementary image comprises at least one of the following: Generate and display a video that alternately displays the first complementary image and the second complementary image; generating and displaying a dynamic image that alternately displays the first complementary image and the second complementary image; The first complementary image and the second complementary image are displayed iteratively through a program loop.

13. An information display device, characterized in that: The device comprises: A first conversion unit, used for converting the information to be displayed into a first image, wherein the first image is an image of the information to be displayed with a white background; A second conversion unit, used to convert the interference information into a second image, where the second image is an interference information image with a white background; an image fusion unit, configured to obtain a fused image according to the first image and the second image; An image splitting unit, configured to obtain a first complementary image and a second complementary image according to the fused image; The image display unit is used to alternately display the first complementary image and the second complementary image.

14. An electronic device comprising a memory and a processor, characterized in that: The memory is used to store one or more computer program instructions, wherein the one or more computer program instructions are executed by the processor to implement the method according to any one of claims 1 to 12.

Images