A Display Method and Device for Preventing Photo-taking Data Leakage

Abstract

The present invention discloses a display method and device for preventing photo-taking data leakage, belonging to the technical field of data protection. The method includes: in response to a user's browsing operation on a target original page in a confidential document, acquiring a target picture frame group associated with the target original page; wherein, the target picture frame group includes multiple target pictures, and each target picture in the target picture frame group associated with the target original page only displays some display objects in the target original page; displaying each target picture in the target picture frame group at a preset frame rate. Starting from the differences in the principles of photo imaging and human eye imaging, the present invention can ensure the normal viewing of confidential information by users, and at the same time increase the difficulty of confidential information being leaked by photo-taking.

Description

Technical Field

[0001] The present invention relates to the technical field of data protection, and particularly relates to a display method and device for preventing data leakage caused by photographing. Background Art

[0002] The security protection of electronic documents is an important part of information security management, aiming to protect electronic documents from unauthorized access, leakage, tampering or destruction. For preventing leakage, although many companies have implemented strategies for preventing the leakage of confidential documents, with the most traditional mobile phone photographing mode, photographing the confidential information that appears on the display screen results in the risk of data leakage not being effectively solved. In the existing technical solutions, usually the control measure of prohibiting the carrying of photographing devices is adopted for restriction, and once the behavior of carrying a photographing device is not detected, it will cause the confidential information to be easily photographed and leaked. And after the confidential information is leaked by being photographed, it is also very difficult to trace the source of the leakage. Summary of the Invention

[0003] The purpose of the present invention is to at least solve one of the technical problems existing in the prior art, and provide a display method and device for preventing data leakage caused by photographing. Starting from the differences in the principles of photo imaging and human eye imaging, it can ensure the normal viewing of confidential information by users, and at the same time increase the difficulty of confidential information being leaked by photographing.

[0004] In order to achieve the above-mentioned invention purpose, the present invention provides the following technical solutions:

[0005] In a first aspect, a display method for preventing data leakage caused by photographing is provided. The method includes:

[0006] In response to a user's browsing operation on a target original page in a confidential document, obtaining a target picture frame group associated with the target original page; wherein, the target picture frame group includes multiple frames of target pictures, and each frame of target picture in the target picture frame group associated with the target original page only displays some display objects in the target original page;

[0007] Displaying each frame of target picture in the target picture frame group at a preset frame rate.

[0008] As a further improvement, the method further includes generating each frame of target picture in the target picture frame group associated with the target original page through the following process steps:

[0009] Obtaining the target original page;

[0010] Dividing all display objects of the target original page into multiple groups, and associating a blank page with each group of display objects; wherein, the blank page has the same size as the target original page;

[0011] According to the preset layout parameters, each group of display objects is respectively displayed on the blank page associated with each group of display objects, obtaining multiple target new pages; wherein, the preset layout parameters are the layout parameters adopted when each group of display objects is in the target original page.

[0012] Convert each target new page into a corresponding target picture, obtaining each frame of target picture in the target picture frame group associated with the target original page.

[0013] As a further improvement, the target picture frame group associated with the target original page carries traceability information corresponding to the browsing operation.

[0014] As a further improvement, the traceability information includes one or more of the time corresponding to receiving the browsing operation, the Mac address corresponding to the terminal that initiated the browsing operation, the IP address corresponding to the terminal that initiated the browsing operation, and the geographical coordinates corresponding to the terminal that initiated the browsing operation.

[0015] As a further improvement, in the case where the target picture frame group associated with the target original page carries traceability information corresponding to the browsing operation, the converting each target new page into a corresponding target picture specifically includes:

[0016] Directly convert the first type of target new page into a picture format first to obtain a first intermediate picture; then convert the first intermediate picture into the target picture corresponding to the first type of target new page; wherein, the first type of target new page is the target new page that only contains the first type of display object; the display object whose position in the target picture does not need to be adjusted compared to its position in the target new page is used as the first type of display object.

[0017] Directly convert the second type of target new page into a picture format first to obtain a second intermediate picture; then adjust the position of the second type of display object in the second intermediate picture according to the preset parameters; then convert the adjusted second intermediate picture into the target picture corresponding to the second type of target new page; wherein, the second type of target new page is the target new page that only contains the second type of display object; the display object whose position in the target picture needs to be adjusted compared to its position in the target new page is used as the second type of display object.

[0018] As a further improvement, the method further includes:

[0019] Obtain the traceability information corresponding to the browsing operation;

[0020] Split the traceability information into multiple information segments;

[0021] Encode each information segment to obtain the binary coding value corresponding to each information segment;

[0022] Associate the binary coding values corresponding to each information segment with the display objects in each row of the target original page;

[0023] Based on the binary coding values associated with the display objects in each row, determine whether each display object in each row of display objects belongs to the first type of display object or the second type of display object; among them, the display object corresponding to 0 in the binary coding value is the first type of display object, and the display object corresponding to 1 in the binary coding value is the second type of display object.

[0024] As a further improvement, the division of all display objects of the target original page into multiple groups specifically includes:

[0025] Obtain a preset number of groups;

[0026] Based on the number of groups, group all display objects of the target original page; among them, the display objects assigned to the same group can only all be the first type of display object or the second type of display object.

[0027] As a further improvement, the conversion of the first intermediate picture into the target picture corresponding to the first type of target new page specifically includes:

[0028] Obtain a preset underlying picture; wherein, positioning rectangular blocks are displayed on the underlying picture; the positioning rectangular blocks are aligned with three corners of the rectangular preset area of the underlying picture, and the area size occupied by each positioning rectangular block is the same as the area size occupied by a single display object, and the size of the rectangular preset area is the same as the size of the first intermediate picture;

[0029] Add the first intermediate picture as an opaque layer to the rectangular preset area of the underlying picture, and merge the first intermediate picture and the underlying picture to obtain the target picture corresponding to the first type of target new page;

[0030] The conversion of the adjusted second intermediate picture into the target picture corresponding to the second type of target new page specifically includes:

[0031] Obtain a preset underlying picture; wherein, positioning rectangular blocks are displayed on the underlying picture; the positioning rectangular blocks are aligned with three corners of the rectangular preset area of the underlying picture, and the area size occupied by each positioning rectangular block is the same as the area size occupied by a single display object, and the size of the rectangular preset area is the same as the size of the adjusted second intermediate picture;

[0032] Add the adjusted second intermediate picture as an opaque layer to the rectangular preset area of the underlying picture, and merge the adjusted second intermediate picture and the underlying picture to obtain the target picture corresponding to the second type of target new page.

[0033] As a further improvement, adjust the position of the second type of display object in the second intermediate picture according to preset parameters, specifically including:

[0034] According to the preset parameters, increase the pixel value at the lower side of the canvas of the second intermediate picture and decrease the pixel value at the upper side of the canvas of the second intermediate picture to obtain the adjusted second intermediate picture; wherein, the preset parameters include a first pixel value that needs to be increased at the lower side of the canvas of the second intermediate picture and a second pixel value that needs to be decreased at the upper side of the canvas of the second intermediate picture, and the first pixel value is equal to the second pixel value.

[0035] In a second aspect, the present invention also provides a display device for preventing photo-taking data leakage, including: a memory, a processor, and a computer program stored on the memory and executable on the processor, and when the processor executes the program, it executes the steps of the above-mentioned display method for preventing photo-taking data leakage.

[0036] Beneficial effects: Compared with the prior art, a display method and device for preventing photo-taking data leakage provided by the present application can enable users to normally view the content of the entire page, while during the photo-taking process, only partial information of the page is captured, which greatly increases the difficulty of stealing confidential information by taking photos. If a user attempts to take a photo of the entire page, the camera only captures scattered partial information at each instant of taking a photo, increasing the difficulty of piecing together the complete page content.

[0037] Additional aspects and advantages of the present invention will be given in part in the following description, become apparent in part from the following description, or be understood through the practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] The present invention will be further described below in conjunction with the drawings and embodiments;

[0039] FIG. 1 is a schematic flowchart of a display method for preventing photo-taking data leakage in an embodiment;

[0040] FIG. 2 is a schematic diagram of the principle of converting a target original page into a target picture in an embodiment;

[0041] FIG. 3 is a schematic flowchart of a display method for preventing photo-taking data leakage in another embodiment;

[0042] FIG. 4 is a schematic flowchart of a display method for preventing photo-taking data leakage in yet another embodiment;

[0043] FIG. 5 is a schematic diagram of the principle of converting a target original page into a target picture in another embodiment;

[0044] FIG. 6 is a schematic diagram of the principle of obtaining traceability information based on photos or videos taken by a leaker in an embodiment. Detailed implementation manners

[0045] This part will describe in detail the specific embodiments of the present invention. The preferred embodiments of the present invention are shown in the accompanying drawings. The accompanying drawings are used to supplement the description in the text part of the specification, enabling people to intuitively and vividly understand each technical feature and the overall technical solution of the present invention, but it should not be construed as a limitation on the protection scope of the present invention.

[0046] The following briefly describes the usage scenario of this application: The original file of a confidential document is stored on a server, and someone is allowed to view the content of the confidential document through a terminal. For example, the server is located in the head office and the terminal is located in a branch office. The confidential document has a total of 3 pages and the original format is a Word file. Although the branch office strictly controls that employees are not allowed to carry photographing devices such as mobile phones when viewing the content of the confidential document through the terminal, there is still a possibility that some leakers hide cameras to take pictures and disclose secrets. Then, in this application, the difficulty of a leaker who views the content of the confidential document through the terminal to disclose confidential information content by taking pictures can be increased, so that each frame of the taken picture can only obtain partial confidential information content. At the same time, in the case of someone secretly taking pictures and disclosing secrets, the time and location of the disclosure can also be traced based on the leaked photos. It can be understood that in addition to Word files, texts generated by other text editing software are also applicable. For example, the pages obtained by text layout in a web page, as long as the background of the page is white.

[0047] As shown in FIG. 1, in an embodiment, a display method for preventing photo-taking data leakage includes:

[0048] Step S202, the server obtains a target picture frame group associated with the target original page in response to a user's browsing operation on the target original page in the confidential document; wherein, the target picture frame group includes multiple frames of target pictures, and each frame of target picture in the target picture frame group associated with the target original page only displays partial display objects in the target original page.

[0049] In one example, the server is located at the head office and the terminal is located at a branch office. There are a total of 3 pages of confidential documents in the original Word file format. That is, there are a total of 3 target original pages in the confidential documents. The server has generated an associated target picture frame group for each target original page in advance. Each target picture in the target picture frame group only displays some of the display objects in the target original page. For example, the picture of each target original page is divided into 4 parts. Therefore, the target picture frame group associated with each page of the confidential document contains 4 target pictures, that is, 4 target pictures. Each target picture only contains part of the content of the target original page. As shown in Figure 2, on the second page, there are a total of 4 lines, and each line has 9 characters, that is, each line has 9 display objects. In the example of Figure 2, the target picture frame group associated with the second page contains 4 target pictures, and each target picture only displays some of the display objects in the target original page. On the left side of Figure 2 is the complete second page (i.e., the target original page), and on the right side, from top to bottom, are the 4 target pictures in the target picture frame group associated with the second page (i.e., the target original page). Taking the topmost target picture as an example, it only contains the 1st, 2nd, and 9th characters in the first line of the target original page (in this article, the characters displayed on the page are also called display objects), the 1st, 8th, and 9th characters in the second line, the 9th character in the third line, and the 1st character in the fourth line. Only some of the display objects in the target original page are also displayed in the other 3 target pictures. And the display objects in each target picture do not repeat. The non-repetition mentioned here means that the numbers of the display objects on the page do not repeat. For example, the 1st character in the first line of Figure 2 can only be assigned to the topmost target picture.

[0050] Step S204, the terminal displays each target picture in the target picture frame group at a preset frame rate.

[0051] As described above, it is known that the target picture frame group associated with the second page contains 4 target pictures. If the preset frame rate is 144 Hz, then after the server generates an associated target picture frame group for each target original page, it will generate a video segment associated with the target original page. The frame rate of this video segment is the above-mentioned preset frame rate, and the target pictures in the target picture frame group associated with the target original page are played in a loop at the above-mentioned preset frame rate. For example, the duration of the video segment is 1 second, and at a frequency of 144 Hz, the 4 target pictures from top to bottom on the right side of Figure 2 are played in a loop. It can be understood that the number of target pictures in the target picture frame group associated with the target original page can be other values in addition to the example numbers, such as 10 or 20. The examples here are only for the convenience of those skilled in the art to understand and do not constitute a limitation on the protection scope of this application. Similarly, the preset frequency can also be other values, such as 100 Hz or 200 Hz. The examples here are only for the convenience of those skilled in the art to understand and do not constitute a limitation on the protection scope of this application.

[0052] For example, in steps S202 to S204, the user remotely accesses a confidential file through a browser on the terminal. When the user clicks on a selection control corresponding to the second page of the confidential file on the browser page with the mouse, a browsing operation for the second page of the confidential file is triggered. The server receives this browsing operation and then returns the video segment corresponding to the second page to the browser on the terminal. The browser on the terminal plays this video segment. Due to the persistence of vision effect, the user can view the content of the second page of the confidential file. However, if someone tries to steal it by taking pictures, only partial content can be captured each time. In the presence of other people at the scene, it greatly increases the difficulty for the leaker to steal the complete content of the confidential file.

[0053] As shown in FIG. 3, in one embodiment, the method further includes generating each frame of the target picture in the target picture frame group associated with the target original page through the following process steps:

[0054] Step S302, obtain the target original page.

[0055] Step S304, divide all display objects of the target original page into multiple groups, and associate a blank page with each group of display objects; wherein, the blank page has the same size as the target original page.

[0056] Step S306, according to the preset layout parameters, display each group of display objects on the blank page associated with each group of display objects respectively to obtain multiple target new pages; wherein, the preset layout parameters are the layout parameters adopted when each group of display objects is in the target original page.

[0057] As shown in Figure 2, all the display objects on the target original page are divided into 4 groups, that is, the content of each target original page is redistributed to 4 new pages. For a Word file, four new Word pages are generated respectively to display each group of display objects, and the layout parameters of these display objects are the same as those in the target original page. For example, as shown in Figure 2, on the left side of Figure 2 is the complete second page (i.e., the target original page), and on the right side, from top to bottom, are 4 target pictures in the target picture frame group associated with the second page (i.e., the target original page). Taking the topmost target picture as an example, it only contains the 1st, 2nd, and 9th characters in the first line of the target original page (in this article, the characters displayed on the page are also called display objects), the 1st, 8th, and 9th characters in the second line, the 9th character in the third line, and the 1st character in the fourth line. As described in step S306, the layout parameters of display objects such as the 1st, 2nd, and 9th characters in the first line of the target original page, the 1st, 8th, and 9th characters in the second line, the 9th character in the third line, and the 1st character in the fourth line, that is, the font and position, are the same as those in the target original page in the new Word page. Since the display objects on the target new page are missing parts compared with the target original page, in order to maintain the same position, spaces are used to occupy the missing parts. Therefore, in this embodiment, the display objects in the target original page are all of the same width.

[0058] Specifically, the Word pages corresponding to each target original page are separately split out into a file, and then scripts can be used to automatically split the display objects in each Word page (i.e., the target original page) into multiple new Word pages (i.e., the target new pages) according to the original layout parameters. The idea is as follows:

[0059] Step A, read the Word document and traverse each line.

[0060] Step B, according to the positions rule, retain specific characters and replace the rest with full-width spaces \u2003.

[0061] Step C, modify the text line by line in Run to ensure that the format remains unchanged.

[0062] Step D, save the new Word file to achieve automatic batch character replacement.

[0063] Step S308, convert each target new page into a corresponding target picture to obtain each frame of the target picture in the target picture frame group associated with the target original page.

[0064] Through steps S302 to S308, each group of display objects can be efficiently displayed on the blank pages associated with each group of display objects, obtaining multiple target new pages, and the layout parameters of each display object in the target new pages are the same as those on the target original page, so that the pictures composed of each frame of target pictures can present the same effect as the target original page in the user's vision.

[0065] Although the pictures captured by the leaker each time are incomplete, in some scenarios, there may be some leakers who may use extremely concealed methods to record the content of the confidential documents displayed on the terminal. Therefore, the present application further provides a solution for tracing the relevant information of the leaker after the leakage.

[0066] Some code references for implementing steps A to D are as follows:

[0067]

[0068] In some embodiments, the target picture frame group associated with the target original page carries trace information corresponding to the browsing operation. The trace information includes one or more of the time corresponding to receiving the browsing operation, the Mac address corresponding to the terminal that initiated the browsing operation, and the IP address corresponding to the terminal that initiated the browsing operation.

[0069] Subsequently, when it is found that the leaker has filmed the video of the confidential document played on the terminal, the time, location, and relevant terminal where the leaker filmed the content can be obtained according to the trace information corresponding to the browsing operation carried by the target picture frame group associated with the target original page, so as to facilitate excluding the identity of the leaker.

[0070] Specifically, as shown in Figure 4 in some embodiments, the method further includes:

[0071] Step S402, obtaining the trace information corresponding to the browsing operation.

[0072] Specifically, after the server receives the user's browsing operation, it will obtain the following trace information: the time corresponding to receiving the browsing operation, the Mac address corresponding to the terminal that initiated the browsing operation, and the IP address corresponding to the terminal that initiated the browsing operation.

[0073] Step S404, splitting the trace information into multiple information segments.

[0074] In one example, each line contains at most 29 characters (i.e., display objects). The first 4 characters are used to encode and distinguish information segments, which can distinguish 16 information segments. The remaining 25 characters are used to encode the data of each information segment. For time information, including the year-month-day part and the hour-minute-second part, the data of the year-month-day part is represented as an 8-digit decimal number, such as 20230301, and the data of the hour-minute-second part is represented as a 6-digit decimal number, such as 090000. The 5th to 29th characters (a total of 25) of each line are used to represent the data of the year-month-day part and the hour-minute-second part. That is, the time information is split into 2 information segments and occupies 2 lines of display objects. For the Mac address, its data consists of 12 characters. For example, 0A:1B:2C:3A:44:5C. Since it contains letters and is not pure numbers, special encoding is required. The Mac address is split into 3 information segments (i.e., 3 fields), namely the first segment: from the 1st to the 4th character, the second segment: from the 5th to the 8th character, and the third segment: from the 9th to the 12th character. Taking the first segment as an example, from the 5th display object to the 9th display object (a total of 5) of each line of display objects is assigned to the first character of the Mac address. In this example, the first character of the Mac address is "0"; from the 10th display object to the 16th display object (a total of 7) of each line of display objects is assigned to the second character of the Mac address. In this example, the second character of the Mac address is "A"; from the 17th display object to the 21st display object (a total of 5) of each line of display objects is assigned to the third character of the Mac address. In this example, the third character of the Mac address is "1"; from the 22nd display object to the 29th display object (a total of 8) of each line of display objects is assigned to the fourth character of the Mac address. In this example, the fourth character of the Mac address is "B". The second and third segments follow the same pattern and will not be elaborated here. Therefore, the Mac address information is split into 3 information segments and occupies 3 lines of display objects. For the IP address, it consists of 4 parts of numbers. For example: 201.100.4.1. Therefore, special encoding is also required. The IP address is split into 2 information segments (i.e., 2 fields), including the first segment: from the first part to the second part (i.e., the data part is 201.100); the second segment: from the third part to the fourth part (i.e., the data part is 4.1). Taking the first segment as an example: from the 5th to the 16th display object (a total of 11) of each line of display objects is assigned to the first part: 201; from the 17th to the 29th display object (a total of 14) of each line of display objects is assigned to the second part: 100. The second segment follows the same pattern and will not be elaborated here. Therefore, the IP address information is split into 2 information segments and occupies 2 lines of display objects. In summary, a total of 7 lines of display objects are required to encode the traceability information.

[0075] Step S406: Encode each information segment to obtain the binary encoding value corresponding to each information segment.

[0076] In an example, when the first four characters (referred to as the field name) used to distinguish the fields corresponding to the information segments are as follows: the binary encoding value of the year-month-day part is 0001, the binary encoding value of the hour-minute-second part is 0010, the binary encoding value of the first segment of the Mac address is 0011, the binary encoding value of the second segment of the Mac address is 0100, the binary encoding value of the third segment of the Mac address is 0101, the binary encoding value of the first segment of the IP address is 0110, and the binary encoding value of the second segment of the IP address is 0111. The above are the binary encoding values of the field names corresponding to the seven information segments, and the binary encoding value conversion rule for the data corresponding to each field is that if the data is a number, convert the decimal number to binary, and if the data is a letter, first convert the letter to a decimal number and then convert it from the decimal number to binary. In this example, the letter A is converted to the corresponding decimal number 0, and so on. In the order of the alphabet, the other 25 letters are incremented by one successively compared to A. For example, the letter Z corresponds to the decimal number 25, and the other letters will not be elaborated one by one.

[0077] Step S408: Associate the binary encoding values corresponding to each information segment with the display objects in each row of the target original page.

[0078] Specifically, in an example, first screen the rows in the target original page that meet the preliminary requirements. For example, there are 20 rows in the target original page, and 10 of them have 29 characters each, that is, there are characters in each position of each of these 10 rows. Then these rows are called the rows that meet the preliminary requirements. Then randomly select 7 rows from these rows that meet the preliminary requirements and assign them to be associated with the field names and binary encoding values of the data of the seven information segments.

[0079] Step S410: Based on the binary encoding values associated with the display objects in each row, determine whether each display object in each row of the display objects belongs to the first type of display object or the second type of display object; among them, the display object corresponding to 0 in the binary encoding value is the first type of display object, and the display object corresponding to 1 in the binary encoding value is the second type of display object.

[0080] For example, if the hour, minute, and second part is 000001, that is, the time is 0:0:1, then the field name of the information segment corresponding to the hour, minute, and second part is 0010, and the data part of the information segment corresponding to the hour, minute, and second part is 0000000000000000000000001. It can be obtained that the binary code value of the information segment corresponding to the hour, minute, and second part is: 00100000000000000000000000001. From this, it can be known that if the first row is associated with the information segment corresponding to the hour, minute, and second part, the 3rd and 29th display objects in this row are the second type of display objects, and the others are the first type of display objects. In an example, the data of the second segment of the IP address is 4.1, then the field name of the information segment corresponding to the second segment of the IP address is 0111, and the data part of the information segment corresponding to the second segment of the IP address is 0000000010000000000000001. It can be obtained that the binary code value of the information segment corresponding to the second segment of the IP address is: 01110000000010000000000000001. From this, it can be known that if the first row is associated with the information segment corresponding to the hour, minute, and second part, the 2nd, 3rd, 4th, 13th, and 29th display objects in this row are the second type of display objects, and the others are the first type of display objects.

[0081] In one embodiment, the dividing all the display objects of the target original page into multiple groups specifically includes:

[0082] Step S3041, obtaining a preset number of groups.

[0083] In an example, the preset number of groups is 4, and it can also be other values, which are not limited in this application.

[0084] Step S3042, grouping all the display objects of the target original page based on the number of groups; wherein, the display objects divided into the same group can only all be the first type of display objects or the second type of display objects.

[0085] In this example, all the display objects of the target original page are divided into 4 groups, and the display objects divided into the same group can only all be the first type of display objects or the second type of display objects. For example, the four groups are respectively named group a, group b, group c, and group d. Among them, the display objects in group a and group b are all the first type of display objects, and the display objects in group c and group d are all the second type of display objects.

[0086] It should be noted that as shown in Figure 2, when the target picture frame group associated with the target original page does not need to carry the traceability information corresponding to the browsing operation, each target new page can be directly converted into a picture format, and the obtained picture is the target picture corresponding to each target new page. In some scenarios, it is necessary to carry the traceability information corresponding to the browsing operation in the target picture frame group associated with the target original page to facilitate the subsequent investigation of the leaker.

[0087] Therefore, in some embodiments, when the target picture frame group associated with the target original page carries the traceability information corresponding to the browsing operation, the conversion of each target new page into the corresponding target picture specifically includes:

[0088] First, directly convert the first type of target new page into a picture format to obtain a first intermediate picture; then convert the first intermediate picture into the target picture corresponding to the first type of target new page; wherein, the first type of target new page is a target new page that only contains the first type of display object; the first type of display object is a display object whose position in the target picture does not need to be adjusted compared to its position in the target new page.

[0089] Specifically, as shown in Figure 5, converting the first intermediate picture into the target picture corresponding to the first type of target new page specifically includes:

[0090] Step S501, obtain a preset underlying picture; wherein, a positioning rectangle block is displayed on the underlying picture; the positioning rectangle block is aligned with three corners of the rectangular preset area of the underlying picture, and the area occupied by each positioning rectangle block is the same as the area occupied by a single display object, and the size of the rectangular preset area is the same as the size of the first intermediate picture.

[0091] Step S502, add the first intermediate picture as an opaque layer to the rectangular preset area of the underlying picture, and merge the first intermediate picture and the underlying picture to obtain the target picture corresponding to the first type of target new page.

[0092] First, directly convert the second type of target new page into a picture format to obtain a second intermediate picture; then adjust the position of the second type of display object in the second intermediate picture according to preset parameters; then convert the adjusted second intermediate picture into the target picture corresponding to the second type of target new page; wherein, the second type of target new page is a target new page that only contains the second type of display object; the second type of display object is a display object whose position in the target picture needs to be adjusted compared to its position in the target new page.

[0093] It is known that there are differences in the positions of the first type of display object and the second type of display object in the same row in the target picture. Therefore, in this embodiment, the first type of target new page only contains the first type of display object, while the second type of target new page only contains the second type of display object. So, for any photo taken by the leaker or a screenshot from a video, the characters in each row in the obtained picture are aligned in height. Therefore, the possibility that the leaker discovers the difference in the typesetting positions of the characters in the same row is further reduced, making it possible for the trace information to be more concealed in the photos or videos taken by the leaker.

[0094] Specifically, as shown in Figure 5, converting the adjusted second intermediate picture into the corresponding target picture of the second type of target new page specifically includes:

[0095] Step S601, obtaining a preset underlying picture; wherein, a positioning rectangular block is displayed on the underlying picture; the positioning rectangular block is aligned with three corners of the rectangular preset area of the underlying picture, and the area size occupied by each positioning rectangular block is the same as the area size occupied by a single display object, and the size of the rectangular preset area is the same as the size of the adjusted second intermediate picture.

[0096] Step S602, adding the adjusted second intermediate picture as an opaque layer to the rectangular preset area of the underlying picture, and merging the adjusted second intermediate picture and the underlying picture to obtain the corresponding target picture of the second type of target new page.

[0097] As shown in Figure 5, adjusting the position of the second type of display object in the second intermediate picture according to preset parameters specifically includes:

[0098] According to preset parameters, increasing the pixel value on the upper side of the canvas of the second intermediate picture and decreasing the pixel value on the lower side of the canvas of the second intermediate picture to obtain the adjusted second intermediate picture; wherein, the preset parameters include the first pixel value that needs to be increased on the upper side of the canvas of the second intermediate picture and the second pixel value that needs to be decreased on the lower side of the canvas of the second intermediate picture, and the first pixel value is equal to the second pixel value.

[0099] Referring to FIG. 5, in this embodiment, the display objects on the target original page are divided into 4 groups, namely group a, group b, group c, and group d. Among them, the display objects in group a and group b are all first-class display objects, and the display objects in group c and group d are all second-class display objects. Two first-class target new pages above in FIG. 5 and two second-class target new pages below are obtained. Since the display objects in the first-class target new pages are and only are first-class display objects, and the first-class display objects are the display objects whose positions in the target picture do not need to be adjusted compared with their positions in the target new pages. Therefore, directly merging the picture format of the first-class target new page (i.e., the first intermediate picture) with the underlying picture can obtain the corresponding target picture of the first-class target new page. For the display objects in the second-class target new pages are and only are second-class display objects, and the second-class display objects are the display objects whose positions in the target picture need to be adjusted compared with their positions in the target new pages. Therefore, in this embodiment, the positions of the second-class display objects in the second intermediate picture are adjusted by adjusting the canvas, that is, all the second-class display objects in the adjusted second intermediate picture are moved down by the first pixel value. Then merging the adjusted second intermediate picture with the underlying picture can obtain the corresponding target picture of the second-class target new page.

[0100] In an example, in a text editing software, all the display objects on the target original page use equally wide characters, and the bottoms of the characters in the same row are set to be aligned, and the line spacing between adjacent rows is 2 times (that is, there is a blank area with 1 times the character height between adjacent rows). Therefore, the area sizes occupied by each display object on the target original page are the same. When the first-class target new page and the second-class target new page are converted into the first intermediate picture and the second intermediate picture, since the sizes of the first intermediate picture and the second intermediate picture are the same. This means that the pixel space areas occupied by the font areas where each display object is located on the first intermediate picture or the second intermediate picture are the same. And due to the adjusted second intermediate picture, the pixel value on the upper side of the canvas of the second intermediate picture is increased, and the pixel value on the lower side of the canvas of the second intermediate picture is decreased. So the second-class display objects in the adjusted second intermediate picture are equivalent to all moving down by the distance of the first pixel. Therefore, when the target picture corresponding to the first-class target new page and the target picture corresponding to the second-class target new page are merged into one picture, it can be found that the second-class display objects will appear in the blank space between the original adjacent rows. By using image processing technology to scan the pixel values of the blank areas below each display object, it can be obtained whether each display object belongs to the first-class display object or the second-class display object, so as to restore the binary coding values of each information segment, and thus obtain the traceability information.

[0101] As shown in Figure 6, in this example, each line in the target original page displays 7 characters, and the grid lines drawn with dotted lines are used to represent each font area and blank area in Figure 6. When video frames associated with each target original page in the video or photo taken by the leaker are collected, multiple frames are fused into one picture and binarized. Specifically, since there are positioning rectangular blocks on each target picture, the direction of each video frame or photo can be corrected based on the positioning rectangular blocks. Then, after aligning the image coordinate systems of each video frame, multiple video frames or photos are fused. Figure 6 shows a partial view of the picture after fusion. It should be noted that the shape and size of the positioning rectangular frame are the same as those of the font area. Therefore, when the line spacing is known, the blank area can be scanned on the binarized picture obtained by fusion. In the example of Figure 6, the line spacing is 2 times, that is, there is a height of one font area between adjacent lines. It should be noted that the font area is the area corresponding to each character specified in the text editing software, also called the character box. For example, in a font with a specification of 15×15 dot matrix, each font area is the area corresponding to 15×15 dot matrix. And according to different line spacings, there is a corresponding blank area below each font area. For example, with a 2-fold line spacing, there is a blank area with the same height as the font area below each font area. By scanning the blank area in the fused binarized picture line by line in the rectangular preset area, the binary coding value corresponding to each line can be obtained. As shown in Figure 6, the binary coding value of the first line is 0010100, and the binary coding value of the second line is 0100010. According to the binary coding value, each information segment can be obtained, so as to know the shooting time, the terminal Mac address, and the IP address of the video or photo, thereby accelerating the efficiency of identifying the leaker.

[0102] It should be noted that in this embodiment, there is no need to use the traditional watermark method for leakage tracking. Instead, a method that is imperceptible to the leaker is proposed, which is more efficient, the traceability information carried is more concealed, and it is more difficult to be erased compared with the watermark carrying traceability information.

[0103] It should be noted that the first pixel can be set to 0.3 times or 0.2 times the height of the blank area. It should also be noted that in order to ensure that the characters in all font areas do not extend downward into the blank area or upward outside the current font area before adjusting the canvas, in addition to selecting fonts with equal width and aligned bottom and top, the following methods can also be used:

[0104] Step 1, display all the characters used on a blank test page;

[0105] Step 2, convert the test page into a picture format, obtain the first test picture and binarize the first test picture;

[0106] Step 3: Scan the blank areas below and above each row of the binarized first test image line by line, and detect whether there are points with a pixel value of 1 in the blank areas before adjusting the canvas. If so, mark the corresponding character as the target character;

[0107] Step 4: Replace the target characters in the target original page with preset characters; wherein, the preset characters are any characters that are not the target characters and are preset in advance.

[0108] Through the above method, the correctness of the traceability information corresponding to the browsing operation carried by the target picture frame group associated with the target original page can be ensured, that is, the correctness of the encoding process can be ensured. Or, use a font that does not have target characters.

[0109] In some examples, if the target character is a lowercase English character, it can be replaced with an uppercase English character that is not the target character; if the target character is a Chinese numeral, it can be replaced with an Arabic numeral that is not the target character; if the target character is a punctuation mark, it can be replaced with a punctuation mark that is not the target character. It should be noted that the scenario of this application is that users are allowed to remotely access and view confidential files, and during the process of remotely accessing and viewing confidential files, the difficulty of confidential file leakage is increased. For example, when presenting the content of a certain confidential file to employees with lower permissions in a company meeting, but it is not desired that the employees secretly take pictures and leak it. Therefore, the confidential files presented to the users of the remote client need to be processed. Therefore, if the user needs the original confidential file, it can be obtained through other channels after authenticating a higher-level permission, such as encrypted emails, etc.

[0110] It should be noted that to set the line spacing to 2 times, the following method can be used to determine the sizes of the font area and the blank area on the picture:

[0111] Step S701: Set the page margins in the four directions of up, down, left, and right of the target original page to 0;

[0112] Step S702: Count the number of characters K corresponding to a full line of character layout on the target original page;

[0113] Step S703: Count the number of lines L corresponding to a full page of character layout on the target original page;

[0114] Step S704: Set the line spacing to 2 times.

[0115] Step S705: Convert the target original page into a picture format to obtain a second test picture with a width of W pixels and a height of H pixels;

[0116] Step S706: Calculate the size of the font area on the second test picture: the width is W / K pixels, and the height is H / (2L) pixels;

[0117] Step S707, calculate the size of the blank area on the second test picture: the width is W / K pixels, and the height is H / (2L) pixels; where K, L, W, and H are all positive integer variables.

[0118] It should be noted that when the line spacing is set to 2 times, a blank area with the same height as the font area will be set below each line of the font area.

[0119] In one embodiment, a display device for preventing photo-taking data leakage is further provided, including: a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, it performs the steps of the above-mentioned display method for preventing photo-taking data leakage. The steps of the display method for preventing photo-taking data leakage here can be the steps in the above-mentioned various embodiments.

[0120] In one embodiment, a computer-readable storage medium is further provided. The computer-readable storage medium stores computer-executable instructions for causing a computer to execute the steps of the above-mentioned display method for preventing photo-taking data leakage. The steps of the display method for preventing photo-taking data leakage here can be the steps of the display method for preventing photo-taking data leakage in the above-mentioned various embodiments.

[0121] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above methods. Among them, any reference to a memory, storage, database, or other medium used in the various embodiments provided in the present application can include non-volatile and / or volatile memories. Non-volatile memories can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memories can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRA), memory bus (Rambus) direct RAM (RDRA), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0122] The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered to be within the scope described in this specification.

Claims

1. A display method for preventing camera data leakage, characterized in that: The method comprises: In response to a user browsing operation on a target original page in a confidential file, a target picture frame group associated with the target original page is obtained; wherein the target picture frame group includes multiple frames of target pictures, and each frame of the target picture in the target picture frame group associated with the target original page only displays a part of the display objects in the target original page; Displaying each target picture frame in the target picture frame group according to a preset frame rate; The method further comprises: Obtaining traceability information corresponding to the browsing operation; Splitting the traceability information into multiple information fragments; Encode each information fragment to obtain a binary code value corresponding to each information fragment; Associating the binary code value corresponding to each piece of information fragment with each row of display objects in the target original page; Based on the binary code value associated with each row of display objects, determine whether each display object in each row of display objects belongs to the first category of display objects or the second category of display objects; wherein the display object corresponding to 0 in the binary code value is the first category of display objects, and the display object corresponding to 1 in the binary code value is the second category of display objects; In the case where the target picture frame group associated with the target original page carries the traceability information corresponding to the browsing operation, converting each target new page into a corresponding target picture specifically includes: The first type of target new page is first directly converted into a picture format to obtain a first intermediate picture; the first intermediate picture is then converted into a target picture corresponding to the first type of target new page; wherein the first type of target new page is a target new page that only contains the first type of display objects; the first type of display objects are display objects whose positions in the target picture do not need to be adjusted compared to their positions in the target new page; The second-category target new page is first directly converted into a picture format to obtain a second intermediate picture; then the position of the second-category display object in the second intermediate picture is adjusted according to preset parameters; then the adjusted second intermediate picture is converted into a target picture corresponding to the second-category target new page; wherein the second-category target new page is a target new page that only contains the second-category display object; the second-category display object is a display object whose position in the target picture needs to be adjusted compared to the position in the target new page; Divide all display objects of the target original page into multiple groups, specifically including: Get the preset number of groups; Based on the number of groups, all display objects of the target original page are grouped; wherein the display objects grouped into the same group can only be all first-category display objects or second-category display objects; The method further comprises: The video frames associated with the multiple target original pages are fused into one picture and binarized. The binary code value corresponding to each line can be obtained by scanning the blank area in the fused binary picture line by line in the rectangular preset area.

2. A display method for preventing camera data leakage according to claim 1, characterized in that: The method further includes generating each frame target picture in the target picture frame group associated with the target original page through the following process steps: Obtain the target original page; Divide all display objects of the target original page into multiple groups, and associate a blank page with each group of display objects; wherein the blank page has the same size as the target original page; According to preset layout parameters, each group of display objects is displayed on a blank page associated with each group of display objects, to obtain multiple target new pages; wherein the preset layout parameters are the layout parameters used when each group of display objects is in the target original page; Each target new page is converted into a corresponding target picture, and each frame target picture in the target picture frame group associated with the target original page is obtained.

3. A display method for preventing camera data leakage according to claim 1, characterized in that: The target picture frame group associated with the target original page carries traceability information corresponding to the browsing operation.

4. A display method for preventing camera data leakage according to claim 3, characterized in that: The tracing information includes one or more of the time corresponding to the receiving of the browsing operation, the Mac address corresponding to the terminal initiating the browsing operation, and the IP address corresponding to the terminal initiating the browsing operation.

5. A display method for preventing camera data leakage according to claim 1, characterized in that: Converting the first intermediate image into a target image corresponding to the first type of target new page specifically includes: Obtain a preset underlying image; wherein a positioning rectangular block is displayed on the underlying image; the positioning rectangular block is aligned with three corners of a rectangular preset area of ​​the underlying image, and the size of the area occupied by each positioning rectangular block is the same as the size of the area occupied by a single display object, and the size of the rectangular preset area is the same as the size of the first intermediate image; Adding the first intermediate image as an opaque layer to a rectangular preset area of ​​the underlying image, and merging the first intermediate image with the underlying image to obtain a target image corresponding to the first type of target new page; Converting the adjusted second intermediate image into a target image corresponding to the second type target new page specifically includes: Obtain a preset underlying image; wherein a positioning rectangular block is displayed on the underlying image; the positioning rectangular block is aligned with three corners of a rectangular preset area of ​​the underlying image, and the size of the area occupied by each positioning rectangular block is the same as the size of the area occupied by a single display object, and the size of the rectangular preset area is the same as the size of the adjusted second intermediate image; The adjusted second intermediate image is added as an opaque layer to the rectangular preset area of ​​the underlying image, and the adjusted second intermediate image and the underlying image are merged to obtain a target image corresponding to the second type of target new page.

6. A display method for preventing camera data leakage according to claim 5, characterized in that: Adjusting the position of the second type of display object in the second middle picture according to preset parameters specifically includes: According to preset parameters, the pixel value on the upper side of the canvas of the second intermediate picture is increased, and the pixel value on the lower side of the canvas of the second intermediate picture is reduced to obtain an adjusted second intermediate picture; wherein the preset parameters include a first pixel value that needs to be increased on the upper side of the canvas of the second intermediate picture and a second pixel value that needs to be reduced on the lower side of the canvas of the second intermediate picture, and the first pixel value is equal to the second pixel value.

7. A display device for preventing camera data leakage, comprising: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the steps of the display method for preventing camera data leakage described in any one of claims 1 to 6 are executed.

Images