Display method and device for preventing photographing data leakage
By generating a target picture frame group, only part of the content of the page is displayed in each frame and traceability information is carried, which solves the problem of confidential information being leaked through mobile phone photos, improves the difficulty of leakage and realizes traceability of leakers.
Patent Information
- Application Number
- CN202510295421.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-03-13
- Publication Date
- 2025-04-18
- Estimated Expiration
- 2045-03-13
AI Technical Summary
The prior art is difficult to effectively prevent confidential information from being leaked through mobile phone photography, and it is difficult to trace the source of the leakage.
By generating a target picture frame group associated with the target original page, each target picture displays only some of the displayed objects in the target original page, and carries traceability information for subsequent traceability during the photo shooting.
It increases the difficulty of confidential information being leaked by taking photos, allowing users to browse the page content normally, while only partial information is captured when taking photos, increasing the difficulty of pieced together the complete page content, and traces the time and place of the leak after the leak.
Smart Images

Figure CN119848955A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of data protection, and in particular to a display method and device for preventing camera data from being leaked. Background Art
[0002] The security protection of electronic documents is an important part of information security management, which aims to protect electronic documents from unauthorized access, leakage, tampering or destruction. In terms of leakage prevention, although many companies have implemented confidential document leakage prevention strategies, the most traditional mobile phone camera mode is used to take pictures of confidential information that appears on the display, resulting in the risk of data leakage not being effectively resolved. In existing technical solutions, the prohibition of carrying camera equipment is usually used as a control measure to restrict, and once the behavior of carrying camera equipment is not discovered, confidential information will be easily photographed and leaked. And when confidential information is leaked by being photographed, it is also very difficult to trace the source of the leak. Summary of the invention
[0003] The purpose of the present invention is to solve at least one of the technical problems existing in the prior art, and to provide a display method and device for preventing data leakage by photographing. Based on the difference between the imaging principles of photographs and those of the human eye, the method and device can ensure that users can view confidential information normally, while increasing the difficulty of confidential information being leaked by photographing.
[0004] In order to achieve the above-mentioned object of the invention, the present invention provides the following technical solutions: In a first aspect, a display method for preventing camera data leakage is provided, the method comprising: In response to a user browsing operation on a target original page in a confidential file, a target picture frame group associated with the target original page is obtained; wherein the target picture frame group includes multiple frames of target pictures, and each frame of the target picture in the target picture frame group associated with the target original page only displays a part of the display objects in the target original page; Display each target picture frame in the target picture frame group according to a preset frame rate.
[0005] As a further improvement, the method further includes generating each frame target picture in the target picture frame group associated with the target original page through the following process steps: Obtain the target original page; Divide all display objects of the target original page into multiple groups, and associate a blank page with each group of display objects; wherein the blank page has the same size as the target original page; According to preset layout parameters, each group of display objects is displayed on a blank page associated with each group of display objects, to obtain multiple target new pages; wherein the preset layout parameters are the layout parameters used when each group of display objects is in the target original page; Each target new page is converted into a corresponding target picture, and each frame target picture in the target picture frame group associated with the target original page is obtained.
[0006] As a further improvement, the target picture frame group associated with the target original page carries traceability information corresponding to the browsing operation.
[0007] As a further improvement, the traceability information includes one or more of the time corresponding to the receipt of the browsing operation, the Mac address corresponding to the terminal initiating the browsing operation, the IP address corresponding to the terminal initiating the browsing operation, and the geographic coordinates corresponding to the terminal initiating the browsing operation.
[0008] As a further improvement, in the case where the target picture frame group associated with the target original page carries traceability information corresponding to the browsing operation, converting each target new page into a corresponding target picture specifically includes: The first type of target new page is directly converted into a picture format to obtain a first intermediate picture; the first intermediate picture is then converted into a target picture corresponding to the first type of target new page; wherein the first type of target new page is a target new page that only contains the first type of display objects; the display objects whose positions in the target picture do not need to be adjusted compared to their positions in the target new page are taken as the first type of display objects; The second-category target new page is first directly converted into a picture format to obtain a second intermediate picture; then the position of the second-category display object in the second intermediate picture is adjusted according to preset parameters; then the adjusted second intermediate picture is converted into a target picture corresponding to the second-category target new page; wherein the second-category target new page is a target new page that only contains second-category display objects; the display objects whose positions in the target picture need to be adjusted compared to their positions in the target new page are regarded as second-category display objects.
[0009] As a further improvement, the method further includes: Obtaining traceability information corresponding to the browsing operation; Splitting the traceability information into multiple information fragments; Encode each information fragment to obtain a binary code value corresponding to each information fragment; Associating the binary code value corresponding to each piece of information fragment with each row of display objects in the target original page; Based on the binary code value associated with each row of display objects, determine whether each display object in each row of display objects belongs to the first category of display objects or the second category of display objects; wherein the display object corresponding to 0 in the binary code value is the first category of display objects, and the display object corresponding to 1 in the binary code value is the second category of display objects.
[0010] As a further improvement, the dividing all display objects of the target original page into a plurality of groups specifically includes: Get the preset number of groups; Based on the number of groups, all display objects of the target original page are grouped; wherein, the display objects grouped into the same group can only all be first-category display objects or second-category display objects.
[0011] As a further improvement, the first intermediate image is converted into a target image corresponding to the first type of target new page, specifically including: Obtain a preset underlying image; wherein a positioning rectangular block is displayed on the underlying image; the positioning rectangular block is aligned with three corners of a rectangular preset area of the underlying image, and the size of the area occupied by each positioning rectangular block is the same as the size of the area occupied by a single display object, and the size of the rectangular preset area is the same as the size of the first intermediate image; Adding the first intermediate image as an opaque layer to a rectangular preset area of the underlying image, and merging the first intermediate image with the underlying image to obtain a target image corresponding to the first type of target new page; Converting the adjusted second intermediate image into a target image corresponding to the second type target new page specifically includes: Obtain a preset underlying image; wherein a positioning rectangular block is displayed on the underlying image; the positioning rectangular block is aligned with three corners of a rectangular preset area of the underlying image, and the size of the area occupied by each positioning rectangular block is the same as the size of the area occupied by a single display object, and the size of the rectangular preset area is the same as the size of the adjusted second intermediate image; The adjusted second intermediate image is added as an opaque layer to the rectangular preset area of the underlying image, and the adjusted second intermediate image and the underlying image are merged to obtain a target image corresponding to the second type of target new page.
[0012] As a further improvement, adjusting the position of the second type of display object in the second intermediate picture according to preset parameters specifically includes: According to preset parameters, the pixel value on the lower side of the canvas of the second intermediate picture is increased, and the pixel value on the upper side of the canvas of the second intermediate picture is reduced to obtain an adjusted second intermediate picture; wherein the preset parameters include a first pixel value that needs to be increased on the lower side of the canvas of the second intermediate picture and a second pixel value that needs to be reduced on the upper side of the canvas of the second intermediate picture, and the first pixel value is equal to the second pixel value.
[0013] In a second aspect, the present invention also provides a display device for preventing camera data leakage, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the steps of the above-mentioned display method for preventing camera data leakage when executing the program.
[0014] Beneficial effects: Compared with the prior art, the display method and device for preventing data leakage by taking photos provided by the present application can enable users to browse the content of the entire page normally, and only partial information of the page is captured during the photo-taking process, which greatly increases the difficulty of stealing confidential information by taking photos. If the user tries to take a photo of the entire page, the camera only captures scattered partial information at the moment of taking a photo each time, which increases the difficulty of piecing together the complete content of the page.
[0015] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] The present invention is further described below in conjunction with the accompanying drawings and embodiments; FIG1 is a schematic diagram of a flow chart of a display method for preventing camera data leakage in one embodiment; FIG2 is a schematic diagram showing the principle of converting a target original page into a target image in one embodiment; FIG3 is a flow chart of a display method for preventing camera data leakage in another embodiment; FIG4 is a flow chart of a display method for preventing camera data leakage in yet another embodiment; FIG5 is a schematic diagram showing the principle of converting a target original page into a target image in another embodiment; FIG6 is a schematic diagram showing the principle of obtaining traceability information based on photos or videos taken by a leaker in one embodiment. DETAILED DESCRIPTION
[0017] This section will describe in detail the specific embodiments of the present invention. The preferred embodiments of the present invention are shown in the accompanying drawings. The purpose of the accompanying drawings is to supplement the description of the text part of the specification with graphics, so that people can intuitively and vividly understand each technical feature and the overall technical solution of the present invention, but it cannot be understood as a limitation on the scope of protection of the present invention.
[0018] The following is a brief description of the use scenario of this application: the original file of the confidential document is stored on the server, and someone is allowed to view the content of the confidential document through the terminal. For example, the server is located in the head office, and the terminal is located in the branch office. The confidential document has a total of 3 pages, and the original format is a Word file. Although the branch strictly controls employees from viewing the contents of confidential documents through the terminal and does not allow them to bring mobile phones and other shooting devices to take pictures, there is still the possibility that some leakers will secretly hide cameras to take pictures and leak secrets. In this application, it is possible to increase the difficulty of leakers who view the contents of the confidential document at the terminal to leak confidential information by taking pictures, so that each frame of the photo can only obtain part of the confidential information content. At the same time, in the event that someone secretly takes pictures to leak, the time and place of the leak can be traced back based on the leaked photos. It is understandable that in addition to Word files, texts generated by other text editing software are also applicable, such as pages obtained by text typesetting in web pages, as long as the background of the page is white.
[0019] As shown in FIG. 1 , in one embodiment, a display method for preventing camera data leakage includes: Step S202, the server responds to the user's browsing operation on the target original page in the confidential file, and obtains a target picture frame group associated with the target original page; wherein the target picture frame group includes multiple frames of target pictures, and each frame of the target picture in the target picture frame group associated with the target original page only displays a part of the display object in the target original page.
[0020] In one example, the server is located in the head office, the terminal is located in the branch office, and the confidential document has a total of 3 pages, and the original format is a Word file. That is, there are a total of 3 target original pages in the confidential document, and the server generates an associated target picture frame group for each target original page in advance, and each frame of the target picture in the target picture frame group only displays part of the display object in the target original page. For example, the screen of each target original page is divided into 4 parts, so the target picture frame group associated with each page of the confidential document contains 4 frames of target pictures, that is, 4 target pictures, and each target picture only contains part of the content of the target original page. As shown in Figure 2, in page 2, there are a total of 4 lines, each line has 9 characters, that is, each line has 9 display objects. In the example of Figure 2, the target picture frame group associated with page 2 contains 4 frames of target pictures, and each frame of the target picture only displays part of the display object in the target original page. The left side of Figure 2 is the complete second page (i.e., the target original page), and the right side, from top to bottom, is the four target pictures in the target picture frame group associated with the second page (i.e., the target original page). As for the top target picture, it only contains the 1st, 2nd, and 9th characters of the first row of the target original page (the characters displayed in the page are referred to as display objects in this article), the 1st, 8th, and 9th characters of the second row, the 9th character of the third row, and the 1st character of the fourth row. The other three target pictures also only display part of the display objects in the target original page. And the display objects in each target picture are not repeated. The non-repetition mentioned here means that the numbers of the display objects in the page are not repeated. For example, the first character of the first row in Figure 2 can only be divided into the top target picture.
[0021] Step S204: the terminal displays each target picture frame in the target picture frame group according to a preset frame rate.
[0022] As described above, it is known that the target picture frame group associated with the second page contains 4 frames of target pictures. If the preset frame rate is 144 Hz, the server will generate a video clip associated with the target original page after generating the associated target picture frame group for each target original page. The frame rate of the video clip is the above-mentioned preset frame rate, and the target pictures in the target picture frame group associated with the target original page are played in a loop at the above-mentioned preset frame rate. For example, the video clip is 1 second long, and the 4 frames of target pictures from top to bottom on the right side of Figure 2 are played in a loop at a frequency of 144 Hz. It is understandable that the number of target pictures in the target picture frame group associated with the target original page can be other values in addition to the number of examples, such as 10 or 20. The examples here are only for the convenience of understanding of those skilled in the art and do not constitute a limitation on the scope of protection of the present application. Similarly, the preset frequency can also be other values, such as 100 Hz or 200 Hz. The examples here are only for the convenience of understanding of those skilled in the art and do not constitute a limitation on the scope of protection of the present application.
[0023] For example, in step S202 to step S204, the user accesses the confidential file remotely through the browser on the terminal. When the user clicks the selection control corresponding to the second page of the confidential file on the browser page with the mouse, the browsing operation for the second page of the confidential file is triggered. The server receives the browsing operation and returns the video clip corresponding to the second page to the browser on the terminal, which plays the video clip. Due to the visual persistence effect, the user can view the content of the second page of the confidential file. However, if an attempt is made to steal it by taking a photo, only partial content can be captured each time. In the presence of other people at the scene, it is greatly difficult for the leaker to steal the complete content of the confidential file.
[0024] As shown in FIG. 3 , in one embodiment, the method further includes generating target pictures of each frame in the target picture frame group associated with the target original page through the following process steps: Step S302, obtaining the target original page.
[0025] Step S304: divide all display objects of the target original page into multiple groups, and associate a blank page with each group of display objects; wherein the blank page has the same size as the target original page.
[0026] Step S306, displaying each group of display objects on a blank page associated with each group of display objects according to preset layout parameters, to obtain multiple target new pages; wherein the preset layout parameters are layout parameters used when each group of display objects is in the target original page.
[0027] As shown in FIG2, all display objects of the target original page are divided into 4 groups, that is, the content of each target original page is redistributed to 4 new pages. For a Word file, four Word pages are generated to display each group of display objects, and the layout parameters of these display objects are the same as those in the target original page. For example, as shown in FIG2, the left side of FIG2 is the complete second page (i.e., the target original page), and the right side is the four target images in the target image frame group associated with the second page (i.e., the target original page) from top to bottom. For the top target image, it only contains the 1st, 2nd, and 9th characters of the first line of the target original page (the characters displayed on the page are referred to as display objects in this article), the 1st, 8th, and 9th characters of the second line, the 9th character of the third line, and the 1st character of the fourth line. According to step S306, the display objects such as the 1st, 2nd, and 9th characters of the 1st line of the target original page, the 1st, 8th, and 9th characters of the 2nd line, the 9th character of the 3rd line, and the 1st character of the 4th line adopt the same typesetting parameters, i.e., fonts and positions, as those in the target original page. Since the display objects on the target new page are missing parts compared to the target original page, spaces are used to occupy the missing parts in order to maintain the same positions. Therefore, in this embodiment, the display objects in the target original page are all of equal width.
[0028] Specifically, the Word pages corresponding to each target original page are separated into a separate file, and then a script can be used to automatically split the display objects in each Word page (i.e. the target original page) into multiple new Word pages (i.e. the target new pages) according to the original typesetting parameters. The idea is as follows: Step A, read the Word document and traverse each line.
[0029] In step B, according to the positions rule, specific characters are retained and the rest of the characters are replaced with full-width spaces \u2003.
[0030] Step C, modify the text one by one, making sure the format remains unchanged.
[0031] Step D, save the new Word file to achieve automatic batch character replacement.
[0032] Step S308: convert each target new page into a corresponding target picture, and obtain each frame target picture in the target picture frame group associated with the target original page.
[0033] Through steps S302 to S308, each group of display objects can be efficiently displayed on the blank pages associated with each group of display objects, thereby obtaining multiple target new pages, and the layout parameters of each display object in the target new page are consistent with those on the target original page, so that the picture composed of the target images of each frame can present an effect consistent with the target original page in the user's vision.
[0034] Although the pictures taken by the leaker are incomplete each time, in some scenarios, there may be some leakers who may use extremely covert methods to record the contents of confidential documents displayed on the terminal. Therefore, this application further provides a solution for tracing the relevant information of the leaker after the leak.
[0035] The following are some codes for implementing steps A to D:
[0036] In some embodiments, the target picture frame group associated with the target original page carries tracing information corresponding to the browsing operation. The tracing information includes one or more of the time corresponding to the receiving of the browsing operation, the Mac address corresponding to the terminal initiating the browsing operation, and the IP address corresponding to the terminal initiating the browsing operation.
[0037] When a video of a confidential file played on a terminal shot by the leaker is subsequently discovered, the time and place where the leaker shot the content and the relevant terminal can be obtained based on the traceability information corresponding to the browsing operation carried by the target picture frame group associated with the target original page, thereby facilitating the exclusion of the leaker's identity.
[0038] Specifically, as shown in FIG4 , in some embodiments, the method further includes: Step S402: Acquire traceability information corresponding to the browsing operation.
[0039] Specifically, after receiving the browsing operation of the user, the server will obtain the following tracing information: the time corresponding to the receipt of the browsing operation, the Mac address corresponding to the terminal initiating the browsing operation, and the IP address corresponding to the terminal initiating the browsing operation.
[0040] Step S404: split the traceability information into multiple information segments.
[0041] In one example, each line contains a maximum of 29 characters (i.e., display objects). The first 4 characters are used to encode and distinguish information fragments, and 16 information fragments can be distinguished. The last 25 characters are used to encode the data of each information fragment. For time information, the field name includes the year-month-day part and the hour-minute-second part. The data of the year-month-month part is represented as an 8-digit decimal number, such as 20230301, and the data of the hour-minute-second part is represented as a 6-digit decimal number, such as 090000. The 5th to 29th characters of each line (25 in total) are used to represent the data of the year-month-day part and the hour-minute-second part. That is, the time information is split into 2 information fragments, occupying 2 lines of display objects. For a Mac address, its data consists of 12 characters, for example, 0A:1B:2C:3A:44:5C. Since it contains letters instead of pure numbers, special encoding is required to split the Mac address into three information fragments (i.e., three fields), namely the first segment: from the 1st to the 4th character, the second segment: from the 5th to the 8th character, and the third segment: from the 9th to the 12th character. Taking the first paragraph as an example, the 5th to 9th display objects in each row of display objects (a total of 5) are assigned to the first character of the Mac address, and the first character of the Mac address in this example is "0"; the 10th to 16th display objects in each row of display objects (a total of 7) are assigned to the second character of the Mac address, and the second character of the Mac address in this example is "A"; the 17th to 21st display objects in each row of display objects (a total of 5) are assigned to the third character of the Mac address, and the third character of the Mac address in this example is "1"; the 22nd to 29th display objects in each row of display objects (a total of 8) are assigned to the fourth character of the Mac address, and the fourth character of the Mac address in this example is "B". The second and third paragraphs are similar and will not be repeated here. Therefore, the Mac address information is divided into 3 pieces of information, occupying 3 rows of display objects. For IP addresses, they are composed of 4 parts of numbers, for example: 201.100.4.1. Therefore, special encoding is also required to split the IP address into 2 information fragments (i.e. 2 fields), including the first segment: from the first part to the second part (i.e. the data part is 201.100); the second segment: from the third part to the fourth part (i.e. the data part is 4.1). Take the first segment as an example: from the bottom 5 to the 16th display object of each row of display objects (a total of 11) are assigned to the first part: 201; from the bottom 17 to the 29th display object of each row of display objects (a total of 14) are assigned to the second part: 100. The second segment is similar and will not be repeated here. Therefore, the IP address information is split into 2 information fragments, occupying 2 rows of display objects. In summary, the traceability information requires a total of 7 rows of display objects for encoding.
[0042] Step S406: Encode each information fragment to obtain a binary code value corresponding to each information fragment.
[0043] In one example, the first four characters (referred to as field names) used to distinguish the fields corresponding to the information fragments are as follows: the binary code value of the year, month, and day part is 0001, the binary code value of the hour, minute, and second part is 0010, the binary code value of the first segment of the Mac address is 0011, the binary code value of the second segment of the Mac address is 0100, the binary code value of the third segment of the Mac address is 0101, the binary code value of the first segment of the IP address is 0110, and the binary code value of the second segment of the IP address is 0111. The above are the binary code values of the field names corresponding to the seven information fragments, and the binary code value conversion rule for the data corresponding to each field is that if the data is a number, the decimal is converted to binary, and if the data is a letter, the letter is first converted to a decimal number, and then converted from a decimal number to binary. In this example, the letter A is converted to a decimal number corresponding to 0, and so on. According to the order of the alphabet, the other 25 letters are sequentially increased by one compared to A. For example, the decimal corresponding to the letter Z is 25, and the other letters are not repeated one by one.
[0044] Step S408: Associating the binary code value corresponding to each piece of information fragment with each row of display objects in the target original page.
[0045] Specifically, in one example, the target original page is first screened for rows that meet the preliminary requirements. For example, there are 20 rows in the target original page, and the number of characters in 10 rows is 29, that is, there are characters in each position of each of the 10 rows, and these rows are called rows that meet the preliminary requirements. Then, 7 rows are randomly selected from these rows that meet the preliminary requirements and are assigned to be associated with the binary encoding values of the field names and data of the 7 information fragments.
[0046] Step S410, based on the binary code value associated with each row of display objects, determine whether each display object in each row of display objects belongs to the first category of display objects or the second category of display objects; wherein the display object corresponding to 0 in the binary code value is the first category of display objects, and the display object corresponding to 1 in the binary code value is the second category of display objects.
[0047] For example, if the hour, minute, and second part is 000001, that is, the time is 0:00:01, then the field name of the information segment corresponding to the hour, minute, and second part is 0010, and the data part of the information segment corresponding to the hour, minute, and second part is 00000000000000000000000001. It can be obtained that the binary encoding value of the information segment corresponding to the hour, minute, and second part is: 00100000000000000000000000001. It can be seen that if the first row is associated with the information segment corresponding to the hour, minute, and second part, the 3rd and 29th display objects in the row are second-class display objects, and the others are first-class display objects. In an example, the data of the second segment of the IP address is 4.1, then the field name of the information segment corresponding to the second segment of the IP address is 0111, and the data part of the information segment corresponding to the second segment of the IP address is 00000000100000000000000001. It can be obtained that the binary code value of the information segment corresponding to the second segment of the IP address is: 011100000000100000000000000001. Therefore, if the first row is associated with the information segment corresponding to the hour, minute, and second part, the 2nd, 3rd, 4th, 13th, and 29th display objects in the row are second-class display objects, and the others are first-class display objects.
[0048] In one embodiment, dividing all display objects of the target original page into a plurality of groups specifically includes: Step S3041, obtaining a preset number of groups.
[0049] In one example, the preset number of groups is 4, or it may be other values, which is not limited in this application.
[0050] Step S3042: group all display objects of the target original page based on the number of groups; wherein the display objects grouped into the same group can only be all first-category display objects or second-category display objects.
[0051] In this example, all display objects of the target original page are divided into four groups, and the display objects divided into the same group can only be first-category display objects or second-category display objects. For example, the four groups are named group a, group b, group c, and group d, respectively, where the display objects in group a and group b are all first-category display objects, and the display objects in group c and group d are all second-category display objects.
[0052] It should be noted that, as shown in FIG2 , when the target picture frame group associated with the target original page does not need to carry the tracing information corresponding to the browsing operation, each target new page can be directly converted into a picture format, so that the obtained picture is the target picture corresponding to each target new page. In some scenarios, it is necessary to carry the tracing information corresponding to the browsing operation in the target picture frame group associated with the target original page to facilitate the subsequent investigation of the leaker.
[0053] Therefore, in some embodiments, when the target picture frame group associated with the target original page carries the traceability information corresponding to the browsing operation, converting each target new page into a corresponding target picture specifically includes: The first type of target new page is first directly converted into a picture format to obtain a first intermediate picture; then the first intermediate picture is converted into a target picture corresponding to the first type of target new page; wherein the first type of target new page is a target new page that only includes the first type of display objects; the first type of display objects are display objects whose positions in the target picture do not need to be adjusted compared to their positions in the target new page.
[0054] Specifically, as shown in FIG5 , converting the first intermediate image into a target image corresponding to the first type of target new page specifically includes: Step S501, obtaining a preset underlying image; wherein a positioning rectangular block is displayed on the underlying image; the positioning rectangular block is aligned with three corners of a rectangular preset area of the underlying image, and the size of the area occupied by each positioning rectangular block is the same as the size of the area occupied by a single display object, and the size of the rectangular preset area is the same as the size of the first intermediate image.
[0055] Step S502: Add the first intermediate image as an opaque layer to a rectangular preset area of the underlying image, and merge the first intermediate image and the underlying image to obtain a target image corresponding to the first type of target new page.
[0056] The second-category target new page is first directly converted into a picture format to obtain a second intermediate picture; then the position of the second-category display object in the second intermediate picture is adjusted according to preset parameters; then the adjusted second intermediate picture is converted into a target picture corresponding to the second-category target new page; wherein the second-category target new page is a target new page that only contains second-category display objects; the second-category display objects are display objects whose positions in the target picture need to be adjusted compared to their positions in the target new page.
[0057] It is known that there is a difference in the position of the first category display object and the second category display object in the same row in the target image. Therefore, in this embodiment, the new page of the first category target only includes the first category display object, and the new page of the second category target only includes the second category display object. Therefore, the leaker can take a photo or screenshot from a video at random, and obtain a picture in which the characters in each row are aligned in height. This further reduces the possibility that the leaker will find that there is a difference in the layout position of characters in the same row, so that the traceability information can be more concealed in the photo or video taken by the leaker.
[0058] Specifically, as shown in FIG5 , converting the adjusted second intermediate image into a target image corresponding to the second type target new page specifically includes: Step S601, obtaining a preset underlying image; wherein a positioning rectangular block is displayed on the underlying image; the positioning rectangular block is aligned with three corners of a rectangular preset area of the underlying image, and the size of the area occupied by each positioning rectangular block is the same as the size of the area occupied by a single display object, and the size of the rectangular preset area is the same as the size of the adjusted second intermediate image.
[0059] Step S602: Add the adjusted second intermediate image as an opaque layer to the rectangular preset area of the underlying image, and merge the adjusted second intermediate image and the underlying image to obtain a target image corresponding to the second type target new page.
[0060] As shown in FIG5 , adjusting the position of the second type of display object in the second middle picture according to the preset parameters specifically includes: According to preset parameters, the pixel value on the upper side of the canvas of the second intermediate picture is increased, and the pixel value on the lower side of the canvas of the second intermediate picture is reduced to obtain an adjusted second intermediate picture; wherein the preset parameters include a first pixel value that needs to be increased on the upper side of the canvas of the second intermediate picture and a second pixel value that needs to be reduced on the lower side of the canvas of the second intermediate picture, and the first pixel value is equal to the second pixel value.
[0061] Referring to FIG. 5 , in this embodiment, the display objects on the target original page are divided into four groups, namely, group a, group b, group c, and group d, wherein the display objects in group a and group b are all first-class display objects, and the display objects in group c and group d are all second-class display objects. The two first-class target new pages at the top and the two second-class target new pages at the bottom in FIG. 5 are obtained. Since the display objects in the first-class target new page are and only are the first-class display objects, and the first-class display objects are display objects whose positions in the target image do not need to be adjusted compared to the positions in the target new page. Therefore, the image format of the first-class target new page (i.e., the first intermediate image) is directly merged with the bottom image to obtain the target image corresponding to the first-class target new page. As for the display objects in the second-class target new page, they are and only are the second-class display objects, and the second-class display objects are display objects whose positions in the target image do need to be adjusted compared to the positions in the target new page. Therefore, this embodiment adjusts the position of the second type display object in the second middle picture by adjusting the canvas, that is, all the second type display objects in the adjusted second middle picture are moved downward by the first pixel value. Then, the adjusted second middle picture is merged with the bottom picture to obtain the target picture corresponding to the second type target new page.
[0062] In one example, in a text editing software, all display objects in the target original page use equal-width characters, and the bottoms of the characters in the same row are aligned, and the line spacing between adjacent rows is 2 times (that is, there is a blank area of 1 times the character height between adjacent rows), so the area occupied by each display object in the target original page is the same. When the first-type target new page and the second-type target new page are converted into the first intermediate image and the second intermediate image, the sizes of the first intermediate image and the second intermediate image are the same. This means that the pixel space area occupied by the font area of each display object on the first intermediate image or the second intermediate image is the same. Since the pixel value on the upper side of the canvas of the second intermediate image is increased and the pixel value on the lower side of the canvas of the second intermediate image is reduced after the adjustment of the second intermediate image, the second-type display objects in the adjusted second intermediate image are equivalent to being moved downward by the distance of the first pixel. Therefore, when the target image corresponding to the first-type target new page and the target image corresponding to the second-type target new page are merged into one image, it can be found that the second-type display object will appear in the blank space between the original adjacent rows. By scanning the pixel values of the blank area below each display object using image processing technology, it is possible to determine whether each display object belongs to the first category or the second category, thereby restoring the binary code value of each information fragment and obtaining the traceability information.
[0063] As shown in FIG6 , in this example, each line in the target original page displays 7 characters, and each font area and blank area in FIG6 is represented by a grid drawn with a dotted line. When the video frames associated with each target original page in the video or photo taken by the leaker are collected, multiple frames are fused into one picture and binarized. Specifically, since there are positioning rectangular blocks on each target picture, the direction of each video frame or photo can be corrected based on the positioning rectangular blocks, and then the image coordinate systems of each video frame are aligned before the multiple video frames or photos are fused. FIG6 shows part of the picture after fusion. It should be noted that the shape and size of the positioning rectangular frame are the same as the shape and size of the font area. Therefore, when the line spacing is known, the blank area can be scanned on the binary picture obtained by fusion. In the example of FIG6 , the line spacing is 2 times, that is, the height of a font area is spaced between adjacent lines. It should be noted that the font area is the area corresponding to each character specified in the text editing software, also called the character box. For example, in a font with a specification of 15×15 dot matrix, each font area is the area corresponding to the 15×15 dot matrix, and according to different line spacings, there is a corresponding blank area under each font area. For example, if the line spacing is 2 times, there is a blank area with the same height as the font area under each font area. By scanning the blank area in the fused binary image line by line in the rectangular preset area, the binary code value corresponding to each line can be obtained. As shown in Figure 6, the binary code value of the first line is 0010100, and the binary code value of the second line is 0100010. According to the binary code value, each piece of information fragment can be obtained to know the shooting time of the video or photo, the terminal Mac address and the IP address, thereby speeding up the efficiency of identifying the leaker.
[0064] It should be noted that, in this embodiment, there is no need to use the traditional watermark method to track leaks. Instead, a method that is imperceptible to the leaker is proposed. It is more efficient and carries more concealed tracing information. Compared with watermarks, tracing information can be less likely to be erased.
[0065] It should be noted that the first pixel can be set to 0.3 times or 0.2 times the height of the blank area. It should also be noted that in order to ensure that all characters in the font area will not extend from the font area downward to the blank area or upward to the current font area before the canvas is adjusted, in addition to selecting a font with equal width and bottom and top alignment, the following method can also be used: Step 1: Display all used characters on a blank test page; Step 2: convert the test page into a picture format, obtain a first test picture and binarize the first test picture; Step 3, scanning the blank area below and above each line of the binary first test image line by line, detecting whether a point with a pixel value of 1 is detected in the blank area before the canvas is adjusted, and if so, marking the corresponding character as the target character; Step 4: Replace the target characters in the target original page with preset characters; wherein the preset characters are any pre-set characters that are not target characters.
[0066] By using the above method, the correctness of the tracing information corresponding to the browsing operation carried by the target picture frame group associated with the target original page can be ensured, that is, the correctness of the encoding process can be ensured. Alternatively, a font without target characters is used.
[0067] In some examples, if the target character is a lowercase English character, it can be replaced with an uppercase English character that is not a target character; if the target character is a Chinese number, it can be replaced with an Arabic numeral that is not a target character; if the target character is a punctuation mark, it can be replaced with a punctuation mark that is not a target character. It should be noted that the scenario of this application is to allow users to remotely access and view confidential files, and to increase the difficulty of confidential file leakage in the process of remote access and viewing confidential files. For example, at a company meeting, the contents of a confidential file are shown to employees with lower authority, but employees are not expected to secretly take photos and leak them, so the confidential files presented to the user of the remote client need to be processed. Therefore, if the user needs the original confidential file, he can obtain it through other channels after authenticating a higher level of authority, such as encrypted emails.
[0068] It should be noted that if the line spacing is set to 2 times, the following method can be used to determine the size of the font area and blank area on the image: Step S701, setting the page margins in the four directions of top, bottom, left, and right of the target original page to 0; Step S702, counting the number of characters K corresponding to a full line of characters typeset on the target original page; Step S703, counting the number of lines L corresponding to the characters typeset on the target original page; Step S704, setting the line spacing to 2 times.
[0069] Step S705, converting the target original page into a picture format to obtain a second test picture with a width of W pixels and a height of H pixels; Step S706, calculating the size of the font area on the second test image: the width is W / K pixels, and the height is H / (2L) pixels; Step S707, calculate the size of the blank area on the second test image: the width is W / K pixels, and the height is H / (2L) pixels; wherein K, L, W, and H are all positive integer variables.
[0070] It should be noted that when the line spacing is set to 2 times, a blank area with the same height as the font area will be set below each line of the font area.
[0071] In one embodiment, a display device for preventing camera data leakage is also provided, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the steps of the display method for preventing camera data leakage when executing the program. The steps of the display method for preventing camera data leakage here may be the steps in the above-mentioned embodiments.
[0072] In one embodiment, a computer-readable storage medium is further provided, wherein the computer-readable storage medium stores computer-executable instructions, wherein the computer-executable instructions are used to cause a computer to execute the above steps of the display method for preventing camera data leakage. The steps of the display method for preventing camera data leakage here may be the steps of the display method for preventing camera data leakage in the above embodiments.
[0073] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRA), memory bus (Rambus) direct RAM (RDRA), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
[0074] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
Claims
1. A display method for preventing camera data leakage, characterized in that: The method comprises: In response to a user browsing operation on a target original page in a confidential file, a target picture frame group associated with the target original page is obtained; wherein the target picture frame group includes multiple frames of target pictures, and each frame of the target picture in the target picture frame group associated with the target original page only displays a part of the display objects in the target original page; Display each target picture frame in the target picture frame group according to a preset frame rate.
2. A display method for preventing camera data leakage according to claim 1, characterized in that: The method further includes generating each frame target picture in the target picture frame group associated with the target original page through the following process steps: Obtain the target original page; Divide all display objects of the target original page into multiple groups, and associate a blank page with each group of display objects; wherein the blank page has the same size as the target original page; According to preset layout parameters, each group of display objects is displayed on a blank page associated with each group of display objects, to obtain multiple target new pages; wherein the preset layout parameters are the layout parameters used when each group of display objects is in the target original page; Each target new page is converted into a corresponding target picture, and each frame target picture in the target picture frame group associated with the target original page is obtained.
3. A display method for preventing camera data leakage according to claim 1, characterized in that: The target picture frame group associated with the target original page carries traceability information corresponding to the browsing operation.
4. A display method for preventing camera data leakage according to claim 3, characterized in that: The tracing information includes one or more of the time corresponding to the receiving of the browsing operation, the Mac address corresponding to the terminal initiating the browsing operation, and the IP address corresponding to the terminal initiating the browsing operation.
5. A display method for preventing camera data leakage according to claim 4, characterized in that: The method further comprises: Obtaining traceability information corresponding to the browsing operation; Splitting the traceability information into multiple information fragments; Encode each information fragment to obtain a binary code value corresponding to each information fragment; Associating the binary code value corresponding to each piece of information fragment with each row of display objects in the target original page; Based on the binary code value associated with each row of display objects, determine whether each display object in each row of display objects belongs to the first category of display objects or the second category of display objects; wherein the display object corresponding to 0 in the binary code value is the first category of display objects, and the display object corresponding to 1 in the binary code value is the second category of display objects.
6. A display method for preventing camera data leakage according to claim 5, characterized in that: In the case where the target picture frame group associated with the target original page carries the traceability information corresponding to the browsing operation, converting each target new page into a corresponding target picture specifically includes: The first type of target new page is first directly converted into a picture format to obtain a first intermediate picture; the first intermediate picture is then converted into a target picture corresponding to the first type of target new page; wherein the first type of target new page is a target new page that only contains the first type of display objects; the first type of display objects are display objects whose positions in the target picture do not need to be adjusted compared to their positions in the target new page; The second-category target new page is first directly converted into a picture format to obtain a second intermediate picture; then the position of the second-category display object in the second intermediate picture is adjusted according to preset parameters; then the adjusted second intermediate picture is converted into a target picture corresponding to the second-category target new page; wherein the second-category target new page is a target new page that only contains second-category display objects; the second-category display objects are display objects whose positions in the target picture need to be adjusted compared to their positions in the target new page.
7. A display method for preventing camera data leakage according to claim 6, characterized in that: The dividing all display objects of the target original page into a plurality of groups specifically includes: Get the preset number of groups; Based on the number of groups, all display objects of the target original page are grouped; wherein, the display objects grouped into the same group can only all be first-category display objects or second-category display objects.
8. A display method for preventing camera data leakage according to claim 5, characterized in that: Converting the first intermediate image into a target image corresponding to the first type of target new page specifically includes: Obtain a preset underlying image; wherein a positioning rectangular block is displayed on the underlying image; the positioning rectangular block is aligned with three corners of a rectangular preset area of the underlying image, and the size of the area occupied by each positioning rectangular block is the same as the size of the area occupied by a single display object, and the size of the rectangular preset area is the same as the size of the first intermediate image; Adding the first intermediate image as an opaque layer to a rectangular preset area of the underlying image, and merging the first intermediate image with the underlying image to obtain a target image corresponding to the first type of target new page; Converting the adjusted second intermediate image into a target image corresponding to the second type target new page specifically includes: Obtain a preset underlying image; wherein a positioning rectangular block is displayed on the underlying image; the positioning rectangular block is aligned with three corners of a rectangular preset area of the underlying image, and the size of the area occupied by each positioning rectangular block is the same as the size of the area occupied by a single display object, and the size of the rectangular preset area is the same as the size of the adjusted second intermediate image; The adjusted second intermediate image is added as an opaque layer to the rectangular preset area of the underlying image, and the adjusted second intermediate image and the underlying image are merged to obtain a target image corresponding to the second type of target new page.
9. A display method for preventing camera data leakage according to claim 8, characterized in that: Adjusting the position of the second type of display object in the second middle picture according to preset parameters specifically includes: According to preset parameters, the pixel value on the upper side of the canvas of the second intermediate picture is increased, and the pixel value on the lower side of the canvas of the second intermediate picture is reduced to obtain an adjusted second intermediate picture; wherein the preset parameters include a first pixel value that needs to be increased on the upper side of the canvas of the second intermediate picture and a second pixel value that needs to be reduced on the lower side of the canvas of the second intermediate picture, and the first pixel value is equal to the second pixel value.
10. A display device for preventing camera data leakage, comprising: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the steps of the display method for preventing camera data leakage described in any one of claims 1 to 9 are executed.
Citation Information
Patent Citations
Information display method, device and electronic device
CN109460273A
A screen information leakage tracing system and method
CN109727180A
Image management method and device
CN113469869A
Real-time screen watermarking method and system for tracing leakage of screen shooting
CN117574336A