Screen shooting traceability method, device and equipment and readable storage medium

Abstract

The invention discloses a screen shooting traceability method, device and equipment and a readable storage medium, which are applied to the field of computer software, and comprise the following steps: encoding watermark information to obtain a watermark information sequence; embedding the watermark information sequence into the image through an R channel, a G channel and a B channel of RGB (Red, Green, Blue) to obtain an image with a watermark; and acquiring the shot image with the watermark image, and tracing to obtain watermark information based on the shot image. According to the method, the watermark is generated by using the RGB channel of the single pixel image, so that the visual concealment of the watermark image is improved, the difficulty in perceiving of human eye recognition is ensured, and the visual quality of a user is not influenced; the watermark embedding position is not influenced by an original image carrier, and watermark information can be hidden in any area of the image; and the watermark information recovery success rate is high.

Description

Technical Field

[0001] The present invention relates to the field of security, and in particular to a screen capture tracing method, device, equipment and readable storage medium. Background Art

[0002] With the widespread use of smartphones, stealing confidential information by photographing the screen is easier, cheaper, and more resistant to traceability using traditional watermarks. Therefore, image watermarking technologies with greater capture robustness are needed to address this problem. Traditional methods typically rely on feature transformation and template overlays to achieve image watermarking, but these methods suffer from complex watermark images, insufficient hidden information, and difficulty recovering the information during traceability. Summary of the Invention

[0003] In view of this, the purpose of the present invention is to provide a screen shooting tracing method, device, equipment and readable storage medium, which solves the problems in the prior art of complex watermark images, insufficient hidden information and high difficulty in information recovery during tracing.

[0004] To solve the above technical problems, the present invention provides a screen capture tracing method, comprising:

[0005] Encode the watermark information to obtain a watermark information sequence;

[0006] Embed the watermark information sequence into the image through the R channel, G channel and B channel of RGB to obtain a watermarked image;

[0007] A photographed image of the watermarked image is obtained, and the watermark information is obtained by tracing the source of the photographed image.

[0008] Optionally, embedding the watermark information sequence into the image through the R channel, G channel, and B channel of RGB to obtain a watermarked image includes:

[0009] A watermark color block frame is formed by the R channel and the G channel of RGB; the watermark color block frame is used to locate the position of the watermark information sequence;

[0010] The watermark information sequence is written into each color block of the watermark color block frame through the B channel of the RGB to obtain the watermarked image.

[0011] Optionally, obtaining a photographed image of the watermarked image and tracing the source of the watermark information based on the photographed image includes:

[0012] performing perspective distortion correction on the captured image to obtain a corrected captured image;

[0013] Acquire the R channel value, G channel value, and B channel value of RGB according to the corrected captured image;

[0014] The watermark information is obtained according to the R channel value, the G channel value and the B channel value of the RGB.

[0015] Optionally, performing perspective distortion correction on the captured image to obtain a corrected captured image includes:

[0016] Obtaining first pixel coordinates of four corner points of the captured image;

[0017] Obtaining second pixel coordinates of four corner points of the watermarked image;

[0018] Establishing a mapping relationship based on the first pixel coordinates and the second pixel coordinates, and obtaining a perspective transformation equation;

[0019] Solving the perspective transformation equation using the least squares method to obtain a solution;

[0020] The first pixel coordinates are inversely mapped using the solution result, and interpolation processing is performed to obtain the corrected captured image.

[0021] Optionally, obtaining an R channel value, a G channel value, and a B channel value of RGB according to the corrected captured image includes:

[0022] Step 1: performing color block segmentation on the corrected captured image to obtain individual color blocks;

[0023] Step 2: Calculate the pixel color mean of each color block in the R channel and the G channel respectively;

[0024] Step 3: Based on the pixel color mean, the true color value of each color block in the R channel and the G channel is determined using the parameter estimation of the binomial distribution, and the values are used as the R channel value and the G channel value;

[0025] Step 4: Construct a color change equation for the B channel according to the R channel value and the G channel value, and calculate the color value of each color block in the B channel as the B channel value.

[0026] Optionally, obtaining the watermark information according to the R channel value, the G channel value, and the B channel value of the RGB includes:

[0027] Repeat steps 1 to 4 to traverse all locatable color blocks, perform data fusion on the B channel values at the same logical position, determine the final binary value by statistical mean, and combine them to generate the watermark information sequence.

[0028] Optionally, the watermark information is encoded to obtain a watermark information sequence, including:

[0029] The terminal ID, current time, and opened document information are encoded in binary form into the 64-bit watermark information sequence.

[0030] The present invention also provides a screen capture tracing device, comprising:

[0031] An encoding module, used to encode watermark information to obtain a watermark information sequence;

[0032] An embedding module, configured to embed the watermark information sequence into the image through the R channel, the G channel, and the B channel of RGB to obtain a watermarked image;

[0033] The source tracing module is used to obtain a photographed image of the watermarked image and obtain the watermark information based on the photographed image by tracing the source.

[0034] The present invention also provides a screen capture tracing device, comprising:

[0035] memory for storing computer programs;

[0036] A processor is used to implement the above-mentioned screen shooting tracing method when executing the computer program.

[0037] The present invention also provides a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are loaded and executed by a processor, the screen shooting tracing method as described above is implemented.

[0038] As can be seen, the present invention encodes the watermark information to obtain a watermark information sequence; embeds the watermark information sequence into the image through the R channel, G channel, and B channel of RGB to obtain a watermarked image; obtains a photograph of the watermarked image, and traces the source of the photographed image to obtain the watermark information. The present invention uses the RGB channels of a single pixel image to generate a watermark, improving the visual concealment of the watermark image, ensuring that it is imperceptible to the human eye and does not affect the user's visual quality. The watermark embedding position is not affected by the original image carrier, and the watermark information can be hidden in any area of the image. The success rate of watermark information recovery is high.

[0039] In addition, the present invention also provides a screen shooting tracing device, equipment and readable storage medium, which also have the above-mentioned beneficial effects. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are merely embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0041] Figure 1 A flowchart of a screen capture tracing method provided by an embodiment of the present invention;

[0042] Figure 2 This is a flowchart illustrating a method for tracing the source of screen shots provided by an embodiment of the present invention;

[0043] Figure 3 A schematic structural diagram of a screen capture and tracing device provided by an embodiment of the present invention;

[0044] Figure 4 A schematic structural diagram of a screen capture and tracing device provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0045] To make the objectives, technical solutions, and advantages of the embodiments of the present invention more clear, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the present invention.

[0046] Traditional image tracing technology is based on the transmission of original images through electronic channels such as copying and transferring. This transmission method can accurately and efficiently extract binary watermark information from images. However, with the widespread use of smartphones, using mobile phones to shoot screens to steal confidential information is easier to operate, less expensive, and more resistant to the tracking and tracing of traditional watermarks. Therefore, a more robust image watermarking technology is needed to solve this problem. Currently, screen shooting tracing methods are mainly based on two algorithms: feature transformation and template superposition: (1) In algorithms based on feature transformation, a positioning border algorithm is usually used to solve the problem caused by lens distortion; (2) In algorithms based on template superposition, orthogonal templates at different angles are usually used to represent binary watermark information and superimposed on the image. The capacity of the watermark information is expanded through periodic templates, and then the corresponding filter or Hough detection is used to extract the watermark information. The current screen capture traceability method has defects, such as (1) complex watermark images: when the generated image watermark is embedded in the image, it will seriously affect the visual quality of the user when browsing, giving the user a bad experience; (2) insufficient hidden information: by changing the histogram of the original carrier image to hide the watermark information, there is a certain compression of the insignificant areas in the image, and in an image with a single pixel value, the regional features of the entire image are consistent, and the watermark information cannot be embedded in the insignificant areas of the image. (3) high difficulty in information recovery: during the screen capture process, due to the existence of various angle differences, image noise and image blur, the extraction process has a great impact on the accuracy of watermark positioning, and the complete watermark information must be included in the capture process. When the captured image only contains a part of the complete watermark image, the steganographic watermark information sequence cannot be extracted.

[0047] In order to solve the above problems, the present invention provides a screen shooting tracing method, which has the following beneficial effects: (1) reducing the complexity of the watermark image: the watermark image is formed by combining three light-colored blocks to ensure that it is not easily perceived by the human eye and does not affect the user's visual quality; (2) improving the hidden information capacity: by embedding watermark information through the RGB channel, the information hiding position will not be affected by the original image carrier, and information can be hidden in any area of the image; (3) improving the success rate of information recovery: by embedding watermark information through the RGB channel, the problem of being unable to extract some watermarked image areas due to illumination distortion and moiré distortion, the problem of uneven image pixels due to lens distortion and color distortion, the problem of inaccurate watermark information positioning, and the problem of local watermark information errors caused by different types of distortion are solved.

[0048] Please refer to Figure 1 , Figure 1 This is a flow chart of a screen capture tracing method provided by an embodiment of the present invention. The method may include:

[0049] S101: Encode the watermark information to obtain a watermark information sequence.

[0050] The executor of this embodiment is a terminal. This embodiment does not limit the type of terminal; any terminal capable of performing the screen capture traceability method is sufficient. Watermark information can be understood as the original information to be hidden, such as text, identifiers, copyright information, etc. Preprocessing the original information can include information type conversion, such as converting the original information into a binary sequence; data compression to reduce the watermark capacity required; and the addition of metadata, such as embedded check bits, timestamps, version numbers, and other auxiliary information for subsequent detection and verification. Furthermore, to improve the watermark's resistance to attacks (such as noise and compression), error correction coding is required to enhance robustness of the preprocessed information. Examples include Reed-Solomon codes (suitable for combating sudden errors and widely used in QR codes and digital watermarks), BCH codes (suitable for binary channels and with strong error correction capabilities), and Hamming codes (simple and lightweight, suitable for small-scale data). Furthermore, to enhance security, encryption and scrambling are performed, such as using symmetric encryption (AES, SM4) or asymmetric encryption (RSA, ECC) to protect the watermark content. Pseudo-random sequences (such as chaotic sequences generated by a key) are used to disrupt the spatial and frequency distribution of the watermark bits, making it difficult for attackers to locate them. Furthermore, to enhance confidentiality, direct sequence spread spectrum is used, such as expanding each watermark bit into a long pseudo-random code (such as Gold code) to disperse the energy and improve anti-interference capabilities. Alternatively, frequency hopping spread spectrum (FHSS) is used to dynamically switch carrier frequencies, increasing the difficulty of cracking.

[0051] Furthermore, the above encoding of the watermark information to obtain the watermark information sequence may specifically include the following steps:

[0052] The terminal ID, current time, and opened document information are encoded in binary form into a 64-bit watermark information sequence.

[0053] Specifically, you can refer to Figure 2 The upper half of the . This embodiment performs binary encoding on the original information to obtain a 64-bit watermark information sequence. The original information includes the terminal ID (identity identifier), the current time, and the opened document information.

[0054] S102: embedding the watermark information sequence into the image through the R channel, G channel and B channel of RGB to obtain a watermarked image.

[0055] It should be noted that the R channel, G channel and B channel in RGB are channel values. Numerical range: The value range of each channel (R, G, B) is 0 to 255, which represents the intensity or brightness of the color component. In image data (such as RGB24 format), the three channel values of each pixel are stored in sequence (such as R→G→B or B→G→R), and each channel occupies 8 bits (1 byte). This embodiment uses the R channel, G channel and B channel of the RGB of the image itself to embed the watermark information sequence, which is more fusion-friendly and the embedding position is not affected by the image carrier. This embodiment does not specifically limit the specific method of embedding, and the watermark information sequence can be written to the R channel of RGB, or to the G channel, or to the B channel.

[0056] Furthermore, in order to improve embedding efficiency and save embedding time, the above-mentioned embedding of the watermark information sequence into the image through the R channel, G channel and B channel of RGB to obtain the watermarked image may include the following steps:

[0057] Step 21: Form a watermark color block frame through the R channel and G channel of RGB; the watermark color block frame is used to locate the position of the watermark information sequence;

[0058] Step 22: Write the watermark information sequence into each color block of the watermark color block frame through the B channel of RGB to obtain a watermarked image.

[0059] Specifically, this embodiment uses the R and G channels of the RGB image to form a watermark color block framework. This framework consists of alternating R and G channel colors of 255 and R and G channel colors of 0, where 255 represents 1. These watermark color block frameworks are used to locate the location of the actual 64-bit watermark information sequence. The 64-bit watermark information sequence is then written into each color block of the framework using the B channel. Each bit of the watermark information sequence is written sequentially from left to right and from top to bottom into a 16*4 vertical grid. Each vertical square is set to 255 or 0 by setting the B channel color, where 255 represents 1. Finally, a 64*64 square grid is generated to represent the entire 64-bit watermark information sequence. It is understandable that this embodiment writes the watermark information sequence into the B channel of the RGB image, but this will produce certain color differences in the image. Therefore, it is necessary to adjust the R and G channels of the RGB image to achieve the concealment of the watermark information sequence. The watermark information sequence is written using the B channel and adjusted using the R and G channels. This approach can improve embedding efficiency and reduce adjustment time.

[0060] S103: Acquire a photographed image with a watermark, and obtain watermark information based on the photographed image by tracing its source.

[0061] When step S102 is completed, the watermarked image can be displayed on the screen. When a shooting device (such as a mobile phone, camera, etc.) is used to shoot the screen, the shot image can be obtained, and the inverse processing technology can be used to trace the source and obtain the watermark information.

[0062] Furthermore, the above-mentioned step of obtaining the photographed image of the watermarked image and obtaining the watermark information based on tracing the source of the photographed image may include the following steps:

[0063] Step 31: performing perspective distortion correction on the captured image to obtain a corrected captured image;

[0064] Step 32: Obtain the R channel value, G channel value, and B channel value of RGB according to the corrected captured image;

[0065] Step 33: Obtain watermark information according to the R channel value, G channel value, and B channel value of RGB.

[0066] This embodiment uses transparent distortion correction technology to adjust tilted or distorted images caused by the shooting angle to a regular shape from a frontal perspective. The watermark information is then obtained through reverse processing using the aforementioned watermark information embedding technology. Specifically, perspective distortion correction is performed on the captured image before watermark extraction. The image deformation is treated as the result of scaling and stretching operations. By constructing a mapping equation and locating the four vertices of the color block, the original information of each point in the color block is extracted, resulting in the corrected captured image.

[0067] Furthermore, the above-mentioned perspective distortion correction of the captured image to obtain the corrected captured image may include the following steps:

[0068] Step 311: Obtain the first pixel coordinates of the four corner points of the captured image;

[0069] Step 312: Obtain the second pixel coordinates of the four corner points of the watermarked image;

[0070] Step 313: establishing a mapping relationship based on the first pixel coordinate and the second pixel coordinate, and obtaining a perspective transformation equation;

[0071] Step 314: Solve the perspective transformation equation using the least squares method to obtain a solution result;

[0072] Step 315: Use the solution result to perform inverse mapping on the first pixel coordinates and perform interpolation processing to obtain a corrected captured image.

[0073] Specifically, steps 311 and 312 in this embodiment can be manually marked or automatically detected. For example, a computer vision algorithm (such as edge detection, corner detection, deep learning model) is used to automatically identify the corners or feature points of the target area to obtain the first pixel coordinates and the second pixel coordinates. The automatic detection algorithm can be Harris corner detection, Hough transform, contour extraction, etc. For example, if the second pixel coordinates are (x1, y1), (x2, y2), (x3, y3), (x4, y4), they need to be mapped to the standard rectangle (0, 0), (W, 0), (W, H), (0, H) after correction. A mapping relationship is established based on the first pixel coordinates and the second pixel coordinates, and a perspective transformation equation (homography matrix) is obtained: the homography matrix H is solved by the correspondence between the original point (second pixel coordinate) and the target point (first pixel coordinate). The solution method is the least squares method (such as the DLT algorithm). The calculated homography matrix H is used to remap the captured image and perform interpolation processing to obtain the corrected captured image.

[0074] Furthermore, obtaining the R channel value, G channel value, and B channel value of the RGB image after correction may include the following steps:

[0075] Step 1: Segment the corrected captured image into color blocks to obtain individual color blocks;

[0076] Step 2: Calculate the pixel color mean of each color block in the R channel and G channel respectively;

[0077] Step 3: Based on the pixel color mean, use the parameter estimation of the binomial distribution to determine the true color value of each color block in the R channel and G channel, and use them as the R channel value and G channel value;

[0078] Step 4: Construct the color change equation of the B channel based on the R channel value and the G channel value, and calculate the color value of each color block in the B channel as the B channel value.

[0079] Specifically, you can refer to Figure 2The lower half of the image. The binomial distribution of R and G is calculated by the mean size of each color block, and the real R channel and G channel colors, that is, the R channel value and the G channel value, are restored. According to the changes in the R channel value and the G channel value, a color change equation is constructed to simulate the color change of the B channel, and the real B channel value is restored. Exemplarily, the threshold is set to 128, and the values of the R channel and G channel in each color block are reset to 0 or 255, so as to enhance the contrast of the R channel and G channel colors. Then the sum of the R channel and G channel pixels of each pixel point in each row is calculated, and the difference between the sum of a certain pixel and the sum of the pixels in the next row is sorted. The edges of each color block in the frame can be found by obtaining the rows with the largest difference. After finding the edges of each color block, the real R channel and G channel colors of the color block can be restored by the ratio of 255 and 0 in the R channel and G channel values in the color block. Furthermore, after finding the edge of the color block, we can know the matrix size of each color block. Due to shooting distortion, the color block may not be exactly a 64*64 matrix. Then we will obtain each watermark information from the color block according to the ratio of 64*64:16*4 (the obtained watermark matrix may not be exactly 16*4). According to the changes in the R channel and G channel of each pixel point, we construct a binary linear equation y=ax+b, where x is the shooting pixel value of the R channel and G channel, and y is the true pixel value (0 or 255). After solving the parameters a and b, we use this equation to simulate the color change of the B channel and obtain the true pixel value of the B channel. Then we set the threshold 128 to reset the pixel value of the B channel to 0 or 255, so as to obtain the final information of the B channel.

[0080] Furthermore, obtaining watermark information according to the R channel value, G channel value, and B channel value of RGB may include the following steps:

[0081] Repeat steps 1 to 4 to traverse all locatable color blocks, perform data fusion on the B channel values at the same logical position, determine the final binary value by statistical mean, and combine them to generate watermark information.

[0082] Specifically, this embodiment can repeatedly calculate all locatable color blocks to obtain multiple sets of 64*64 matrix B channel information, calculate the average value of the same position in different color blocks to obtain the final distribution of 0 and 1 of the watermark information, and thus restore the complete 64-bit information.

[0083] The screen capture traceability method provided by the embodiment of the present invention encodes watermark information to obtain a watermark information sequence; embeds the watermark information sequence into an image through the R channel, G channel, and B channel of RGB to obtain a watermarked image; obtains a captured image of the watermarked image, and traces the captured image to obtain the watermark information. The present invention uses the RGB channels of a single pixel image to generate a watermark, thereby improving the visual concealment of the watermark image, ensuring that it is imperceptible to the human eye and does not affect the user's visual quality. The watermark embedding position is not affected by the original image carrier, and the watermark information can be hidden in any area of the image. The watermark information recovery success rate is high. The repeated embedding and overlapping embedding of the watermark increases the number of candidate pixels that can be used for steganographic watermark recovery, solving the problem of single watermark extraction failure. The watermark information is embedded using color blocks, and a traceability solution is constructed to solve the traceability problem of screen capture leaks. At the same time, the present invention also solves the distortion problems caused by lighting, moiré, lens, color, etc. through the overlapping and repeated embedding of color blocks, thereby improving the accuracy and success rate of watermark information extraction.

[0084] The following is an introduction to a screen capture tracing device provided by an embodiment of the present invention. The screen capture tracing device described below and the screen capture tracing method described above can be referenced to each other.

[0085] Please refer to Figure 3 , Figure 3 A schematic structural diagram of a screen capture tracing device provided in an embodiment of the present invention may include:

[0086] The encoding module 100 is used to encode the watermark information to obtain a watermark information sequence;

[0087] The embedding module 200 is used to embed the watermark information sequence into the image through the R channel, G channel and B channel of RGB to obtain a watermarked image;

[0088] The tracing module 300 is configured to obtain a photographed image of the watermarked image and obtain the watermark information by tracing the photographed image.

[0089] Based on the above embodiment, the embedded module 200 may include:

[0090] A frame unit, configured to form a watermark color block frame using the R channel and the G channel of RGB; the watermark color block frame is used to locate the position of the watermark information sequence;

[0091] The writing unit is used to write the watermark information sequence into each color block of the watermark color block frame through the B channel of the RGB to obtain the watermarked image.

[0092] Based on the above embodiment, the traceability module 300 may include:

[0093] a correction unit, configured to perform perspective distortion correction on the captured image to obtain a corrected captured image;

[0094] a channel value acquiring unit, configured to acquire an R channel value, a G channel value, and a B channel value of RGB according to the corrected captured image;

[0095] The tracing unit is used to obtain the watermark information according to the R channel value, the G channel value and the B channel value of the RGB.

[0096] Based on the above embodiment, the correction unit may include:

[0097] A first acquisition subunit, configured to acquire first pixel coordinates of four corner points of the captured image;

[0098] A second acquiring subunit, configured to acquire second pixel coordinates of four corner points of the watermarked image;

[0099] a mapping subunit, configured to establish a mapping relationship based on the first pixel coordinates and the second pixel coordinates, and obtain a perspective transformation equation;

[0100] A solving subunit, configured to solve the perspective transformation equation using the least squares method to obtain a solution result;

[0101] An interpolation subunit is used to use the solution result to perform inverse mapping on the first pixel coordinates and perform interpolation processing to obtain the corrected captured image.

[0102] Based on the above embodiment, the channel value obtaining unit may include:

[0103] The first subunit is configured to execute step 1: performing color block segmentation on the corrected captured image to obtain individual color blocks;

[0104] The second subunit is configured to execute step 2: respectively calculating the pixel color mean of each color block in the R channel and the G channel;

[0105] The third subunit is configured to execute step 3: based on the pixel color mean, determine the true color value of each color block in the R channel and the G channel using the parameter estimation of the binomial distribution, and use the true color value as the R channel value and the G channel value;

[0106] The fourth subunit is configured to execute step 4: construct a color change equation for the B channel according to the R channel value and the G channel value, and calculate the color value of each color block in the B channel as the B channel value.

[0107] Based on the above embodiment, the traceability module 300 may include:

[0108] The loop unit is used to repeatedly execute steps 1 to 4 to traverse all locatable color blocks, perform data fusion on the B channel values at the same logical position, determine the final binary value by statistical mean, and combine them to generate the watermark information sequence.

[0109] Based on the above embodiment, the encoding module 100 may include:

[0110] The encoding unit is used to encode the terminal ID, current time, and opened document information in binary form into the 64-bit watermark information sequence.

[0111] It should be noted that the order of the modules and units in the above-mentioned screen shooting tracing device can be changed without affecting the logic.

[0112] The screen shooting tracing device provided by the embodiment of the present invention is used to encode watermark information through the encoding module 100 to obtain a watermark information sequence; the embedding module 200 is used to embed the watermark information sequence into the image through the R channel, G channel and B channel of RGB to obtain a watermarked image; the tracing module 300 is used to obtain a photographed image of the watermarked image, and obtain the watermark information based on the photographed image by tracing the source. The present invention uses the RGB channel of a single pixel image to generate a watermark, thereby improving the visual concealment of the watermark image, ensuring that it is not easily detected by the human eye, and does not affect the user's visual quality; and the watermark embedding position is not affected by the original image carrier, and the watermark information can be hidden in any area of the image; and the watermark information recovery success rate is high; through repeated embedding and overlay embedding of watermarks, the number of candidate pixels that can be used for steganographic watermark recovery is increased, solving the problem that a single watermark cannot be extracted; watermark information is embedded using color blocks, and a traceability solution is constructed to solve the traceability problem of screen leaks; at the same time, the present invention also solves the distortion problems caused by lighting, moiré, lens, color, etc. through overlay embedding and repeated embedding of color blocks, thereby improving the accuracy and success rate of watermark information extraction.

[0113] The following introduces a screen capture tracing device provided by an embodiment of the present invention. The screen capture tracing device described below and the screen capture tracing method described above can refer to each other.

[0114] Please refer to Figure 4 , Figure 4 A schematic structural diagram of a screen capture traceability device provided in an embodiment of the present invention may include:

[0115] Memory 10, for storing computer programs;

[0116] The processor 20 is configured to execute a computer program to implement the above-mentioned screen capture tracing method.

[0117] The memory 10 , the processor 20 , and the communication interface 31 all communicate with each other via the communication bus 32 .

[0118] In the embodiment of the present invention, the memory 10 is used to store one or more programs. The program may include program code, and the program code includes computer operation instructions. In the embodiment of the present invention, the memory 10 may store programs for implementing the following functions:

[0119] Encode the watermark information to obtain a watermark information sequence;

[0120] Through the R channel, G channel and B channel of RGB, the watermark information sequence is embedded into the image to obtain a watermarked image;

[0121] A captured image with a watermark is obtained, and watermark information is obtained based on the captured image.

[0122] In one possible implementation, the memory 10 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and applications required for at least one function, etc.; the data storage area may store data created during use.

[0123] In addition, the memory 10 may include a read-only memory and a random access memory, and provides instructions and data to the processor. A portion of the memory may also include NVRAM. The memory stores an operating system and operating instructions, executable modules or data structures, or a subset or an extended set thereof. The operating instructions may include various operating instructions for implementing various operations. The operating system may include various system programs for implementing various basic tasks and processing hardware-based tasks.

[0124] The processor 20 may be a central processing unit (CPU), an application-specific integrated circuit, a digital signal processor, a field programmable gate array, or other programmable logic device. The processor 20 may be a microprocessor or any conventional processor. The processor 20 may call a program stored in the memory 10 .

[0125] The communication interface 31 may be an interface of a communication module, used for connecting to other devices or systems.

[0126] Of course, it needs to be explained that Figure 4 The structure shown does not constitute a limitation on the screen capture and tracing device in the embodiment of the present invention. In actual applications, the screen capture and tracing device may include Figure 4 More or fewer components than shown, or combinations of certain components.

[0127] The following introduces a computer-readable storage medium provided in an embodiment of the present invention. The computer-readable storage medium described below and the screen capture tracing method described above can be referenced to each other.

[0128] The present invention also provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the above-mentioned screen shooting tracing method are implemented.

[0129] The computer-readable storage medium may include: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, etc., which can store program codes.

[0130] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from the other embodiments. Reference can be made to the descriptions of the identical or similar parts between the various embodiments. For the devices disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the descriptions are relatively simple, and the relevant parts can be referred to the descriptions of the methods.

[0131] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the above description has generally described the components and steps of each example according to their functions. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0132] Finally, it should be noted that, in this document, relationships such as first and second, etc., are used solely to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that includes a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus.

[0133] The above is a detailed introduction to the screen shooting tracing method, device, equipment and computer-readable storage medium provided by the present invention. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the ideas of the present invention, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as limiting the present invention.

Claims

1. A screen capture tracing method, characterized in that: include: Encode the watermark information to obtain a watermark information sequence; Embed the watermark information sequence into the image through the R channel, G channel and B channel of RGB to obtain a watermarked image; A photographed image of the watermarked image is obtained, and the watermark information is obtained by tracing the source of the photographed image.

2. The screen shooting tracing method according to claim 1, characterized in that: The watermark information sequence is embedded into the image through the R channel, G channel and B channel of RGB to obtain a watermarked image, including: A watermark color block frame is formed by the R channel and the G channel of RGB; the watermark color block frame is used to locate the position of the watermark information sequence; The watermark information sequence is written into each color block of the watermark color block frame through the B channel of the RGB to obtain the watermarked image.

3. The screen shooting tracing method according to claim 1, characterized in that: Acquiring a photographed image of the watermarked image, and tracing the source of the photographed image to obtain the watermark information, including: performing perspective distortion correction on the captured image to obtain a corrected captured image; Acquire the R channel value, G channel value, and B channel value of RGB according to the corrected captured image; The watermark information is obtained according to the R channel value, the G channel value and the B channel value of the RGB.

4. The screen capture tracing method according to claim 3, characterized in that: Performing perspective distortion correction on the captured image to obtain a corrected captured image includes: Obtaining first pixel coordinates of four corner points of the captured image; Obtaining second pixel coordinates of four corner points of the watermarked image; Establishing a mapping relationship based on the first pixel coordinates and the second pixel coordinates, and obtaining a perspective transformation equation; Solving the perspective transformation equation using the least squares method to obtain a solution; The first pixel coordinates are inversely mapped using the solution result, and interpolation processing is performed to obtain the corrected captured image.

5. The screen shooting tracing method according to claim 3, characterized in that: Obtaining an R channel value, a G channel value, and a B channel value of RGB according to the corrected captured image, including: Step 1: performing color block segmentation on the corrected captured image to obtain individual color blocks; Step 2: Calculate the pixel color mean of each color block in the R channel and the G channel respectively; Step 3: Based on the pixel color mean, the true color value of each color block in the R channel and the G channel is determined using the parameter estimation of the binomial distribution, and the values are used as the R channel value and the G channel value; Step 4: Construct a color change equation for the B channel according to the R channel value and the G channel value, and calculate the color value of each color block in the B channel as the B channel value.

6. The screen capture tracing method according to claim 5, characterized in that: Obtaining the watermark information according to the R channel value, the G channel value, and the B channel value of the RGB, including: Repeat steps 1 to 4 to traverse all locatable color blocks, perform data fusion on the B channel values at the same logical position, determine the final binary value by statistical mean, and combine them to generate the watermark information sequence.

7. The screen capture tracing method according to claim 1, characterized in that: Encode the watermark information to obtain a watermark information sequence, including: The terminal ID, current time, and opened document information are encoded in binary form into the 64-bit watermark information sequence.

8. A screen capture tracing device, characterized in that: include: An encoding module, used to encode watermark information to obtain a watermark information sequence; An embedding module, configured to embed the watermark information sequence into the image through the R channel, the G channel, and the B channel of RGB to obtain a watermarked image; The source tracing module is used to obtain a photographed image of the watermarked image and obtain the watermark information based on the photographed image by tracing the source.

9. A screen capture and tracing device, characterized in that: include: Memory for storing computer programs; A processor, configured to implement the screen shooting tracing method according to any one of claims 1 to 7 when executing the computer program.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are loaded and executed by the processor, the screen shooting tracing method according to any one of claims 1 to 7 is implemented.

Images