Image processing method and apparatus

Abstract

This specification provides an image processing method and apparatus. The image processing method is applied to a business application and includes: acquiring an initial image to be processed, wherein the initial image to be processed is an image to which a watermark needs to be added; segmenting the initial image to be processed into multiple sub-images to be processed and recording the initial position information of each sub-image; generating a final image based on the multiple sub-images to be processed and recording the target position information of each sub-image; sending the final image to be processed to a watermarking service provider and receiving a final watermark image returned by the watermarking service provider based on the final image; and generating a target watermark image corresponding to the initial image to be processed based on the final watermark image, the initial position information of each sub-image, and the target position information. This method ensures data security and eliminates the need for the business application and the watermarking service provider to negotiate specific watermarking algorithms, reducing communication costs and improving processing efficiency.

Description

Technical Field

[0001] The embodiments in this specification relate to the field of computer technology, and in particular to image processing methods. Background Technology

[0002] Digital watermarking is a type of protective information embedded into a carrier using computer algorithms. It's a content-based, non-cryptographic computer information hiding technology that embeds marker information into a digital carrier without affecting its usability. Image dark watermarking is applied to image scenarios, adding hidden marker information that is beyond the range of human visual perception. This means that an image with and without a dark watermark is difficult to distinguish from the naked eye. Dark watermarking is commonly used for copyright control, tracing evidence, and so on.

[0003] Currently, when users need to add a watermark to an image, they typically need to send the image to a third-party watermarking service provider, who then adds the watermark. To prevent the watermarking service provider from directly obtaining the original image and causing data leakage, users currently perform homomorphic encryption on the original image and send the encrypted file to the watermarking service provider. However, this method uses a computationally intensive homomorphic encryption algorithm and requires a matching watermarking algorithm, making it uncommon. Therefore, a new image processing method is urgently needed to solve these problems. Summary of the Invention

[0004] In view of this, embodiments of this specification provide an image processing method. One or more embodiments of this specification also relate to an image processing apparatus, a computing device, a computer-readable storage medium, and a computer program, to address technical deficiencies in the prior art.

[0005] According to a first aspect of the embodiments of this specification, an image processing method is provided, applied to a business entity, comprising:

[0006] Obtain an initial image to be processed, wherein the initial image to be processed is the image to which a watermark needs to be added;

[0007] The initial image to be processed is divided into multiple sub-images to be processed, and the initial position information of each sub-image to be processed is recorded;

[0008] A processing image is generated based on the multiple processing sub-images, and the target location information of each processing sub-image is recorded;

[0009] The image to be processed is sent to the watermarking service provider, and the watermarking service provider returns the watermarked image to be processed based on the image to be processed.

[0010] The target watermark image corresponding to the initial image to be processed is generated based on the watermark image to be processed, the initial position information of each sub-image to be processed, and the target position information.

[0011] According to a second aspect of the embodiments of this specification, an image processing method is provided, applied to an image processing system, the image processing system including a business party and a watermarking service party, the method comprising:

[0012] The service provider obtains an initial image to be processed, divides the initial image to be processed into multiple sub-images to be processed, records the initial position information of each sub-image to be processed, generates an image to be processed based on the multiple sub-images to be processed, records the target position information of each sub-image to be processed, and sends the image to be processed to the watermark service provider.

[0013] The watermarking service provider adds a target watermark to the image to be processed, generates a watermarked image to be processed, and sends the watermarked image to the service provider.

[0014] The service provider receives the watermark image to be processed and generates a target watermark image corresponding to the initial watermark image based on the watermark image to be processed, the initial position information of each sub-image to be processed, and the target position information.

[0015] According to a third aspect of the embodiments of this specification, an image processing apparatus is provided, applied in a business context, comprising:

[0016] The acquisition module is configured to acquire an initial image to be processed, wherein the initial image to be processed is an image for which a watermark needs to be added;

[0017] The segmentation module is configured to segment the initial image to be processed into multiple sub-images to be processed, and record the initial position information of each sub-image to be processed;

[0018] The generation module is configured to generate a processing image based on the plurality of processing sub-images and record the target location information of each processing sub-image;

[0019] The receiving module is configured to send the image to be processed to the watermarking service provider and receive the watermarked image to be processed returned by the watermarking service provider based on the image to be processed.

[0020] The restoration module is configured to generate a target watermark image corresponding to the initial watermark image based on the watermark image to be processed, the initial position information of each sub-image to be processed, and the target position information.

[0021] According to a fourth aspect of the embodiments of this specification, a computing device is provided, comprising:

[0022] Memory and processor;

[0023] The memory is used to store computer-executable instructions, and the processor is used to execute the computer-executable instructions, which, when executed by the processor, implement the steps of the above-described image processing method.

[0024] According to a fifth aspect of the embodiments of this specification, a computer-readable storage medium is provided that stores computer-executable instructions that, when executed by a processor, implement the steps of the image processing method described above.

[0025] According to a sixth aspect of the embodiments of this specification, a computer program is provided, wherein when the computer program is executed in a computer, it causes the computer to perform the steps of the above-described image processing method.

[0026] One embodiment of this specification provides a method for adding a dark watermark to an initial image to be processed to obtain a target watermarked image. This method protects the information security of the initial image to be processed by performing a segmented rearrangement of the initial image to be processed. Sending the image to be processed to the watermarking service provider will not lead to the leakage of the information corresponding to the initial image to be processed. After the watermarking service provider adds the dark watermark, the business party restores the watermarked image to be processed to obtain the target watermarked image with the added dark watermark. This method performs image segmentation and rearrangement with a small computational load, ensuring timely and efficient processing. Sending the rearranged image to the watermarking service provider ensures data security and eliminates the need for the business party and the watermarking service provider to negotiate specific watermarking algorithms, reducing communication costs and improving processing efficiency. Attached Figure Description

[0027] Figure 1 This is a schematic diagram illustrating an image processing method provided in one embodiment of this specification;

[0028] Figure 2 This is a flowchart illustrating an image processing method applied to a business application, as provided in one embodiment of this specification.

[0029] Figure 3 This is a schematic diagram of the segmentation of the initial image to be processed provided in one embodiment of this specification;

[0030] Figure 4 This is a schematic diagram of the rearrangement of an image to be processed provided in one embodiment of this specification;

[0031] Figure 5 This is a flowchart illustrating the processing procedure of an image processing method provided in one embodiment of this specification.

[0032] Figure 6This is a schematic diagram of the structure of an image processing apparatus provided in one embodiment of this specification;

[0033] Figure 7 This is a structural block diagram of a computing device provided in one embodiment of this specification. Detailed Implementation

[0034] Many specific details are set forth in the following description to provide a full understanding of this specification. However, this specification can be implemented in many other ways than those described herein, and those skilled in the art can make similar extensions without departing from the spirit of this specification. Therefore, this specification is not limited to the specific implementations disclosed below.

[0035] The terminology used in one or more embodiments of this specification is for the purpose of describing particular embodiments only and is not intended to be limiting of the one or more embodiments of this specification. The singular forms “a,” “described,” and “the” as used in one or more embodiments of this specification and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used in one or more embodiments of this specification refers to and includes any or all possible combinations of one or more associated listed items.

[0036] It should be understood that although the terms first, second, etc., may be used to describe various information in one or more embodiments of this specification, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, first may also be referred to as second without departing from the scope of one or more embodiments of this specification, and similarly, second may also be referred to as first. Depending on the context, the word "if" as used herein may be interpreted as "when," "when," or "in response to a determination."

[0037] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this manual are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation portals are provided for users to choose to authorize or refuse.

[0038] First, the terms and concepts used in one or more embodiments of this specification will be explained.

[0039] Image watermarking: This involves adding hidden markers to image data. These markers are outside the range of human visual perception, meaning that it is difficult to distinguish between images with and without a watermark. Watermarking is often used in scenarios such as copyright control and tracing evidence.

[0040] With the development of computer technology, digital technology is being applied to more and more scenarios. As digital technology businesses grow, a vast and complex ecosystem of cooperation has gradually formed. With the improvement of this ecosystem, various businesses are interacting with the outside world, carrying large amounts of data. With the promulgation of relevant laws and regulations on personal information protection, protecting users' personal information has become increasingly important for businesses. Currently, businesses need to add hidden watermarks to images in many business scenarios. However, businesses cannot add hidden watermarks directly; therefore, they need to send the images to a third-party watermarking service provider to add the watermark. However, due to the need to protect personal data privacy, businesses cannot directly send the original image to the watermarking service provider. Therefore, there is an urgent need for an image processing method that supports privacy protection when adding watermarks to images.

[0041] In current image processing, there exists a homomorphic encryption frequency domain transform image watermarking algorithm, which combines homomorphic encryption and frequency domain transform algorithms. The specific steps are as follows:

[0042] (1) The business party obtains a encrypted image by homomorphically encrypting the original image, and then submits the encrypted image to the watermarking service provider.

[0043] (2) After receiving the image, the watermarking service provider adds a dark watermark to the encrypted image. During this process, the watermarking service provider cannot obtain the real content of the image because all the data it obtains is encrypted.

[0044] (3) The watermarking service provider returns the watermarked image to the business party. The business party decrypts the image to obtain a new image, which also has a watermark. This new image is equivalent to the image returned after the original image is sent to the watermarking service provider to add the watermark. This is because the homomorphic encryption ensures equivalence.

[0045] While this method can ensure information security, it also has the following drawbacks:

[0046] (1) Homomorphic encryption algorithms have a large computational load and a large time overhead.

[0047] (2) The algorithm for dark watermarking needs to be compatible with the atomic operations of homomorphic encryption algorithms. Some dark watermarking algorithms may break homomorphism. Therefore, the business party and the watermarking service provider need to negotiate the specific homomorphic algorithm and dark watermarking algorithm. At the same time, the dark watermarking algorithm cannot be too complex, otherwise it will lead to the wrong result when the watermark is added to the encrypted image and then decrypted.

[0048] Based on this, an image processing method is provided in this specification. This specification also relates to an image processing apparatus, a computing device, and a computer-readable storage medium, which will be described in detail in the following embodiments.

[0049] See Figure 1 , Figure 1 This specification illustrates a schematic diagram of an image processing method according to an embodiment of the present specification, such as... Figure 1 As shown, the image processing method is applied to an image processing system, which includes a business party 102 and a watermarking service party 104.

[0050] In a real-world business scenario, business party 102 needs to add a watermark to an image. However, business party 102 does not have the ability to add watermarks itself and needs to use the watermarking service provider 104's watermarking and watermark extraction capabilities. Therefore, the image needs to be sent to the watermarking service provider 104 so that the watermarking service provider 104 can add a watermark to the image.

[0051] However, in order to ensure the data security of the image and prevent the watermarking service provider 104 from using the image for other purposes (such as training samples for machine learning), the business party 102 wants to use the watermarking service capability of the watermarking service provider 104, but does not want the watermarking service provider 104 to recognize the content of the image.

[0052] Based on this, this specification provides an image processing method, see [link to relevant documentation]. Figure 1 The business party 102 takes the image that needs to be watermarked as the initial image to be processed, and divides the initial image to be processed according to the preset segmentation method to obtain multiple image blocks. Then, the multiple image blocks are rearranged and combined into a new image, i.e. the image to be processed. At this time, the content of the image to be processed is different from the content of the initial image to be processed. The business party 102 can then send the image to be processed to the watermark service provider 104.

[0053] After obtaining the image to be processed, the watermarking service provider 104 can add a dark watermark to it. At this point, the watermarking service provider cannot obtain the original image from the image to be processed, and therefore cannot know the content of the original image, thus protecting the data security of the original image to be processed. After adding the dark watermark to the image to be processed, the watermarking service provider 104 obtains a watermarked image with the added dark watermark. The watermarked image and the original image are visually identical. Finally, the watermarking service provider 104 sends the watermarked image to the business party 102.

[0054] After receiving the watermark image to be processed, business party 102 can further segment the watermark image according to the preset segmentation method, and then restore the segmented image blocks according to the order of the initial watermark image to obtain the target watermark image. The target watermark image and the initial watermark image are completely identical to each other when viewed with the naked eye. The difference lies in the fact that a dark watermark has been added to the target watermark image.

[0055] Using the image processing method provided in this manual, the business party does not need to send the initial image to be processed (original image) to the watermarking service provider. Instead, the initial image to be processed is first segmented and rearranged to obtain the image to be processed. At this point, the image to be processed is different from the original initial image, and the content information from the original image can no longer be obtained from the image to be processed. The watermarking service provider only needs to add a dark watermark to the initial image to be processed and return the watermarked image to the business party. After obtaining the watermarked image, the business party can then restore it to obtain the target watermarked image containing the dark watermark.

[0056] When a business needs to extract a watermark, the target watermark image is segmented in the same way to generate a new watermark image to be processed. This new watermark image is then sent to the watermarking service provider, who extracts the dark watermark. Through this process, the business does not need to worry about the dark watermark being destroyed when restoring the target watermark image from the new watermark image, because the watermarking service provider uses the original watermark image for extraction. Furthermore, there is no need for the business and the watermarking service provider to negotiate the specific dark watermarking algorithm, making the process of adding a dark watermark to an image more convenient.

[0057] See Figure 2 , Figure 2 A flowchart is shown of an image processing method applied to a business party according to an embodiment of this specification, which specifically includes the following steps.

[0058] Step 202: Obtain the initial image to be processed, wherein the initial image to be processed is the image to which a watermark needs to be added.

[0059] It should be noted that the image processing method provided in the embodiments of this specification is applied to the business side, and more specifically, to the business side's terminal, which may be a laptop computer, a smart terminal, a server, a cloud server, or other terminal device. The specific form of the terminal is not limited in the embodiments provided in this specification.

[0060] Based on this, the method provided in this specification is that the terminal of the business party obtains the initial image to be processed, wherein the initial image to be processed specifically refers to the image to which a watermark needs to be added, and more specifically, the initial image to be processed specifically refers to the image to which a dark watermark needs to be added.

[0061] In practical applications, there are several ways to obtain the initial image to be processed. For example, the business can save the initial image to be processed to a certain storage location on the terminal in advance. When the initial image to be processed needs to be processed, it can be obtained based on the storage location. Another example is that when the business needs to add a watermark to an initial image to be processed, it can send the initial image to be processed to the terminal by sending an image processing command.

[0062] In one specific embodiment provided in this specification, the business party saves the initial image to be processed in advance to location a on the terminal. The application running on the terminal finds the corresponding initial image to be processed in location a and selects the initial image to be processed so that the terminal can obtain the initial image to be processed that needs to be watermarked.

[0063] Step 204: Divide the initial image to be processed into multiple sub-images to be processed, and record the initial position information of each sub-image to be processed.

[0064] Specifically, the sub-images to be processed refer to the multiple sub-images obtained after segmenting the initial image to be processed based on the segmentation information. See also Figure 3 , Figure 3 This specification illustrates a segmentation diagram of an initial image to be processed according to an embodiment, as shown below. Figure 3 As shown, an initial image to be processed is divided into 7*7=49 sub-images to be processed, and the initial position information of each sub-image to be processed is used as the number of each sub-image to be processed. Figure 3 Each sub-image to be processed is represented by a number indicating its image number. In practical applications, there are many ways to confirm the location information of the sub-image to be processed, such as... Figure 3 The method shown is to start recording from the top left corner of the image to be processed, in a left-to-right, top-to-bottom manner; alternatively, it can start from the bottom left corner of the initial image to be processed, in a left-to-right, bottom-to-top manner. In the embodiments provided in this specification, no limitation is made on how to record the initial position information of the sub-image to be processed, and the actual application shall prevail.

[0065] Furthermore, in practical applications, the initial position information of each sub-image to be processed can be recorded in a corresponding position information record table, and each sub-image to be processed can correspond to a position information record table.

[0066] In one specific embodiment provided in this specification, the initial image to be processed is divided into multiple sub-images to be processed, including:

[0067] Determine the first segment size information;

[0068] Based on the first segmentation size information, the initial image to be processed is cut to obtain multiple sub-images to be processed.

[0069] Specifically, the first segmentation size information refers to the segmentation size information used to segment the initial image to be processed. In practical applications, the first segmentation size information can be determined based on the size information of the initial image to be processed, or it can be determined based on the pixel resolution of the initial image to be processed. After determining the first segmentation size information, the initial image to be processed can be segmented according to the first segmentation size information to obtain multiple sub-images to be processed.

[0070] For example Figure 3 As shown, taking an initial image to be processed with a size of 700*700 as an example, its corresponding first segmentation size information is 7*7, so the initial image to be processed can be divided into 49 sub-images of 100*100 each.

[0071] In another specific embodiment provided in this specification, the initial image to be processed may also be rectangular. For example, if the initial image to be processed is 1080*720, based on the aspect ratio of the initial image to be processed, its first segmentation size information is 9*6, which means it can be divided into several sub-images of size 9*6.

[0072] It should be noted that the embodiments provided in this specification do not limit how the initial image to be processed is segmented, as long as it can be segmented into multiple sub-images to be processed. The first segmentation size information can be set by the business side or determined based on historical data. It is only necessary to record the first segmentation size information after segmenting the initial image to be processed into multiple sub-images to be processed according to the first segmentation size information.

[0073] Step 206: Generate a processing image based on the multiple processing sub-images, and record the target location information of each processing sub-image.

[0074] Specifically, the images to be processed refer to the images sent to the watermarking service provider after each sub-image to be processed has been randomly arranged. See [link to relevant documentation]. Figure 4 , Figure 4 This specification illustrates a schematic diagram of the rearrangement of an image to be processed according to an embodiment, as shown below. Figure 4 As shown, continuing Figure 3In the example, after scrambling the 49 sub-images to be processed, a new image to be processed is obtained. At the same time, the target position information of each sub-image to be processed is recorded. The target position information specifically refers to the current position information of the sub-image to be processed. For example, taking sub-image 19 as an example, its initial position information is 19 and its target position information is 0. Taking sub-image 1 as an example, its initial position information is 1 and its target position information is 12.

[0075] In practical applications, target location information and initial location information can be stored in the same location information record table. For example, taking the sub-image to be processed 1 as an example, its initial location information and target location information can be represented by (1,12), where 1 represents its initial location information and 12 represents its target location information. As another example, taking the sub-image to be processed 19 as an example, its initial location information and target location information can be represented by (19,0), where 19 represents its initial location information and 0 represents its target location information.

[0076] In practical applications, it is necessary to rearrange the sub-images to be processed to obtain the image to be processed. Specifically, generating the image to be processed based on the multiple sub-images includes:

[0077] An initial position sequence is generated based on the initial position information of each sub-image to be processed, and a disordered position sequence is generated based on the initial position sequence.

[0078] A matching image is generated based on each sub-image to be processed, the initial position sequence, and the disordered position sequence;

[0079] If the image similarity between the image to be matched and the initial image to be processed is less than a preset threshold, the image to be matched is determined to be the image to be processed.

[0080] Specifically, the initial position sequence refers to the position sequence generated from the initial position information of each sub-image to be processed, for example, using... Figure 3 Taking the illustration as an example, an initial position sequence (0, 1, ..., 48) is generated from the initial position information of each sub-image to be processed. After obtaining the initial position sequence, a randomized position sequence can be generated based on the initial position sequence. Specifically, generating a randomized position sequence based on the initial position sequence includes:

[0081] The initial position information in the initial position sequence is randomly adjusted to generate a disordered position sequence corresponding to the initial position sequence.

[0082] In practical applications, after obtaining the initial position sequence, each element in the initial position sequence is randomly permuted with other elements to obtain a randomized position sequence (19, 38, 20...39). The elements in the randomized position sequence represent the target position information for each sub-image to be processed. For example, for sub-image 19, it is the 19th position in the initial position sequence and the 0th position in the randomized position sequence. Therefore, it can be determined that sub-image 19 moves from position 19 to position 0, i.e., the position information corresponding to sub-image 19 is (19, 0). Similarly, for sub-image 20, it is the 20th position in the initial position sequence and the 2nd position in the randomized position sequence. Therefore, it can be determined that sub-image 20 moves from position 20 to position 2, i.e., the position information corresponding to sub-image 20 is (20, 2)...

[0083] After determining the position information of each sub-image to be processed in the initial position sequence and the position information in the disordered position sequence, the corresponding rearrangement can be performed to generate the image to be matched.

[0084] The image to be matched specifically refers to the initial image generated after segmentation and rearrangement. In practical applications, the image to be matched cannot be directly used as the image to be processed. Further judgment is needed on the image to be matched to determine whether the original initial image to be processed can be restored from the image to be matched. Only when the difference between the image to be matched and the initial image to be processed is large enough can the image to be matched be determined as the image to be processed that can be transmitted to the watermarking service provider.

[0085] Specifically, in order to determine the difference between the image to be matched and the initial image to be processed, the image similarity between the two images can be calculated. If the image similarity is less than a preset threshold, it means that the difference between the image to be matched and the initial image to be processed is large enough that the information carried in the initial image to be processed cannot be obtained from the image to be matched.

[0086] Furthermore, calculating the image similarity between the image to be matched and the initial image to be processed can be achieved through a pre-trained image similarity model. The image to be matched and the initial image to be processed are input into the pre-trained image similarity model, and the image similarity output by the model is obtained. In practical applications, the image to be matched can also be converted into an image vector, and the initial image to be processed can be converted into an initial image vector. Then, the vector similarity between the image vector to be matched and the initial image vector to be processed can be calculated, and this vector similarity can be used to represent the image similarity between the image to be matched and the initial image to be processed.

[0087] If the image similarity between the image to be matched and the initial image to be processed is less than a preset threshold, then the image to be matched can be determined as the image to be processed.

[0088] In practical applications, there are also cases where, due to inappropriate segmentation size information, the generated image to be matched is not significantly different from the initial image to be processed. The watermarking service provider can easily reconstruct the image to be processed from the image to be matched. That is, the image similarity between the generated image to be matched and the initial image to be processed is greater than or equal to a preset threshold. In another specific embodiment provided in this specification, the method further includes:

[0089] If the image similarity between the image to be matched and the initial image to be processed is greater than or equal to the preset threshold, a second segmentation size information is determined, wherein the second segmentation size information is smaller than the first segmentation size information;

[0090] The initial image to be processed is cut based on the second segmentation size information to obtain multiple sub-images to be processed, and the step of generating an image to be processed based on the multiple sub-images to be processed continues.

[0091] If the image similarity between the image to be matched and the initial image to be processed is greater than or equal to a preset threshold, it means that the image to be matched and the initial image to be processed are highly similar, and the information carried in the initial image to be processed can still be obtained from the image to be matched. In this case, the image to be matched cannot be sent to the watermarking service provider as the image to be processed.

[0092] Therefore, the initial image to be processed needs to be re-segmented. Accordingly, new segmentation dimensions need to be determined, namely, the second segmentation dimensions. It's important to note that these second segmentation dimensions must be smaller than the first segmentation dimensions. The second segmentation dimensions can be determined based on the first segmentation dimensions. For example, if the first segmentation dimensions are 10*10, the second segmentation dimensions can be set to 5*5; if the first segmentation dimensions are 9*6, the second segmentation dimensions can be 3*2. In practical applications, the second segmentation dimensions may not necessarily be related to the first segmentation dimensions. For example, if the first segmentation dimensions are 10*10, the second segmentation dimensions can be 4*3. In practice, it is sufficient that the second segmentation dimensions are smaller than the first segmentation dimensions.

[0093] After determining the second segmentation size information, the initial image to be processed is re-segmented based on the second segmentation size information to obtain more sub-images to be processed. The steps of recording the initial position information of each sub-image to be processed and generating a new image to be processed based on each sub-image are then repeated. It should be noted that when segmenting the initial image to be processed using the second segmentation size information, the second segmentation size information can be used as the first segmentation size information mentioned above. If, after segmenting and rearranging the initial image to be processed using the second segmentation size information, the image similarity between the generated image to be matched and the initial image to be processed is still greater than or equal to a preset threshold, a new, smaller second segmentation size information needs to be determined until the image similarity between the generated image to be matched and the initial image to be processed is less than the preset threshold.

[0094] By calculating the image similarity between the image to be matched and the initial image to be processed, the images to be matched that are greater than or equal to a preset threshold are re-segmented and rearranged, making it more difficult to obtain the information carried in the initial image to be processed, thus further ensuring the security of the information in the initial image to be processed.

[0095] In one specific embodiment provided in this specification, the method further includes:

[0096] Obtain the current segmentation size information, wherein the current segmentation size information is either the first segmentation size information or the second segmentation size information;

[0097] Save the current segmentation size information, the target position information of each sub-image to be processed, and the initial position information.

[0098] Specifically, the current segmentation size information refers to the segmentation size information corresponding to the image to be processed. When the image to be matched obtained after segmenting and rearranging the initial image to be processed using the first segmentation size information can be used as the image to be processed, the first segmentation size information is the current segmentation size information. When the image to be matched obtained after segmenting and rearranging the initial image to be processed using the second segmentation size information can be used as the image to be processed, the second segmentation size information is the current segmentation size information.

[0099] After determining the current size information, it is necessary to save the current segmentation size information along with the target position information and initial position information of each sub-image to be processed, so as to provide a reference in the subsequent restoration process.

[0100] Step 208: Send the image to be processed to the watermarking service provider and receive the watermarked image to be processed returned by the watermarking service provider based on the image to be processed.

[0101] After obtaining the image to be processed, it can be sent to the watermarking service provider, who will then add a dark watermark to the image. At this point, the image is messy and the watermarking service provider cannot extract any useful information from it.

[0102] After adding the corresponding dark watermark to the image to be processed, the watermark service provider obtains the watermarked image and sends it to the business party. The business party can then obtain the watermarked image. The watermarked image and the image to be processed are identical to each other when viewed with the naked eye.

[0103] Step 210: Generate the target watermark image corresponding to the initial image to be processed based on the watermark image to be processed, the initial position information of each sub-image to be processed, and the target position information.

[0104] After obtaining the watermarked image to be processed, the watermarked image can be restored to the target watermarked image based on the initial and target position information of each sub-image to be processed saved in the above steps. The target watermarked image is an image that is indistinguishable from the initial watermarked image to be processed by the naked eye. The target watermarked image is the image with a dark watermark added to the initial watermarked image. It should be noted that, depending on the differences in different dark watermarking algorithms, the dark watermark may be destroyed or may remain intact during the process of restoring the watermarked image to the target watermarked image. In the embodiments provided in this specification, the integrity of the dark watermark in the target watermarked image is not limited.

[0105] Specifically, the process of generating a target watermark image corresponding to the initial image to be processed based on the watermark image to be processed, the initial position information of each sub-image to be processed, and the target position information includes:

[0106] The watermark image to be processed is segmented according to the current segmentation size information to obtain multiple watermark sub-images to be processed, wherein the watermark sub-images to be processed and the sub-images to be processed correspond one-to-one.

[0107] Generate the target watermark image based on the initial position information and target position information corresponding to each watermark sub-image to be processed.

[0108] In practical applications, the watermark image to be processed is segmented according to the pre-saved current segmentation size information to obtain multiple watermark sub-images to be processed. At this time, the size, position and other information of the obtained watermark sub-images to be processed correspond to the sub-images to be processed.

[0109] After obtaining multiple watermark sub-images to be processed, each watermark sub-image can be restored based on the saved initial position information and target position information, thereby generating the target watermark image.

[0110] For example, with Figure 4 Taking the image shown as an example, for the watermark sub-image 19 to be processed, the saved position information is (19,0), where 19 is the initial position information and 0 is the target position information, indicating that the current watermark sub-image 19 to be processed is located at the 0th position and needs to be restored to the 19th position.

[0111] After performing the above processing steps on the watermark sub-images to be processed, the final target watermark image can be obtained.

[0112] In practical applications, besides adding a dark watermark to an image, it is also necessary to extract the dark watermark from an image that has already been watermarked. Therefore, in a specific embodiment provided in this specification, the method further includes:

[0113] Receive a watermark extraction command for the target watermark image;

[0114] A watermark image to be processed is generated based on the target watermark image, the initial position information of each sub-image to be processed, and the target position information;

[0115] The watermark image to be processed is sent to the watermark service provider, and the target watermark returned by the watermark service provider based on the watermark image to be processed is received.

[0116] Specifically, the watermark extraction instruction refers to the instruction to extract the dark watermark from the target watermark image. After receiving the watermark extraction instruction, the target watermark image can be segmented according to a similar processing method to the process of generating the target watermark image. After the target watermark image is segmented and rearranged according to the initial position information and target position information of each pre-saved sub-image to be processed, the watermark image to be processed is obtained. The watermark image to be processed at this time is the watermark image to be processed generated during the process of adding the dark watermark.

[0117] Specifically, in one embodiment provided in this specification, the method further includes:

[0118] Retrieve pre-saved current segmentation size information;

[0119] Accordingly, a watermark image to be processed is generated based on the target watermark image, the initial position information of each sub-image to be processed, and the target position information, including:

[0120] The target watermark image is segmented according to the current segmentation size information to obtain multiple watermark sub-images to be processed, wherein the watermark sub-images to be processed and the sub-images to be processed correspond one-to-one.

[0121] The watermark image to be processed is generated based on the initial position information and target position information corresponding to each watermark sub-image.

[0122] During the process of processing the initial image to be processed to generate the target watermark image, the current segmentation size information is saved. Different images may have different segmentation size information. After obtaining the current segmentation size information, the target watermark image can be segmented based on this information to obtain multiple watermark sub-images to be processed. At this time, the watermark sub-images to be processed correspond one-to-one with the sub-images to be processed in the above steps. Then, according to the initial position information and target position information corresponding to each sub-image to be processed that are saved in advance, the target watermark image can be rearranged into the watermark image to be processed.

[0123] After obtaining the watermark image to be processed, it is sent to the watermark service provider, who then extracts the target watermark to be added to the watermark image and sends the target watermark to the business party.

[0124] The image processing method provided in the embodiments of this specification offers a method for adding a dark watermark to an initial image to be processed to obtain a target watermarked image. This method protects the information security of the initial image to be processed by performing a segmented rearrangement of the initial image to be processed. Sending the image to be processed to the watermarking service provider will not lead to the leakage of the information corresponding to the initial image to be processed. After the watermarking service provider adds the dark watermark, the business party restores the watermarked image to be processed to obtain the target watermarked image with the added dark watermark. This method performs image segmentation and rearrangement processing with a small computational load, ensuring timely and efficient processing. Sending the rearranged image to be processed to the watermarking service provider ensures data security and eliminates the need for the business party and the watermarking service provider to negotiate specific watermarking algorithms, reducing communication costs and improving processing efficiency.

[0125] The following is in conjunction with the appendix Figure 5 Taking the application of the image processing method provided in this specification in a banking business scenario as an example, the image processing method will be further explained. Figure 5 A flowchart illustrating the processing steps of an image processing method according to an embodiment of this specification is shown, specifically including the following steps.

[0126] Step 502: Obtain the initial image to be processed, A1, where the initial image to be processed, A1 is the image to which a watermark needs to be added.

[0127] Step 504: Determine the first segmentation size information, and cut the initial image to be processed A1 based on the first segmentation size information to obtain multiple sub-images to be processed.

[0128] Step 506: Record the initial position information of each sub-image to be processed and generate an initial position sequence.

[0129] Step 508: Randomly adjust the initial position information in the initial position sequence to generate a disordered position sequence corresponding to the initial position sequence, wherein the disordered position sequence corresponds to the target position information of each sub-image to be processed.

[0130] Step 510: Generate the matching image A2 based on the disordered position sequence and each sub-image to be processed.

[0131] Step 512: Calculate the image similarity between the image to be matched A2 and the initial image to be processed A1.

[0132] Step 514: Determine whether the image similarity is less than a preset threshold. If not, proceed to step 516; if yes, proceed to step 518.

[0133] Step 516: Determine the second segmentation size information that is smaller than the first segmentation size information, use the second segmentation size information as the first segmentation size information, and continue to execute the operation of step 504.

[0134] Step 518: Determine the image to be matched A2 as the image to be processed A3, and at the same time save the current segmentation size information, the initial position information and the target position information corresponding to each sub-image to be processed.

[0135] Step 520: Send the image A3 to be processed to the watermarking service provider and receive the watermarked image A4 to be processed returned by the watermarking service provider based on the image A3.

[0136] Step 522: Divide the watermark image A4 into multiple watermark sub-images according to the current segmentation size information, wherein each watermark sub-image corresponds to another sub-image.

[0137] Step 524: Generate the target watermark image A5 based on the initial position information and target position information corresponding to each watermark sub-image to be processed.

[0138] The image processing method provided in the embodiments of this specification offers a method for adding a dark watermark to an initial image to be processed to obtain a target watermarked image. This method protects the information security of the initial image to be processed by performing a segmented rearrangement of the initial image to be processed. Sending the image to be processed to the watermarking service provider will not lead to the leakage of the information corresponding to the initial image to be processed. After the watermarking service provider adds the dark watermark, the business party restores the watermarked image to be processed to obtain the target watermarked image with the added dark watermark. This method performs image segmentation and rearrangement processing with a small computational load, ensuring timely and efficient processing. Sending the rearranged image to be processed to the watermarking service provider ensures data security and eliminates the need for the business party and the watermarking service provider to negotiate specific watermarking algorithms, reducing communication costs and improving processing efficiency.

[0139] Corresponding to the above method embodiments, this specification also provides embodiments of an image processing apparatus. Figure 6 A schematic diagram of the structure of an image processing apparatus according to one embodiment of this specification is shown. Figure 6 As shown, the device includes:

[0140] The acquisition module 602 is configured to acquire an initial image to be processed, wherein the initial image to be processed is an image for which a watermark needs to be added;

[0141] The segmentation module 604 is configured to segment the initial image to be processed into multiple sub-images to be processed, and record the initial position information of each sub-image to be processed;

[0142] The generation module 606 is configured to generate a processing image based on the plurality of processing sub-images and record the target position information of each processing sub-image;

[0143] The receiving module 608 is configured to send the image to be processed to the watermarking service provider and receive the watermarked image to be processed returned by the watermarking service provider based on the image to be processed.

[0144] The restoration module 610 is configured to generate a target watermark image corresponding to the initial watermark image based on the watermark image to be processed, the initial position information of each sub-image to be processed, and the target position information.

[0145] Optionally, the segmentation module 604 is further configured to:

[0146] Determine the first segment size information;

[0147] Based on the first segmentation size information, the initial image to be processed is cut to obtain multiple sub-images to be processed.

[0148] Optionally, the generation module 606 is further configured to:

[0149] An initial position sequence is generated based on the initial position information of each sub-image to be processed, and a disordered position sequence is generated based on the initial position sequence.

[0150] A matching image is generated based on each sub-image to be processed, the initial position sequence, and the disordered position sequence;

[0151] If the image similarity between the image to be matched and the initial image to be processed is less than a preset threshold, the image to be matched is determined to be the image to be processed.

[0152] Optionally, the generation module 606 is further configured to:

[0153] If the image similarity between the image to be matched and the initial image to be processed is greater than or equal to the preset threshold, a second segmentation size information is determined, wherein the second segmentation size information is smaller than the first segmentation size information;

[0154] The initial image to be processed is cut based on the second segmentation size information to obtain multiple sub-images to be processed, and the step of generating an image to be processed based on the multiple sub-images to be processed continues.

[0155] Optionally, the generation module 606 is further configured to:

[0156] The initial position information in the initial position sequence is randomly adjusted to generate a disordered position sequence corresponding to the initial position sequence.

[0157] Optionally, the generation module 606 is further configured to:

[0158] Obtain the current segmentation size information, wherein the current segmentation size information is either the first segmentation size information or the second segmentation size information;

[0159] Save the current segmentation size information, the target position information of each sub-image to be processed, and the initial position information.

[0160] Optionally, the restoration module is further configured to:

[0161] The watermark image to be processed is segmented according to the current segmentation size information to obtain multiple watermark sub-images to be processed, wherein the watermark sub-images to be processed and the sub-images to be processed correspond one-to-one.

[0162] Generate the target watermark image based on the initial position information and target position information corresponding to each watermark sub-image to be processed.

[0163] Optionally, the device further includes:

[0164] The instruction receiving module is configured to receive a watermark extraction instruction for the target watermark image;

[0165] The image generation module is configured to generate a watermark image to be processed based on the target watermark image, the initial position information of each sub-image to be processed, and the target position information.

[0166] The watermark receiving module is configured to send the watermark image to be processed to the watermark service provider and receive the target watermark returned by the watermark service provider based on the watermark image to be processed.

[0167] Optionally, the device further includes:

[0168] The size acquisition module is configured to acquire pre-saved current segmentation size information;

[0169] Accordingly, the image generation module is further configured as follows:

[0170] The target watermark image is segmented according to the current segmentation size information to obtain multiple watermark sub-images to be processed, wherein the watermark sub-images to be processed and the sub-images to be processed correspond one-to-one.

[0171] The watermark image to be processed is generated based on the initial position information and target position information corresponding to each watermark sub-image.

[0172] The image processing apparatus provided in the embodiments of this specification offers a device for adding a dark watermark to an initial image to be processed to obtain a target watermark image. This device protects the information security of the initial image to be processed by performing a segmented rearrangement of the initial image to be processed. Sending the image to be processed to the watermark service provider will not lead to the leakage of the information corresponding to the initial image to be processed. After the watermark service provider adds the dark watermark, the business party restores the watermark image to be processed to obtain the target watermark image with the added dark watermark. Through this device, the image segmentation and rearrangement process has a small computational load, ensuring timely and efficient processing. Sending the rearranged image to be processed to the watermark service provider ensures data security and eliminates the need for the business party and the watermark service provider to negotiate specific watermarking algorithms, reducing communication costs and improving processing efficiency.

[0173] The above is an illustrative scheme of an image processing apparatus according to this embodiment. It should be noted that the technical solution of this image processing apparatus and the technical solution of the image processing method described above belong to the same concept. For details not described in detail in the technical solution of the image processing apparatus, please refer to the description of the technical solution of the image processing method described above.

[0174] Figure 7 A structural block diagram of a computing device 700 according to one embodiment of this specification is shown. The components of the computing device 700 include, but are not limited to, a memory 710 and a processor 720. The processor 720 is connected to the memory 710 via a bus 730, and a database 750 is used to store data.

[0175] The computing device 700 also includes an access device 740, which enables the computing device 700 to communicate via one or more networks 760. Examples of these networks include Public Switched Telephone Network (PSTN), Local Area Network (LAN), Wide Area Network (WAN), Personal Area Network (PAN), or combinations of communication networks such as the Internet. The access device 740 may include one or more of any type of wired or wireless network interface (e.g., a network interface card (NIC)), such as an IEEE 802.11 Wireless Local Area Network (WLAN) wireless interface, a Wi-MAX (Worldwide Interoperability for Microwave Access) interface, an Ethernet interface, a Universal Serial Bus (USB) interface, a cellular network interface, a Bluetooth interface, or a Near Field Communication (NFC) interface.

[0176] In one embodiment of this specification, the above-described components of the computing device 700 and Figure 7 Other components, not shown, can also be connected to each other, for example, via a bus. It should be understood that... Figure 7 The block diagram of the computing device shown is for illustrative purposes only and is not intended to limit the scope of this specification. Those skilled in the art can add or replace other components as needed.

[0177] The computing device 700 can be any type of stationary or mobile computing device, including mobile computers or mobile computing devices (e.g., tablet computers, personal digital assistants, laptop computers, notebook computers, netbooks, etc.), mobile phones (e.g., smartphones), wearable computing devices (e.g., smartwatches, smart glasses, etc.) or other types of mobile devices, or stationary computing devices such as desktop computers or personal computers (PCs). The computing device 700 can also be a mobile or stationary server.

[0178] The processor 720 is configured to execute the following computer-executable instructions, which, when executed by the processor, implement the steps of the aforementioned data processing method. The above is an illustrative scheme of a computing device according to this embodiment. It should be noted that the technical solution of this computing device and the technical solution of the aforementioned image processing method belong to the same concept; details not described in detail in the technical solution of the computing device can be found in the description of the technical solution of the aforementioned image processing method.

[0179] An embodiment of this specification also provides a computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement the steps of the above-described image processing method.

[0180] The above is an illustrative scheme of a computer-readable storage medium according to this embodiment. It should be noted that the technical solution of this storage medium and the technical solution of the image processing method described above belong to the same concept. For details not described in detail in the technical solution of the storage medium, please refer to the description of the technical solution of the image processing method described above.

[0181] An embodiment of this specification also provides a computer program, wherein when the computer program is executed in a computer, it causes the computer to perform the steps of the above-described image processing method.

[0182] The above is an illustrative example of a computer program according to this embodiment. It should be noted that the technical solution of this computer program and the technical solution of the image processing method described above belong to the same concept. Details not described in detail in the computer program's technical solution can be found in the description of the technical solution of the image processing method described above.

[0183] The foregoing has described specific embodiments of this specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims may be performed in a different order than that shown in the embodiments and may still achieve the desired result. Furthermore, the processes depicted in the drawings do not necessarily require the specific or sequential order shown to achieve the desired result. In some embodiments, multitasking and parallel processing are possible or may be advantageous.

[0184] The computer instructions include computer program code, which may be in the form of source code, object code, executable file, or certain intermediate forms. The computer-readable medium may include any entity or device capable of carrying the computer program code, recording media, USB flash drives, portable hard drives, magnetic disks, optical disks, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc. It should be noted that the content included in the computer-readable medium may be appropriately added to or subtracted according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media may not include electrical carrier signals and telecommunication signals.

[0185] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that the embodiments in this specification are not limited to the described order of actions, because according to the embodiments in this specification, some steps can be performed in other orders or simultaneously. Furthermore, those skilled in the art should also understand that the embodiments described in this specification are all preferred embodiments, and the actions and modules involved are not necessarily essential to the embodiments in this specification.

[0186] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0187] The preferred embodiments disclosed above are merely illustrative of this specification. The optional embodiments do not exhaustively describe all details, nor do they limit the invention to the specific implementations described. Clearly, many modifications and variations can be made based on the embodiments described herein. These embodiments are selected and specifically described in this specification to better explain the principles and practical applications of the embodiments, thereby enabling those skilled in the art to better understand and utilize this specification. This specification is limited only by the claims and their full scope and equivalents.

Claims

1. An image processing method, applied to a business context, comprising: Obtain an initial image to be processed, wherein the initial image to be processed is the image to which a watermark needs to be added; The initial image to be processed is divided into multiple sub-images to be processed, and the initial position information of each sub-image to be processed is recorded; A processing image is generated based on the multiple processing sub-images, and the target location information of each processing sub-image is recorded; The image to be processed is sent to the watermarking service provider, and the watermarking service provider returns the watermarked image to be processed based on the image to be processed. The target watermark image corresponding to the initial image to be processed is generated based on the watermark image to be processed, the initial position information of each sub-image to be processed, and the target position information. Receive a watermark extraction instruction for the target watermark image and obtain pre-saved current segmentation size information; The target watermark image is segmented according to the current segmentation size information to obtain multiple watermark sub-images to be processed, wherein the watermark sub-images to be processed and the sub-images to be processed correspond one-to-one. Generate a watermark image to be processed based on the initial position information and target position information corresponding to each watermark sub-image to be processed; The watermark image to be processed is sent to the watermark service provider, and the target watermark returned by the watermark service provider based on the watermark image to be processed is received.

2. The method as described in claim 1, wherein the initial image to be processed is segmented into multiple sub-images to be processed, comprising: Determine the first segment size information; Based on the first segmentation size information, the initial image to be processed is cut to obtain multiple sub-images to be processed.

3. The method as described in claim 2, wherein generating the image to be processed based on the plurality of sub-images to be processed includes: An initial position sequence is generated based on the initial position information of each sub-image to be processed, and a disordered position sequence is generated based on the initial position sequence. A matching image is generated based on each sub-image to be processed, the initial position sequence, and the disordered position sequence; If the image similarity between the image to be matched and the initial image to be processed is less than a preset threshold, the image to be matched is determined to be the image to be processed.

4. The method of claim 3, further comprising: If the image similarity between the image to be matched and the initial image to be processed is greater than or equal to the preset threshold, a second segmentation size information is determined, wherein the second segmentation size information is smaller than the first segmentation size information; The initial image to be processed is cut based on the second segmentation size information to obtain multiple sub-images to be processed, and the step of generating an image to be processed based on the multiple sub-images to be processed continues.

5. The method of claim 3, wherein generating a disordered position sequence based on the initial position sequence comprises: The initial position information in the initial position sequence is randomly adjusted to generate a disordered position sequence corresponding to the initial position sequence.

6. The method of claim 4, further comprising: Obtain the current segmentation size information, wherein the current segmentation size information is either the first segmentation size information or the second segmentation size information; Save the current segmentation size information, the target position information of each sub-image to be processed, and the initial position information.

7. The method as described in claim 6, comprising generating a target watermark image corresponding to the initial image to be processed based on the watermark image to be processed, the initial position information of each sub-image to be processed, and the target position information, comprising: The watermark image to be processed is segmented according to the current segmentation size information to obtain multiple watermark sub-images to be processed, wherein the watermark sub-images to be processed and the sub-images to be processed correspond one-to-one. Generate the target watermark image based on the initial position information and target position information corresponding to each watermark sub-image to be processed.

8. An image processing method applied to an image processing system, the image processing system comprising a business party and a watermarking service party, the method comprising: The service provider obtains an initial image to be processed, divides the initial image to be processed into multiple sub-images to be processed, records the initial position information of each sub-image to be processed, generates an image to be processed based on the multiple sub-images to be processed, records the target position information of each sub-image to be processed, and sends the image to be processed to the watermark service provider. The watermarking service provider adds a target watermark to the image to be processed, generates a watermarked image to be processed, and sends the watermarked image to the service provider. The service provider receives the watermark image to be processed, and generates a target watermark image corresponding to the initial watermark image based on the watermark image to be processed, the initial position information and the target position information of each sub-image to be processed. It receives a watermark extraction instruction for the target watermark image, obtains pre-saved current segmentation size information, segments the target watermark image according to the current segmentation size information, and obtains multiple watermark sub-images to be processed. Each sub-image to be processed corresponds to another sub-image to be processed. The service provider generates a watermark image to be processed based on the initial position information and the target position information corresponding to each sub-image to be processed, sends the watermark image to be processed to the watermark service provider, and receives the target watermark returned by the watermark service provider based on the watermark image to be processed.

9. An image processing apparatus, applied to a business entity, comprising: The acquisition module is configured to acquire an initial image to be processed, wherein the initial image to be processed is an image for which a watermark needs to be added; The segmentation module is configured to segment the initial image to be processed into multiple sub-images to be processed, and record the initial position information of each sub-image to be processed; The generation module is configured to generate a processing image based on the plurality of processing sub-images and record the target location information of each processing sub-image; The receiving module is configured to send the image to be processed to the watermarking service provider and receive the watermarked image to be processed returned by the watermarking service provider based on the image to be processed. The restoration module is configured to generate a target watermark image corresponding to the initial watermark image based on the watermark image to be processed, the initial position information of each sub-image to be processed, and the target position information. The instruction receiving module is configured to receive a watermark extraction instruction for the target watermark image; The size acquisition module is configured to acquire pre-saved current segmentation size information; The image generation module is configured to segment the target watermark image according to the current segmentation size information to obtain multiple watermark sub-images to be processed, wherein the watermark sub-images to be processed and the sub-images to be processed correspond one-to-one; and to generate a watermark image to be processed according to the initial position information and target position information corresponding to each watermark sub-image to be processed. The watermark receiving module is configured to send the watermark image to be processed to the watermark service provider and receive the target watermark returned by the watermark service provider based on the watermark image to be processed.

10. A computing device, comprising: Memory and processor; The memory is used to store computer-executable instructions, and the processor is used to execute the computer-executable instructions, which, when executed by the processor, implement the steps of the method according to any one of claims 1-7.

11. A computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement the steps of the method according to any one of claims 1-7.

Images