Image processing method, electronic device, and storage medium

By encoding and image fusion of the information to be encoded by electronic devices, the problem of information leakage in confidential situations of electronic devices is solved, traceless display and accurate traceability are achieved, and information security and user experience are improved.

WO2024244729A1PCT designated stage expired Publication Date: 2024-12-05BOE TECHNOLOGY GROUP CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/087982
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-31
Filing Date
2024-04-16
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

In office or conference venues where confidentiality is required, writing and document display using electronic devices with display screens can easily lead to information leakage. The existing screen watermarks are difficult to ensure information security and user perception at the same time, and screenshots and sneak shots cannot be provided. Accurate traceability of behavior.

Method used

By encoding the information to be encoded corresponding to the display device, adjusting the pixel value of the specific area of ​​the target image, generating an encoded image, and fusing the target image with the encoded image to form a fused image to achieve traceability display and subsequent decoding to provide a traceability basis. .

Benefits of technology

It realizes the improvement of information security, avoids information leakage without affecting the user's impression, and provides accurate traceability basis for screenshots and candid shooting, improving the universality and decoding accuracy of screen watermarking technology.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024087982_05122024_PF_FP_ABST
    Figure CN2024087982_05122024_PF_FP_ABST
Patent Text Reader

Abstract

Embodiments of the present disclosure provide an image processing method, an electronic device, and a storage medium. The image processing method comprises: encoding first information to be encoded corresponding to a display apparatus to obtain first encoded information; according to the first encoded information, adjusting a pixel value of at least one first predetermined area of an image to be encoded corresponding to a target image to obtain a first encoded image; and fusing the target image and the first encoded image to obtain a fused image.
Need to check novelty before this filing date? Find Prior Art

Description

Image processing method, electronic device and storage medium Technical Field

[0001] The present application relates to the field of image processing technology, and in particular to an image processing method, electronic equipment, and storage medium. Background Art

[0002] With the continuous development of computer and network technologies, paperless and electronic office work has gradually become popular, and the application of various electronic devices with display screens has become more and more extensive. Such electronic devices are mainly used for writing and document display in daily office work, meetings and other occasions.

[0003] Although the use of such electronic devices can bring convenience to people's daily office work, if such electronic devices are used for writing and document display in some office or meeting situations where confidentiality is required, it is easy to cause information leakage.

[0004] Summary of the Invention

[0005] According to a first aspect, the present disclosure provides an image processing method, comprising: encoding first information to be encoded corresponding to a display device to obtain first encoded information; adjusting pixel values ​​of at least one first predetermined area of ​​an image to be encoded corresponding to a target image according to the first encoded information to obtain a first encoded image; and fusing the target image and the first encoded image to obtain a fused image.

[0006] For example, the first coding information includes at least one first coding number; wherein, according to the first coding information, adjusting the pixel values ​​of at least one first predetermined area of ​​the image to be encoded corresponding to the target image to obtain the first coding image includes: adjusting the pixel values ​​of at least one first predetermined area of ​​the image to be encoded corresponding to the target image according to at least one first predetermined pixel value respectively corresponding to at least one first coding number to obtain the first coding image, wherein the pixel values ​​of at least one first predetermined area of ​​the first coding image include at least one first predetermined pixel value respectively corresponding to at least one first coding number.

[0007] For example, the number of bits of the first coding number is N, where N is a positive integer; wherein, according to at least one first predetermined pixel value corresponding to each of the at least one first coding number, adjusting the pixel value of at least one first predetermined area of ​​the image to be coded corresponding to the target image, to obtain the first coded image includes: for each first predetermined area in the at least one first predetermined area, dividing the first predetermined area into N first predetermined sub-areas, wherein the N first predetermined sub-areas include N1 first coding sub-areas and N2 second coding sub-areas, the N-bit first coding number includes N1 first coding number and N2 second coding number, and N1 and N2 are natural numbers; based on the first coding strategy, according to a first predetermined pixel value corresponding to each N1-bit first coding number, the pixel values ​​of N1 first coding sub-regions of the image to be encoded corresponding to the target image are adjusted to obtain N1 first coding region images; based on the second coding strategy, according to a plurality of predetermined pixel values ​​corresponding to each N2-bit second coding number, the pixel values ​​of N2 second coding sub-regions of the image to be encoded corresponding to the target image are adjusted to obtain N2 second coding region images; and based on the N1 first coding region images and the N2 second coding region images, a first coding image is obtained.

[0008] For example, based on the first coding strategy, according to a first predetermined pixel value corresponding to each of the N1-bit first coding numbers, the pixel values ​​of the N1 first coding sub-regions of the image to be encoded corresponding to the target image are adjusted to obtain N1 first coding region images, including: for each first coding sub-region in the N1 first coding sub-regions, determining the first coding number corresponding to the first coding sub-region, and obtaining the first target coding number corresponding to the first coding sub-region; and adjusting the pixel value of the first coding sub-region to the first predetermined pixel value corresponding to the first target coding number, and obtaining the first coding region image corresponding to the first coding sub-region.

[0009] For example, the plurality of first predetermined pixel values ​​include a first coded predetermined pixel value and at least one second coded predetermined pixel value, and the first coded predetermined pixel value is greater than any one of the at least one second coded predetermined pixel value; wherein, based on the second coding strategy, according to the plurality of predetermined pixel values ​​corresponding to the N2-bit second coded numbers, adjusting the pixel values ​​of the N2 second coded sub-regions of the image to be coded corresponding to the target image, and obtaining the N2 second coded region images includes: for each second coded sub-region of the N2 second coded sub-regions, determining the second coded number corresponding to the second coded sub-region, and obtaining the second target coded number corresponding to the second coded sub-region; according to the first predetermined association A relationship set is used to determine a first predetermined ratio corresponding to the second target coding number, wherein the first predetermined association relationship set includes N2 first predetermined association relationships, and the first predetermined association relationship represents the association relationship between the second coding number and the first predetermined ratio; and according to the first predetermined ratio, the pixel value of the coded first region in the second coding sub-region is adjusted to the first coded predetermined pixel value, and the pixel value of the coded second region in the second coding sub-region is adjusted to at least one second coded predetermined pixel value, to obtain a second coding region image corresponding to the second coding sub-region, wherein the ratio between the size information of the coded first region and the size information of the second coding sub-region is the first predetermined ratio.

[0010] For example, the above method also includes: determining a second predetermined association relationship corresponding to each of the N1 first coding sub-regions to obtain a second predetermined association relationship set, wherein the second predetermined association relationship set includes N1 second predetermined association relationships, the second predetermined association relationship represents the association relationship between the first predetermined region identifier and the first predetermined policy identifier, the first predetermined region identifier is used to represent the first coding sub-region, and the first predetermined policy identifier represents that the coding strategy corresponding to the first coding sub-region is the first coding strategy; determining a third predetermined association relationship corresponding to each of the N2 second coding sub-regions to obtain a third predetermined association relationship set, wherein the third predetermined association relationship set includes N2 third predetermined association relationships, the third predetermined association relationship represents the association relationship between the second predetermined region identifier and the second predetermined policy identifier, the second predetermined region identifier is used to represent the second coding sub-region, and the second predetermined policy identifier represents that the coding strategy corresponding to the second coding sub-region is the second coding strategy; and storing the second predetermined association relationship set and the third predetermined association relationship set.

[0011] For example, the first information to be encoded includes a multi-bit first number to be encoded; wherein, encoding the first information to be encoded corresponding to the display device to obtain the first encoded information includes: dividing the multi-bit first number to be encoded into a plurality of first groups to be encoded; determining the first check code corresponding to each of the plurality of first groups to be encoded to obtain a plurality of first check codes; and obtaining the first encoded information based on the multi-bit first number to be encoded and the plurality of first check codes.

[0012] For example, fusing the target image and the first encoded image to obtain a fused image includes: determining the product between the pixel value of at least one pixel included in the target image and a first predetermined coefficient to obtain first pixel information; determining the product between the pixel value of at least one pixel included in the first encoded image and a second predetermined coefficient to obtain second pixel information; obtaining third pixel information based on the first pixel information and the second pixel information; and obtaining the fused image based on the third pixel information.

[0013] For example, the shape of the first predetermined area includes at least one of the following: rectangle, square, diamond, triangle, and circle.

[0014] For example, the shape of the first coding sub-region includes at least one of the following: rectangle, square, diamond, triangle, circle; the shape of the second coding sub-region includes at least one of the following: rectangle, square, diamond, triangle, circle.

[0015] For example, the first information to be encoded includes at least one of the following: a device identification, a time displayed on a display device, and a geographical location.

[0016] According to the second aspect, the present disclosure also provides an image processing method, comprising: processing an image to be processed to obtain a second encoded image, wherein the image to be processed includes one of the following: a fused image and a captured image corresponding to the fused image, and the fused image is obtained according to the method of any one of claims 1 to 11; obtaining second encoded information based on pixel values ​​of at least one second predetermined area of ​​the second encoded image; and decoding the second encoded information to obtain second information to be encoded corresponding to the display device.

[0017] For example, obtaining the second coding information based on the pixel value of at least one second predetermined area of ​​the second encoded image includes: determining the second coding number corresponding to each of the at least one second predetermined areas of the second encoded image based on at least one second predetermined pixel value corresponding to each of the at least one second predetermined areas of the second encoded image, to obtain the second coding information.

[0018] For example, the number of bits of the second coding number is N, the N-bit second coding number includes an N1-bit first decoding number and an N2-bit second decoding number, N is a positive integer, and N1 and N2 are natural numbers; wherein, based on at least one second predetermined pixel value corresponding to each of the at least one second predetermined areas of the second coded image, determining the second coding number corresponding to each of the at least one second predetermined areas of the second coded image, and obtaining the second coding information includes: determining at least one second predetermined area corresponding to the second coded image and N1 first decoding sub-areas and N2 second decoding sub-areas corresponding to each of the at least one second predetermined area; for each second predetermined area in the at least one second predetermined area, obtaining the second coding information in one of the following ways: based on the first decoding strategy, obtaining the first decoding information based on a second predetermined pixel value corresponding to each of the N1 first decoding sub-areas and multiple second predetermined pixel values ​​corresponding to each of the N2 second decoding sub-areas; when it is determined that the first decoding information includes the first target decoding number corresponding to each of the N1 first decoding sub-areas and does not include the second target decoding number corresponding to each of the N2 second decoding sub-areas, based on the second decoding strategy, Obtaining second decoding information based on a plurality of second predetermined pixel values ​​corresponding to each of the N2 second decoding sub-regions of the second predetermined region; and, if it is determined that the second decoding information includes a second target decoding number corresponding to each of the N2 second decoding sub-regions, obtaining an N-bit second code number based on the N1-bit first target decoding number and the N2-bit second target decoding number; or, based on the second decoding strategy, obtaining third decoding information based on a second predetermined pixel value corresponding to each of the N1 first decoding sub-regions and a plurality of second predetermined pixel values ​​corresponding to each of the N2 second decoding sub-regions; if it is determined that the third decoding information includes the second target decoding number corresponding to each of the N2 second decoding sub-regions and does not include the first target decoding number corresponding to each of the N1 first decoding sub-regions, obtaining fourth decoding information based on a second predetermined pixel value corresponding to each of the N1 first decoding sub-regions of the second predetermined region, based on the first decoding strategy; and, if it is determined that the fourth decoding information includes the first target decoding number corresponding to each of the N1 first decoding sub-regions, obtaining an N-bit second code number based on the N1-bit first target decoding number and the N2-bit second target decoding number.

[0019] For example, the number of bits of the second coding number is N, the N-bit second coding number includes an N1-bit first decoding number and an N2-bit second decoding number, N is a positive integer, and N1 and N2 are natural numbers; wherein, based on at least one second predetermined pixel value corresponding to at least one second predetermined area of ​​the second coded image, determining the second coding number corresponding to each of the at least one second predetermined areas of the second coded image, and obtaining the second coding information includes: determining at least one second predetermined area corresponding to the second coded image and N1 first decoding sub-areas and N2 second decoding sub-areas corresponding to each of the at least one second predetermined area; for each second predetermined area in the at least one second predetermined area, determining a decoding strategy corresponding to the N1 first decoding sub-areas of the second predetermined area and a decoding strategy corresponding to the N second decoding sub-areas of the second predetermined area, to obtain a first decoding strategy corresponding to the N1 first decoding sub-areas and a second decoding strategy corresponding to the N2 second decoding sub-areas; based on the first decoding strategy, according to the N1 second predetermined area A first target decoding number corresponding to each of the N1 first decoding sub-regions is obtained according to a second predetermined pixel value corresponding to each of the N2 second decoding sub-regions of the second predetermined region; based on the second decoding strategy, a second target decoding number corresponding to each of the N2 second decoding sub-regions is obtained according to a plurality of second predetermined pixel values ​​corresponding to each of the N2 second decoding sub-regions of the second predetermined region; and an N-bit second coding number is obtained according to the N1-bit first target decoding number and the N2-bit second target decoding number.

[0020] For example, the multiple second predetermined pixel values ​​include a first decoding predetermined pixel value and at least one second decoding predetermined pixel value, and the first decoding predetermined pixel value is greater than any one of the at least one second decoding predetermined pixel value; wherein, based on the second decoding strategy, according to the multiple second predetermined pixel values ​​corresponding to the N2 second decoding sub-regions of the second predetermined region, obtaining the second target decoding number corresponding to each of the N2 second decoding sub-regions includes: for each second decoding sub-region of the N2 second decoding sub-regions, according to the first decoding predetermined pixel value corresponding to the second decoding sub-region, determining the decoding first region in the second decoding sub-region; determining the ratio between the size information of the decoding first region and the size information of the second decoding sub-region, and obtaining the second predetermined ratio corresponding to the second decoding sub-region; and determining the second decoding number corresponding to the second predetermined ratio according to the first predetermined association relationship set, and obtaining the second target decoding number corresponding to the second predetermined sub-region, wherein the first predetermined association relationship set includes N2 first predetermined association relationships, and the first predetermined association relationship represents the association relationship between the second decoding number and the second predetermined ratio.

[0021] For example, determining the decoding strategies corresponding to N1 first decoding sub-regions of the second predetermined region and the decoding strategies corresponding to N second decoding sub-regions of the second predetermined region, and obtaining the first decoding strategies corresponding to the N1 first decoding sub-regions and the second decoding strategies corresponding to the N2 second decoding sub-regions includes: determining, based on the second predetermined association relationship set, that the encoding strategies corresponding to the N1 first decoding sub-regions are respectively the first encoding strategies, then determining that the decoding strategies corresponding to the N1 first decoding sub-regions are the first decoding strategies, wherein the second predetermined association relationship set includes N1 second predetermined association relationships, the second predetermined association relationship representing the association relationship between the first predetermined region identifier and the first predetermined strategy identifier, and the first predetermined association relationship set including the N1 second predetermined association relationships. The predetermined area identifier is used to represent the first decoding sub-area, and the first predetermined strategy identifier represents that the coding strategy corresponding to the first decoding sub-area is the first coding strategy; and when the coding strategy corresponding to each of the N2 second decoding sub-areas is determined to be the second coding strategy according to the third predetermined association relationship set, the decoding strategy corresponding to the N2 second decoding sub-areas is determined to be the second decoding strategy, wherein the third predetermined association relationship set includes N2 third predetermined association relationships, the third predetermined association relationship represents the association relationship between the second predetermined area identifier and the second predetermined strategy identifier, the second predetermined area identifier is used to represent the second decoding sub-area, and the second predetermined strategy identifier represents that the coding strategy corresponding to the second decoding sub-area is the second coding strategy.

[0022] For example, decoding the second coded information to obtain second information to be coded corresponding to the display device includes: obtaining multiple second check codes based on the second coded information; determining second groups to be coded corresponding to each of the multiple second check codes to obtain multiple second groups to be coded; and obtaining second information to be coded based on the multiple second groups to be coded.

[0023] For example, processing the image to be processed to obtain the second encoded image includes: obtaining a feature map of at least one scale according to the image to be processed; and obtaining the second encoded image according to the feature map of at least one scale.

[0024] For example, at least one scale includes J scales, where J is a positive integer; wherein obtaining the second encoded image according to the feature map of the at least one scale includes: when 1≤j<J, obtaining a fused feature map of the jth scale according to the feature map of the jth scale and the upsampled feature map, wherein the upsampled feature map of the jth scale is obtained based on the feature map of the j+1th scale and the upsampled feature map, and the feature map of the jth scale is obtained based on the feature map of the j-1th scale, and j is an integer greater than or equal to 1 and less than or equal to J; and obtaining the second encoded image according to the fused feature map of the 1st scale.

[0025] According to a third aspect, the present disclosure also provides an electronic device comprising: one or more processors; a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors execute the above-mentioned image processing method.

[0026] According to a third aspect, the present disclosure further provides a computer-readable storage medium having executable instructions stored thereon, which, when executed by a processor, causes the processor to perform the above-mentioned image processing method.

[0027] According to a third aspect, the present disclosure further provides a computer program product, comprising a computer program, which implements the above-mentioned image processing method when executed by a processor. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] The above and other features of the embodiments of the present disclosure will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which:

[0029] FIG1 is a flowchart of an image processing method according to an embodiment of the present disclosure;

[0030] FIG2A is a schematic diagram of a first coding sub-region under a first coding strategy according to an embodiment of the present disclosure;

[0031] FIG2B is a schematic diagram of a second coding sub-region under a second coding strategy according to an embodiment of the present disclosure;

[0032] FIG2C is a schematic diagram showing the coexistence of a first coding sub-region and a second coding sub-region according to an embodiment of the present disclosure;

[0033] FIG2D is a schematic diagram showing the coexistence of a first coding sub-region and a second coding sub-region according to another embodiment of the present disclosure;

[0034] FIG2E is a schematic diagram showing a plurality of first predetermined areas on an image to be encoded according to an embodiment of the present disclosure;

[0035] FIG3 is a schematic diagram of a first encoded image according to an embodiment of the present disclosure;

[0036] FIG4 is a schematic diagram of a fused image according to an embodiment of the present disclosure;

[0037] FIG5 is a flowchart of an image processing method according to another embodiment of the present disclosure;

[0038] FIG6 is a flow chart of obtaining a second encoded image from a fused image according to one embodiment of the present disclosure;

[0039] FIG7 is a framework diagram of an image processing method according to yet another embodiment of the present disclosure; and

[0040] FIG8 is a block diagram of an electronic device suitable for implementing an image processing method according to an embodiment of the present disclosure.

[0041] In the drawings, the same or similar structures are marked with the same or similar reference numerals. DETAILED DESCRIPTION

[0042] In order to make the purpose, technical solutions and advantages of the embodiments of the present disclosure clearer, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the described embodiments of the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure. It should be noted that throughout the drawings, the same elements are represented by the same or similar figure marks. In the following description, some specific embodiments are only for descriptive purposes and should not be understood as any limitation to the present disclosure, but are only examples of the embodiments of the present disclosure. Conventional structures or configurations will be omitted when they may cause confusion in the understanding of the present disclosure. It should be noted that the shapes and sizes of the components in the figures do not reflect the actual size and proportion, but only illustrate the contents of the embodiments of the present disclosure.

[0043] It should be noted that in the drawings, the sizes and relative sizes of elements may be exaggerated for clarity and / or descriptive purposes. Thus, the sizes and relative sizes of the individual elements are not necessarily limited to those shown in the drawings. In the specification and drawings, the same or similar reference numerals indicate the same or similar parts.

[0044] Unless otherwise defined, the technical or scientific terms used in the embodiments of the present disclosure should have the ordinary meanings understood by those of ordinary skill in the art. The terms "first," "second," and similar terms used in this disclosure do not indicate any order, quantity, or importance, but are simply used to distinguish different components. The terms "include" or "comprising" and similar terms mean that the elements or objects preceding the word include the elements or objects listed after the word and their equivalents, without excluding other elements or objects.

[0045] Unless otherwise specified, directional terms such as "upper," "lower," "left," "right," "inner," and "outer" are used herein to indicate positions or relationships based on the figures shown. These terms are intended solely to facilitate the description of the present disclosure and are not intended to indicate or imply that the devices, components, or parts referred to must have, be constructed, or operate in a specific orientation. It should be understood that when the absolute positions of the objects being described change, the relative positions they represent may also change accordingly. Therefore, these directional terms should not be construed as limiting the present disclosure.

[0046] In addition, in the description of the embodiments of the present disclosure, the term "connected" or "connected to" may refer to a direct connection between two components or a connection between two components via one or more other components. In addition, the two components may be connected or coupled via a wired or wireless manner.

[0047] In the technical solutions disclosed herein, the collection, storage, use, processing, transmission, provision, disclosure and application of the data involved (including but not limited to user personal information) comply with the provisions of relevant laws and regulations, take necessary confidentiality measures, and do not violate public order and good morals.

[0048] Screen watermarking technology has a long history and is generally categorized as either explicit or implicit. While adding explicit or implicit watermarks to screen information can reduce the risk of leaks, explicit watermarks, being visible to the naked eye, can create a poor user experience and affect the display quality. Furthermore, displaying device information via explicit watermarks can also result in secondary leaks. While implicit watermarks can be displayed imperceptibly, they only encrypt digital data and provide no basis for tracing back to the source during screenshots and surreptitious photography.

[0049] In view of this, the present disclosure provides an image processing method for preventing information leakage, improving information security, and enhancing user experience, while also providing a basis for accurate tracing of actions such as screenshots and candid photography. Specifically, the method includes encoding first information to be encoded corresponding to a display device to obtain first encoded information; adjusting the pixel values ​​of at least one first predetermined region of an image to be encoded corresponding to a target image based on the first encoded information to obtain a first encoded image; and fusing the target image with the first encoded image to obtain a fused image.

[0050] FIG1 is a flowchart of an image processing method according to an embodiment of the present disclosure.

[0051] As shown in FIG. 1 , the image processing method may include operations S110 to S130 .

[0052] In operation S110 , first to-be-encoded information corresponding to the display device is encoded to obtain first encoded information.

[0053] In operation S120, pixel values ​​of at least one first predetermined area of ​​an image to be encoded corresponding to a target image are adjusted according to the first encoding information to obtain a first encoded image.

[0054] In operation D130, the target image and the first encoded image are fused to obtain a fused image.

[0055] According to an embodiment of the present disclosure, the display device may be a device with a display screen, such as a mobile phone, a tablet computer, a television, a monitor, a laptop computer, a digital photo frame, a navigator, or any other product or component with a display function.

[0056] According to an embodiment of the present disclosure, the first information to be encoded corresponding to the display device may refer to at least one of the device identification of the display device, the time displayed on the display device, and the geographical location. The device identification may be the SN (Serial Number) code of the device, or the IP (Internet Protocol Address) address or MAC (Media Access Control Address) address to which the device belongs, or the internal number of the device. The time displayed on the display device may be a time including year, month, day, hour, and minute levels. The geographical location may be the current geographical location of the device.

[0057] According to an embodiment of the present disclosure, the first coded information may be information obtained by performing multi-base conversion on the information to be coded. Base conversion may be understood as binary conversion, quaternary conversion, octal conversion, decimal conversion, hexadecimal conversion, etc. For example, the first coded information may be information obtained by performing binary conversion on at least one of a device identifier, a time displayed by a display device, and a geographic location.

[0058] According to an embodiment of the present disclosure, by adding the encoded device identification, displayed time, geographic location and other information to the target image, a basis is provided for tracing the source analysis of the target image if the target image is subsequently leaked.

[0059] According to an embodiment of the present disclosure, the target image may be an image to be displayed on a display screen, and may refer to a picture with visual effects.

[0060] According to an embodiment of the present disclosure, the image to be encoded may be an image matrix used to generate an encoded image. Specifically, the size of the image to be encoded is the same as the size of the target image, that is, the width and height of the image to be encoded and the target image are the same. Before the encoded image is formed, the pixel values ​​in the image to be encoded may all be 0.

[0061] According to an embodiment of the present disclosure, the first predetermined area may be a coding area in an image to be coded. By changing the pixel values ​​of the coding area according to the first coding information, a first coded image corresponding to the adjusted pixel values ​​of the coding area can be obtained. The pixel values ​​in the first coded image can be associated with the coded device identification, the displayed time, and the geographic location information.

[0062] According to an embodiment of the present disclosure, a first coded image with device identification, display time, and geographic location is superimposed and fused with a target image to be displayed on a display screen, and the transparency of the first coded image is adjusted to a preset transparency value so that the first coded image is displayed seamlessly on the display screen.

[0063] According to an embodiment of the present disclosure, the first information to be encoded corresponding to the display device is encoded onto the image to be encoded to obtain a first encoded image, and the target image and the first encoded image are fused to achieve seamless display of the first encoded image. Compared with the clear watermark of the prior art, the embodiment of the present disclosure can achieve seamless display of the first encoded image, improving the user's viewing experience. In addition, the clear watermark of the prior art generally directly displays the first information to be encoded of the embodiment of the present disclosure, while the present application encodes the first information to be encoded, obtains the encoded information, and then seamlessly displays the first encoded image obtained according to the encoded information on the display screen. The embodiment of the present disclosure avoids the problem of secondary leakage of the first information to be encoded and improves the security of the information. Compared with the dark watermark of the prior art, the objects targeted by the embodiment of the present disclosure can include images, not just digital data, which improves the universality of screen watermarking technology. Moreover, the first encoded image of the embodiment of the present disclosure is also easy to extract in the subsequent decoding process, and the first information to be encoded is obtained, providing convenience and basis for accurate tracing of information.

[0064] According to an embodiment of the present disclosure, operation S110 may include the following operations: dividing a multi-bit first number to be encoded into a plurality of first groups to be encoded; determining a first check code corresponding to each of the plurality of first groups to be encoded to obtain a plurality of first check codes; and obtaining first coding information based on the multi-bit first number to be encoded and the plurality of first check codes.

[0065] According to an embodiment of the present disclosure, the first information to be encoded may include a multi-digit first number to be encoded, for example, a number to be encoded consisting of the SN code of the device and the time displayed by the display device.

[0066] According to an embodiment of the present disclosure, determining a first check code corresponding to each of a plurality of first groups to be coded to obtain the plurality of first check codes may include the following operations: determining a polynomial and a basic field associated with the first number to be coded; dividing the first number to be coded into groups of predetermined bits to obtain the plurality of first groups to be coded; treating the first groups to be coded obtained after the division as coefficients of the polynomial, constructing a new polynomial, and calculating the remainder when the new polynomial is divided by the original polynomial, using the remainder as the first check code. The remainder is added to the end of the first number to be coded to obtain the plurality of final first coded numbers.

[0067] According to the embodiments of the present disclosure, the above encoding operation can be understood as BCH encoding, that is, the first number to be encoded is divided into first encoding groups according to a fixed number of k (k is a positive integer), and each first encoding group is then independently converted into a binary digit group of length n (n>k). This process can be called a codeword. If the number of first encoding groups is M (obviously M>=2), the set of M codewords obtained is called the first encoding group with a code length of n and a number of information M, denoted by n, M. The process of converting the first encoding group into codewords is called encoding, and the inverse process is called decoding.

[0068] According to the embodiments of the present disclosure, by adopting the BCH encoding method, since BCH encoding already includes check bits, it can be used to detect and correct data errors, which can play a good verification role in data transmission and verification scenarios. By adopting the BCH encoding method, the accuracy of information restoration when restoring the encoded information can also be improved.

[0069] According to an embodiment of the present disclosure, the first encoding information may include at least one first encoding number. Operation S120 may further include the following operation: adjusting pixel values ​​of at least one first predetermined region of an image to be encoded corresponding to the target image based on at least one first predetermined pixel value corresponding to each of the at least one first encoding numbers, to obtain a first encoded image, wherein the pixel values ​​of the at least one first predetermined region of the first encoded image include at least one first predetermined pixel value corresponding to each of the at least one first encoding numbers.

[0070] According to an embodiment of the present disclosure, the number of bits of the first coded number may be N, where N is a positive integer. Taking the example of the first information to be coded including a device identifier and a displayed time, the first coded information may include a 24-bit binary coded number for the device identifier and a 23-bit binary coded number for the time. Therefore, the first coded information may include a 47-bit coded number, where N is 47. It should be noted that the specific number of bits described above is for example purposes only, and the number of bits may be adaptively adjusted based on actual needs.

[0071] According to an embodiment of the present disclosure, since the first coding information needs to be presented in the form of an image, it is necessary to establish a correspondence between the first coding information and the pixel value. Specifically, it is necessary to establish a correspondence between the coding number in the first coding information and the pixel value. For example, one or more pixel values ​​can be pre-configured to be associated with the coding number, and the first predetermined pixel value can be the pre-configured pixel value. Exemplarily, the coding number is 0, and the corresponding first predetermined pixel value can be 0 or 255, 0, 0, 0. When adjusting the pixel value of the first predetermined area on the image to be encoded according to the first coding information, the original pixel value of the first predetermined area can be adjusted to the above-mentioned first predetermined pixel value.

[0072] According to an embodiment of the present disclosure, adjusting pixel values ​​of at least one first predetermined region of an image to be encoded corresponding to a target image according to at least one first predetermined pixel value corresponding to at least one first coding number to obtain a first coded image may include the following operations: for each first predetermined region of the at least one first predetermined region, dividing the first predetermined region into N first predetermined sub-regions, wherein the N first predetermined sub-regions include N1 first coding sub-regions and N2 second coding sub-regions, the N-bit first coding number includes an N1-bit first coding number and an N2-bit second coding number, and N1 and N2 are natural numbers; based on a first coding strategy, adjusting pixel values ​​of the N1 first coding sub-regions of the image to be encoded corresponding to the target image according to a first predetermined pixel value corresponding to each of the N1-bit first coding numbers to obtain N1 first coding region images; based on a second coding strategy, adjusting pixel values ​​of the N2 second coding sub-regions of the image to be encoded corresponding to the target image according to multiple predetermined pixel values ​​corresponding to each of the N2-bit second coding numbers to obtain N2 second coding region images; and obtaining the first coded image based on the N1 first coding region images and the N2 second coding region images.

[0073] According to embodiments of the present disclosure, the first coding sub-region may be a region for implementing a first coding strategy; the second coding sub-region may be a region for implementing a second coding strategy. Within the first predetermined region, the first and second coding sub-regions may coexist, or only the first or the second coding sub-region may exist. The specific location can be adaptively adjusted based on actual needs. The positions of the first and second coding sub-regions can be adaptively adjusted based on actual needs.

[0074] According to an embodiment of the present disclosure, the first coding number may refer to a coding number using a first coding strategy; the second coding number may refer to a coding number using a second coding strategy. Each first coding number in the first coding strategy corresponds to a first predetermined pixel value; each second coding number in the second coding strategy may correspond to multiple first predetermined pixel values.

[0075] For example, assuming the number of bits in the first code number is 47, the first predetermined area can be divided into 47 first predetermined sub-areas. Within the 47-bit first code number, the 24-bit code number representing the device can be the first code number, processed using the first coding strategy, and in this case, the first code sub-area can be 24. The 23-bit code number representing the time can be the second code number, processed using the second coding strategy, and in this case, the second code sub-area can be 23. Optionally, the 47-bit first code number can be processed using only the first coding strategy or only the second coding strategy. When using only the first coding strategy, the number N1 of the first coding sub-areas is 47, and the number N2 of the second coding sub-areas is 0. When using only the second coding strategy, the number N1 of the first coding sub-areas is 0, and the number N2 of the second coding sub-areas is 47. In another embodiment, the 24-bit code number representing the device identifier can be processed using a combination of the first and second coding strategies, and the 23-bit code number representing the time can also be processed using a combination of the first and second coding strategies. The specific strategy adopted can be adaptively adjusted according to actual needs.

[0076] According to an embodiment of the present disclosure, the first coding region image may be obtained by adjusting pixel values ​​of the first coding sub-region; and the second coding region image may be obtained by adjusting pixel values ​​of the second coding sub-region.

[0077] According to an embodiment of the present disclosure, based on the first coding strategy, according to a first predetermined pixel value corresponding to each of the N1-bit first coding numbers, adjusting the pixel values ​​of the N1 first coding sub-regions of the image to be encoded corresponding to the target image, and obtaining the N1 first coding region images may include the following operations: for each first coding sub-region in the N1 first coding sub-regions, determining the first coding number corresponding to the first coding sub-region, and obtaining the first target coding number corresponding to the first coding sub-region; and adjusting the pixel value of the first coding sub-region to the first predetermined pixel value corresponding to the first target coding number, and obtaining the first coding region image corresponding to the first coding sub-region.

[0078] FIG2A is a schematic diagram of a first coding sub-region under a first coding strategy according to an embodiment of the present disclosure.

[0079] In the case shown in FIG2A , N1 can be 4. Specifically, a codable region can be selected from the image to be encoded 201 as the first predetermined region 202. Four first coding sub-regions 203 can be divided within the first predetermined region 202. Each first coding sub-region 203 can represent a first code number. Using quaternary as an example, the first code number represented by each first coding sub-region 203 can be 0, 1, 2, or 3. The first target code number corresponding to the first coding sub-region 203 can be one of 0, 1, 2, and 3. The disclosed embodiment uses pixel values ​​to represent the first code number. On an 8-bit display screen, the minimum pixel value displayed on the screen is 0, and the maximum is 255. Using quaternary, all pixel values ​​in a first coding sub-region can represent the first code number as 0, all pixel values ​​as 85 as 1, all pixel values ​​as 170 as 2, and all pixel values ​​as 255 as 3.

[0080] For example, in FIG2A , if the pixel values ​​of the first coding sub-region from left to right in the first row are 0 and 85, respectively; and the pixel values ​​of the first coding sub-region from left to right in the second row are 170 and 255, respectively, then the code numbers represented by the first predetermined region are 0, 1, 2, and 3, respectively. It is understood that in the actual process of adjusting pixel values, the pixel values ​​can be adjusted in a sequence of left to right and then top to bottom, or from top to bottom and then left to right, or from right to left and then bottom to top, or from bottom to top and then right to left, or clockwise, or counterclockwise, and the specific adjustment sequence can be adaptively adjusted according to actual needs.

[0081] According to an embodiment of the present disclosure, the first predetermined area may be divided into first coding sub-areas in a horizontal or vertical manner as shown in FIG2A , or in a diagonal manner. The division manner may be adaptively adjusted according to actual needs.

[0082] According to an embodiment of the present disclosure, the shape of the first predetermined area may be a square as shown in FIG2A . In addition, the shape of the first predetermined area may also be at least one of a rectangle, an irregular trapezoid, a trapezoid, a parallelogram, a rhombus, a triangle, and a circle.

[0083] According to an embodiment of the present disclosure, the shape of the first coding sub-region can be a square as shown in Figure 2A. In addition, the shape of the first predetermined region can also be at least one of a rectangle, an irregular trapezoid, a trapezoid, a parallelogram, a rhombus, a triangle, and a circle.

[0084] According to an embodiment of the present disclosure, based on the second coding strategy, according to multiple predetermined pixel values ​​corresponding to each of the N2-bit second coding numbers, adjusting the pixel values ​​of N2 second coding sub-regions of the image to be encoded corresponding to the target image to obtain N2 second coding region images may include the following operations: for each second coding sub-region of the N2 second coding sub-regions, determining the second coding number corresponding to the second coding sub-region, and obtaining a second target coding number corresponding to the second coding sub-region; determining a first predetermined ratio corresponding to the second target coding number according to a first predetermined association relationship set, wherein the first predetermined association relationship set includes N2 first predetermined association relationships, and the first predetermined association relationship represents the association relationship between the second coding number and the first predetermined ratio; and according to the first predetermined ratio, adjusting the pixel value of the coded first region in the second coding sub-region to the first coded predetermined pixel value, and adjusting the pixel value of the coded second region in the second coding sub-region to at least one second coded predetermined pixel value, to obtain a second coded region image corresponding to the second coding sub-region, wherein the ratio between the size information of the coded first region and the size information of the second coding sub-region is the first predetermined ratio.

[0085] According to an embodiment of the present disclosure, the plurality of first predetermined pixel values ​​may include a first coded predetermined pixel value and at least one second coded predetermined pixel value, wherein the first coded predetermined pixel value is greater than any one of the at least one second coded predetermined pixel value. For example, a coded number of 0 may correspond to four pixel values: 255, 0, 0, and 0, wherein the first coded predetermined pixel value may be 255, and the second coded predetermined pixel value may be any of the four pixel values ​​except 255.

[0086] FIG2B is a schematic diagram of a second coding sub-region under a second coding strategy according to an embodiment of the present disclosure.

[0087] In the case shown in FIG2B , N2 can be 4. Specifically, the first predetermined area 202 can be divided into four second coding sub-areas 204. Each second coding sub-area 204 can represent a second code number. Taking quaternary as an example, the second code number represented by each second coding sub-area 204 can be 0, 1, 2, or 3. The second target code number corresponding to the second coding sub-area 204 can be one of 0, 1, 2, and 3.

[0088] In the case shown in FIG. 2B , the first predetermined association relationship set may include four first predetermined association relationships, that is, four association relationships between second coding numbers and first predetermined ratios.

[0089] 2B , each second coding sub-region 204 can be further divided evenly into a first coding region 205 and a second coding region 206. The pixel value of the first coding region is a first predetermined coding pixel value, and the pixel value of the second coding region is a second predetermined coding pixel value, where the first predetermined coding pixel value is greater than the second predetermined coding pixel value.

[0090] According to an embodiment of the present disclosure, the first predetermined ratio may be a ratio between size information of the encoded first region and size information of the second encoded sub-region, wherein the size information may refer to the number of regions or the area of ​​the regions.

[0091] 2 , for example, taking the example of dividing the second coding sub-region 204 into four equal parts, if the second coding number is 0, the corresponding first predetermined ratio is 1 / 4, that is, the area of ​​the coded first region 205 accounts for 1 / 4 of the total area of ​​the second coding sub-region. At this time, there can be only 1 coded first region 205 and 3 coded second regions 206 in the second coding sub-region 204. The first predetermined pixel value of the coded first region 205 can be 255, and the pixel values ​​of the remaining 3 coded second regions 206 can be 0, 0, and 0, respectively.

[0092] If the second coding number is 1, the corresponding first predetermined ratio is 2 / 4, that is, the area of ​​the first coding region 205 accounts for 2 / 4 of the total area of ​​the second coding sub-region. At this time, there can be two first coding regions 205 and two second coding regions 206 in the second coding sub-region 204. The first predetermined pixel values ​​of the two first coding regions 205 can be 255 respectively, and the pixel values ​​of the remaining two second coding regions 206 can be 0 and 0 respectively.

[0093] If the second coding number is 2, the corresponding first predetermined ratio is 3 / 4, that is, the area of ​​the coded first region 205 accounts for 3 / 4 of the total area of ​​the second coding sub-region. At this time, there can be 3 coded first regions 205 and 1 coded second region 206 in the second coding sub-region 204. The first predetermined pixel values ​​of the three coded first regions 205 can be 255 respectively, and the pixel values ​​of the remaining 1 coded second region 206 can be 0 and 0 respectively.

[0094] If the second coding number is 3, the corresponding first predetermined ratio is 4 / 4, that is, the area of ​​the coded first region 205 accounts for 4 / 4 of the total area of ​​the second coding sub-region. At this time, there can be 4 coded first regions 205 and 0 coded second regions 206 in the second coding sub-region 204, and the first predetermined pixel values ​​of the 4 coded first regions 205 can all be 255.

[0095] It can be understood that in the actual process of adjusting pixel values, the pixel values ​​can be adjusted in the order from left to right and then from top to bottom, or from top to bottom and then from left to right, or from right to left and then from bottom to top, or from bottom to top and then from right to left, or clockwise, or counterclockwise. The specific adjustment order can be adaptively adjusted according to actual needs.

[0096] According to an embodiment of the present disclosure, the first predetermined area may be divided into second coding sub-areas in a horizontal or vertical manner as shown in FIG2B , or in a diagonal manner. The division manner may be adaptively adjusted according to actual needs.

[0097] According to an embodiment of the present disclosure, the second coding sub-region is divided into the coding first region and the coding second region in a horizontal or vertical division as shown in FIG2B , or in a diagonal division manner. The division manner can be adaptively adjusted according to actual needs.

[0098] According to an embodiment of the present disclosure, the shape of the second coding sub-region can be a square as shown in Figure 2B. In addition, the shape of the second coding sub-region can also be at least one of a rectangle, an irregular trapezoid, a trapezoid, a parallelogram, a rhombus, a triangle, and a circle.

[0099] According to an embodiment of the present disclosure, the shape of the first coding area and the shape of the second coding area can both be a square as shown in Figure 2B. In addition, the shape of the first coding area and the shape of the second coding area can also be at least one of a rectangle, an irregular trapezoid, a trapezoid, a parallelogram, a rhombus, a triangle, and a circle.

[0100] FIG2C is a schematic diagram showing the coexistence of a first coding sub-region and a second coding sub-region according to an embodiment of the present disclosure.

[0101] As shown in Figure 2C, one second coding sub-region and three first coding sub-regions may be included in the first predetermined region 202. In one second coding sub-region, there may be one first coding region and three second coding regions.

[0102] FIG2D is a schematic diagram showing the coexistence of a first coding sub-region and a second coding sub-region according to another embodiment of the present disclosure.

[0103] As shown in FIG2D , the first predetermined area 202 may further include two second coding sub-areas and two first coding sub-areas. One of the second coding sub-areas may include one first coding area and three second coding areas; another second coding sub-area may include two first coding areas and two second coding areas.

[0104] 2C to 2D , the arrangement and combination of the first coding sub-region 203 and the second coding sub-region 204 can be adaptively adjusted according to actual needs, and the arrangement and combination of the first coding region 205 and the second coding region 206 in the second coding sub-region 204 can also be adaptively adjusted according to actual needs.

[0105] FIG2E is a schematic diagram showing a plurality of first predetermined areas on an image to be encoded according to an embodiment of the present disclosure.

[0106] As shown in FIG2E , multiple first predetermined areas 202 can be selected for encoding on the image to be encoded 201 . Each first predetermined area 202 can adopt the same or different encoding strategies, and each first predetermined area 202 can adopt the same or different shapes for encoding.

[0107] In another embodiment, multiple first predetermined areas 202 may be selected near the edges and the center of the image to be encoded 201 to prevent incomplete encoded images due to edge cropping during subsequent decoding.

[0108] According to the embodiment of the present disclosure, in order to ensure the accuracy of the restoration process of the encoded image, the encoding should not be too complex. Too complex encoding will have a high bit error rate during restoration. In order to further improve the accuracy of restoration, the embodiment of the present disclosure adopts the above-mentioned redundant encoding method to encode information so that complete information can be accurately extracted during the restoration process. By encoding multiple first predetermined areas 202 in the image to be encoded 201 as described above, the encoding image can be copied, so that the final fused image will have multiple encoding images. When restoring the fused image, the encoding images of different first predetermined areas can be effectively complemented, so as to completely restore accurate information. The complementary method can select the overlapping of encoding areas, the majority of encoding values, etc.

[0109] According to an embodiment of the present disclosure, by presenting the device identification, the time displayed by the display device, and the geographic location in the form of pixel values ​​on the final fused image, not only can the information be encrypted, but also a basis for accurate tracing of the information can be provided. For example, if the fused image is photographed and disseminated without permission, after the disseminated fused image is discovered, by performing information restoration processing on the first coded image on the fused image, it can be known at what time the fused image was taken, from which device the fused image came, and the geographic location of the fused image at the time of taking the image. Based on this, by presenting the device identification, the time displayed by the display device, and the geographic location in the form of pixel values ​​on the final fused image, a basis for accurate tracing of the information can be provided.

[0110] According to an embodiment of the present disclosure, the above-mentioned image processing method may further include the following operations: determining a second predetermined association relationship corresponding to each of the N1 first coding sub-regions to obtain a second predetermined association relationship set, wherein the second predetermined association relationship set includes N1 second predetermined association relationships, the second predetermined association relationship represents the association relationship between the first predetermined region identifier and the first predetermined strategy identifier, the first predetermined region identifier is used to represent the first coding sub-region, and the first predetermined strategy identifier represents that the coding strategy corresponding to the first coding sub-region is the first coding strategy; determining a third predetermined association relationship corresponding to each of the N2 second coding sub-regions to obtain a third predetermined association relationship set, wherein the third predetermined association relationship set includes N2 third predetermined association relationships, the third predetermined association relationship represents the association relationship between the second predetermined region identifier and the second predetermined strategy identifier, the second predetermined region identifier is used to represent the second coding sub-region, and the second predetermined strategy identifier represents that the coding strategy corresponding to the second coding sub-region is the second coding strategy; and storing the second predetermined association relationship set and the third predetermined association relationship set.

[0111] According to an embodiment of the present disclosure, by constructing a relationship between the first predetermined area identifier and the first predetermined strategy identifier, and by constructing a relationship between the second predetermined area identifier and the second predetermined strategy identifier, it is possible to facilitate the restoration of the information of the corresponding predetermined sub-area directly based on the identifier, the corresponding decoding strategy, and the use of the corresponding decoding strategy when restoring the coded information. For example, after the first coding sub-area is encoded using the first coding strategy, the first predetermined strategy identifier used to characterize the first coding strategy and the first predetermined area identifier characterizing the first coding sub-area are stored in a specified list to obtain a second predetermined association relationship set. In the subsequent process of restoring information for the area, the first predetermined strategy identifier and the first predetermined area identifier that need to be restored can be found from the second predetermined association relationship set, and the first coding strategy can be obtained based on the first predetermined strategy identifier, and then the information of the first coding sub-area can be restored using the decoding strategy related to the first coding strategy.

[0112] According to an embodiment of the present disclosure, in addition to using the coding strategy and the first predetermined sub-region used by the identifier, the shape of the coding region can also be used to distinguish the coding strategy and the first predetermined sub-region. For example, the shape of the first coding sub-region using the first coding strategy can be set to a quadrilateral, and the shape of the second coding sub-region using the second coding strategy can be set to a triangle. In this way, when restoring the information on the first coded image, the coding strategy used in the first predetermined sub-region can be determined based on the shape of the first predetermined sub-region, and the decoding strategy corresponding to the coding strategy can be used to restore the information in the first predetermined sub-region.

[0113] According to the embodiments of the present disclosure, by constructing a second association relationship set and a third association relationship set, or using the shape of the first predetermined sub-area to distinguish the first coding strategy from the second coding strategy, it is possible to quickly distinguish the coding strategy adopted on the first coded image and the first predetermined sub-area adopting the coding strategy during the process of restoring the information on the first coded image, so that the corresponding decoding strategy can be found to restore the information, thereby improving the efficiency of restoring the information on the first coded image.

[0114] According to an embodiment of the present disclosure, operation S130 may also include the following operations: determining the product between the pixel value of at least one pixel included in the target image and a first predetermined coefficient to obtain first pixel information; determining the product between the pixel value of at least one pixel included in the first encoded image and a second predetermined coefficient to obtain second pixel information; obtaining third pixel information based on the first pixel information and the second pixel information; and obtaining a fused image based on the third pixel information.

[0115] In order to enable the first coded image to be seamlessly displayed on the target image, a first predetermined coefficient and a second predetermined coefficient can be set when fusing the first coded image and the target image. The third pixel information of the fused image can be determined by multiplying the respective pixels by the respective predetermined coefficients. By adjusting the first predetermined coefficient and the second predetermined coefficient, the first coded image can be seamlessly displayed on the target image, while also facilitating extraction during subsequent decoding. Specifically, the process of determining the third pixel can be shown as formula (1). p = a × b + c × d (1)

[0116] Among them, p can represent third pixel information, for example, a third pixel value (the pixel value of at least one pixel of the fused image), a can represent the pixel value of at least one pixel included in the target image, b can represent the first predetermined coefficient; c can represent the pixel value of at least one pixel included in the first encoded image, and d can represent the second predetermined coefficient.

[0117] According to the embodiments of the present disclosure, when fusing the target image and the first encoded image, the transparency of the first encoded image can be set. For example, the transparency of the first encoded image can be set to 97% before being superimposed on the target image. This superposition does not affect the display effect and is not noticeable.

[0118] According to an embodiment of the present disclosure, in order to seamlessly display the first coded image on the target image, the RGB pixel channels of the first coded image can be adjusted. For example, the color displayed by the first coded image can be adjusted to a yellow-green color that is difficult to distinguish with the naked eye. The color-adjusted first coded image is then fused with the target image according to the process shown in formula (1) to obtain a fused image. By adjusting the first coded image to a color that is difficult to distinguish with the naked eye, the first coded image can be seamlessly displayed on the target image and can also be easily extracted.

[0119] FIG3 is a schematic diagram of a first encoded image according to an embodiment of the present disclosure; FIG4 is a schematic diagram of a fused image according to an embodiment of the present disclosure.

[0120] 3 and 4 , FIG3 may be a first coded image including the device identification and the moment displayed by the display device, which is a two-dimensional image. By superimposing the first coded image on the target image with a curve with a certain transparency, a fused image as shown in FIG4 can be obtained.

[0121] FIG5 is a flowchart of an image processing method according to another embodiment of the present disclosure.

[0122] As shown in FIG. 5 , the image processing method according to another embodiment may include operations S510 to S530 .

[0123] In operation S510, the image to be processed is processed to obtain a second encoded image, wherein the image to be processed includes one of the following: a fused image and a captured image corresponding to the fused image, and the fused image is obtained according to the image processing method described in operations S110 to S130.

[0124] In operation S520, second encoding information is obtained based on pixel values ​​of at least one second predetermined area of ​​the second encoded image.

[0125] In operation S530, the second coded information is decoded to obtain second information to be coded corresponding to the display device.

[0126] According to an embodiment of the present disclosure, processing the image to be processed may be understood as performing a decoding operation on the image to be processed.

[0127] According to embodiments of the present disclosure, in a few scenarios, a fused image may be captured and disseminated without permission, or exported and disseminated as a file, resulting in information leakage. A captured image corresponding to a fused image may refer to an image captured without permission that includes the fused image.

[0128] According to embodiments of the present disclosure, the second coded image may refer to a decoded image obtained by decoding the image to be processed. The second coded image may be identical to the first coded image, with the terms "first" and "second" used solely to distinguish between the image obtained by the encoding process and the image obtained by the decoding process. The second coded image may also be associated with information such as the encoded device identifier, the time displayed on the display device, and the geographic location.

[0129] According to an embodiment of the present disclosure, the second predetermined area may refer to a coding area on the second coding image.

[0130] According to an embodiment of the present disclosure, the second coded information may include a device identifier, a time displayed on a display device, a geographic location, etc. after multi-base conversion. Multi-base conversion may include binary conversion, quaternary conversion, octal conversion, decimal conversion, hexadecimal conversion, etc. The second information to be coded may be the same as the first information to be coded. The terms "first" and "second" are used only to distinguish the coded information obtained by encoding from the coded information obtained by decoding.

[0131] According to an embodiment of the present disclosure, the second information to be encoded may be the same as the first information to be encoded, including information about the device identifier, the time displayed by the display device, and the geographic location. The terms "first" and "second" are used only to distinguish between the information to be encoded required for the encoding process and the information to be encoded obtained during the decoding process.

[0132] According to an embodiment of the present disclosure, by decrypting a fused image or a captured image corresponding to the fused image, it is possible to obtain the moment at which the fused image was captured or exported, the device from which the fused image came, and the geographical location of the fused image at the moment it was captured or exported. Based on this, a basis can be provided for accurate tracing of information.

[0133] According to an embodiment of the present disclosure, operation S510 may include the following operations: obtaining a feature map of at least one scale according to the image to be processed; and obtaining a second encoded image according to the feature map of at least one scale.

[0134] According to an embodiment of the present disclosure, at least one scale includes J scales, where J is a positive integer; obtaining the second encoded image according to the feature map of the at least one scale includes: when 1≤j<J, obtaining a fused feature map of the jth scale according to the feature map of the jth scale and the upsampled feature map, wherein the upsampled feature map of the jth scale is obtained based on the feature map of the j+1th scale and the upsampled feature map, and the feature map of the jth scale is obtained based on the feature map of the j-1th scale, where j is an integer greater than or equal to 1 and less than or equal to J; and obtaining the second encoded image according to the fused feature map of the 1st scale.

[0135] FIG6 is a flowchart of obtaining a second encoded image from a fused image according to an embodiment of the present disclosure.

[0136] As shown in Figure 6, the process of obtaining the second encoded image 603 from the fused image 601 can be implemented using an end-to-end deep learning image segmentation network, for example, combined with a U-Net model structure or a D-LinkNet model structure, etc. By combining the U-Net model structure or the D-LinkNet model structure, a fused feature map 602 can be obtained.

[0137] According to an embodiment of the present disclosure, if the captured image corresponds to the fused image, some preprocessing, such as cropping, affine transformation, etc., can be performed before inputting it into the U-Net model or the D-LinkNet model to convert it into an image with the same resolution as the fused image.

[0138] According to an embodiment of the present disclosure, by decoding the second target image output by the U-Net model or the D-LinkNet model using a decoding strategy corresponding to the encoding strategy, the device identification and the time displayed by the display device can be decoded.

[0139] According to an embodiment of the present disclosure, a U-Net model structure or a D-LinkNet model can adopt a self-supervised learning approach during model training, generating random code images in real time during training and superimposing them with training images, and the code images are used as network labels for training.

[0140] According to the embodiments of the present disclosure, during the decoding phase, the output second coded image may contain information that is decoded incorrectly. However, due to the use of certain redundant coding during the encoding phase, for example, encoding multiple first predetermined areas of the image to be encoded, resulting in multiple second coded images appearing on the image to be processed, this allows for effective information complementarity between the second coded images. For another example, the introduction of BCH error correction code during encoding of the information to be encoded increases parity bits in the coded number, thereby improving decoding accuracy during the decoding process. Therefore, by adopting this encoding method, the second coded image has a certain degree of error tolerance when being decoded, thereby improving decoding accuracy.

[0141] According to an embodiment of the present disclosure, operation S520 may include the following operations: determining a second coding number corresponding to at least one second predetermined area of ​​the second encoded image based on at least one second predetermined pixel value corresponding to at least one second predetermined area of ​​the second encoded image, and obtaining second coding information.

[0142] According to an embodiment of the present disclosure, the second predetermined pixel value may be one or more preconfigured pixel values ​​associated with the second code number. For example, if the second predetermined pixel value is 0, the corresponding second code number may be 0; if the second predetermined pixel value is 85, the corresponding second code number may be 1. For another example, if the second predetermined pixel value is 255, 0, 0, 0, the corresponding second code number may be 0; and if the second predetermined pixel value is 255, 255, 0, 0, the corresponding second code number may be 1.

[0143] According to an embodiment of the present disclosure, the number of bits of the second coding number is N, and the N-bit second coding number includes an N1-bit first decoding number and an N2-bit second decoding number, where N is a positive integer and N1 and N2 are natural numbers. Determining the second coding number corresponding to each of the at least one second predetermined regions of the second coded image based on at least one second predetermined pixel value corresponding to each of the at least one second predetermined regions of the second coded image, and obtaining the second coding information may include the following operations: determining at least one second predetermined region corresponding to the second coded image and N1 first decoding sub-regions and N2 second decoding sub-regions corresponding to each of the at least one second predetermined region; and obtaining the second coding information for each of the at least one second predetermined region by one of the following methods:

[0144] Based on the first decoding strategy, first decoding information is obtained according to a second predetermined pixel value corresponding to each of the N1 first decoding sub-regions and multiple second predetermined pixel values ​​corresponding to each of the N2 second decoding sub-regions; when it is determined that the first decoding information includes the first target decoding numbers corresponding to each of the N1 first decoding sub-regions and does not include the second target decoding numbers corresponding to each of the N2 second decoding sub-regions, based on the second decoding strategy, second decoding information is obtained according to multiple second predetermined pixel values ​​corresponding to each of the N2 second decoding sub-regions of the second predetermined region; and when it is determined that the second decoding information includes the second target decoding numbers corresponding to each of the N2 second decoding sub-regions, an N-bit second coding number is obtained according to the N1-bit first target decoding number and the N2-bit second target decoding number.

[0145] Alternatively, based on the second decoding strategy, third decoding information is obtained according to a second predetermined pixel value corresponding to each of the N1 first decoding sub-regions and multiple second predetermined pixel values ​​corresponding to each of the N2 second decoding sub-regions; when it is determined that the third decoding information includes the second target decoding numbers corresponding to each of the N2 second decoding sub-regions and does not include the first target decoding numbers corresponding to each of the N1 first decoding sub-regions, based on the first decoding strategy, fourth decoding information is obtained according to a second predetermined pixel value corresponding to each of the N1 first decoding sub-regions of the second predetermined region; and when it is determined that the fourth decoding information includes the first target decoding numbers corresponding to each of the N1 first decoding sub-regions, an N-bit second coding number is obtained based on the N1-bit first target decoding number and the N2-bit second target decoding number.

[0146] According to an embodiment of the present disclosure, the first decoding sub-region may be an area for implementing a first decoding strategy; the second decoding sub-region may be an area for implementing a second decoding strategy. Within the second predetermined area, the first decoding sub-region and the second decoding sub-region may both appear, or only the first decoding sub-region or only the second decoding sub-region may exist. The specific arrangement may be adaptively adjusted based on actual needs. The positions of the first decoding sub-region and the second decoding sub-region may be adaptively adjusted based on actual needs.

[0147] According to an embodiment of the present disclosure, a first decoding number may refer to a coding number using a first coding strategy; a second decoding number may refer to a coding number using a second coding strategy. Each first decoding number in the first decoding strategy corresponds to a second predetermined pixel value; each second decoding number in the second decoding strategy may correspond to multiple second predetermined pixel values. The first decoding strategy may correspond to the first coding strategy, and the second decoding strategy may correspond to the second coding strategy.

[0148] According to an embodiment of the present disclosure, in the process of obtaining the second code number based on the second predetermined pixel value, the first decoding strategy may be first attempted for decoding. If the first decoding strategy can obtain a complete second code number, the second decoding strategy may not be used. If the first decoding strategy cannot obtain a complete second code number, the second decoding strategy may be used for decoding. If the second code number cannot be obtained, the second decoding strategy may be used for decoding.

[0149] For example, assume the second coded image is generated using a combination of the first and second coding strategies. The second code number has 47 bits. Within the 47-bit first code number, the 24-bit code number representing the device can be the first decoding number, with N1 being 24; the 23-bit code number representing the time can be the second decoding number, with N2 being 23. The second coded image will have 24 first decoding sub-regions and 23 second decoding sub-regions. In this case, decoding can be performed using the first decoding strategy first. However, the result will only yield a 24-bit code number based on the pixel values ​​of the 24 first decoding sub-regions. This 24-bit code number can be used as the first target decoding number in the first decoding information. Since 24 bits are less than 47 bits, the second coded image has not been fully decoded. In this case, the second decoding strategy can be used to decode the remaining region, yielding a 23-bit code number. This 23-bit code number can be used as the second target decoding number in the second decoding information. In another embodiment, decoding can be attempted using the second decoding strategy first. If the second decoding strategy yields a complete second code number, the first decoding strategy can be discontinued. If the complete second code number cannot be obtained, the first decoding strategy can be used again for decoding. If the second code number cannot be obtained, the first decoding strategy can be used again for decoding. The example process of first using the second decoding strategy can be similar to the example process of first using the first decoding strategy described above. The third decoding information and the fourth decoding information can refer to the first decoding information and the second decoding information, respectively, and will not be repeated here.

[0150] According to an embodiment of the present disclosure, the number of bits of the second coding number is N, and the N-bit second coding number includes an N1-bit first decoding number and an N2-bit second decoding number, N is a positive integer, and N1 and N2 are natural numbers; wherein, according to at least one second predetermined pixel value corresponding to at least one second predetermined area of ​​the second coded image, determining the second coding number corresponding to at least one second predetermined area of ​​the second coded image, obtaining the second coding information may include the following operations: determining at least one second predetermined area corresponding to the second coded image and N1 first decoding sub-areas and N2 second decoding sub-areas corresponding to each of the at least one second predetermined area; for each second predetermined area in the at least one second predetermined area, determining the N1 first decoding sub-areas corresponding to the second predetermined area; The first decoding strategy corresponding to the N1 first decoding sub-regions and the second decoding strategy corresponding to the N2 second decoding sub-regions are obtained based on the decoding strategy corresponding to the N1 first decoding sub-regions and the decoding strategy corresponding to the N second decoding sub-regions of the second predetermined region; based on the first decoding strategy, according to a second predetermined pixel value corresponding to each of the N1 first decoding sub-regions of the second predetermined region, a first target decoding number corresponding to each of the N1 first decoding sub-regions is obtained; based on the second decoding strategy, according to multiple second predetermined pixel values ​​corresponding to each of the N2 second decoding sub-regions of the second predetermined region, a second target decoding number corresponding to each of the N2 second decoding sub-regions is obtained; and based on the N1-bit first target decoding number and the N2-bit second target decoding number, an N-bit second coding number is obtained.

[0151] For example, assuming N is 4, N1 is 2, and N2 is 2, that is, there are two first decoding sub-regions and two second decoding sub-regions in the second predetermined region, and the pixel values ​​in the two first decoding sub-regions are 0 and 85, respectively. Then, using the first decoding strategy to decode these two first decoding sub-regions, the first target decoding numbers obtained are 0 and 1, respectively. If the pixel values ​​in the two second decoding sub-regions are (255, 0, 0, 0) and (255, 255, 255, 0), then using the second decoding strategy to decode these two second decoding sub-regions, the second target decoding numbers obtained are 0 and 2, respectively. Based on the 2-bit first target decoding numbers 0 and 1 and the 2-bit second target decoding numbers 0 and 2, a 4-bit second coded number 0102 can be obtained. The second coded number can also be any permutation or combination of the 4-digit numbers 0, 1, 0, and 2 except 0102. The order of the obtained second coded numbers can be related to the decoding order of the decoding strategy, which can be related to the encoding order of the encoding strategy. The encoding order can be adaptively adjusted according to actual needs.

[0152] According to an embodiment of the present disclosure, the multiple second predetermined pixel values ​​include a first decoding predetermined pixel value and at least one second decoding predetermined pixel value, and the first decoding predetermined pixel value is greater than any one of the at least one second decoding predetermined pixel value; wherein, based on the second decoding strategy, according to the multiple second predetermined pixel values ​​corresponding to each of the N2 second decoding sub-regions of the second predetermined region, obtaining the second target decoding number corresponding to each of the N2 second decoding sub-regions includes: for each of the N2 second decoding sub-regions, according to the first decoding predetermined pixel value corresponding to the second decoding sub-region, determining the decoding first region in the second decoding sub-region; determining the ratio between the size information of the decoding first region and the size information of the second decoding sub-region, and obtaining the second predetermined ratio corresponding to the second decoding sub-region; and determining the second decoding number corresponding to the second predetermined ratio according to the first predetermined association relationship set, and obtaining the second target decoding number corresponding to the second predetermined sub-region, wherein the first predetermined association relationship set includes N2 first predetermined association relationships, and the first predetermined association relationship represents the association relationship between the second decoding number and the second predetermined ratio.

[0153] The first decoding region may refer to a region with large pixel values. For example, assuming N is 4, N1 is 0, and N2 is 4, that is, there are 4 second decoding sub-regions in the second predetermined region, and the pixel values ​​in the 4 second decoding sub-regions are (255, 0, 0, 0), (255, 255, 0, 0), (255, 255, 255, 0), and (255, 255, 255, 255). Based on these pixel values, it can be seen that in each second predetermined sub-region, the second predetermined proportion of the first decoding region with large pixel values ​​to the second decoding sub-region is 1 / 4, 2 / 4, 3 / 4, and 4 / 4, respectively. From the first predetermined association relationship set, based on the preset first predetermined association relationship, the code numbers corresponding to these second predetermined proportions are found to be 0, 1, 2, and 3, respectively.

[0154] According to an embodiment of the present disclosure, determining the decoding strategies corresponding to N1 first decoding sub-regions of the second predetermined region and the decoding strategies corresponding to N second decoding sub-regions of the second predetermined region, and obtaining the first decoding strategies corresponding to the N1 first decoding sub-regions and the second decoding strategies corresponding to the N2 second decoding sub-regions may include the following operations: determining that the coding strategies corresponding to the N1 first decoding sub-regions are respectively the first coding strategies according to the second predetermined association relationship set, determining that the decoding strategies corresponding to the N1 first decoding sub-regions are the first decoding strategies, wherein the second predetermined association relationship set includes N1 second predetermined association relationships, and the second predetermined association relationships represent the relationship between the first predetermined region identifier and the first predetermined strategy identifier. The first predetermined area identifier is used to represent the first decoding sub-area, and the first predetermined strategy identifier represents that the coding strategy corresponding to the first decoding sub-area is the first coding strategy; and when it is determined that the coding strategy corresponding to each of the N2 second decoding sub-areas is the second coding strategy according to the third predetermined association relationship set, the decoding strategy corresponding to the N2 second decoding sub-areas is determined to be the second decoding strategy, wherein the third predetermined association relationship set includes N2 third predetermined association relationships, the third predetermined association relationship represents the association relationship between the second predetermined area identifier and the second predetermined strategy identifier, the second predetermined area identifier is used to represent the second decoding sub-area, and the second predetermined strategy identifier represents that the coding strategy corresponding to the second decoding sub-area is the second coding strategy.

[0155] According to an embodiment of the present disclosure, by establishing a relationship between the first predetermined region identifier and the first predetermined policy identifier, and establishing a relationship between the second predetermined region identifier and the second predetermined policy identifier, it is possible to facilitate, when restoring the coded information, directly restoring the information of the corresponding predetermined sub-region based on the identifier, the corresponding decoding strategy, and utilizing the corresponding decoding strategy. For example, when decoding the second coded image, the second predetermined association relationship set and the third predetermined association relationship set can be found from a specified list, and the corresponding coding policy identifier and predetermined region identifier can be obtained from the association relationship set. Based on the coding policy identifier, the specific coding strategy to be adopted is obtained, and then the decoding strategy corresponding to the coding strategy is utilized to complete the decoding of the second coded image.

[0156] According to an embodiment of the present disclosure, by constructing a second association relationship set and a third association relationship set, the encoding strategy adopted on the second encoded image and the second predetermined sub-area adopting the encoding strategy can be quickly distinguished during the process of restoring the information on the second encoded image, so that the corresponding decoding strategy can be found for decoding processing, thereby improving the efficiency of decoding processing of the second encoded image.

[0157] According to an embodiment of the present disclosure, operation S530 may include the following operations: obtaining multiple second verification codes based on the second coding information; determining the second groups to be encoded corresponding to each of the multiple second verification codes to obtain multiple second groups to be encoded; and obtaining second information to be encoded based on the multiple second groups to be encoded.

[0158] According to the embodiments of the present disclosure, the above operation can be understood as the reverse operation of BCH encoding. For example, the second check code at the end of the second coded information is deleted to obtain a second group to be coded, and the code numbers in the second group to be coded are combined according to the predetermined bits to obtain the second information to be coded.

[0159] According to the embodiments of the present disclosure, by adopting the BCH encoding method, since the BCH encoding already includes a check bit, it can be used to detect and correct data errors, which can play a good verification role in data transmission and verification scenarios. By adopting the BCH encoding method, the decoding accuracy of the encoded information can also be improved.

[0160] FIG7 is a framework diagram of an image processing method according to yet another embodiment of the present disclosure.

[0161] As shown in Figure 7, encoding the information to be encoded 701 corresponding to the display device yields encoded information 702. The pixel values ​​of the image to be encoded 703 are adjusted based on encoded information 702 to yield encoded image 704. Encoded image 704 is then fused with target image 705 to yield fused image 706. Fused image 706 is captured or exported using an electronic device 707, such as a mobile phone or USB flash drive, to yield captured image 708 or the derived fused image. When captured image 708 or the derived fused image is disseminated online, or when the captured image or derived fused image is discovered online, it can be decoded to yield the information to be encoded 701 corresponding to the display device. This allows for the determination of the time at which the captured image was leaked, the device from which it was leaked, and the geographic location of the leak.

[0162] According to an embodiment of the present disclosure, the processing procedure shown in FIG. 7 may refer to the relevant contents in operations D110 to S130 and operations S51() to S530, which will not be repeated here.

[0163] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium, and a computer program product.

[0164] According to an embodiment of the present disclosure, an electronic device includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the method described above.

[0165] According to an embodiment of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to cause a computer to execute the method described above.

[0166] According to an embodiment of the present disclosure, a computer program product includes a computer program, and when the computer program is executed by a processor, the computer program implements the method described above.

[0167] FIG8 is a block diagram of an electronic device suitable for implementing an image processing method according to an embodiment of the present disclosure. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0168] As shown in Figure 8, electronic device 800 includes a computing unit 801, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 802 or a computer program loaded from a storage unit 808 into a random access memory (RAM) 803. In RAM 803, various programs and data required for the operation of electronic device 800 can also be stored. Computing unit 801, ROM 802, and RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to bus 804.

[0169] Multiple components in the electronic device 800 are connected to the I / O interface 805, including an input unit 806, such as a keyboard, a mouse, etc.; an output unit 807, such as various types of displays, speakers, etc.; a storage unit 808, such as a magnetic disk, an optical disk, etc.; and a communication unit 809, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 809 allows the electronic device 800 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0170] The computing unit 801 can be a variety of general-purpose and / or specialized processing components with processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The computing unit 801 performs the various methods and processes described above, such as the image processing method. For example, in some embodiments, the image processing method can be implemented as a computer software program that is tangibly contained in a machine-readable medium, such as the storage unit 808. In some embodiments, part or all of the computer program can be loaded and / or installed on the electronic device 800 via the ROM 802 and / or the communication unit 809. When the computer program is loaded into the RAM 803 and executed by the computing unit 801, one or more steps of the image processing method described above can be performed. Alternatively, in other embodiments, the computing unit 801 can be configured to perform the image processing method by any other appropriate means (e.g., by means of firmware).

[0171] Various embodiments of the systems and techniques described above can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system-on-chip systems (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0172] The program code for implementing the method of the present disclosure can be written in any combination of one or more programming languages. Such program code can be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data mining device, so that when the program code is executed by the processor or controller, the functions / operations specified in the flow chart and / or block diagram are implemented. The program code can be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0173] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0174] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0175] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), and the Internet.

[0176] A computer system may include a client and a server. The client and server are generally remote from each other and typically interact through a communication network. The client-server relationship arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, a server in a distributed system, or a server integrated with a blockchain.

[0177] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in this disclosure can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved. This is not a limitation herein.

[0178] The above specific embodiments do not constitute a limitation on the scope of protection of this disclosure. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions may be made based on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this disclosure shall be included within the scope of protection of this disclosure.

Claims

1. An image processing method, comprising: Encoding the first information to be encoded corresponding to the display device to obtain first encoded information; According to the first encoding information, adjusting pixel values ​​of at least one first predetermined area of ​​the image to be encoded corresponding to the target image to obtain a first encoded image; as well as The target image and the first encoded image are fused to obtain a fused image.

2. The method according to claim 1, wherein: The first coding information includes at least one first coding number; The step of adjusting pixel values ​​of at least one first predetermined area of ​​the image to be encoded corresponding to the target image according to the first encoding information to obtain the first encoded image includes: According to at least one first predetermined pixel value corresponding to each of the at least one first coding number, the pixel values ​​of at least one first predetermined area of ​​the image to be encoded corresponding to the target image are adjusted to obtain the first encoded image, wherein the pixel values ​​of at least one first predetermined area of ​​the first encoded image include at least one first predetermined pixel value corresponding to each of the at least one first coding number.

3. The method according to claim 2, wherein: The number of digits of the first coding number is N, where N is a positive integer; The step of adjusting the pixel value of at least one first predetermined area of ​​the image to be encoded corresponding to the target image according to at least one first predetermined pixel value corresponding to each of the at least one first coded numbers to obtain the first encoded image comprises: For each first predetermined area in the at least one first predetermined area, Divide the first predetermined area into N first predetermined sub-areas, wherein the N first predetermined sub-areas include N1 first coding sub-areas and N2 second coding sub-areas, the N-bit first coding numbers include N1-bit first coding numbers and N2-bit second coding numbers, and N1 and N2 are natural numbers; Based on the first coding strategy, according to a first predetermined pixel value corresponding to each of the N1-bit first coding numbers, pixel values ​​of N1 first coding sub-regions of the image to be coded corresponding to the target image are adjusted to obtain N1 first coding region images; Based on the second coding strategy, according to a plurality of predetermined pixel values ​​corresponding to the N2-bit second coding numbers, adjusting pixel values ​​of N2 second coding sub-regions of the image to be coded corresponding to the target image to obtain N2 second coding region images; and The first encoded image is obtained according to the N1 first encoded region images and the N2 second encoded region images.

4. The method according to claim 3, wherein: The method of adjusting the pixel values ​​of N1 first coded sub-regions of the image to be coded corresponding to the target image based on the first coding strategy according to a first predetermined pixel value corresponding to each of the N1 first coded numbers to obtain N1 first coded region images includes: For each first coding sub-region in the N1 first coding sub-regions, determining a first code number corresponding to the first coding sub-region, and obtaining a first target code number corresponding to the first coding sub-region; and The pixel value of the first coding sub-region is adjusted to a first predetermined pixel value corresponding to the first target coding number, so as to obtain a first coding region image corresponding to the first coding sub-region.

5. The method according to claim 3 or 4, wherein: The plurality of first predetermined pixel values ​​include a first coded predetermined pixel value and at least one second coded predetermined pixel value, the first coded predetermined pixel value being greater than any one of the at least one second coded predetermined pixel value; Wherein, based on the second coding strategy, according to a plurality of predetermined pixel values ​​corresponding to the N2 second coding numbers, respectively, adjusting the pixel values ​​of N2 second coding sub-regions of the image to be coded corresponding to the target image, and obtaining N2 second coding region images includes: For each second coding sub-region in the N2 second coding sub-regions, Determine a second code number corresponding to the second coding sub-region, and obtain a second target code number corresponding to the second coding sub-region; Determine a first predetermined ratio corresponding to the second target code number according to a first predetermined association relationship set, wherein the first predetermined association relationship set includes N2 first predetermined association relationships, and the first predetermined association relationship represents an association relationship between the second code number and the first predetermined ratio; and According to the first predetermined ratio, the pixel value of the first coding area in the second coding sub-area is adjusted to the first predetermined coding pixel value, and the pixel value of the second coding area in the second coding sub-area is adjusted to the at least one second predetermined coding pixel value, so as to obtain a second coding area corresponding to the second coding sub-area. The regional image, wherein the ratio between the size information of the encoded first region and the size information of the second encoded sub-region is the first predetermined ratio.

6. The method according to claim 3 or 4, further comprising: Determine a second predetermined association relationship corresponding to each of the N1 first coding sub-regions to obtain a second predetermined association relationship set, wherein the second predetermined association relationship set includes N1 second predetermined association relationships, the second predetermined association relationship represents an association relationship between a first predetermined region identifier and a first predetermined strategy identifier, the first predetermined region identifier is used to represent the first coding sub-region, and the first predetermined strategy identifier represents that the coding strategy corresponding to the first coding sub-region is the first coding strategy; determining a third predetermined association relationship corresponding to each of the N2 second coding sub-regions to obtain a third predetermined association relationship set, wherein the third predetermined association relationship set includes N2 third predetermined association relationships, the third predetermined association relationship represents an association relationship between a second predetermined region identifier and a second predetermined strategy identifier, the second predetermined region identifier is used to represent the second coding sub-region, and the second predetermined strategy identifier represents that the coding strategy corresponding to the second coding sub-region is the second coding strategy; and The second predetermined association relationship set and the third predetermined association relationship set are stored.

7. The method according to any one of claims 1 to 3, wherein: The first information to be encoded includes a plurality of first numbers to be encoded; The step of encoding the first information to be encoded corresponding to the display device to obtain the first encoded information includes: dividing the first information to be encoded with multiple digits into multiple first groups to be encoded; Determine a first check code corresponding to each of the plurality of first to-be-encoded groups to obtain a plurality of first check codes; and The first coding information is obtained according to the multiple first numbers to be encoded and the multiple first check codes.

8. The method according to any one of claims 1 to 3, wherein: The fusing the target image and the first coded image to obtain a fused image comprises: Determine the product between each pixel value of at least one pixel included in the target image and a first predetermined coefficient to obtain first pixel information; Determine the relationship between the pixel value of at least one pixel included in the first coded image and the second predetermined coefficient The product is obtained to obtain the second pixel information; Obtaining third pixel information according to the first pixel information and the second pixel information; and The fused image is obtained according to the third pixel information.

9. The method according to any one of claims 1 to 3, wherein: The shape of the first predetermined area includes at least one of the following: rectangle, square, diamond, triangle, and circle.

10. The method according to claim 3 or 4, wherein: The shape of the first coding sub-region includes at least one of the following: rectangle, square, diamond, triangle, circle; The shape of the second coding sub-region includes at least one of the following: rectangle, square, diamond, triangle, and circle.

11. The method according to any one of claims 1 to 3, wherein: The first information to be encoded includes at least one of the following: a device identification, a time displayed on the display device, and a geographical location.

12. An image processing method, comprising: Processing the image to be processed to obtain a second coded image, wherein the image to be processed includes one of the following: a fused image and a captured image corresponding to the fused image, and the fused image is obtained according to any one of claims 1 to 11; Obtaining second encoding information according to pixel values ​​of at least one second predetermined area of ​​the second encoded image; and The second coded information is decoded to obtain second information to be coded corresponding to the display device.

13. The method according to claim 12, wherein: The obtaining second encoding information according to the pixel values ​​of at least one second predetermined area of ​​the second encoded image comprises: According to at least one second predetermined pixel value corresponding to at least one second predetermined area of ​​the second encoded image, a second code number corresponding to at least one second predetermined area of ​​the second encoded image is determined to obtain the second encoding information.

14. The method according to claim 13, wherein: The number of bits of the second coded number is N, the N-bit second coded number includes N1-bit first decoded number and N2-bit second decoded number, N is a positive integer, and N1 and N2 are natural numbers; The step of determining, based on at least one second predetermined pixel value corresponding to at least one second predetermined area of ​​the second coded image, a second code number corresponding to each of the at least one second predetermined areas of the second coded image, and obtaining the second coded information comprises: Determine at least one second predetermined area corresponding to the second encoded image and N1 first decoding sub-areas and N2 second decoding sub-areas respectively corresponding to the at least one second predetermined area; For each second predetermined area in the at least one second predetermined area, the second coding information is obtained by one of the following methods: Based on the first decoding strategy, first decoding information is obtained according to a second predetermined pixel value corresponding to each of the N1 first decoding sub-regions and a plurality of second predetermined pixel values ​​corresponding to each of the N2 second decoding sub-regions; In a case where it is determined that the first decoding information includes the first target decoding numbers corresponding to the N1 first decoding sub-regions respectively and does not include the second target decoding numbers corresponding to the N2 second decoding sub-regions respectively, based on the second decoding strategy, obtaining second decoding information according to a plurality of second predetermined pixel values ​​corresponding to the N2 second decoding sub-regions respectively of the second predetermined region; and When it is determined that the second decoding information includes the second target decoding numbers corresponding to the N2 second decoding sub-regions respectively, obtaining the N-bit second coding number according to the N1-bit first target decoding number and the N2-bit second target decoding number; or Based on the second decoding strategy, third decoding information is obtained according to a second predetermined pixel value corresponding to each of the N1 first decoding sub-regions and a plurality of second predetermined pixel values ​​corresponding to each of the N2 second decoding sub-regions: When it is determined that the third decoding information includes the second target decoding numbers corresponding to the N2 second decoding sub-regions respectively and does not include the first target decoding numbers corresponding to the N1 first decoding sub-regions respectively, based on the first decoding strategy, obtain fourth decoding information according to a second predetermined pixel value corresponding to each of the N1 first decoding sub-regions of the second predetermined region; and In the case where it is determined that the fourth decoding information includes the first target decoding numbers corresponding to the N1 first decoding sub-regions respectively, according to the N1-bit first target decoding number and the N2-bit second target decoding number, The second code number is N bits.

15. The method according to claim 13, wherein: The number of bits of the second coded number is N, the N-bit second coded number includes N1-bit first decoded number and N2-bit second decoded number, N is a positive integer, and N1 and N2 are natural numbers; The step of determining, based on at least one second predetermined pixel value corresponding to at least one second predetermined area of ​​the second coded image, a second code number corresponding to each of the at least one second predetermined areas of the second coded image, and obtaining the second coded information comprises: Determine at least one second predetermined area corresponding to the second encoded image and N1 first decoding sub-areas and N2 second decoding sub-areas respectively corresponding to the at least one second predetermined area; For each second predetermined area in the at least one second predetermined area, Determine a decoding strategy corresponding to N1 first decoding sub-areas of the second predetermined area and a decoding strategy corresponding to N second decoding sub-areas of the second predetermined area, and obtain a first decoding strategy corresponding to the N1 first decoding sub-areas and a second decoding strategy corresponding to the N2 second decoding sub-areas; Based on the first decoding strategy, according to a second predetermined pixel value corresponding to each of the N1 first decoding sub-areas of the second predetermined area, obtaining a first target decoding number corresponding to each of the N1 first decoding sub-areas; Based on the second decoding strategy, according to a plurality of second predetermined pixel values ​​corresponding to each of the N2 second decoding sub-regions of the second predetermined region, obtain a second target decoding number corresponding to each of the N2 second decoding sub-regions; and The N-bit second encoding number is obtained according to the N1-bit first target decoding number and the N2-bit second target decoding number.

16. The method according to claim 15, wherein: The plurality of second predetermined pixel values ​​include a first decoded predetermined pixel value and at least one second decoded predetermined pixel value, the first decoded predetermined pixel value being greater than any one of the at least one second decoded predetermined pixel value; Wherein, based on the second decoding strategy, according to a plurality of second predetermined pixel values ​​corresponding to each of the N2 second decoding sub-areas of the second predetermined area, obtaining the second target decoding number corresponding to each of the N2 second decoding sub-areas includes: For each second decoding sub-region in the N2 second decoding sub-regions, determining a decoded first region in the second decoding subregion according to a first decoded predetermined pixel value corresponding to the second decoding subregion; determining a ratio between the size information of the first decoded region and the size information of the second decoded sub-region to obtain a second predetermined ratio corresponding to the second decoded sub-region; and According to a first predetermined association relationship set, a second decoding number corresponding to the second predetermined ratio is determined to obtain a second target decoding number corresponding to the second predetermined sub-area, wherein the first predetermined association relationship set includes N2 first predetermined association relationships, and the first predetermined association relationship represents the association relationship between the second decoding number and the second predetermined ratio.

17. The method according to claim 15 or 16, wherein: The determining of the decoding strategies corresponding to the N1 first decoding sub-regions of the second predetermined region and the decoding strategies corresponding to the N second decoding sub-regions of the second predetermined region, and obtaining the first decoding strategies corresponding to the N1 first decoding sub-regions and the second decoding strategies corresponding to the N2 second decoding sub-regions comprises: In the case where it is determined that the coding strategy corresponding to each of the N1 first decoding sub-regions is the first coding strategy according to the second predetermined association relationship set, determining that the decoding strategy corresponding to the N1 first decoding sub-regions is the first decoding strategy, wherein the second predetermined association relationship set includes N1 second predetermined association relationships, the second predetermined association relationship represents an association relationship between a first predetermined region identifier and a first predetermined strategy identifier, the first predetermined region identifier is used to represent the first decoding sub-region, and the first predetermined strategy identifier represents that the coding strategy corresponding to the first decoding sub-region is the first coding strategy; and In the case where it is determined that the coding strategy corresponding to each of the N2 second decoding sub-areas is the second coding strategy according to the third predetermined association relationship set, the decoding strategy corresponding to the N2 second decoding sub-areas is determined to be the second decoding strategy, wherein the third predetermined association relationship set includes N2 third predetermined association relationships, the third predetermined association relationship represents the association relationship between the second predetermined area identifier and the second predetermined strategy identifier, the second predetermined area identifier is used to represent the second decoding sub-area, and the second predetermined strategy identifier represents that the coding strategy corresponding to the second decoding sub-area is the second coding strategy.

18. The method according to any one of claims 12 to 16, wherein: The decoding of the second coded information to obtain the second information to be coded corresponding to the display device includes: Obtaining a plurality of second check codes according to the second coding information; Determine the second to-be-encoded groups corresponding to the plurality of second check codes respectively, to obtain a plurality of second to-be-encoded groups; and The second information to be encoded is obtained according to the multiple second groups to be encoded.

19. The method according to any one of claims 12 to 16, wherein: The processing of the image to be processed to obtain a second coded image comprises: Obtaining a feature map of at least one scale according to the image to be processed; and The second encoded image is obtained according to the feature map of the at least one scale.

20. The method according to claim 19, wherein: The at least one scale includes J scales, where J is a positive integer; The obtaining, according to the feature map of the at least one scale, the second encoded image comprises: In the case of 1≤j<J, According to the feature map of the j-th scale and the upsampled feature map, a fused feature map of the j-th scale is obtained, wherein the upsampled feature map of the j-th scale is obtained according to the feature map of the j+1-th scale and the upsampled feature map, and the feature map of the j-th scale is obtained according to the feature map of the j-1-th scale, and j is an integer greater than or equal to 1 and less than or equal to J; and The second encoded image is obtained according to the fused feature map at the first scale.

21. An electronic device, comprising: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors are enabled to execute the method according to any one of claims 1 to 20.

22. A computer-readable storage medium having executable instructions stored thereon, which, when executed by a processor, causes the processor to execute the method according to any one of claims 1 to 20.

23. A computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the method according to any one of claims 1 to 20 is implemented.

Citation Information

Patent Citations

  • Image encryption, identification method and device, equipment and medium

    CN109561236A

  • Image processing method and device, electronic equipment and readable storage medium

    CN112686355A

  • Image processing method and device, electronic equipment and storage medium

    CN113132080A

  • Image processing method and device, equipment, storage medium and program product

    CN114007076A

  • Device for recording information about defective pixels, and defective pixel value correction device and method

    US20190087945A1