Image processing method, device, electronic device and storage medium
By generating digital fingerprint images with the characteristic parameters of the pathological image and fusing them with the image to be encrypted, and using the blockchain system for verification, the problem of easy cracking of encryption methods in the existing technology is solved, and the high security and uniqueness of the image are achieved. Reduced costs.
Patent Information
- Application Number
- CN202111227375.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-10-21
- Publication Date
- 2024-12-27
- Estimated Expiration
- 2041-10-21
AI Technical Summary
Existing digital encryption methods are easy to be cracked, and complex passwords or fingerprints require high investment, making it difficult to ensure the security and uniqueness of information.
By obtaining characteristic parameters in the pathological image, a unique digital fingerprint image is generated, and fusing it with the image to be encrypted, an encrypted image is generated, and data sharing and authentication are used to ensure the uniqueness and anti-counterfeiting of the image are ensured by using the blockchain system to share and authenticate. .
It improves the security and uniqueness of images, reduces the generation cost, avoids easy cracking and illegal use, and provides effective anti-counterfeiting and intellectual property protection.
Smart Images

Figure CN114092488B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of image processing technology, and in particular to an image processing method, device, electronic device and storage medium. Background Art
[0002] With the development of science and technology, many information and files are stored and transmitted in digital form. Digital files in daily work and life, including medical images, books and videos, works of art, etc., are easily infringed and imitated due to network transmission, or cause information resource leakage.
[0003] Currently, digital passwords or fingerprints can be set manually, and most encryption methods are completed by setting regular programs on computers. However, they are easily cracked by humans or computers by finding regular patterns in the later stage, and the security is not high. Moreover, the more complex the digital password or fingerprint designed by the computer, the greater the investment required in digital files and physical products. Summary of the invention
[0004] Based on this, it is necessary to provide an image processing method, device, electronic device and medium to address the above problems.
[0005] In a first aspect, an image processing method is provided, comprising:
[0006] Acquiring an image to be processed, wherein the image to be processed is an image cut from a pathological image;
[0007] Adjust the characteristic parameters of the image to be processed according to a preset transformation rule to obtain a digital fingerprint image corresponding to the image to be processed;
[0008] The digital fingerprint image is merged with the image to be encrypted to obtain an encrypted image.
[0009] Optionally, the characteristic parameter includes a color scale parameter;
[0010] The step of adjusting the characteristic parameters of the image to be processed according to a preset transformation rule to obtain a digital fingerprint image corresponding to the image to be processed includes:
[0011] The color scale parameters of the image to be processed are reduced by a first multiple in the same proportion to obtain a digital fingerprint image corresponding to the image to be processed.
[0012] Optionally, the characteristic parameters include color scale parameters; and adjusting the characteristic parameters of the image to be processed according to a preset transformation rule to obtain a digital fingerprint image corresponding to the image to be processed includes:
[0013] Compare the value of the color scale parameter of the image to be processed with a preset threshold, reduce the color scale parameter greater than the preset threshold by a second multiple, and reduce the color scale parameter less than the preset threshold by a third multiple, to obtain a digital fingerprint image corresponding to the image to be processed.
[0014] Optionally, the fusing the digital fingerprint image with the image to be encrypted to obtain the encrypted image includes:
[0015] Acquire a target image composed of the digital fingerprint images arranged in a tiled manner, wherein the target image has the same size as the image to be encrypted;
[0016] Based on a preset fusion algorithm, an interpolation operation is performed on the pixel values of the image to be encrypted and the target fingerprint image to obtain the encrypted image.
[0017] Optionally, obtaining the image to be processed includes:
[0018] Acquiring the pathological image, wherein the pathological image is obtained by scanning a pathological section with a digital pathology scanner;
[0019] Performing a cutting process on the pathological image to obtain a plurality of cutting images;
[0020] One of the multiple cut images is obtained as the image to be processed.
[0021] Optionally, the method further includes:
[0022] Uploading the encrypted image to the blockchain system so that the encrypted image and information of the current node are shared as block data to other nodes in the blockchain system, and the current node is the node that uploaded the encrypted image;
[0023] When a verification request for the encrypted image is received from a target node in the blockchain system, the digital fingerprint image and the image to be encrypted corresponding to the encrypted image are sent to the target node through the blockchain system. The target node is a node that has passed authentication verification in the blockchain system, and the verification request is recorded in the blockchain system.
[0024] Optionally, before fusing the digital fingerprint image with the image to be encrypted, the method further includes:
[0025] Acquire a digital video file, split the digital video file into multiple picture files, use the multiple picture files as the images to be encrypted, trigger the step of fusing the digital fingerprint image with the image to be encrypted, and obtain multiple encrypted images corresponding to the multiple picture files;
[0026] According to the order of the multiple picture files in the digital video file, a target digital video file is generated based on the multiple encrypted images.
[0027] Optionally, the method further includes:
[0028] Merging the image to be encrypted with a plurality of different digital fingerprint images respectively to obtain a plurality of encrypted images corresponding to the image to be encrypted, wherein the plurality of encrypted images are provided to different authorized users;
[0029] The corresponding relationship between each of the encrypted image, the digital fingerprint image and the authorized user is recorded.
[0030] Optionally, the method further includes:
[0031] In response to a query request for an image to be detected, searching for a target encrypted image that is identical to the digital fingerprint image of the image to be detected in the stored encrypted images;
[0032] When a target encrypted image identical to the digital fingerprint image of the image to be detected is found, determining an authorized user corresponding to the target encrypted image;
[0033] Output the digital fingerprint image of the target encrypted image and the information of the authorized user.
[0034] In a second aspect, an image processing device is provided, comprising:
[0035] An acquisition module is used to acquire an image to be processed, wherein the image to be processed is an image cut from a pathological image;
[0036] A processing module, used to adjust the characteristic parameters of the image to be processed according to a preset transformation rule to obtain a digital fingerprint image corresponding to the image to be processed;
[0037] The fusion module is used to fuse the digital fingerprint image with the image to be encrypted to obtain an encrypted image.
[0038] According to a third aspect, an electronic device is provided, comprising a memory and a processor, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor executes the steps of the first aspect and any possible implementation thereof.
[0039] In a fourth aspect, a computer storage medium is provided, wherein the computer storage medium stores one or more instructions, wherein the one or more instructions are suitable for being loaded by a processor and executing the steps of the above-mentioned first aspect and any possible implementation thereof.
[0040] The main purpose of the present application is to provide an image processing method, device, electronic device and storage medium, by acquiring an image to be processed, wherein the image to be processed is an image cut from a pathological image; adjusting the characteristic parameters of the image to be processed according to a preset transformation rule to obtain a digital fingerprint image corresponding to the image to be processed; fusing the digital fingerprint image with the image to be encrypted to obtain an encrypted image, wherein a natural pathological image is used to generate a digital fingerprint of the image to be encrypted, which has the advantages of uniqueness and being difficult to imitate and crack, thereby improving reliability, and the production cost of the digital fingerprint image is low. BRIEF DESCRIPTION OF THE DRAWINGS
[0041] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the background technology, the drawings required for use in the embodiments of the present application or the background technology will be described below.
[0042] Figure 1 A flowchart of an image processing method provided in an embodiment of the present application;
[0043] Figure 2 A schematic diagram of a pathological section processing flow provided in an embodiment of the present application;
[0044] Figure 3 A schematic diagram of adjusting image color scale parameters provided in an embodiment of the present application;
[0045] Figure 4 A schematic diagram of image fusion provided in an embodiment of the present application;
[0046] Figure 5 A schematic diagram of the structure of an image processing device provided in an embodiment of the present application;
[0047] Figure 6 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0048] In order to enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.
[0049] The terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices.
[0050] Reference to "embodiments" in this application means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described in this application may be combined with other embodiments.
[0051] The embodiments of the present application are described below in conjunction with the drawings in the embodiments of the present application.
[0052] See also Figure 1 , Figure 1 : is a flow chart of an image processing method provided by an embodiment of the present application. The method may include:
[0053] 101. Obtain an image to be processed, where the image to be processed is an image cut from a pathological image.
[0054] The execution subject of the embodiment of the present application may be an image processing device, or an electronic device. In a specific implementation, the electronic device may be a terminal, which may also be referred to as a terminal device, including but not limited to a desktop computer, which may have a touch-sensitive surface (e.g., a touch screen display and / or a touch pad). It should also be understood that in some embodiments, the device may also be other portable devices such as a mobile phone, a laptop computer, or a tablet computer having a touch-sensitive surface (e.g., a touch screen display and / or a touch pad).
[0055] The above-mentioned image to be processed can be an image obtained by cutting from a pathological image. The pathological image mentioned in the embodiment of the present application is an image formed by one or more staining of biological sample tissue, and a digital pathological image can usually be generated by a digital pathology scanner. The pathological image of a biological sample can come from animals, plants or human bodies, etc. The pathological image is a natural image, and each pathological image is unique and complex.
[0056] In an optional implementation, the above step 101 includes:
[0057] Acquiring a pathological image, wherein the pathological image is obtained by scanning a pathological section with a digital pathology scanner;
[0058] Performing cutting processing on the pathological image to obtain a plurality of cut images;
[0059] One of the multiple cut images is obtained as the image to be processed.
[0060] Specifically, a large number of digital pathology slice images (i.e., the above-mentioned pathology images) can be generated by scanning the pathology slices with a digital pathology scanner. Figure 2 A schematic diagram of a pathological section processing process is shown in FIG. Figure 2 As shown, a cervical cell pathology TCT slice a is used as the slice to be scanned, and a digital pathology image b of about 1G is generated by scanning with a 40-fold magnification of a digital pathology scanner.
[0061] Furthermore, the obtained pathological image can be cut to obtain a plurality of cut images, wherein the size of each cut image can be a preset image size. The obtained cut image can be selected as an image to be processed and used as a digital fingerprint image after a series of processing.
[0062] like Figure 2 As shown, a complete 1G digital pathology image b can be cut into a certain pixel ratio, for example, N cut images of 512×512 pixels in size. Figure 2 Only one cut image c is given for illustration. The obtained cut images can be numbered, such as digital numbers 1 to N, that is, images 1 to N can be used as digital fingerprint data sources for encryption.
[0063] 102. Adjust the characteristic parameters of the image to be processed according to a preset transformation rule to obtain a digital fingerprint image corresponding to the image to be processed.
[0064] The characteristic parameters of the image to be processed may be parameters reflecting the characteristics of the image, such as color value, contrast, brightness, etc. In the embodiment of the present application, the characteristic parameters of the image to be processed may be processed in the same proportion or in a non-same proportion according to the preset transformation rules to obtain a more suitable digital fingerprint image. In the embodiment of the present application, the preset transformation rules may be set as needed to adjust the characteristic parameters, that is, a regular processing method may be selected, which is simple, convenient and effective, and does not affect the observation and normal use of the original image, and is not limited here.
[0065] Optionally, the above-mentioned characteristic parameter can be a color scale parameter. Color scale is an index standard indicating the brightness of an image, that is, a color index. In the digital image processing tutorial, it refers to grayscale resolution (also known as grayscale resolution or amplitude resolution). The color richness and fineness of an image are determined by the color scale, which can be used for underexposed or overexposed images, and can also adjust the contrast of an image. In the embodiment of the present application, it can be an RGB color value.
[0066] Furthermore, the above step 102 may include:
[0067] The color scale parameters of the image to be processed are reduced by a first multiple in the same proportion to obtain a digital fingerprint image corresponding to the image to be processed.
[0068] In an optional embodiment, the above step 102 includes: comparing the value of the color scale parameter of the above image to be processed with a preset threshold, reducing the color scale parameter greater than the above preset threshold by a second multiple, and reducing the color scale parameter less than the above preset threshold by a third multiple, to obtain a digital fingerprint image corresponding to the above image to be processed.
[0069] The first multiple, the second multiple, the third multiple and the preset threshold can be set as required. Step 103 can be performed by using the adjusted image as the digital fingerprint image.
[0070] For example, Figure 3 A schematic diagram of adjusting the image color scale parameters provided in an embodiment of the present application: Figure 2 The cut image c obtained in the illustrated embodiment can be adjusted to obtain one or more digital fingerprint images, such as image A1, image A2 and image A3. Specifically, the RGB color value of the cut image c is: (R230, G21, B44; R123, G11, B35; ...), and after processing in the same proportion (all parameters are reduced by the first multiple: 10 times), image A1 is obtained, and its RGB color value is: (R23, G2, B4; R12, G1, B3; ...); in another embodiment, the preset threshold is 100, the second multiple is 100 times, and the third multiple is 10 times, and it is processed according to the non-same proportion regularity, that is, when the color value is greater than 100, it is reduced by 100 times; when it is less than 100, it is reduced by 10 times, and then image A2 is obtained after processing, and its RGB color value is (R2, G2, B4; R1, G1, B3; ...). The above two transformation rules are only examples, and the rules can be adjusted as needed to better perform subsequent image fusion.
[0071] 103. The digital fingerprint image is merged with the image to be encrypted to obtain an encrypted image.
[0072] The data form of the image fusion mentioned in the embodiment of the present application is an image containing brightness, color, temperature, distance and other scene features. These images can be given in the form of one or one column, and image fusion is to fuse the information of two or more images into one image, so that the fused image contains more information. In the embodiment of the present application, encryption or anti-counterfeiting function can be achieved through image fusion.
[0073] In the embodiment of the present application, the obtained digital fingerprint image is fused with the image to be encrypted, and finally an encrypted image is generated. The encrypted image has no obvious difference from the original image to be encrypted and does not affect normal use.
[0074] In an optional implementation, the above step 103 includes:
[0075] Obtain a target image composed of the digital fingerprint images arranged in a tiled manner, wherein the target image has the same size as the image to be encrypted;
[0076] Based on a preset fusion algorithm, an interpolation operation is performed on the pixel values of the above-mentioned image to be encrypted and the target fingerprint image to obtain the above-mentioned encrypted image.
[0077] In the embodiment of the present application, the digital fingerprint image and the image to be encrypted of the same size can be used for fusion, that is, when the original digital fingerprint image and the image to be encrypted are of the same size, they can be directly fused, or multiple digital fingerprint images can be tiled and arranged to form a target image of the same size as the image to be encrypted and then fused, and there is no limitation here. Figure 4 The target image used in the encrypted image shown in FIG. 1 includes four digital fingerprint images A2. Therefore, the size of the digital fingerprint image obtained by cutting can also be determined according to the size of the image to be encrypted, so as to better perform image fusion. The above-mentioned preset fusion algorithm can be selected or set as needed.
[0078] Digital fingerprint refers to information related to a user and a purchase process. When the publisher discovers illegal distribution, the user who distributes illegally can be tracked based on this information. The digital fingerprint system mainly consists of two parts: one is the copy distribution system for embedding fingerprints into copies and distributing fingerprinted copies; the other is the tracking system for tracking and judging illegal distributors. The tracking scheme refers to the process of using certain decoding rules to determine illegal distribution when the publisher obtains pirated copies.
[0079] In the embodiment of the present application, digital fingerprint technology can be used in the image fusion stage. When the digital fingerprint image is integrated into the original image, a corresponding tracking system is set to further achieve anti-counterfeiting and tracking.
[0080] The above-mentioned image to be encrypted may be a medical image such as a pathological image. Medical images have privacy characteristics. The addition of digital fingerprint image encryption technology that is not easy to imitate can avoid easy and low-cost malicious downloads and illegal commercial applications.
[0081] Pathological images are unique and complex, and are not easily imitated or cracked by computers. Each pathological image or partial pathological image is like a digital file with a "natural password". Digital files in daily work and life, including medical images, books, videos, and works of art, are easily infringed and imitated due to network dissemination. Due to the spread of network technology and computer post-processing, original digital files are easily illegally used.
[0082] The existing digital fingerprint encryption method is completed by computer-set regular programs, and it is easy to be cracked by computer programs in the later stage. Pathological images are natural images, unique, and can be generated in large quantities in a short period of time. It is easy to generate passwords but difficult to decipher passwords.
[0083] The image processing method in the embodiment of the present application also provides an anti-counterfeiting method. When disputes such as intellectual property rights occur, the data owner can provide the original image to be encrypted and the digital fingerprint image used, and the party that illegally obtains the data or forges the data cannot separate these images.
[0084] The data owner has mastered the corresponding encoding algorithm and tracking algorithm, and can realize encryption according to the image to be encrypted and the digital fingerprint image, and decryption of the encrypted image to obtain the original image and the digital fingerprint image. For example, based on a current public image M, the image M can be split into the original image M0 and the corresponding digital fingerprint image m0 using the corresponding decoding rules. These processing operations can be demonstrated instantly. In order to better prevent infringement, it has been mentioned above that the encoding algorithm and tracking algorithm used by the data owner can be submitted to a trusted third party, such as a trusted authentication agency, so that the original image M0 and the corresponding digital fingerprint image m0 can be provided in the event of a dispute. The authentication agency uses its algorithm to verify the image M to determine whether it can be split into M0 and m0. It can also be further protected by submitting the copyright of the algorithm. The submission of the above algorithm can be implemented based on blockchain, and the reliability and immutability of data can be enhanced in the form of blockchain.
[0085] In another implementation, the data owner can submit the original image, the corresponding digital fingerprint image and the encrypted image to a trusted third party, and retain the use of the encoding algorithm and the tracking algorithm alone. That is, when necessary, not only can the original image and the corresponding digital fingerprint image be provided, but the image M can also be split based on the existing algorithm, and the authentication agency can verify whether the split images match.
[0086] Further optionally, the data owner can also store the image processing record in the blockchain when generating the encrypted image, so that the data owner can provide the record of generating the image M based on the original image M0 and the digital fingerprint image m0 to further assist the proof. Therefore, it can be determined that the data owner is the intellectual property protector of the original image.
[0087] See also Figure 4 A schematic diagram of image fusion is shown in Figure 4 As shown, taking the pathological image d1 as an example, a general hospital can upload the complete pathological image d1 of patient x and the information of patient x to the cloud server. A uses private resources or personal technology to invade the cloud server, downloads and sells a large amount of patient data, and conducts secondary development, etc. The data resources of patients and hospitals including patient x are maliciously used. However, using the image processing method in the embodiment of the present application, the downloaded data has been processed by a computer, and the digital fingerprint image (such as A2) is fused with the d1 image on the image to be encrypted d1, and finally the d2 image is generated. In the remote pathology platform and a reasonable development environment, there is no obvious difference between the d2 image and the d1 image, which does not affect normal use. At the same time, it is encrypted and cannot be traced back to the hospital and the patient x. If a dispute over intellectual property rights occurs, the hospital can provide the original A2 image and the d1 image, but A will not be able to split the d1 image, and cannot provide the original A2 image and the d1 image. Even if two images can be provided, it cannot be confirmed on the surface. You can also refer to the description of the aforementioned dispute resolution method to verify the authenticity of the evidence, which will not be repeated here. Therefore, determining that the hospital is the party protecting the intellectual property rights of the original digital pathology images can help resolve infringement disputes.
[0088] Optionally, the method further includes:
[0089] The image to be encrypted is respectively merged with a plurality of different digital fingerprint images to obtain a plurality of the encrypted images corresponding to the image to be encrypted, and the plurality of encrypted images are provided to different authorized users;
[0090] The corresponding relationship between each of the encrypted images, the digital fingerprint images and the authorized users is recorded.
[0091] Optionally, the method further includes:
[0092] In response to a query request for an image to be detected, extracting a digital fingerprint image from the image to be detected;
[0093] Searching for a target encrypted image that is identical to the digital fingerprint image in the image to be detected in the stored encrypted images;
[0094] When a target encrypted image identical to the digital fingerprint image of the image to be detected is found, determining the authorized user corresponding to the target encrypted image;
[0095] Output the digital fingerprint image of the target encrypted image and the information of the authorized user.
[0096] In the embodiment of the present application, for an image to be encrypted, it can be fused with different digital fingerprint images respectively to obtain multiple encrypted images corresponding to the image to be encrypted, so as to provide them to different authorized users, and the corresponding relationship between each encrypted image, digital fingerprint image and authorized user can be recorded. Furthermore, when information leakage, illegal use, etc. occur, the leaked or illegally used encrypted image (as the image to be detected) can be identified, and the target encrypted image with the same digital fingerprint image as the image to be detected can be found, and then the corresponding authorized user can be found, and the information of the authorized user can be output, that is, the leaked or illegally used encrypted image can be traced and the propagation path can be locked.
[0097] Specifically, since the digital fingerprint scheme can be used to resist collusion attacks from users, the issuer usually encodes the digital fingerprint to increase the collusion tolerance of the fingerprint scheme. This encoding is called collusion-tolerant encoding. If a digital fingerprint system can resist collusion attacks, the scheme is called collusion-secure. The collusion-tolerant encoding of fingerprints usually includes two parts: the fingerprint encoding algorithm (generating a copy with a digital fingerprint) and the tracking algorithm (how to track illegal users).
[0098] The fingerprint encoding algorithm in the embodiment of the present application refers to encoding the digital fingerprint image used according to certain rules in the process of fusing and encrypting the image to be processed with the digital fingerprint image to generate an encrypted image with certain anti-attack capabilities.
[0099] Correspondingly, the tracking algorithm mentioned in the embodiment of the present application refers to the process of using certain decoding rules to determine illegal distribution when the publisher obtains a pirated copy. Each fingerprint encoding algorithm has a corresponding tracking mechanism, that is, the above decoding rules have a corresponding relationship with the set encoding algorithm, and the encoding algorithm and tracking algorithm used can be designed as needed, such as an image fingerprint scheme based on the DCT domain, which is not limited in the embodiment of the present application.
[0100] Therefore, when the image to be detected is obtained, a preset tracking algorithm can be used to process the image to be detected, so as to extract the digital fingerprint image in the image to be detected using a preset decoding rule.
[0101] Among them, the fingerprint encoding algorithm and tracking algorithm are unique to the issuer, or entrusted to a trusted third party for tracking and verification when necessary. Other users cannot perform the same digital fingerprint image encryption and decoding process, which can achieve image anti-counterfeiting and tracking.
[0102] The digital fingerprint technology based on pathological images used in the embodiments of the present application has the advantages of uniqueness and difficulty in imitation and cracking. The generation of such digital fingerprint images can be continuous and non-repetitive in batches, with relatively low cost, while the cost of cracking is high.
[0103] The image processing method in the embodiment of the present application can also be applied to the processing of video files.
[0104] In an optional implementation, before fusing the digital fingerprint image with the image to be encrypted, the method further includes:
[0105] Acquire a digital video file, split the digital video file into multiple picture files, use the multiple picture files as the images to be encrypted, trigger the step of fusing the digital fingerprint image with the image to be encrypted, and obtain multiple encrypted images corresponding to the multiple picture files;
[0106] According to the order of the multiple picture files in the digital video file, a target digital video file is generated based on the multiple encrypted images.
[0107] The digital video file is composed of multiple frames of images in time sequence, so it can be split into multiple picture files, each picture file is used as the image to be encrypted, and then each image to be encrypted is fused with the digital fingerprint image, as shown in the above step 103, to obtain the encrypted image corresponding to each picture file. That is, after processing each frame of the picture, the target digital video file is reassembled according to the original order of the multiple picture files in the digital video file, so that the digital fingerprint image is added to the bottom layer of the digital video file. Among them, the digital fingerprint image can be obtained by Figure 1 The steps in the illustrated embodiment are obtained; a digital video file can select the same digital fingerprint image for processing, and for a digital video file, part of the video clips (part of the image frame) can also be selected for the above processing, which is not limited here.
[0108] The digital fingerprint image data used in the processing is only used as an encryption layer and does not affect the normal application of the original digital file. After adding a digital fingerprint image that is not easy to imitate to the underlying file, it can be uploaded to the cloud Internet for dissemination, which has a certain anti-counterfeiting function. Even if the video file is processed twice or more, based on blockchain traceability and other technologies, it can be determined that the party that can provide the original video file + digital fingerprint image is the intellectual property protection party.
[0109] The blockchain mentioned in the embodiments of the present application is a data sharing system, and the system may include multiple nodes, and the multiple nodes may refer to each client in the data sharing system. Each node can receive input information when performing normal work, and maintain the shared data in the data sharing system based on the received input information. In order to ensure the information intercommunication within the data sharing system, there may be an information connection between each node in the data sharing system, and the nodes can transmit information through the above information connection. For example, when any node in the data sharing system receives input information, other nodes in the data sharing system obtain the input information according to the consensus algorithm, and store the input information as data in the shared data, so that the data stored on all nodes in the data sharing system are consistent.
[0110] Each node in the data sharing system has a corresponding node identifier, and each node in the data sharing system can store the node identifiers of other nodes in the data sharing system, so that the generated blocks can be broadcast to other nodes in the data sharing system according to the node identifiers of other nodes.
[0111] Blockchain is a new application model of computer technologies such as distributed data storage, peer-to-peer transmission, consensus mechanism, encryption algorithm, etc. Blockchain is essentially a decentralized database, a string of data blocks generated by cryptographic methods. Each data block contains a batch of network transaction information, which is used to verify the validity of its information (anti-counterfeiting) and generate the next block. Blockchain can include the underlying blockchain platform, platform product service layer, and application service layer.
[0112] The underlying blockchain platform can include processing modules such as user management, basic services, smart contracts, and operation monitoring. Among them, the user management module is responsible for the identity information management of all blockchain participants, including maintaining public and private key generation (account management), key management, and the maintenance of the correspondence between the user's real identity and the blockchain address (authority management), etc., and, under authorization, supervises and audits the transactions of certain real identities and provides risk control rule configuration (risk control audit); the basic service module is deployed on all blockchain node devices to verify the validity of business requests, and records valid requests to storage after consensus is reached. For a new business request, the basic service first adapts the interface for parsing and authentication (interface adaptation), and then encrypts the business information through the consensus algorithm (consensus management). The smart contract module is responsible for the registration and issuance of contracts, as well as contract triggering and contract execution. Developers can define the contract logic in a programming language and publish it to the blockchain (contract registration). According to the logic of the contract terms, the key or other events are called to trigger the execution and complete the contract logic. It also provides the function of contract upgrade and cancellation. The operation monitoring module is mainly responsible for the deployment, configuration modification, contract setting, cloud adaptation and real-time status visualization output of the product during the product release process, such as alarm, network monitoring, node equipment health monitoring, etc.
[0113] In an optional implementation, the above method further includes:
[0114] Uploading the encrypted image to the blockchain system so that the encrypted image and information of the current node are shared as block data to other nodes in the blockchain system, where the current node is the node that uploaded the encrypted image;
[0115] When a verification request for the encrypted image is received from a target node in the blockchain system, the digital fingerprint image and the image to be encrypted corresponding to the encrypted image are sent to the target node through the blockchain system. The target node is a node that has passed authentication verification in the blockchain system, and the verification request is recorded in the blockchain system.
[0116] Specifically, based on the above-mentioned blockchain function, the encrypted image obtained after processing can be uploaded to the blockchain by the current node. The encrypted image and the information of the current node can be shared with other nodes in the blockchain system as block data, and other nodes can obtain the encrypted image through the blockchain.
[0117] The above-mentioned target node can be a node with notarization authority, such as a third-party appraisal agency or platform in an infringement dispute. When necessary, the target node can send a verification request for the encrypted image to the current node, and authenticate the target node in the blockchain system. After the verification, the current node can provide the digital fingerprint image and the image to be encrypted corresponding to the encrypted image to the target node through the blockchain system as evidence to prove that it is the owner of the intellectual property rights. Combined with blockchain, data security and reliability can be further improved, and evidence can be verified accurately.
[0118] In another embodiment, physical craft products, including automobile shells, high-end customized crafts, etc., also face the risk of being copied, infringed, maliciously downloaded and used. Once a related dispute occurs, it is impossible to trace the source and determine the uniqueness. Combined with the method in the embodiment of the present application, the digital fingerprint image can also be used in the production and manufacturing of physical products to achieve anti-counterfeiting, information tracing and other similar functions.
[0119] For example, car shells are usually produced by spraying paint evenly. The chemical composition of paints from different manufacturers is slightly different. By collecting the remaining fragments of car shells at the scene of a car accident, it can be determined that it is a car of a certain model from a certain manufacturer.
[0120] The embodiment of the present application provides a manufacturing method, which performs 3D printing of digital fingerprint images in all areas after spraying the car shell, and there is no obvious color gradation difference in the naked eye and ordinary instruments. If a car accident occurs and it is necessary to trace the debris left at the scene, each car has a unique digital fingerprint image, which can be retrieved and located in the digital fingerprint image information library. Each digital fingerprint image stored in the digital fingerprint image information library has corresponding stored manufacturer information, which can be accurately traced.
[0121] Based on the description of the above-mentioned image processing method embodiment, the present application embodiment also discloses an image processing device. Figure 5 , the image processing device 500 comprises:
[0122] An acquisition module 510 is used to acquire an image to be processed, where the image to be processed is an image cut from a pathological image;
[0123] The processing module 520 is used to adjust the characteristic parameters of the image to be processed according to a preset transformation rule to obtain a digital fingerprint image corresponding to the image to be processed;
[0124] The fusion module 530 is used to fuse the digital fingerprint image with the image to be encrypted to obtain an encrypted image.
[0125] According to one embodiment of the present application, Figure 1 Each step involved in the method shown can be performed by Figure 5 The operations performed by various modules in the image processing device 500 shown are not described in detail here.
[0126] The image processing device 500 in the embodiment of the present application can obtain an image to be processed, which is an image cut from a pathological image; adjust the characteristic parameters of the image to be processed according to a preset transformation rule to obtain a digital fingerprint image corresponding to the image to be processed; merge the digital fingerprint image with the image to be encrypted to obtain an encrypted image, wherein the digital fingerprint of the image to be encrypted is generated using a natural pathological image, which has the advantages of uniqueness and being difficult to imitate and crack, thereby improving reliability, and the production cost of the digital fingerprint image is low.
[0127] Based on the description of the above method embodiment and device embodiment, the present application embodiment also provides an electronic device. Figure 6 The electronic device 600 at least includes a processor 601, an input device 602, an output device 603, and a computer storage medium 604. The processor 601, the input device 602, the output device 603, and the computer storage medium 604 in the electronic device may be connected via a bus or other means.
[0128] The computer storage medium 604 can be stored in the memory of the electronic device. The computer storage medium 604 is used to store a computer program. The computer program includes program instructions. The processor 601 is used to execute the program instructions stored in the computer storage medium 604. The processor 601 (or CPU (Central Processing Unit)) is the computing core and control core of the electronic device, which is suitable for implementing one or more instructions, and is specifically suitable for loading and executing one or more instructions to implement the corresponding method flow or corresponding function; in one embodiment, the processor 601 of the embodiment of the present application can be used to perform a series of processing, including such as Figure 1 The various steps involved in the method shown, etc.
[0129] The embodiment of the present application also provides a computer storage medium (Memory), which is a memory device in an electronic device for storing programs and data. It is understandable that the computer storage medium here can include both built-in storage media in electronic devices and, of course, extended storage media supported by electronic devices. The computer storage medium provides a storage space that stores the operating system of the electronic device. In addition, one or more instructions suitable for being loaded and executed by the processor 601 are also stored in the storage space, and these instructions can be one or more computer programs (including program codes). It should be noted that the computer storage medium here can be a high-speed RAM memory, or a non-volatile memory, such as at least one disk storage; optionally, it can also be at least one computer storage medium located away from the aforementioned processor.
[0130] In one embodiment, the processor 601 may load and execute one or more instructions stored in a computer storage medium to implement the corresponding steps in the above embodiment; in a specific implementation, the processor 601 may load and execute one or more instructions stored in a computer storage medium to implement the corresponding steps in the above embodiment; Figure 1 Any steps involved in the method shown will not be repeated here.
[0131] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0132] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the division of the module is only a logical function division, and there may be other division methods in actual implementation, for example, multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. The mutual coupling, direct coupling, or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.
[0133] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, that is, they may be located in one place or distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0134] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that contains one or more available media integrations. The available medium may be a read-only memory (ROM), or a random access memory (RAM), or a magnetic medium, such as a floppy disk, a hard disk, a tape, a magnetic disk, or an optical medium, such as a digital versatile disc (DVD), or a semiconductor medium, such as a solid state disk (SSD), etc.
Claims
1. An image processing method, characterized in that: The method comprises: Acquiring an image to be processed, wherein the image to be processed is an image cut from a pathological image; Adjusting the characteristic parameters of the image to be processed according to a preset transformation rule to obtain a digital fingerprint image corresponding to the image to be processed, wherein the characteristic parameters include color scale parameters; Merging the digital fingerprint image with the image to be encrypted to obtain an encrypted image; The step of adjusting the characteristic parameters of the image to be processed according to a preset transformation rule to obtain a digital fingerprint image corresponding to the image to be processed includes: comparing the value of the color scale parameter of the image to be processed with a preset threshold, reducing the color scale parameter greater than the preset threshold by a second multiple, and reducing the color scale parameter less than the preset threshold by a third multiple, to obtain the digital fingerprint image corresponding to the image to be processed.
2. The method according to claim 1, characterized in that: The step of fusing the digital fingerprint image with the image to be encrypted to obtain an encrypted image includes: Acquire a target image composed of the digital fingerprint images arranged in a tiled manner, wherein the target image has the same size as the image to be encrypted; Based on a preset fusion algorithm, an interpolation operation is performed on the pixel values of the image to be encrypted and the target fingerprint image to obtain the encrypted image.
3. The method according to claim 1 or 2, characterized in that: The step of obtaining the image to be processed comprises: Acquiring the pathological image, wherein the pathological image is obtained by scanning a pathological section with a digital pathology scanner; Performing a cutting process on the pathological image to obtain a plurality of cutting images; One of the multiple cut images is obtained as the image to be processed.
4. The method according to claim 1, characterized in that: The method further comprises: Uploading the encrypted image to the blockchain system so that the encrypted image and information of the current node are shared as block data to other nodes in the blockchain system, and the current node is the node that uploaded the encrypted image; When a verification request for the encrypted image is received from a target node in the blockchain system, the digital fingerprint image and the image to be encrypted corresponding to the encrypted image are sent to the target node through the blockchain system. The target node is a node that has passed authentication verification in the blockchain system, and the verification request is recorded in the blockchain system.
5. The method according to claim 3, characterized in that: Before fusing the digital fingerprint image with the image to be encrypted, the method further includes: Acquire a digital video file, split the digital video file into multiple picture files, use the multiple picture files as the images to be encrypted, trigger the step of fusing the digital fingerprint image with the image to be encrypted, and obtain multiple encrypted images corresponding to the multiple picture files; According to the order of the multiple picture files in the digital video file, a target digital video file is generated based on the multiple encrypted images.
6. The method according to claim 3, characterized in that: The method further comprises: Merging the image to be encrypted with a plurality of different digital fingerprint images respectively to obtain a plurality of encrypted images corresponding to the image to be encrypted, wherein the plurality of encrypted images are provided to different authorized users; The corresponding relationship between each of the encrypted image, the digital fingerprint image and the authorized user is recorded.
7. The method according to claim 6, characterized in that: The method further comprises: In response to a query request for an image to be detected, extracting a digital fingerprint image from the image to be detected; Searching for a target encrypted image that is identical to the digital fingerprint image in the image to be detected in the stored encrypted images; When a target encrypted image identical to the digital fingerprint image in the image to be detected is found, determining the authorized user corresponding to the target encrypted image; Output the digital fingerprint image of the target encrypted image and the information of the authorized user.
8. An image processing device, characterized in that: include: An acquisition module is used to acquire an image to be processed, wherein the image to be processed is an image cut from a pathological image; A processing module, used for adjusting the characteristic parameters of the image to be processed according to a preset transformation rule to obtain a digital fingerprint image corresponding to the image to be processed, wherein the characteristic parameters include a color scale parameter; The processing module is specifically used to compare the value of the color scale parameter of the image to be processed with a preset threshold, reduce the color scale parameter greater than the preset threshold by a second multiple, and reduce the color scale parameter less than the preset threshold by a third multiple, to obtain a digital fingerprint image corresponding to the image to be processed; The fusion module is used to fuse the digital fingerprint image with the image to be encrypted to obtain an encrypted image.
9. An electronic device, characterized in that: The method comprises a memory and a processor, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor executes the steps of the image processing method according to any one of claims 1 to 7.
10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the processor is caused to perform the steps of the image processing method according to any one of claims 1 to 7.
