Image data transmission method, device, equipment, medium and product

Abstract

The invention provides an image data transmission method and device, equipment, a medium and a product, and the method comprises the steps: intercepting an image displayed on intranet display equipment, and obtaining to-be-transmitted image data; acquiring a privacy information area of the to-be-transmitted image data, processing the to-be-transmitted image data based on the privacy information area, and removing privacy information in the privacy information area to obtain a processed image; and receiving an acquisition request sent by the extranet display device, and sending the processed image to the extranet display device in response to the acquisition request. According to the invention, the processed image transmitted to the extranet display equipment does not comprise privacy information, and data privacy protection during data conversion of the intranet and the extranet is ensured.

Description

Technical Field

[0001] The present invention relates to the field of image processing technology, and in particular to image data transmission methods, devices, equipment, media and products. Background Art

[0002] In order to protect private data, data management often uses the method of isolating data between the internal and external networks. The data that needs to be protected can only be read on the internal network. For example, due to the sensitivity of medical data, hospitals usually use the method of isolating internal and external networks when managing image data. However, in some cases, data conversion between the internal and external networks is required, such as remote consultations in hospitals or medical record discussions between hospitals. In the prior art, data is directly read from the internal network device and sent to the external network device. In this process, the data may be leaked through the external network device, resulting in the leakage of private data. Summary of the invention

[0003] The present invention provides an image data transmission method, device, equipment, medium and product, which are used to solve the defect of privacy data leakage during internal and external network data conversion in the prior art, and realize data privacy protection during internal and external network data conversion.

[0004] The present invention provides an image data transmission method, comprising: Intercept the image displayed on the intranet display device to obtain the image data to be transmitted; Acquire the privacy information region of the image data to be transmitted, process the image data to be transmitted based on the privacy information region, remove the privacy information in the privacy information region, and obtain a processed image; A collection request sent by an external network display device is received, and the processed image is sent to the external network display device in response to the collection request.

[0005] According to a method for transmitting image data provided by the present invention, the image displayed on the intranet display device is intercepted to obtain image data to be transmitted, comprising: Acquire the image type of the image displayed on the intranet display device, and determine the capture range based on the image type; The image displayed by the intranet display device is intercepted based on the interception range to obtain the image data to be transmitted.

[0006] According to an image data transmission method provided by the present invention, obtaining the privacy information area of ​​the image data to be transmitted includes: The image data to be transmitted is input into a privacy information region recognition model to obtain the privacy information region output by the privacy information region recognition model.

[0007] According to an image data transmission method provided by the present invention, after obtaining the processed image, the method comprises: sending the processed image to a local display device for display; receiving, through the local display device, privacy information region correction information, and correcting the privacy information region based on the privacy information region correction information; Processing the image data to be transmitted based on the corrected privacy information area to obtain the updated processed image; The processed image and the correction data set corresponding to the processed image are stored in a reference database, wherein the correction data set includes the private information area before and after correction.

[0008] According to an image data transmission method provided by the present invention, before sending the processed image to a local display device for display, the method comprises: Matching the data in the reference database based on the processed image and the current privacy processing information to determine a reference processed image; The current private information region is adjusted based on the correction data group corresponding to the reference processed image, and the processed image is updated based on the adjusted private information region.

[0009] According to an image data transmission method provided by the present invention, the processing of the image data to be transmitted based on the privacy information area to remove the privacy information in the privacy information area includes: Determining a processing method corresponding to the private information area based on the private information area; The private information in the private information area is removed based on the processing method corresponding to the private information area.

[0010] The present invention also provides an image data transmission device, comprising: The capture module is used to capture the image displayed on the intranet display device to obtain the image data to be transmitted; A processing module, used for obtaining the privacy information region of the image data to be transmitted, processing the image data to be transmitted based on the privacy information region, removing the privacy information in the privacy information region, and obtaining a processed image; The sending module is used to receive a collection request sent by an external network display device, and send the processed image to the external network display device in response to the collection request.

[0011] The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, any of the above-mentioned image data transmission methods is implemented.

[0012] The present invention also provides a non-transitory computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, any of the above-mentioned image data transmission methods is implemented.

[0013] The present invention also provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor, any of the above-mentioned image data transmission methods is implemented.

[0014] The image data transmission method, device, equipment, medium and product provided by the present invention intercept the image displayed on the intranet display device to obtain the image data to be transmitted, identify the privacy information area of ​​the image data to be transmitted, and process the privacy information area based on the identified privacy information area, remove the privacy information in the privacy information area, obtain the processed image, and send the processed image to the external network display device in response to the acquisition request sent by the external network display device. In this way, the processed image transmitted to the external network display device does not include the privacy information, which ensures the data privacy protection during the conversion of internal and external network data. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the technical solutions in the present invention or the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0016] Figure 1 It is a flowchart of the image data transmission method provided by the present invention.

[0017] Figure 2 It is a schematic diagram of the data flow process in the image data transmission method provided by the present invention.

[0018] Figure 3 It is a structural schematic diagram of the image data transmission device provided by the present invention.

[0019] Figure 4 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0020] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0021] In order to protect private data, data management often uses the method of isolating data between the internal and external networks. The data that needs to be protected can only be read on the internal network. For example, due to the sensitivity of medical data, hospitals usually use the method of isolating internal and external networks when managing image data. However, in some cases, data conversion between the internal and external networks is required, such as remote consultations in hospitals or medical record discussions between hospitals. In the prior art, data is directly read from the internal network device and sent to the external network device. In this process, the data may be leaked through the external network device, resulting in the leakage of private data.

[0022] In view of the defect of privacy data leakage during the conversion of internal and external network data in the prior art, the present invention provides an image data transmission method, device, equipment, medium and product to achieve the technical effect of protecting data privacy during the conversion of internal and external network data.

[0023] Combine the following Figure 1-2 The image data transmission method provided by the present invention is described. The image data transmission method provided by the present invention can be executed by a terminal device with data processing capabilities, including but not limited to a computer, a server, a mobile terminal, a wearable electronic device, etc. Figure 1 As shown, the image data transmission method provided by the present invention comprises the steps of: S110, intercepting the image displayed on the intranet display device to obtain image data to be transmitted; S120, obtaining a privacy information region of the image data to be transmitted, processing the image data to be transmitted based on the privacy information region, removing the privacy information in the privacy information region, and obtaining a processed image; S130: receiving a collection request sent by the external network display device, and sending the processed image to the external network display device in response to the collection request.

[0024] The image data transmission method provided by the present invention intercepts the image displayed on the intranet display device to obtain the image data to be transmitted, identifies the privacy information area of ​​the image data to be transmitted, processes the identified privacy information area based on the privacy information area, removes the privacy information in the privacy information area, obtains the processed image, and sends the processed image to the external network display device in response to the acquisition request sent by the external network display device. In this way, the processed image transmitted to the external network display device does not include the privacy information, thereby ensuring the data privacy protection during the conversion of internal and external network data.

[0025] In the image data transmission method provided by the present invention, when the image data stored in the intranet needs to be sent to the external network for internal and external network conversion, the image data is not directly read from the data storage library of the intranet, but is instead Figure 2As shown, the image is intercepted when the intranet display device displays the image to obtain the image data to be transmitted. Specifically, in many cases, the file name, data creation time, modification time, etc. during data storage may contain privacy information (for example, the file name includes the name, ID number, etc.). In the image data transmission method provided by the present invention, the image displayed by the intranet display device is intercepted to obtain the image data to be transmitted, and then the image data to be transmitted is processed, which can avoid the leakage of the privacy data carried by the file itself after the original file is processed and transmitted.

[0026] In one possible implementation, the images displayed on the intranet display device can be directly intercepted to obtain the image data to be transmitted. After research, the inventors found that in some cases, explanatory information will be added to the image data stored in the intranet in a fixed position or area. Taking the hospital as an example, for some medical images, the patient's name, gender, age and other information may be added in a fixed position (for example, above or below the image). In another possible implementation of the image data transmission method provided by the present invention, further, the image displayed on the intranet display device is intercepted to obtain the image data to be transmitted, including: Obtain the image type of the image displayed on the intranet display device, and determine the capture range based on the image type; The image displayed by the intranet display device is intercepted based on the interception range to obtain the image data to be transmitted.

[0027] A correspondence between image type and interception range is pre-constructed. For example, for a CT image, the privacy-related information is fixedly added within the 2 cm range above the image. Then the interception range is the portion excluding the 2 cm above the image. According to the image type of the image displayed on the intranet display device and the pre-constructed correspondence between the image type and the interception range, the range for intercepting the image displayed on the intranet display device can be determined. Based on the range, the image displayed on the intranet display device is intercepted to obtain the image to be transmitted.

[0028] By first intercepting the image displayed by the intranet display device and then further removing the privacy data after interception, the reliability of privacy data removal can be improved.

[0029] The captured image data to be transmitted is used to identify the privacy information area, where the privacy information area is an area in the image data to be transmitted that includes privacy information, such as the face part of a person in a photo.

[0030] Specifically, obtaining the privacy information area of ​​the image data to be transmitted includes: The image data to be transmitted is input into the privacy information region recognition model to obtain the privacy information region output by the privacy information region recognition model.

[0031] The private information region recognition model is a pre-built model for identifying private information regions in image data. The private information region recognition model may be a trained deep learning model, that is, the private information region recognition model is trained based on multiple sets of training data, each set of training data includes sample image data and private information region labels corresponding to the sample image data.

[0032] In order to ensure the efficiency and security of the method provided by the present invention, the privacy information area recognition model is deployed locally, so that the image data to be transmitted does not need to be sent to other external devices such as servers where the model is deployed for processing, thereby preventing data leakage.

[0033] After obtaining the privacy information region output by the privacy information region recognition model, the image data to be transmitted is processed based on the privacy information region, and the privacy information in the privacy information region is removed to obtain a processing effect.

[0034] Specifically, the image data to be transmitted is processed based on the privacy information area to remove the privacy information in the privacy information area, including: Determine a processing method corresponding to the privacy information area based on the privacy information area; The private information in the private information area is removed based on the processing method corresponding to the private information area.

[0035] The private information in the private information area can be removed by mosaic or uniform color. When the area of ​​the private information area is smaller than the preset area, the corresponding processing method is uniform color, that is, all pixel colors in the private information area are unified into one color (for example, black). When the area of ​​the private information area is larger than the preset area, the corresponding processing method can be uniform color or mosaic. When the processing method is mosaic, the size of the mosaic is determined according to the area size of the private information area.

[0036] The image data to be transmitted is processed based on the privacy information area, and the processed image is obtained after the privacy information in the privacy information area is removed. Figure 2 As shown, after the processed image is obtained, the processed image can be sent to a local display device for display. Thus, before the processed image is sent to an external network device, it can be checked by a specialist.

[0037] Specifically, after obtaining the processed image, it includes: Send the processed image to the local display device for display; receiving, through a local display device, privacy information region correction information, and correcting the privacy information region based on the privacy information region correction information; The image data to be transmitted is processed based on the corrected privacy information area to obtain an updated processed image; The processed image and the correction data set corresponding to the processed image are stored in a reference database, wherein the correction data set includes the privacy information area before and after correction.

[0038] As described above, the privacy information area recognition model is a model deployed locally. To ensure that it runs quickly and at low cost, the privacy information area recognition model in the method provided by the present invention has a relatively simple structure and a small number of parameters. The privacy information area recognized by the privacy information area recognition model may be wrong. In the image data transmission method provided by the present invention, the image data to be transmitted is processed based on the privacy information area obtained by machine recognition. After the processed image is obtained, it is sent to the local display device for display, so that a specialist can view the processed image through the display device and verify it. When the specialist views the processed image and believes that there is a privacy information area that has not been recognized, the unrecognized privacy information area can be input through the display device, or when the specialist views the processed image and believes that there is an area that is not a privacy information area but is processed, the area that is mistakenly recognized as a privacy information area can be input through the display device. After receiving the privacy information area correction information input by the specialist through the display device, the previously recognized privacy information area is corrected based on the privacy information area correction information.

[0039] Furthermore, after the privacy information area is corrected and the image data to be transmitted is processed based on the corrected privacy information area to obtain an updated processed image, the processed image and the corrected data group corresponding to the processed image are stored in the reference database, so that the initially generated processed image can be verified by the information in the parameter database before the processed image is manually corrected later. That is, before the processed image is sent to the local display device for display, it includes: Matching the data in the reference database based on the processed image and the current privacy information area to determine a reference processed image; The current privacy information region is adjusted based on the correction data set corresponding to the reference processed image, and the processed image is updated based on the adjusted privacy information region.

[0040] Matching the data in the reference database based on the processed image and the current privacy information region can be achieved by calculating the similarity. The calculation of the similarity can include two steps. The first step is to calculate the first similarity between the processed image and the image in the reference database. When the first similarity is higher than a preset similarity threshold, the image in the reference database is used as a candidate image. Then, the second similarity between the privacy information region before correction in the candidate image and the privacy information region of the current processed image is calculated, and the candidate image with the highest second similarity is selected as the reference processed image. The privacy information region identified in the current processed image is adjusted according to the corrected privacy information region in the reference processed image, and the processed image is further updated based on the adjusted privacy information region, that is, the privacy information of the image to be transmitted is removed according to the adjusted privacy information region to obtain an updated processed image.

[0041] Furthermore, the second similarity can be evaluated from two aspects: one is the position similarity between the position of the private information region between the corrections in the candidate image and the private information region of the current processed image in the image, and the other is the content similarity between the content of the private information region between the corrections in the candidate image and the private information region of the current processed image. The content similarity can be determined by counting pixel values.

[0042] After obtaining the final processed image, if a collection request sent by an external network display device is received, the processed image is sent to the external network display device for display in response to the collection request. The external network display device can remotely share the processed image through network software. From the above description, it can be seen that the method provided by the present invention only needs to be executed by a device connected to the internal network display device and the external network display device respectively. It is easy to use and does not rely on network settings, while ensuring the security of privacy information.

[0043] The image data transmission device provided by the present invention is described below. The image data transmission device described below and the image data transmission method described above can be referred to in correspondence with each other. Figure 3 As shown, the image data transmission device provided by the present invention includes: The capture module 310 is used to capture the image displayed on the intranet display device to obtain the image data to be transmitted; The processing module 320 is used to obtain the privacy information area of ​​the image data to be transmitted, process the image data to be transmitted based on the privacy information area, remove the privacy information in the privacy information area, and obtain a processed image; The sending module 330 is used to receive a collection request sent by the external network display device, and send the processed image to the external network display device in response to the collection request.

[0044] The image data transmission device provided by the present invention intercepts the image displayed on the intranet display device to obtain the image data to be transmitted, identifies the privacy information area of ​​the image data to be transmitted, processes the identified privacy information area based on the identified privacy information area, removes the privacy information in the privacy information area, obtains the processed image, and sends the processed image to the external network display device in response to the acquisition request sent by the external network display device. In this way, the processed image transmitted to the external network display device does not include the privacy information, thereby ensuring the data privacy protection during the conversion of internal and external network data.

[0045] In a possible implementation, in the image data transmission device provided by the present invention, the image displayed on the intranet display device is intercepted to obtain the image data to be transmitted, including: Obtain the image type of the image displayed on the intranet display device, and determine the capture range based on the image type; The image displayed by the intranet display device is intercepted based on the interception range to obtain the image data to be transmitted.

[0046] In a possible implementation, in the image data transmission device provided by the present invention, obtaining the privacy information area of ​​the image data to be transmitted includes: The image data to be transmitted is input into the privacy information region recognition model to obtain the privacy information region output by the privacy information region recognition model.

[0047] In a possible implementation, in the image data transmission device provided by the present invention, the processing module 320 is further used to: After obtaining the processed image, the processed image is sent to a local display device for display; receiving, through a local display device, privacy information region correction information, and correcting the privacy information region based on the privacy information region correction information; The image data to be transmitted is processed based on the corrected privacy information area to obtain an updated processed image; The processed image and the correction data set corresponding to the processed image are stored in a reference database, wherein the correction data set includes the privacy information area before and after correction.

[0048] In a possible implementation, in the image data transmission device provided by the present invention, the processing module 320 is further used to: before sending the processed image to the local display device for display, match the data in the reference database based on the processed image and the current privacy processing information to determine the reference processed image; The current privacy information region is adjusted based on the correction data set corresponding to the reference processed image, and the processed image is updated based on the adjusted privacy information region.

[0049] In a possible implementation, in the image data transmission device provided by the present invention, processing the image data to be transmitted based on the privacy information area to remove the privacy information in the privacy information area includes: Determine a processing method corresponding to the privacy information area based on the privacy information area; The private information in the private information area is removed based on the processing method corresponding to the private information area.

[0050] Figure 4 An example of a physical structure diagram of an electronic device is shown in FIG. Figure 4 As shown, the electronic device may include: a processor 410, a communication interface 420, a memory 430 and a communication bus 440, wherein the processor 410, the communication interface 420 and the memory 430 communicate with each other through the communication bus 440. The processor 410 may call the logic instructions in the memory 430 to execute the image data transmission method, which includes: intercepting the image displayed on the intranet display device to obtain the image data to be transmitted; obtaining the privacy information area of ​​the image data to be transmitted, processing the image data to be transmitted based on the privacy information area, removing the privacy information in the privacy information area, and obtaining the processed image; receiving the acquisition request sent by the external network display device, and sending the processed image to the external network display device in response to the acquisition request.

[0051] In addition, the logic instructions in the above-mentioned memory 430 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store program codes.

[0052] On the other hand, the present invention also provides a computer program product, which includes a computer program. The computer program can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the image data transmission method provided by the above methods, which includes: intercepting the image displayed on the intranet display device to obtain the image data to be transmitted; obtaining the privacy information area of ​​the image data to be transmitted, processing the image data to be transmitted based on the privacy information area, removing the privacy information in the privacy information area, and obtaining a processed image; receiving a collection request sent by an external network display device, and sending the processed image to the external network display device in response to the collection request.

[0053] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, it is implemented to execute the image data transmission method provided by the above-mentioned methods. The method includes: intercepting the image displayed on the intranet display device to obtain the image data to be transmitted; obtaining the privacy information area of ​​the image data to be transmitted, processing the image data to be transmitted based on the privacy information area, removing the privacy information in the privacy information area, and obtaining a processed image; receiving an acquisition request sent by the external network display device, and sending the processed image to the external network display device in response to the acquisition request.

[0054] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0055] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0056] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for transmitting image data, characterized in that: include: Intercept the image displayed on the intranet display device to obtain the image data to be transmitted; Acquire the privacy information region of the image data to be transmitted, process the image data to be transmitted based on the privacy information region, remove the privacy information in the privacy information region, and obtain a processed image; A collection request sent by an external network display device is received, and the processed image is sent to the external network display device in response to the collection request.

2. The image data transmission method according to claim 1, characterized in that: The step of intercepting the image displayed on the intranet display device to obtain the image data to be transmitted includes: Acquire the image type of the image displayed on the intranet display device, and determine the capture range based on the image type; The image displayed by the intranet display device is intercepted based on the interception range to obtain the image data to be transmitted.

3. The image data transmission method according to claim 1, characterized in that: The step of obtaining the privacy information area of ​​the image data to be transmitted includes: The image data to be transmitted is input into a privacy information region recognition model to obtain the privacy information region output by the privacy information region recognition model.

4. The image data transmission method according to claim 3, characterized in that: After the processed image is obtained, the method includes: sending the processed image to a local display device for display; receiving, through the local display device, privacy information region correction information, and correcting the privacy information region based on the privacy information region correction information; Processing the image data to be transmitted based on the corrected privacy information area to obtain the updated processed image; The processed image and the correction data set corresponding to the processed image are stored in a reference database, wherein the correction data set includes the private information area before and after correction.

5. The image data transmission method according to claim 4, characterized in that: Before sending the processed image to the local display device for display, the method includes: Matching the data in the reference database based on the processed image and the current privacy information area to determine a reference processed image; The current private information region is adjusted based on the correction data group corresponding to the reference processed image, and the processed image is updated based on the adjusted private information region.

6. The image data transmission method according to claim 1, characterized in that: The processing of the image data to be transmitted based on the privacy information area to remove the privacy information in the privacy information area includes: Determining a processing method corresponding to the private information area based on the private information area; The private information in the private information area is removed based on the processing method corresponding to the private information area.

7. An image data transmission device, characterized in that: include: The capture module is used to capture the image displayed on the intranet display device to obtain the image data to be transmitted; A processing module, used for obtaining the privacy information region of the image data to be transmitted, processing the image data to be transmitted based on the privacy information region, removing the privacy information in the privacy information region, and obtaining a processed image; The sending module is used to receive a collection request sent by an external network display device, and send the processed image to the external network display device in response to the collection request.

8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that: When the processor executes the computer program, the image data transmission method according to any one of claims 1 to 6 is implemented.

9. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the image data transmission method according to any one of claims 1 to 6 is implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the image data transmission method according to any one of claims 1 to 6 is implemented.

Images