Image processing apparatus and method, program, storage medium, online medical care system, and image management apparatus

Abstract

To provide an image processor capable of suppressing the transmission or recording of the image of a part to be considered relating to the dignity of a patient or a part pertinent to personal information such as the face of the patient.SOLUTION: The image processing device includes a first acquisition unit configured to acquire an image obtained by imaging a patient, a second acquisition unit configured to acquire information about an affected part of the patient, a third acquisition unit configured to acquire information about a caution-required part of the patient that requires consideration in determining whether or not to display as an image, a determination unit configured to determine whether or not it is necessary to show the caution-required part to a doctor based on the information about the affected part and the information about the caution-required part, and an image processing unit configured to perform processing on a region including the caution-required part in the image when the determination unit determines that it is not necessary to show the caution-required part to the doctor.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to an image processing device for processing images of a patient. [Background technology]

[0002] Conventionally, a telemedicine system has been known in which a patient's terminal and a medical examiner's terminal are connected via a network, allowing the examiner to examine the patient remotely. In this case, the patient sends images of their facial expressions and the affected area to the medical terminal, and the doctor then examines them. In addition to telemedicine, a camera may be used to capture and record images of the affected area during face-to-face consultations between the doctor and the patient.

[0003] Images of sensitive areas that affect the patient's dignity, such as the genitals, or personal information such as the patient's face may be transmitted or saved, causing anxiety and embarrassment, resulting in psychological stress for the patient.

[0004] Generally, when a moving image or a still image contains information that is not desirable to display, a technique is known in which image processing such as masking is performed to prevent the information from being identified.

[0005] However, if the image to be processed is an affected area, it must be confirmed at the time of examination. Therefore, if the affected area and the special care area are located in the same position, it is necessary not to process the image. For example, Patent Document 1 discloses a technology for processing an object on an image according to the location of the object to be processed. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-150849 Summary of the Invention [Problem to be solved by the invention]

[0007] However, during an examination, a doctor may check not only the affected area but also areas other than the affected area to check for the spread of the disease from the affected area, infection to other areas, lesions, etc. If a doctor simply determines whether to perform image processing based on the positional relationship between the affected area and the area requiring special attention that is known in advance, as in the prior art disclosed in Patent Document 1, there is a possibility that the doctor may overlook conditions such as infection, spread, or lesions.

[0008] The present invention has been made in consideration of the above-mentioned problems, and its purpose is to provide an image processing device that can suppress the transmission and recording of images of areas requiring special care that affect the patient's dignity, or areas that correspond to personal information such as the patient's face. [Means for solving the problem]

[0009] The image processing device of the present invention is characterized by comprising a first acquisition means for acquiring an image of a patient, a second acquisition means for acquiring information about the patient's affected area, a third acquisition means for acquiring information about a specially-needed area of ​​the patient that requires consideration when deciding whether or not to display it as an image, a determination means for determining whether or not the specially-needed area needs to be shown to a doctor based on the information about the affected area and the information about the specially-needed area, and an image processing means for processing an area in the image that includes the specially-needed area when the determination means determines that the specially-needed area does not need to be shown to a doctor. [Effects of the Invention]

[0010] According to the present invention, it is possible to suppress the transmission and recording of images of sensitive areas that affect the patient's dignity, or of areas that contain personal information such as the patient's face. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a diagram showing the overall configuration of an online medical consultation system according to a first embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram of a doctor-side information processing device and a patient-side information processing device. [Figure 3] FIG. 1 is a block diagram of an image processing device. [Figure 4] 10 is a flowchart showing the operation of the image processing device. [Figure 5] FIG. 10 is a diagram showing a UI for inputting information about a region requiring special care. [Figure 6] 10 is a flowchart showing the operation of an image processing determination process. [Figure 7] FIG. 10 is a diagram showing a table to be referenced in the image processing determination process. [Figure 8] FIG. 10 is a diagram showing a UI for performing processing to exclude an image from image processing. [Figure 9] FIG. 10 is a diagram showing the overall configuration of an online medical consultation system according to a third embodiment of the present invention. [Figure 10] 10 is a flowchart showing the operation of an image processing device according to a third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention claimed. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numerals are used to designate the same or similar components, and redundant explanations will be omitted.

[0013] (First embodiment) FIG. 1 is a diagram showing the overall configuration of an online medical consultation system 100 according to a first embodiment of the present invention.

[0014] In the online medical consultation system 100 of this embodiment, a doctor's information processing device, such as a PC, smartphone, or tablet, is connected to a patient's information processing device, also a PC, smartphone, or tablet, via the Internet. The doctor and patient can communicate via voice or chat using an application. The information processing device is also equipped with a camera that allows the doctor and patient to take pictures of themselves, allowing for smoother communication by sharing images.

[0015] The online medical consultation system 100 of this embodiment will be described using an example in which video distribution is performed using imaging devices internal to the doctor-side information processing device 102 and the patient-side information processing device 103, but the devices that perform video distribution are not limited to internal devices. For example, imaging devices may be located external to the doctor-side information processing device 102 and the patient-side information processing device 103, and the connection may be either wired or wireless. Furthermore, the network 101 will be described using an example in which it connects the doctor's environment, which is the hospital, with the patient's environment, but it may also be a closed intranet within the hospital.

[0016] As shown in Fig. 1, the online medical consultation system 100 of this embodiment includes a doctor-side information processing device 102, a patient-side information processing device 103, an image processing device 104, and a medical information management device 105. The doctor-side information processing device 102, the image processing device 104, and the medical information management device 105 are connected via an intra-hospital network. The patient-side information processing device 103, the doctor-side information processing device 102, and the image processing device 104 are connected via the Internet via a network 101.

[0017] The doctor-side information processing device 102 transmits data acquired from the keyboard, microphone, and camera to the patient-side information processing device 103 via the network 101. It also receives data acquired from the patient-side information processing device 103 via the network 101. The doctor-side information processing device 102 also receives video and image data transmitted from the patient-side information processing device 103 via processing by the image processing device 104. The processing of video and image data transmitted from the patient-side information processing device 103 will be described in detail in Figure 4 and subsequent figures.

[0018] The patient-side information processing device 103 transmits data acquired from the keyboard, microphone, and camera to the doctor-side information processing device 102 or image processing device 104 via the network 101. It also receives data acquired from the doctor-side information processing device 102 via the network 101.

[0019] The image processing device 104, the details of which will be described later with reference to FIG. 3, has the functions of an image processing determination processing section 300 and an image processing section 310, and processes videos and still images of the patient as needed.

[0020] The medical information management device 106 stores in-hospital patient information (ID, name, medical department, age, sex, medical history, past medical treatment history, etc.), doctor information (ID, name, department affiliation information, etc.), and clinical paths. It also stores updated data. Such management devices are registered on a PC, in-hospital server, or cloud server, and can be accessed via the network 101 when necessary.

[0021] The doctor-side information processing device 102 may also have the function of the image processing device 104. Alternatively, the patient-side information processing device 103 may also have the function of the image processing unit 310.

[0022] In this way, by processing the image of the special care area, which requires careful consideration from the patient's point of view in determining whether or not to display it as an image, as necessary, the patient can receive medical treatment without stress.

[0023] FIG. 2 is a block diagram showing the hardware configuration of the doctor-side information processing device 102 and the patient-side information processing device 103. As shown in FIG.

[0024] Since the doctor-side information processing device 102 and the patient-side information processing device 103 have the same hardware configuration, the information processing device 200 will be described as a representative example.

[0025] The information processing device 200 includes a display unit 201, a VRAM 202, a BMU 203, a keyboard 204, a PD 205, a CPU 206, a HDD 207, a ROM 208, a RAM 209, a microphone 210, a speaker 211, a camera 212, a network I / F 213, and a bus 214.

[0026] The display unit 201 displays, for example, live view video, icons, messages, menus, and other UI (user interface) information.

[0027] The VRAM 202 stores moving images to be displayed on the display unit 201. The data stored in the VRAM 202 is transferred to the display unit 201 in accordance with a predetermined rule and displayed on the display unit 201.

[0028] The BMU (Bit Move Unit) 203 controls, for example, data transfer between memories (for example, between the VRAM 202 and other memories) and data transfer between memories and each I / O device (for example, the network I / F 213).

[0029] The keyboard 204 has various keys for inputting characters and the like.

[0030] The PD (pointing device) 205 is used, for example, to point to icons, menus, and other content displayed on the display unit 201, or to drag and drop objects.

[0031] The CPU 206 controls each device based on the OS and control programs stored in the HDD 207 or the ROM 208 .

[0032] The HDD 207 stores various control programs, various data to be temporarily stored, and the like.

[0033] The RAM 209 includes a work area for the CPU 206, a data saving area for error processing, a load area for control programs, and the like.

[0034] The ROM 208 stores various control programs executed within the information processing device 200 and data such as temporarily stored data.

[0035] The microphone 210 captures various sounds (voices). The microphone 210 may be a device separate from the information processing device 200.

[0036] The speaker 211 emits various sounds (voices). The speaker 211 may be a device separate from the information processing device 200.

[0037] The camera 212 captures moving and still image data of the doctor or patient. The camera 212 may be a device separate from the information processing device 200.

[0038] The network I / F 213 communicates with the doctor-side information processing device 102, the patient-side information processing device 103, the image processing device 104, and the medical information management device 105 via the network. The network I / F 213 is also used by the patient-side information processing device 103 to communicate with the doctor-side information processing device 102 and the image processing device 104.

[0039] The bus 214 includes an address bus, a data bus, and a control bus.

[0040] The control program can be provided to the CPU 206 from the HDD 207 or the ROM 208, or from another information processing device via the network I / F 213 over the network.

[0041] [Hardware configuration of image processing device] FIG. 3 is a block diagram for explaining an example of the hardware configuration of the image processing determination processing unit 300 and the image processing unit 310 in the image processing device 104 of this embodiment.

[0042] The image processing determination processing unit 300 receives data on affected area information and special care area information from the medical information management device 105, the doctor-side information processing device 102, and the patient-side information processing device 103, and determines the area to be processed in the image. The affected area information may be obtained by performing image recognition using the image processing device 104. The image processing processing unit 310 processes the video and image data received from the patient-side information processing device 103 as needed, based on the area to be processed in the image determined by the image processing determination processing unit 300, and transmits the processed data to the doctor-side information processing device 102.

[0043] Here, we will explain the hardware configuration of the image processing determination processing unit 300. Note that since the hardware configurations of the image processing determination processing unit 300 and the image processing processing unit 310 are similar, we will explain the configuration of the image processing determination processing unit 300 as a representative and omit explanation of the configuration of the image processing processing unit 310.

[0044] The CPU 301 controls each part of the image processing determination processing unit 300 based on a control program such as an OS stored in the ROM 302 or the HDD 304 and a program described later.

[0045] The ROM 302 stores various control programs executed within the image processing determination processing unit 300 and data such as temporarily stored data.

[0046] The RAM 303 includes a work area for the CPU 301, an area for saving data during error processing, an area for loading control programs, and the like.

[0047] The HDD 304 stores various control programs, various data to be temporarily stored, and the like.

[0048] The network I / F 305 communicates with the doctor-side information processing device 102, the patient-side information processing device 103, and the medical information management device 105 via the network.

[0049] The bus 306 is a system bus (consisting of an address bus, a data bus, and a control bus) that connects the above-mentioned units and the image processing unit 310. The image processing unit 310 may be connected via a network via a network I / F 305.

[0050] Furthermore, although the configuration has been described in which one image processing device 104 performs the functions of the image processing determination processing unit 300 and the image processing processing unit 310, these may be constructed in separate housings.

[0051] [Processing flow of image processing device] 4 is a flowchart showing the processing flow of the image processing device 104 of this embodiment. This processing is performed simultaneously with the start of online medical consultation, and after the processing starts, communication begins between the doctor-side information processing device 102 and the patient-side information processing device 103. Each step in FIG. 4 will be described in detail below.

[0052] In step S401, the CPU 301 of the image processing determination processing unit 300 acquires information about the patient's affected area. The information about the affected area includes the name of the disease, the name of the disease site, and the status of the disease, and is acquired from the medical information management device 105. The information about the affected area may also be acquired by inputting via the keyboard 201 of the doctor-side information processing device 102 or by voice input via the microphone 210.

[0053] In step S402, the CPU 301 acquires the patient's special care area information. The special care area information includes areas related to privacy and areas related to the patient's dignity, such as the genitals. The special care area information is acquired from the medical information management device 105. In this case, the special care area information may be set in advance according to the patient's age and gender, or may be set in detail for each patient. Alternatively, the special care area information may be acquired from input via the keyboard 204 or PD 205 of the doctor-side information processing device 102, or via input via the keyboard 204 or PD 205 of the patient-side information processing device 103.

[0054] FIG. 5 is a diagram showing an example of a UI displayed on the display unit 201 when inputting consideration-requiring body part information. UI 500 is an example of a UI for selecting and inputting from the body part name. Furthermore, when there are many body part items to select, the selection can be made easier if the items are grouped and displayed in a list. UI 501 is a UI for selecting and inputting, as shown in selection body part example 503, from a human body model 502 displayed on the display unit 201 by clicking or tapping with the PD 205. Alternatively, consideration-requiring body part information may be acquired by voice input using the microphone 210.

[0055] In step S403, the CPU 301 determines whether or not to process the image data showing the care-requiring part based on the affected part information, and transmits the part to be processed to the image processing unit 310.

[0056] In step S404, the CPU 301 starts acquiring moving image data from the patient-side information-processing device 103, and continues processing in the subsequent steps while the moving image data continues to be acquired.

[0057] In step S405, the CPU 301 of the image processing unit 310 acquires the received moving image data from the patient-side information processing device 103.

[0058] In step S406, the CPU 301 determines whether or not an image processing region exists in the image acquired in step S405, based on the image processing target region received in step S403.

[0059] For example, this can be achieved by inferring body parts using a trained model. The trained model identifies feature points (e.g., the center of the head and joint points) from the target image, and then detects body parts and their positions based on these feature points.

[0060] If there is no image processing region in step S406, the process proceeds to step S407, where the image is transmitted without image processing to the doctor-side information processing device 102. If there is an image processing region, the process proceeds to step S408.

[0061] In step S408, the CPU 301 processes the image and transmits the processed image to the doctor-side information processing device 102. The image processing method involves performing at least one of filling, deformation, color conversion, blurring, and mosaic processing on the entire image, a partial image, or only the processed region, to make it difficult to identify the region. The deformation is a process of changing the shape of the image using homography conversion, wave processing, spiral processing, etc. The color conversion is a process of changing the brightness, saturation, contrast, color temperature, hue, etc. of the image. The blurring is a process of blurring the image using a Gaussian filter, a smoothing filter, etc.

[0062] Thereafter, the image processing device 104 continues the processing from step S405 to step S409 while receiving image data during online medical consultation.

[0063] [Process flow for determining the processed part] The machining part determination process in step S403 will be described in detail with reference to Fig. 6. Fig. 6 is a flowchart showing the flow of the machining part determination process in this embodiment.

[0064] In step S601, the CPU 301 of the image processing determination processing unit 300 makes a determination based on the positions of the affected area and the special care area. If the information on the affected area and the special care area match, the process proceeds to step S605, and if they do not match, the process proceeds to step S602.

[0065] In step S602, the CPU 301 makes a determination based on the characteristics of the disease. As an example of determining the characteristics of the disease, the determination is made by referring to a table 700 showing disease characteristics, an example of which is shown in FIG. 7. Table 700 is a table showing data on whether the disease is contagious or spreadable, and on the extent of impact if it is contagious or spreadable. Table 700 is loaded from ROM 302 or HDD 304. Alternatively, it may be acquired from the medical information management device 105 via a network. If the disease in table 700 is not spreadable, the disease will not spread to areas requiring special attention, and the doctor does not need to look at areas requiring special attention during the examination, so the process proceeds to step S606. On the other hand, if the disease is spreadable, the process proceeds to step S603.

[0066] In step S603, the CPU 301 makes a determination based on the condition of the affected area. In this embodiment, the condition of the affected area is whether or not it is in a period of worsening tendency due to infection or spread. If it is in a recovery state or chronic state without worsening or spread of infection, the disease will not spread to the special care area and the doctor does not need to examine the special care area during the examination, so the process proceeds to step S606. If not, the process proceeds to step S604.

[0067] The condition of the affected area may be estimated and determined by referring to a clinical path, etc. A clinical path shows a step-by-step treatment (treatment and examination) plan until a target state is reached, and by performing treatment according to the clinical path, the treatment content is standardized, which increases the understanding of medical staff and patients. Because the treatment and treatment content in the clinical path are in line with the status of the affected area, it is possible to estimate the condition of the affected area in detail by referring to the clinical path.

[0068] In step S604, CPU 301 refers to table 700 and determines whether the expected range of expansion of the affected area includes a special care area. If the current disease is contagious and spreadable, the column for the contagious and spreadable area in table 700 indicates the area to which the contagious and spreadable area will extend. For example, if the contagious and spreadable area is a specific area such as the hand, the special care area will be excluded from processing if it matches the specific area; if it is unspecified such as the whole body, all special care areas will be excluded from processing. If the special care area is included in the expected range of expansion of the affected area, there is a possibility that a disease exists in the special care area, and a doctor will need to examine it during the examination, so the process proceeds to step S605. If not, the disease will not spread to the special care area, and a doctor will not need to examine the special care area during the examination, so the process proceeds to step S606.

[0069] In step S605, the CPU 301 determines that the acquired special attention area is not to be subjected to image processing.

[0070] In step S606, the CPU 301 determines that the acquired care-requiring part is to be subjected to image processing.

[0071] As explained above, by performing the processing of this embodiment, it is possible to perform an examination while reducing the psychological burden on the patient by displaying the areas necessary for the examination while processing and hiding the areas requiring special attention. Note that, although it has been explained in Fig. 6 that the judgment is made by referring to all of the progression of the disease in step S602, the disease status in step S603, and the enlarged area in step S604, the judgment may be made by using only some of them.

[0072] (Second embodiment) The image processing area determined at the start of the examination may need to be excluded and confirmed during the examination, for example, if a lesion or a new disease is suspected. In such cases, the doctor selects the area to be excluded from the currently processed areas, and after obtaining the patient's consent, leaves only the area to be excluded unprocessed. In the second embodiment, an example will be described in which the patient's psychological burden is reduced while the doctor is able to receive an examination of areas requiring special care.

[0073] Hereinafter, the process of excluding a processed portion according to this embodiment will be described with reference to Fig. 8. Note that the system configuration is the same as that of the first embodiment, and therefore description thereof will be omitted.

[0074] [Processing flow for excluding processed parts] Figure 8 shows an example of a UI and a flowchart for excluding sensitive areas from processing targets during online medical consultation. The process of excluding sensitive areas from processing targets by the doctor will be explained with reference to the UI screen.

[0075] In step S801, in the video call mode of online medical consultation, the CPU 206 of the doctor's information processing device 102 displays a UI 810 on the display unit 201.

[0076] The UI 810 displays a large image of the patient acquired from the image processing device 104. At this time, the CPU 206 of the doctor-side information processing device 102 overlays an image 811 acquired from the doctor-side information processing device 102 in the lower left corner. This allows the doctor to check how his or her own image is displayed to the patient.

[0077] The CPU 206 of the patient-side information-processing device 103 displays the doctor-side image as shown in the UI 813. The CPU 206 of the patient-side information-processing device 103 also displays an image 814 acquired from the patient-side information-processing device 103 as an overlay on the bottom left.

[0078] In the video call mode, the CPU 206 of the doctor-side information processing device 102, for example, places an exclusion region selection start button 812 on the UI displayed on the display unit 201 of the doctor-side information processing device 102. Then, the process of step S802 is started by determining whether the PD 205 of the doctor-side information processing device 102 has operated the exclusion region selection start button 812. The process of step S802 can also be started by determining whether a voice indicating the start of the exclusion mode is heard from the microphone 210 of the doctor-side information processing device 102.

[0079] In step S802, the CPU 206 of the doctor-side information processing device 102 selects a region to be excluded from the regions currently set as image processing targets. In the exclusion region selection mode, the CPU 206 of the doctor-side information processing device 102 displays the currently processed region as shown in UI 820 on the display unit 201 in order to select a processed region to be excluded. In other words, the CPU 206 of the doctor-side information processing device 102 overlays a region list 821 for selecting a region to be excluded from processing and a button 822 for determining the region to be excluded from processing on the display unit 201. In addition, the CPU 206 of the doctor-side information processing device 102 displays a reduced image 823 of the patient on the display unit 201.

[0080] The CPU 206 of the doctor-side information processing device 102 can start the processing of step S803 by determining that the doctor has operated the PD 205 with respect to the decision button 821. The CPU 206 of the patient-side information processing device 103 displays an image on the display unit 201 as in the UI 824, just as in step S801.

[0081] In step S803, the CPU 206 of the doctor-side information processing device 102 transmits a consent confirmation message to the CPU 206 of the patient-side information processing device 103, and displays a UI 830, which is an image similar to the UI 810, on the display unit 201 of the doctor-side information processing device 102. However, the UI 830 displays a display 831 on the display unit 201 indicating that exclusion confirmation is in progress. The CPU 206 of the patient-side information processing device 103 overlays a decision button 833 on the display unit 201, which includes a confirmation message as to whether or not the area selected by the doctor as an exclusion target should be excluded from processing targets. The processing of S804 can be started by determining that the patient has operated the decision button 833 using the PD 205 of the patient-side information processing device 103.

[0082] In step S804, the CPU 206 of the patient-side information processing device 103 determines the areas to be excluded from image processing and notifies the image processing unit 310. The image processing unit 310 updates the settings so that the areas to be excluded from image processing are excluded from the areas to be processed.

[0083] The CPU 206 of the doctor-side information processing device 102 again displays a UI 840 similar to the UI 810 on the display unit 201, and the CPU 206 of the patient-side information processing device 103 again displays a UI 842 similar to the UI 813. The CPU 206 of the doctor-side information processing device 102 displays a message 841 on the display unit 201 indicating that exclusion update is in progress, and the CPU 206 of the patient-side information processing device 103 also displays a message 843 on the display unit 201 indicating that exclusion update is in progress.

[0084] When the image processing unit 310 completes the setting of excluding the region to be excluded from image processing from the processing target, in step S805, the CPU 206 of the doctor-side information processing device 102 displays a UI 850 in which the region to be image processed has been updated on the display unit 201. Similarly, the CPU 206 of the patient-side information processing device 103 displays a UI 851 in which the region to be image processed has been updated on the display unit 201.

[0085] The video call mode continues until the consultation is completed, and processing is carried out according to the above steps as appropriate.

[0086] As explained above, by performing the above processing, if the image processing area becomes an area that needs to be viewed during the examination, only the necessary areas can be excluded from image processing, making it possible to perform an examination that reduces the psychological burden on the patient. (Third embodiment) In the first and second embodiments, the case of online consultation has been described, but even in the case of face-to-face consultation where an image of the affected area is taken and saved, if an area requiring special care is shown in the image, the patient may feel psychological burden when the image is saved. In the third embodiment, a process of processing the image of the affected area as needed to remove the area requiring special care when saving the image of the affected area will be described.

[0087] [System Configuration] 9 is a diagram showing the configuration of a system 900 including a medical imaging device and an image management device in the third embodiment. The following description will be given assuming that the system 900 in this embodiment is used in a hospital or the like.

[0088] The imaging device 901 captures an image of a subject and generates image data and video data (hereinafter, image data will be described as including video data). In the following description, the image data captured by the imaging device 901 will be described as visible light image data. The imaging device 901 is a small, portable imaging device, and, like a commercially available digital camera, is equipped with a display device that allows the captured image to be checked, and an interface such as buttons and a touch panel for various operations.

[0089] The network 902 realizes an inter-device network. For example, the imaging device 901 is connected to the network 902 as soon as the power is turned on by a user, and becomes able to communicate with other devices in the medical system 900 via the network 902. In this embodiment, unless otherwise specified, the imaging device 901 and its peripheral devices are assumed to remain in a communicable state until the power is turned off. Furthermore, some of the unique functions of the imaging device 901 may be limited during communication.

[0090] While the connection and communication method between the imaging device 901 and the network 902 has been described above, the same applies to communications between various other devices, such as the electronic medical record terminal device 904, medical information management device 903, image management device 905, and image processing device 906. Although omitted from Fig. 9, an illumination device configured with halogen lighting, light-emitting diode lighting, or the like may be installed for imaging purposes as needed. These illumination devices communicate with and are controlled via an interface disposed in the imaging device 901 and the network 902.

[0091] The medical information management device 903 stores in-hospital patient information (ID, name, medical department, age, sex, medical history, past medical treatment history, etc.), doctor information (ID, name, department affiliation information, etc.), and clinical paths. It also collates and authenticates doctor login and logoff information to the electronic medical record terminal device 904, provides doctor information, and provides patient information in the form of electronic medical records. It also stores updated data. It may also store setting information, such as imaging settings for the imaging device 901, for each medical department and doctor information. Such management devices are registered on a PC, an in-hospital server, or a cloud server, and can be accessed via the network 902 when needed.

[0092] At the time of a medical examination, the electronic medical record terminal device 904 downloads information about the logged-in doctor and the patient to be examined from the above-mentioned medical information management device 903, provides electronic medical record functions, and displays, edits, and updates the information.

[0093] The image management device 905 stores, updates, and deletes image data, photographer information, and patient information associated with the image data, and references the data as needed. The image management device 905 may be installed for each department in the hospital or on an external network such as the cloud. The image data is obtained from the image processing device 906 via the network.

[0094] The image processing device 906 has the same configuration as in the first embodiment and has the functions of an image processing determination processing unit 300 and an image processing processing unit 310. The image processing determination processing unit 300 receives data on affected area information and special care area information from the medical information management device 903 and the electronic medical record terminal device 904 and determines the area to be processed in the image. The image processing processing unit 310 processes the video and image data received from the imaging device 901 via the network as needed, based on the area to be processed in the image determined by the image processing determination processing unit 300, and transmits the processed video and image data to the image management device 905. The image processing processing unit 310 may be installed in each department within a hospital or on an external network such as the cloud. Since the configuration is the same as in the first embodiment, a description thereof will be omitted.

[0095] In this embodiment, the imaging device 901, medical information management device 903, electronic medical record terminal device 904, image management device 905, and image processing device 906 are described as separate devices. However, the functions of two or more devices may be realized by a single device, such as by constructing the medical information management device 903, electronic medical record terminal device 904, and image processing device 906 in the same housing. In this way, a system with appropriate cost can be configured in accordance with the load and capacity required by the system.

[0096] [Processing flow for processing and saving images] 10 is a flowchart showing the flow of processing for image processing of still images and moving image data of a patient's affected area based on the affected area information and the care-required area information. Note that, in this description, a doctor or medical staff member takes an image of the patient's affected area using an imaging device 901 during medical treatment, and the image processing is performed in a separate image processing device 906, but the imaging device 901 and the image processing device 906 do not have to be separate devices.

[0097] 10 is a flowchart showing the process of storing images processed by the image processing determination processing unit 300 and the image processing processing unit 310 of the image processing device 906 of this embodiment. This process is performed simultaneously with the start of the affected area photography mode, and the captured images or moving images are processed as needed and stored in the image management device 905.

[0098] In step S1001, the CPU 301 of the image processing determination processing unit 300 in the image processing device 906 acquires information about the affected area of ​​the patient. The affected area information includes the name of the disease and the status of the disease, and is acquired from the medical information management device 903. Alternatively, the affected area information may be acquired by inputting it into the electronic medical record terminal 904, for example.

[0099] In step S1002, the CPU 301 acquires information on the patient's special care site from the medical information management device 903. Alternatively, the information may be acquired from an input via the electronic medical record terminal 904.

[0100] In step S1003, the CPU 301 performs a process to determine whether or not to process image data showing a care-requiring area based on the affected area information. The process to determine the area to be processed is the same as in the first embodiment, and therefore a description thereof will be omitted.

[0101] In step S1004, the CPU 301 acquires image data from the imaging device 901 based on the result of the processed portion determination process.

[0102] In step S1005, CPU 301 determines whether the image acquired in step S1004 contains an image processing portion. If not, the process proceeds to step S1006, where the image is not processed and is saved in image management device 905. If the image contains an image processing portion, the process proceeds to step S1007.

[0103] In step S1007, CPU 301 processes the image and transmits the image data to image management device 905. Image processing is processing that makes it difficult to identify the part by performing at least one of painting, deformation, color conversion, blurring, and mosaic processing on the entire area of ​​the image, a partial area, or only the area of ​​the processed part.

[0104] As described above, according to this embodiment, when images of the affected area are saved, the image of areas requiring special attention can be processed as necessary and saved, making it possible to perform examinations that reduce the psychological burden on the patient.

[0105] (Other embodiments) The present invention can also be realized by supplying a program that realizes one or more of the functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more of the functions.

[0106] The disclosure of this specification includes the following image processing device, method, program, and storage medium.

[0107] (Item 1) a first acquisition means for acquiring an image of a patient; a second acquiring means for acquiring information about the affected area of ​​the patient; a third acquiring means for acquiring information on a special care site of the patient that requires consideration in determining whether or not to display the image; a determining means for determining whether or not the special care area needs to be shown to a doctor based on the information about the affected area and the information about the special care area; an image processing means for processing a region in the image including the special care site when the determining means determines that the special care site does not need to be shown to a doctor; An image processing device comprising:

[0108] (Item 2) 2. The image processing device according to item 1, wherein the second acquisition means acquires information about the affected area from a device that manages medical information within a hospital.

[0109] (Item 3) 2. The image processing device according to item 1, wherein the second acquisition means acquires information about the affected area from information input by a doctor.

[0110] (Item 4) 4. The image processing device according to any one of items 1 to 3, characterized in that the information about the affected area includes at least one piece of information about the disease name, the location of the affected area, the status of the affected area, and the area where the disease is infected or contagious.

[0111] (Item 5) The image processing device described in item 4 is characterized in that the determination means determines whether or not the special care area needs to be shown to a doctor based on at least one piece of information: the position of the affected area, the name of the disease in the affected area, the location of the affected area, the status of the affected area, and the area where the disease is infected or contagious.

[0112] (Item 6) 2. The image processing device according to item 1, wherein the third acquisition means acquires information about the special care area from a device that manages medical information within a hospital.

[0113] (Item 7) 2. The image processing device according to item 1, wherein the third acquisition means acquires information about the special care area from information input by a doctor.

[0114] (Item 8) The image processing device according to any one of items 1 to 7, characterized in that the image processing means performs at least one of filling processing, deformation processing, color conversion processing, blurring processing, and mosaic processing on the area including the special care area as the processing.

[0115] (Item 9) 9. The image processing device according to any one of items 1 to 8, further comprising a selection unit for selecting a region to be excluded from the region subjected to the processing by the image processing unit.

[0116] (Item 10) An online medical consultation system in which a patient-side information processing device having a first photographing means for photographing a patient and a doctor-side information processing device having a second photographing means for photographing a doctor are communicably connected, 10. An online medical consultation system, wherein either the patient-side information processing device or the doctor-side information processing device comprises the image processing device according to claim 1.

[0117] (Item 11) An image management device used in an online medical consultation system in which a patient-side information processing device having a first imaging means for imaging a patient and a doctor-side information processing device having a second imaging means for imaging a doctor are communicably connected, 10. An image management device comprising the image processing device according to any one of items 1 to 9.

[0118] (Item 12) a first acquisition step of acquiring an image of a patient; a second acquiring step of acquiring information about the affected area of ​​the patient; a third acquisition step of acquiring information about a special care site in the patient that requires consideration in determining whether or not to display the image; a determining step of determining whether or not the special care area needs to be shown to a doctor based on the information about the affected area and the information about the special care area; an image processing means for processing a region including the special care site in the image when it is determined in the determination step that the special care site does not need to be shown to a doctor; An image processing method comprising:

[0119] (Item 13) Item 13. A program for causing a computer to execute each step of the image processing method according to Item 12.

[0120] (Item 14) Item 13. A computer-readable storage medium storing a program for causing a computer to execute each step of the image processing method according to Item 12.

[0121] The invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0122] 100: Online medical treatment system, 101: Network, 102: Doctor-side information processing device, 103: Patient-side information processing device, 104: Image processing device, 105: Medical information management device

Claims

1. a first acquisition means for acquiring an image of a patient; a second acquiring means for acquiring information about the affected area of ​​the patient; a third acquiring means for acquiring information on a special care site of the patient that requires consideration in determining whether or not to display the image; a determining means for determining whether or not the special care area needs to be shown to a doctor based on the information about the affected area and the information about the special care area; an image processing means for processing a region in the image including the special care site when the determining means determines that the special care site does not need to be shown to a doctor; An image processing device comprising:

2. 2. The image processing apparatus according to claim 1, wherein the second acquiring means acquires information about the affected area from a device that manages medical information in a hospital.

3. 2. The image processing apparatus according to claim 1, wherein the second acquisition means acquires information about the affected area from information input by a doctor.

4. 2. The image processing apparatus according to claim 1, wherein the information about the affected area includes at least one of information about a disease name, a location of the affected area, a status of the affected area, and an area where the disease is infected or contagious.

5. The image processing device according to claim 4, characterized in that the determination means determines whether or not the area requiring special attention needs to be shown to a doctor based on at least one piece of information: the location of the affected area, the name of the disease in the affected area, the location of the affected area, the status of the affected area, and the area where the disease is infected or contagious.

6. 2. The image processing apparatus according to claim 1, wherein the third acquisition means acquires the information about the special care area from a device that manages medical information in a hospital.

7. 2. The image processing apparatus according to claim 1, wherein the third acquisition means acquires information about the special care area from information input by a doctor.

8. 2. The image processing device according to claim 1, wherein the image processing means performs at least one of filling, deformation, color conversion, blurring, and mosaic processing on the region including the special care area as the processing.

9. 2. The image processing apparatus according to claim 1, further comprising a selection unit for selecting a region to be excluded from the region processed by the image processing unit.

10. An online medical consultation system in which a patient-side information processing device having a first photographing means for photographing a patient and a doctor-side information processing device having a second photographing means for photographing a doctor are communicably connected, 10. An online medical consultation system, wherein either the patient-side information processing device or the doctor-side information processing device comprises the image processing device according to claim 1.

11. An image management device used in an online medical consultation system in which a patient-side information processing device having a first image capturing means for capturing an image of a patient and a doctor-side information processing device having a second image capturing means for capturing an image of a doctor are communicably connected, An image management device comprising the image processing device according to any one of claims 1 to 9.

12. a first acquisition step of acquiring an image of a patient; a second acquiring step of acquiring information about the affected area of ​​the patient; a third acquisition step of acquiring information about a special care site in the patient that requires consideration in determining whether or not to display the image; a determining step of determining whether or not the special care area needs to be shown to a doctor based on the information about the affected area and the information about the special care area; an image processing means for processing a region including the special care site in the image when it is determined in the determination step that the special care site does not need to be shown to a doctor; An image processing method comprising:

13. A program for causing a computer to execute each step of the image processing method according to claim 12.

14. A computer-readable storage medium storing a program for causing a computer to execute each step of the image processing method according to claim 12.

Images