Information processing system, information processing apparatus, program, and information processing method

Abstract

To provide an information processing system, an information processing apparatus, a program, and an information processing method capable of appropriately associating a plurality of pieces of information on patients.SOLUTION: An information processing system performs: patient information display processing for displaying patient information including a patient number; patient number display processing for displaying only the patient number from the patient information displayed by the patient information display processing; and image association processing for associating a first image obtained by imaging the patient number displayed by the patient number display processing with a second image obtained by imaging an affected portion of a patient corresponding to the patient number.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing system, an information processing device, a program, and an information processing method, and more particularly to an information processing system, an information processing device, a program, and an information processing method that manage patient information. [Background technology]

[0002] BACKGROUND ART There is known a technique for acquiring and collecting images and information relating to people and things, and managing the acquired and collected images and information, etc., for the purpose of performing arbitrary processing such as analyzing, managing, or understanding the behavior of people or the status of things.

[0003] For example, Patent Document 1 discloses a technology for acquiring information entered by a user on a document, associating the information with code information assigned to the document, and storing and managing the information in a storage unit. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2024-32083 Summary of the Invention [Problem to be solved by the invention]

[0005] Incidentally, medical institutions manage patient medical records in association with images of the patient (e.g., images of the affected area) taken when diagnosing the patient. When making the association, they may use a method such as attaching an identification code, such as a one-dimensional code or a two-dimensional code, to the medical record, taking an image of the record, and associating the image of the patient with the image of the patient.

[0006] However, with this method, there is a concern that problems may arise, such as the identification code attached to the medical record image and then photographed may not be properly recognized, and the medical record image may not be properly associated with the patient's image.

[0007] The present invention has been made in consideration of the above circumstances, and has as its objective to provide an information processing system, an information processing device, a program, and an information processing method that can appropriately associate multiple pieces of patient information. [Means for solving the problem]

[0008] In order to achieve the above object, the information processing system of the present invention executes a patient information display process that displays patient information including the patient number, a patient number display process that displays only the patient number from the patient information displayed in the patient information display process, and an image association process that associates a first image captured of the patient number displayed in the patient number display process with a second image captured of the affected area of ​​the patient corresponding to the patient number.

[0009] According to this, the first image capturing only the patient number from the patient information excludes information other than the patient number, and therefore the patient number can be properly recognized based on this first image.

[0010] Then, by associating this first image with a second image of the affected area of ​​the patient corresponding to the patient number captured in the first image, multiple pieces of information about the patient can be appropriately associated.

[0011] The image association process executed by this information processing system stores the first image and the second image in a memory area as management images of the patient, and further stores the first image and the second image in a memory area as management images of one patient, and also stores management images of other patients in the memory area by identifying them as the management images of the one patient.

[0012] The image association process performed by this information processing system uses character information as learning data and performs a recognition process to recognize a first image based on a trained model generated by machine learning using the learning data, and a recognition process to recognize an image other than the one recognized as the first image in the recognition process as a second image.

[0013] In order to achieve the above object, the information processing device of the present invention executes a patient information display process that displays patient information including the patient number, a patient number display process that displays only the patient number from the patient information displayed in the patient information display process, and an image association process that associates a first image captured of the patient number displayed in the patient number display process with a second image captured of the affected area of ​​the patient corresponding to the patient number.

[0014] To achieve the above object, the program of the present invention causes an information processing device implemented by a computer to execute a patient information display process that displays patient information including the patient number, a patient number display process that displays only the patient number from the patient information displayed in the patient information display process, and an image association process that associates a first image captured of the patient number displayed in the patient number display process with a second image captured of the affected area of ​​the patient corresponding to the patient number.

[0015] To achieve the above object, the information processing method of the present invention involves an information processing device implemented by a computer that executes a patient information display process that displays patient information including the patient number, a patient number display process that displays only the patient number from the patient information displayed in the patient information display process, and an image association process that associates a first image captured of the patient number displayed in the patient number display process with a second image captured of the affected area of ​​the patient corresponding to the patient number. [Effects of the Invention]

[0016] According to the present invention, a plurality of pieces of patient information can be appropriately associated with each other. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a block diagram illustrating an outline of the configuration of an information processing system according to an embodiment of the present invention. [Figure 2] 1 is a block diagram illustrating an outline of the configuration of a computer that implements an OCR device and an information processing device of the information processing system according to the present embodiment. [Figure 3] FIG. 2 is a block diagram for explaining an outline of the functions of the OCR device of the information processing system according to the present embodiment. [Figure 4] 1 is a block diagram for explaining an outline of the functions of an information processing device of the information processing system according to the present embodiment. [Figure 5] 1 is a block diagram for explaining an outline of processing of an information processing device of the information processing system according to the present embodiment. [Figure 6] 1 is a block diagram for explaining an outline of processing of an information processing device of the information processing system according to the present embodiment. [Figure 7] 10 is a flowchart outlining the processing of the information processing system according to the present embodiment. [Figure 8] 1 is a block diagram for explaining an outline of processing of an information processing device of the information processing system according to the present embodiment. [Figure 9] 10 is a flowchart outlining the processing of the information processing system according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0018] Next, an information processing system according to an embodiment of the present invention will be described with reference to FIGS.

[0019] 1 is a block diagram illustrating an outline of the configuration of an information processing system according to an embodiment of the present invention. As shown in the figure, the information processing system 10 mainly comprises an OCR device 20, a camera 30, and an information processing device 40.

[0020] In this embodiment, the OCR device 20 and the program described below stored in the information processing device 40 are linked (connected) via an API (Application Programming Interface), and the camera 30 is connected to the information processing device 40 via a wired or wireless connection.

[0021] In this embodiment, the OCR device 20 is managed by a service provider 1 that provides OCR services, the camera 30 is owned by a medical professional 2 such as a doctor who performs medical procedures, and the information processing device 40 is managed by the medical professional 2.

[0022] In this embodiment, the OCR device 20 and the information processing device 40 are implemented by computers having substantially the same hardware configuration, such as desktop or notebook computers.

[0023] 2 is a block diagram illustrating the general configuration of a computer. As shown in the figure, the computer includes a processor 101, a memory 102, a storage 103, a transmitter / receiver 104, and an input / output unit 105, which are electrically connected to each other via a bus 106.

[0024] The processor 101 is an arithmetic unit that controls the operation of the computer, controls the transmission and reception of data between elements, and performs processing necessary for executing application programs.

[0025] In this embodiment, the processor 101 is, for example, a CPU (Central Processing Unit), and executes application programs loaded in a memory 102 (described below) to perform various processes.

[0026] In this embodiment, the memory 102 is implemented as a main storage device that is configured as a volatile storage device such as a DRAM (Dynamic Random Access Memory).

[0027] This memory 102 is used as a working area for the processor 101, and also stores a BIOS (Basic Input / Output System) that is executed when the computer is started, various setting information, and the like.

[0028] The storage 103 stores programs and information used in various processes.

[0029] The transmission / reception unit 104 connects the computer to a network such as the Internet, and in this embodiment, the OCR device 20 and the information processing device 40 are connected by an API via the network via the transmission / reception unit 104.

[0030] The transmitting / receiving unit 104 may be compatible with a wireless communication standard such as Wi-Fi, or may be equipped with a short-range communication interface such as Bluetooth (registered trademark) or BLE (Bluetooth Low Energy).

[0031] The input / output unit 105 is an interface to which input / output devices such as a keyboard, a mouse, or a display are connected.

[0032] The bus 106 transmits, for example, address signals, data signals, and various control signals between the processor 101, memory 102, storage 103, transmission / reception unit 104, and input / output unit 105 that are connected to it.

[0033] 3 is a block diagram illustrating an outline of the functions of the OCR device 20. As shown in the figure, the OCR device 20 includes a trained model storage unit 21, which is realized by partitioning the storage area of ​​the storage 103.

[0034] In this embodiment, the trained model storage unit 21 stores trained models generated by performing machine learning using character information including numbers as training data.

[0035] In this embodiment, the OCR device 20 executes a process of recognizing characters, numbers, etc. from an arbitrary image that has been subjected to optical processing, based on a trained model.

[0036] The camera 30 shown in FIG. 1 captures an image by capturing any object as a subject, and in this embodiment, it captures a screen 101 that displays only the patient number, which is the medical record number, displayed on the display of the information processing device 40 as a first image, and captures the affected area of ​​the patient 3 as a second image.

[0037] 4 is a block diagram illustrating an outline of the functions of the information processing device 40. As shown in the figure, the information processing device 40 includes a medical record storage unit 41, an image receiving unit 42, a captured image storage unit 43, a medical record display processing unit 44, a medical record number display processing unit 45, an image association processing unit 46, and a management image storage unit 47.

[0038] The medical record memory unit 41, the captured image memory unit 43, and the managed image memory unit 47 are realized by partitioning the memory area of ​​the storage 103, and the image reception unit 42, the medical record display processing unit 44, the medical record number display processing unit 45, and the image association processing unit 46 are realized by executing programs stored in the memory 102 of the information processing device 40 by the processor 101.

[0039] In this embodiment, the medical record storage unit 41 stores the patient information for each patient 3, which includes a medical record number, in the form of a database after being subjected to electromagnetic processing.

[0040] In this embodiment, the image receiving unit 42 executes a process of receiving input of an image captured by the camera 30. The received image is stored in the captured image storage unit 43.

[0041] In this embodiment, the images captured by the camera 30 and stored in this captured image memory unit 43 are an image of the medical record number to be displayed by the medical record number display processing unit 45 described later, and an image of the patient's affected area.

[0042] In this embodiment, the medical record display processing unit 44 executes a process of displaying the medical records stored in the medical record storage unit 41 on the display of the information processing device 40 (patient information display process).

[0043] 5 is a diagram illustrating an outline of the processing of the medical record number display processing unit 45. As shown in the figure, in this embodiment, the medical record number display processing unit 45 executes processing to extract only the medical record number C from the medical record 100 displayed by the medical record display processing unit 44, and display a screen 101 showing only the extracted medical record number C on the display of the information processing device 40 (patient number display processing).

[0044] This medical record number display processing unit 45 may, for example, pre-set a position within the medical record 100 where a predetermined medical record number C will be displayed, and then recognize and extract the number displayed at this set position as the medical record number C.

[0045] In this embodiment, the image association processing unit 46 shown in Figure 4 recognizes the image captured by the camera 30 and stored in the captured image storage unit 43 as the first image, recognizes the image captured with medical record number C as the second image, and recognizes the image captured of the affected area of ​​patient 3 as the second image, and performs processing to associate the first image with the second image captured of the affected area of ​​patient 3 corresponding to the medical record number C of this first image (image association processing).

[0046] 6 is a diagram illustrating an outline of the processing of the image association processing unit 46. As shown in the figure, the image association processing unit 46 associates the first image with the second image by executing a recognition process P1, a grasping process P2, and a management image storage process P3.

[0047] 7 is a flowchart outlining the recognition process P1 and the understanding process P2. As shown in the figure, first, in step S1, OCR processing is performed on an image captured by the camera 30 and accepted by the image accepting unit 42, based on a trained model of the OCR device 20 that cooperates (connects) with the program of the information processing device 40 via an API.

[0048] When a character string is recognized in step S2 by executing the OCR process in step S1, it is determined in step S3 whether the recognized character string is a number.

[0049] If the character string is recognized as a number in step S3, in this embodiment, the recognized number is determined to be medical record number C, and in step S4, the image received by the image receiving unit 42 is recognized as the first image (recognition processing).

[0050] On the other hand, if the character string is not recognized in step S2 or if the character string is recognized as not being a number in step S3, the image received by the image receiving unit 42 is recognized as the second image in step S5 (recognition process).

[0051] In this embodiment, the management image storage process P3 shown in Figure 6 is a process of associating the first image with the second image as a management image of patient 3 corresponding to medical record number C captured in the image recognized as the first image, and storing the image in the management image memory unit 47 shown in Figure 4.

[0052] This management image saving process P3 associates the recognized first image with the second image grasped after the first image is recognized and the image grasped before the next recognition of the first image, and thereby saves the first image and the second image in the management image memory unit 47 as management images of patient 3 corresponding to medical record number C captured in the image recognized as the first image.

[0053] 8 is a diagram illustrating an outline of the management image storage process P3. As shown in the figure, when a first image a is recognized, then second images b to d are grasped, and then a first image e is recognized, the first image a and second images b to d are associated with each other and stored in the management image storage unit 47 as management images of one patient 3a corresponding to the medical record number C captured in the first image a.

[0054] Next, if the first image e is recognized, then the second images f and g are grasped, and then the first image h is recognized, the first image e is associated with the second images f and g, identified as management images of one patient 3a, and stored in the management image memory unit 47 as management images of another patient 3b corresponding to the medical record number C captured in the first image e.

[0055] Next, if the first image h is recognized, then the second images i to k are grasped, and then the first image l is recognized, the first image h and the second images i to k are associated with each other, identified as management images of one patient 3a, and stored in the management image memory unit 47 as management images of another patient 3c corresponding to the medical record number C captured in the first image h.

[0056] Next, an outline of the processing of the information processing system 10 according to this embodiment will be described.

[0057] 9 is a flowchart outlining the processing of the information processing system 10 according to this embodiment. As shown in the figure, first, in step S10, the medical worker 2 executes processing to display the medical record 100 on the display of the information processing device 40 (patient information display processing).

[0058] Next, in step S11, only the medical record number C is extracted from the medical record 100 displayed on the display, and a process is executed to display a screen 101 showing only the extracted medical record number C on the display of the information processing device 40 (patient number display process).

[0059] After the screen 101 is displayed on the display, the medical worker 2 takes an image of the screen 101 and inputs the captured image into the information processing device 40. In step S12, a process is executed to accept the image of the screen 101 on which only the medical record number C is displayed.

[0060] On the other hand, when the medical worker 2 takes an image of the affected area of ​​the patient 3 and inputs the taken image into the information processing device 40, a process of accepting the taken image of the affected area is executed in step S13.

[0061] The act of capturing an image of the screen 101 displaying only the medical record number C and inputting the image into the information processing device 40, and the act of capturing an image of the affected area of ​​the patient 3 and inputting the image into the information processing device 40 are repeated until a predetermined number of patients (n) is reached, and if the predetermined number of patients (n) is reached in step S14, an image association process is executed in step S15.

[0062] In the image association process, a recognition process P1, an understanding process P2, and a management image saving process P3 are executed, and the first image and the second image are associated and saved as a management image of patient 3 corresponding to medical record number C captured in the image recognized as the first image.

[0063] In this way, the first image capturing only the medical record number C from the medical record 100 excludes information other than the medical record number C, and therefore the medical record number C can be properly recognized based on this first image.

[0064] Then, by associating this first image with a second image of the affected area of ​​patient 3 corresponding to medical record number C captured in the first image, multiple pieces of information about patient 3 (in this embodiment, the first image and the second image) can be appropriately associated.

[0065] The present invention is not limited to the above-described embodiment, and various modifications are possible without departing from the spirit of the invention.

[0066] In the above embodiment, a case has been described in which the OCR device 20 and the program of the information processing device 40 are linked (connected) via an API, but this is not limited to this. For example, software that performs OCR processing using a trained model may be stored in the information processing device 40.

[0067] In the above embodiment, the case was described in which the medical record number C is composed of numbers, and when numbers are recognized in the first image, it is determined that it is medical record number C. However, the medical record number C may be composed of symbols or codes, or a combination of symbols, codes, and numbers, and a process may be executed to determine that it is medical record number C depending on the type of numbers, symbols, codes, etc. that it is composed of. [Explanation of symbols]

[0068] 1. Service providers 2. Medical professionals 3 patients 10 Information Processing Systems 20 OCR device 30 Camera 40 Information processing equipment

Claims

1. a patient information display process for displaying patient information including the patient number; a patient number display process for displaying only the patient number from the patient information displayed in the patient information display process; an image association process for associating a first image obtained by capturing the patient number displayed in the patient number display process with a second image obtained by capturing an affected area of ​​the patient corresponding to the patient number; An information processing system that executes the above.

2. The image association process includes: storing the first image and the second image in a storage area as control images of the patient; The information processing system according to claim 1 .

3. The image association process includes: storing the first image and the second image in a storage area as control images of one patient, and storing control images of other patients in the storage area by distinguishing them from the control image of the one patient; 3. The information processing system according to claim 1.

4. The image association process includes: character information is used as learning data, and a recognition process is performed to recognize the first image based on a trained model generated by machine learning using the learning data.

3. The information processing system according to claim 1.

5. The image association process includes: a recognition process in which character information is used as learning data and the first image is recognized based on a trained model generated by machine learning using the learning data; and executing a recognition process of recognizing, as the second image, an image other than the image recognized as the first image in the recognition process.

3. The information processing system according to claim 1.

6. a patient information display process for displaying patient information including the patient number; a patient number display process for displaying only the patient number from the patient information displayed in the patient information display process; an image association process for associating a first image obtained by capturing the patient number displayed in the patient number display process with a second image obtained by capturing an affected area of ​​the patient corresponding to the patient number; An information processing device that executes the above.

7. An information processing device implemented by a computer, a patient information display process for displaying patient information including the patient number; a patient number display process for displaying only the patient number from the patient information displayed in the patient information display process; an image association process for associating a first image obtained by capturing the patient number displayed in the patient number display process with a second image obtained by capturing an affected area of ​​the patient corresponding to the patient number; A program that executes the following.

8. An information processing device implemented by a computer, a patient information display process for displaying patient information including the patient number; a patient number display process for displaying only the patient number from the patient information displayed in the patient information display process; an image association process for associating a first image obtained by capturing the patient number displayed in the patient number display process with a second image obtained by capturing an affected area of ​​the patient corresponding to the patient number; An information processing method that performs the above.

Images