Information processing device and program

Abstract

This information processing device acquires test information for a patient, said test information being outputted by a medical testing device, generates a computer-readable encoded image on the basis of the test information, and presents the generated encoded image.

Description

Information Processing Apparatus and Program

[0001] The present invention relates to an information processing apparatus and a program.

[0002] Patients frequently undergo examinations while attending a medical institution for purposes such as treatment. Generally, the examination results are confirmed by patients at the medical institution by checking the display on electronic medical records, or obtained as printed copies from the medical institution, after which patients record and confirm the content of the results.

[0003] In addition, when transferring to another hospital, documents such as referral letters and printed materials such as medical records have been provided from the previously involved hospital to the new hospital. The new hospital has conventionally optically read these documents and printed materials with a scanner or the like and registered them in an electronic medical record system for use.

[0004] Japanese Patent Application Laid-Open No. 2020-123354

[0005] However, from the patient's perspective, it is preferable that examination information and the like can be managed electronically rather than being provided in paper form. For example, in the treatment of glaucoma, it is desirable to be able to continuously grasp changes in one's visual field, but paper media are difficult to manage, and cumulative examination results and treatment details cannot be easily checked.

[0006] The same applies when transferring between hospitals. Currently, examination information and the like are not exchanged electronically, so in reality there are cases where cumulative examination results and treatment details cannot be managed efficiently.

[0007] The present invention has been made in view of the above circumstances, and one of its objects is to provide an information processing system, an information processing apparatus, and a program that can facilitate the transfer of examination and treatment information.

[0008] One aspect of the present invention that solves the problems of the above conventional example is an information processing apparatus, comprising: acquisition means for acquiring patient examination information output from a medical examination apparatus; generation means for generating a computer-readable coded image based on the examination information; and coded image presenting means for presenting the generated coded image.

[0009] According to the present invention, it is possible to easily exchange information on examinations and treatments.

[0010] This is a block diagram showing an example of an information processing system according to an embodiment of the present invention. This is a block diagram showing an example of an information processing device according to an embodiment of the present invention. This is an explanatory diagram showing an example of an image processed by an information processing device according to an embodiment of the present invention. This is an explanatory diagram showing an example of a list display of information related to a coded image by an information processing device according to an embodiment of the present invention. This is an explanatory diagram showing an example of image data compressed by an information processing device according to an embodiment of the present invention. This is an explanatory diagram showing an example of information recorded on a server by an information processing device according to an embodiment of the present invention. This is an explanatory diagram showing an example of information generated by an information processing device according to an embodiment of the present invention to explain inspection results.

[0011] Embodiments of the present invention will be described with reference to the drawings. The information processing system 1 according to an embodiment of the present invention is configured to include a plurality of information processing devices 10, as illustrated in Figure 1. The information processing devices 10 can be implemented in various ways, such as (1) a portable device such as a smartphone held by a patient, (2) an electronic medical record system installed in a medical institution, or (3) an examination device installed in a medical institution.

[0012] As illustrated in Figure 1, the information processing device 10 includes a control unit 11, a storage unit 12, an operation unit 13, a display unit 14, an input / output unit 15, and a communication unit 16, and is connectable to a medical examination device 2, an imaging device 3, and a printer device 4. While the information processing device 10 illustrated in Figure 1 may be connected to the examination device 2, imaging device 3, and printer device 4 respectively, their depiction is omitted in Figure 1 for illustrative purposes. Furthermore, this information processing device 10 may be connected to a server 5 via a network for communication.

[0013] The control unit 11 is a program control device such as a CPU, and operates according to a program stored in the memory unit 12. In one example of this embodiment, the control unit 11 acquires patient examination information output by the examination device 2 and generates a computer-readable coded image based on this acquired examination information. The control unit 11 also presents the generated coded image to the user, for example, by displaying it on the display unit 14. The operation of this control unit 11 will be described in detail later.

[0014] The storage unit 12 is a memory device, disk device, etc., and holds the program executed by the control unit 11. This program may be provided on a computer-readable, non-temporary recording medium and stored in the storage unit 12. The storage unit 12 also functions as the work memory of the control unit 11.

[0015] The operation unit 13 is a mouse, keyboard, or touch panel, and accepts user input and outputs information representing that operation to the control unit 11. The display unit 14 is a display or the like and displays information according to instructions input from the control unit 11.

[0016] The input / output unit 15 is a USB (Universal Serial Bus) interface, etc., and outputs information to peripheral devices such as the printer device 4 according to instructions input from the control unit 11. The input / output unit 15 also receives input of examination result information from the medical examination device 2 and outputs it to the control unit 11. Furthermore, the input / output unit 15 outputs image data obtained by the imaging device 3 when it captures images formed on paper media or images displayed on an external computer display device, etc. (In the following description, this image data obtained by the imaging device 3 will be called imaging data, and will be distinguished from medical image data (hereinafter simply referred to as image data) that is included as part of the examination information) to the control unit 11.

[0017] The communication unit 16 is, for example, a network interface, and in accordance with instructions input from the control unit 11, it accesses an instructed external server 5 via the network, obtains information from the server 5 and outputs it to the control unit 11, or uploads information input from the control unit 11 to the server 5.

[0018] The medical examination device 2 is, for example, a visual field testing device, and receives instructions from the information processing device 10 to output information representing the results of the patient's examination.

[0019] The imaging device 3 optically captures an image displayed on a display or an image formed on a paper medium, which is the target of the imaging, and generates imaging data. In this embodiment, the imaging device 3 may be a flatbed scanner or a camera. The imaging device 3 may also be integrated with the information processing device 10 (i.e., it may be built into the information processing device 10). The printer device 4 forms the image to be output by the information processing device 10 on the paper medium according to the instructions input from the information processing device 10.

[0020] Next, an example of the operation of the control unit 11 will be described. In this embodiment, the control unit 11 operates according to user instructions and executes a program stored in the memory unit 12, thereby realizing a configuration that functionally includes at least an acquisition unit 21, an acquisition unit 22, a recording unit 23, and an acquisition unit 24 as the coded image generation processing unit 20, as illustrated in Figure 2. The control unit 11 may also functionally include a reading unit 31, a decoding unit 32, and a utilization processing unit 33 as the coded image utilization processing unit 30.

[0021] Here, the acquisition unit 21 of the coded image generation processing unit 20 acquires patient examination information output by the medical examination device 2. In one example of this embodiment, the medical examination device 2 may include devices that perform biochemical tests such as blood tests and urine tests, which output examination information represented as string or numerical data (hereinafter, the output in this example will be called "string output"), devices that output examination information in the form of image data such as CT, MRI, ultrasound, endoscopic images, image examinations using contrast agents, and even X-rays (hereinafter, the output in this example will be called "image output"), devices that output examination information represented as graph image data such as electrocardiograms and electromyograms (hereinafter, the output in this example will be called "graph output"), and devices that output examination information in tabular format (a format in which numerical and other string data are arranged in the row and column directions), such as blood tests, urine tests, or measured sensitivity information in visual field test results (hereinafter, the output in this example will be called "table output").

[0022] Furthermore, the image output may include image data related to specialized medical care, such as ophthalmology and dentistry. Examples of ophthalmic image output include fundus photographs, anterior segment photographs, optical coherence tomography (OCT) images (posterior segment and anterior segment), and ultrasound images, while examples of dental image output may include cone-beam CT and panoramic X-ray images.

[0023] The testing device 2 generally combines these string outputs, image outputs, and graph outputs to produce test information. As an example, the test information output by the testing device 2 for visual field testing, as illustrated in Figure 3, includes string outputs representing patient identification information (such as name and medical record number), age, gender, and other information (patient information: P), a table output (V) of the patient's measured visual field sensitivity at various points within the patient's visual field, an image output (T) representing the measured values ​​as a grayscale image, a combination of a table output and an image output showing the difference from a healthy person (there may be multiple types, such as total deviation and pattern deviation; D1, D2), and a gaze track (a graph output showing the amount of eye movement during the test; G), all arranged in a complex manner according to a predetermined layout. This layout may further include legend information (L) related to the image output. In this example, the testing device 2 outputs this test information as document data in a predetermined format such as PDF (Portable Document Format). Currently, the layout differs depending on the manufacturer and model of the testing device 2.

[0024] The physician prints the test result information output by the testing device 2, or reads it using electronic medical record software and displays it on a computer screen for presentation to the patient. In this embodiment, when the information processing device 10 is implemented as a portable device such as a smartphone held by the patient, the patient, as the user, operates the information processing device 10 to cause the imaging device 3 to capture the printed test result information or the test result information displayed on the screen. In this example, the acquisition unit 21 acquires imaging data related to the test result information captured by the imaging device 3.

[0025] In this example, the acquisition unit 21 optically recognizes the acquired imaging data and obtains inspection information. For example, if the inspection information includes string output, the acquisition unit 21 recognizes the string included in the imaging data using optical character recognition (OCR) and acquires the original data, which is the inspection information (string data) with string output.

[0026] On the other hand, if the inspection information includes an image output, the acquisition unit 21 either acquires the image data included in the image output as inspection information as is, or converts the information represented by the image data into a string and acquires it. When acquiring the information by converting it into a string, the acquisition unit 21 performs information recognition processing according to the type of image data. An example of this processing will be described later.

[0027] Furthermore, if document data with various outputs laid out, as illustrated in Figure 3, is obtained as inspection information, the acquisition unit 21 recognizes the regions (segments) in the document data that describe string outputs, image outputs, graph outputs, etc., and the format of the output of the information contained within those segments (which may be string outputs, image outputs, etc.). As an example, the acquisition unit 21 analyzes the layout using a document layout analysis (DLA) tool such as DocLayout-YOLO (https: / / github.com / opendatalab / DocLayout-YOLO), divides it into segments in which each piece of information is described, and then recognizes which form of output (string output, image output, graph output, etc.) is being produced for each segmented part, and executes the corresponding processing.

[0028] In this example, it is preferable to set a layout pattern that is predetermined for each manufacturer and model of the inspection device 2. This setting associates information that identifies a region on the imaging data (hereinafter referred to as region setting information: RA, RB, ..., RE (Figure 3)), the format of the output contained within each region (e.g., string output, image output, etc.), and the type of information represented by the output contained within that region (e.g., "measured value of field sensitivity and grayscale image output").

[0029] The acquisition unit 21 compares the information of the area occupied by all the recognized segments (the area corresponding to the union of SA, SB, etc.) with the entire area specified by the area setting information (the area corresponding to the union of RA, RB, etc.), and acquires the layout pattern setting with the smallest difference (the non-overlapping parts of each union).

[0030] The acquisition unit 21 sequentially selects each segment and determines the region identified by the region setting information in the acquired layout pattern that corresponds to the selected segment. This determination can be made, for example, by selecting the region whose centroid is closest to the centroid of the selected segment from among the regions identified by the region setting information in the acquired layout pattern as the corresponding region.

[0031] When the acquisition unit 21 determines the region corresponding to the selected segment, it uses the output format information associated with the region setting information of the determined region and the type of information within that region to extract string data, image data, etc., from the image portion within the selected segment. For example, if the output format for the region setting information of the region corresponding to the selected segment is "table output" and the type of information is "measured values ​​of field sensitivity," then the unit extracts the string data (numerical values ​​in this case) arranged in each row and column. Various processes for extracting string data arranged in each row and column from string data arranged in such a table format using OCR are known, so a detailed explanation is omitted here. The measured values ​​of field sensitivity of the widely known Humphrey perimeter are arranged in a table format (however, the number of elements in each row differs from row to row), so this process can obtain numerical data of the sensitivity at each inspection point in the field of view.

[0032] Furthermore, if the acquisition unit 21 has an output format associated with the region setting information for the region corresponding to the selected segment, and the type of that information is a grayscale image of the field of view sensitivity, then the image output (T) inside it will have multiple levels of grayscale pixel blocks (in the example in Figure 3, the inside of a small rectangle is filled with gray pixels of brightness corresponding to the sensitivity value at the corresponding inspection point) arranged at the positions corresponding to each inspection point.

[0033] The acquisition unit 21 then detects the brightness of pixel clusters arranged at each examination point in the image output (T) representing the patient's visual field sensitivity within the region of this segment, and performs a process to convert the detected brightness values ​​for each examination point into sensitivity values ​​according to predetermined rules. Specifically, the rules here are table information that associates the magnitude of the brightness value within the range between the highest and lowest brightness of pixels included in the image data (hereinafter referred to as corrected brightness; for example, if the highest brightness Ba and the lowest brightness Bb are detected, and the brightness of the pixel cluster is B, then (B-Bb) / (Ba-Bb)) with sensitivity information (numerical information). The acquisition unit 21 converts the brightness value for each examination point into the above-mentioned corrected brightness, then refers to the table information to convert it into sensitivity information, and obtains the sensitivity value for each examination point as numerical information.

[0034] However, this is just one example, and the acquisition unit 21 may use a machine learning model that has been trained to understand the relationship between CT or MRI image data and predetermined numerical information used for medical judgment (for example, the area of ​​a lesion in the image data) to obtain string data of a predetermined test result from the image output.

[0035] Furthermore, the acquisition unit 21 may, for graph output, acquire predetermined features represented by each type of graph as examination information using graph OCR with a machine learning model. For example, for electrocardiogram graph output, the acquisition unit 21 may use graph OCR to obtain information such as P wave height, P wave width, Q wave height, R wave height, QRS width, etc., that appear in the electrocardiogram and acquire them as examination information.

[0036] Since the acquisition unit 21 acquires string data representing the content from image output and the like, the amount of data to be encoded by the subsequent coded image generation unit 22 can generally be reduced compared to when the image data is encoded as is.

[0037] Furthermore, when the information processing device 10 is implemented as an electronic medical record system deployed in a medical institution, the acquisition unit 21 receives document data (PDF data, etc.) containing examination information output by the examination device 2, etc. In this case, if the examination information is output as a string, the acquisition unit 21 acquires the information of that string as is as examination information.

[0038] Furthermore, if the inspection information included in the data output by the inspection device 2 includes image output or graph output, the acquisition unit 21 either acquires the image data included in the image output as inspection information as is, or, as in the example already described, acquires numerical information of the inspection result represented by the image data. In addition, if the output of the inspection information is a graph output, the acquisition unit 21 may, as in the example already described, extract predetermined features represented by the graph for each type of graph using graph OCR with a machine learning model and acquire them as inspection information.

[0039] Furthermore, if the information processing device 10 is implemented as an inspection device deployed in a medical institution, that is, if the information processing device 10 is configured integrally with the inspection device 2, the inspection information is obtained as is (as data), so the acquisition unit 21 in this example acquires the inspection information obtained through the operation of the inspection device as is.

[0040] The coded image generation unit 22 generates a computer-readable coded image based on the inspection information obtained by the acquisition unit 21, that is, using the inspection information as the target for encoding. Specifically, if the inspection information obtained by the acquisition unit 21 includes information on the date and time the inspection was performed, the coded image generation unit 22 extracts the information on the date and time the inspection was performed (inspection date and time information). Alternatively, if the coding image generation unit 22 cannot extract the inspection date and time information, it may generate the inspection date and time information using the current date and time (the date and time the processing is being performed) as the inspection date and time. In this case, a doctor or other person may be allowed to set the inspection date and time information.

[0041] The code image generation unit 22 generates a code image by using, as an encoding target (information serving as a base of the code image), information that associates examination date and time information with at least a part of examination information (a part including at least an examination result). Since methods for generating a code image based on information to be encoded are widely known, description thereof will be omitted here. In the example of the present embodiment, the code image generation unit 22 may generate a barcode, a two-dimensional barcode, or the like as the code image. However, the code image of the present embodiment is not limited to these examples such as barcodes, and may be a code image embedded in various images (for example, a code image as disclosed in U.S. Pat. No. 7,387,261), and any optically computer-readable code image may be used.

[0042] The recording unit 23 stores and holds the examination information obtained by the acquisition unit 21 in the storage unit 12, the server 5 used by a user, or the like (hereinafter referred to as the storage unit 12 or the like). As an example, when the information processing apparatus 10 of the present embodiment is (1) implemented in a portable device such as a smartphone carried by a patient, the user is limited to the individual patient, so the recording unit 23 may store and hold the examination information obtained by the acquisition unit 21 in the storage unit 12 or the like.

[0043] Furthermore, in the following example, when information is recorded in an external device such as the server 5 as described above, the recording unit 23 may encrypt the information to be recorded by a predetermined method and then record the encrypted information in the server 5. Information serving as a key for this encryption (encryption key) may be specified by the user, or may be information known in the information processing apparatus 10 (for example, telephone number information unique to the information processing apparatus 10, IMEI (International Mobile Equipment Identifier), MAC address of a communication interface, etc.). Furthermore, this encryption key may be information unique to the user such as My Number information.

[0044] Furthermore, in the following example, the encryption method may be symmetric encryption (encryption in which the encryption key and the decryption key are common) or asymmetric encryption, as long as the decryption key is kept secret.

[0045] Furthermore, if there is a code image generated by the code image generation unit 22 based on the test information obtained by the acquisition unit 21, the recording unit 23 may store and record this code image in the storage unit 12 or the like instead of or together with the test information obtained by the acquisition unit 21.

[0046] When the information processing apparatus 10 of the present embodiment is implemented in (2) an electronic medical record system installed in a medical institution, the recording unit 23 stores and records the test information obtained by the acquisition unit 21 in the storage unit 12 or an external server 5 in association with information identifying the patient related to the test information. If information identifying the patient is included in the test information obtained by the acquisition unit 21, the information identifying the patient may be extracted, and the test information may be stored and recorded in the storage unit 12 or the external server 5 in association with the extracted information.

[0047] Also in this example, if there is a code image generated by the code image generation unit 22 based on the test information obtained by the acquisition unit 21, the recording unit 23 may store and record this code image in the storage unit 12 or the like instead of or together with the test information obtained by the acquisition unit 21. Also in this case, when recording information in an external device such as the server 5, the recording unit 23 may encrypt the information to be recorded by a predetermined method before recording it in the server 5. The selection of an encryption key and the encryption method are the same as in the examples already described, so repeated description will be omitted.

[0048] Furthermore, when the information processing apparatus 10 is implemented in (3) a test apparatus installed in a medical institution or the like, the recording unit 23 is not necessarily required; however, in this example, the recording unit 23 stores and records the test information obtained by the acquisition unit 21 in the storage unit 12 or an external server 5 in association with information identifying the patient related to the test information. Also in this example, when recording information in an external device such as the server 5, the recording unit 23 may encrypt the information to be recorded by a predetermined method before recording it in the server 5. The selection of an encryption key and the encryption method are the same as in the examples already described, so repeated description will be omitted.

[0049] Furthermore, if patient identification information is included in the examination information obtained by the acquisition unit 21, the patient identification information may be extracted and associated with the extracted information, and the examination information may be stored and recorded in the storage unit 12 or an external server 5. If there is a coded image generated by the coded image generation unit 22 based on the examination information obtained by the acquisition unit 21, the recording unit 23 may store and record this coded image in the storage unit 12 or the like, either in place of the examination information obtained by the acquisition unit 21 or together with the examination information obtained by the acquisition unit 21.

[0050] The coded image presentation unit 24 displays the coded image generated by the coded image generation unit 22 on the display unit 14 in response to user instructions. The coded image presentation unit 24 may also display coded images previously generated by the coded image generation unit 22, which have been recorded by the recording unit 23 in the storage unit 12, etc., on the display unit 14 in response to user instructions. If the recording of inspection information, etc. is performed on the server 5, the coded image presentation unit 24 acquires the inspection information, etc. from the server 5, instructs the coded image generation unit 22 to use the acquired inspection information, etc. as the target for encoding and generate a coded image, and displays the generated coded image on the display unit 14.

[0051] In this case, if the inspection information, etc., is encrypted on the server 5, the encrypted inspection information, etc., is decrypted using a predetermined decryption key (converted to plaintext), and then the decrypted inspection information, etc., is used as the target for encoding, and the coded image generation unit 22 is instructed to generate a coded image.

[0052] Furthermore, the information processing device 10 according to one aspect of this embodiment may also operate as a coded image utilization processing device 30. The control unit 11 of the information processing device 10 operating as a coded image utilization processing device 30 functionally includes a reading unit 31, a decoding unit 32, and a utilization processing unit 33. Here, the reading unit 31 acquires imaging data obtained by the imaging device 3 based on user instructions. If the acquired imaging data includes a coded image, the reading unit 31 extracts the portion of the coded image. This extraction process can employ widely known methods.

[0053] The decoding unit 32 decodes the coded image extracted by the reading unit 31 and obtains the information encoded in the coded image. In this embodiment, the coded image encodes inspection information and inspection date and time information, and the decoding unit 32 decodes and obtains this encoded information.

[0054] The utilization processing unit 33 provides the examination information and examination date and time information acquired by the decoding unit 32 to predetermined processing. An example of this embodiment of the information processing device 10 is included in an electronic medical record system provided on the medical institution side. In this information processing device 10, the control unit 11, as processing of the utilization processing unit 33, incorporates the examination information and examination date and time information acquired by the decoding unit 32 into the corresponding patient's electronic medical record information.

[0055] The information processing device 10 of this embodiment basically has the above configuration and operates as shown in the following example. Below, we will sequentially describe examples in which the information processing device 10 is implemented in (1) a portable device such as a smartphone owned by a patient, (2) an electronic medical record system installed in a medical institution, and (3) a testing device installed in a medical institution.

[0056] (1) An example in which the information processing device 10 is implemented in a portable device such as a smartphone owned by the patient. In this example, the patient takes an image of the test results presented by the doctor using their own information processing device 10 and generates an encoded image. When the patient undergoes a visual field test using the examination device 2, the examination device 2 outputs document data (PDF data, etc.) representing the test information as illustrated in Figure 3. The doctor imports this document data into the electronic medical record system, presents the document data to the patient, and uses the document data to determine treatment guidelines, etc.

[0057] When a patient operates the smartphone, which is the information processing device 10, to have the imaging device 3 capture the test result information displayed on the electronic medical record screen, the information processing device 10 performs the following processing on the imaging data captured by the imaging device 3.

[0058] In this example, the information processing device 10 performs OCR processing on the portion of the imaging data that contains text characters, and obtains patient identification information as text data. Such OCR processing can employ widely known methods. Furthermore, regarding sensitivity information (T), the information processing device 10 extracts numerical sensitivity data for each examination point from the image output content using the method already described, and obtains it as an examination result.

[0059] Furthermore, for parts where the inspection results are shown as graph output rather than text, such as the gaze track (G), the information processing device 10 extracts the graph output image portion as image data.

[0060] The information processing device 10 generates a computer-readable coded image based on numerical information representing the sensitivity at each position in the obtained field of view, image data representing the gaze track (G), etc. (at least one type of inspection information). Specifically, if the OCR processing result performed on the imaging data includes information on the date and time the inspection was performed, the information processing device 10 extracts that date and time information as the inspection date and time. The information processing device 10 then encodes the information including the information representing the inspection date and time and the above inspection information to generate a coded image. Here, the coded image is assumed to be a two-dimensional barcode such as a QR code (registered trademark).

[0061] The information processing device 10 further records the generated coded image in the storage unit 12, associating it with information representing the inspection date and time and a title (for example, string data representing the content of the inspection). The title information may be entered by the user, or it may be an extract of a part of the string data that was to be encoded. This recording of coded images is used as follows.

[0062] The patient may, for example, display the generated and recorded coded images to communicate them to a doctor at another hospital (different from the hospital where the examination was performed). In this process, the information processing device 10, following the instructions of the user (the patient), displays a list of recorded coded images as illustrated in Figure 4, prompting the patient to select a coded image to present. At this time, the information processing device 10 displays a list of the corresponding recorded title information as the coded image list. The information processing device 10 may also set the display order to the order of the associated examination date and time.

[0063] The information processing device 10, upon the user's selection of a title from the list of titles corresponding to the code image to be presented, displays and outputs the code image corresponding to the selected title, in accordance with the user's instructions. The user then presents the displayed code image to a doctor or other medical professional at the healthcare facility.

[0064] In this example, a physician or other medical professional at a medical institution, upon receiving a coded image, uses the medical institution's information processing device 10 to capture the displayed coded image and obtain imaging data including the coded image. The medical institution's information processing device 10 then decodes the coded image contained in the acquired imaging data to obtain the patient's examination information and the date and time of the examination. The medical institution's information processing device 10 then incorporates this examination information and the date and time of the examination as information in the electronic medical record.

[0065] (2) Example of the information processing device 10 being implemented as part of an electronic medical record system deployed in a medical institution Next, an example of operation when the information processing device 10 of this embodiment is implemented as part of an electronic medical record system deployed in a medical institution will be described. In this example, the information processing device 10 directly receives input of examination information from the examination device 2. Here, as already illustrated, if the examination device 2 is a visual field testing device, the PDF information of the image as illustrated in Figure 3 will be input from the examination device 2.

[0066] Therefore, the information processing device 10 in this example of the embodiment performs OCR processing on the portion of the PDF information input from the inspection device 2 that contains text characters, and obtains patient identification information, etc., as text data. Such OCR processing can employ widely known methods. Furthermore, the information processing device 10 obtains numerical information of sensitivity (T), etc., at each inspection point as an inspection result using the method already described.

[0067] Furthermore, for parts where the inspection results are shown as graph output rather than text, such as the gaze track (G), the information processing device 10 extracts the image portion showing the graph output as image data.

[0068] The information processing device 10 generates a computer-readable coded image based on numerical information representing the sensitivity at each position in the obtained field of view, image data representing the gaze track (G), etc. (at least one type of inspection information). Specifically, if the OCR processing result performed on the imaging data includes information on the date and time the inspection was performed, the information processing device 10 uses that date and time information as the inspection date and time, and encodes the information including the information representing the inspection date and time and the above inspection information into a coded image. Here, the coded image is assumed to be a two-dimensional barcode such as a QR code (registered trademark).

[0069] The information processing device 10 records the generated coded image in the storage unit 12, associating it with patient identification information, information representing the date and time of examination, and title information. Here, the patient identification information and title information may be obtained based on string data obtained by OCR processing, etc., or may be entered by a physician. This record is used as follows. In one example of this embodiment, this record is used when creating a referral letter. For example, a physician who has received a request for a referral letter from a patient displays a list of coded images that are associated with the patient identification information from among the coded images generated and recorded in the information processing device 10. At this time, the information processing device 10 displays a list of title information recorded in association with each coded image as a list of coded images. The information processing device 10 may set the display order to the order of the associated date and time of examination.

[0070] The information processing device 10, when a physician (the user) selects information corresponding to the title of the code image to be presented from a list, outputs the code image corresponding to the selected title information according to the user's instructions. In this example, the code image is printed out along with the contents of a separately written referral letter and handed to the patient.

[0071] Upon receiving this referral letter, a physician or other medical professional at another medical institution uses an information processing device 10 installed at that institution to capture the printed coded image and acquire imaging data including the coded image. The information processing device 10 then decodes the coded image contained in the acquired imaging data to obtain the patient's examination information and the date and time of the examination, and incorporates this information into the electronic medical record.

[0072] Alternatively, the coded images recorded in the memory unit 12 can also be used to deliver information to the patient. In this case, the information processing device 10 displays a list of coded images associated with information identifying the patient (displays a list of title information recorded in association with each coded image), and when the user, a physician, selects the title information corresponding to the coded image to be presented from the list, the device displays and outputs the coded image corresponding to the selected title information.

[0073] The user, a physician, presents the displayed coded image to the patient, who then uses their own information processing device 10 to capture and acquire the coded image. The patient decodes the coded image using their own information processing device 10, obtains examination information, and records it. This record can be used by the patient to electronically manage, confirm, and manage their own condition.

[0074] (3) An example in which the information processing device 10 is implemented in an examination device installed in a medical institution, etc. If the information processing device 10 is implemented in the examination device 2, the examination information output by the examination device 2 itself can be encoded as an encoded image and output as is. As an example, in this embodiment, the information processing device 10 implemented in the examination device 2 obtains information that identifies the patient, etc., which will be output as a string, as the information of the string to be output as the target of encoding.

[0075] Furthermore, when the inspection device 2 produces an output as illustrated in Figure 3, even if it processes numerical information obtained through inspection (sensitivity information), such as sensitivity information (T), into image data for output, the numerical information before processing into image data may also be obtained as the target for encoding. Depending on the type of information, the image data generated based on the numerical information obtained through inspection may also be obtained as the target for encoding. For example, the information processing device 10 extracts the relevant portion of the gaze track (G) in the example of Figure 3 as image data and acquires the extracted image data as the target for encoding.

[0076] The information processing device 10 encodes the information to be encoded acquired here into a coded image as information of the examination results. The coded image obtained by encoding is then output to an electronic medical record system, etc., along with conventionally output data as illustrated in Figure 3, or the coded image is printed out. When printing, it may also be printed together with conventionally output data (for example, on the same page as this data), as illustrated in Figure 3.

[0077] In this example, the electronic medical record system allows for the acquisition of examination information via coded images. Furthermore, when printed, the output contains these coded images. By providing this to the patient, the patient can then image and decode the coded images to obtain the examination information. This allows the patient to electronically manage, verify, and track their own medical status.

[0078] [Information Compression Processing] Note that each type of coded image has an upper limit on the amount of information that can be encoded. Therefore, depending on the content of the inspection information to be encoded, it may not be possible to encode all of its content. In this embodiment, the information processing device 10 may perform information compression processing on a predetermined type of inspection information before generating the coded image.

[0079] Specifically, for string data, the information processing device 10 may perform information compression processing such as Deflate (RFC1951) or run-length encoding. For the graph output of the gaze track (G) exemplified in Figure 3, the information processing device 10 may perform information compression processing to reduce the amount of data, such as reducing the image data of the graph (i.e., reducing the number of pixels in at least one of the vertical or horizontal directions). This information compression processing by the information processing device 10 may differ depending on the type of image data (for example, grayscale images related to the sensitivity of visual field testing, total deviation image data, etc., or CT image data, MRI image data, etc.). In this case, the method of information compression processing may be predetermined for each type of image data.

[0080] Furthermore, the information processing device 10 may also perform compression processing on the image output. Specifically, the grayscale images included in the visual field test information illustrated in Figure 3, and the image outputs included in the total deviation and pattern deviation, represent the values ​​for each test point with pixel blocks of a predetermined image pattern. Since this image pattern is predetermined, the information processing device 10 associates unique code information with each different image pattern, replaces the pixel blocks at each test point with code information, and compresses them by representing them as a sequence of code information (for example, by arranging the test points in a predetermined order, and arranging the code information corresponding to the image pattern at the corresponding test point in the order of the arrangement of the test points). The information processing device 10 includes the compressed information as the target of encoding and generates a coded image.

[0081] The information processing device 10, which decodes the coded image generated in this manner, reconstructs the original image data using the compressed information obtained after decoding. Here, the compressed information includes coded information that identifies the image patterns to be placed at positions corresponding to each inspection point in the field of view. Therefore, the original image data can be reconstructed by referring to the coded information and placing the corresponding image patterns at positions corresponding to each inspection point in the field of view.

[0082] Furthermore, information from the examination data that does not affect the diagnosis may be discarded, and only the information that does affect the diagnosis may be encoded. For example, in the results of a dental examination, if the information can be compressed by comparing it with a normal example, the information processing device 10 may perform such compression. Specifically, regarding information representing the status of tooth decay (cavities), by encoding only the information of teeth where the decay is progressing, the information can be compressed compared to encoding the information of all teeth. When decoding the information in this example, teeth for which there is no information may be output as normal teeth.

[0083] The information processing device 10 may compress information not only in the case of teeth but also in general cases by extracting only information about the lesion in image data, etc., or by generating feature quantities such as statistical quantities based on data of the part necessary for diagnosis, such as the part where the lesion is located.

[0084] Furthermore, there are cases where, if one set of data falls within a certain range, the other set of data becomes unnecessary. In this case, the information processing device 10 may encode the data while retaining only one side of the data. For example, if the hemoglobin value is sufficiently high (exceeding a predetermined threshold), that data may be retained, while ferritin values, which are referenced when the hemoglobin value is relatively low to obtain specific anemia findings, may be deleted from the data to compress the information.

[0085] Furthermore, depending on the medical information represented by the image data, the detailed information represented by the image data may not always be necessary. For example, in renal dynamic scintigraphy images, the time-dependent changes in the amount of isotopes at the positions of the left and right kidneys and the bladder are relevant (Figure 5(a)). Therefore, it is conceivable to calculate the average values ​​of the image density (brightness) at the positions of the left and right kidneys (BLav, BRav) and the average value of the image density (brightness) at the bladder (BCav), and instead of the actual image, only this set of information [BLav, BRav, BCav] is to be encoded.

[0086] In this example, based on the information obtained by decoding the coded image, schematic image data, as illustrated in Figure 5(b), is reconstructed. In this example, the upper part of a vertically elongated rectangular region (simulating the area from the lower back to the buttocks of the human body) is divided into left and right regions (L, R), and another region is set in the center of the lower region (C). Image data may then be generated by setting the brightness of the upper left region L to BLav, the brightness of the upper right region R to BRav, and the brightness of the lower central region C to Cav.

[0087] Alternatively, the entire data may be compressed using Deflate (RFC1951) or run-length encoding (specifically, a dictionary-based compression method such as general ZIP compression is acceptable), and the compressed data may be converted to binary (using Base64 or similar methods) to generate an encoded image of the converted binary data.

[0088] Alternatively, the field of view data may be converted into a predetermined structured data format (e.g., string information in JSON format, or data in protocol buffer format), and then compressed along with the image data after binary conversion. A coded image may then be generated from the compressed data. Furthermore, the data that forms the basis of this coded image may be encrypted.

[0089] [Compression using a dictionary based on examination information] The data to be compressed includes multiple data elements (for example, if it is visual field data, it includes the sensitivity value for each examination point in the visual field). Alternatively, the frequency of occurrence of data elements included in previously obtained data can be examined, a code dictionary can be created such that the more frequently occurring elements have shorter codes, and the compression process can be performed using this code dictionary.

[0090] For example, if the values ​​of each test point can be represented by 4 bits in the results of visual field tests conducted on multiple people in the past, if the most frequent value is 0 dB, the code corresponding to this 0 dB is "0" (1 bit), if the next most frequent value is -12 dB, the code corresponding to this -12 dB is "10" (2 bits), and so on. A dictionary is generated that associates values ​​with codes by performing Huffman coding. The information processing device 10 then refers to this dictionary when compressing and decompressing the visual field data to encode and compress it (which may then be output as a coded image), and also restores the visual field data from the compressed data (which may be obtained by decoding the coded image).

[0091] However, this is just one example, and instead of encoding the data for each test point individually, the data for multiple test points could be encoded together, for example, using a code that represents that "eight test points with 0 dB are adjacent to each other (i.e., all test points arranged in a 3x3 grid are 0 dB)." In this example as well, the codes could be made shorter in order of frequency of appearance in past test cases.

[0092] Furthermore, the encoding method is not limited to Huffman coding; MH (Modified Huffman) coding used with run-length encoding may be used, or other encoding methods may be employed. In any case, a dictionary is generated that associates the data of the actual inspection points (multiple points may be included) with the encoding results, and this dictionary is shared (or made accessible) among multiple information processing devices 10. In this example as well, the information processing device 10 uses this dictionary to encode and compress the inspection data, such as field of view data (which may then be output as an encoded image), and then restores the original inspection data from the compressed data (which may be obtained by decoding the encoded image).

[0093] [Recording on the Server] In the description of this embodiment so far, the information processing device 10 has been described as storing the acquired inspection information and generated coded images in the storage unit 12 of the information processing device 10, but this embodiment is not limited to this example. For example, the information processing device 10 may store the acquired inspection information and generated coded images in the storage unit 12, or, instead of storing them in the storage unit 12, it may store them in a server 5 (a storage server capable of holding data) that can be accessed via a network.

[0094] In this example, the server 5 on the network is implemented using a general-purpose computer device. The server 5 receives patient identification information, along with examination information, examination date and time information, coded images, etc., from the information processing device 10, associates these with each other, and records them in a database. In this example, the server 5 stores and records the examination information, etc., as records in the database. In this example, each record is associated with reference information (for example, a record identifier such as a hash value based on the information within the record).

[0095] As already mentioned, when recording examination information, etc., on an external storage server such as Server 5, the examination information, etc., may be encrypted before recording. In this example, the reference information is not encrypted, but at least a portion of the patient identification information and examination information is encrypted. The selection of the encryption key and the encryption method may be the same as in the example already explained (in this case, the user of the information processing device 10 that recorded the information on Server 5 can retrieve and decrypt the information), and if the decryption key is provided to the extent necessary, the information processing device 10 of the user to whom the decryption key is provided will be able to retrieve the examination information, etc.

[0096] In this example, server 5 adds links (reference information) to previously recorded information to the information it accepts to be recorded, so that the history of test information and other data recorded for each patient identification can be easily accessed.

[0097] Specifically, as illustrated in Figure 6(a), server 5 maintains a data table T separately from database D, which associates patient identification information (or information in which at least a part of it is encrypted) P with reference information Ln (for convenience, referred to as the latest reference information) of record Rn, which contains the last recorded examination information and examination date and time information among the records Ri(P) (where i = 1, 2, ..., n) stored in database D for the patient identified by the above information P. Note that i and n are natural numbers.

[0098] When Server 5 receives patient identification information P, along with examination information, examination date and time information, etc., from the information processing device 10, it refers to data table T and obtains the latest reference information Ln associated with the patient identification information at that time. Server 5 adds this latest reference information Ln to the received examination information, examination date and time information, etc., and adds it to database D as a new record Rn+1(P), and also generates reference information Ln+1 for the newly added record. Server 5 records this generated reference information Ln+1 as the new latest reference information, associating it with patient identification information P (overwriting the previous latest reference information Ln) in data table T (Figure 6(b)).

[0099] At this time, the server 5 may also update record Rn(P) by appending the new reference information Ln+1 to record R referenced by the original reference information Ln (Figure 6(c)). In this way, records Ri(P) (i=1, 2, ..., n, n+1) containing examination information recorded with patient identification information P as the key are linked to each other in chronological order of the records (that is, the record referenced by reference information Ri will contain both the reference information Li-1 of the immediately preceding record Ri-1 and the reference information Li+1 of the immediately following record Ri+1).

[0100] When the server 5, which performs this processing, receives an instruction from the information processing device 10 to record information P that identifies the patient, it responds to the instruction by referring to the data table T and obtaining the latest reference information Ln associated with the patient identification information P. The server 5 then reads the record Rn(P) referenced by the latest reference information Ln from the database and sends it to the information processing device 10 that requested the recording.

[0101] On the other hand, when server 5 receives a request from information processing device 10 to record along with reference information Lj (j = 1, 2...) (i.e., when patient identification information P is not identified), server 5 responds to the request by reading the record Rj(X) referenced by the reference information Lj (a record relating to patient X whose details are unknown to the requester) from database D and sending it to information processing device 10 that requested the recording.

[0102] In this example of the embodiment, the information processing device 10, which causes the server 5 to record examination information, etc., holds at least patient identification information P and reference information L such as a URL for requesting the server 5 to record. The information processing device 10 also encodes information (hereinafter referred to as access information) that includes at least the patient identification information P and the reference information L such as the URL for requesting the server 5 to record (hereinafter referred to as access information), and generates an encoded image.

[0103] When using the information processing device 10 in this example, for example, the information processing device 10 owned by the medical institution generates an encoded image by encoding the access information along with the examination information, and presents it to the patient. The patient then reads this encoded image with the information processing device 10 owned by the patient, and the information processing device 10 owned by the patient decodes the read encoded image and obtains the access information along with the new examination information. Subsequently, the patient can also obtain past examination information by sending this access information to the server 5 and requesting that it be recorded.

[0104] In this example of the embodiment, the patient identification information P may include the patient's personal information such as name, address, and residence, or it may be encrypted personal information, or unique identification information for each patient generated independently of personal information. In this case, if the information is encrypted personal information, or generated independently of personal information, the examination information etc. recorded in the database D of the server 5 may be recorded without encryption. In this case, the information recorded in the database D may include attribute information such as age and gender, but it should not include personally identifiable information, or such personal information should be encrypted.

[0105] In this way, a user who knows the relationship between the patient's personal information that identifies the patient, such as the patient themselves or the doctor examining the patient, and the patient identification information P mentioned above, or a user of the information processing device 10 who has received a coded image of the patient identification information P encoded by such a user, will be able to obtain the patient's individual examination information, etc., from the server 5.

[0106] On the other hand, a user of the information processing device 10 who is unaware of the relationship between the patient's personal information that identifies an individual patient and the patient-identifying information P mentioned above can access attribute information such as age and gender, and specific patient test information (test information that is associated with common patient-identifying information, although the personal information is unknown), but cannot access the information that identifies the individual patient (sensitive information), and therefore cannot identify the individual patient. In other words, according to this example, a series of test information for each patient is recorded after the patient has been anonymized. Such records can be used for case studies and obtaining statistical information.

[0107] Furthermore, in the information processing device 10 according to this example, when inspection information is obtained, a portion of the inspection information may be stored in the storage unit 12 for encoding, and information including at least the portion of the inspection information that was not encoded may be recorded by the server 5. According to this example, relatively large image data can be recorded by the server 5, while relatively small string data can be encoded to generate an encoded image, thereby reducing the amount of information to be included in the encoded image.

[0108] Furthermore, in the description so far, the information processing device 10 has been described as acquiring and recording (by optical character recognition methods, etc.) examination information and examination date and time, or presenting them as coded images. However, this embodiment is not limited to this, and may also include information entered by a physician, such as disease name, medical history, current medical history, examination results, prescription details, and allergy information, which are described in referral letters and medical information reports.

[0109] As an example, an information processing device 10 installed at the medical institution issuing the referral letter may acquire and record at least a portion of the information entered by the doctor into the electronic medical record, and then encode it to obtain a coded image. This coded image does not need to be decodeable by the patient's information processing device 10, so it may be printed on paper, sealed, and delivered to another medical institution (the medical institution receiving the referral letter) via the patient. In this case, an information processing device 10 installed at the medical institution receiving the referral letter reads and decodes the coded image printed on the paper and obtains the test information, etc. This obtained test information, etc. is imported into the electronic medical record system of the medical institution receiving the referral letter.

[0110] [Explanatory Information] Furthermore, according to this embodiment, regardless of whether medical information such as test results is output as text strings, images, or graphs, the information processing device 10 acquires text string data, numerical data, etc., through recognition processing such as OCR, making it possible to process this data.

[0111] For example, the information processing device 10 may perform the following simulation processing based on numerical data (sensitivity information at each test point in the visual field) obtained from the visual field test information. That is, the information processing device 10 in this example of the embodiment may, with respect to predetermined image data (for example, a landscape image prepared in advance, or the user of the information processing device 10 may specify and use image data obtained by taking a photograph themselves), cut out a predetermined circular area C around a fixed point P on the image data, as illustrated in Figure 7(a).

[0112] In this case, the circular area may be determined based on the field of view angle represented by the visual field test information (such as a range of 10 degrees around the fixation point or 30 degrees around the fixation point). Since image data captured by recent smartphones and the like includes focal length information, the field of view is estimated from this focal length information, and a circular area is set that is estimated to correspond to the field of view angle represented by the visual field test information within the estimated field of view. For example, if the image data is captured with a focal length setting of 50 mm, the field of view is estimated to be approximately 45 degrees. If the size of this image data is height h and width w, and h > w, the center of this image data is set as the center position, and a circular area with radius 2w / 3 (= 30w / 45) is set as a range of 30 degrees around the fixation point. This setting does not necessarily correspond to the actual field of view.

[0113] The information processing device 10 further modifies the brightness of the image data within the circle obtained by cropping this circular area, according to the sensitivity information, for each inspection point of the visual field test, and generates adjusted image data.

[0114] Specifically, assuming that the image within the cropped circle represents the entire field of view, the information processing device 10 virtually overlays the sensitivity information T (exemplified in Figure 7(b)), which is the result information of the field of view examination, by aligning its center, and sets the brightness value of each pixel in the image within the circle based on the sensitivity information of its nearest inspection point. For example, if the brightness value of a pixel in the original image is B, the information processing device 10 does not change the portion where the sensitivity of the nearest inspection point is 30 dB or higher, but if the sensitivity s of the nearest inspection point is less than 30 dB, it corrects the brightness value B by multiplying it by (s / 30), so that the brightness value decreases as the sensitivity s decreases (i.e., the sensitivity is lower) (Figure 7(c)).

[0115] In addition, in the results of the visual field test (if the visual field test is performed correctly), the test point in the visual field corresponding to Mariotte's blind spot will have a low sensitivity value (or a value indicating that nothing is visible), but since patients generally view with both eyes, they do not recognize this Mariotte's blind spot. Therefore, in this embodiment, the information processing device 10 may choose not to perform the above brightness value correction for the test point corresponding to Mariotte's blind spot (M in Figure 7(c)).

[0116] In this example, the information processing device 10 performs a visual field simulation using the examination information, but it is not limited to this example. Alternatively, it may generate visual field information (sensitivity information) predicted for a specified number of years later based on the examination information, and use this generated predicted visual field information to perform the above simulation processing.

[0117] Furthermore, the image data used in the above processing by the information processing device 10 is not limited to still images, but may also be moving image data. Since moving image data includes a series of still images, when using moving image data, the information processing device 10 can sequentially apply the brightness value correction process to each of the series of still images and display the series of still images with corrected brightness values ​​in sequence.

[0118] Such simulations and other processes for explaining test information to the patient are not limited to the visual field test example described above. For example, hearing could be represented visually, with representative sound sources listed for each frequency band, and the ease with which each sound is heard could be shown in a graph (a graph representing the test results). For instance, representative sound sources such as a dog barking at 100 Hz, a truck driving at 200 Hz, and a time signal around 400 Hz could be shown, and the ease with which each sound is heard could be displayed in a graph based on the test information.

[0119] This makes it possible to display the actual symptoms represented by the test information in a way that is easy for the patient to understand. Note that this is just one example of a visual field test; the information processing device 10 may also play sounds that are audible or inaudible based on the results of a hearing test, or it may display general information regarding blood test results (such as the range of normal values).

[0120] Furthermore, if the string data or numerical data acquired through recognition processing such as OCR includes data that can be used to predict the future progression of symptoms and prognosis, the information processing device 10 may use this data to acquire or generate information predicting the progression of symptoms and prognosis and present it to the user.

[0121] For example, if the visual field test results include the MD slope value (the change in MD value, which represents the degree of visual field loss compared to a normal person), the future visual field may be predicted and displayed using this MD slope value.

[0122] Furthermore, as in the example already explained, if past examination information, etc., is stored on server 5, and past examination information relating to a specific patient can be obtained from server 5 using access information, etc., and if information on the time-series changes in examination information can be obtained, the information processing device 10 may use the obtainable time-series change information to generate information predicting the future progression of symptoms and prognosis.

[0123] Specifically, the information processing device 10 may perform a process to estimate the future visual field based on the changes in past visual field test information (for example, a process disclosed in Japanese Patent No. 6053574).

[0124] In this example as well, the information processing device 10 can predict future symptom progression and prognosis, but may also predict changes in hearing, or predict the prognosis for infectious diseases, etc.

[0125] [Example of incorporating patient-side records] Furthermore, if the patient-side information processing device 10 records information related to the patient's own treatment, the information processing device 10 may include information related to the patient's own treatment among the information encoded as the coded image when presenting coded images related to past examination information, etc., to the doctor, etc.

[0126] For example, if a patient uses an information processing device 10 to record information about medications they have taken or used (referred to as patient-side recorded information), the information processing device 10 generates an encoded image based on the examination information recorded at the instruction of the user patient. The device includes this recorded patient-side recorded information in the information to be encoded when generating the encoded image.

[0127] Here, patient-side record information includes, for example, each time a drug is taken, used as eye drops, applied topically, or otherwise used (hereinafter referred to as "taking, etc."), the following: drug type information indicating the type of drug taken, etc.; dosage information indicating the amount taken, etc.; and date and time information indicating the date and time of taking, etc.

[0128] In this example of the embodiment, the medical institution receives the above-mentioned coded image from the patient, reads it with the information processing device 10 installed at the medical institution, and decodes the examination information and patient record information. This makes it possible to acquire not only information on past examination results but also records of the patient's own medication use, etc., and incorporate them into a system such as an electronic medical record.

[0129] [Example of generating two or more coded images] Furthermore, when the information processing device 10 generates coded images, the number of coded images to be generated is not limited to one. For example, if the size (amount of information) of the information to be encoded exceeds the size of the information that can be represented by a single coded image, the information to be encoded may be divided into two or more parts, and coded images corresponding to each part may be generated and output.

[0130] For example, when a patient captures an image of the test results presented by a doctor using their own information processing device 10, and the information processing device 10 extracts string data or image data from the captured image using OCR or other processing to be encoded, the information processing device 10 determines the size (amount of information) Z of the information to be encoded. The information processing device 10 includes, in addition to the data corresponding to the OCR processing result performed on the captured data, information representing the date and time the test was performed (test date and time) in the data to be encoded.

[0131] The information processing device 10 also divides the amount of information Z obtained above by the size z of the information that can be represented by one coded image to be generated, and finds the smallest integer N that exceeds Z / z. The information processing device 10 divides the data to be encoded into N subdata (each with a size of z or less), encodes each subdata, and generates the corresponding coded image (a total of N coded images).

[0132] The information processing device 10 then records the N coded images generated above in the storage unit 12, associating them with information representing the inspection date and time and title information.

[0133] The patient uses this record to communicate it, for example, to a doctor at another medical institution. That is, the patient operates the information processing device 10 to display the recorded coded images. In this example of the embodiment, the information processing device 10, following the instructions of the user (the patient), displays a list of title information associated with the recorded coded images and prompts the user to select a coded image to present. At this time, the information processing device 10 may display the list of title information in the order of the associated examination date and time.

[0134] When a user selects a title from the list that corresponds to the code image they wish to present, the information processing device 10 displays the code image associated with the selected title, in accordance with the user's instructions. If there are multiple (N) code images corresponding to the selected title, the information processing device 10 displays all N code images simultaneously or sequentially. The user then presents the displayed code images (multiple code images, if any) to a doctor or other medical professional at the healthcare facility.

[0135] In this example, a physician or other medical professional at a medical institution, upon receiving a coded image, uses the information processing device 10 installed at the medical institution to capture the displayed coded image. If multiple coded images are presented, the information processing device 10 installed at the medical institution will capture all of the multiple coded images simultaneously or sequentially.

[0136] The medical institution's information processing device 10 decodes the coded images (all of them if there are multiple) contained in the image data acquired by imaging, and obtains the patient's examination information and the date and time of the examination. The medical institution's information processing device 10 then incorporates this examination information and the date and time of the examination as information in the electronic medical record.

[0137] According to this example of the embodiment, even relatively large image data can be exchanged using multiple coded images, thereby enabling the sharing of medical information.

[0138] Furthermore, when generating multiple coded images in this manner, the information processing device 10 may, instead of dividing the data corresponding to each coded image according to the size of the information, divide it in advance as follows, and then further divide the divided data according to the size z of the information that can be included in a single coded image. That is, the information processing device 10 may divide the data to be represented using multiple coded images into data that includes patient personal information (sensitive information) such as the patient's name, address, and residence, and patient-specific identification information (information not related to sensitive information), and data such as examination information (or a URL for obtaining examination information) along with patient-specific identification information (data not related to sensitive information).

[0139] In this example, the information processing device 10 encrypts (or compresses and encrypts) data containing sensitive information before encoding it into a coded image, and generates coded images for data that does not contain sensitive information as is (or after compression only). At the same time, the information processing device 10 provides the patient, their attending physician, or other persons authorized by the patient with the decryption key information (called the decryption key) for decrypting the encrypted data as a separate coded image (called the decryption key image). The persons who have obtained the decryption key image (including the patient) keep this image confidential.

[0140] The information processing device 10, which decodes the coded images generated in this way, decodes the coded images (all of them if there are multiple) to obtain the patient's examination information and the date and time of the examination. However, a user of the information processing device 10 who does not receive the decryption key image for decrypting the encrypted data can access attribute information such as age and gender, and examination information of a specific patient (examination information that is associated with information that identifies a common patient, although personal information is unknown), but cannot access information that identifies the individual patient (sensitive information), and therefore cannot identify the individual patient.

[0141] On the other hand, a user of the information processing device 10, who has received a decryption key image in order to decrypt encrypted data, can decrypt the decryption key image to obtain the decryption key and also decrypt the encrypted data. This makes it possible to obtain sensitive information that identifies the individual patient, along with attribute information such as the patient's age and gender, and the patient's examination information (examination information that is associated with information that identifies a common patient, although personal information is unknown).

[0142] In this example, as with the case via server 5, a series of examination information for each patient can be provided as anonymized patient information via coded images, which can be used for case studies and obtaining statistical information. Furthermore, even with the same coded image, if a decryption key image is provided, it can be used for information transfer between medical institutions.

Claims

1. An information processing device comprising: an acquisition means for acquiring patient examination information output by a medical examination device; a generation means for generating a computer-readable coded image based on the examination information; and a coded image presentation means for presenting the generated coded image.

2. An information processing device according to claim 1, wherein the acquisition means applies optical recognition processing to image data in which inspection information has been captured to acquire the inspection information as a target for encoding, and the generation means generates a computer-readable coded image based on the inspection information that has been the target for encoding.

3. An information processing apparatus according to claim 2, wherein the acquisition means extracts image data contained in the imaging data by optical recognition processing, compresses the extracted image data and makes it subject to encoding, and the generation means generates a computer-readable coded image based on the compressed image data that has been subject to encoding.

4. An information processing apparatus according to claim 3, wherein the generation means performs information compression processing using an information compression processing method determined for each type of image data included in the inspection information.

5. An information processing device according to claim 3, wherein the inspection information is inspection information relating to a visual field test, and the generating means recognizes the image patterns within a grayscale image that represents sensitivity in a visual field using a plurality of predetermined image pattern pixel blocks, and expresses the grayscale image as a sequence of code information associated with each of the recognized image patterns, and performs information compression processing.

6. An information processing apparatus according to claim 1, further comprising recording means for accumulating and recording the acquired inspection information.

7. An information processing device according to claim 6, wherein the recording means stores and records the acquired inspection information and records reference information of the recorded inspection information.

8. An information processing device comprising: means for reading a computer-readable coded image generated based on patient examination information output by a medical examination device; means for decoding the read coded image; and means for presenting the decoded information and predetermined explanatory information generated based on the information to a user.

9. A program that causes a computer to function as: an acquisition means for acquiring patient examination information output by a medical examination device; a generation means for generating a computer-readable coded image based on the examination information; and a coded image presentation means for presenting the generated coded image.

Images