Information systems, information processing methods, and programs

Abstract

To provide a technique that reduces the burden of work of associating information about a patient with an image obtained by photographing the patient.SOLUTION: An information system includes: a control device capable of communicating with an electronic medical record terminal and including first acquisition means for acquiring first information about a first patient from the electronic medical record terminal in response to a change in a display target patient of an electronic medical record to the first patient on the electronic medical record terminal; and associating means for associating the first information with a first image taken by a specific imaging device capable of communicating with the control device between when the display target patient is changed to the first patient and when the display target patient is changed to another patient.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to an information system, an information processing method, and a program.

Background Art

[0002] An imaging device or an imaging system that captures an image of an affected part of a subject (patient) to record the progress or assist in diagnosis is known. Patent Document 1 discloses an imaging processing system that assigns information based on the state of an affected part of a subject (for example, the main complaint of the patient and the findings of the photographer, etc.) to image data generated by imaging processing.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In a medical field or the like, some work is required to manage information related to a patient (such as the patient's name) in association with an image obtained by photographing the patient. In the conventional techniques including Patent Document 1, since a doctor or a photographer etc. had to identify the patient and associate the information related to the patient, the association work was a relatively laborious work.

[0005] The present invention has been made in view of such a situation, and an object thereof is to provide a technique for reducing the burden of the work of associating information related to a patient with an image obtained by photographing the patient.

Means for Solving the Problems

[0006] In order to solve the above problems, the present invention It is an information system,The system comprises a control device that can communicate with an electronic medical record terminal, including a first acquisition means for acquiring first information about the first patient from the electronic medical record terminal in response to the electronic medical record terminal being changed to a first patient, and an association means for associating the first information with a first image taken by a specific imaging device that can communicate with the control device between the time the patient to be displayed is changed to the first patient and the time it is changed to another patient. The control device includes a transmitting means for transmitting the first information to the specific imaging device in response to the acquisition of the first information, the specific imaging device is included in the information system and includes a receiving means for receiving the first information from the control device, and the association means is included in the specific imaging device and associates the first information received from the control device with the first image. We provide an information system characterized by [this feature]. [Effects of the Invention]

[0007] According to the present invention, it is possible to reduce the burden of associating information about a patient with images obtained by photographing that patient.

[0008] Further features and advantages of the present invention will become clearer from the accompanying drawings and the description of the embodiments for carrying out the invention below. [Brief explanation of the drawing]

[0009] [Figure 1] A diagram showing the configuration of a medical imaging system. [Figure 2] A block diagram showing a digital still camera operating as an imaging device 101. [Figure 3] A block diagram showing a computer operating as the imaging system control device 106. [Figure 4] A flowchart of the image processing steps in the image capture system. [Figure 5] A diagram showing the imaging device 101 viewed from the rear. [Figure 6] A diagram showing an example of a warning message during the image capture process. [Figure 7] This figure shows the display state of the display unit 204 of the imaging device 101 when medical record information has been erased. [Figure 8] A diagram showing the configuration of the imaging system for the transport system. [Figure 9]A flowchart illustrating the process (recording process) for recording equipment malfunctions and other issues using a photography system for transport systems. [Figure 10] A diagram showing an example of device information displayed on the imaging device 101. [Figure 11] A flowchart of the imaging process in an imaging system that may include multiple imaging devices 101. [Figure 12] A flowchart of the recording process in a transport system that may include multiple imaging devices 101. [Modes for carrying out the invention]

[0010] The embodiments will be described in detail below with reference to the attached drawings. Note that the following embodiments do not limit the invention as defined in the claims. While the embodiments describe multiple features, not all of these features are essential to the invention, and the features may be combined in any way. Furthermore, in the attached drawings, identical or similar configurations are given the same reference numerals, and redundant descriptions are omitted.

[0011] [First Embodiment] This embodiment describes an imaging system used in a medical setting to photograph a patient's affected area and support diagnosis. For example, the imaging system of this embodiment is used by a physician to photograph the affected area and to store the image data of the affected area with metadata such as photographer information and patient information attached.

[0012] In the description of this embodiment, it is assumed that an imaging device (digital camera) capable of capturing visible light is used, but the type of the imaging device is not particularly limited. As other examples of the imaging device, a multi-spectral camera capable of capturing different wavelength regions according to medical treatment purposes and imaging purposes, a polarization camera having a polarizer that transmits only light vibrating in a certain direction, and an infrared camera capable of capturing the infrared to near-infrared region can be mentioned. As still other examples, a three-dimensional shape measurement camera capable of capturing a three-dimensional shape, a microscope-type camera, a dermoscope (skin magnifier)-type camera, and a camera having a plurality of the above-described imaging functions can be mentioned.

[0013] ●System Configuration FIG. 1 is a diagram showing the configuration of a medical imaging system. The imaging system in FIG. 1 includes a function as an information system that performs processing (information processing) for associating information related to a patient with a captured image. In the imaging system, the imaging device 101 captures a subject (for example, the affected part 107 of a patient) to generate image data. In the following description, it is assumed that the image data captured by the imaging device 101 is visible light image data. The imaging device 101 is a portable small imaging device similar to a commercially available digital camera, and is provided with a display device capable of confirming the captured image, and interfaces such as buttons and a touch panel for various operations.

[0014] The network 102 is a communication network that enables communication between devices in the imaging system. Although the electronic medical record terminal 104 does not include the word "device", in the general term "device" used in this specification, the electronic medical record terminal 104 is included as long as there is no technical contradiction.

[0015] For example, when the imaging device 101 is powered on by the photographer, it connects to the network 102 and can communicate with other devices in the imaging system via the network 102. The network 102 performs wireless data transmission, wired data transmission, and various controls. The communication protocol used for communication via the network 102 is not particularly limited, and examples include Hypertext Transfer Protocol (HTTP) and File Transfer Protocol (FTP). As other examples, Picture Transfer Protocol (PTP), Universal Serial Bus (USB), and Local Area Network (LAN) can be mentioned. As still other examples, Health Level Seven (HL7) and Digital Imaging and Communications in Medicine (DICOM) can be mentioned. Any communication protocol may be used as long as communication of image data, text, control data, etc. is possible.

[0016] In this embodiment, each device including the imaging device 101 shall maintain a continuously communicable state until the power is turned off. Also, although the connection and communication methods regarding the imaging device 101 and the network 102 have been described in detail above, the same applies to various devices such as the electronic medical record management device 103, the electronic medical record terminal 104, the image management device 105, and the imaging system control device 106. Also, although not shown in FIG. 1, an illumination device composed of halogen illumination, light-emitting diode illumination, etc. may be provided together for photography as needed.

[0017] The electronic medical record management device 103 stores patient information (ID, name, medical department, age, gender, medical history, lesions, etc.) and physician information (ID, name, affiliation information such as medical department, etc.). The electronic medical record management device 103 can verify and authenticate physician login / logoff information entered into the electronic medical record terminal 104, provide physician information to the electronic medical record terminal 104, and provide patient information to the electronic medical record terminal 104 in the form of an electronic medical record. In addition, the electronic medical record management device 103 can store data updated by the electronic medical record terminal 104. The electronic medical record management device 103 can be implemented as a personal computer (PC), an in-hospital server, or a cloud server. The electronic medical record terminal 104 can be accessed via the network 102 when necessary.

[0018] During a doctor's examination of a patient, the electronic medical record terminal 104 downloads the logged-in doctor's information and the patient's information from the electronic medical record management device 103 to provide electronic medical record functionality. This enables the display, editing, and updating of the electronic medical record.

[0019] The image management device 105 can store, update, and delete image data, as well as photographer information and patient information linked to the image data. The image management device 105 also includes data retrieval functions as needed.

[0020] The imaging system control device 106 acquires the aforementioned photographer information and patient information from the electronic medical record terminal 104 and transmits the acquired information to the imaging device 101. When imaging, the imaging device 101 can temporarily store the photographer information and patient information transmitted from the imaging system control device 106 along with the image data. Subsequently, the imaging system control device 106 detects various events such as imaging events of the imaging device 101 and receives various data linked to the captured image data. The imaging system control device 106 transmits the received image data and other various data to the electronic medical record terminal 104 and the image management device 105. Details of the processing performed by the imaging system control device 106 and the imaging device 100 will be described later.

[0021] Furthermore, the imaging system control device 106 may perform image processing on the image data received from the imaging device 101 according to the purpose of the examination (e.g., thumbnail extraction, data compression, pathology estimation, etc.). The imaging system control device 106 can also display the results of the image processing on the display unit 304 described later, or transmit the results of the image processing to the electronic medical record terminal 104 via the network 102 for display on the electronic medical record terminal 104. The imaging system control device 106 may also transmit the results of the image processing to the imaging device 101 for display on the display unit 204 of the imaging device 101. The imaging system control device 106 may also transmit the processed image data to the image management device 105. By configuring the imaging system control device 106 in this way, users of the imaging system can check the image data during imaging and check the image processing results of the captured patient images during medical treatment.

[0022] In this embodiment, the imaging device 101, the electronic medical record management device 103, the electronic medical record terminal 104, the image management device 105, and the imaging system control device 106 are described as separate devices, but this embodiment is not limited to this configuration. For example, at least a portion of the electronic medical record terminal 104, the electronic medical record management device 103, the imaging system control device 106, and the image management device 105 may be constructed in the same housing, thereby realizing the functions of two or more devices in a single device. In this way, a system with an appropriate cost can be configured to match the load and capacity required by the system.

[0023] ●Configuration of imaging device 101 A digital still camera operating as an imaging device 101 will be described using Figure 2. Figure 2 is a block diagram showing a digital still camera operating as an imaging device 101. The digital still camera functions as an imaging device 101 by executing a predetermined control program to perform the imaging process described below.

[0024] 200 is the imaging unit, which uses a solid-state image sensor to read an optical image and generates electrical image data through analog-to-digital conversion.

[0025] 201 is the CPU that controls the entire imaging device 101.

[0026] 202 is a read-only memory (ROM) that stores the operating procedures of the CPU 201 (for example, programs for processing when the power of the imaging device 101 is turned on and basic input / output processing).

[0027] 203 is Random Access Memory (RAM) and functions as the main memory (primary temporary storage) of the CPU 201. Note that the main memory of the CPU 201 may be a different storage device than RAM. For example, the main memory may be composed of non-volatile memory devices such as Read-Only Memory (ROM) or Electrically Erasable Programmable Read-Only Memory (EEPROM). Another example is the main memory being composed of a file area or virtual memory area on an external storage device (not shown) connected via a network. Various programs, including control programs for implementing the processes described later, are loaded into RAM 203 from ROM 202, etc., and executed by the CPU 201. RAM 203 also provides a work area for the CPU 201 when executing various processes.

[0028] 204 is a display unit that performs various displays under the control of the CPU 201. For example, the display unit 204 may display data stored in the ROM 202, RAM 203, or media drive 206, etc. The display unit 204 may also display live view images captured by the imaging unit 200, captured images captured by the imaging unit 200 in response to the release button being operated and a shooting command being input, and various setting screens.

[0029] 205 is an input unit that includes buttons and other controls for performing various operations. These buttons and controls include, for example, the release button located on the top of the imaging device 101, and the directional keys and setting keys located on the back. The touch panel and other controls provided on the display unit 204 are also included in the input unit 205. The user (photographer) can input various instructions to the imaging device 101 by operating the input unit 205.

[0030] 206 is a media drive and includes a mounting section for inserting a removable storage medium. The media drive 206 enables the storage medium to store data and to read stored data.

[0031] 207 is a network interface (communication unit). The imaging device 101 sends and receives data to and from a server computer or personal computer via the network interface 207.

[0032] 208 is the system bus (including the address bus, data bus, and control bus) that connects each of the aforementioned units.

[0033] 209 is a wired or wireless communication line.

[0034] 210 is a computer network. The imaging device 101 is connected to the computer network 210 via a communication line 209.

[0035] 211 is the image processing unit. The CPU 201 temporarily stores the image data and its attribute information generated by the imaging unit 200 in the RAM 203. Then, as needed, the image processing unit 211 performs a series of image processing operations to obtain image data suitable for the shooting purpose, such as data containing human visual characteristics, 3D data, or both. Furthermore, if the processing load is large, the image processing unit 211 may divide the data processing and share the processing with the shooting system control device 106.

[0036] 212 is a file generation unit. For example, the file generation unit 212 converts image data into a general-purpose still image format to generate an image file.

[0037] ●Configuration of the imaging system control device 106 Figure 3 illustrates the computer operating as the imaging system control device 106. Figure 3 is a block diagram showing the computer operating as the imaging system control device 106. The computer executes a predetermined control program to perform the processes described below and functions as the imaging system control device 106. The computer may be located and function on a server, such as within a local network or in the cloud.

[0038] 301 is the CPU that controls the entire imaging system control device 106.

[0039] 302 is a ROM that stores the operating procedures of the CPU 301 (for example, programs such as the startup process and basic input / output processing of the imaging system control device 106).

[0040] 303 is RAM and functions as the main memory of the CPU 301. Various programs, including control programs for implementing the processes described later, are loaded into RAM 303 from the HDD 305 (hard disk drive), etc., and executed by the CPU 301. In addition, RAM 303 provides a work area for when the CPU 301 executes various processes.

[0041] 304 is a display unit that performs various displays under the control of the CPU 301.

[0042] 305 refers to a hard disk drive (HDD), which is used for storing and reading application programs, data, and libraries.

[0043] 306 is the input section, which includes a pointing device and a keyboard.

[0044] 307 is a media drive and includes a mounting section for inserting a removable storage medium. The imaging system control device 106 can read data captured by the imaging device 101 and stored on the storage medium via the media drive 307.

[0045] 308 is a network interface (communication unit). The imaging system control device 106 transmits and receives data to and from external devices via the network interface 308. In this embodiment, the imaging system control device 106 is connected to the imaging device 101 via the network interface 308. The CPU 301 then transmits and receives various data to and from the imaging device 101, acquires images captured by the imaging device 101, and records them in the HDD 305.

[0046] 309 is the system bus (including the address bus, data bus, and control bus) that connects each of the aforementioned units.

[0047] 310 is a wireless or wired communication line.

[0048] 311 is a computer network. The imaging system control device 106 is connected to the computer network 311 via a wireless or wired communication line 310.

[0049] ●User interface of imaging device 101 Figure 5 shows the imaging device 101 as viewed from the rear. Referring to Figure 5, the various buttons and user interface details of the imaging device 101 will be explained. For all buttons except the power button 501, the operation will be explained when the imaging device 101 is powered on.

[0050] 501 is a power button that switches the power ON / OFF. When the imaging device 101 is not powered on, if the photographer presses the power button 501, the CPU 201 determines that the photographer has instructed the photographer to turn the power ON and turns on the power. When the power is already on, if the photographer presses the power button, the CPU 201 determines that the photographer has instructed the photographer to turn the power OFF and turns off the power.

[0051] 502 is the shutter release button. When the photographer presses the shutter release button 502, the CPU 201 determines that a still image capture command has been issued.

[0052] 503 is the up button, 504 is the right button, 505 is the down button, 506 is the left button, and 507 is the select button. These buttons perform the functions of the input unit 205.

[0053] When the photographer presses one of the buttons indicated by symbols 503 to 506, the CPU 201 determines that the photographer has given an instruction to switch the selected object and switches the selected object on the display 508, which will be described later. When the photographer presses the OK button 507, the CPU 301 determines that the photographer has given a OK instruction and stores the selected information in the RAM 303, and also switches the state of the imaging device 101.

[0054] 508 is a display and implements the functions of the display unit 204. In the example in Figure 5, the display 508 displays an image of the patient's affected area 107. The display 508 may also have a touch panel function in addition to the display function and implement the functions of the input unit 205. In that case, when the photographer touches any point on the screen with their finger, the CPU 201 determines that there has been an input instruction from the photographer, determines the content of the operation from the touched position, and performs various processes such as display updates and setting updates. For example, an OK button 511, a Cancel button 512, an Exit button 513, etc. may be placed on the screen, and a configuration may be adopted in which the photographer's instructions are input via these buttons.

[0055] 509 is an example of patient information display. In the example in Figure 5, the patient's name, gender, and age are displayed. By displaying patient information superimposed on the subject image during shooting in this way, the physician can avoid making mistakes in associating patient information with the patient being photographed. In this embodiment, patient information is received from the shooting system control device 106 along with physician information. 510 is the date and time information of the shooting. The display 508 may also display physician information as photographer information, and the displayed information may be switched according to the hospital's operational status and priority.

[0056] ● Shooting and processing flow Figure 4 is a flowchart of the imaging process in the imaging system. The imaging process is performed, for example, to record the patient's injury or illness. In the following explanation, the person taking the image is assumed to be a physician, but the person taking the image may be a technician, assistant, or nurse designated by the physician. Prior to performing the imaging process, the physician is assumed to have logged in to the electronic medical record terminal 104. When the physician logs in to the electronic medical record terminal 104, the electronic medical record terminal 104 obtains patient information (ID, name, department, age, gender, medical history, lesions, etc.) and physician information (ID, name, department affiliation information, etc.) from the electronic medical record management device 103. The electronic medical record terminal 104 can then display the electronic medical record based on the information obtained from the electronic medical record management device 103.

[0057] The imaging process includes processing by the imaging device 101 and processing by the imaging system control device 106. Unless otherwise specified, the processing by the imaging device 101 is achieved by the CPU 201 of the imaging device 101 executing a control program. Unless otherwise specified, the processing by the imaging system control device 106 is achieved by the CPU 301 of the imaging system control device 106 executing a control program.

[0058] The division of processing tasks between devices in the imaging system is not limited to the divisions shown in the following description and Figure 4. For example, the processing described below as being performed by the imaging device 101 may be performed by other devices such as the imaging system control device 106 or the electronic medical record terminal 104, if technically possible. Also, multiple devices may perform the same processing. For example, the processing described below as being performed by the imaging device 101 may be performed by both the imaging device 101 and the imaging system control device 106, if technically possible.

[0059] In S402, the CPU 301 of the imaging system control device 106 determines whether the patient whose electronic medical record is displayed on the electronic medical record terminal 104 (the patient whose electronic medical record is to be displayed) has changed. In this embodiment, the physician can select the patient whose electronic medical record is to be displayed by operating the electronic medical record terminal 104. Therefore, a change in the patient whose electronic medical record is to be displayed occurs in accordance with the selection of the patient whose electronic medical record is to be displayed by the physician. The CPU 301 repeatedly performs the determination in S402 until the patient whose electronic medical record is to be displayed has changed, and proceeds to S403 in accordance with the change in the patient whose electronic medical record is to be displayed.

[0060] Furthermore, the specific configuration for achieving the S402 determination is not particularly limited, and any appropriate configuration can be adopted depending on the practices of the source or policy of the recipient when introducing the imaging system, or the protocol used to connect devices in the imaging system. For example, the electronic medical record terminal 104 may notify the imaging system control device 106 of changes in the patients to be displayed via the network 102. In this case, the CPU 301 of the imaging system control device 106 can determine that the patients to be displayed have changed upon receiving the notification from the electronic medical record terminal 104. As another example, the CPU 301 of the imaging system control device 106 may determine whether or not the patients to be displayed have changed by monitoring and detecting changes in the patients to be displayed on the electronic medical record terminal 104. In this case, for example, the CPU 301 of the imaging system control device 106 may monitor and detect changes in the patients to be displayed by monitoring the screen of the electronic medical record terminal 104.

[0061] In S403, the CPU 301 obtains information (first information) regarding the changed target patient (the patient whose electronic medical record is now displayed) from the electronic medical record terminal 104 and transmits it to the imaging device 101. The information regarding the target patient obtained here is not particularly limited, but in the following explanation, it will be assumed to be the information (medical record information) recorded in the target patient's electronic medical record. Examples of medical record information include physician ID, physician's name, medical department, patient ID, patient's name, age, gender, medical history, imaging history, affected area, and lesion. In the following explanation, it will be assumed that the medical record information obtained here includes physician ID, patient ID, patient's name, age, and gender.

[0062] In the imaging system, the patient being imaged is highly likely to be the patient whose electronic medical record is displayed on the electronic medical record terminal 104 at the time of imaging (the patient whose electronic medical record is displayed at the time of imaging). Taking this into consideration, the imaging process in Figure 4 is configured such that, when the patient whose record is displayed changes, the CPU 301 of the imaging system control device 106 acquires information about the changed patient whose record is displayed (the first patient) from the electronic medical record terminal 104. This makes it possible to easily associate information about the patient being imaged with the image obtained through imaging, and reduces the burden of the association work.

[0063] In S404, the CPU 201 of the imaging device 101 displays at least a portion of the medical record information received from the imaging system control device 106 on the display unit 204. In the example in Figure 5, as described above, the patient's name, gender, and age are displayed on the display 508 of the display unit 204 (see patient information display 509). The user (imaging operator such as a doctor) confirms that the patient indicated by the medical record information displayed on the display unit 204 matches the patient being imaged. If the patient indicated by the medical record information matches the patient being imaged, the user selects the OK button 511. If the patient indicated by the medical record information does not match the patient being imaged, the user selects the Cancel button 512. A mismatch between the patient indicated by the medical record information and the patient being imaged can occur, for example, if the doctor forgets to switch the target patient for display in the electronic medical record terminal 104, or if the correct medical record information is not sent to the imaging device 101 due to a communication error in the imaging system.

[0064] In S405, the CPU201 determines the result of the user's button selection. If the OK button 511 is selected, the process proceeds to S407; if the Cancel button 512 is selected, the process proceeds to S406.

[0065] In S406, the CPU 301 of the imaging system control device 106 displays a user interface for modifying medical record information on the display unit 304. The user performs the necessary modifications on the user interface displayed on the display unit 304. This updates the information in the electronic medical record. The process then proceeds to S403, where the CPU 301 of the imaging system control device 106 transmits the updated medical record information to the imaging device 101. By providing this configuration, which allows the user to check and modify (update) medical record information (such as patient information) as needed, it is possible to prevent errors in linking the image data of the patient being photographed with the patient's medical record information.

[0066] In this description, we have explained a configuration in which the user modifies medical record information on the user interface displayed on the display unit 304 of the imaging system control device 106. However, a configuration may also be adopted that allows the user to perform the same operation on the display unit of the electronic medical record terminal 104 or the display unit 204 of the imaging device 101.

[0067] In S407, the CPU 201 of the imaging device 101 performs the shooting process in response to the user pressing the release button 502. The image data obtained by shooting is temporarily stored in the RAM 203, ROM 202, or media drive 206, etc.

[0068] In S408, the CPU 201 adds the medical record information transmitted from the imaging system control device 106 in S403 as metadata to the image data captured in S407. This links the image data and the medical record information. The method of linking is not particularly limited, but for example, the CPU 201 can write the medical record information to the metadata area of ​​the image data. Alternatively, the CPU 201 may control the file generation unit 212 to generate a metadata file containing the medical record information, thereby associating the image data file with the metadata file.

[0069] In this example, the CPU 201 of the imaging device 101 is responsible for associating medical record information (metadata) with the captured images. However, instead of the CPU 201 of the imaging device 101, the CPU 301 of the imaging system control device 106 may also associate the medical record information (metadata) with the captured images. In this case, in S403, the CPU 301 of the imaging system control device 106 acquires medical record information from the electronic medical record terminal 104, but does not need to transmit the acquired medical record information to the imaging device 101. Then, the CPU 301 of the imaging system control device 106 associates the medical record information with the downloaded images in response to the data generation event in S409, which will be described later.

[0070] In S409, the CPU 201 notifies the imaging system control device 106 of a data generation event. A data generation event indicates that image data with metadata has been generated in the imaging device 101. Therefore, upon receiving notification of the data generation event, the CPU 301 of the imaging system control device 106 recognizes that new image data has been generated in the imaging device 101 and can receive (download) the image data.

[0071] The timing at which the CPU 301 of the imaging system control device 106 downloads image data from the imaging device 101 is not particularly limited. For example, the CPU 301 of the imaging system control device 106 can download image data upon receiving notification of a data generation event. In this case, image data is downloaded each time imaging is performed by the imaging device 101. Alternatively, the CPU 301 of the imaging system control device 106 may later download image data corresponding to multiple imaging sessions stored in the storage area of ​​the imaging device 101 (such as the ROM 203 or media drive 206) all at once. The timing of the batch download is not particularly limited, but could be, for example, when imaging for a particular patient is considered to be complete (for example, when the patient displayed in the electronic medical record is changed to another patient, or when the doctor starts inputting information into a specific area such as the diagnosis results in the electronic medical record). By configuring it in this way, it is possible to suppress the occurrence of delays due to the download time for each imaging session in medical departments where the number of imaging sessions per patient is large, or in hospitals where there is insufficient bandwidth on the network 102, thereby reducing stress on the imaging operator.

[0072] Furthermore, the CPU 201 of the imaging device 101 may display the captured image (first image) and a user interface (first user interface) including a cancel option in response to the image being captured in S407. The cancel option is a user-selectable option, such as the cancel button 512 shown in Figure 5. If the cancel option is selected in the user interface, the CPU 201 of the imaging device 101 will refrain from sending the aforementioned data generation event (first notification) to the imaging system control device 106. If a predetermined time (first time) elapses without the cancel option being selected in the user interface, the CPU 201 of the imaging device 101 will send the aforementioned data generation event (first notification) to the imaging system control device 106. This makes it possible to prevent the imaging system control device 106 from downloading images that the user considers unnecessary.

[0073] In S410, the CPU 201 of the imaging device 101 determines whether or not to issue a warning (second or third notification) prompting the user to check the medical record information. If it is determined that a warning should be issued, the process proceeds to S411; otherwise, the process proceeds to S412.

[0074] The determination here is based on the possibility that the physician has forgotten to switch the patient displayed in the electronic medical record. For example, if imaging using the same medical record information continues for a predetermined period of time (in other words, if a predetermined period of time (second period) has elapsed after the displayed patient has been changed to the current patient (first patient) and before it has been changed to another patient), it is highly likely that the physician has forgotten to switch the patient displayed in the electronic medical record. Therefore, CPU201 decides to issue a warning. As another example, if imaging is performed a predetermined number of times using the same medical record information (in other words, if imaging is performed a predetermined number of times after the displayed patient has been changed to the current patient (first patient) and before it has been changed to another patient), it is highly likely that the physician has forgotten to switch the patient displayed in the electronic medical record. Therefore, CPU201 decides to issue a warning.

[0075] In S411, the CPU 201 issues a warning to the user prompting them to check the medical record information. The method of issuing the warning is not particularly limited, but for example, if imaging using the same medical record information continues for more than 30 minutes, the CPU 201 can display a warning message 601 on the display 508 as shown in Figure 6. After that, the process proceeds to S405. Then, similar to the process in S405 described above, the CPU 201 determines whether the user selected the OK button 511 or the Cancel button 512, and the process proceeds to S405 or S406 depending on the determination result. By issuing such warnings, it is possible to suppress inconsistencies in metadata linked to the image data being captured (for example, associating the image data with the medical record information of the previous patient even though the patient being photographed has changed).

[0076] In the above explanation, it was assumed that the CPU 201 of the imaging device 101 performs the judgment in S410 and the warning in S411. However, a configuration in which the CPU 301 of the imaging system control device 106 performs the judgment in S410 and the warning in S411 may also be adopted. Alternatively, the CPU 301 of the imaging system control device 106 may notify the imaging device 101 or the electronic medical record terminal 104 of the judgment result in S410. In this case, the imaging device 101 and the electronic medical record terminal 104 can issue a warning in response to the notification from the imaging system control device 106. Furthermore, warnings may be issued simultaneously by multiple devices such as the imaging device 101, the imaging system control device 106, and the electronic medical record terminal 104. By configuring it in this way, it becomes possible to suppress inconsistencies in metadata linked to image data, regardless of the physician's gaze and actions, as well as the circumstances of the examination.

[0077] In S412, the CPU 201 of the imaging device 101 determines whether or not to end the imaging. If the user has finished imaging all the necessary affected areas and wishes to end the imaging, they select the end button 513. If the end button 513 is selected, the CPU 201 determines that the imaging should be ended. If it is determined that the imaging should not be ended, the process returns to S407. If it is determined that the imaging should be ended, the CPU 201 erases the medical record information held by the imaging device 101 (medical record information transmitted from the imaging system control device 106 in S403). After that, the process proceeds to S413.

[0078] Figure 7 shows the display state of the display unit 204 of the imaging device 101 when the medical record information has been erased. As shown in Figure 7, the patient information display 701 does not contain medical record information. Also, the shooting date and time 702 does not contain date and time information. In this way, by erasing the metadata (medical record information) in the imaging device 101 each time imaging of a patient is completed, it is possible to suppress the association of incorrect metadata with image data. In addition, the user can recognize that imaging has been completed by looking at the display state in Figure 7.

[0079] Furthermore, the imaging device 101 may be configured so that it does not take a picture even if the release button 502 is pressed before receiving medical record information. This makes it possible to suppress the generation of image data where the photographer and subject are unknown. In addition, a configuration may be adopted that allows the user to erase the memory of previously stored image data and metadata after completing the imaging of the affected area. For example, in response to the user selecting the cancel button 512 after completing the imaging of the affected area, the imaging device 101 deletes the temporarily stored image data along with the corresponding metadata. The imaging device 101 also requests the imaging system control device 106 to erase the image data and corresponding metadata that the imaging system control device 106 has stored so far. In this way, it is possible to reduce the effort required to erase data from each device when the image data from previous imaging does not have the desired composition or color for the physician.

[0080] In S413, the CPU 301 of the imaging system control device 106 stores the series of image data and corresponding metadata captured up to that point in the image management device 105. The image management device 105 may have a storage device such as an HDD or a file server, or it may be connected to a storage device in the form of a cloud system. The image management device 105 may also organize and classify the storage location of the image data according to the content of the metadata, and may assign search tags to the image data.

[0081] The CPU 301 of the imaging system control device 106 may transmit the series of image data captured up to this point to the electronic medical record terminal 104, thereby displaying a user interface (second user interface) for selecting images to store on the electronic medical record terminal 104. Alternatively, the CPU 301 of the imaging system control device 106 may display the user interface (second user interface) for selecting images to store on the display unit 304. The physician then confirms the image data on the user interface displayed on the electronic medical record terminal 104 or the display unit 304 and selects the image data to store. In this case, in S413, the CPU 301 of the imaging system control device 106 stores the selected image data and corresponding metadata in the image management device 105. With this configuration, only data significant to the physician can be selected and saved from multiple image data, thereby shortening the image data search time and saving storage space.

[0082] As described above, by appropriately collecting and storing image data and metadata, the effort of connecting the imaging device 101 to the image management device 105, or removing the media drive 206 from the imaging device 101 to collect and organize image data can be eliminated. Furthermore, based on medical record information (metadata), images can be re-examined using various search criteria at a later date or used in conferences, allowing physicians to easily access the desired image data.

[0083] ● Flow of imaging processing in an imaging system that may include multiple imaging devices 101 In the explanation in Figure 4, there was one imaging device 101 and one electronic medical record terminal 104 included in the imaging system. However, depending on the hospital's facilities, size, and the characteristics of the medical treatment, an imaging system including multiple imaging devices 101 and electronic medical record terminals 104 may be used. In such cases, this section explains how medical record information acquired from a specific electronic medical record terminal 104 is transmitted to a specific imaging device 101.

[0084] Figure 11 is a flowchart of the imaging process in an imaging system that may include multiple imaging devices 101. The imaging system used here may include multiple electronic medical record terminals 104, or it may include only one electronic medical record terminal 104. If the imaging system includes multiple electronic medical record terminals 104, the imaging process shown in Figure 11 is executed in parallel for each electronic medical record terminal 104.

[0085] Note that explanations of the imaging process in Figure 11 that are the same as or similar to the imaging process in Figure 4 will be omitted as appropriate. Also, in Figure 11, steps in which the same or similar processes as in Figure 4 are performed will be denoted by the same reference numerals as in Figure 4.

[0086] Furthermore, prior to the imaging process, the physicians are assumed to have logged into their respective electronic medical record terminals 104. Once a physician logs into the electronic medical record terminal 104, the terminal 104 retrieves patient information (ID, name, medical department, age, gender, medical history, lesions, etc.) and physician information (ID, name, department affiliation information, etc.) from the electronic medical record management device 103. The electronic medical record terminal 104 can then display the electronic medical record based on the information retrieved from the electronic medical record management device 103.

[0087] In S1101, the CPU 301 of the imaging system control device 106 attempts to detect the imaging device 101 connected to the imaging system. The detection method may be one that sends a packet to a specific IP address on the network and detects the response, or it may be a method such as Universal Plug and Play (UPnP) that automatically discovers and connects to devices on the network; it goes without saying that any protocol is acceptable as long as detection is possible.

[0088] In S1102, the CPU 301 determines whether it has detected an imaging device 101 connected to the imaging system. If one or more imaging devices 101 are detected, the process proceeds to S1103. If no devices are detected, it is possible that the imaging device 101 is not powered on, or that there is a problem with the imaging system or network. In this case, the CPU 301 may notify the electronic medical record terminal 104 by displaying a message to that effect, or it may notify the person in charge of maintaining the imaging system or the vendor.

[0089] In S1103, the CPU 301 determines whether multiple imaging devices 101 have been detected. If multiple imaging devices 101 are detected, the process proceeds to S1104. If only a single imaging device 101 is detected, the process proceeds to S403.

[0090] In S1104, the CPU 301 acquires the location information of each of the multiple imaging devices 101. This acquisition method may include using a Global Positioning System (GPS), or, if multiple Wi-Fi access points exist, Wi-Fi positioning may be used. Alternatively, Radio Frequency Identifier (RFID) positioning, beacon positioning using Bluetooth signals, or positioning using wideband wireless technology such as Ultra Wide Band (UWB) may be used. Any method that utilizes the positioning functions of the imaging devices 101 and the medical facility can be used. Once the location information of each imaging device 101 is acquired, the process proceeds to S1105.

[0091] In S1105, the CPU 301 uses the location information of each of the multiple imaging devices 101 and the location information of the electronic medical record terminal 104 to select the imaging device 101 to use (the imaging device 101 to which medical record information will be transmitted). The selection method is not particularly limited, but for example, the CPU 301 can select the imaging device 101 that is the shortest distance from the electronic medical record terminal 104. The method for obtaining the location information of the electronic medical record terminal 104 is not particularly limited. For example, if the electronic medical record terminal 104 is a personal computer installed in a specific room, the installation location of the electronic medical record terminal 104 may be stored in the imaging system control device 106 in advance. If the electronic medical record terminal 104 is portable, a configuration may be adopted to obtain its location information using GPS or the like, similar to the location information of the imaging device 101. The imaging system control device 106 may also be equipped with information such as a floor map to assist in calculating the distance traveled. Furthermore, if multiple imaging devices 101 are detected at the same distance due to location information acquisition errors or chance, the imaging system control device 106 may transmit the same information to all of those imaging devices 101. Alternatively, a configuration may be adopted that allows the physician to select an imaging device 101 through a user interface displayed on the electronic medical record terminal 104 or the display unit 204 of the imaging device 101. Once a specific imaging device 101 is selected, the process proceeds to S403. The process in S403 is the same as the process described with reference to Figure 4, but the destination of the medical record information is the imaging device 101 selected in S1105.

[0092] Furthermore, the imaging system control device 106 may be configured to switch between executing the imaging process shown in Figure 4 and the imaging process shown in Figure 11 by changing the program or settings of the imaging system control device 106. Alternatively, when the imaging system control device 106 is started up, it may be configured to dynamically switch between the imaging process shown in Figure 4 and the imaging process shown in Figure 11 depending on the number of imaging devices 101 and electronic medical record terminals 104.

[0093] ●Summary of the first embodiment As described above, according to the imaging system (information system) of the first embodiment, the imaging system control device 106 acquires information (e.g., medical record information) about the changed target patient (first patient) from the electronic medical record terminal 104 in response to a change in the target patient of the electronic medical record in the electronic medical record terminal 104. The imaging device 101 then associates information about the first patient with the images (first images) taken between the time the target patient is changed to the first patient and the time it is changed to another patient. This reduces the burden of associating information about a patient with images obtained by photographing that patient. As mentioned above, the imaging system control device 106 may also associate information about the first patient with the first images.

[0094] Furthermore, according to the imaging system of this embodiment, the imaging device 101 can display medical record information in response to a change in the patient being displayed in the electronic medical record. This allows the user to perform imaging while confirming that the patient being imaged and the medical record information associated with the image correspond correctly. Therefore, if the medical record information is incorrect, the user can notice it before imaging, enabling more accurate association between the image and the medical record information.

[0095] Furthermore, according to the imaging system of this embodiment, the imaging system control device 106 can download image data associated with metadata (medical record information) and store it in the image management device 105. Therefore, the user can later confirm which patient the image data corresponds to, making it possible to make better use of the image data during examinations.

[0096] Furthermore, according to the imaging system of this embodiment, the image management device 105 can store images in the image management device 105 using classification information such as pathology, gender, patient, age, and doctor, based on metadata. Therefore, it is possible to reduce the effort required to organize image data according to specific interest information and the effort required to search for image data when retrieving image data according to specific interest information at a later date.

[0097] Furthermore, according to the imaging system of this embodiment, the imaging system control device 106 can automatically download image data captured by the imaging device 101 in response to the change in the patient displayed in the electronic medical record terminal 104 from the current patient to another patient. Therefore, the effort required to retrieve image data from storage media, for example, can be reduced. In addition, stress on doctors and patients can be reduced even in communication infrastructures with limited network bandwidth.

[0098] Furthermore, according to the imaging system of this embodiment, the imaging system control device 106 can automatically download image data captured by the imaging device 101 each time it takes an image. Therefore, the effort required to retrieve image data from a storage medium, for example, can be reduced.

[0099] Furthermore, with the imaging system of this embodiment, the user can select the images to be stored on the user interface of the imaging system control device 106. Therefore, only images useful for medical treatment can be selected and stored from among the captured images.

[0100] Furthermore, according to the imaging system of this embodiment, if imaging using the same medical record information continues for a predetermined period of time or longer, the user is notified. Therefore, it is possible to prevent forgetting to switch the patient being displayed or to mistakenly associate the medical record information of another patient with an image in the event of a system failure.

[0101] Furthermore, according to the imaging system of this embodiment, if imaging is performed a predetermined number of times using the same medical record information, the user is notified. Therefore, it is possible to prevent forgetting to switch the patient being displayed or to mistakenly associate the medical record information of another patient with an image in the event of a system failure.

[0102] Furthermore, according to the imaging system of this embodiment, even when multiple imaging devices and electronic medical record terminals are present, the relative positions of each can be acquired, and medical record information can be transmitted to the imaging device that requires the shortest user travel distance. This reduces the effort required for the user to select the desired imaging device from a list of multiple imaging devices located within the facility.

[0103] The hardware configuration of the imaging device 101 in this embodiment may be the same as that of a normal digital camera, or it may be a small, portable digital camera. By installing the special control program for the imaging system of this embodiment as the control program for the imaging device 101, and having the CPU 201 execute the control program, the various functions of this embodiment described above can be realized. The hardware configuration of the imaging system control device 106 may also be the same as that of a normal computer. By installing the special control program for the imaging system of this embodiment as the control program for the imaging system control device 106, and having the CPU 301 execute the control program, the various functions of this embodiment described above can be realized. Therefore, by preparing a new control program for business systems that are not limited to medical use, it is possible to realize a business imaging system other than medical use using an existing normal digital camera or computer. An embodiment using such a control program for business systems will be described as the second embodiment.

[0104] [Second Embodiment] This embodiment describes a photography system that assists in and records trouble analysis on-site in a logistics support system that performs large-scale sorting in places such as logistics warehouses and factories. In this embodiment, it is assumed that the device block name, alarm location, sensor number, work name, etc., for a part of the conveying equipment and the transported objects (workpieces) that are the subjects of the logistics system are registered in advance in the data system of the conveying line, which will be described later, on a PC, factory server, or cloud server.

[0105] In the following explanation, we will assume that a digital camera capable of capturing visible light is used for shooting. However, as with the first embodiment, it goes without saying that the same methods can be applied when the information that can be captured and the form of the camera differ depending on the purpose of recording and analysis.

[0106] In this explanation, the photographer is assumed to be the equipment operator (operator and maintenance personnel). Since the schedule and shifts are registered in the transport system, the photographer's information (personal ID, affiliation, etc.) is also registered in the transport system's PC, server, or cloud server and can be accessed when needed.

[0107] In addition, in the imaging system of this embodiment, the configuration and connection conditions of the imaging device 101, network 102, setting values ​​for imaging conditions in the imaging device 101, image management device 105, imaging system control device 106, etc. are the same as in the first embodiment unless otherwise specified, and therefore their explanation is omitted.

[0108] ● System Configuration Figure 8 shows the configuration of the imaging system for the transport system. 801 is a transport control management device. The transport control management device 801 controls the entire transport system by controlling various transport systems, sensors, control terminals (passage sensors, presence / absence sensors, monitoring devices, transport stages, etc.), various logistics devices, and the transport control terminal device 802, as well as collecting and transmitting information. 803 is a robot-type food serving device. It shows an example configuration for serving workpieces such as box-shaped workpieces 804.

[0109] The imaging system control device 106 communicates with the imaging device 101 to detect imaging, receive captured image data, and perform image processing according to the purpose (e.g., thumbnail extraction, data compression, etc.) as described in the first embodiment. In that case, the imaging system control device 106 may transmit the results, receive necessary images (downloaded from the imaging device 101 or image management device 105), and obtain parameters necessary for imaging from the transport control management device 801. The imaging system control device 106 can also obtain detailed status, operating status, and various information of the transport control terminal device 802 and the serving device 803 via the network 102. The transport control management device 801 also stores the details, location, and repair results of past device troubles internally or in an external storage device such as a server.

[0110] ●Processing flow for recording device troubles Figure 9 is a flowchart illustrating the process (recording process) for recording equipment trouble status and other information using the imaging system for the transport system in this embodiment. Prior to the recording process, the operator is assumed to have logged into the transport system. This login may be linked to an attendance management system using an ID card, or it may be a login to a personal computer; any means that allows the operator to be identified is acceptable. The transport control management device 801 has already acquired various device information for the transport system.

[0111] The recording process includes processing by the imaging device 101 and processing by the imaging system control device 106. Unless otherwise specified, the processing by the imaging device 101 is achieved by the CPU 201 of the imaging device 101 executing a control program. Unless otherwise specified, the processing by the imaging system control device 106 is achieved by the CPU 301 of the imaging system control device 106 executing a control program.

[0112] Furthermore, similar to the imaging process in the first embodiment (Figures 4 and 11), the division of processing between devices is not limited to the division shown in the following description and in Figure 9.

[0113] In S902, the CPU 301 of the imaging system control device 106 detects whether trouble information has occurred in a specific device. If detected, processing proceeds to S903. If not detected, processing remains in S902 and waits.

[0114] In S903, the CPU 301 acquires information about the malfunctioning device and transmits it to the imaging device 101. The information acquired and transmitted to the imaging device 101 can include various types of information, such as device ID, location information, trouble details, date of imaging, trouble history, and imaging history. Here, the CPU 301 will primarily transmit auxiliary information to the imaging device 101 for the operator to use when imaging the device. For example, the CPU 301 will transmit the device ID, location information, trouble details, and time as metadata to the imaging device 101.

[0115] In S904, the CPU 201 of the imaging device 101 displays the metadata transmitted from the imaging system control device 106 on the display 508 in Figure 10, as shown in the device information 1001. This allows the operator to easily confirm that it matches the device being imaged. The operator checks the displayed information and selects the OK button 511 if there are no errors in the device information (including trouble information obtained from the device). If there is an error in the actual device information due to some mistake (for example, if the system's sensor detection malfunctions), the operator presses the cancel button 512.

[0116] In S905, the CPU 201 of the imaging device 101 determines whether or not the selection of the OK button 511 has been detected. If the selection of the OK button 511 is detected, the process proceeds to S907. If the selection of the Cancel button 512 is detected, the process proceeds to S906.

[0117] In S906, the CPU 301 of the imaging system control device 106 attempts to collect and update information on the device experiencing the problem again. After that, the process proceeds to S903.

[0118] In S907, the CPU 201 of the imaging device 101 takes an image and stores the image data in the RAM 203. Note that, in this case, the image data is temporarily stored, and if the exit button 513 or the like provided on the imaging device 101 is not pressed, the CPU 201 may discard the image data.

[0119] In S908, the CPU 201 adds the metadata transmitted in S903 to the image data captured in S907. The method of adding the metadata is not particularly limited, but for example, the CPU 201 can write the metadata to the metadata area of ​​the image data. Alternatively, the CPU 201 may control the file generation unit 212 to generate a metadata file containing the metadata, and associate the image data file with the metadata file.

[0120] In step S909, the CPU 201 notifies the imaging system control device 106 of a data generation event. A data generation event indicates that image data with metadata has been generated in the imaging device 101. Therefore, upon receiving notification of the data generation event, the CPU 301 of the imaging system control device 106 recognizes that new image data has been generated in the imaging device 101 and can receive (download) the image data.

[0121] The timing at which the CPU 301 of the imaging system control device 106 downloads image data from the imaging device 101 is not particularly limited. For example, the CPU 201 of the imaging device 101 may store the image data in a memory area (ROM 202 or media drive 206), and the CPU 301 of the imaging system control device 106 may download the image data later. This configuration can alleviate stress on the photographer even in infrastructure environments where delays occur due to download time for each shot, such as in transport systems with a large number of shots or insufficient bandwidth on the network 102.

[0122] In S910, the CPU 201 of the imaging device 101 determines whether or not to issue a warning (notification) to the operator. If it is determined that a warning should be issued, the process proceeds to S911; otherwise, the process proceeds to S912. For example, if the same metadata is used for longer than a predetermined time, or if the number of images taken exceeds a predetermined number, a warning may be issued to determine whether a warning cancellation is necessary due to communication between the transport control management device 801 and the transport control terminal device 802, or because the transport control management device 801 has been forgotten to be operated. The method of issuing a warning is the same as in Figure 6, so the explanation is omitted.

[0123] In S911, CPU201 alerts the user to ensure there are no errors in their handling of the transport control management device 801 and the transport control terminal device 802. The process then proceeds to S905.

[0124] In S912, the CPU 201 determines whether or not to terminate the imaging process. If the termination button 513 is pressed, the CPU 201 clears the metadata held by the imaging device 101. The process then proceeds to S913. The method for clearing the metadata is the same as in Figure 7, so the explanation is omitted.

[0125] In this way, by clearing metadata such as device information each time a device malfunction is captured, it is possible to suppress the misassociation of other device malfunction information with the captured image data. Alternatively, if device information is not entered, it may be possible to suppress shooting by preventing shooting even if the release button 502 is pressed.

[0126] In S913, the CPU 301 of the imaging system control device 106 stores the series of imaging data and metadata captured up to that point in the image management device 105. After that, processing returns to S902, and the CPU 301 returns to a state where it waits for an abnormality to be detected.

[0127] As explained in the first embodiment, it goes without saying that the storage location may be organized according to the metadata content during storage, and searchability may be improved by tagging. In this way, the operator can save the trouble of connecting to the imaging device 101 and organizing the captured data using the media drive. In addition, since images can be organized according to trouble attributes, device ID, and frequency of occurrence, the operator can save the trouble of organizing image data and record troubles or phenomena for improvement.

[0128] ● Recording process flow in a transport system that may include multiple imaging devices 101 Furthermore, in the above explanation, the imaging device 101 and the transport control management device 801 in Figure 8 were described as having a one-to-one relationship, similar to Figure 1 of the first embodiment. However, depending on the equipment and scale of the logistics warehouse or factory, and the characteristics of the equipment, there may be systems in which multiple imaging devices 101 and transport control management devices 801 exist. In such cases, we will also explain how metadata such as the device ID, location information, trouble details, and time obtained from the transport control management device 801 is transmitted to a specific imaging device.

[0129] Figure 12 is a flowchart of the recording process in a transport system that may include multiple imaging devices 101. The transport system used here may include multiple transport control management devices 801, or it may include only one transport control management device 801. If the transport system includes multiple transport control management devices 801, the recording process shown in Figure 12 is executed in parallel for each transport control management device 801.

[0130] Note that explanations of the recording process in Figure 12 that are the same as or similar to the recording process in Figure 9 will be omitted as appropriate. Also, in Figure 12, steps in which the same or similar processes as in Figure 9 are performed will be denoted by the same reference numerals as in Figure 9.

[0131] Also, as in Figure 9, the operator has already logged into the transport system prior to performing the record-keeping process.

[0132] In S902, the CPU 301 of the imaging system control device 106 determines whether a new anomaly has been detected in the logistics system. If detected, the CPU 301 determines that imaging of the new equipment anomaly will now begin. Then, the process proceeds to S1201. If no anomaly is detected, the process returns to S902, and the CPU 301 performs the detection process again.

[0133] In S1201, CPU301 attempts to detect the imaging device connected to the system. The detection method could be sending packets to a specific IP address on the network and detecting the response, or it could be a method like Universal Plug and Play (UPnP) that automatically discovers and connects to devices on the network; needless to say, any protocol that allows detection is acceptable.

[0134] In S1202, the CPU 301 determines whether it has detected any imaging devices connected to the system. If one or more imaging devices are detected, the process proceeds to S1203. If no devices are detected, it is possible that the imaging device is not powered on or that there is a problem with the system or network. In this case, the CPU 301 may display a notification indicating the possibility of a problem, or it may notify the person responsible for maintaining the system or the relevant contractor.

[0135] In S1203, the CPU 301 determines whether multiple imaging devices were detected in S1202. If multiple imaging devices are detected, the process proceeds to S1204. If only a single imaging device is detected, the process proceeds to S903.

[0136] In S1204, the CPU 301 acquires the location information of each imaging device. The acquisition method may be the Global Positioning System (GPS), or if there are multiple Wi-Fi access points, Wi-Fi positioning may be used. Needless to say, any positioning method provided by the imaging device and facility is acceptable, including Radio Frequency Identifier (RFID) positioning, beacon positioning that emits Bluetooth signals, or positioning methods using wideband wireless such as Ultra Wide Band (UWB). Once the location information of each imaging device has been acquired, the process proceeds to S1205.

[0137] In S1205, the CPU 301 uses the position information of each of the multiple imaging devices 101 and the position information of the transport control management device 801 to determine which imaging device 101 has traveled the shortest distance and which device information will be transmitted to. The method for acquiring the position information of the transport control management device 801 is not particularly limited. For example, if the transport control management device 801 is a personal computer installed in a specific room, the installation location of the transport control management device 801 may be stored in the imaging system control device 106 in advance. If the transport control management device 801 is in a portable form, a configuration may be adopted in which the position information is acquired using GPS or the like, similar to the position information of the imaging devices 101. The imaging system control device 106 may also be equipped with information such as a floor map to assist in calculating the travel distance. Furthermore, if multiple imaging devices 101 are detected at similar distances due to position information acquisition errors or chance, the imaging system control device 106 may transmit the same information to all of those imaging devices 101. Alternatively, a configuration may be adopted that allows the operator to select the imaging device 101 through a user interface displayed on the transport control management device 801 or the display unit 204 of the imaging device 101. When a specific imaging device 101 is selected, the process proceeds to S903. The process in S903 is the same as the process described with reference to Figure 9, but the destination of the metadata is the imaging device 101 selected in S1205.

[0138] Furthermore, the recording system control device 106 may be configured to switch between executing the recording process shown in Figure 9 and the recording process shown in Figure 12 by changing the program or settings of the recording system control device 106. Alternatively, when the recording system control device 106 is started up, it may be configured to dynamically switch between the recording process shown in Figure 9 and the recording process shown in Figure 12 depending on the number of imaging devices 101 and transport control management devices 801.

[0139] ●Summary of the second embodiment As explained above, according to the imaging system of the second embodiment, the imaging device 101 can automatically acquire device information and operator information when the status of the transport device (for example, when an abnormality is detected) changes. Therefore, it is possible to easily link image data with metadata such as device information and operator information. As a result, the effort required to link operators or input information can be reduced, and the utilization of image data can be promoted.

[0140] Furthermore, according to the imaging system of this embodiment, the imaging device 101 can display device information and operator information when the status of the transport device (for example, when an abnormality is detected) changes. Therefore, the operator can take images while confirming that the device, image data, and metadata correspond correctly. If the device information or other information is incorrect, the operator can notice it before taking the image, so the linking of image data and metadata can be done more accurately.

[0141] Furthermore, according to the imaging system of this embodiment, the imaging device 101 can display device information and operator information when the status of the transport device (for example, when an abnormality is detected) changes. Therefore, the operator can verify whether the device, image data, and associated metadata are correctly corresponded. If the correspondence is incorrect, the operator can correct or update the device information. Therefore, if the device information is incorrect, the operator can correct the metadata associated with the image data.

[0142] Furthermore, the imaging system of this embodiment allows image data and metadata to be downloaded together and stored in a storage device. Therefore, it is possible to later confirm which device or operator captured the image data, making better use of the image data during maintenance, inspection, and repair.

[0143] Furthermore, according to the imaging system of this embodiment, image data and metadata can be downloaded together and stored in a storage device or similar based on the accompanying information of the metadata, using classification information such as device ID, abnormality details, date and time, frequency, and location. Therefore, the effort required to organize image data according to specific interest information and the effort required to search for image data when retrieving it later according to specific interest information can be reduced.

[0144] Furthermore, according to the imaging system of this embodiment, image data and metadata can be automatically downloaded in association with each other at the timing of a change in the state of the transport device (for example, detection of an abnormality). Therefore, the effort required to retrieve image data from storage media, for example, can be reduced. In addition, even in the case of image data communication infrastructure with limited network bandwidth, stress on operators and equipment can be reduced.

[0145] Furthermore, according to the imaging system of this embodiment, image data and metadata can be automatically downloaded and linked together each time the imaging device takes a picture. Therefore, the effort required to, for example, retrieve image data from a storage medium can be reduced.

[0146] Furthermore, according to the imaging system of this embodiment, the downloaded images can be linked with device information and confirmed on the transport control system, and the image data to be stored can be selected before being sent to the storage device. Therefore, only images useful for maintenance, inspection, and repair can be selected and stored from among the captured images.

[0147] Furthermore, according to the imaging system of this embodiment, if a certain amount of time has elapsed since specific device information was transmitted to the imaging device, a notification can be issued to confirm the device information. Therefore, it is possible to suppress the failure to switch the status of the transport device (for example, detecting an abnormality) or the occurrence of a system failure, which could result in incorrect device information being associated with image data or image data associated with incorrect device information being stored.

[0148] Furthermore, according to the imaging system of this embodiment, when a certain number of images are taken after specific device information has been transmitted to the imaging device, a notification can be issued to confirm the device information. Therefore, it is possible to suppress the failure to switch the status of the transport device (for example, detecting an abnormality) or the occurrence of a system failure, which could result in incorrect device information being associated with image data or image data associated with incorrect device information being stored.

[0149] Furthermore, according to the imaging system of this embodiment, even when multiple imaging devices and transport control management devices are present, the system can acquire the relative positions of each device, select the imaging device that requires the shortest operator movement distance as the destination for transmitting device information, and transmit it. This reduces the effort required for the operator to select the desired imaging device from a list of multiple imaging devices located within the facility.

[0150] [Other embodiments] The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0151] [summary] The embodiments described above disclose, but are not limited to, the inventions shown in at least the following items. [Item 1] A control device that can communicate with an electronic medical record terminal, including a first acquisition means for acquiring first information relating to the first patient from the electronic medical record terminal in response to the change in the patient whose electronic medical record is displayed to the first patient on the electronic medical record terminal, The system includes an association means for associating the first information with a first image taken by a specific imaging device that can communicate with the control device, between the time the patient to be displayed is changed to the first patient and the time it is changed to another patient, An information system characterized by having the following features. [Item 2] The control device includes a transmission means for transmitting the first information to the specific imaging device in response to the acquisition of the first information. The aforementioned specific imaging device is included in the information system and includes receiving means for receiving the first information from the control device, The association means is included in the specific imaging device and associates the first information received from the control device with the first image. The information system described in item 1, characterized by the features described herein. [Item 3] The particular imaging device includes a first display means that displays at least a portion of the first information in response to receiving the first information from the control device. The information system described in item 2, characterized by the features described herein. [Item 4] The control device includes a second acquisition means for acquiring the first image associated with the first information from the specific imaging device in response to the display target patient being changed to a patient other than the first patient. An information system as described in item 2 or 3, characterized by the features described herein. [Item 5] The control device includes a second acquisition means for acquiring the first image associated with the first information from the specific imaging device, in response to the first information being associated with the first image. An information system as described in item 2 or 3, characterized by the features described herein. [Item 6] The aforementioned specific imaging device is A second display means that displays the first image and a first user interface including a cancel option in response to the capture of the first image, Notification means that provides a first notification to the control device in response to the fact that a first time has elapsed without the cancellation option being selected in the first user interface, Includes, The second acquisition means acquires the first image associated with the first information from the specific imaging device when the first notification is given. An information system as described in item 4 or 5, characterized by the features described herein. [Item 7] The control device includes storage means for storing the first image acquired from the specific imaging device in a storage device. An information system characterized by any one of items 4 to 6. [Item 8] The control device includes a third display means for displaying a second user interface for selecting an image to store. The storage means stores the first image in the storage device when the first image is selected in the second user interface. The information system described in item 7, characterized by the features described herein. [Item 9] A second notification means provides a second notification to the user in response to the fact that a second period of time has elapsed between the time the displayed patient is changed to the first patient and the time the displayed patient is changed to another patient. An information system according to any one of items 1 to 8, further comprising the above. [Item 10] A third notification means provides a third notification to the user in response to the fact that a predetermined number of images have been taken by the specific imaging device after the patient to be displayed has been changed to the first patient, and before the patient to be displayed has been changed to another patient. An information system according to any one of items 1 to 9, further comprising the above. [Item 11] The control device includes selection means for selecting an imaging device to be used as the specific imaging device from among the multiple imaging devices, based on the location of the electronic medical record terminal and the location of each of the multiple imaging devices, when the multiple imaging devices are able to communicate with the control device. An information system according to any one of items 1 to 10, characterized by the features described herein. [Item 12] In response to the change in the patient whose electronic medical record is displayed on the electronic medical record terminal to the first patient, the first acquisition means of a control device that can communicate with the electronic medical record terminal performs a first acquisition step of acquiring first information relating to the first patient from the electronic medical record terminal, The association means includes an association step of associating the first information with a first image taken by a specific imaging device that can communicate with the control device between the time the patient to be displayed is changed to the first patient and the time it is changed to another patient, An information processing method characterized by comprising: [Item 13] A program for causing a computer to function as one of the means of an information system described in any one of items 1 through 11.

[0152] The invention is not limited to the embodiments described above, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, claims are attached to disclose the scope of the invention. [Explanation of Symbols]

[0153] 101...Imaging device, 102...Network, 103...Electronic medical record management device, 104...Electronic medical record terminal, 105...Image management device, 106...Imaging system control device, 107...Affected area

Claims

1. An information system, A control device that can communicate with an electronic medical record terminal, including a first acquisition means for acquiring first information relating to the first patient from the electronic medical record terminal in response to the change in the patient whose electronic medical record is displayed to the first patient on the electronic medical record terminal, The system includes an association means for associating the first information with a first image captured by a specific imaging device that can communicate with the control device, between the time the patient to be displayed is changed to the first patient and the time it is changed to another patient, Equipped with, The control device includes a transmission means for transmitting the first information to the specific imaging device in response to the acquisition of the first information. The aforementioned specific imaging device is included in the information system and includes receiving means for receiving the first information from the control device, The association means is included in the specific imaging device and associates the first information received from the control device with the first image. An information system characterized by the following features.

2. The particular imaging device includes a first display means that displays at least a portion of the first information in response to receiving the first information from the control device. The information system according to feature 1.

3. The control device includes a second acquisition means for acquiring the first image associated with the first information from the specific imaging device in response to the display target patient being changed to a patient other than the first patient. The information system according to feature 1.

4. The control device includes a second acquisition means for acquiring the first image associated with the first information from a specific imaging device, in response to the first information being associated with the first image. The information system according to feature 1.

5. The aforementioned specific imaging device is A second display means that displays the first image and a first user interface including a cancel option in response to the capture of the first image, Notification means that provides a first notification to the control device in response to the fact that a first time has elapsed without the cancellation option being selected in the first user interface, Includes, The second acquisition means acquires the first image associated with the first information from the specific imaging device when the first notification is given. The information system according to feature 3.

6. The control device includes storage means for storing the first image acquired from the specific imaging device in a storage device. The information system according to feature 3.

7. The control device includes a third display means for displaying a second user interface for selecting an image to store. The storage means stores the first image in the storage device when the first image is selected in the second user interface. The information system according to feature 6.

8. A second notification means provides a second notification to the user in response to the fact that a second period of time has elapsed between the time the patient to be displayed is changed to the first patient and the time the patient to be displayed is changed to another patient. The information system according to claim 1, further comprising the following:

9. A third notification means provides a third notification to the user in response to the fact that a predetermined number of images have been taken by the specific imaging device after the patient to be displayed has been changed to the first patient, and before the patient to be displayed has been changed to another patient. The information system according to claim 1, further comprising the following:

10. The control device includes selection means for selecting an imaging device to be used as the specific imaging device from among the multiple imaging devices, based on the location of the electronic medical record terminal and the location of each of the multiple imaging devices, when the multiple imaging devices are able to communicate with the control device. The information system according to feature 1.

11. In response to the change in the patient whose electronic medical record is displayed on the electronic medical record terminal to the first patient, the first acquisition means of a control device that can communicate with the electronic medical record terminal performs a first acquisition step of acquiring first information relating to the first patient from the electronic medical record terminal, Upon acquisition of the first information, the transmitting means of the control device transmits the first information to a specific imaging device capable of communicating with the control device (transmission step), The receiving means of the specific imaging device receives the first information from the control device in a receiving step, The association means for the specific imaging device includes an association step of associating the first information received from the control device with a first image taken by the specific imaging device between the time the target patient is changed to the first patient and the time it is changed to another patient, An information processing method characterized by comprising:

12. A program for causing a computer to function as one of the means of an information system according to any one of claims 1 to 10.

Images