Inspection support device, its control method, and program

Abstract

To provide an inspection auxiliary device and a control method for the same, and a program that, when a patient to be photographed is changed due to a movement of an inspector, can prevent an error in registration operations performed by the inspector to associate photographic data of an affected part of the patient with patient information.SOLUTION: An imaging apparatus 100 has a function to acquire patient information in a bar code on a patient's wrist band from a reading operation performed by an inspector, a function to hold the patient information in an in-camera storage unit, a function to perform photographing according to the inspector's depression of a release button to generate imaging data, and a function to associate the imaging data with the patient information held in the in-camera storage unit and store the data and information. The imaging apparatus 100 acquires walking information related to walking of the inspector from a walking measurement device 101, and performs a notification to the inspector based on the walking information. The imaging apparatus stops the imaging according to the depression of the release button during the notification, and deletes the patient information from the in-camera storage unit based on the movement of the inspector during the notification.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to an examination support device, its control method, and a program, and particularly to an examination support device, its control method, and a program for assisting a registration operation of associating imaging data of an affected part taken for examination with patient information.

Background Art

[0002] Conventionally, in order to manage changes in a patient's condition, an examiner (for example, a nurse) takes pictures of the patient's affected part with a camera every day. However, in a medical field, there is a problem that mistakes often occur in a registration operation of associating imaging data of the affected part with examination-related information (for example, patient information such as a patient's name and medical record number). Examples of such mistakes in the registration operation include recording omission, recording error, and misidentification of patients.

[0003] There are also several conventional techniques for suppressing such mistakes in the registration operation. For example, when the patient to be photographed changes and an examiner reads a patient identifier (such as a barcode) with a camera, patient information is displayed on the display of the camera to facilitate visual confirmation and suppress mistakes in the registration operation (for example, see Patent Document 1). Also, there is a known technique for using the shooting position of the camera and the position of the patient determined based on GPS information to detect whether the patient to be photographed has changed and suppress such mistakes in the registration operation (for example, see Patent Document 2).

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, the technology described in Patent Document 1 had a problem in that if the examiner who reads the patient identifier (barcode, etc.) with the camera made a mistake, the visual confirmation of the patient's number being photographed would also be missed, making it impossible to prevent registration errors. This problem is likely to occur when the examiner moves around to photograph patients in the same room one after another.

[0006] Furthermore, GPS measurement accuracy is insufficient inside hospitals (indoors). Therefore, with the technology described in Patent Document 2, even if the camera's shooting position is determined to have changed based on GPS information, it is difficult to distinguish whether this is due to the examiner's movement or a GPS measurement error, making it difficult to accurately detect a change in the patient being photographed. This problem is particularly pronounced in cases where patients in the same room are photographed one after another.

[0007] Therefore, the present invention aims to provide an examination assistance device, a control method thereof, and a program that can prevent errors in the registration process by which an examiner associates imaging data of a patient's affected area with patient information when the patient being photographed changes due to the examiner's movement. [Means for solving the problem]

[0008] To solve the above problems, the present invention provides an examination assistance device having a function to acquire patient information of a patient identifier by an examiner's reading operation and store it in a camera's internal storage unit, a function to perform imaging by an examiner's imaging operation and generate imaging data, and a function to store the imaging data in association with the patient information stored in the camera's internal storage unit, wherein the device includes an acquisition means for acquiring walking information relating to the examiner's walking, a notification means for notifying the examiner based on the walking information, a stop means for stopping imaging by the imaging operation while the notification is being made, a deletion means for deleting the patient information from the camera's internal storage unit based on the examiner's actions while the notification is being made, and a termination means for ending the notification when the patient information has been deleted from the camera's internal storage unit by the deletion means. a second detection means for detecting horizontal movement, to have The notification means makes the notification based on the detection by the second detection means. It is characterized by the following: [Effects of the Invention]

[0009] According to the present invention, when the affected area of ​​a patient being photographed changes due to the examiner's movement, it is possible to prevent errors in the registration process of associating the photographed data of the affected area with patient information. [Brief explanation of the drawing]

[0010] [Figure 1] This is an overall system diagram of the present invention, including an imaging device as an inspection support device that detects the examiner's walking and notifies the examiner. [Figure 2] This is a block diagram showing the hardware configuration of the imaging device. [Figure 3] Figure 1 is a block diagram showing the hardware configuration of the gait measurement device. [Figure 4] Figure 1 is a sequence diagram showing an example of the inspection process according to this embodiment, which is executed by the system shown in Figure 1. [Figure 5] This figure shows an example of the notification UI displayed in step S414 of Figure 4. [Figure 6] This table shows an example of camera settings stored in the camera's internal memory. [Figure 7] This flowchart shows an example of a patient information setting process performed in an imaging device. [Figure 8] Figure 7 is a flowchart showing an example of the walking condition check process in step S703. [Figure 9] Figure 7 is a flowchart showing an example of the setting retention condition check process in step S706. [Figure 10] Figure 7 is a flowchart showing an example of the setting deletion condition check process in step S708. [Figure 11] This is an overhead view showing how the examiner uses the system shown in Figure 1 to photograph each patient in a large ward. [Modes for carrying out the invention]

[0011] Hereinafter, preferred embodiments of the present invention will be described in detail based on the accompanying drawings.

[0012] FIG. 1 is an overall configuration diagram of a system 1 including an imaging device as an inspection assistance device of the present invention that detects the walking of an inspector and notifies the inspector.

[0013] In FIG. 1, the system 1 includes an imaging device 100 capable of wireless communication and a walking measurement device 101.

[0014] When the inspector performs an imaging operation, specifically, presses a release button 501 (FIG. 5), the imaging device 100 captures an image of the affected part of the patient and generates imaging data. Further, the imaging device 100 acquires patient information such as a patient management number associated with the patient from a patient identifier such as a barcode printed on a list band or the like worn on the patient's arm or the like by a patient information acquisition function described later. The imaging device stores the imaging data of the affected part of the patient in association with the acquired patient information. Furthermore, the imaging device 100 is provided with an acceleration sensor and a gyro sensor capable of detecting the raising / lowering state and the horizontal movement state, similar to a commercially available digital camera. When the power of the imaging device 100 is turned on, it can communicate wirelessly with the walking measurement device 101, and maintains a state of being continuously communicable with the walking measurement device 101 until the power is turned off.

[0015] The walking measurement device 101 (external device) detects walking and counts walking information (number of steps and walking time) in the same manner as a commercially available walking measurement device (step counter). Further, the walking measurement device 101 can communicate wirelessly with the imaging device 100 in accordance with, for example, the wireless communication standard Bluetooth Low Energy (BLE). When wireless communication with the imaging device 100 is established, the walking measurement device 101 transmits the walking information to the imaging device 100.

[0016] First, in this embodiment, an example will be described in which walking information is transmitted and received when wireless communication is established between the imaging device 100 and the walking measurement device 101 in the system 1. However, the example is not limited to this as long as the walking information can be transmitted and received between the imaging device 100 and the walking measurement device 101. For example, the connection form between the imaging device 100 and the walking measurement device 101 may be a wired connection, or the imaging device 100 may have the function of the walking measurement device 101 (the first detection means) inside it.

[0017] FIG. 2 is a block diagram showing the hardware configuration of the imaging device 100.

[0018] The imaging device 100 is a digital still camera, and realizes the imaging process described below by executing a predetermined control program.

[0019] In FIG. 2, the imaging device 100 includes a CPU 200, a ROM 201, a RAM 202, a display device 203, an imaging unit 204, an input device 205, and a memory card 206. The imaging device 100 further includes a network interface 207, a detection device 208, a file generation unit 209, and a system bus 210.

[0020] The CPU 200 controls the entire digital still camera.

[0021] The ROM 201 stores the operation processing procedures of the CPU 200 (for example, programs such as processing when the power of the digital still camera is turned on and basic input / output processing).

[0022] The RAM 202 functions as the main memory of the CPU 200. Various programs including the control program for realizing the processes described later are loaded from the ROM 201 or the like to the RAM 202 and executed by the CPU 200. In addition, the RAM 202 provides a work area when the CPU 200 executes various processes.

[0023] The display device 203 performs various displays under the control of the CPU 200. For example, the display device 203 displays a live view of the image target or data stored on the storage medium.

[0024] The imaging unit 204 reads an optical image using a solid-state image sensor and generates electrical image data by performing an analog-to-digital conversion.

[0025] The input device 205 consists of buttons for performing various operations, such as the release button 501 (Figure 5) located on the top of the imaging device 100.

[0026] Memory card 206 is a removable storage medium that allows for the storage and retrieval of data.

[0027] The network interface 207 (communication means) connects to, for example, a server computer, a personal computer, a gait measurement device 101, etc., and transmits and receives data.

[0028] The detection device 208 (second detection means) is composed of, for example, a two-axis accelerometer or an angular velocity sensor (gyro sensor) for detecting horizontal movement.

[0029] The file generation unit 209, under the control of the CPU 200, converts the image data generated by the imaging unit 204 into image data in a general-purpose still image format (in this embodiment, JPEG image data).

[0030] The system bus 210 consists of an address bus, a data bus, and a control bus that connect the aforementioned units to each other.

[0031] Figure 3 is a block diagram showing the hardware configuration of the gait measurement device 101.

[0032] The gait measurement device 101 is a pedometer, and by executing a predetermined control program, it achieves the step count measurement described below.

[0033] In Figure 3, the gait measurement device 101 includes a CPU 300, ROM 301, RAM 302, display device 303, detection device 304, network interface 305, and system bus 306.

[0034] The CPU300 is responsible for controlling the entire gait measurement system.

[0035] ROM301 stores the operating procedures of CPU300 (for example, programs for processing when the power of the gait measurement device is turned on and basic input / output processing).

[0036] RAM302 functions as the main memory of the CPU300. Various programs, including control programs for implementing the processes described later, are loaded into RAM302 from ROM301 and executed by the CPU300. RAM302 also provides a work area for the CPU300 when it executes various processes.

[0037] The display device 303 performs various displays under the control of the CPU 300. For example, the display device 303 displays walking information stored in the storage medium.

[0038] The detection device 304 consists of, for example, a 3-axis acceleration sensor for detecting walking motion, and is attached to the person being measured (e.g., the examiner) to measure acceleration.

[0039] The network interface 305 connects to, for example, a server computer, a personal computer, or the aforementioned imaging device 100, and transmits and receives walking information.

[0040] The system bus 306 consists of an address bus, a data bus, and a control bus that connect the units described above.

[0041] Figure 4 is a sequence diagram showing an example of the inspection process according to this embodiment, which is performed by System 1.

[0042] Figure 4 outlines the inspection process according to this embodiment; a more detailed explanation will be provided using the flowcharts in Figure 7 and subsequent figures.

[0043] First, the startup sequence from steps S401 to S407 is executed.

[0044] In step S401, when the examiner (e.g., a nurse) turns on the power of the imaging device 100, the imaging device 100 (hereafter CPU 200) establishes a wireless connection with the gait measurement device 101 using the aforementioned connection method (e.g., BLE connection).

[0045] In step S402, once a wireless connection is established between the gait measurement device 101 (hereinafter referred to as CPU 300) and the imaging device 100, the gait measurement device begins measuring gait. Note that the gait information (e.g., number of steps and walking time) that the gait measurement device 101 stores in RAM 302 may be initialized when the wireless connection is established in step S401. Alternatively, the CPU 200 may acquire gait information from the gait measurement device 101 when the wireless connection is established in step S401 and store it in the camera's internal memory.

[0046] In step S403, the CPU 200 acquires patient information from the RAM 202 and memory card 206 (hereinafter referred to as "camera internal memory") inside the imaging device 100. However, during the execution of the startup sequence which begins immediately after the power of the imaging device 100 is turned ON, patient information is not present in the RAM 202 or memory card 206 of the imaging device 100. The imaging device 100 also has a patient information acquisition function that acquires patient information from the displayed barcode when the examiner sets the imaging device 100 to live view mode and a barcode printed on the patient's wristband, etc., is displayed in the live view of the display device 203. The CPU 200 saves the patient information acquired by the patient information acquisition function by writing it to the RAM 202 or memory card 206, in preparation for acquiring patient information next time.

[0047] In step S404, the CPU 200 (acquisition means) requests the gait measurement device 101 to acquire gait information. This request is made, for example, using the GET method of the HTTP request method.

[0048] In step S405, the CPU 300 responds to the request for gait information acquisition in step S404 by acquiring the gait information stored in the RAM 302, which has been updated sequentially since the start of gait measurement in step S402.

[0049] In step S406, the CPU 300 transmits the gait information acquired in step S405 to the imaging device 100.

[0050] Furthermore, the processes in steps S404 to S406 (hereinafter referred to as "polling check") are executed periodically while the power of the imaging device 100 is ON.

[0051] In step S407, the CPU 200 performs a walking condition check based on walking information obtained through polling checks to determine whether or not the examiner has walked. The details of this process will be described later, but this process allows the CPU 200 to determine, based on the difference in walking information, whether or not the examiner has walked since the last patient image was taken in step S410, which will be described later. Note that in step S407, which is executed in the startup sequence where no patient image is taken, the CPU 200 determines that the examiner has not walked and starts the image acquisition sequence.

[0052] During the shooting sequence, the following steps S408 to S411 are executed.

[0053] In step S408, the CPU 200 displays a live view of the target to be imaged on the display device 203. At this time, the examiner activates the patient information acquisition function by performing a reading operation, adjusting the camera's orientation so that the barcode or other information indicating patient information printed on the wristband worn by the patient is included in the live view. When the patient information acquisition function is activated, patient information is read from the barcode in the live view and written to the RAM 202 or memory card 206.

[0054] In step S409, the CPU 200 performs patient information acquisition processing. This step (step S409) is the same process as step S403 described above. Specifically, it acquires patient information written to the camera's internal memory during the live view display in step S408 from the camera's internal memory. Furthermore, upon completion of the patient information acquisition processing in step S409, a screen may be displayed to notify the examiner that the patient imaging process in step S410 is now ready.

[0055] In step S410a, when the examiner presses the release button 501 on the input device 205 (indicating an imaging operation), the CPU 200 performs patient imaging and acquires imaging data of the patient's affected area, etc. This acquired patient imaging data is stored in association with the patient information acquired in step S409.

[0056] In step S410b, the CPU200 performs a walking condition check, similar to step S407 described above, to determine whether or not the examiner walked based on the walking information obtained in the last polling check. If it is determined that the examiner did not walk, the process returns to step S410a; if it is determined that the examiner walked, the process proceeds to step S411.

[0057] Furthermore, by adjusting the camera orientation during the live view display in step S408 and taking patient images in step S410 for each patient being examined, the examiner can save the imaging data for each patient in association with their patient information.

[0058] In step S411, the CPU 200 resets the gait information. Specifically, in this embodiment, it deletes the gait information held in the RAM 302 of the gait measurement device 101 and the gait information managed in the camera's internal memory. The purpose of resetting the gait information is to determine whether the examiner walked after the last patient image was taken in step S410. Therefore, although this embodiment states that the gait information is deleted, it is also possible to return the gait information in the RAM 302 of the gait measurement device 101 and the camera's internal memory to their initial values ​​without deleting them, or to overwrite the initial values ​​with the gait information at the time of imaging.

[0059] Then, the notification sequence begins.

[0060] During the notification sequence, the following steps S412 to S415 are executed.

[0061] In step S412, the CPU 200 performs a live view display, similar to step S408 described above. At this time, similar to step S408, the examiner can activate the patient information acquisition function and write the acquired patient information to RAM 202 or memory card 206.

[0062] In step S413, the CPU200 performs a walking condition check, similar to step S407, to determine whether the examiner walked or not based on the walking information obtained in the last polling check. If it is determined that the examiner did not walk, the process returns to step S408; if it is determined that the examiner walked, the process proceeds to step S413.

[0063] In step S414, the CPU 200 (notification means) displays a notification UI 507 (Figure 5) on the display device 203 indicating that the examiner has walked. Details of the notification UI 507 will be described later. The examiner using the imaging device 100 (e.g., a nurse) confirms this notification and takes action according to its content.

[0064] In step S415, the CPU 200 performs a patient information reset process. This step (step S415) is performed, for example, when an instruction to delete patient information is given via the notification UI displayed in step S414. By deleting the patient information from the camera's internal memory, it becomes possible to acquire new patient information when the shooting sequence is resumed.

[0065] Subsequently, CPU200 (termination mechanism) terminates the display of the notification UI and resumes the shooting sequence.

[0066] Figure 5 shows an example of the notification UI displayed in step S414 of Figure 4. Note that the operation of all buttons except the power button 500 is described for when the imaging device 100 is powered on.

[0067] In Figure 5, the imaging device 100 includes various buttons that constitute the input device 205 and a display device 203 that displays the notification UI 507.

[0068] The power button 500 is one of the buttons that make up the input device 205 and switches the power of the imaging device 100 ON / OFF. When the imaging device 100 is not powered on, if the examiner (for example, a nurse) presses the power button 500, the CPU 200 determines that the user has instructed it to power on and turns on the power of the imaging device 100. When the imaging device 100 is powered on, if the user presses the power button 500, the CPU 200 determines that the user has instructed it to turn off the power and turns off the power of the imaging device 100.

[0069] The release button 501 is one of the buttons that make up the input device 205, and when the user presses the release button 501, the CPU 200 determines that there has been an instruction to capture a still image.

[0070] The up button 502, right button 503, down button 504, left button 505, and select button 506 are also buttons that make up the input device 205. When the user presses any of the up button 502, right button 503, down button 504, or left button 505, the CPU 200 determines that the user has performed an operation to switch the selection target and switches the selection target in the notification UI 507 described later. When the user presses the select button 506, the CPU 200 determines that the user has performed a select operation and switches the state of the imaging device 100 according to the selection target.

[0071] The notification UI 507 is displayed on a touch panel display that has both the functions of a display device 203 and an input device 205. When a user presses any point on the screen of the touch panel display with their finger, the CPU 200 determines that there has been an input instruction from the user, determines the content of the operation from the pressed position, and performs various processes such as updating the display.

[0072] The notification UI 507 includes a message notification frame 508, a setting delete button 509, and a setting keep button 510.

[0073] Message notification frame 508 displays text to inform the user of the situation.

[0074] The setting delete button 509 (delete instruction button) is one of the selectable options that the user can switch between. If the confirm button 506 is pressed while the setting delete button 509 is selected, the CPU 200 determines that the examiner has instructed the deletion of patient information and deletes the currently set patient information from the camera's internal memory. Similarly, if the user presses the setting delete button 509 with their finger, the CPU 200 also determines that the examiner has instructed the deletion of patient information and deletes the currently set patient information from the camera's internal memory.

[0075] The setting hold button 510 (hold instruction button) is one of the selectable options that the user can switch between. If the confirm button 506 is pressed while the setting hold button 510 is selected, the CPU 200 determines that the examiner has instructed the camera to retain patient information and retains the currently set patient information in the camera's internal memory. Similarly, if the user presses the setting hold button 510 with their finger, the CPU 200 also determines that the examiner has instructed the camera to retain patient information and retains the currently set patient information in the camera's internal memory.

[0076] Figure 6 is a table showing an example of camera settings stored in the camera's internal memory.

[0077] The camera settings shown in Figure 6 are stored in the camera's internal memory and used in the following steps: the walking condition check process in step S703, the setting retention condition check process in step S706, and the setting deletion condition check process in step S708. Figure 6 only provides a brief explanation of each camera setting item; further details will be explained in Figure 7 and subsequent figures.

[0078] Data 600 is data representing patient information. For example, in Data 600, the patient's name and ID are managed using comma separation. The patient information obtained in steps S403 and S409 mentioned above corresponds to Data 600.

[0079] Data 601 is data indicating the time interval at which walking information is acquired from the walking measurement device 101. In this embodiment, this data defines the execution interval of the polling check in steps S404 to S406 described above. Note that the polling check does not necessarily have to be performed at the time interval shown in data 601; data 601 can be used as a guideline for the execution interval, and the check may be performed at least at the time interval shown in data 601.

[0080] Data 602 is a threshold for the number of steps taken by the examiner to be considered as walking. In this embodiment, if the number of steps taken since the last patient image was taken by the imaging device 100 is equal to or greater than the threshold shown in data 602, the CPU 200 detects that the examiner has walked.

[0081] Data 603 is a threshold for walking time that indicates the examiner has walked. In this embodiment, the CPU 200 detects the examiner walking if the walking time since the last patient image was taken by the imaging device 100 is greater than or equal to the threshold shown in data 603.

[0082] Data 604 is a value indicating whether or not the CPU 200 detected the examiner's walking (walking detection result). The walking detection result value shown in Data 604 will be used in step S704 described later.

[0083] Data 605 is the threshold for detecting inactivity time, which is the time at which the examiner is considered not to be operating the imaging device 100 (no operation). In this embodiment, if the elapsed time since the notification UI 507 described in Figure 5 above was displayed is greater than or equal to the threshold shown in data 605, the CPU 200 detects inactivity and deletes the patient information settings.

[0084] Data 606 is data indicating the shooting mode when walking is detected. The data indicating the shooting mode when the notification UI 507 described in Figure 5 above is displayed is stored as data 606. Data 606 will be used in the determination process in step S1006 described later.

[0085] Data 607 is a threshold number of times the release button 501 is pressed before the examiner is deemed to be continuing the imaging operation. For example, if the number of times the release button 501 has been pressed since the notification UI 507 described in Figure 5 above was displayed is equal to or greater than the threshold shown in data 607, the CPU 200 determines that the examiner is continuing the imaging operation, and the patient information in the camera's internal memory is retained.

[0086] Data 608 is data that manages the determination result (setting retention detection result) of whether or not to retain the patient information settings. Data 608 is used in the determination processing in steps S707 and S709 described later.

[0087] The above describes an example of the data held by the imaging device 100 according to the present invention. It should be noted that each piece of data may be modified later on the imaging device 100 by the examiner (e.g., a nurse).

[0088] Figure 7 is a flowchart showing an example of a patient information setting process performed in the imaging device 100.

[0089] Using the flowchart in Figure 7, we will explain in detail how the settings of patient information held in the camera's internal memory are processed when the examiner's walking is detected after patient imaging has been performed, using the notification UI 507 in Figure 5 and the camera settings in Figure 6.

[0090] In step S701, when the patient information acquisition function is activated during live view display, the CPU 200 acquires patient information from the barcode displayed in the live view and saves the patient information to the camera's internal memory. This process corresponds to steps S408 and S409 in Figure 4. At this time, the patient information is saved to the camera's internal memory as data 600 in Figure 6. Furthermore, after the examiner takes a picture of the patient, the gait information managed by the gait measurement device 101 and the camera's internal memory is deleted (reset). This process corresponds to steps S410a, S410b, and S411 in Figure 4. The process then proceeds to step S702.

[0091] In step S702, the CPU 200 saves the gait information (e.g., number of steps, walking time) acquired from the gait measurement device 101 by the final polling check to the RAM 202. Note that if patient information is saved to the camera's internal memory in step S701, there is a risk that the processes in steps S702 to S704 will be executed repeatedly at high speed until the gait conditions are met in step S704, which will be described later. For this reason, it is desirable to set the interval for polling checks to not acquire data at intervals shorter than the time interval shown in data 601.

[0092] In step S703, the CPU 200 performs a walking condition check process to determine whether or not the examiner walked, using the walking information acquired in step S702. This process will be explained in detail in Figure 8 below.

[0093] In step S704, the CPU 200 obtains the gait detection result value shown in data 604 and determines whether or not the examiner's gait was detected. The gait detection result value reflects the processing result of step S703 described above. If it is determined that the examiner's gait was detected (the gait condition is met), the process proceeds to step S705; otherwise, it proceeds to step S702.

[0094] In step S705, the CPU 200 displays a notification UI 507 (Figure 5) on the touch panel display indicating that the examiner's walking has been detected. At this time, the CPU 200 starts measuring the number of times the release button 501 has been operated and compares it with the threshold shown in the data 607 described above. This comparison result will be used in step S905, which will be described later. The CPU 200 also saves the shooting mode to the RAM 202 in a format such as data 606. The shooting mode saved in the RAM 202 will be used in step S1006, which will be described later. Furthermore, the CPU 200 (stopping means) stops the imaging process caused by the operation of the release button 501 while the notification UI 507 is displayed. This prevents the generation of imaging data associated with patient information set in the camera's internal memory, even though the patient being imaged may have changed.

[0095] In step S706, the CPU 200 performs a setting retention condition check process to determine whether or not to retain the settings of the patient information held in the camera memory unit. This process will be explained in detail in Figure 9 below.

[0096] In step S707, the CPU 200 obtains the value of the setting retention detection result shown in data 608 and determines whether or not to retain the patient information settings stored in the camera memory unit. The value of the setting retention detection result reflects the processing result of step S706 described above. If it is determined that the patient information settings stored in the camera memory unit should be retained (the setting retention condition is met), the process proceeds to step S702; otherwise, the process proceeds to step S708. If the setting retention condition is met, the CPU 200 closes the notification UI 507 displayed in step S705 and prepares the system for imaging processing by operating the release button 501.

[0097] In step S708, the CPU 200 performs a setting deletion condition check process to determine whether or not to delete the patient information settings held by the imaging device 100. This process will be explained in detail in Figure 10 below.

[0098] In step S709, the CPU 200 obtains the value of the setting retention detection result shown in data 608 and determines whether or not to retain the patient information settings held in the camera memory unit. The value of the setting retention detection result reflects the processing result of step S708 described above. In this step (step S709), the same processing as in step S707 described above is executed. If the setting retention condition is met, the process proceeds to step S706; otherwise, the process proceeds to step S710. As a side note, if the setting retention condition is not met, the CPU 200 closes the notification UI 507 displayed in step S705.

[0099] In step S710, the CPU 200 (deletion means) deletes the patient information saved in step S701. For example, the CPU 200 deletes the patient information settings held in the camera memory by overwriting the patient information of data 600 with an empty value. After completing this step (step S710), the CPU 200 can prepare for the next patient imaging by restarting the imaging sequence in Figure 4 from step S408 (live view display).

[0100] Figure 8 is a flowchart showing an example of the walking condition check process in step S703 of Figure 7.

[0101] The following explanation of this process will be given in detail using Figure 6 (camera settings).

[0102] In step S801, the CPU200 initializes the value of the gait detection result of data 604 to FALSE.

[0103] In step S802, the CPU 200 acquires data 602, which is the threshold for the number of steps the examiner considers to have walked, and data 603, which is the threshold for the walking time the examiner considers to have walked, from the camera's internal storage. In this embodiment, the value of data 602 (threshold for the number of steps) is set to 7 steps, and the value of data 603 (threshold for the walking time) is set to 5 seconds.

[0104] In step S803, the CPU 200 compares the number of steps obtained from the gait measurement device 101 in step S702 with the threshold (7 steps) shown in data 602 to determine whether the examiner walked or not. If the number of steps obtained is equal to or greater than the threshold, the process proceeds to step S804; otherwise, it proceeds to step S805.

[0105] In step S804, the CPU 200 updates the value of the gait detection result in data 604 to TRUE. As a result, it is determined in step S704 that the gait condition has been met.

[0106] In step S805, the CPU 200 compares the walking time obtained from the gait measurement device 101 in step S702 with the threshold (5 seconds) shown in data 603 to determine whether the examiner walked or not. If the obtained walking time is greater than or equal to the threshold, the process proceeds to step S804; otherwise, it proceeds to step S806.

[0107] In step S806, the CPU 200 determines whether the imaging device 100 is in a horizontal movement state. For example, by using the two-axis acceleration sensor and angular velocity sensor (gyro sensor) that make up the detection device 208, it is possible to determine whether the imaging device 100 is in an upward or downward movement state or a horizontal movement state. If it is in a horizontal movement state, the process proceeds to step S804; otherwise, this process ends and the process proceeds to step S704 as described above. Note that the imaging device 100 is in a horizontal movement state for example, when the examiner is moving the imaging device 100 on a nurse's cart.

[0108] In this process, it is sufficient for the determinations in steps S803 to S806 to be performed, and the order is not limited to that of this embodiment.

[0109] Figure 9 is a flowchart showing an example of the setting retention condition check process in step S706 of Figure 7.

[0110] The following will explain this process in detail using Figure 5 (Notification UI) and Figure 6 (Camera Settings).

[0111] In step S901, the CPU200 initializes the value of the setting retention detection result for data 608 to FALSE.

[0112] In step S902, the CPU 200 obtains data 607 from the camera's internal memory, which is the threshold number of times the release button 501 should be pressed before the inspector is deemed to be continuing the imaging operation. In this embodiment, the value of data 607 (the threshold number of times the release button 501 is pressed) is set to 3. Note that the value of data 607 can be changed as appropriate by the inspector or other personnel.

[0113] In step S903, the CPU 200 determines whether the setting retention button 510 of the notification UI 507, which receives an instruction to retain the patient information being set in the camera's internal memory, has been pressed. If the setting retention button 510 has been pressed, the process proceeds to step S904; otherwise, the process proceeds to step S905.

[0114] In step S904, the CPU200 updates the value of the setting retention detection result in data 608 to TRUE. As a result, in step S707, it is determined that the setting retention condition has been met.

[0115] In step S905, the CPU 200 determines whether the number of times the release button 501 has been operated since the notification UI 507 was displayed in step S705 is equal to or greater than the threshold (equal to the specified number) shown in data 607. If the number of operations is equal to or greater than the threshold, the process proceeds to step S904; otherwise, this process ends and the process proceeds to step S707.

[0116] Figure 10 is a flowchart showing an example of the setting deletion condition check process in step S708 of Figure 7.

[0117] The following will explain this process in detail using Figure 5 (Notification UI) and Figure 6 (Camera Settings).

[0118] In step S1001, the CPU 200 initializes the value of the setting retention detection result of data 608 to TRUE. Note that when the setting retention detection result of data 608 was initialized in step S901, its value was set to FALSE. When considering mutual exclusion, for example, instead of using the same data 608 for the setting retention condition check process and the setting deletion condition check process, a separate setting deletion detection result may be added to the camera setting value in Figure 6 for the setting deletion condition check process.

[0119] In step S1002, the CPU 200 acquires the idle time (data 605) and the shooting mode (data 606) when walking is detected, which are thresholds for deleting the patient information settings held in the camera's internal memory. In this embodiment, the value of data 605 (threshold for idle time) is set to 10 seconds. Note that the value of data 605 can be changed as appropriate by the examiner or other personnel.

[0120] In step S1003, the CPU 200 determines whether the setting delete button 509 of the notification UI 507, which accepts an instruction to delete patient information currently set in the camera's internal memory, has been pressed (i.e., a prescribed operation has occurred). If the setting delete button 509 has been pressed, the process proceeds to step S1004; otherwise, the process proceeds to step S1005.

[0121] In step S1004, the CPU 200 updates the value of the setting retention detection result for data 608 to FALSE. As a result, in step S709, it is determined that the setting retention condition is not met.

[0122] In step S1005, the CPU 200 determines whether the idle time of the imaging device 100 is greater than or equal to the threshold shown in data 605 (i.e., whether idle time exceeding a specified time has been detected). The timing for starting to measure the idle time of the imaging device 100 may be, for example, the timing when the notification UI 507 is displayed in step S705, or the timing when the imaging device 100 was last operated. If the idle time of the imaging device 100 is greater than or equal to the threshold shown in data 605, the process proceeds to step S1004; otherwise, the process proceeds to step S1006.

[0123] In step S1006, the CPU 200 determines whether the shooting mode has changed (i.e., whether a prescribed operation has occurred) since it was acquired in step S1002. If the shooting mode has changed, the process proceeds to step S1004; otherwise, it proceeds to step S1007. The difference between steps S1005 and S1006 is that in step S1005, even if the imaging device 100 is inactive, the process does not immediately proceed to step S1004, whereas in step S1006, the process proceeds immediately if the shooting mode has changed. The timing for saving the shooting mode of data 606 has already been explained in step S705 and is therefore omitted here.

[0124] In step S1007, the CPU 200 further determines whether the examiner has walked. This determination is performed by a process equivalent to the walking condition check process in Figure 8, based on walking information (number of steps or walking time: second walking information) obtained from the walking measurement device 101 by polling checks while the notification UI 507 is displayed. For example, if the value of data 602 (step threshold) is 7 steps, and 7 or more steps are detected while the notification UI 507 is displayed, it is determined in this step (step S1007) that the examiner has walked. If the number of steps obtained in step S1002 is equal to or greater than the threshold shown in data 602, the process proceeds to step S1004; otherwise, this process ends and the process proceeds to step S709 as described above.

[0125] Figure 11 is an overhead view showing how the examiner uses System 1 to photograph each patient in the large room 1100.

[0126] Up to this point, the inspection process performed by System 1 has been explained in detail using the sequences in Figure 4, the notification UI 507 in Figure 5, the camera settings in Figure 6, and the flowcharts in Figures 7 to 10. In Figure 11, the meaning of each figure number will first be explained. Then, an effective example of the present invention, assumed when System 1 is used for mobile imaging in a large room 1100 by an examiner (e.g., a nurse), will be described.

[0127] Furthermore, room 1100 is a room intended for multiple patients to be admitted to the ward, and in the example shown in Figure 11, it is a four-bed room.

[0128] The overhead view of the large room 1100 in Figure 11 includes the examiner 1101, nurse cart 1102, partition curtain 1103, patients 1104-1107, and walking trajectory 1108.

[0129] The examiner (e.g., a nurse) 1101 carries an imaging device 100 and a gait measurement device 101, walks around to the beds of each patient 1104-1107, and takes images of the affected area while communicating with each patient 1104-1107.

[0130] The nurse cart 1102 has casters for smooth horizontal movement and is mainly used to transport items needed during rounds, such as a laptop computer, imaging device 100, blood pressure monitor, and disinfectant. In this embodiment, the case in step S806 in which the imaging device 100 is determined to be in a horizontal movement state corresponds to the case in which the examiner is moving the imaging device 100 on the nurse cart 1102.

[0131] Partition curtain 1103 is used to protect the privacy of patients 1104-1107 who are hospitalized in the large room 1100.

[0132] Patients 1104-1107 are patients lying in individual medical beds located in the large room 1100. For example, if the medical bed size is 200 x 90 centimeters, and the headboard edge of each medical bed is against the wall of the large room 1100 as shown in Figure 11, then it is not possible to walk along the headboard edge of the bed. Therefore, the maximum distance an examiner can walk across a single medical bed in the large room is 490 centimeters (200 x 2 + 90).

[0133] Walking trajectory 1108 is the walking trajectory taken by examiner 1101 when taking round-trip images in the general room 1100 using system 1. Note that walking trajectory 1108 is merely one example of a route taken by examiner 1101 to visit each patient 1104-1107 in the general room 1100, and is not limited to this walking trajectory.

[0134] Next, a preferred example of examiner 1101 taking round-trip images of each patient 1104-1107 in the large room 1100 will be described. In this embodiment, examiner 1101 rounds out patients 1104, 1105, 1106, and 1107 in that order during round-trip imaging.

[0135] First, examiner 1101 walks to patient 1104's bedside. While communicating with patient 1104, the examiner turns on the power of the imaging device 100. At this time, the imaging device 100 cannot take images of the affected area of ​​patient 1104 because patient information of patient 1104 has not yet been stored in the camera's internal memory.

[0136] However, after the imaging device 100 is powered on, if the examiner 1101 communicates with the patient 1104 for a while without walking, the CPU 200 starts the imaging sequence and displays a live view on the display device 203 of the imaging device 100. After this live view display starts, the examiner 1101 adjusts the orientation of the imaging device 100 so that the barcode or other information indicating patient information printed on the wristband worn by patient 1104 is included in this live view. This activates the patient information acquisition function of the imaging device 100, and patient 1104's patient information is stored in the camera's internal memory unit of the imaging device 100.

[0137] Subsequently, examiner 1101 takes one photograph of the affected area of ​​patient 1104 at the spot and begins walking to patient 1104's feet. At this point, when examiner 1101 arrives at patient 1104's feet and takes another photograph of the affected area, none of the steps, walking time, or horizontal movement conditions described in the walking condition check process in Figure 8 above are met, so the CPU 200 does not detect that the examiner has walked. Therefore, the notification UI 507 (Figure 5) is not displayed on the imaging device 100, and examiner 1101 can continue the process of saving the photographed data associated with patient 1104's patient information each time a photograph is taken of the affected area of ​​patient 1104.

[0138] Next, when examiner 1101 places the imaging device 100 on the nurse cart 1102 and begins walking toward patient 1105, the walking condition check process in Figure 8 above detects horizontal movement of the imaging device 100. In this case, the CPU 200 resets the walking information in the camera's internal memory, starts the imaging sequence, and displays a live view on the display device 203 of the imaging device 100. Furthermore, when the walking condition check process in Figure 8 above detects horizontal movement of the imaging device 100, a notification UI 507 (Figure 5) is displayed on the imaging device 100. This informs examiner 1101 that the patient being imaged may have changed.

[0139] Upon arriving at patient 1105's bedside, examiner 1101 checks the notification UI 507 displayed on the imaging device 100 and presses the setting deletion button 509, which indicates an instruction to delete the patient information settings. As a result, patient 1104's patient information is deleted from the camera's internal memory, and the CPU 200 resumes the imaging sequence and displays a live view on the imaging device 100's display device 203. After this live view display starts, examiner 1101 adjusts the orientation of the imaging device 100 so that the barcode or other information indicating patient information, printed on the wristband worn by patient 1105, is visible in the live view. This activates the imaging device 100's patient information acquisition function, and patient 1105's patient information is saved in the imaging device 100's internal memory.

[0140] After the examiner 1101 has finished photographing the affected area of ​​patient 1105, they begin walking towards the next patient, 1106.

[0141] When examiner 1101 arrives at patient 1106's bedside, they begin preparations such as changing the patient's position for imaging of the affected area while communicating with the patient. At this time, the walking condition check process described in Figure 8 detects that the examiner has walked, and a notification UI 507 (Figure 5) is displayed on the imaging device 100. However, the setting deletion condition check process in Figure 10 determines that if the time since the display of the notification UI 507 exceeds a threshold (10 seconds in this embodiment) (i.e., there has been inactivity for longer than the specified time), the patient information of patient 1105 is deleted from the camera's internal memory. After this deletion of patient information, the CPU 200 resumes the imaging sequence and displays a live view on the display device 203 of the imaging device 100. This helps to prevent errors by the examiner in registering patient information. Furthermore, since the live view is already displayed on the imaging device 100, the examiner can quickly activate the patient information acquisition function of the imaging device 100 and acquire patient information of patient 1106 from the barcode on patient 1106's wristband, etc.

[0142] Once examiner 1101 has finished preparing for imaging of patient 1106, such as changing the patient's position, he adjusts the orientation of the imaging device 100 so that the barcode on patient 1106's wristband is visible in the live view displayed on the imaging device 100. This activates the patient information acquisition function of the imaging device 100, and patient 1106's patient information is stored in the camera's internal memory.

[0143] Subsequently, if the examiner takes one photograph of the affected area of ​​patient 1106, and then makes additional round trips to change patient 1106's position at the bedside, the notification UI 507 (Figure 5) will appear on the imaging device 100, even though patient 1106 is still the patient being photographed. This is because, in the walking condition check process shown in Figure 8 above, either the number of steps or the walking time exceeds the threshold, and the examiner is detected as having walked. At this point, if the examiner 1101 presses the setting hold button 510 on the notification UI 507, which holds the patient information being set, the examiner can continue photographing the affected area of ​​patient 1106 while retaining the patient information of patient 1106 in the camera's internal memory. However, operating the touch panel display of the imaging device 100 with one hand is difficult, and considering situations such as when the examiner is assisting the patient with one hand for photography, the operability is not good. In such situations, the examiner only needs to operate the release button 501 three times with one hand, for example. As a result, the patient information of patient 1106 in the camera's internal memory is retained, the display of the notification UI 507 ends, and the camera becomes ready to take pictures by pressing the release button 501, allowing the examiner to easily continue taking pictures of the affected area of ​​patient 1106.

[0144] Finally, when examiner 1101 places the imaging device 100 on the nurse cart 1102 and begins walking toward patient 1107, the walking condition check process in Figure 8 above detects horizontal movement of the imaging device 100. In this case, the CPU 200 resets the walking information in the camera's internal memory, starts the shooting sequence, and displays a live view on the imaging device 100's display device 203. Furthermore, when the walking condition check process in Figure 8 above detects horizontal movement of the imaging device 100, the imaging device 100 displays a notification UI 507 (Figure 5).

[0145] When examiner 1101 arrives at patient 1105's bedside, they check the notification UI 507 on the imaging device 100, but do not press either the setting delete button 509 or 510 within the notification UI 507. Instead, they change the shooting mode to adjust brightness or for other purposes. In this case, the setting delete condition check process in Figure 10 determines that the shooting mode has been changed (YES in step S1006), and patient information for patient 1106 is deleted from the camera's internal memory. After this patient information deletion, the CPU 200 resumes the shooting sequence and displays a live view on the display device 203 of the imaging device 100. This allows for easy deletion of patient information settings without having to press the setting delete buttons 509 or 510. Furthermore, since the live view is already displayed on the imaging device 100, the examiner can quickly activate the patient information acquisition function of the imaging device 100 and acquire patient information for patient 1107 from the barcode on patient 1107's wristband, etc.

[0146] After changing the shooting mode, examiner 1101 adjusts the orientation of the imaging device 100 so that the barcode on patient 1107's wristband is visible in the live view displayed on the imaging device 100. This activates the patient information acquisition function of the imaging device 100, and patient 1106's patient information is saved in the camera's internal memory.

[0147] After the examiner has finished taking images of the affected area of ​​patient 1107, they leave room 1100.

[0148] Thus, even in indoor settings such as a large room 1100 where GPS information acquisition is difficult, and where the examiner moves around and photographs patients one after another, the imaging device 100 can accurately detect a change in the patient being photographed from their walking motion and notify the examiner. Furthermore, after notification, the imaging device restricts the examiner from photographing the affected area until a specific operation or action by the examiner is detected, thereby preventing errors in the registration process of associating the image data of the affected area with patient information.

[0149] In this embodiment, patient information is obtained from the barcode on the patient's wristband, but other information such as medical information may also be obtained simultaneously.

[0150] Although the present invention has been described in detail above based on its preferred embodiments, the present invention is not limited to these specific embodiments, and various forms that do not depart from the spirit of the invention are also included in the present invention. Some of the above embodiments may be combined as appropriate.

[0151] Furthermore, the present invention also includes cases in which a software program that realizes the functions of the above-described embodiment is supplied directly from a recording medium or via wired / wireless communication to a system or device having a computer capable of executing the program, and the program is executed.

[0152] Therefore, in order to implement the functional processing of the present invention on a computer, the program code supplied to and installed on the computer itself also realizes the present invention. In other words, the computer program itself for realizing the functional processing of the present invention is also included in the present invention.

[0153] In that case, the form of the program is irrelevant, as long as it possesses the functionality of a program, including object code, programs executed by an interpreter, and script data supplied to the OS.

[0154] The recording medium for supplying the program may be, for example, a hard disk, a magnetic recording medium such as magnetic tape, an optical / magneto-optical storage medium, or a non-volatile semiconductor memory.

[0155] Another possible method for supplying the program is to store the computer program forming the present invention on a server on a computer network, and have connected client computers download and execute the computer program. [Explanation of Symbols]

[0156] 1 System 100 Imaging device 101 Pedestrian Measurement Device 200 CPU 203 Display device 204 Imaging Department 205 Input device 207 Network Interfaces 208 Detection device 209 File Generation Section 501 Release Button 507 Notification UI

Claims

1. An examination assistance device having the following functions: acquiring patient information of a patient identifier through a reading operation by the examiner and storing it in the camera's internal memory; generating imaging data by taking an image through an imaging operation by the examiner; and storing the imaging data in association with the patient information stored in the camera's internal memory, A means for acquiring walking information related to the examiner's walking, A notification means for notifying the examiner based on the aforementioned walking information, While the aforementioned notification is being made, a stop means is provided to stop the imaging operation, A deletion means for deleting the patient information from the camera's internal storage based on the actions of the examiner while the aforementioned notification is being made, When the patient information is deleted from the camera's internal storage by the deletion means, the termination means terminates the notification. A second detection means for detecting horizontal movement, It has, The inspection assistance device is characterized in that the notification means makes the notification based on the detection by the second detection means.

2. The inspection assistance device according to claim 1, characterized in that the walking information is the number of steps or walking time taken by the examiner after imaging was performed by the imaging operation.

3. The system further comprises a first detection means for detecting the walking of the inspector, The inspection assistance device according to claim 1 or 2, characterized in that the acquisition means acquires the walking information based on the detection result of the first detection means.

4. The system further comprises communication means for communicating with an external device that detects the walking of the examiner, The inspection assistance device according to claim 1 or 2, characterized in that the acquisition means acquires the walking information based on the detection result of the external device received by the communication means.

5. The examination assistance device according to any one of claims 1 to 4, characterized in that if a prescribed operation by the examiner is detected while the aforementioned notification is being made, the patient information is deleted by the deletion means and the notification is terminated.

6. The notification means further includes a delete instruction button that receives an instruction to delete the patient information from the camera's internal storage unit. The inspection assistance device according to claim 5, characterized in that the aforementioned operation is the selection and determination operation of the delete instruction button.

7. The inspection assist device according to claim 5, characterized in that the aforementioned operation is an operation to change the shooting mode of the inspection assist device.

8. The inspection assistance device according to any one of claims 1 to 7, characterized in that if inactivity for a specified period of time or longer is detected while the notification is being made, the patient information is deleted by the deletion means and the notification is terminated.

9. The acquisition means further acquires second walking information, which is the number of steps or walking time taken by the inspector while the notification is being given. The examination assistance device according to any one of claims 1 to 8, characterized in that the deletion of the patient information by the deletion means is performed based on the second walking information.

10. The inspection assistance device according to any one of claims 1 to 9, characterized in that the termination means terminates the notification while retaining the patient information stored in the camera's internal storage if another prescribed operation is performed while the notification is being given.

11. The notification means further includes a retain instruction button that receives an instruction to retain the patient information stored in the camera's internal storage unit. The inspection assistance device according to claim 10, characterized in that the other operation specified above is the selection and determination operation of the hold instruction button.

12. The inspection assistance device according to claim 10, characterized in that the other operations specified in the provisions are the imaging operations a specified number of times or more while the notification is being given.

13. A control method for an examination assistance device having the following functions: acquiring patient information of a patient identifier through a reading operation by the examiner and storing it in the camera's internal memory; generating imaging data by taking an image through an imaging operation by the examiner; and storing the imaging data in association with the patient information stored in the camera's internal memory; The acquisition step involves acquiring gait information regarding the examiner's walking, A notification step in which the examiner is notified based on the aforementioned walking information, While the aforementioned notification is being given, the stopping step stops the imaging operation, A deletion step is performed to delete the patient information from the camera's internal storage based on the actions of the examiner while the aforementioned notification is being given. If the patient information is deleted from the camera's internal storage in the deletion step, the termination step terminates the notification. A second detection step for detecting horizontal movement, It has, The control method is characterized in that the notification step is performed based on the detection in the second detection step.

14. A computer-executable program that causes a computer to function as each step of the inspection assistance apparatus described in any one of claims 1 to 12.

Images