Safety device

Abstract

To prevent a patient from unconsciously removing a puncture needle or a tube during dialysis treatment, nasogastric tube treatment, etc.SOLUTION: A safety device 10 comprises a terminal device 30 and a camera 40. The camera 40 takes an image of a patient 20 and transmits the captured image data to the terminal device 30. A control device 31 in the terminal device 30, on the basis of sample images stored in a memory 37, identifies a target such as a puncture needle appearing in the captured image. The control device 31, when detecting that the targeted image is blurred, a part of the targeted image is missing, or a focal distance is changed, determines that the patient has put out his / her hand to the target, and alerts a doctor or nurse by image, voice, etc.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a safety device for use in artificial dialysis, nasogastric tubes, etc. [Background technology]

[0002] In artificial dialysis, nasogastric tubes, and the like, typically when a patient has dementia, the patient may unconsciously remove the puncture needle or (nutrition) tube. If the puncture needle is removed during artificial dialysis, blood will leak, which is dangerous for the patient. To avoid such danger, a moisture sensor has been proposed as a safety device for artificial dialysis (see, for example, Patent Document 1). This moisture sensor detects blood running down the patient's arm when the puncture needle becomes dislodged from the patient's arm. When the moisture sensor detects blood and determines that the puncture needle has become dislodged from the arm, it issues an alert with a buzzer sound. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2015-167697 A Summary of the Invention [Problem to be solved by the invention]

[0004] The safety device (moisture sensor) disclosed in Patent Document 1 detects blood running down the patient's arm, and therefore cannot issue a warning before the puncture needle comes off the patient's arm. In other words, the safety device disclosed in Patent Document 1 cannot prevent the patient from unintentionally removing the puncture needle from the patient's arm. The same is true for the tube in the nasogastric tube.

[0005] The present invention has been made against this background, and its object is to provide a safety device that prevents a patient from removing a puncture needle or tube in artificial dialysis, a nasogastric tube, or the like. [Means for solving the problem]

[0006] (1) A safety device according to the present invention includes a camera that captures an image of an imaging area including a patient's arm or nose and outputs captured image data, a control device to which the captured image data is input, and an alarm device capable of communicating with the control device. The control device executes a target identification process that identifies a target image showing a predetermined target shown in an image represented by the captured image data, a determination process that determines whether or not a foreign object has approached the target based on changes in two different target images identified at a predetermined time interval, and an alarm process that outputs alarm information to the alarm device based on the determination that a foreign object has approached the target in the determination process.

[0007] The camera captures an image of an imaging area including the patient's arm into which the puncture needle is inserted or the patient's nose into which a (nutrition) tube is inserted, and outputs captured image data. The captured image data is input to a control device. The control device specifies an image of a target (target image) shown in the captured image indicated by the input captured image data. The target is, for example, a puncture needle, a tube, gauze on which the puncture needle or tube is placed, tape for fixing the puncture needle or tube, an arm, a nose, a marker, etc. When a patient unconsciously reaches for the puncture needle inserted in the arm or the tube connected to the nose, the outstretched hand hides the target image, or the target image becomes out of focus and blurred. The control device determines whether a foreign object (the patient's hand) has approached the target based on changes in two different target images specified at a predetermined time interval. That is, the control device determines whether the patient unconsciously reaches for the puncture needle or tube. When the control device determines that the patient is unconsciously reaching for the puncture needle or tube to remove it, it outputs notification information to the alarm device to issue a warning. Therefore, the safety device according to the present invention can prevent the patient from removing the puncture needle or tube from his / her arm or nose. The alarm device may be, for example, a speaker, a display, or a mobile communication terminal carried by the doctor (nurse).

[0008] (2) The camera may have an autofocus function. The change between the two different target images identified at a predetermined time interval is a change in width of the outline or pattern of the target image caused by the autofocus function. The determination process determines that a foreign object has approached the target based on the change in width being equal to or greater than a first threshold, and determines that a foreign object has not approached the target based on the change in width being less than the first threshold.

[0009] When a patient reaches for the puncture needle or tube and the hand comes between the camera and the target, the camera uses an autofocus function to focus on the hand. This causes the camera to lose focus on the target, such as the puncture needle, and the target image becomes blurred. In other words, the width of the outline or pattern of the target image becomes wider. If the change in the width of the outline or pattern of the target image is equal to or greater than a first threshold, the control device determines that the patient is unconsciously reaching for the puncture needle or tube to remove the puncture needle or tube.

[0010] (3) The change between the two different target images identified at a predetermined time interval may be a change in a matching rate between the two target images. In the target identification process, the determination process determines that a foreign object has approached the target based on the matching rate being less than a second threshold, and determines that a foreign object has not approached the target based on the matching rate being equal to or greater than the second threshold.

[0011] When the patient unconsciously reaches for the puncture needle in the arm or the tube in the nose and the hand gets between the target and the camera, a part or all of the target image is not captured. When the matching rate of the two different target images identified at a predetermined time interval becomes less than a second threshold, the control device determines that the patient has unconsciously reached for the puncture needle or tube.

[0012] (4) The camera may have an autofocus function and output a focal length together with the captured image data. The change between the two different target images identified at a predetermined time interval is a change between the two focal lengths corresponding to the target images. The determination process is a process of determining that a foreign object has approached the target based on the change in the focal length being equal to or greater than a third threshold, and determining that a foreign object has not approached the target based on the change in the focal length being less than the third threshold.

[0013] When a patient unconsciously reaches for the puncture needle in his arm or the tube in his nose and the hand comes between the camera and a target such as the puncture needle, the tube, or the gauze, the autofocus function of the camera is activated to focus on the hand and change the focal length. If the change in focal length is equal to or greater than a third threshold, the control device determines that the patient has unconsciously reached for the puncture needle or the tube.

[0014] (5) The control device may include a memory that stores sample image data showing at least one of an arm, a nose, a tape, a puncture needle, a tube, gauze, or a marker. The target is at least one of a patient's arm, a nose, a tape, a puncture needle, a tube, gauze, or a marker. The target identification process includes a first process of identifying an object shown in the captured image, and a second process of identifying the target based on a matching rate between the identified object and a sample image shown by the sample image data.

[0015] According to the above configuration, the target can be reliably identified using the sample image.

[0016] (6) The control device may include a memory that stores first sample image data showing an arm or a nose, and second sample image data showing at least one of a tape, a puncture needle, a tube, gauze, or a marker. The target is at least one of a tape, a puncture needle, a tube, gauze, or a marker. The target identification process includes a first process of identifying an object shown in the captured image, a third process of identifying the patient's arm or nose based on a matching rate between the identified object and a first sample image shown by the first sample image data, and a second process of identifying the target based on a matching rate between the identified object located on the patient's arm or under the nose and a second sample image shown by the second sample image data.

[0017] The control device identifies the patient's arm or nose in the captured image. The control device identifies a target based on the object on the identified arm or under the nose and the second sample image. This makes it possible to prevent an object in an area other than the arm or under the nose from being erroneously identified as a target.

[0018] (7) The control device may further include a touch panel. The target identification process includes a display process for acquiring captured image data input from the camera, identifying an object shown in the captured image data, and displaying the captured image on the touch panel with an icon representing the identified object superimposed thereon, a designation receiving process for receiving designation of the icon via the touch panel, and a process for identifying the object represented by the designated icon as the target.

[0019] The control device can reliably identify a specific object (such as a patient's arm, nose, puncture needle, tube, tape, gauze, marker, etc.) as a target by accepting the designation from a doctor or nurse.

[0020] (8) The safety device according to the present invention may further include a camera attachment member having a fixing portion for fixing the camera and a mounting portion for being attached to the patient's arm or head.

[0021] Since the camera is attached to the patient's arm or head, the relative position between the camera and the target (puncture needle, tube, gauze, etc.) does not change even if the patient moves his / her arm or head, or even if the patient moves. Therefore, the safety device according to the present invention can reliably capture an image of the target with the camera even if the patient moves his / her arm or head, or even if the patient moves.

[0022] (9) A safety device according to the present invention includes a marker affixed to a patient's hand or arm, a camera for capturing an image of the patient, a control device to which captured image data output by the camera is input, and an alarm device capable of communicating with the control device. The control device executes a target position identification process for identifying a target position that is a position of a predetermined target shown in an image represented by the captured image data, a marker position identification process for identifying a marker position that is the position of the marker shown in the captured image, a proximity determination process for determining whether a separation distance between the target position and the marker position has become less than a fourth threshold, and an alarm process for outputting alarm information to the alarm device based on a determination that the separation distance has become less than the fourth threshold.

[0023] When the patient unconsciously reaches for the puncture needle or tube, the distance (separation distance) between the target and the marker becomes shorter. When the separation distance becomes less than the fourth threshold, an alarm is issued. Therefore, the safety device according to the present invention can prevent the puncture needle or tube from coming off the patient's arm or nose.

[0024] (10) The two cameras may be disposed at a distance from each other. The control device executes the target position specifying process and the marker position specifying process for each of the two captured images output by each camera, calculates the separation distance for each of the two captured image data in the approach determination process, and executes the notification process based on the determination that both of the two separation distances are less than the fourth threshold value.

[0025] The two cameras arranged at a distance from each other capture images of the patient from different directions. The captured image data output by each camera indicates captured images of the patient captured from different directions. In each captured image, the distance between the target position and the marker position is calculated and compared with a fourth threshold. When both of the distances are less than the fourth threshold, a notification process is executed. That is, when the marker (patient's arm) approaches the target (puncture needle, etc.) in both captured images, a notification process is executed. Therefore, it is possible to detect whether the patient unconsciously reaches out to the target more accurately than when using a single camera.

[0026] (11) The camera may be a stereo camera having two adjacent cameras. The target position and the marker position are positions in a three-dimensional space. The separation distance is a distance between the target position and the marker position in the three-dimensional space.

[0027] The stereo camera outputs two captured image data. An object captured in one captured image and an object captured in the other captured image have a parallax according to the distance from the camera to the object. The positions of the target and the marker in the three-dimensional space are calculated based on the position of the object (target and marker) in the captured image and the parallax. The position is indicated by, for example, the direction and distance (three-dimensional polar coordinates) of the target or the marker relative to the camera. In this way, the stereo camera functions as a device that detects the position of an object in the three-dimensional space in the imaging range. The control device calculates the distance between the target (such as a puncture needle) and the marker (the patient's arm) and compares the distance with a fourth threshold. Therefore, it is possible to detect whether the patient unconsciously reaches out to the target more accurately than when a normal camera is used.

[0028] (12) A program according to the present invention is implemented in a terminal device having a communication interface and a computer. The program includes: an image data acquisition process for acquiring image data input from a camera capturing an image of an imaging area including a patient's arm or nose at a predetermined time interval; a target identification process for identifying a target image showing a predetermined target appearing in an image represented by the captured image data; and a determination process for determining whether or not a foreign object has approached the target based on changes in two different target images identified at the predetermined time interval. The computer is caused to execute a notification process for outputting notification information based on the determination that a foreign object has approached the target in the determination process.

[0029] The present invention can also be understood as a program installed in a terminal device.

[0030] (13) A program according to the present invention is implemented in a terminal device having a communication interface and a computer. The program causes the computer to execute an image data acquisition process for acquiring image data input from a camera capturing an image of a patient with a marker affixed to his or her arm at a predetermined time interval, a target position identification process for identifying a target position that is a position of a predetermined target shown in an image represented by the captured image data, a marker position identification process for identifying a marker position that is the position of the marker, an approach determination process for determining whether a distance between the target position and the marker position is less than a fourth threshold, and a notification process for outputting notification information based on a determination that the distance has become less than the fourth threshold.

[0031] The present invention can also be understood as a program installed in a terminal device.

[0032] (14) A safety device according to the present invention includes a camera that captures an image of a patient and outputs captured image data, a control device to which the captured image data is input, an alarm device capable of communicating with the control device, a first marker affixed to one arm of the patient, and a second marker affixed to the other arm of the patient. The control device executes a first marker position identification process that identifies a position of the first marker shown in an image represented by the captured image data, a second marker position identification process that identifies a position of the second marker shown in the captured image, a relative distance calculation process that calculates a relative distance between the first marker and the second marker based on the positions of the first marker and the second marker, a proximity determination process that determines whether the relative distance is less than a fifth threshold, and an alarm process that outputs alarm information to the alarm device based on the determination in the proximity determination process that the relative distance is less than the fifth threshold.

[0033] The camera captures an image of the patient and outputs captured image data. The captured image data is input to a control device. The control device identifies the positions of the first marker and the second marker in the captured image shown by the input captured image data, and calculates the relative positions of the first marker and the second marker. When the patient unconsciously reaches out the other arm (hand) to the puncture needle inserted into the arm, the relative distance becomes shorter. When the relative distance becomes less than a fifth threshold, the control device determines that the patient is unconsciously reaching out the hand to the puncture needle to remove it, and outputs notification information to the notification device to notify the patient. Therefore, the safety device according to the present invention can prevent the patient from removing the puncture needle from the arm. The notification device is, for example, a speaker, a display, or a mobile communication terminal carried by a doctor (nurse).

[0034] (15) The safety device of the present invention includes a camera that captures an image of a patient and outputs the captured image data, a control device to which the captured image data is input, an alarm device capable of communicating with the control device, a first marker that is attached to the patient's head and neck, and a second marker that is attached to each of the patient's arms. The control device executes a first marker position identification process to identify a position of the first marker appearing in the captured image indicated by the captured image data; a second marker position identification process to identify the positions of each of the two second markers appearing in the captured image; a relative distance calculation process to calculate a first relative distance between the first marker and one of the second markers and a second relative distance between the first marker and the other of the second marker based on the positions of the first marker and the second marker; a proximity determination process to determine whether or not at least one of the first relative distance or the second relative distance is less than a fifth threshold; and an alarm process to output alarm information to the alarm device based on the determination in the proximity determination process that at least one of the first relative distance or the second relative distance is less than the fifth threshold.

[0035] The camera captures an image of the patient and outputs captured image data. The captured image data is input to the control device. The control device specifies the position of the first marker and the position of the second marker in the captured image shown by the input captured image data, and calculates a first relative position between the first marker and one of the second markers and a second relative distance between the first marker and the other of the second markers. When the patient unconsciously stretches his / her arm (hand) to the tube inserted in the nose, the first relative distance or the second relative distance becomes shorter. The control device determines that the patient is unconsciously stretching his / her hand to remove the tube based on at least one of the first relative distance and the second relative distance becoming less than a fifth threshold, and outputs notification information to the notification device to notify the patient. Therefore, the safety device according to the present invention can prevent the patient from removing the tube from the nose. The notification device is, for example, a speaker, a display, or a mobile communication terminal carried by a doctor (nurse). Effect of the Invention

[0036] The safety device according to the present invention can prevent a patient from removing a puncture needle or tube in artificial dialysis, a nasogastric tube, or the like. [Brief description of the drawings]

[0037] [Figure 1] FIG. 1 is a diagram illustrating the use of a safety device 10 according to a first embodiment of the present invention. [Diagram 2] FIG. 2 is an enlarged view of part II (arm 21 of patient 20) in FIG. [Diagram 3] FIG. 3 is a functional block diagram of the safety device 10. [Figure 4] FIG. 4 is a flowchart of the safety confirmation process of the safety device 10. [Diagram 5] FIG. 5 is a flowchart according to the first modification of the first embodiment. [Figure 6] FIG. 6 is a flowchart according to the second modification of the first embodiment. [Figure 7] FIG. 7 is a flowchart according to the third modification of the first embodiment. [Figure 8] FIG. 8 is a flowchart according to the fourth modification of the first embodiment. [Figure 9] FIG. 9 is a perspective view of a camera attachment member 70 and a camera 40 according to the fifth modification of the first embodiment. [Figure 10] FIG. 10 is a flowchart of a safety confirmation process in the second embodiment of the present invention. [Figure 11] FIG. 11 is a diagram illustrating the use of the safety device 10 according to the first modified example of the second embodiment. [Figure 12] FIG. 12 is a diagram illustrating the use of a safety device 10 according to a third embodiment of the present invention. [Figure 13] FIG. 13 is a flowchart of the safety confirmation process according to the third embodiment. [Figure 14] FIG. 14 is a diagram illustrating the use of the safety device 10 according to the first modified example of the third embodiment. [Figure 15]FIG. 15 is a flowchart of a safety confirmation process according to the first modified example of the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0038] Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. Note that this embodiment is merely one aspect of the safety device according to the present invention, and it goes without saying that the embodiment may be changed without departing from the gist of the present invention.

[0039] [First embodiment]

[0040] Fig. 1 shows a state in which a safety device 10 according to a first embodiment of the present invention is used on a patient 20 undergoing artificial dialysis. Fig. 2 is an enlarged view of part II in Fig. 1, showing an enlarged view of an arm 21 of the patient 20. Fig. 3 is a functional block diagram of the safety device 10. Fig. 4 is a flowchart of a safety confirmation process executed by the safety device 10.

[0041] As shown in Fig. 1, the safety device 10 is applied to a patient 20 undergoing dialysis. This safety device 10 issues a warning by a warning screen or a warning sound if the patient unconsciously tries to remove a puncture needle 62 (see Fig. 2) from the arm 21. This safety device 10 can also be applied to a patient 20 using a nasogastric tube. In this case, a warning is issued if the patient unconsciously tries to remove the (nutrition) tube from the nose. The following description will be given on the assumption that the safety device 10 is used for a patient 20 undergoing dialysis.

[0042] The safety device 10 includes a terminal device 30, a camera 40, and a mobile communication terminal 51 (see FIG. 3). The terminal device 30 and the camera 40 are installed near the bed 25 on which the patient 20 lies or near a chair (not shown) on which the patient sits. In FIG. 1, the terminal device 30 and the camera 40 are placed on a stand 26. The stand 26 is typically a storage box, a desk, or a table placed beside the bed 25. The mobile communication terminal 51 is a smartphone carried by a doctor or nurse for work, a tablet installed in a supervision room of a hospital, a personal computer, or the like.

[0043] As shown in FIG. 3, the camera 40 is a so-called digital camera, and includes an optical system 41 and a plurality of image pickup elements 42. The optical system 41 is made up of a plurality of lenses. The optical system 41 guides light incident from the outside to the image pickup elements 42. The image pickup elements 42 are CCD, CMOS, or the like. Each image pickup element 42 outputs pixel data according to the incident light. The pixel data includes pixel position data indicating a pixel position and color data indicating color, brightness, luminance, or the like. The pixel position data may be determined by the arrangement order of the plurality of pixel data. The plurality of pixel data forms captured image data. The captured image data may be data indicating a color image or may be data indicating a monochrome image. The captured image data may be data indicating a still image or may be data (frames) indicating a moving image.

[0044] Camera 40 further includes an autofocus mechanism 46. Autofocus mechanism 46 is, for example, a motor that changes the position of the lens of optical system 41, and changes the focal length of optical system 41. In other words, camera 40 has an autofocus function.

[0045] The camera 40 further includes a communication interface 47. The communication interface 47 is an interface for performing wireless communication (so-called wireless LAN (registered trademark)) such as Wi-Fi (registered trademark) and Bluetooth (registered trademark) or wired communication using a communication cable such as a LAN (registered trademark) cable. The camera 40 transmits captured image data generated by capturing an image to the terminal device 30 through the communication interface 47.

[0046] The camera 40 further includes a memory 44 in which a driver program 45 is stored, and a CPU 43 which is a central processing unit that executes the driver program 45. The driver program 45 executes a process of generating captured image data by the image sensor 42, a process of transmitting the captured image data through a communication interface 47, and a process of changing the focal length using an autofocus mechanism 46.

[0047] As the camera 40, for example, an existing (commercially available) digital camera is used.

[0048] The terminal device 30 is a terminal capable of communicating with other devices, such as a personal computer, a smartphone, or a tablet.

[0049] The terminal device 30 includes a control device 31 , a communication interface 32 , a speaker 33 , a display device 34 , and an input interface 35 .

[0050] The communication interface 32 is an interface for performing wireless communication (so-called wireless LAN (registered trademark)) such as Wi-Fi (registered trademark) and Bluetooth (registered trademark), wired communication using a communication cable such as a LAN (registered trademark) cable, mobile communication with a base station of a mobile communication network, etc. The communication interface 32 may be a single communication interface, or may include multiple communication interfaces.

[0051] The speaker 33 outputs a sound corresponding to the input audio data.

[0052] The display device 34 is a display, a touch panel, a monitor, or the like, and displays a screen according to input screen data. When the display device 34 is a touch panel, the display device 34 has a touch sensor which is the input interface 35, and outputs the input data input through the touch sensor. The speaker 33, or the display device 34, or the speaker 33 and the display device 34, correspond to the "notification device" described in the claims.

[0053] The input interface 35 is a touch sensor of a touch panel, a microphone for voice input, a keyboard, a mouse, etc. The input interface 35 accepts input from users such as doctors and nurses.

[0054] Although not shown in Fig. 3, the communication interface 32, the speaker 33, the display device 34, and the input interface 35 are communicatively connected to the control device 31 by signal lines, a circuit board pattern, or the like. The control device 31 transmits commands such as an instruction to capture an image to the camera 40 through the communication interface 32, and receives captured image data transmitted by the camera 40. The control device 31 also inputs audio data to the speaker 33 and causes the speaker 33 to output the audio. The control device 31 also inputs screen data to the display device 34 and causes the display device 34 to display the screen. The control device 31 also accepts user instructions through the input interface 35.

[0055] The control device 31 is realized by electronic components such as a CPU 36, ICs, capacitors, resistors, and coils mounted on a circuit board.

[0056] The control device 31 includes a CPU 36 which is a central processing unit, and a memory 37 .

[0057] The CPU 36 executes the OS 38 and the control program 39 stored in the memory 37. Specifically, the CPU 36 executes instructions written in the OS 38 and the control program 39. The CPU 36 executes the OS 38 and the control program 39 in a pseudo-parallel manner, for example, by multitasking. The CPU 36 corresponds to the "computer" recited in the claims.

[0058] The memory 37 stores an OS 38, which is an operating system, and a control program 39, which is an application program installed in the terminal device 30. The memory 37 also stores data necessary for the execution of the control program 39, such as sample image data, thresholds, and warning notification data (not shown). The sample image data, thresholds, and warning notification data are stored in the memory 37 when the control program 39 is installed. Alternatively, the sample image data, thresholds, and warning notification data may be part of the control program 39. The control program 39 may be a single program, or may be a program consisting of multiple module programs. The multiple module programs are, for example, a UI module that accepts user input, a communication module that inputs and outputs data through the OS 38, an image processing module that performs image processing, and a main body control module. The control program 39 is created, for example, by reusing an existing communication module and image processing module, and further using an existing SDK (software development kit). The control program 39 corresponds to the "program" described in the claims.

[0059] The sample image data is, for example, image data obtained by imaging an arm or a nose, image data obtained by imaging a puncture needle or a tube, image data obtained by imaging a tape, gauze, a marker, etc. The sample image data is used by the control program 39 to identify the arm 21, nose, puncture needle 62, tube 63, tape 64, gauze 61, or a marker (not shown) of the patient 20 shown in FIG.

[0060] The mobile communication terminal 51 shown in FIG. 3 is a smartphone (registered trademark) carried by a doctor or a nurse, or a tablet or a personal computer installed in a supervision room. The mobile communication terminal 51 includes a communication interface, a display (or a touch panel), and a speaker. The mobile communication terminal 51 receives warning notification data transmitted by the terminal device 30, and displays a warning screen indicated by the warning notification data on a display, or outputs a warning sound indicated by the warning notification data from a speaker. The mobile communication terminal 51 corresponds to the "notification device" described in the claims. Note that when the warning screen is displayed on the display device 34 of the terminal device 30, or when the warning sound is output from the speaker 33 of the terminal device 30, the mobile communication terminal 51 does not need to be used.

[0061] 1 and 3 show a marker 50 that is attached to the arm 22 of a patient 20. The marker 50 will be described in the second embodiment.

[0062] FIG. 4 is a flowchart of the safety confirmation process that the control program 39 causes the CPU 36 to execute.

[0063] The safety confirmation process will be described below with reference to Figures 1 to 4. The safety confirmation process that the control program 39 causes the CPU 36 to execute is also a process that is executed by the CPU 36, the control device 31, or the terminal device 30.

[0064] As shown in FIG. 1 and FIG. 2, a doctor or nurse places gauze 61 or the like on the arm 21 of a patient 20, then inserts a puncture needle 62 into the arm 21, and fixes a tube 63 extending from the puncture needle 62 to the arm 21 using tape 64. A user who is a doctor or nurse adjusts the direction of the camera 40 so that the lens of the camera 40 faces the arm 21 of the patient 20, and then operates the terminal device 30 to start the control program 39. The started control program 39 inputs input screen data showing a predetermined input screen into the display device 34. The user inputs an instruction to execute a safety confirmation process into the terminal device 30 through the input interface 35 according to the input screen displayed on the display device 34. The doctor or nurse also operates the dialysis device 65 to start dialysis.

[0065] Upon receiving an instruction to execute the safety confirmation process, the control program 39 executes the safety confirmation process shown in Fig. 4. First, the control program 39 transmits an image capture instruction to the camera 40 via the communication interface 32 (S11). The image capture instruction is, for example, a command.

[0066] The driver program 45 of the camera 40 drives the autofocus mechanism 46 to adjust the focal length, and then captures images at a predetermined time interval. The driver program 45 then transmits captured image data to the terminal device 30 through the communication interface 47 at a predetermined time interval. The captured image data is data generated by capturing an image of an imaging area including the arm 21 of the patient 20. In other words, the captured image data is data representing a captured image that at least shows the arm 21 of the patient 20. The predetermined time interval is, for example, several hundred milliseconds to several seconds. The driver program 45 sequentially adjusts the focal length at the predetermined time interval.

[0067] The control program 39 of the terminal device 30 receives and acquires the captured image data transmitted by the camera 40 through the communication interface 32 (S12). The process of step S12 corresponds to a "captured image data acquisition process" recited in the claims.

[0068] The control program 39 executes image processing on the acquired captured image data (S13). The image processing is, for example, binarization processing. By executing the binarization processing, the amount of data processed by the CPU 36 is reduced.

[0069] The control program 39 acquires boundary data based on the processed image data, which is the captured image data that has been subjected to image processing (S14). Specifically, the control program 39 identifies, as a boundary, a pixel between which the difference in color, brightness, or luminance between the pixels changes by a threshold value or more, and acquires pixel position information of the pixel indicating the boundary as boundary data. The area surrounded by the boundary indicated by the boundary data indicates, for example, the arm 21 of the patient 20, the gauze 61 placed on the arm 21, the tape 64 attached to the arm 21, the puncture needle 62 inserted into the arm 21, and the tube 63 extending from the puncture needle 62. That is, the control program 39 detects a plurality of objects (detected objects) such as the arm 21 as boundary data. The boundary data indicates the shape, size, and position of the detected object. Note that the control program 39 may use an existing module having a process for acquiring boundary data, that is, a function for detecting an object reflected in the captured image. The process of step S14 corresponds to the "first process" described in the claims.

[0070] Furthermore, the control program 39 reads out and acquires the first sample image data stored in the memory 37 from the memory 37 (S15). The first sample image data is boundary line data showing the contour of the arm extracted from captured image data of the person's arm. In other words, the first sample image data is data showing the shape of the person's arm. Note that the first sample image data may be a plurality of data generated by capturing images of the arm from various angles.

[0071] The control program 39 determines whether or not there is any detected object whose shape is similar to the shape of the arm shown in the first sample image data among the multiple detected objects detected in step S14 (S16). That is, in step S16, it is determined whether or not the arm 21 of the patient 20 has been detected. Whether or not the shape of the detected object is similar to the shape of the arm shown in the first sample image data is determined, for example, by whether or not the matching rate of the shapes is equal to or greater than a predetermined threshold. For example, an existing authentication module is used in the control program 39.

[0072] If the patient 20 unconsciously extends the arm 22 not inserted with the puncture needle 62 toward the puncture needle 62 and the arm 21 is partially or entirely covered by the arm 22, the control program 39 determines in step S16 that the arm 21 of the patient 20 cannot be detected (S16: No). If the patient 20 does not extend the arm 22 toward the arm 21, the control program 39 determines in step S16 that the arm 21 of the patient 20 has been detected (S16: Yes). The process in step S16 corresponds to the "third process" recited in the claims.

[0073] When the control program 39 determines that the arm 21 of the patient 20 has been detected (S16: Yes), it acquires boundary data that is similar to the first sample image data as first specified data and stores it in the memory 37 (S17). On the other hand, when the control program 39 determines that the arm 21 of the patient 20 cannot be detected (S16: No), it reads out and acquires from the memory 37 the first specified data that was previously stored in the memory 37 (S18). That is, when the arm 21 is covered by the arm 22 of the patient 20, the past first specified data is used. Note that the first specified data read out from the memory 37 in step S18 may be the newest data, the oldest data, or data between the two of the multiple first specified data stored in the memory 37. That is, the first specified data used may be the immediately preceding data, the data immediately after the start of dialysis, or data between the two.

[0074] The control program 39 acquires boundary data indicating a detected object on the arm 21 of the patient 20 from among the multiple detected objects detected in step S14 as the second identification data (S19). Specifically, the control program 39 acquires multiple detected objects (second detected objects) that are within the boundary line indicated by the first identification data acquired in step S17 or step S18 from among the multiple detected objects detected in step S14. The second detected objects are gauze 61 placed on the arm 21 of the patient 20, tape 64 attached to the arm 21, puncture needle 62 inserted into the arm 21, tube 63 extending from the puncture needle 62, and the like. Since the second detected object is identified after identifying the arm 21 of the patient 20, it is possible to prevent an object other than the arm 21 from being erroneously identified as the second detected object. In other words, misidentification in the control program 39 is prevented.

[0075] The control program 39 judges whether or not the second specified data was acquired in step S19 (S20). If the patient 20 unconsciously extends the arm 22 toward the arm 21 and the target such as the puncture needle 62 is covered by the arm 22, the control program 39 judges that the second specified data was not acquired (S20: No). If the patient 20 does not extend the arm 22 toward the arm 21, the control program 39 judges that the second specified data was acquired (S20: Yes).

[0076] When the control program 39 determines that the second identification data has been acquired (S20: Yes), it reads out and acquires the second sample image data stored in the memory 37 from the memory 37 (S21). The second sample image data is boundary data showing the outline of at least one of the gauze 61, the puncture needle 62, the tube 63, and the tape 64. The gauze 61, the puncture needle 62, the tube 63, and the tape 64 correspond to the "target" described in the claims. The target may be any one of the gauze 61, the puncture needle 62, the tube 63, and the tape 64, or may be a plurality of them.

[0077] The control program 39 determines whether or not a target has been detected based on the second specific data acquired in step S19 and the second sample image data read from the memory 37 in step S21 (S22). That is, in step S22, it is determined whether or not the patient 20 has unconsciously extended the arm 22 to the puncture needle 62 and the target has been obscured by the arm 22. Specifically, the control program 39 calculates the coincidence rate between the shape indicated by the second specific data and the shape indicated by the second sample image data, and when the calculated coincidence rate is equal to or higher than the threshold value stored in the memory 37, it determines that the second specific data indicates data of the target and that the target has been detected. The process of step S22 corresponds to the "second process" described in the claims.

[0078] When the control program 39 determines that a target has been detected (S22: Yes), that is, when it determines that the target such as the gauze 61 or the puncture needle 62 is not obscured by the arm 22 of the patient 20, it executes the processes from step S23 to step S26 for determining whether or not the target is blurred. More specifically, when the patient 20 unconsciously extends the arm 22 to the puncture needle 62, although the target is not obscured by the arm 22, the camera 40 changes the focus from the arm 21 to the arm 22 by the autofocus function. Then, the image of the target on the arm 21 becomes blurred. In steps S23 to S26, it is determined whether or not the focal length has been changed and the target image has become blurred.

[0079] First, the control program 39 stores boundary data indicating the target detected in step S22 in the memory 37 as target image data (S23). The control program 39 determines a boundary width based on the target image data, and stores the boundary width in the memory 37 in association with the target image data (S24). For example, the control program 39 determines the boundary width as the distance between two pixels whose color, brightness, or luminance changes by more than a threshold value. The process of step S23 corresponds to the "target identification process" described in the claims. The image indicated by the target image data corresponds to the "target image" described in the claims. The width of the boundary line corresponds to the "width of the outline of the target image" described in the claims.

[0080] Next, the control program 39 reads out from the memory 37 a boundary line width previously stored in the memory 37 as an initial value and acquires it (S25). The boundary line width read out from the memory 37 may be the most recent data, the oldest data, or data between the two, among the multiple boundary line widths stored in the memory 37. In other words, the boundary line width used may be the immediately preceding data, the data immediately after the start of dialysis, or data between the two.

[0081] The control program 39 judges whether the difference (change) between the border width determined in step S24 and the border width (initial value) read from the memory 37 in step S25 is equal to or greater than the first threshold value stored in the memory 37 (S26). That is, in step S26, it is judged whether the target image has become blurred. When the control program 39 judges that the difference is equal to or greater than the first threshold value (S26: Yes), that is, when it judges that the target image has become blurred, it outputs the warning notification data stored in the memory 37 to at least one of the display device 34, the speaker 33, and the communication interface 32 (S27). The warning notification data is screen data showing a warning screen and audio data showing a warning sound. The display device 34 displays a warning screen indicated by the input warning notification data. The speaker 33 outputs a warning sound indicated by the input warning notification data. The communication interface 32 transmits the warning notification data to a mobile communication terminal 51 carried by a doctor or a nurse. The change in the boundary line width corresponds to "a change in the width of the outline or pattern of the target image by the autofocus function" as recited in the claims. The processing of step S26 corresponds to "judgment processing" as recited in the claims. The arm 22 of the patient 20 corresponds to "foreign object" as recited in the claims. The warning notification data corresponds to "notification information" as recited in the claims. The processing of step S27 corresponds to "notification processing" as recited in the claims. An application program that receives the warning notification data transmitted by the terminal device 30, displays a warning screen, and outputs a warning sound is pre-installed in the mobile communication terminal 51.

[0082] When the control program 39 determines in step S20 that the second identification data could not be acquired (S20: No), it outputs the warning notification data to at least one of the display device 34, the speaker 33, and the communication interface 32 (portable communication terminal 51) (S27). That is, when the arm 21 of the patient 20 is entirely covered by the arm 22, a warning screen is displayed on the display device 34, or a warning sound is output from the speaker 33, or a warning screen is displayed and a warning sound is output on the portable communication terminal 51 carried by the doctor or nurse.

[0083] Furthermore, when the control program 39 determines in step S22 that the target cannot be detected (S22: No), it outputs the warning notification data to at least one of the display device 34, the speaker 33, and the communication interface 32 (portable communication terminal 51) (S27). That is, when a target such as the puncture needle 62 on the arm 21 is covered by the arm 22 of the patient 20, a warning screen is displayed on the display device 34 and a warning sound is output from the speaker 33, or a warning screen is displayed and a warning sound is output on the portable communication terminal 51 carried by the doctor or nurse.

[0084] In this way, if the entire arm 21 of the patient 20 is obscured by the other arm 22 of the patient 20 (S20: No), if the entire arm 21 is not obscured by the arm 22 of the patient 20 but a target such as the puncture needle 62 is obscured (S22: No), or if the target is not obscured by the arm 22 of the patient 20 but the arm 22 of the patient 20 approaches the target such as the puncture needle 62 and the target image becomes blurred (S26: Yes), a warning screen is displayed on the display device 34, or a warning sound is output from the speaker 33, or a warning screen is displayed on the mobile communication terminal 51 and a warning sound is output (S27).

[0085] If the patient 20 unconsciously brings the arm 22 closer to the puncture needle 62, it is detected in step S26 that the target image has become blurred (S26: Yes) before the arm 22 covers all or part of the arm 21. Therefore, the judgment processes in steps S20 and S22 are auxiliary processes for improving safety.

[0086] After executing the process of step S27, the control program 39 judges whether or not the user has input a reset instruction to the terminal device 30 using the input interface 35 (S28). For example, a doctor or nurse (user) who sees the warning screen or hears the warning sound alerts the patient 20 and then inputs a reset instruction to the terminal device 30 using the input interface 35.

[0087] If the control program 39 determines that a reset command has not been input (S28: No), it repeatedly executes the output of the warning notification data (S27). Alternatively, the control program 39 maintains the display of the warning screen on the display device 34 and the output of the warning sound from the speaker 33. If the control program 39 determines that a reset command has been input (S28: Yes), it executes the processes from step S12 onwards again.

[0088] When the control program 39 determines in step S26 that the difference is not equal to or greater than the first threshold value (S26: No), that is, when it determines that the target image is not blurred, it determines whether or not the user has input an end instruction to the terminal device 30 using the input interface 35 (S29). For example, after artificial dialysis is completed, a doctor or nurse (user) inputs an end instruction to the terminal device 30 using the input interface 35.

[0089] When the control program 39 determines that the end command has not been input (S29: No), it executes the processes from step S12 onward again. That is, until the user inputs the end command into the terminal device 30, it is repeatedly determined whether the patient 20 unconsciously extends the arm 22 toward the arm 21. The repetition period is, for example, an interval of several hundred milliseconds to several seconds. The period corresponds to the "predetermined time interval" described in the claims.

[0090] If the control program 39 determines that an end instruction has been input (S29: Yes), it ends the safety confirmation process (END).

[0091] [Effects of the first embodiment]

[0092] The safety device 10 according to the first embodiment detects that the patient 20 has extended the arm 22 toward the arm 21 based on whether the target image has become blurred, and issues a warning to a doctor or nurse. Therefore, the safety device 10 according to the first embodiment can prevent the patient 20 from unintentionally removing the puncture needle 62 or the tube 63 in artificial dialysis, a nasogastric tube, or the like.

[0093] The safety device 10 according to the first embodiment identifies the arm 21 of the patient 20 in the captured image (S17), and then identifies an object on the arm 21 as a target (S23). This prevents an object located at a position other than on the arm 21 from being mistakenly identified as a target. In other words, it prevents an object other than the puncture needle 62, etc. from being mistakenly recognized as a target.

[0094] [Variation 1]

[0095] In the first embodiment, an example is described in which it is determined whether or not the patient 20 is unconsciously trying to remove the puncture needle 62 based on whether or not an image of a target (target image) such as the puncture needle 62 has become blurred. In this modified example, an example is described in which it is determined whether or not the patient 20 is unconsciously trying to remove the puncture needle 62 based on whether or not a part or the whole of the target image has been lost.

[0096] The configurations and processes other than those described below are the same as those described in the first embodiment. The same reference numerals and step numbers as those in the first embodiment are used for the same configurations and processes as those in the first embodiment. In this modification, since it is determined whether or not the target image is missing, the camera 40 may or may not have an autofocus mechanism 46.

[0097] 5 is a flowchart of a safety confirmation process that the control program 39 causes the CPU 36 to execute. The control program 39 executes the safety confirmation process shown in FIG. 5 instead of the safety confirmation process shown in FIG.

[0098] The control program 39 executes the processes from step S11 to step S23. That is, the control program 39 identifies the arm 21 of the patient 20 from the captured image captured by the camera 40 (S17), and identifies a target on the arm 21 (S23). Furthermore, if the control program 39 cannot identify the arm 21 of the patient 20 (S20: No) or cannot identify the target (S22: No), it outputs warning notification data to at least one of the display device 34, the speaker 33, and the communication interface 32 (mobile communication terminal 51) (S27).

[0099] After detecting a target (S22: Yes) and storing the target image data in memory 37 (S23), the control program 39 reads out from memory 37 the past target image data stored in memory 37 (S31). The target image data read out from memory 37 may be the newest data, the oldest data, or data between the two of the multiple target image data stored in memory 37. In other words, the target image data used may be the immediately preceding data, the data immediately after the start of dialysis, or data between the two.

[0100] The control program 39 calculates a matching rate between the target image indicated by the current target image data acquired in step S23 and the target image indicated by the target image data read from the memory 37 in step S31 (S32). The control program 39 judges whether the calculated matching rate is less than a second threshold value stored in the memory 37 (S33). For example, when the patient 20 extends the arm 22 toward the puncture needle 62 and the arm 22 covers a part of the target (puncture needle 62, etc.), the matching rate decreases. A change (decrease) in the matching rate due to a missing target image corresponds to a "change in the target image" described in the claims. The process of step S33 corresponds to a "determination process" described in the claims.

[0101] In step S22, the target is identified using the second sample image data based on the matching rate between the boundary data and the second sample image data and a threshold value, but the threshold value is set low so that an object with a missing part can be recognized as a target. Then, the boundary data (target image data) identified as the target is compared with the past target image data, not with the second sample image data.

[0102] When the control program 39 determines that the matching rate is less than the second threshold value (S33: Yes), it outputs warning notification data to at least one of the display device 34, the speaker 33, and the communication interface 32 (mobile communication terminal 51) (S27).

[0103] After executing the process of step S27, the control program 39 executes the process of step S28 in the same manner as in the first embodiment. Furthermore, if the control program 39 determines in step S33 that the matching rate is not less than the second threshold value (S33: No), it executes the process of step S29 in the same manner as in the first embodiment.

[0104] [Effects of Modification Example 1]

[0105] In this modified example, whether or not the patient 20 is about to remove the puncture needle 62 is determined based on the disappearance of the image of the target in the captured image. Therefore, even if the camera 40 does not have an autofocus function, a warning can be issued to the doctor or nurse before the patient 20 removes the puncture needle 62.

[0106] [Variation 2]

[0107] In the first embodiment, an example was described in which it was determined whether or not the patient 20 is unconsciously trying to remove the puncture needle 62 based on whether or not the image of a target (target image) such as the puncture needle 62 is blurred. In this modification, an example is described in which it is determined whether or not the patient 20 is unconsciously trying to remove the puncture needle 62 based on the focal length output by the camera 40.

[0108] The configurations and processes other than those described below are the same as those described in the first embodiment. The same reference numerals and step numbers as those in the first embodiment are used for the same configurations and processes as those in the first embodiment.

[0109] 6 is a flowchart of the safety confirmation process executed by the CPU 36 under the control program 39. The control program 39 executes the safety confirmation process shown in FIG. 6 instead of the safety confirmation process shown in FIG.

[0110] The control program 39 transmits an image capturing instruction to the camera 40 (S11), and receives the captured image data and focal length transmitted by the camera 40 (S41). Thereafter, the control program 39 executes the processes from step S13 to step S22. That is, the control program 39 identifies the arm 21 of the patient 20 from the captured image captured by the camera 40 (S17), and identifies a target on the arm 21 (S22: Yes). Furthermore, if the control program 39 cannot identify the arm 21 of the patient 20 (S20: No) or cannot identify the target (S22: No), it outputs warning notification data to at least one of the display device 34, the speaker 33, and the communication interface 32 (mobile communication terminal 51) (S27).

[0111] When the control program 39 determines that the target has been detected in step S22 (S22: Yes), it stores the boundary data as target image data in the memory 37 together with the focal length received in step S41 (S42). The control program 39 also reads out the past focal length stored in the memory 37 from the memory 37 (S43). The focal length read out from the memory 37 may be the most recent focal length or the oldest focal length among the multiple focal lengths stored in the memory 37, or a focal length between the two. In other words, the focal length read out may be the focal length immediately before the start of artificial dialysis, or a focal length between the two.

[0112] The control program 39 calculates the absolute value of the difference between the focal length acquired in step S41 and the past focal length read from the memory 37 in step S43 as the amount of change in focal length (S44). The control program 39 judges whether the calculated amount of change in focal length is equal to or greater than a third threshold value stored in the memory 37 (S45). That is, in step S45, it is judged whether the focus of the camera 40 has shifted from a target such as the puncture needle 62 on the arm 21 of the patient 20 to another object. When the control program 39 judges that the amount of change in focal length is equal to or greater than the third threshold value (S45: Yes), it outputs warning notification data to at least one of the display device 34, the speaker 33, and the communication interface 32 (mobile communication terminal 51) (S27). The change in focal length due to the focus of the camera 40 shifting from the arm 21 to the arm 22 corresponds to "a change in the two different target images specified at a predetermined time interval" as described in the claims. The process of step S45 corresponds to the "determination process" described in the claims.

[0113] After executing the process of step S27, the control program 39 executes the process of step S28 in the same manner as in the first embodiment. Furthermore, if the control program 39 determines in step S45 that the amount of change in the focal length is not equal to or greater than the third threshold value (S45: No), it executes the process of step S29 in the same manner as in the first embodiment.

[0114] [Effects of Modification Example 2]

[0115] In this modified example, whether or not the patient 20 is unconsciously attempting to remove the puncture needle 62 is determined based on the amount of change in focal length, which reduces the processing load on the CPU 36 compared to when determining whether or not the patient 20 is unconsciously attempting to remove the puncture needle 62 based on whether the target image has become blurred.

[0116] Note that multiple past focal lengths may be read out in step S43, and the "amount of change in focal length" calculated in step S44 may be the amount of change per unit time, i.e., the slope of the change in focal length over time. In that case, in step S45, it is determined whether the focal length has changed rapidly in a short time (unit time).

[0117] [Variation 3]

[0118] In the above-described first embodiment, an example has been described in which the arm 21 of the patient 20 is identified and then the target is identified. In this modification, an example will be described in which the target is directly identified.

[0119] The configurations and processes other than those described below are the same as those described in the first embodiment. The same reference numerals and step numbers as those in the first embodiment are used for the same configurations and processes as those in the first embodiment.

[0120] 7 is a flowchart of the safety confirmation process executed by the CPU 36 under the control program 39. The control program 39 executes the safety confirmation process shown in FIG.

[0121] After executing the processes of steps S11 to S14, the control program 39 reads out second sample image data indicating the target from the memory 37 (S21). The control program 39 determines whether or not the target has been detected based on the boundary data indicating the detected object identified in step S14 and the target indicated by the second sample image data acquired in step S21 (S22). Specifically, the control program 39 determines whether or not the matching rate between the boundary data identified in step S14 and the second sample image data is equal to or greater than a threshold stored in the memory 37.

[0122] When the control program 39 determines that the target could not be detected (S22: No), it determines whether the detected object identified in step S14 is similar to a part of the target shown in the second sample image data (S51). When the control program 39 determines that the detected object is not similar to a part of the target shown in the second sample image data (S51: No), it outputs warning notification data to at least one of the display device 34, the speaker 33, and the communication interface 32 (mobile communication terminal 51) (S27). When the control program 39 determines that the detected object is similar to a part of the target shown in the second sample image data (S51: Yes), it stores boundary data indicating the detected object as target image data in the memory 37 (S52). That is, in step S52, target image data indicating a target image with a part missing is stored in the memory 37.

[0123] When the control program 39 determines that the target has been detected in step S22 (S22: Yes), it stores boundary data indicating the detected object as target image data in the memory 37 (S23). After executing the process of step S23 or the process of step S52, the control program 39 executes the processes of steps S24 to S29, as in the first embodiment. That is, depending on whether the target image indicated by the acquired target image data (S52, S23) has become blurred, it determines whether the patient 20 is extending the arm 22 toward the arm 21 to remove the puncture needle 62 from the arm 21, and issues a warning to a doctor or nurse.

[0124] [Effects of Modification 3]

[0125] In this modification, a target such as the puncture needle 62 is directly detected without detecting the arm 21 of the patient 20, so the processing load on the CPU 36 is reduced compared to the first embodiment.

[0126] [Variation 4]

[0127] In the above-described first embodiment, an example has been described in which the control program 39 identifies a target appearing in a captured image by using the second sample image data. In this modification, an example will be described in which a doctor or a nurse specifies a target on a captured image.

[0128] The configurations and processes other than those described below are the same as those described in the first embodiment. The same reference numerals and step numbers as those in the first embodiment are used for the same configurations and processes as those in the first embodiment.

[0129] In this modification, the display device 34 is a touch panel having a touch sensor as the input interface 35.

[0130] 8 is a flowchart of the safety confirmation process executed by the CPU 36 under the control program 39. The control program 39 executes the safety confirmation process shown in FIG. 8 instead of the safety confirmation process shown in FIG.

[0131] The control program 39 executes the processes of steps S11 to S14. That is, the control program 39 acquires captured image data from the camera 40 (S11, S12), and acquires boundary data indicating an object (detected object) reflected in the captured image (S13, S14). The control program 39 outputs the captured image data and icon data indicating an icon superimposed on the detected object or placed in the vicinity of the detected object to the display device 34 (S61). The display device 34 displays the captured image having a plurality of icons each indicating a detected object. The icons are, for example, a square or circle frame, or an arrow. The process of step S61 corresponds to the "display process" described in the claims.

[0132] A user who is a doctor or a nurse touches an icon indicating a target such as the puncture needle 62 in a captured image displayed on the display device 34 which is a touch panel. That is, the user specifies a target on the touch panel. Note that the user may specify one icon or multiple icons.

[0133] The control program 39 accepts the icon designation by the user (S62). The process of step S62 corresponds to the "designation acceptance process" described in the claims.

[0134] The control program 39 stores boundary data indicating the detected object corresponding to the icon designated by the user in the memory 37 as target image data (S63). The process of step S63 corresponds to the "process of identifying as a target" described in the claims.

[0135] Thereafter, the control program 39 executes the processes from step S24 to step S29 in the same manner as in the first embodiment.

[0136] [Effects of Modification Example 4]

[0137] In this modified example, a doctor or nurse specifies the target, so the processing load on the CPU 36 is reduced compared to when the control program 39 specifies the target.

[0138] The control program 39 may identify the arm 21 of the patient 20 appearing in the captured image in the same manner as in the first embodiment, and then overlay an icon representing an object appearing on the arm 21 on the captured image. In this case, the icon is prevented from representing an object that is not on the arm 21.

[0139] [Variation 5]

[0140] In the above-described first embodiment, as shown in Fig. 1, an example has been described in which the camera 40 is placed on the table 26 placed beside the bed 25. In this modification, an example will be described in which the camera 40 is attached to the patient 20.

[0141] The configurations and processes other than those described below are the same as those described in the first embodiment. The same reference numerals and step numbers as those in the first embodiment are used for the same configurations and processes as those in the first embodiment.

[0142] FIG. 9 is a perspective view of the camera attachment member 70. As shown in FIG.

[0143] The safety device 10 includes a camera attachment member 70 in addition to the terminal device 30 and the camera 40. The camera attachment member 70 is a member for attaching the camera 40 to the patient 20.

[0144] The camera attachment member 70 includes a fixing portion 71 for fixing the camera 40 and a mounting portion 72 for being mounted on the arm 21 of the patient 20 .

[0145] The fixed part 71 is rod-shaped. The camera 40 is attached to one end (upper end) of the fixed part 71. The camera 40 is supported by the fixed part 71 so that the orientation of the lens can be changed with respect to the fixed part 71. Specifically, a spherical body is provided at one end of the fixed part 71, and a spherical recess into which the spherical body fits is provided at the bottom of the housing of the camera 40. However, the camera 40 may be fixed to the camera mounting member 70.

[0146] The mounting part 72 is annular (ring-shaped) with a gap. The mounting part 72 is, for example, a synthetic resin molded product and has elasticity. The mounting part 72 is mounted on the arm 21 of the patient 20 or removed from the arm 21 of the patient 20 by elastic deformation. The mounting part 72 is connected to the other end (lower end) of the rod-shaped fixing part 71.

[0147] The doctor or nurse attaches the camera attachment member 70, to which the camera 40 is fixed, to the upper arm portion of the arm 21 of the patient 20, and then points the lens of the camera 40 toward the puncture needle 62. In other words, the camera 40 is attached to the patient 20 so that the arm 21 of the patient 20, including the puncture needle 62, is its imaging range.

[0148] By attaching the camera 40 to the upper arm of the patient 20, the distance from the camera 40 to the puncture needle 62 is always constant even if the patient 20 moves the arm 21. Furthermore, even if the patient 20 moves or the patient 20 moves the arm 21, the puncture needle 62 and the like will not move out of the imaging range of the camera 40. In other words, the camera 40 can always image the arm 21 of the patient 20, including the puncture needle 62 and the like, regardless of the movement of the patient 20.

[0149] [Effects of Modification 5]

[0150] In this modification, regardless of the movement of the patient 20, it is possible to always obtain images of the puncture needle 62 and the like.

[0151] In the case of a nasogastric tube rather than artificial dialysis, the attachment part 72 is attached to the head of the patient 20, not to the arm 21 of the patient 20.

[0152] [Second embodiment]

[0153] In a second embodiment of the present invention, a marker 50 is affixed to an arm 22 of a patient 20. The arm 22 is the arm opposite to an arm 21 into which a puncture needle 62 is inserted. In this embodiment, an example will be described in which a warning is issued based on the marker 50 approaching a target on the arm 21.

[0154] The configurations and processes other than those described below are the same as those described in the first embodiment. The same reference numerals and step numbers as those in the first embodiment are used for the same configurations and processes as those in the first embodiment.

[0155] The safety device 10 includes a marker 50 shown in Figs. 1 and 3 in addition to the terminal device 30 and the camera 40. The marker 50 is a paper or plastic sticker having an attachment surface on one side. However, the marker 50 does not have to have an attachment surface. In that case, the marker 50 is attached to the back of the hand, wrist, or the like on the arm 22 of the patient 20 with tape. Also, two markers 50 may be attached to both sides of the arm 22, i.e., on the back side and the palm side. This allows the camera 40 to reliably capture an image of the marker 50.

[0156] The marker 50 is provided with a pattern to facilitate recognition by the control program 39. The pattern is a checkered pattern or the like. However, as long as the control program 39 can recognize (identify) the marker 50 based on the external shape of the marker 50, the marker 50 may be plain. Also, instead of a pattern, a code such as a barcode or QR code (registered trademark) may be provided on the marker 50. In that case, the control program 39 has a code reading program (pre-made program) as a module program.

[0157] The camera 40 is disposed so that not only the arm 21 of the patient 20 but also the arm 22 of the patient 20 is in the imaging range, specifically so that the entire patient 20 appears in the captured image.

[0158] Fig. 10 is a flowchart of the safety confirmation process executed by the control program 39 in this embodiment. The control program 39 (CPU 36, control device 31, terminal device 30) executes the safety confirmation process shown in Fig. 10 instead of the safety confirmation process shown in Fig. 4.

[0159] The control program 39 executes the processes from step S11 to step S23. That is, the control program 39 stores target image data indicating a target such as the puncture needle 62 on the arm 21 of the patient 20 in the memory 37 based on the captured image data output by the camera 40 (S23). The process of step S23 corresponds to the "target position identification process" described in the claims.

[0160] Next, the control program 39 reads out the third sample image data from the memory 37 (S71). The third sample image data is image data showing the marker 50. The control program 39 identifies boundary data showing the marker 50 based on the boundary data (first detected object) acquired in step S14 and the third sample image data, and stores the identified boundary data as marker image data in the memory 37 (S72). Specifically, the control program 39 stores the boundary data, the matching rate of which with the shape or pattern of the marker shown in the third sample image data is equal to or higher than a threshold, in the memory 37 as marker image data. The process of step S72 corresponds to the "marker position identification process" described in the claims.

[0161] The control program 39 calculates the distance between the target and the marker 50 based on the target image data acquired in step S23 and the marker image data acquired in step S73 (S73). The distance is calculated as the inter-pixel distance between the pixel representing the target and the pixel representing the marker 50, for example.

[0162] The separation distance may be calculated based on the target image data, the marker image data acquired in step S73, and the past marker image data stored in the memory 37. The past marker image data is the immediately preceding data, the data immediately after the start of dialysis, or data between the two. For example, when the arm 22 (hand) of the patient 20 approaches the arm 21 (camera 40), the size of the marker 50 shown in the captured image increases. The control program 39 calculates the distance by which the arm 22 (hand) of the patient 20 approaches the camera 40 based on the size of the marker 50 indicated by the marker image data acquired in step S73 and the size of the marker 50 indicated by the past marker image data, and calculates the separation distance between the target and the marker 50 based on the calculated distance, the target image data, and the marker image data acquired in step S73.

[0163] The control program 39 determines whether or not the separation distance calculated in step S73 is less than a fourth threshold value stored in the memory 37 (S74). That is, in step 74, it is determined whether or not the patient 20 has unconsciously extended the arm 22 (hand) toward the puncture needle 62. The process of step S74 corresponds to the "approach determination process" described in the claims.

[0164] When the control program 39 determines that the separation distance is less than the fourth threshold (S74: Yes), it outputs warning notification data to at least one of the display device 34, the speaker 33, and the communication interface 32 (mobile communication terminal 51) (S27). After that, the control program 39 executes the process of step S28 in the same manner as in the first embodiment.

[0165] When the control program 39 determines that the separation distance is not less than the fourth threshold value (S74: No), the control program 39 executes the process of step S29 in the same manner as in the first embodiment.

[0166] [Effects of the second embodiment]

[0167] In this embodiment, when the patient 20 unconsciously extends the arm 22 (hand) toward the puncture needle 62 and the distance between the target, such as the puncture needle 62, and the marker 50 becomes short, a warning is issued. Therefore, the safety device 10 according to this embodiment can prevent the puncture needle 62 from being removed from the arm 21 of the patient 20.

[0168] When the safety device 10 is used for a nasogastric tube, the markers 50 are attached to both arms of the patient 20, and the above-mentioned separation distance is calculated for each marker 50.

[0169] Furthermore, the configurations and processes described in the above-mentioned modified examples 3 to 5 may be adopted in the second embodiment.

[0170] [Variation 1]

[0171] In the second embodiment, an example has been described in which one camera 40 is used. In the present modified example, an example in which two cameras 40 are used will be described.

[0172] The configurations and processes other than those described below are the same as those described in the second embodiment. The same reference numerals and step numbers as those in the second embodiment are used for the same configurations and processes as those in the second embodiment.

[0173] FIG. 11 is an explanatory diagram for explaining the use of the safety device 10 according to this modified example.

[0174] As shown in FIG. 11, the safety device 10 includes a terminal device 30, two cameras 40, and a marker 50.

[0175] One of the two cameras 40 is disposed on the side of the patient 20 lying on the bed 25, and the other camera 40 is disposed near the head or feet of the patient 20 lying on the bed 25. However, one camera 40 may be disposed on the side of the bed 25, and the other camera 40 may be disposed above the bed 25 (above the patient 20). In the example shown in FIG. 11, the other camera 40 is disposed near the head of the patient 20.

[0176] The control program 39 executes the safety confirmation process shown in FIG. 10, similarly to the second embodiment. In step S11, the control program 39 transmits an image capture instruction to each of the two cameras 40. In step S12, the control program 39 acquires the captured image data transmitted by each of the two cameras 40. In steps S13 to S23, the control program 39 identifies each of the arms 21 of the patient 20 shown in each captured image data, and then identifies each of the objects on the arms 21 as targets using the first sample image data, and stores two pieces of boundary data indicating the targets in the memory 37. That is, a target is identified for each of the two captured images. Next, the control program 39 executes the processes of steps S71 and S72, and stores marker image data indicating the position of the marker 50 affixed on the arm 22 of the patient 20 in the memory 37 for each captured image data (for each of the two cameras 40). That is, a marker 50 (the arm 22 of the patient 20) is identified for each of the two captured images.

[0177] In step S73, the control program 39 calculates the separation distance between the target and the marker 50 for each of the two captured image data. In step S75, the control program 39 determines whether or not both of the two separation distances are less than a fourth threshold. That is, even if it is determined that the other arm 22 of the patient 20 is approaching the target on the arm 21 of the patient 20 in the image captured by one camera 40 (less than the fourth threshold), if the target on the arm 21 of the patient 20 and the other arm 22 of the patient are separated from each other in the image captured by the other camera 40 (fourth threshold or more), in step S74, it is determined that the separation distance is equal to or greater than the fourth threshold (S74: No).

[0178] If the control program 39 determines in step S74 that both of the separation distances are less than the fourth threshold value (S74: Yes), it executes the processes of steps S27 and S28. If the control program 39 determines in step S74 that both of the separation distances are not less than the fourth threshold value (S74: No), it executes the process of step S29.

[0179] [Effects of Modification Example 1]

[0180] In this modified example, by using two cameras 40, it is possible to more accurately detect whether or not the patient 20 has unconsciously extended his / her arm 22 toward the puncture needle 62 or the like.

[0181] [Variation 2]

[0182] In this modification, an example will be described in which the camera 40 is a stereo camera. The camera 40 has two adjacent cameras. The camera 40 transmits two captured image data generated by each camera in association with each other.

[0183] The control program 39 executes the safety confirmation process shown in FIG. 10 in the same manner as in the second embodiment. After executing the process of step S11, the control program 39 acquires the two captured image data transmitted by the camera 40 in step S12. In steps S13 to S23, the control program 39 identifies the arm 21 of the patient 20 for each of the two captured image data, and then identifies an object on the arm 21 as a target using the first sample image data, and stores two pieces of boundary data indicating the target in the memory 37. In step S23, the control program 39 calculates a parallax based on the two pieces of boundary data indicating the target. Based on the parallax and boundary data, the control program 39 calculates the direction and distance in which the target is located, and stores the calculated direction and distance in the memory 37. The direction and distance function as coordinate data (spherical coordinate data or three-dimensional polar coordinate data) indicating the position of the target three-dimensionally.

[0184] Next, the control program 39 executes the processes of steps S71 and S72, and stores marker image data indicating the position of the marker 50 affixed to the arm 22 of the patient 20 in the memory 37 for each of the two captured image data. In addition, in step S72, the control program 39 calculates the parallax based on the two marker image data. Based on the indication and the marker image data, the control program 39 calculates the direction and distance in which the marker 50 is located, and stores the direction and distance in the memory 37. The direction and distance function as coordinate data (spherical coordinate data or three-dimensional polar coordinate data) indicating the position of the marker 50 three-dimensionally.

[0185] In step S73, the control program 39 calculates the separation distance between the target and the marker 50 based on the direction and distance stored in the memory 37 in steps S23 and S72, respectively. The separation distance calculated in step S73 is a distance in a three-dimensional space.

[0186] In step S75, the control program 39 determines whether the separation distance is less than a fourth threshold value. That is, the control program 39 determines whether the arm 22 of the patient 20 approaches the target in the three-dimensional space, not whether the arm 22 of the patient 20 approaches the target in the captured image.

[0187] If the control program 39 determines in step S74 that the separation distance is less than the fourth threshold (S74: Yes), it executes the processes of steps S27 and S28. If the control program 39 determines in step S74 that neither of the two separation distances is less than the fourth threshold (S74: No), it executes the process of step S29.

[0188] [Effects of Modification Example 2]

[0189] In this modification, by using a stereo camera (camera 40), it is possible to more accurately detect whether or not the patient 20 has unconsciously extended his / her arm 22 toward the puncture needle 62.

[0190] [Third embodiment]

[0191] FIG. 12 is a diagram illustrating the use of the safety device 10 according to the third embodiment.

[0192] The configurations and processes other than those described below are the same as those described in the first or second embodiment. The same reference numerals and step numbers as those in the first or second embodiment are used for the same configurations and processes as those in the first or second embodiment.

[0193] In the following, a safety device 10 for use in artificial dialysis is described.

[0194] As shown in Fig. 12, the safety device 10 includes a first marker 81 and a second marker 82 in addition to the terminal device 30, the camera 40, and the mobile communication terminal 51 (see Fig. 3). The first marker 81 and the second marker 82 are paper or plastic stickers having an attachment surface on one side. However, the first marker 81 and the second marker 82 do not have to have an attachment surface. In that case, the first marker 81 and the second marker 82 are attached to the patient 20 with tape.

[0195] The first marker 81 and the second marker 82 are each provided with a pattern to facilitate recognition by the control program 39 (see FIG. 3). The pattern is a checkered pattern or the like. However, as long as the control program 39 can recognize (identify) the first marker 81 and the second marker 82 based on their outer shapes, the first marker 81 and the second marker 82 may be plain. Instead of a pattern, a code such as a barcode or a QR code (registered trademark) may be provided on the first marker 81 and the second marker 82. In this case, the control program 39 has a code reading program (pre-made program) as a module program.

[0196] The first marker 81 and the second marker 82 may have various shapes, such as a circle, a rectangle, or an ellipse.

[0197] The pattern applied to the first marker 81 is different from the pattern applied to the second marker 82. Alternatively, the outer shape of the first marker 81 is different from the outer shape of the second marker 82. The control program 39 distinguishes between the first marker 81 and the second marker 82 based on the outer shape or the pattern.

[0198] The first marker 81 is attached to the arm 21 of the patient 20. The arm 21 is the arm of the patient 20 that has been punctured with the puncture needle 62. The second marker 82 is attached to the arm 22 of the patient 20. The arm 22 is the arm of the patient 20 that has not been punctured with the puncture needle 62.

[0199] Two second markers 82 may be attached to both sides of arm 22, i.e., the back side and the palm side. This allows camera 40 to reliably capture an image of second marker 82. Arm 21 corresponds to "one arm" in the claims. Arm 22 corresponds to "the other arm" in the claims.

[0200] The camera 40 is disposed so that not only the arm 21 of the patient 20 but also the arm 22 of the patient 20 is in the imaging range, specifically so that the entire patient 20 appears in the captured image.

[0201] The memory 37 (see FIG. 3) of the terminal device 30 stores in advance fourth sample image data generated by imaging the first marker 81 and fifth sample image data generated by imaging the second marker .

[0202] FIG. 13 is a flowchart of the safety confirmation process according to the third embodiment.

[0203] The control program 39 (see FIG. 3) causes the CPU 36 (see FIG. 3) to execute the safety confirmation process shown in FIG. 13. The process that the control program 39 causes the CPU 36 to execute is also a process executed by the CPU 36, the control device 31 (see FIG. 3), or the terminal device 30 (see FIG. 3).

[0204] The control program 39 executes the processes from steps S11 to S14 in the same manner as in the first embodiment. That is, the control program 39 causes the camera 40 to capture an image (S11), acquires captured image data (S12), performs image processing on the acquired captured image data (S13), and acquires boundary data indicating a detected object appearing in the captured image (S14).

[0205] The control program 39 also reads out the fourth sample image data and the fifth sample image data from the memory 37 (S81). The control program 39 identifies boundary data indicating the first marker 81 based on the boundary data (detected object) acquired in step S14 and the fourth sample image data, and stores the position of the identified boundary data in the memory 37 as the first marker position (S82). Specifically, the control program 39 identifies, as the boundary data indicating the first marker 81, the boundary data whose matching rate with the shape or pattern of the first marker 81 indicated by the fourth sample image data is equal to or higher than a threshold. The first marker position is a position in the captured image, for example, a pixel position (pixel number) of the boundary data indicating the first marker 81. The process of step S82 corresponds to the "first marker position identification process" described in the claims.

[0206] Similarly, the control program 39 identifies boundary data indicating the second marker 82 based on the boundary data (detected object) acquired in step S14 and the fifth sample image data, and stores the position of the identified boundary data as the second marker position in the memory 37 (S83). The process of step S83 corresponds to the "second marker position identification process" recited in the claims.

[0207] The control program 39 calculates the relative distance between the identified first marker position and second marker position on the captured image (S84). The process of step S84 corresponds to the "relative distance calculation process" recited in the claims.

[0208] The control program 39 determines whether or not the calculated relative distance is less than a fifth threshold value stored in the memory 37 (S85). That is, in step S85, it is determined whether or not the patient 20 has unconsciously extended the arm 22 (hand) toward the puncture needle 62. The process of step S85 corresponds to the "approach determination process" recited in the claims.

[0209] When the control program 39 determines that the relative distance is less than the fifth threshold (S85: Yes), that is, when it determines that the patient 20 unconsciously extends the arm 22 (hand) toward the puncture needle 62, it outputs the warning notification data stored in the memory 37 to at least one of the display device 34, the speaker 33, and the communication interface 32 (see FIG. 3) (S27). The process of step S27 corresponds to the "notification process" recited in the claims.

[0210] Thereafter, the control program 39 executes the process of step S28 as in the first embodiment. Furthermore, if the control program 39 determines that the relative distance is equal to or greater than the fifth threshold (S85: No), that is, if it determines that the patient 20 has not unconsciously extended the arm 22 (hand) toward the puncture needle 62, it executes the process of step S29 as in the first embodiment.

[0211] [Effects of the third embodiment]

[0212] A first marker 81 is affixed to the arm 21 of the patient 20, and a second marker 82 is affixed to the arm 22. Identifying the position of the first marker 81 and the position of the second marker 82 is easier and more reliable than identifying the position of the arm 21 itself or the arm 22 itself of the patient 20. Therefore, the safety device 10 of this embodiment can easily and reliably determine whether the patient 20 has unconsciously extended the arm 22 (hand) toward the puncture needle 62. As a result, the safety device 10 can prevent the patient 20 from unconsciously removing the puncture needle 62 inserted into the arm 21 during artificial dialysis or infusion.

[0213] [Modification 1 of the third embodiment]

[0214] In the third embodiment, the case where the safety device 10 is used for artificial dialysis has been described. In this modification, an example where the safety device 10 is used for a nasogastric tube will be described.

[0215] FIG. 14 is a diagram illustrating the use of the safety device 10 according to this modified example.

[0216] The configurations and processes other than those described below are the same as those described in the first to third embodiments. The same reference numerals and step numbers as those in the first to third embodiments are used for the same configurations and processes as those in the first to third embodiments.

[0217] As shown in FIG. 14, the safety device 10 includes a first marker 81 and a plurality of second markers 82 in addition to the terminal device 30, the camera 40, and the mobile communication terminal 51 (see FIG. 3).

[0218] The first marker 81 is attached to the head and neck of the patient 20. The head and neck refers to a part including the face, head, and neck of the patient 20. In other words, the first marker 81 is attached near the tube 23 inserted into the nose of the patient 20.

[0219] The second marker 82 is attached to each of the arms 21, 22 of the patient 20. The second marker 82 may be attached to each of both sides of the arm 21 and both sides of the arm 22. This allows the camera 40 to reliably capture images of the second marker 82 on each of the arms 21 and 22. The two sides of the arms 21, 22 refer to the back and palm sides of the hands.

[0220] The pattern applied to the first marker 81 is different from the pattern applied to the second marker 82. Alternatively, the outer shape of the first marker 81 is different from the outer shape of the second marker 82. The control program 39 distinguishes between the first marker 81 and the second marker 82 based on the outer shape or the pattern.

[0221] Furthermore, the pattern affixed to second marker 82 affixed to arm 21 differs from the pattern affixed to second marker 82 affixed to arm 22. Or, the outer shape of second marker 82 affixed to arm 21 differs from the outer shape of second marker 82 affixed to arm 22. Control program 39 distinguishes between second marker 82 affixed to arm 21 and second marker 82 affixed to arm 22 based on the outer shape or pattern.

[0222] The memory 37 of the terminal device 30 prestores fourth, fifth, and sixth sample image data. The fourth sample image data is image data generated by imaging a first marker 81 affixed to the head and neck of the patient 20. The fifth sample image data is image data generated by imaging a second marker 82 affixed to the arm 21 of the patient 20. The sixth sample image data is image data generated by imaging a second marker 82 affixed to the arm 22 of the patient 20.

[0223] The camera 40 is positioned so that the head and neck and both arms 21, 22 of the patient 20 are also included in the imaging range, specifically so that the entire patient 20 appears in the captured image.

[0224] FIG. 15 is a flowchart of the safety confirmation process according to this modified example.

[0225] The control program 39 (see FIG. 3) causes the CPU 36 (see FIG. 3) to execute the safety confirmation process shown in FIG. 15 instead of the safety confirmation process shown in FIG. 13. The process that the control program 39 causes the CPU 36 to execute is also the process executed by the CPU 36, the control device 31 (see FIG. 3), or the terminal device 30 (see FIG. 3).

[0226] The control program 39 executes the processes from steps S11 to S14 in the same manner as in the third embodiment. That is, the control program 39 causes the camera 40 to capture an image (S11), acquires captured image data (S12), performs image processing on the acquired captured image data (S13), and acquires boundary data indicating a detected object appearing in the captured image (S14).

[0227] The control program 39 also reads out the fourth sample image data, the fifth sample image data, and the sixth sample image data from the memory 37 (S91). The control program 39 identifies boundary data indicating the first marker 81 based on the boundary data (detected object) acquired in step S14 and the fourth sample image data, and stores the position of the identified boundary data as the first marker position in the memory 37 (S82). Specifically, the control program 39 identifies, as the boundary data indicating the first marker 81, the boundary data whose matching rate with the shape or pattern of the first marker 81 indicated by the fourth sample image data is equal to or higher than a threshold. The first marker position is a position in the captured image, for example, a pixel position (pixel number) of the boundary data indicating the first marker 81. The process of step S82 corresponds to the "first marker position identification process" described in the claims.

[0228] Similarly, the control program 39 identifies boundary data indicating the second marker 82 affixed to the arm 21 of the patient 20 based on the boundary data (detected object) acquired in step S14 and the fifth sample image data, and stores the position of the identified boundary data in the memory 37 as one second marker position (S92). Similarly, the control program 39 identifies boundary data indicating the second marker 82 affixed to the arm 22 of the patient 20 based on the boundary data (detected object) acquired in step S14 and the sixth sample image data, and stores the position of the identified boundary data in the memory 37 as the other second marker position (S92). The process of step S92 corresponds to the "second marker position identification process" described in the claims.

[0229] The control program 39 calculates a first relative distance between the identified first marker position and a second marker position on the arm 21 on the captured image (S93). The control program 39 also calculates a second relative distance between the identified first marker position and the second marker position on the arm 22 on the captured image (S93). The process of step S93 corresponds to a "relative distance calculation process" recited in the claims.

[0230] The control program 39 determines whether or not at least one of the calculated first relative distance or the second relative distance is less than a fifth threshold value stored in the memory 37 (S94). That is, in step S94, it is determined whether or not the patient 20 has unconsciously extended the arm 21 or the arm 22 toward the tube 23 inserted in the nose. The process of step S94 corresponds to the "approach determination process" described in the claims.

[0231] When the control program 39 determines that at least one of the first relative distance and the second relative distance is less than the fifth threshold (S94: Yes), that is, when it determines that the patient 20 unconsciously extends the arm 21 or the arm 22 into the nasal tube 23, it outputs the warning notification data stored in the memory 37 to at least one of the display device 34, the speaker 33, and the communication interface 32 (S27). Thereafter, the control program 39 executes the process of step S28 as in the third embodiment. When the control program 39 determines that the first relative distance and the second relative distance are equal to or greater than the fifth threshold (S94: No), that is, when it determines that the patient 20 has not unconsciously extended the arm 21 or the arm 22 into the nasal tube 23, it executes the process of step S29 as in the third embodiment.

[0232] [Effects of Modification Example 1]

[0233] In a nasogastric tube, the safety device 10 can prevent a patient 20 from unintentionally removing a tube 23 inserted into the nose.

[0234] [Other variations]

[0235] In the above-mentioned first and second embodiments, an example in which the safety device 10 is used for artificial dialysis has been described. However, the safety device 10 may also be used for a nasogastric tube. In that case, data showing a person's face including the area below the nose is used as the first sample image data, instead of data showing a person's arm. Also, image data showing gauze, a tube, a tape, a nose, an ear, or an eye is used as the second sample image. Also, the gauze, the tube, the tape, the nose, the ear, or the eye is used as a target for determining whether the image is blurred, whether the target image is missing, or whether the focal length has changed.

[0236] Modification 2 or 3 of the first embodiment may be combined with Modification 4 or 5 of the first embodiment. Also, Modification 2 or 3 of the first embodiment may be combined with Modification 4 or 5 of the first embodiment and used in the second embodiment.

[0237] In the above-described first embodiment, an example has been described in which the gauze 61, the puncture needle 62, the tube 63, or the tape 64 on the arm 21 of the patient 20 is targeted. However, a marker (not shown) attached to the arm 21 of the patient 20 may be targeted.

[0238] In the above-described first embodiment, an example has been described in which it is determined whether the arm 22 of the patient 20 approaches a target such as the puncture needle 62 based on a change in the width of the boundary line (contour) of the target image. However, it may also be determined whether the arm 22 of the patient 20 approaches a target such as the puncture needle 62 based on a change in the width of the pattern of the target.

[0239] In the above-described first and second embodiments, examples have been described in which the terminal device 30 and the camera 40 are separate devices. However, the terminal device 30 and the camera 40 may be the same device. In that case, the CPU 43 and the memory 44 of the camera 40 become the CPU 36 and the memory 37 of the terminal device 30, and the driver program 45 is stored in the memory 37. The terminal device 30 is, for example, a smartphone (registered trademark), a tablet, or a notebook computer equipped with the camera 40. The control program 39 and the driver program 45 stored in the memory 37 correspond to the "program" described in the claims.

[0240] The safety device 10 according to the first and second embodiments may be used for other treatments that use needles or tubes, such as intravenous drip, in addition to artificial dialysis and nasogastric tubes.

[0241] In the above-described first and second embodiments, the notification device is described as being the display device 34, the speaker 33, and the mobile communication terminal 51. However, the notification device may be a red lamp or an LED. [Explanation of symbols]

[0242] 10...Safety device 20...patient 21. Arm 22. Arm 23... Tube 25. Bed 26 units 30 Terminal device 31. Control device 32 Communication Interface 33···Speaker 34...Display device 35 Input Interface 36··CPU 37. Memory 39. Control program 40. Camera 41...Optical system 42 Imaging element 46 Autofocus mechanism 50 Marker 51 Mobile communication terminal 61...Gauze 62...Puncture needle 63...Tube 64... Tape 65...Artificial dialysis equipment 70 Camera mounting member 71... Fixed part 72... Mounting part 81 First marker 82 Second marker

Claims

1. a camera for capturing an image of an imaging area including a patient's arm or nose and outputting captured image data; a control device to which the captured image data is input; An alarm device capable of communicating with the control device, The control device includes: a target identification process for identifying a target image showing a predetermined target that appears in a captured image represented by the captured image data; a determination process for determining whether or not a foreign object has approached the target based on changes in the two different target images identified at a predetermined time interval; a notification process for outputting notification information to the notification device based on the determination that a foreign object has approached the target in the determination process, the safety device executing the notification process.

2. The camera has an autofocus function, The change between the two different target images identified at a predetermined time interval is a change in the outline or width of a pattern of the target images caused by the autofocus function, The above determination process is as follows: The safety device of claim 1, further comprising: determining that a foreign object is approaching the target based on the change in width being equal to or greater than a first threshold; and determining that a foreign object is not approaching the target based on the change in width being less than the first threshold.

3. The change between the two different target images identified at a predetermined time interval is a change in the matching rate between the two target images, The above determination process is as follows: A safety device as described in claim 1, wherein, in the target identification process, it is determined that a foreign object has approached the target based on the matching rate being less than a second threshold, and it is determined that a foreign object has not approached the target based on the matching rate being greater than or equal to the second threshold.

4. The camera has an autofocus function and outputs a focal length together with the captured image data; The change between the two different target images identified at a predetermined time interval is a change between the two focal lengths corresponding to the target images, The above determination process is as follows:

2. The safety device according to claim 1, further comprising a process for determining that a foreign object has approached the target based on the change in the focal length being equal to or greater than a third threshold, and for determining that a foreign object has not approached the target based on the change in the focal length being less than the third threshold.

5. the control device includes a memory configured to store sample image data representing at least one of an arm, a nose, a tape, a puncture needle, a tube, gauze, or a marker; the target is at least one of a patient's arm, a nose, a tape, a puncture needle, a tube, gauze, or a marker; The above target identification process is a first process for identifying an object appearing in the captured image; 5. The safety device according to claim 1, further comprising a second process of identifying the target based on a matching rate between the identified object and a sample image represented by the sample image data.

6. the control device includes a memory that stores first sample image data representing an arm or a nose, and second sample image data representing at least one of a tape, a puncture needle, a tube, gauze, or a marker; the target is at least one of a tape, a needle, a tube, gauze, or a marker; The above target identification process is a first process for identifying an object appearing in the captured image; a third process of identifying an arm or a nose of a patient based on a matching rate between the identified object and a first sample image represented by the first sample image data; A safety device as described in any one of claims 1 to 4, further comprising a second process for identifying the target based on a matching rate between the identified object located on the patient's arm or under the nose and a second sample image represented by the second sample image data.

7. The control device further includes a touch panel, The above target identification process is a display process of acquiring captured image data input from the camera, identifying an object appearing in the captured image data, and displaying the captured image on the touch panel with an icon representing the identified object superimposed thereon; a designation receiving process for receiving designation of the icon via the touch panel; The safety device according to claim 1 , further comprising a process of identifying an object indicated by the designated icon as the target.

8. The safety device according to claim 1 , further comprising a camera mounting member having a fixing portion for fixing the camera, and a mounting portion for mounting on an arm or head of a patient.

9. a marker that is attached to the patient's hand or arm; A camera for imaging a patient; a control device to which the captured image data output by the camera is input; An alarm device capable of communicating with the control device, The control device includes: a target position identification process for identifying a target position that is a position of a predetermined target shown in a captured image represented by the captured image data; a marker position identification process for identifying a marker position that is a position of the marker in the captured image; an approach determination process for determining whether or not a distance between the target position and the marker position is less than a fourth threshold; and an alarm process of outputting alarm information to the alarm device based on the determination that the separation distance has become less than the fourth threshold value.

10. The two cameras are spaced apart, The control device includes: Executing the target position specifying process and the marker position specifying process for each of the two captured images output by each camera, The safety device according to claim 9, wherein in the approach judgment process, the separation distance is calculated for each of the two captured image data, and the notification process is executed based on a determination that both of the separation distances are less than the fourth threshold value.

11. The camera is a stereo camera having two adjacent cameras, the target position and the marker position are positions in three-dimensional space; The safety device of claim 9 , wherein the separation distance is the distance between the target position and the marker position in three-dimensional space.

12. A program implemented in a terminal device having a communication interface and a computer, an image data acquisition process for acquiring image data input from a camera capturing an image of an imaging region including a patient's arm or nose at a predetermined time interval; a target identification process for identifying a target image showing a predetermined target that appears in a captured image represented by the captured image data; a determination process for determining whether or not a foreign object has approached the target based on changes in the two different target images identified at a predetermined time interval; a notification process for outputting notification information based on the determination that a foreign object has approached the target in the determination process.

13. A program implemented in a terminal device having a communication interface and a computer, an image data acquisition process for acquiring image data input from a camera capturing an image of a patient with a marker attached to his / her arm at a predetermined time interval; a target position identification process for identifying a target position that is a position of a predetermined target shown in a captured image represented by the captured image data; a marker position identification process for identifying a marker position, which is the position of the marker; an approach determination process for determining whether or not a distance between the target position and the marker position is equal to or smaller than a fourth threshold; and an alarm process of outputting alarm information based on the determination that the separation distance has become equal to or less than the fourth threshold.

14. a camera for capturing an image of a patient and outputting captured image data; a control device to which the captured image data is input; An alarm device capable of communicating with the control device; a first marker attached to one arm of the patient; a second marker attached to the patient's other arm; The control device includes: a first marker position identification process for identifying a position of the first marker in a captured image represented by the captured image data; a second marker position specifying process for specifying a position of the second marker in the captured image; a relative distance calculation process of calculating a relative distance between the first marker and the second marker based on a position of the first marker and a position of the second marker; a proximity determination process for determining whether the relative distance is less than a fifth threshold; and an alarm process of outputting alarm information to the alarm device based on the determination in the proximity determination process that the relative distance is less than the fifth threshold.

15. a camera for capturing an image of a patient and outputting captured image data; a control device to which the captured image data is input; An alarm device capable of communicating with the control device; a first marker attached to the patient's head and neck; and a second marker attached to each of the patient's arms, The control device includes: a first marker position identification process for identifying a position of the first marker in a captured image represented by the captured image data; a second marker position specifying process for specifying positions of the two second markers shown in the captured image; a relative distance calculation process for calculating a first relative distance between the first marker and one of the second markers and a second relative distance between the first marker and the other of the second markers based on a position of the first marker and a position of the second marker; a proximity determination process for determining whether or not at least one of the first relative distance and the second relative distance is less than a fifth threshold; and an alarm process of outputting alarm information to the alarm device based on a determination in the proximity determination process that at least one of the first relative distance or the second relative distance is less than the fifth threshold.

Images