Monitoring device, and monitoring system

The monitoring device uses an infrared imaging unit and a reflection-preventing cover member to address the anxiety caused by face reflections in nursing care facilities, ensuring accurate caregiver behavior monitoring without visibility.

JP2024162612APending Publication Date: 2024-11-21KONICA MINOLTA INC
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2023078303
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-11
Publication Date
2024-11-21

AI Technical Summary

Technical Problem

In nursing care facilities, the reflection of residents' faces on the cover of monitoring cameras installed above beds causes anxiety due to the perception of being watched, which is not addressed by existing systems.

Method used

A monitoring device with an infrared imaging unit, a human sensor, and a cover member that prevents reflections through an uneven shape or diffuse reflection, allowing the device to capture images without revealing the caregiver's presence.

Benefits of technology

Prevents resident faces from being reflected in images, reducing anxiety and enabling accurate behavior determination of caregivers while maintaining device inconspicuousness.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024162612000001_ABST
    Figure 2024162612000001_ABST
Patent Text Reader

Abstract

To provide a monitoring device capable of reducing the anxiety of care recipients due to being reflected in images by preventing care recipients from being seen in images.SOLUTION: The monitoring device used for monitoring care recipients installed above beds in nursing care facilities includes: an imaging unit that picks up images of a care recipient using infrared light; a person presence sensor; a drive unit configured to change the imaging direction of the imaging unit based on detection information of the person presence sensor; and a cover member covering the imaging unit and the drive unit. The cover member has an anti-reflection function on the cover member.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a monitoring device and a monitoring system. [Background technology]

[0002] In Japan, the standard of living has improved, the sanitary environment has improved, and the level of medical care has improved, all of which have come with the rapid economic growth since the war. This, combined with the declining birth rate, has resulted in an aging society with a high aging rate. In such an aging society, it is expected that the number of people who require nursing care due to illness, injury, aging, etc. will increase.

[0003] In facilities such as hospitals and elderly care facilities, people who need care may fall while walking or fall off their beds and get injured. For this reason, systems are being developed that enable caregivers, nurses, and other staff to rush to the scene immediately in response to the actions of people who need care.

[0004] The following prior art is disclosed in Patent Document 1 below. An imaging module built into a multipurpose pole is driven to rotate around a predetermined rotation axis, enabling imaging of a 360-degree range. A cover body of a dark color such as black or brown is provided to encase the imaging module. When a human sensor detects a visitor or the like, the rotation of the imaging module is stopped at a position corresponding to the position where the human sensor detected the visitor or the like, and imaging of the visitor or the like begins. By providing the cover body, the presence of the camera cannot be confirmed from the outside, which makes visitors feel uncomfortable and prevents intruders from avoiding the camera. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2002-290960 A Summary of the Invention [Problem to be solved by the invention]

[0006] However, when the above-mentioned prior art is applied to a monitoring device for care recipients in a nursing care facility, the following problem occurs. In a nursing care facility, in order to monitor residents such as care recipients, it is necessary to install a monitoring camera on the ceiling or the like above the bed in the room. As a result, the face of the resident sleeping in the bed is reflected by the cover covering the camera. This makes the resident feel uneasy and uncomfortable that they are being monitored.

[0007] The present invention has been made to solve the above-mentioned problems, and aims to provide a monitoring device and a monitoring system that can prevent a care recipient or the like from being reflected in the image and suppress anxiety or the like of the care recipient or the like caused by the reflection. [Means for solving the problem]

[0008] The above-mentioned object of the present invention is achieved by the following means.

[0009] (1) A monitoring device that is installed above a bed in a nursing care facility and used to monitor a person receiving care, the monitoring device comprising: an imaging unit that captures an image of the person receiving care using infrared light; a human presence sensor; a drive unit that changes the imaging direction of the imaging unit based on detection information from the human presence sensor; and a cover member that covers the imaging unit and the drive unit, the cover member having a function to prevent reflections on the cover member.

[0010] (2) The monitoring device described in (1) above, wherein the cover member has at least one of the anti-glare function by having an uneven shape or the anti-glare function by diffuse reflection.

[0011] (3) The monitoring device described in (1) above, further comprising a behavior judgment unit that judges the behavior of the person being cared for based on the image captured by the imaging unit.

[0012] (4) A monitoring device as described in (3) above, which has a three-dimensional image acquisition unit that acquires a three-dimensional image of the person being cared for, and the behavior determination unit determines the behavior of the person being cared for based on the image captured by the imaging unit and the acquired three-dimensional image.

[0013] (5) A monitoring device as described in (1) above, having a three-dimensional image acquisition unit that acquires a three-dimensional image of the person being cared for, and an output unit that outputs the image captured by the imaging unit and the acquired three-dimensional image.

[0014] (6) The monitoring device described in (1) above, wherein the cover member transmits visible light with a transmittance of 10% or less.

[0015] (7) The monitoring device according to (1) above, wherein the driving unit slows down the speed at which the imaging direction of the imaging unit is changed based on information about a set time.

[0016] (8) The monitoring device described in (1) above, wherein the entire monitoring device is the same color as the cover member.

[0017] (9) The behavior determination unit of the monitoring device described in (3) above uses a trained neural network to recognize the skeleton of the person being cared for based on the image, and determines the behavior of the person being cared for based on the recognized skeleton.

[0018] (10) A monitoring system comprising the monitoring device described in claim 5, a receiving unit that receives the image and the three-dimensional image output by the output unit, and a behavior determination unit that determines the behavior of the person being cared for based on the image and the three-dimensional image received by the receiving unit. Effect of the Invention

[0019] A monitoring device installed above a bed in a nursing care facility is equipped with an imaging unit that captures an image of the caregiver using infrared light and a motion sensor. A cover member that covers the imaging unit and a drive unit that changes the imaging direction of the imaging unit based on detection information from the motion sensor is equipped with a reflection prevention function. This prevents the care recipient from being reflected in the image, thereby reducing anxiety caused by the care recipient due to reflection. [Brief description of the drawings]

[0020] [Figure 1] FIG. 1 is a diagram showing a schematic configuration of a monitoring system. [Diagram 2] FIG. 2 is a block diagram showing a hardware configuration of the information processing device. [Diagram 3] FIG. 1 is an explanatory diagram showing a schematic configuration of an information processing device. [Figure 4] FIG. 11 is an explanatory diagram showing another example of a schematic configuration of an information processing device. [Diagram 5] FIG. 4 is a block diagram showing the functions of a control unit. [Figure 6] FIG. [Figure 7] FIG. 13 is a diagram showing a human rectangle detected in a captured image. [Figure 8] FIG. 2 is a schematic diagram showing joint points. [Figure 9] FIG. 13 is a schematic diagram showing joint points detected based on a human rectangle; [Figure 10] 4 is a flowchart showing the operation of the monitoring system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] Hereinafter, a monitoring device and a monitoring system according to an embodiment of the present invention will be described with reference to the drawings. In the drawings, the same elements are given the same reference numerals, and duplicated explanations will be omitted. In addition, the dimensional ratios in the drawings are exaggerated for the convenience of explanation, and may differ from the actual ratios.

[0022] FIG. 1 is a diagram showing a schematic configuration of a monitoring system 10. As shown in FIG.

[0023] The watching system 10 includes an information processing device 100, a communication network 200, and a mobile terminal 300. The information processing device 100 constitutes a watching device. A part of the information processing device 100, or a part or all of the watching system 10 may constitute the watching device.

[0024] The information processing device 100 is connected to the mobile terminal 300 via the access point 210 by the communication network 200 so that they can communicate with each other. The information processing device 100 may be one integrated device. The information processing device 100 may be a plurality of devices that are separately arranged. A server (not shown) that can communicate with the information processing device 100 and the mobile terminal 300 via the communication network 200 may be provided. Then, some of the functions of the information processing device 100 may be implemented by the server. Also, a fixed terminal (not shown) that can communicate with the information processing device 100 and the mobile terminal 300 via the communication network 200 may be provided. Then, some or all of the functions of the mobile terminal 300 may be implemented by the fixed terminal.

[0025] The information processing device 100 may be disposed at a high position on the ceiling or wall of each room of the subject 500. The subject 500 is, for example, a person who needs care or nursing. The subject 500 constitutes a person receiving care. The mobile terminal 300 is carried by each staff member who provides care or nursing for the subject 500. The mobile terminal 300 includes a smartphone and a tablet terminal.

[0026] 2 is a block diagram showing a hardware configuration of the information processing device 100. The information processing device 100 includes a control unit 110, a communication unit 120, a storage unit 130, and a camera unit 140, which are interconnected via a bus.

[0027] The control unit 110 is configured with a CPU (Central Processing Unit) and memories such as a RAM (Random Access Memory) and a ROM (Read Only Memory), and controls each unit of the information processing device 100 and performs arithmetic processing according to a program. The functions of the control unit 110 will be described in detail later.

[0028] The communication unit 120 is an interface circuit (eg, a LAN card) for communicating with the mobile terminal 300 and the like via the communication network 200.

[0029] The storage unit 130 stores various programs and various data, and is configured, for example, by an SSD or HDD.

[0030] Camera unit 140 includes camera 141, drive mechanism 142, and motion sensor 143. Camera 141 constitutes an imaging section that captures an image of subject 500. Drive mechanism 142 constitutes a drive section. Motion sensor 143 constitutes a three-dimensional image acquisition section.

[0031] The camera unit 140 is integrated with the information processing device 100 and installed above the bed 70. Specifically, for example, the camera unit 140 is arranged together with the information processing device 100 at a high position (at least higher than the bed) on the ceiling or a wall (side surface) of the room of the subject 500.

[0032] The camera 141 captures a two-dimensional captured image 700 (see FIG. 8; hereinafter, also simply referred to as "captured image 700"). The captured image 700 includes a moving image and a still image. The captured image 700 may be a moving image made up of a plurality of frames (still images). The camera 141 is an infrared camera, but a visible light camera may be used instead, or a combination of these may be used. For ease of explanation, the following description will be given taking as an example a case where the captured image 700 is a moving image made up of a plurality of frames captured by an infrared camera. The infrared camera may be configured to include an optical system such as a lens, and an imaging sensor.

[0033] The camera 141 can capture an image 700 overlooking a subject 500 lying in bed 70.

[0034] Fig. 3 is an explanatory diagram showing a schematic configuration of information processing device 100. Driving mechanism 142 changes the imaging direction of camera 141. Driving mechanism 142 may include a motor, gears, and a joint member with camera 141. Camera 141 may change its imaging direction by rotating about a predetermined axis, for example, in the direction indicated by the arrow in Fig. 3.

[0035] 3, camera unit 140 includes a cover member 144 that covers camera 141 and drive mechanism 142. Cover member 144 is colored gray in FIG.

[0036] If the driving mechanism 142 is located in a position that cannot be seen from outside the information processing device 100, the cover member 144 may cover only the camera 141.

[0037] The cover member 144 can have an anti-reflection function on the cover member 144 by having the uneven shape 144a. The anti-reflection function can prevent the face of the subject 500 sleeping on the bed 70 from being reflected on the cover member 144 due to the reflection of the cover member 144. The uneven shape 144a includes a linear depression or a pattern with a linear bulge, in addition to a simple bulge or depression.

[0038] The cover member 144 may have a function of preventing reflection by diffuse reflection. For example, the diffuse reflection may be realized by embedding suitable granular matter in the base material of the cover member 144.

[0039] The cover member 144 may achieve anti-glare functionality by using the uneven surface 144a and diffuse reflection.

[0040] The anti-reflection function is a function that makes a face unrecognizable on the cover member 144 at a position 3 m away from the cover member 144, for example. When the information processing device 100 is installed on the ceiling of a room with an average ceiling height, the anti-reflection function can make a face unrecognizable on the cover member 144. It is preferable that the anti-reflection function is a function that makes a face unrecognizable on the cover member 144 at a position 2 m away from the cover member 144. It is more preferable that the anti-reflection function is a function that makes a face unrecognizable on the cover member 144 at a position 1 m away from the cover member 144.

[0041] The cover member 144 may be configured to transmit visible light with a transmittance of 10% or less. For this purpose, the cover member 144 may be manufactured using, for example, a near-infrared-transmitting black dispersion liquid and a general carbon black dispersion liquid. The camera 141 and the driving mechanism 142 covered with the cover member 144 having a visible light transmittance of 10% or less cannot be seen by the naked eye through the cover member 144. On the other hand, the imaging sensor of the camera 141 can detect visible light transmitted through the cover member 144 having a visible light transmittance of 10% or less. Therefore, the cover member 144 has a visible light transmittance of 10% or less. This makes it possible to make the camera 141 and the driving mechanism 142 invisible to the subject 500. At the same time, a color captured image 700 can be captured with the visible light transmitted through the cover member 144. The color captured image 700 is, for example, an image in which at least one of the three values ​​of RGB values ​​is not 0.

[0042] It is preferable that the entire information processing device 100 is the same color as the cover member 144. This can prevent the subject 500 from being aware of the location where the camera 141 is mounted on the information processing device 100. This can make the camera 141 and the like less noticeable.

[0043] The human sensor 143 is a sensor for detecting the position of the target person 500. The human sensor 143 is configured, for example, by a stereo camera or a TOF (Time Of Flight) sensor. The human sensor 143 detects depth information for each pixel within a predetermined detection range to generate a distance image 800 (see FIG. 7 ; hereinafter, also simply referred to as “distance image 800”). The depth information is information on the distance from the camera unit 140 to an object (for example, a person, a floor, a wall, a bed, and furniture). The depth information can be information on the distance in a direction perpendicular to the captured image 700 (normal direction). The distance image 800 is depth information for each pixel. Therefore, the distance image 800 can also be said to be a three-dimensional image. The distance image 800 constitutes the detection information of the human sensor 143.

[0044] The detection direction and detection range of the depth information by the motion sensor 143 may be fixed. The detection range of the depth information by the motion sensor 143 may be wider than the imaging range of each frame of the captured image 700 by the camera 141. Note that the imaging range by the camera 141 is expanded by changing the imaging direction of the camera 141. The fixed detection range of the motion sensor 143 may include multiple imaging ranges by the camera 141 before and after a change in the imaging direction. Note that the distance image 800 does not include texture information including patterns, colors, and the like.

[0045] The motion sensor 143 may be replaced by other devices for detecting the location of people, including, for example, beacons.

[0046] FIG. 4 is an explanatory diagram showing yet another example of the schematic configuration of the information processing device 100. In FIG. 4, the human sensor 143 and the like are omitted from the illustration. In the information processing device 100 of FIG. 4, the proportion of the part that moves when the imaging direction of the camera 141 is changed is relatively large. In this case, even if the lens of the camera 141 is covered with the cover member 144, the movement accompanying the change in the imaging direction of the camera 141 is likely to be recognized by the subject 500. In this case, the cover member 144 may be a member that covers the entire information processing device 100 except for the part installed on the ceiling or the like. This can reduce the possibility that the subject 500 will recognize the movement accompanying the change in the imaging direction of the camera 141.

[0047] The function of the control unit 110 will now be described.

[0048] 5 is a block diagram showing functions of the control unit 110. The control unit 110 functions as a position detection unit 111, a drive control unit 112, a recognition unit 113, an estimation unit 114, and a behavior recognition unit 115. The behavior recognition unit 116 constitutes a behavior determination unit.

[0049] The position detection unit 111 acquires a distance image 800 from the human presence sensor 143 and detects the position of the target person 500 from the distance image 800 .

[0050] FIG. 6 is a diagram showing a distance image 800. In the distance image 800 of FIG. 6, depth information (the distance from the camera unit 140 to an object) is shown by color tones. Note that the distance image 800 shown in FIG. 6 is an image obtained by converting the distance image 800 in which depth information is shown by differences in color into gray. For this reason, the tone density of the distance image 800 shown in FIG. 6 does not necessarily accurately reflect the depth information. In the example of FIG. 6, a subject 500 (person) is detected in the distance image 800.

[0051] The position detection unit 111 may detect the position of the target person 500 by a known technique such as a time subtraction method (frame subtraction method) or a background subtraction method. The position detection unit 111 may detect the position of the target person 500 by using a trained model of a neural network that has been trained to detect a person from the distance image 800.

[0052] Drive control unit 112 rotates camera 141 using drive mechanism 142 so that subject 500 detected by position detection unit 111 is within the imaging range of camera 141. This changes the imaging direction of camera 141 so that subject 500 detected by position detection unit 111 is included in captured image 700. When multiple people are detected in distance image 800, the imaging direction of camera 141 can be changed so that at least one of them is included in captured image 700. Calibration is performed between distance image 800 and captured image 700 to associate each pixel with each other.

[0053] The recognition unit 113 recognizes (detects) the target person 500 from the captured image 700.

[0054] FIG. 7 is a diagram showing a human rectangle 710 detected in a captured image 700. The recognition unit 113 may detect the subject 500 included in the captured image 700 as a human rectangle 710 that is an area including the subject 500. Specifically, the recognition unit 113 detects an area in which an object exists on the captured image 700. Then, the recognition unit 113 detects the subject 500 by estimating a category of the object included in the detected area. The area in which the object exists is detected as a candidate rectangle including the object on the captured image. Among the detected candidate rectangles, a candidate rectangle estimated to have an object category of a person is detected as a human rectangle 710 to detect the subject 500. The recognition unit 113 may use a trained model of a neural network reflecting a dictionary (parameters) for detecting the human rectangle 710 from the captured image 700. Then, the recognition unit 113 may detect the human rectangle 710 from the captured image 700 using the trained model. As the trained model, for example, a known model, Region Proposal Network (RPN), may be used. The recognition unit 113 may output a human rectangle 710 as a combination of the captured image 700 and the coordinates of two opposing vertices e1 and e2 of the human rectangle 710.

[0055] The recognition unit 113 may detect the target person 500 as a silhouette from the captured image 700 using a known technique such as a time subtraction method (frame subtraction method) or a background subtraction method.

[0056] The estimation unit 114 estimates joint points 720 of the target person 500 recognized by the recognition unit 113. Specifically, the estimation unit 114 recognizes the joint points 720 from the human rectangle 710. The joint points 720 form a skeleton.

[0057] FIG. 8 is a schematic diagram showing an articulation point 720.

[0058] In the example of FIG. 8, the joint points 720 include a head joint point 720a, a shoulder joint point 720b, a waist joint point 720c, and a joint point 720d constituting the trunk.

[0059] FIG. 9 is a schematic diagram showing articulation points 720 detected based on a human rectangle 710.

[0060] In the example of FIG. 9, joint points 720 of a subject 500 in a sitting position on a chair are shown. The estimation unit 114 may estimate the joint points 720 using a trained model of a neural network that has been trained to detect the joint points 720 from a human rectangle 710. As the trained model, a known model such as Deep Pose may be used. Details of DeepPose are described in a known document (Alexander Toshev, et al. “DeepPose: Human Pose Estimation via Deep Neural Networks”, in CVPR, 2014).

[0061] The behavior recognition unit 115 recognizes (determines) the behavior of the subject 500 based on the joint points 720 estimated by the estimation unit 114. For example, when a lying posture of the subject 500 is detected from the joint points 720 in a short time after a standing posture of the subject 500 is detected, the behavior recognition unit 115 may recognize the behavior of "falling". The behavior of the subject 500 may be recognized using a trained model of a neural network. The trained model is a model trained to estimate behavior based on a plurality of joint points 720, each of which is estimated from a plurality of captured images adjacent in time series. The behavior of the subject 500 may be recognized using a relative positional relationship between the joint points 720 and an object (e.g., a bed 70). For example, when a lying posture is detected from the joint points 720 outside the bed 70 and in a relatively close range from the bed 70 in the captured image 700, the behavior of "falling" may be recognized. The position and extent of the bed 70 may be preset in a coordinate system of the coordinates of the articulation points 720 .

[0062] The control unit 110 may detect an event related to the subject 500 from the behavior of the subject 500 recognized by the behavior recognition unit 115. An event is a change in the state or situation of the subject 500, such as getting up, getting out of bed, falling, or tripping, which should be reported (notified) to a caregiver, etc. When the control unit 110 detects an event, it may transmit an event notification notifying the contents of the event to an external device such as the mobile terminal 300 or a fixed terminal (not shown) of the administrator.

[0063] The operation of the monitoring system 10 will now be described.

[0064] 10 is a flowchart showing the operation of the monitoring system 10. This flowchart can be executed by the control unit 110 of the information processing device 100 in accordance with a program.

[0065] The control unit 110 acquires a distance image 800 by the human presence sensor 143 (S101).

[0066] The control unit 110 detects the target person 500 from the distance image 800 (S102).

[0067] The control unit 110 changes the imaging direction of the camera 141 so that the detected target person 500 is within the imaging range of the camera 141 (S103).

[0068] The control unit 110 detects the target person 500 from the image 700 captured by the camera 141 (S104).

[0069] The control unit 110 estimates (recognizes) the joint points 720 of the target person 500 detected from the captured image 700 (S105).

[0070] The control unit 110 determines the behavior of the target person 500 based on the estimated joint points 720 etc. (S106).

[0071] Steps S101 to S106 are repeatedly executed. That is, the target person 500 detected from the distance image 800 is continuously tracked by changing the imaging direction of the camera 141. Then, the behavior of the target person 500 is continuously determined based on the joint points 720 estimated from the image of the target person 500 included in the captured image 700.

[0072] Second embodiment A second embodiment of the present invention will be described. This embodiment differs from the first embodiment in the following respects. In the first embodiment, a two-dimensional joint point 720 is estimated based on a two-dimensional captured image 700. On the other hand, in this embodiment, a three-dimensional joint point 720T is estimated based on a two-dimensional captured image 700 and a distance image 800. In other respects, this embodiment is similar to the first embodiment, so duplicated explanations will be omitted.

[0073] The function of the control unit 110 will be described with reference to FIG.

[0074] The estimation unit 114 estimates a three-dimensional joint point 720T based on the human rectangle 710 and the distance image 800. The three-dimensional joint point 720T is a joint point 720 expressed by three-dimensional coordinates.

[0075] Specifically, the estimation unit 114 estimates the three-dimensional joint point 720T as follows, for example. As in the first embodiment, the two-dimensional joint point 720 is estimated from the human rectangle 710. Depth information corresponding to the pixels of the two-dimensional joint point 720 is extracted from the distance image 800 for each two-dimensional joint point 720. The extracted depth information is associated with the corresponding two-dimensional joint point 720. The two-dimensional joint point 720 is converted into the three-dimensional joint point 720T in a predetermined three-dimensional coordinate system using the depth information associated with the joint point 720. The predetermined three-dimensional coordinate system may be a three-dimensional coordinate system in which the position and range of the bed 70 are preset in the room of the subject 500.

[0076] The behavior recognition unit 116 recognizes the behavior of the target person 500 based on the three-dimensional joint points 720T. By recognizing the behavior based on the three-dimensional joint points 720T, it is possible to improve the accuracy of detecting the behavior.

[0077] The motion sensor 143 that generates the distance image 800 may be composed of an infrared camera and an infrared projector. In this case, the infrared camera may also serve as the camera 141. The infrared projector projects a predetermined dot pattern using infrared rays within a predetermined range. The infrared camera captures an infrared image of the dot pattern projected onto a target object including the subject 500. The distance (depth information) to the target object is calculated by utilizing the fact that the geometric shape of the captured dot pattern changes depending on the distance to the target object. In this way, the distance image 800 is generated.

[0078] Furthermore, the functions of the estimation unit 114 and the behavior recognition unit 116 may be executed by a server (not shown) communicatively connected to the information processing device 100 and the mobile terminal 300. In this case, the captured image 700 and the distance image 800 are transmitted (output) from the information processing device 100 to the server. The server receives the captured image 700 and the distance image 800 by a receiving unit. The communication unit 120 constitutes an output unit.

[0079] Third embodiment A third embodiment of the present invention will now be described. In this embodiment, the speed at which the imaging direction of the camera 141 is changed is slowed down in accordance with time.

[0080] The driving mechanism 142 that changes the imaging direction of the camera 141 may include a motor and a power transmission mechanism such as gears. The faster the imaging direction of the camera 141 is changed, the louder and higher the sound generated by the motor and the power transmission mechanism becomes. Therefore, in this embodiment, the speed at which the imaging direction of the camera 141 is changed is slowed down based on information about the set time. Information about the set time may be stored in the storage unit 130 in advance. The control unit 110 controls the driving mechanism 142 at the set time to slow down the speed at which the imaging direction of the camera 141 is changed. The set time may be appropriately set according to, for example, the sleeping time of the subject 500. The set time may be set at night, for example. This makes it possible to reduce the generated sound of the driving mechanism 142 during a time when the subject 500 may be sensitive to the generated sound due to the relatively small environmental sound. Therefore, it is possible to suppress the influence of the generated sound of the driving mechanism 142 on the sleep of the subject 500.

[0081] The embodiment provides the following advantages.

[0082] A monitoring device installed above a bed in a nursing care facility is equipped with an imaging unit that captures an image of the caregiver using infrared light and a motion sensor. A cover member that covers the imaging unit and a drive unit that changes the imaging direction of the imaging unit based on detection information from the motion sensor is equipped with a reflection prevention function. This prevents the care recipient from being reflected in the image, thereby reducing anxiety caused by the care recipient due to reflection.

[0083] The cover member has at least one of the anti-glare function due to the uneven shape and the anti-glare function due to diffuse reflection, which makes it possible to simply and effectively provide the cover member with the anti-glare function.

[0084] In addition, the behavior of the care recipient is determined based on the image captured by the imaging unit, thereby making it possible to determine the behavior of the care recipient while suppressing anxiety of the care recipient due to being caught in the image.

[0085] Furthermore, a three-dimensional image of the care recipient is acquired, and the behavior of the care recipient is judged based on the image captured by the imaging unit and the three-dimensional image, thereby improving the accuracy of judging the behavior of the care recipient.

[0086] In addition, a three-dimensional image of the care recipient is acquired, and the image captured by the imaging unit and the acquired three-dimensional image are output. This allows the behavior of the care recipient to be executed by an external device using the image and the three-dimensional image. This makes it possible to more flexibly improve the accuracy of determining the behavior of the care recipient.

[0087] The cover member is configured to transmit visible light with a transmittance of 10% or less, which makes it possible to prevent the care recipient from seeing the camera and capture color images.

[0088] Furthermore, the speed at which the imaging direction of the imaging unit is changed is slowed down based on the information on the set time, thereby making it possible to reduce the effect of the noise generated by the drive unit on the sleep of the care recipient.

[0089] In addition, the entire monitoring device is the same color as the cover member, which makes it possible to prevent the care recipient from being aware of the location of the imaging unit in the monitoring device.

[0090] In addition, the trained neural network is used to recognize the skeleton of the care recipient based on the image, and the behavior of the care recipient is determined based on the recognized skeleton. This makes it possible to determine the behavior of the care recipient with high accuracy using a simpler configuration.

[0091] The above-described configurations of the monitoring device and the monitoring system are the main configurations described in order to explain the features of the above-described embodiment. Therefore, the monitoring device and the monitoring system are not limited to the above-described configurations, and can be modified in various ways within the scope of the claims. In addition, the configurations of general monitoring devices and monitoring systems are not excluded.

[0092] For example, some steps may be omitted from the above-described flowchart, other steps may be added, some of the steps may be executed simultaneously, and one step may be divided into multiple steps and executed.

[0093] The means and methods for performing various processes in the above-mentioned system can also be realized by a dedicated hardware circuit. The means and methods for performing various processes in the above-mentioned system can also be realized by a programmed computer. The above-mentioned program may be provided by a computer-readable recording medium such as a USB memory or a DVD (Digital Versatile Disc)-ROM, or may be provided online via a network such as the Internet. In this case, the program recorded in the computer-readable recording medium is usually transferred to and stored in a storage unit such as a hard disk. The above-mentioned program may also be provided as a standalone application software, or may be incorporated as a function into the software of a device such as an information processing device. [Explanation of symbols]

[0094] 10 Monitoring system, 70 beds, 100 Information processing device, 110 control section, 111 Position detection unit, 112 Drive control unit, 113 Recognition Department, 114 Estimation Department, 115 Behavioral Recognition Department, 120 Communications Department, 130 storage section, 140 camera unit, 141 cameras, 142 Drive mechanism, 143 Human sensor, 200 communication networks, 210 access points, 300 mobile devices, 500 subjects, 700 captured images, 710 people rectangle, 720 articulation points.

Claims

1. A monitoring device that is installed above a bed in a nursing care facility and used to monitor a person receiving care, an imaging unit that captures an image of the care recipient using infrared light; A human sensor and A drive unit that changes an imaging direction of the imaging unit based on detection information of the human presence sensor; a cover member for covering the imaging unit and the driving unit, The cover member has a function of preventing reflection on the cover member. Monitoring device.

2. The monitoring device according to claim 1 , wherein the cover member has at least one of the anti-glare function by having an uneven shape and the anti-glare function by diffuse reflection.

3. The monitoring device according to claim 1 , further comprising a behavior determining unit that determines a behavior of the care recipient based on the image captured by the imaging unit.

4. A three-dimensional image acquisition unit for acquiring a three-dimensional image of the care recipient, The monitoring device according to claim 3 , wherein the behavior determining unit determines the behavior of the care recipient based on the image captured by the imaging unit and the acquired three-dimensional image.

5. A three-dimensional image acquisition unit for acquiring a three-dimensional image of the care recipient, The monitoring device according to claim 1 , further comprising an output unit that outputs the image captured by the imaging unit and the acquired three-dimensional image.

6. The monitoring device according to claim 1 , wherein the cover member transmits visible light with a transmittance of 10% or less.

7. The monitoring device according to claim 1 , wherein the drive unit slows down a speed at which the imaging direction of the imaging unit is changed based on information about a set time.

8. The monitoring device according to claim 1 , wherein the entire monitoring device is the same color as the cover member.

9. The monitoring device of claim 3, wherein the behavior determination unit uses a trained neural network to recognize the skeleton of the person being cared for based on the image, and determines the behavior of the person being cared for based on the recognized skeleton.

10. The monitoring device according to claim 5 ; a receiving unit that receives the image output by the output unit and the three-dimensional image; a behavior determining unit that determines a behavior of the care recipient based on the image and the three-dimensional image received by the receiving unit; A monitoring system having the above.

Citation Information

Patent Citations

  • Detection recognizing system

    JP2018088157A

  • Domed surveillance camera including means for blocking scattered reflection and stray light

    US20150277000A1

  • Imaging device

    WO2021152935A1

  • Open space monitor system

    JP2002290960A