Watching support device and watching support system

The monitoring support device addresses privacy concerns and reduces system complexity by outputting status information instead of raw images, enhancing privacy protection and lowering costs in nursing care facilities.

JP2024169894AInactive Publication Date: 2024-12-06NIPPON SEIMITSU SOKKI KK
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2023086736
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-26
Publication Date
2024-12-06
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Conventional monitoring systems for nursing care facilities output raw image data, which can compromise the privacy of the care recipients and require significant communication infrastructure, leading to high system construction costs, especially when monitoring multiple individuals.

Method used

A monitoring support device that captures images, determines the state of the monitored object, and outputs status information instead of raw image data, using a compact camera unit with low-resolution imaging and advanced processing to ensure privacy and reduce data transmission load.

Benefits of technology

The system accurately determines the state of monitored individuals while protecting their privacy and reducing system complexity and communication requirements, allowing for efficient monitoring of multiple subjects with lower costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024169894000001_ABST
    Figure 2024169894000001_ABST
Patent Text Reader

Abstract

To realize the construction of a simple system considering the privacy of a watching target while adequately grasping the state of the watching target.SOLUTION: A watching support device 10 includes: an imaging section 11a for obtaining image data by imaging a living space of a watching target; a state determination section 12a for determining to which one of a plurality of predetermined modes the state of the watching target corresponds based on the image data obtained in the imaging section 11a; and an information output section 12b for outputting a determination result by the state determination section 12a as status information related to the state of the watching target in place of the image data obtained in the imaging section 11a.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a watching support device and a watching support system. [Background technology]

[0002] In recent years, with the increase in the demand for nursing care, a monitoring support method for watching over those in need of care has been proposed, for example, by capturing images of the living space of a nursing facility with a camera and using the captured images to detect the movements of the person in need of care (the person being monitored) in the living space (see, for example, Patent Documents 1, 2, and 3). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-91521 A [Patent Document 2] JP 2016-120190 A [Patent Document 3] JP 2017-126372 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the conventional monitoring support technology described above, image data obtained by capturing images of the living space by a camera is output directly to the side providing the monitoring support (for example, the side of a computer device operated by a care staff member), so the privacy of the person requiring care (the person being monitored) in the living space is not necessarily taken into consideration, and there is a risk that the person requiring care and his / her family, etc. will feel resistance. In addition, the output of image data requires a communication environment and data processing capacity that can transmit and receive the image data, which may lead to high costs for system construction, especially when there are a large number of people being monitored.

[0005] The present invention aims to provide technology that enables the construction of a simple system that can accurately grasp the status of an entity being monitored, while still respecting the privacy of the entity being monitored. [Means for solving the problem]

[0006] One aspect of the present invention is An imaging unit that captures an image of a space of a monitoring target to obtain image data; A state determination unit that determines which of a plurality of predetermined states the state of the monitoring target corresponds to based on the image data obtained by the imaging unit; an information output unit that outputs a result of the determination by the state determination unit as status information regarding the state of the object to be watched over, instead of image data obtained by the imaging unit; This is a monitoring support device equipped with the above. Effect of the Invention

[0007] According to the present invention, it is possible to construct a simple system that allows the state of an entity being watched over to be accurately grasped, while still respecting the privacy of the entity being watched over. [Brief description of the drawings]

[0008] [Figure 1] 1 is an explanatory diagram illustrating a configuration example of a monitoring support system according to an embodiment of the present invention; [Diagram 2] 1 is a functional block diagram illustrating a configuration example of a watching support device according to an embodiment of the present invention. [Diagram 3] 1 is an explanatory diagram showing an overview of a zone setting process in a watching support device according to an embodiment of the present invention; [Figure 4] 1 is an explanatory diagram showing an overview of data flow in a watching support device according to one embodiment of the present invention; [Diagram 5] 1 is an explanatory diagram showing an overview of a status determination process in a watching support device according to one embodiment of the present invention; [Figure 6]1 is an explanatory diagram showing an overview of a zone setting process performed using a binary image in a watching support device according to one embodiment of the present invention; [Figure 7] 1 is an explanatory diagram showing an overview of a status information output process in a watching support system according to an embodiment of the present invention; [Figure 8] 1 is an explanatory diagram showing an overview of a live image output process in a watching support system according to an embodiment of the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0010] <1. Example of monitoring support system configuration> First, a configuration example of a watching support system according to this embodiment will be described.

[0011] The monitoring support system is a system constructed for monitoring a monitoring target. More specifically, the monitoring support system is configured to support a person in charge of watching the monitoring target in watching over the monitoring target.

[0012] The monitoring support system is installed and used in, for example, a nursing facility. In this case, the monitored object is a person in need of care who resides in the nursing facility, and the person in charge of monitoring is a nursing staff member. However, the installation location is not limited to a nursing facility, and the system may be installed in, for example, an ordinary home for home care by a family member, a hospital for a nurse to monitor an inpatient, or a childcare facility for a childcare worker to monitor an infant. Furthermore, the monitored object is not limited to a human being, and may be an animal such as a pet or livestock.

[0013] Monitoring here means grasping the behavior and condition of the monitored object so as to determine whether there is an abnormality in the behavior and condition of the monitored object and to be able to immediately respond if an abnormality is detected. In particular, for example, in nursing care sites, the importance of monitoring is increasing in order to prevent accidents such as tripping or falling of the person requiring care.

[0014] In addition, it is desirable for monitoring to be performed at a location away from the object being monitored, due to issues such as securing the personnel to be responsible for monitoring and the equipment environment, etc. In other words, it is desirable for the monitoring support system to be constructed so as to be compatible with centralized management by the person in charge of monitoring. On the other hand, consideration must also be given to protecting the privacy of those being watched, i.e., the subjects of watching.

[0015] In addition, in order to reduce the burden on users, the monitoring support system is required to be easy to install and relocate, and also to be inexpensive.

[0016] The monitoring support system according to the present embodiment has been constructed in consideration of these demands. Hereinafter, a configuration example of the monitoring support system according to the present embodiment will be specifically described, taking as an example a case where the system is installed in a care facility. FIG. 1 is an explanatory diagram illustrating a schematic configuration example of a monitoring support system installed in a care facility.

[0017] As shown in FIG. 1, the watching support system 1 includes a camera unit 10 that functions as a watching support device according to this embodiment.

[0018] The camera unit 10 is installed in the room 2 of a resident (i.e., a person requiring care who is the object of monitoring) in a care facility. More specifically, the camera unit 10 is attached to a wall or ceiling of the room 2, and is arranged so as to be able to capture an image of the space (i.e., living space) within the room 2, particularly the space including the bed 3 used by the resident (person requiring care). To enable such an arrangement, the camera unit 10 is formed to be about the same size as a cigarette packet, for example. In other words, the camera unit 10 is configured to be small and lightweight so as to be easily attached to a wall or the like.

[0019] When there are multiple living rooms 2, the camera units 10 are installed individually in each living room 2. In other words, the monitoring support system 1 is configured with multiple camera units 10 so as to individually correspond to each of the multiple residents.

[0020] The specific configuration of the camera unit 10 will be described in detail later.

[0021] In addition to the camera unit 10, the monitoring support system 1 is configured to include a gateway 20 that serves as a relay point for communication with the camera unit 10, and a management server device 30 to which the gateway 20 is connected.

[0022] When there are multiple camera units 10, the gateway 20 is capable of communicating with each of the camera units 10. The communication with the camera units 10 may be, for example, wireless communication, but is not limited to this and may be wired communication. However, wireless communication does not require the installation of communication lines, so that even when multiple camera units 10 are installed, the installation can be easily performed. It should be noted that, if the camera unit 10 is configured to communicate directly with the management server device 30, the gateway 20 may be omitted. For example, if the camera unit 10 and the management server device 30 are installed in a one-to-one relationship or installed in a short distance between them, the gateway 20 can be omitted and the camera unit 10 and the management server device 30 can communicate directly wirelessly or the like, thereby simplifying the system configuration.

[0023] The management server device 30 is configured by an information processing terminal such as a computer device installed in a staff room (i.e., a room of the care staff) in the care facility, or a tablet device or a smartphone carried by the care staff. More specifically, the management server device 30 is configured by an information processing terminal having a function as a computer, and outputs information to the care staff using a display screen 31 of the information processing terminal. The information output using the display screen 31 includes display output of information on the monitored object (person requiring care) sent from the camera unit 10. In other words, the management server device 30 functions as a monitor device that is communicably connected to the camera unit 10 via the gateway 20 and displays and outputs information on the monitored object (person requiring care) based on the output contents from the camera unit 10.

[0024] <2. Example of the configuration of the monitoring support device (camera unit)> Next, a configuration example of the camera unit 10 that functions as a monitoring support device according to this embodiment will be described. FIG. 2 is a functional block diagram illustrating a configuration example of the watching support device according to this embodiment.

[0025] (Overall composition) As shown in FIG. 2, the camera unit 10 is roughly divided into a sensor module 11, a control module 12, and a communication module 13.

[0026] (Sensor module) The sensor module 11 captures an image of the space in the room 2 in which the camera unit 10 is installed, that is, the living space of a resident of the room 2 (a person requiring care who is a monitored subject). To this end, the sensor module 11 has an image sensor 11a such as a CMOS (Complementary Metal Oxide Semiconductor) sensor, an optical system 11b such as a wide-angle lens, and a light source 11c that irradiates illumination light such as infrared light, which are mounted on a substrate. The image sensor 11a is electrically connected to the control module 12, for example, via a flexible printed circuit (FPC) not shown. With this configuration, the sensor module 11 captures a moving image of the living space of the monitored subject, regardless of whether it is daytime or nighttime, and obtains image data consisting of a plurality of frames as a result of the imaging. In other words, the sensor module 11 functions as an imaging unit that captures an image of the living space of the monitored subject and obtains image data consisting of a plurality of frames.

[0027] The image sensor 11a in the sensor module 11 is configured to obtain low-resolution image data of 10,000 pixels or less. Specifically, the image sensor 11a is configured to obtain low-resolution image data of, for example, 64 pixels x 64 pixels = 4096 pixels. In this case, it is possible to use an image sensor 11a having a total pixel count of 64 pixels x 64 pixels. However, this is not necessarily limited to this, and it is also possible to use a general high-resolution sensor having a pixel count of several million pixels to several tens of millions pixels, and thin out the pixels to obtain low-resolution image data of, for example, 64 pixels x 64 pixels.

[0028] The optical system 11b in the sensor module 11 is configured to realize a viewing angle of, for example, 120°. As a result, even when the camera unit 10 is attached to the wall surface of the room 2, the sensor module 11 can cover 90% or more of the area in the room 2 as an imaging area.

[0029] (Control Module) The control module 12 is composed of, for example, a microcomputer, and controls the processing operations in the camera unit 10. The control processing performed by the control module 12 includes control processing for the operation of the sensor module 11 and the communication module 13, as well as control processing for image data received from the image sensor 11a.

[0030] These various control processes are performed by the control module 12 by executing a predetermined program installed in advance. To exchange various information including such a predetermined program with an external device (not shown), an interface unit 15 such as a USB (Universal Serial Bus) may be connected to the control module 12.

[0031] By executing a predetermined program, the control module 12 functions as a state determination section 12a, an information output section 12b, an information acquisition section 12c, a binarization processing section 12d, an area setting section 12e, and an information storage section 12f.

[0032] The state determination unit 12a has a function of determining, for each frame constituting the image data, which of a plurality of predetermined conditions the state of the object to be watched (specifically, the person in need of care shown in the image) corresponds to, based on the image data obtained by the sensor module 11, and making the determination result into status information on the state of the object to be watched. Note that the status information and specific examples of the plurality of predetermined conditions specified by the status information will be described in detail later.

[0033] The information output unit 12b has a function of outputting status information (i.e., the determination result by the status determination unit 12a) on the state of the monitored object to the outside (e.g., the gateway 20, the management server device 30, etc.) through the communication module 13. However, the information output unit 12b is configured to be able to respond to a selective output mode, for example, outputting the status information instead of the image data obtained by the sensor module 11, or outputting the image data obtained by the sensor module 11 instead of or together with the status information.

[0034] The information acquiring unit 12c has a function of acquiring various information sent from the outside (for example, the gateway 20, the management server device 30, etc.) through the communication module 13. The various information acquired by the information acquiring unit 12c includes image request information requesting the output of image data acquired by the sensor module 11, GUI (Graphical User Interface) operation information on the display screen, etc.

[0035] The binarization processing unit 12d is a function that performs binarization processing of image data when generating status information. More specifically, the binarization processing unit 12d performs binarization that makes it possible to distinguish between a portion determined to be a moving point and the other portion based on the inter-frame difference of the image data obtained by the sensor module 11. A specific example of the binarization processing will be described in detail later.

[0036] The area setting unit 12e has a function of setting a gaze area, which is a target area for state determination of the object being watched over by the state determination unit 12a, within the image capturing field angle of the sensor module 11. Specific examples of the gaze area to be set will be described in detail later.

[0037] The information storage unit 12f has a function of storing demarcation information of the gaze area set by the area setting unit 12e.

[0038] (Communication module) The communication module 13 is for establishing communication with the gateway 20 if a gateway 20 is present, and for establishing communication with the management server device 30 if a gateway 20 is not present, and is configured to perform short-range (e.g., approximately 10 m to 50 m) wireless communication in accordance with, for example, Bluetooth (registered trademark).

[0039] Upon establishing communication with the gateway 20, the communication module 13 transmits information to the management server device 30 via the gateway 20 under the control of the control module 12. Furthermore, upon establishing communication with the management server device 30, the communication module 13 transmits information directly to the management server device 30.

[0040] Similarly, by establishing communication with the gateway 20, the communication module 13 receives information from the management server device 30 through the gateway 20 while following the control of the control module 12. Also, by establishing communication with the management server device 30, the communication module 13 receives information directly from the management server device 30.

[0041] The protocol, data format, etc., used when the communication module 13 communicates are not limited to a specific format, and may be any format that allows information to be exchanged between the communication module 13 and the gateway 20 or the management server device 30.

[0042] (Housing) The sensor module 11, control module 12, and communication module 13 described above are housed in one housing (not shown) constituting the camera unit 10. As described above, the housing constituting the camera unit 10 is small and lightweight, for example, about the size of a cigarette pack, and is formed in a size suitable for attachment to a wall or ceiling surface of the room 2 of the person requiring care, who is the object to be monitored.

[0043] <3. Example of processing operation in monitoring support device (camera unit)> Next, an example of the processing operation in the camera unit 10 having the above-mentioned configuration will be described.

[0044] The processing operation examples of the camera unit 10 include an installation processing operation example and an operation processing operation example. The installation processing operation example is a processing operation example when installing the camera unit 10 in the living room 2 prior to operation of the camera unit. The operation processing operation example is a processing operation example when operating the camera unit installed in the living room 2. These processing operation examples will be described in order below.

[0045] (Example of installation process) The camera unit 10 is installed by attaching the camera unit 10 to a wall or ceiling of the living room 2. In this case, if the housing of the camera unit 10 is small and lightweight, about the size of a cigarette pack, it can be easily attached to the wall or ceiling of the living room 2.

[0046] By attaching the camera unit 10 to a wall or ceiling of the living room 2, the camera unit 10 can capture images of the state inside the living room 2 with the image sensor 11a. In this case, for example, if the optical system 11b in the sensor module 11 has a viewing angle of 120°, it is possible to fit 90% or more of the area inside the living room 2 within the imaging angle of view of the image sensor 11a.

[0047] When installing the camera unit 10, a zone setting process may be performed within the imaging angle of view of the image sensor 11a in conjunction with the installation. The zone setting process is performed by the function of the area setting unit 12e of the control module 12, and is a process for setting a gaze area within the imaging angle of view of the image sensor 11a of the camera unit 10. The gaze area refers to an area (zone) that should be particularly observed within the imaging angle of view when performing a process of generating status information, which will be described later.

[0048] (Zone setting process) Here, the zone setting process will be described in detail.

[0049] The zone setting process is preferably performed using an image captured by the image sensor 11a. In other words, it is preferable to output the image captured by the image sensor 11a to a display screen and perform the zone setting process on the display screen while visually checking the output image on the display screen. As a display screen for outputting the image capturing results by the image sensor 11a, for example, the display screen 31 in the management server device 30 can be used. However, this is not limited to this, and for example, an information processing terminal (specifically, a tablet device, a smartphone, etc.) capable of communicating with the camera unit 10 may be prepared, and the display screen of the information processing terminal may be used.

[0050] In the following description, an example will be given in which the zone setting process is performed on the display screen of an information processing terminal having a touch panel function. FIG. 3 is an explanatory diagram showing an overview of the zone setting process carried out on a display screen, and shows an example of a display output on the display screen.

[0051] As shown in the figure, an information processing terminal capable of communicating with the camera unit 10 outputs the image captured by the image sensor 11a of the camera unit 10 on the display screen 14a. As a result, the image captured within the imaging angle of the image sensor 11a is monitored and displayed on the display screen 14a as the state inside the room 2 in which the camera unit 10 is installed. Therefore, when installing the camera unit 10, by checking the contents of the monitoring display on the display screen 14a, it becomes possible to appropriately install the camera unit 10 so that, for example, the bed 3 used by the resident (person requiring care) is positioned within the imaging angle of the image sensor 11a. In the example shown in the figure, in addition to the bed 3, a room light 4 and a dressing table mirror 5 are present within the imaging angle of the image sensor 11a.

[0052] Also, on the display screen 14a of the portable information terminal, a frame image 14c that defines the range of the gaze area is displayed and output so as to be superimposed on the image captured by the image sensor 11a. In the illustrated example, a frame image 14c that connects any four points within the image capture angle of the image sensor 11a is displayed and output. The area (rectangular zone) surrounded by the frame image 14c is the range of the gaze area. In other words, in the illustrated example, the gaze area surrounded by the frame image 14c can be defined by definition information (hereinafter also referred to as zone position information) that specifies any four points within the image capture angle of view.

[0053] The demarcation information (zone position information) defining the gaze area is stored and held by the function of the information storage unit 12f in the control module 12, and is set in the control module 12. That is, the demarcation information of the gaze area is stored and held in the information storage unit 12f, the range of the gaze area is defined based on the demarcation information, and a frame image 14c indicating the range of the gaze area is displayed and output on the display screen 14a.

[0054] Since such a gaze area is an area (zone) that should be particularly focused on when generating status information, which will be described later, it is desirable to set it so as to include a location where the monitored subject is frequently present. For example, if the camera unit 10 is installed in a room 2 of a nursing facility, it is desirable to set the gaze area so as to include a bed 3 in the room 2. This is because the more frequently the monitored subject is present, the more accurately the status information, which will be described later, can be generated. Specifically, by setting the gaze area around the bed 3, it becomes possible to detect the movement of the monitored subject on the bed 3, getting out of the bed 3, etc.

[0055] Setting the range of the gaze area by using the operation function (touch panel function) of the portable information terminal while referring to the display output contents on the display screen 14a provides a very convenient and easy setting for the worker who sets the range. Specifically, for example, in a state where a frame image 14c indicating the range of the gaze area is displayed and output on the display screen 14a, the worker (i.e., the operator of the information processing terminal) operates the touch panel function of the information processing terminal to tap, drag, swipe, or the like on the frame image 14c and move the frame image 14c to a desired position. Then, the demarcation information specifying the position of the frame image 14c after the movement is stored and held in the information storage unit 12f of the camera unit 10 as the setting result of the gaze area.

[0056] That is, in the zone setting process, a frame image 14c indicating the range of the gaze area is displayed superimposed on the captured image on the display screen 14a which displays and outputs the captured image by the camera unit 10. Then, the display position (including the shape and size of the frame) of the frame image 14c can be changed by performing a direct operation on the display screen 14a, that is, a so-called GUI operation, and the display position of the frame image 14c after the change can be set as the gaze area within the imaging field angle of the image sensor 11a.

[0057] In this way, by performing the zone setting process using GUI operations, the operator can intuitively set the gaze area while checking the contents of the monitoring display on the display screen 14a. Therefore, the zone setting process becomes easy and simple, and it is very convenient for the operator who sets the gaze area. Specifically, for example, no matter how the bed 3 is arranged in the room 2, it is easily possible to appropriately set the gaze area to include the bed 3.

[0058] The above-described zone setting process is not essential in the installation procedure of the camera unit 10, and may not be performed. In other words, the installed camera unit 10 may be started to operate without setting a focus area (zone). In addition, when the zone setting process is performed, the zone setting process may be performed at any time after the camera unit 10 starts to operate, rather than at the same time as the installation of the camera unit 10.

[0059] In addition, when performing the zone setting process, the zone setting process may be performed using a binarized image by the binarization processing unit 12d. The binarized image by the binarization processing unit 12d and the zone setting process performed using the binarized image will be described in detail later.

[0060] (Example of operation processing) After the camera unit 10 is installed through the processing operations of the above procedure, the camera unit 10 can be operated (i.e., the monitoring support system 1 including the camera unit 10 can be operated). An example of the operational processing operation of the camera unit 10 while the monitoring support system 1 is in operation will be described below.

[0061] The operational processing operations of the camera unit 10 while the watching support system 1 is in operation include at least imaging processing, motion extraction processing, binarization processing, status determination processing, and information output processing by the camera unit 10. Each of these processes will be described in turn below.

[0062] (Image capture processing) During operation of the monitoring support system 1, the camera unit 10 constantly captures an image of the space (living space) in the room 2 in which it is installed. Specifically, as the camera unit 10 performs imaging processing, the sensor module 11 in the camera unit 10 converts light incident on each pixel of the image sensor 11a into an electrical signal, thereby obtaining image data (i.e., image data consisting of a plurality of frames) constituting a video of an image of the living space. The image sensor 11a can obtain image data even at night because the sensor module 11 has a light source 11c that corresponds to infrared light or the like. In other words, in the sensor module 11, the image sensor 11a can obtain image data regardless of day or night.

[0063] At this time, the image sensor 11a is configured to obtain low-resolution image data. The low-resolution image data has a resolution as low as, for example, 64 pixels x 64 pixels = 4096 pixels, which is much lower than general image data having several million pixels to several tens of millions of pixels. Therefore, the low-resolution image data corresponds to an image with a coarse resolution obtained by performing mosaic processing on an image with a general resolution. Although it is difficult to identify the face of a person in the living space with such an image with a coarse resolution, the resolution is sufficient for performing status identification, which will be described later. In other words, the low-resolution image data obtained by the image sensor 11a allows the generation of status information, which will be described later, while also taking into consideration the privacy of the person appearing in the image (specifically, the monitored object). In addition, the low-resolution image data makes it easier to accommodate the miniaturization, weight reduction, and power consumption of the image sensor 11a, compared to the case of obtaining image data with a general resolution.

[0064] (Motion extraction processing) Once image data is acquired by the image sensor 11a, the image data is sent to the control module 12 for processing as follows. FIG. 4 is an explanatory diagram showing an outline of the data flow.

[0065] Image data D1, D2, D3, ... of a plurality of frames constituting a moving image are sent from the image sensor 11a to the control module 12 in chronological order. Then, every time the control module 12 receives image data of each frame, the control module 12 sets the image data D1 of the current frame, which is the latest frame, as image data D1' indicating the current state. At this time, the control module 12 temporarily holds at least the image data D2 of the previous frame received before the current frame, and the image data D3 of the frame before that received before that. This is for use in processes (motion extraction process, status determination process, etc.) described later.

[0066] When the image data D1 of the current frame is received from the image sensor 11a, the state determination unit 12a in the control module 12 performs a motion extraction process to detect the motion of the monitored object. Specifically, the state determination unit 12a extracts the difference between the image data D1 of the current frame and the image data D2 of the previous frame. The monitored object is the main object that may move within the angle of view of each image data. Therefore, the extracted difference can be considered to correspond to the motion of the monitored object. From this, if the magnitude of the extracted difference is greater than a preset threshold, the state determination unit 12a recognizes that some kind of change in state has occurred in the room 2, for example, the monitored object has moved (changed in state), and extracts the difference as a moving part between each frame. Hereinafter, this "moving part" may also be referred to as a "moving point" or simply as "motion".

[0067] (Binarization processing) Then, the binarization processing unit 12d performs binarization processing on the moving parts extracted by the state determination unit 12a. Specifically, for example, the binarization is performed by setting the pixels of the moving parts to "1" and the pixels of the other non-moving parts to "0" so that the parts where the difference value between the frames extracted by the state determination unit 12a exceeds a threshold and is determined to be a moving point and the other parts (where the difference value is below the threshold and is determined to be not a moving point) can be separately identified. As a result, the binarized data D4, which is the result of the binarization, can clearly identify the parts where there was a movement (change in state) from the previous frame and the other parts (i.e., the parts where there was no change in state).

[0068] In other words, when the state determination unit 12a extracts a movement (change in state) based on the difference between the image data D1 and D2 between frames, the binarization processing unit 12d performs a binarization process that makes it possible to distinguish between pixel parts determined to have movement and other pixel parts, thereby visualizing the parts determined to have movement. If the binarization processing unit 12d performs such a binarization process, the binarized data D4 obtained thereby can be used to improve the accuracy of the state determination unit 12a in determining the movement of the object being watched, as described below.

[0069] The difference between the image data D1 and D2 extracted by the state determination unit 12a is considered to be mainly due to the movement (change in state) of the object being watched as described above, but may also be due to other factors. Examples of other factors include the influence of disturbance light such as the blinking of lights in the living room 2. Even if such other factors are included, if the binarization processing unit 12d performs binarization processing, it becomes possible to distinguish whether the part determined to be a movement is due to a change in the state of the object being watched or due to the influence of disturbance light, etc., by comparing the binarized data D4 with the image data D1 of the current frame (i.e., a live image) or recognizing the positional relationship with the gaze area, which will be described in detail later. Therefore, it is possible to suppress erroneous determinations due to the influence of disturbance light, etc., in the determination of the movement of the object being watched by the state determination unit 12a, and as a result, it is possible to improve the accuracy of the determination.

[0070] (Status determination process) In the control module 12, after the state determination unit 12a performs the motion extraction process, the state determination unit 12a subsequently performs a status determination process for determining the state of the object being watched over. By performing the status determination process, the state determination unit 12a generates status information of the object being watched over.

[0071] Specifically, when the state determination unit 12a determines that the object being watched over has moved (changed in state) based on the image data D1 of the current frame, the image data D2 of the previous frame, and the image data D3 of the frame before the previous frame, and the processing result of the movement extraction process, it recognizes the direction of the movement. Then, based on these recognition results, it determines which of multiple predetermined patterns the state of the object being watched over corresponds to.

[0072] At this time, if definition information (zone position information) for the gaze area has been set in the information storage unit 12f by the zone setting process, the status determination unit 12a may determine the status of the object being monitored while reflecting the positional relationship between the gaze area and the object being monitored.

[0073] FIG. 5 is an explanatory diagram showing an overview of the status determination process. In the illustrated example, five predetermined modes are assumed: "Going into bed" (see FIG. 5(a)), in which the monitored subject P enters the gaze area E in which the bed 3 is located (or within the angle of view of the image sensor 11a if the zone setting process has not been performed); "Leaving bed" (see FIG. 5(b)), in which the monitored subject P leaves the gaze area E in which the bed 3 is located (or within the angle of view of the image sensor 11a); "Waking up" (see FIG. 5(c)), in which the monitored subject P starts to move on the bed 3; "Going to sleep" (see FIG. 5(d)), in which the monitored subject P is asleep on the bed 3; and "Leaving the room" (see FIG. 5(e)), in which no one is on the bed 3.

[0074] When these multiple predetermined patterns are assumed, for example, if there is movement (change in state) of the monitored subject P and the direction of the movement is from outside to inside the gaze area E (or the angle of view of the image sensor 11a), the state determination unit 12a determines that the state of the monitored subject P corresponds to "in bed" at the time of obtaining image data D1 of the current frame, and generates status information to the effect that the subject is "in bed" (see Figure 5(a)). Furthermore, for example, if there is movement (change in state) of the monitored subject P and the direction of the movement is from inside to outside the gaze area E (or the angle of view of the image sensor 11a), the state determination unit 12a determines that the state of the monitored subject P corresponds to “leaving the bed” at the time of obtaining the image data D1 of the current frame, and generates status information to that effect (see FIG. 5(b)). Furthermore, for example, if there is movement (change in state) of the monitored subject P and the movement is limited to only within the gaze area E (or the angle of view of the image sensor 11a), the state determination unit 12a determines that the state of the monitored subject P corresponds to "wake-up" at the time of obtaining image data D1 of the current frame, and generates status information indicating that the state is "wake-up" (see Figure 5(c)). Furthermore, for example, after generating status information indicating "going to bed" or "waking up", if there is no movement (change in status) of the monitored subject P without going through the generation of status information indicating "getting out of bed", the status determination unit 12a determines that the status of the monitored subject P corresponds to "asleep" at the time of obtaining image data D1 of the current frame, and generates status information indicating "asleep" (see Figure 5(d)). Furthermore, for example, if there is no movement (change in status) of the monitored subject P after generating status information indicating "leaving bed" without going through the generation of status information indicating "in bed", the status determination unit 12a determines that the status of the monitored subject P corresponds to "leaving the room" at the time of obtaining image data D1 of the current frame, and generates status information indicating "leaving the room" (see Figure 5(e)).

[0075] As described above, the status determination unit 12a recognizes not only the presence or absence of movement of the watched-over target P, but also the direction of the movement, and performs a status determination of the watched-over target P based on these recognition results. Therefore, by taking into account the direction of movement of the watched-over target P, the status determination unit 12a can determine the status of the watched-over target P in a more detailed manner than ever before (specifically, whether the status corresponds to one of the five statuses of "going to bed", "getting out of bed", "getting up", "asleep", or "leaving the room").

[0076] Moreover, at that time, if the zone position information is set in the information storage unit 12f, the state determination unit 12a reflects the positional relationship with the gaze area E defined by the zone position information. Therefore, the state determination unit 12a can accurately perform the detailed determination described above. Furthermore, by taking into account the positional relationship with the gaze area E, it becomes possible to rank the necessity (urgency) of checking the state for each of the five states that are the determination results. Specifically, it becomes possible to rank the five states, for example, by giving "getting out of bed" an A rank that requires urgent checking, "getting up" and "leaving the room" a B rank that requires attention, and "going to bed" and "going to sleep" a C rank that does not require checking.

[0077] Here, the status information generated by the status determination unit 12a is used to identify which of the above-mentioned five aspects the status of the watched-over target P falls into, but the information is not limited to this and may be other information (for example, information for identifying four or less aspects or six or more aspects) as long as it is used to identify the status of the watched-over target P. The data format of the status information is also not particularly limited as long as it is set appropriately.

[0078] (Information output processing) When the status determination unit 12a generates the status information, the information output unit 12b outputs the status information in the control module 12. Specifically, the information output unit 12b outputs the status information by transmitting the status information generated by the status determination unit 12a to an external device (e.g., the gateway 20, the management server device 30, etc.) via the communication module 13 every time the status information is generated (i.e., at a timing corresponding to each frame of image data).

[0079] At this time, the information output unit 12b does not, in principle, output to the outside the image data obtained by the sensor module 11. In other words, instead of the image data obtained by the sensor module 11, the information output unit 12b outputs the status information generated by the state determination unit 12a based on the image data.

[0080] In this way, the information output unit 12b basically outputs status information to the outside instead of image data. Therefore, compared to the case where the image data obtained by the sensor module 11 is directly output to the outside, it is possible to reduce the amount of data output to the outside, and it is possible to reduce the load on the communication environment and data processing capacity required for information output.

[0081] However, the information output unit 12b may be configured to output image data obtained by the sensor module 11 as necessary. For example, when the information acquisition unit 12c acquires image request information sent from the outside (for example, the gateway 20, the management server device 30, etc.), the information output unit 12b outputs the image data obtained by the sensor module 11 in response to the image request information, instead of or together with the status information generated by the state determination unit 12a.

[0082] In addition, when outputting status information or image data, the transmission data format and communication protocol, etc., used by the information output unit 12b to transmit to the outside through the communication module 13 are not limited to a specific form as long as they are compatible with the management server device 30.

[0083] (Zone setting process using binary images) In the series of processes described above, the binarization processing unit 12d performs binarization processing. The binarized image obtained by this binarization processing may be used to perform the zone setting processing described above.

[0084] When a binary image is used, specifically, a binary image generated by the binary processing unit 12d is displayed on the display screen instead of the image captured by the image sensor 11a (i.e., the binary data D4 is visualized), and a frame image 14c indicating the range of the gaze area is displayed so as to be superimposed on the binary image.

[0085] FIG. 6 is an explanatory diagram showing an overview of the zone setting process performed using a binarized image, and shows an example of a display output on a display screen. As shown in the figure, the display screen displays the state of the interior of the living room 2 in which the camera unit 10 is installed, which is a binarized image captured by the image sensor 11a and binarized by the binarization processing unit 12d. Therefore, for example, if the monitoring display is performed in a state where there is no object to be watched in the living room 2 (a state where the object to be watched is not present within the image capturing angle of the image sensor 11a), it is understood that the parts 4', 5' determined to have movement (change in state) in the binarized image displayed on the monitoring screen are not caused by the movement of the object to be watched, but are visualized due to the influence of disturbance light from the room light 4, mirror 5, etc. Therefore, by changing the display position of the frame image 14c so as to avoid the parts 4', 5' determined to have movement due to the influence of disturbance light, etc. while checking the contents of the monitoring display, it becomes possible to appropriately set the gaze area.

[0086] In this way, when performing zone setting processing using GUI operations, by monitoring and displaying the binarized image by the binarization processing unit 12d, it becomes possible to set the range of the gaze area defined by the frame image 14c so as to avoid those parts that are determined to have movement and are not caused by the movement of the object being watched (for example, those caused by the influence of disturbance light, etc.). Therefore, it is possible to prevent parts affected by disturbance light, etc. from falling within the range of the gaze area, thereby optimizing the zone setting processing, and as a result, it is possible to further improve the accuracy of the determination of the movement of the object being watched.

[0087] <4. Example of processing operation in the monitoring support system> Next, an example of the processing operation in the watching support system 1 including the camera unit 10 will be described. Here, an example of a processing operation in which information transmitted from the camera unit 10 is output to a monitor on the management server device 30 will be mainly described.

[0088] (Status information processing) FIG. 7 is an explanatory diagram showing an overview of the status information output process performed by the management server device 30. As shown in FIG.

[0089] While the monitoring support system 1 is in operation, in principle, status information is output from the camera unit 10 to the management server device 30. When the status information is output from the camera unit 10, the management server device 30 receives the status information via the gateway 20. Then, the management server device 30 creates a visible image of the received status information.

[0090] The status information is visualized as an image, for example, as follows. A group of icon images including a plurality of types of status display icons 32 that uniquely correspond to each of the various types of status information generated by the camera unit 10 are prepared in advance and stored in a specified memory area in the management server device 30. Then, when the management server device 30 receives status information from the camera unit 10, it selects the status display icon 32 that uniquely corresponds to the received status information from the group of icon images in the specified memory area, and makes the selected status display icon 32 available for display output on the display screen 31.

[0091] The status display icon 32 is composed of an icon image with a simple design that symbolizes the content of the status information so that the content can be understood at a glance. Moreover, it is desirable that the status display icon 32 reflects the contents of the status information not only in the displayed pattern but also in the display color. Specifically, it is possible to vary the display color of the icon image according to the above-mentioned ranking. For example, it is possible to realize the following: an icon image of "Leaving bed" classified as A rank requiring urgent confirmation has a red base color, an icon image of "Getting up" classified as B rank requiring attention has a yellow base color, an icon image of "Leaving the room" also classified as B rank has an orange base color, an icon image of "Going to bed" classified as C rank not requiring confirmation has a green base color, and an icon image of "Going to sleep" also classified as C rank has a blue base color.

[0092] When such a status display icon 32 is displayed, some status display icon 32 is displayed on the display screen 31 while the status information is being output from the camera unit 10. In other words, some status information is output from the camera unit 10 for each frame of image data, so some status display icon 32 is displayed on the display screen 31 regardless of whether the object being watched over is moving (state transition). Therefore, by referring to the display contents on the display screen 31, the care staff handling the management server device 30 can accurately grasp the state of the object being watched over, regardless of whether the object being watched over is moving (state transition).

[0093] Moreover, if some status information is output for each frame of image data, any action (state transition) of the monitored subject can be reflected in the display of the status display icon 32 on the order of the frame rate. In other words, if there is any action (state transition) of the monitored subject, the display output of the status display icon 32 can be switched instantly (without delay, etc.). Therefore, the care staff operating the management server device 30 can quickly respond to the change in the state of the monitored subject (for example, take necessary measures, etc.).

[0094] In this way, on the management server device 30 side, the status display icon 32 is displayed based on the status information from the camera unit 10, so that the care staff handling the management server device 30 can accurately grasp the condition of the monitored subject. Even in this case, the status display icon 32 based on the status information is displayed and output instead of displaying the image capture result by the camera unit 10 as is, so that the privacy of the monitored subject is taken into consideration, and it is possible to eliminate the possibility that the monitored subject (person requiring care) and their family members will feel resistance.

[0095] As described above, while the monitoring support system 1 is in operation, in principle, status information is output from the camera unit 10, and the management server device 30 displays and outputs the status display icon 32 in real time in response to the status information (i.e., while quickly responding to any changes in status). In other words, in principle, the image captured by the camera unit 10 is not displayed on the display screen 31 of the management server device 30, and only the status display icon 32 is displayed and output.

[0096] At this time, the following information may be displayed on the display screen 31 in association with the status display icon 32. Specifically, for example, icon images for various user interfaces (UI) are displayed. This allows a user-friendly UI for the care staff who handles the management server device 30, and makes it possible to achieve very high convenience. In addition, for example, environmental information in the room 2 in which the camera unit 10 is installed (for example, temperature information and humidity information in the room 2) is displayed. This makes it possible to grasp the state of the monitored object more easily and accurately. Note that the acquisition of environmental information can be performed using known technology, and detailed explanations thereof will be omitted here.

[0097] In addition, when the status display icon 32 is displayed, an alarm may be output as necessary. For example, when an emergency check is required, such as displaying an icon image of "get out of bed," an alarm such as a sound or light output is output to notify the care staff operating the management server device 30 that an emergency check is required. This allows the care staff operating the management server device 30 to respond more quickly.

[0098] Incidentally, when the monitoring support system 1 is configured to include a plurality of camera units 10, the status information from each camera unit 10 is sent to the management server device 30 in parallel. In this case, the management server device 30 may display and output the respective status display icons 32 based on the status information from each camera unit 10 in a list format. At this time, it is preferable that the management server device 30 displays and outputs the list format in a manner that allows the installation location of each camera unit 10 to be recognized. The example of FIG. 7 shows a case where the status display icons 32 are displayed and output in a list format on the display screen 31 of the management server device 30 for each of the rooms A to F in which the camera units are installed. The installation location of each camera unit 10 may be determined, for example, based on the identification information of the camera unit 10 transmitted together with the status information.

[0099] In this way, when a plurality of monitored objects are present, it is possible to easily and accurately grasp the status of each monitored object by displaying the status in a list format on the display screen 31. Moreover, by displaying the status in a list format using the status display icons 32, the status can be grasped by a simple symbolized design, making it easy to grasp the status of the monitored object and providing excellent visibility, which is particularly useful when applied to displaying in a list format.

[0100] (Image data processing) During operation of the monitoring support system 1, image data obtained by the sensor module 11 may be output from the camera unit 10 as necessary. The processing operation when image data is output will be described below.

[0101] For example, consider a situation in which a status display icon 32 is displayed and output on the display screen 31, and the status display icon 32 is an icon image of "get out of bed" that requires emergency confirmation. In this case, the care staff who handles the management server device 30 performs a predetermined operation such as tapping or clicking on the status display icon 32 on the display screen 31 that requires emergency confirmation in order to grasp the condition of the monitored subject in more detail. Then, the management server device 30 transmits image request information requesting output of image data to the camera unit 10, which is the sender of the status information on which the status display icon 32 for which the predetermined operation was performed is based. The transmission data format, communication protocol, etc. when transmitting the image request information are not limited to a specific mode as long as they are compatible with the camera unit 10.

[0102] In response to this, when image request information is transmitted from the management server device 30 to the camera unit 10 which is the source of the status information, the information acquisition unit 12c of the control module 12 acquires the image request information via the communication module 13. Then, when the information acquisition unit 12c acquires the image request information, this information acquisition is used as a trigger to switch the output mode to the management server device 30 so that the information output unit 12b of the control module 12 outputs the image data acquired by the sensor module 11. At this time, the information output unit 12b may stop outputting the status information or may output it together with the image data. In other words, the information output unit 12b outputs the image data acquired by the sensor module 11 instead of or together with the status information.

[0103] In this way, when image data is sent from the camera unit 10, the management server device 30 receives the image data via the gateway 20. Then, the management server device 30 performs visualization of the received image data. Specifically, a visible image that can be displayed on the display screen 31 of the management server device 30 is generated based on each pixel data in the image data.

[0104] FIG. 8 is an explanatory diagram showing an overview of the live image output process performed by the management server device 30. As shown in FIG. In the management server device 30, the image data from the camera unit 10 is visualized, and a live image 33 of the interior of the room 2 in which the camera unit 10 is installed is displayed and output on the display screen 31, as shown in the figure. In other words, when image data is sent from the camera unit 10 in response to transmission of image request information, the management server device 30 switches the display output content on the display screen 31 from the status display icon 32 to the live image 33.

[0105] The live image 33 is a moving image that displays and outputs in real time the state of the interior of the living room 2 in which the camera unit 10 is installed. Therefore, when the live image 33 is displayed and output on the display screen 31, the care staff operating the management server device 30 can visually check the live image 33 and grasp the state of the monitored subject in the living room 2 in more detail and accurately than when checking the status display icon 32. As a result, the care staff can take action such as rushing to the monitored subject as necessary, for example.

[0106] If the image data from the camera unit 10 is low-resolution image data of 10,000 pixels or less (for example, 64 pixels x 64 pixels = 4096 pixels), the live image 33 displayed on the display screen 31 will have a resolution corresponding to this. Therefore, even when a live image 33 showing the state inside the living room 2 in real time is displayed, the live image 33 will have a low resolution, so that the privacy of the person appearing in the image (specifically, the person being watched) is also taken into consideration without requiring resolution conversion processing such as mosaic processing. In other words, even when a live image 33 is displayed, the privacy of the person being watched can be protected.

[0107] Furthermore, when a zone setting process is being performed on the camera unit 10 side when displaying and outputting the live image 33 on the display screen 31, a frame image 14c indicating the range of the gaze area set in the zone setting process may be displayed on the live image 33. Specifically, for example, based on the definition information (zone position information) of the gaze area, the frame image 14c indicating the outer edge of the gaze area is displayed superimposed on the live image 33. In this way, the range of the gaze area can be visually confirmed on the live image 33, which is suitable for grasping the state of the object to be watched.

[0108] When a list of a plurality of status display icons 32 is displayed on the display screen 31, the display output content can be switched from the status display icons 32 to the live image 33 as follows.

[0109] For example, when a predetermined operation such as tapping or clicking is performed on a certain status display icon 32 and image data is sent from the camera unit 10 in response to this, the display output content is switched so that a live image 33 is displayed and output on the display screen 31 in place of the status display icon 32 on which the predetermined operation was performed. In this case, the other status display icons 32 on which no predetermined operation was performed are displayed in a list on the display screen 31 together with the live image 33 after the display switching.

[0110] However, the manner in which the display output contents are switched is not limited to this, and for example, as shown in Fig. 8, only the live image 33 after the display switching may be displayed and output on the display screen 31. In other words, on the display screen 31, the other status display icons 32 for which no predetermined operation has been performed are not displayed and only the live image 33 after the display switching is enlarged and displayed. With such a manner in which the display output contents are switched, the live image 33 that is particularly desired to be watched is enlarged and displayed on the display screen 31, so that the state of the object of monitoring that requires urgent confirmation can be confirmed in detail, which is very suitable for grasping the state of the object of monitoring.

[0111] As described above, while the monitoring support system 1 is in operation, it is possible to easily and accurately grasp the state of the monitored object based on the status display icon 32, which is generally highly visible under normal circumstances, while switching the display to the live image 33 as necessary (for example, when a predetermined operation is performed on the management server device 30 side) to enable detailed confirmation of the state of the monitored object. This makes it possible to enjoy the advantage of exchanging status information instead of image data between the camera unit 10 and the management server device 30 under normal circumstances, while also eliminating the disadvantage of not exchanging image data under normal circumstances by switching the display output content to the live image 33 as necessary.

[0112] <5. Effects of this embodiment> According to this embodiment, one or more of the following advantages are achieved.

[0113] (a) In this embodiment, in principle, the camera unit 10 outputs status information on the state of the monitored object generated based on the image data instead of the image data obtained by the image sensor 11a. Therefore, the output destination of the status information (for example, the management server device 30) can accurately grasp the state of the monitored object based on the status information. Moreover, even in this case, while enabling the state of the monitored object to be accurately grasped, the status information is outputted while taking into consideration the privacy of the monitored object, and it is possible to eliminate the possibility that the monitored object or the like will feel resistance. Furthermore, by outputting the status information, it is possible to reduce the amount of data compared to the case where the image data is outputted as is, and it is possible to reduce the load on the communication environment, data processing capacity, etc. required for information output. This is very useful, especially when there are a large number of monitored objects.

[0114] As described above, according to this embodiment, the camera unit 10 outputs status information instead of image data, making it possible to accurately grasp the condition of the monitored subject, while still making it possible to construct a simple system that respects the privacy of the monitored subject.

[0115] (b) In this embodiment, when the camera unit 10 acquires image request information from the outside, it outputs image data obtained by the sensor module 11 instead of or together with the status information. Therefore, even if the camera unit 10 is configured to output status information as a rule, it is possible to exceptionally output image data when, for example, it becomes necessary to grasp the state of the monitored object in more detail. In other words, it is possible to realize a simple state grasp of the monitored object under normal circumstances, while grasping the state of the monitored object in detail using the live image 33 as necessary, which is very convenient for the system user. Moreover, even in this case, depending on the resolution of the image data, the privacy protection effect for the monitored object can be obtained.

[0116] (c) In this embodiment, the multiple predetermined states of the monitored subject that are determined when generating status information include at least five states of the monitored subject: "asleep," "wake up," "get out of bed," "leave the room," and "go to bed." By limiting the states to these five states, it is possible to cover almost all states that the monitored subject can be in, reduce the load of the process of determining which state the monitored subject falls into, and simplify understanding of the state the monitored subject is in.

[0117] (d) In this embodiment, each of the modules 11-13 constituting the camera unit 10 is housed in a single housing, and the housing is formed in a size suitable for mounting on a wall or ceiling surface of the room 2. This improves the degree of freedom in installing the camera unit 10 in the room 2, thereby making it possible to sufficiently ensure the versatility of the camera unit 10 and the monitoring support system 1.

[0118] (e) In this embodiment, the binarization processing unit 12d performs binarization on the image data obtained by the sensor module 11 to distinguish between a portion determined to be a moving point and the other portion based on the frame difference of the image data. That is, when extracting a movement (change in state) within the imaging angle of the camera unit 10 based on the difference in image data between each frame, a binarization process is performed to distinguish between a pixel portion determined to have moved and the other pixel portion, thereby visualizing the portion determined to have moved. Then, the state determination unit 12a uses the binarization result by the binarization processing unit 12d when determining the state of the monitored object. This improves the accuracy of the state determination of the monitored object by the state determination unit 12a. Specifically, based on the binarized image in which the movement is visualized, for example, the binarized image is compared with a live image, or the positional relationship with the gaze area set within the camera imaging angle of view is recognized, thereby making it possible to distinguish whether the portion determined to have moved is due to a change in state of the monitored object or due to the influence of disturbance light (flashing of lights), etc. Therefore, erroneous determinations due to the influence of ambient light, etc. can be suppressed, and as a result, the accuracy of determining the state of the object being monitored can be improved.

[0119] (f) In this embodiment, a frame image 14c showing the range of the gaze area is displayed on the display screen 14a by superimposing it on the image captured by the image sensor 11a, and the range of the gaze area is set by changing the display position of the frame image 14c by a GUI operation performed directly on the display screen 14a. That is, it is possible to perform a zone setting process using a GUI operation. Therefore, the gaze area can be intuitively set on the display screen 14a, and the zone setting process becomes easy and simple. In particular, by displaying a binary image on the display screen 14a as described in this embodiment, the accuracy of determining the state of the object to be watched can be improved reliably.

[0120] (g) In this embodiment, the region setting unit 12e, which sets a gaze region that is a target region for state determination by the state determination unit 12a, uses the binarization result by the binarization processing unit 12d when setting the gaze region. That is, a binarized image in which the parts determined to be moving are visualized is used to set the gaze region (zone setting process) within the camera capture angle of view. Specifically, the zone setting is performed so as to avoid parts that are distinguished as having disturbance light or the like in the binarized image. Therefore, it is possible to prevent parts affected by disturbance light or the like from falling within the gaze region, which is very preferable for improving the accuracy of determining the state of the object to be watched.

[0121] (h) In this embodiment, the monitoring support system 1 is configured to display and output an image related to the monitored subject on the management server device 30 based on the output contents from the camera unit 10. Therefore, by visually checking the image display output contents on the management server device 30, it is possible to grasp the behavior and state of the monitored subject, which is extremely convenient for care staff and others who are responsible for monitoring the monitored subject. Moreover, since status information is output from the camera unit 10 in principle, it is possible to build a simple system that allows the state of the monitored subject to be accurately grasped while still taking into consideration the privacy of the monitored subject.

[0122] (i) In this embodiment, the management server device 30 is configured to display and output only the status display icon 32 based on the status information from the camera unit 10 in real time according to the status information while the monitoring support system 1 is in operation, in principle. Therefore, the status display icon 32 with excellent visibility is displayed and output in real time, and by referring to the status display icon 32, the care staff handling the management server device 30 can accurately grasp the state of the monitored object and can quickly respond to changes in the state of the monitored object (for example, take measures as necessary). Moreover, even in this case, the display and output of the status display icon 32 takes into consideration the privacy of the monitored object, and it is possible to eliminate the possibility that the monitored object (person requiring care) and his / her family will feel resistance.

[0123] (j) In this embodiment, the management server device 30 is configured to display the status display icon 32 in a different color depending on the rank of the status information on which it is based. Therefore, if the meaning of each display color is understood in advance, the care staff who handles the management server device 30 can accurately and easily determine, for example, whether the condition of the monitored subject requires urgency based on the display color of the status display icon 32, which is extremely convenient.

[0124] <6. Modifications, etc.> Although the embodiment of the present invention has been specifically described above, the present invention is not limited to the above-mentioned embodiment, and various modifications can be made without departing from the gist of the present invention.

[0125] In the above embodiment, the status information and the corresponding status display icons are described by giving several specific examples, but the present invention is not limited to these specific examples. In other words, the types and specific contents of the status information and the status display icons are not particularly limited, and may be preset according to the system installation environment, etc.

[0126] In the above embodiment, the case where the monitoring support system 1 mainly includes a plurality of camera units 10 has been exemplified, but the present invention is not limited to this, and the number of camera units 10 installed may be one or more. The same applies to the management server device 30, and the monitoring support system 1 may be configured with a plurality of management server devices 30. Regardless of whether the management server device 30 is singular or multiple, as long as it has an image display output function, it may be configured with any of a computer device, a tablet device, a smartphone, etc., and in the case of a plurality of devices, these may be mixed. [Explanation of symbols]

[0127] 1... monitoring support system, 2... room, 3... bed, 4... room light, 5... mirror, 10... camera unit, 11... sensor module, 11a... image sensor, 11b... optical system, 11c... light source, 12... control module, 12a... status determination unit, 12b... information output unit, 12c... information acquisition unit, 12d... binarization processing unit, 12e... area setting unit, 12f... information storage unit, 13... communication module, 14a... display screen, 14c... frame image, 20... gateway, 30... management server device, 31... display screen, 32... status display icon, 33... live image, D1, D1', D2, D3... image data, D4... binarized data, E... gaze area, P... monitoring target

Claims

1. An imaging unit that captures an image of a space of a monitoring target to obtain image data; A state determination unit that determines which of a plurality of predetermined states the state of the monitoring target corresponds to based on the image data obtained by the imaging unit; an information output unit that outputs a result of the determination by the state determination unit as status information regarding the state of the object to be watched over, instead of image data obtained by the imaging unit; A monitoring support device comprising:

2. An information acquisition unit that acquires image request information from an external source, The information output section is configured to output image data obtained by the imaging section in place of or together with the status information in response to acquisition of the image request information by the information acquisition section. The monitoring support device according to claim 1 .

3. The predetermined multiple states determined by the state determination unit include at least five states of the object of monitoring: going to sleep, waking up, getting out of bed, leaving the room, and going into bed. The monitoring support device according to claim 1 or 2.

4. The imaging unit, the state determination unit, and the information output unit are housed in a single housing, and the housing is formed in a size suitable for mounting on a wall or ceiling surface of the living space. The monitoring support device according to claim 1 or 2.

5. a binarization processing unit that performs binarization on the image data obtained by the imaging unit to make it possible to distinguish between a portion determined to be a moving point and other portions based on an inter-frame difference of the image data, The state determination unit is configured to use a binarization result by the binarization processing unit when determining a state of the monitoring target. The monitoring support device according to claim 1 .

6. a region setting unit that sets a gaze region, which is a target region for state determination by the state determination unit, within an image capturing angle of view by the image capturing unit, and sets the gaze region based on a content of a GUI operation on a display screen that displays and outputs an image captured by the image capturing unit; The monitoring support device according to claim 1 .

7. The monitoring support device according to claim 1 , A monitor device that is communicably connected to the monitoring support device and displays and outputs an image related to the object being monitored based on the output content from the monitoring support device; A monitoring support system equipped with:

8. The monitor device is configured to display and output only an icon image based on the status information from the monitoring support device in real time in accordance with the status information. The monitoring support system according to claim 7.

9. The monitor device is configured to display the icon image in a different color depending on the rank of the status information on which the icon image is based. The monitoring support system according to claim 8.

Citation Information

Patent Citations

  • Leaving bed detecting device

    JP2016120190A

  • Monitored person monitoring system, monitored person monitoring device and monitored person monitoring method

    JP2017126372A

  • Sensor box, watching system, and program

    JP2020091521A