Image processing device, image processing system, image processing program, and image processing method

Abstract

To provide an image processing device, image processing system, image processing program, and image processing method, which make it easier to check the situation when articles are destroyed in a nursing care facility.SOLUTION: An image processing device is provided, comprising an acquisition unit for acquiring image information related to images captured by an image capturing unit installed in a nursing care facility, a destruction detection unit configured to detect destruction of an article(s) in the nursing care facility on the basis of the acquired image information, and an extraction unit for extracting image information corresponding to destitution of the article(s) from the acquired image information.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present invention relates to an image processing apparatus, an image processing system, an image processing program, and an image processing method.

Background Art

[0002] In Japan, due to the improvement of living standards, the improvement of sanitary environment, and the improvement of medical standards accompanying the high economic growth after the war, the aging of the population has become remarkable. Therefore, combined with the decline in the birth rate, it has become an aging society with a high aging rate. In such an aging society, an increase in the number of care recipients who require care, such as due to illness, injury, and aging, is assumed.

[0003] Care recipients are at risk of falling while walking or falling from a bed and getting injured in care facilities such as hospitals and elderly welfare facilities. Therefore, the development of a system that enables staff such as nurses and caregivers to rush to the care recipient immediately when such a situation occurs is underway (for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] When destruction of an article occurs in such a care facility, it is desirable that staff and family members of the care recipient can easily confirm the situation at the time of the destruction of the article. This is because the condition of the care recipient can be grasped in more detail from the situation at the time of the destruction of the article.

[0006] This invention has been made in view of these circumstances, and aims to provide an image processing device, an image processing system, an image processing program, and an image processing method that facilitate the confirmation of the circumstances when items are damaged in nursing care facilities. [Means for solving the problem]

[0007] The above-mentioned problems of the present invention are solved by the following means.

[0008] (1) An image processing apparatus comprising: an acquisition unit that acquires image information relating to an image captured by an imaging unit installed in a nursing care facility; a destruction detection unit that detects destruction of an item within the nursing care facility based on the acquired image information; and an extraction unit that extracts image information corresponding to the destruction of the item from the acquired image information.

[0009] (2) The extraction unit is the image processing apparatus according to (1) above, which extracts image information corresponding to the time of destruction of the article and the time before and after it.

[0010] (3) The image processing apparatus according to (1) above, further comprising a first reception unit for receiving designations of items within the nursing care facility, wherein the destruction detection unit detects the destruction of the designated item.

[0011] (4) The first receiving unit is the image processing apparatus described in (3) above, which receives the designation of the article in advance.

[0012] (5) The image processing apparatus according to (3) above, wherein the first receiving unit retrospectively receives the designation of the destroyed article, and the destruction detection unit detects the destruction of the designated article based on the image information for a predetermined period stored in the storage unit.

[0013] (6) The image processing apparatus according to (1) above, further comprising an information detection unit that detects at least one of article information and person information relating to an article and a person, respectively, included in the image based on the acquired image information, wherein the destruction detection unit detects the destruction of the article based on at least one of the detected article information and person information.

[0014] (7) The image processing apparatus according to (1) above, wherein the destruction detection unit detects destruction of the article based on information relating to the shape of the article.

[0015] (8) The image processing apparatus according to (1) above, further comprising a second reception unit for receiving designation of an area within the nursing care facility, wherein the destruction detection unit detects the destruction of the article in the designated area.

[0016] (9) The image processing apparatus according to (1) above, further comprising a third receiving unit for receiving a setting of a detection level for the destruction of the article, wherein the destruction detection unit detects the destruction of the article based on the set detection level.

[0017] (10) The image processing apparatus described in (9) above, wherein the third receiving unit is configured to accept the setting of different detection levels for each image acquisition time period.

[0018] (11) The image processing apparatus according to (1) above, further comprising a storage control unit that stores the extracted image information in a storage unit.

[0019] (12) An image processing system comprising the image processing device described in any of (1) to (11) above and the imaging unit.

[0020] (13) An image processing program for causing a computer to perform a process that includes acquiring image information relating to images captured by an imaging unit installed in a nursing care facility, detecting damage to items within the nursing care facility based on the acquired image information, and extracting image information corresponding to the damage to the items from the acquired image information.

[0021] (14) A method for causing an image processing system to execute, including obtaining image information regarding an image captured by an imaging unit installed in a nursing care facility, detecting destruction of an article within the nursing care facility based on the obtained image information, and extracting the image information corresponding to the destruction of the article from the obtained image information.

Advantages of the Invention

[0022] In the image processing apparatus, image processing system, image processing program, and image processing method according to the present invention, destruction of an article within a nursing care facility is detected, and image information corresponding to the destruction of this article is extracted. Therefore, it becomes easy for staff and the like to confirm the situation at the time of destruction of an article in the nursing care facility.

Brief Description of the Drawings

[0023] [Figure 1] It is a diagram showing a schematic configuration of an image processing system according to an embodiment. [Figure 2] It is a block diagram showing the configuration of the detection unit shown in FIG. 1. [Figure 3] It is a block diagram showing the configuration of the image processing apparatus shown in FIG. 1. [Figure 4] It is a diagram showing an example of an article rectangle and a person rectangle detected in an image captured by the camera shown in FIG. 1. [Figure 5] It is a functional block diagram of the image processing apparatus shown in FIG. 1. [Figure 6] It is a block diagram showing the configuration of the mobile terminal shown in FIG. 1. [Figure 7] It is a flowchart showing an example of processing by the image processing system shown in FIG. 1. [Figure 8] It is a functional block diagram of the image processing apparatus according to Modification 1. [Figure 9] It is a flowchart showing an example of processing by the image processing apparatus shown in FIG. 8. [Figure 10] It is a functional block diagram of the image processing apparatus according to Modification 2. [Figure 11] Figure 10 shows a flowchart illustrating an example of processing performed by the image processing device. [Figure 12] This flowchart shows an example of processing by the image processing device according to Modification 3. [Modes for carrying out the invention]

[0024] Hereinafter, an image processing system, an image processing program, and an image processing method according to embodiments of the present invention will be described with reference to the drawings. In the drawings, the same elements are denoted by the same reference numerals, and redundant explanations are omitted. The dimensional ratios in the drawings are exaggerated for illustrative purposes and may differ from actual ratios.

[0025] <Embodiment> [Configuration of Image Processing System 10] Figure 1 shows a schematic configuration of an image processing system 10 according to one embodiment. The image processing system 10 is used, for example, in hospitals and nursing care facilities such as elderly care facilities. The image processing system 10 includes a detection unit 100, an image processing device 200, a communication network 300, and a mobile terminal 400. The detection unit 100 is connected to the image processing device 200 and the mobile terminal 400 via the communication network 300 so that they can communicate with each other. The mobile terminal 400 can be connected to the communication network 300 via an access point 310.

[0026] (Detection unit 100) Figure 2 is a block diagram showing the configuration of the detection unit 100. As shown in the example in Figure 2, the detection unit 100 comprises a control unit 110, a communication unit 120, a camera 130, and a motion sensor 140, which are interconnected by a bus. Here, the camera 130 corresponds to a specific example of the imaging unit of the present invention. The detection unit 100 can be a single integrated device or multiple devices arranged separately.

[0027] The control unit 110 consists of a CPU (Central Processing Unit) and memory such as RAM (Random Access Memory) and ROM (Read Only Memory), and performs control and calculation processing of each part of the detection unit 100 according to the program.

[0028] The communication unit 120 is an interface circuit (for example, a LAN card) for communicating with the image processing device 200 and the mobile terminal 400, etc., via the communication network 300.

[0029] Camera 130 is, for example, a wide-angle camera. Camera 130 is installed within a nursing care facility. Camera 130 is installed in a position that provides an overhead view of a predetermined area, such as the ceiling of the room of a care recipient 500. Camera 130 captures an image (for example, image 600 in Figure 4 described later) that includes the predetermined area. Care recipient 500 is, for example, a person who requires care or nursing from staff, etc. The predetermined area may be, for example, a three-dimensional area including the entire floor surface of the room of care recipient 500. Camera 130 may also be a standard camera with a narrower field of view than a wide-angle camera. For the sake of simplicity, the following explanation will assume that camera 130 is a wide-angle camera. Image 600 may include, for example, the care recipient 500 as an image. Image 600 may include still images and videos. Camera 130 is a near-infrared camera that illuminates the imaging area with near-infrared light using an LED (Light Emitting Device), and captures a predetermined area by receiving the reflected near-infrared light reflected by objects within the imaging area with a CMOS (Complementary Metal Oxide Semiconductor) sensor. Image 600 may be a monochrome image where the reflectance of near-infrared light is the value of each pixel. Camera 130 may be replaced with a visible light camera, or both may be used in combination. Camera 130 may also be a camera equipped with a microphone.

[0030] The body movement sensor 140 is a Doppler shift type sensor that transmits and receives microwaves to and from the bed 700 and detects the Doppler shift of microwaves caused by the body movements (e.g., respiratory movements) of the person requiring care 500.

[0031] The detection unit 100 transmits image information related to the image captured by the camera 130 to the image processing device 200 via the communication network 300. The detection unit 100 may also transmit the Doppler shift of the care recipient 500 detected by the motion sensor 140 to a mobile terminal 400 or a server (not shown) via the communication network 300.

[0032] (Image processing device 200) Figure 3 is a block diagram showing the configuration of the image processing device 200. The image processing device 200 is, for example, a server or a computer such as a PC (Personal Computer). The image processing device 200 may consist of multiple devices, for example, it may be virtually configured as a cloud server by a large number of servers. The image processing device 200 has a control unit 210, a communication unit 220, a storage unit 230, a display unit 240, and an input unit 250. Each component is interconnected by a bus.

[0033] The basic configuration of the control unit 210 and the communication unit 220 is the same as that of the control unit 110 and the communication unit 120 of the detection unit 100, so redundant explanations will be omitted. The specific functions of the control unit 210 will be described later.

[0034] The storage unit 230 is composed of, for example, RAM, ROM, HDD (Hard Disk Drive), etc. The storage unit 230 stores various programs, including the operating system, and various data. The storage unit 230 stores, for example, image information transmitted from the detection unit 100. The storage unit 230 has applications installed for sending and receiving various information with other devices and for determining output results based on various information acquired from other devices. The storage unit 230 also stores information necessary for extracting image information corresponding to the destruction of items, as described later.

[0035] The display unit 240 and the input unit 250 are touch panels, and the display surface of the display unit 240, which is made of liquid crystal or the like, is equipped with a touch sensor as the input unit 250. The display unit 240 displays, for example, a moving image received from the detection unit 100.

[0036] Next, the functions of the image processing device 200, specifically the control unit 210, will be explained using Figures 4 and 5. The control unit 210 detects damage to items within the nursing care facility based on image information related to the video captured by the camera 130, and extracts image information corresponding to this damage to the items. Here, damage to an item refers to an irreversible change in the shape of the item.

[0037] Figure 4 shows an example of an image 600 of the room of a care recipient 500, captured by camera 130. This image 600 includes, for example, items such as a bed 700 and curtains 800 installed in the room, and the care recipient 500 sitting on the bed 700.

[0038] Figure 5 is a functional block diagram of the control unit 210. The control unit 210 functions, for example, as a first receiving unit 211, an acquisition unit 212, an information detection unit 213, a destruction detection unit 214, an extraction unit 215, and a storage control unit 216.

[0039] The first reception unit 211 receives designations for items within the nursing care facility. For example, staff members of the nursing care facility designate items such as curtains 800 via the input unit 250. The first reception unit 211 then receives the designations for items within the nursing care facility. Staff members may, for example, designate items that are easily damaged in advance. Staff members may also designate items that, if damaged, would pose a danger or cause significant damage.

[0040] The acquisition unit 212 acquires image information relating to an image (for example, image 600) captured by the camera 130. The acquisition unit 212 also acquires image information from, for example, the detection unit 100. The acquisition unit 212 may further acquire audio information relating to sound collected by a camera with a microphone or the like.

[0041] The information detection unit 213 detects item information relating to the items contained in each image based on the image information acquired by the acquisition unit 212. The item information includes, for example, information regarding the position of the curtain 800, the size of the curtain 800, the type of curtain 800, and the shape of the curtain 800. The position of the curtain 800 can be represented, for example, using the coordinates of the item rectangle 620 in the image 600.

[0042] The information detection unit 213 further detects person information related to the person contained in each image based on the image information acquired by the acquisition unit 212. The person information includes, for example, information about the position of the person requiring care 500, the size of the person requiring care 500, and the type of person requiring care 500. The position of the person requiring care 500 can be represented, for example, using the coordinates of the person rectangle 610 in the image 600. The person information may also include, for example, information about the posture of the person, such as standing and sitting. The information detection unit 213 detects, for example, at least one of person information and item information. It is preferable that the information detection unit 213 detects both person information and item information.

[0043] The person rectangle 610 is the region in image 600 that includes the person requiring care 500, and the item rectangle 620 is the region in image 600 that includes the curtain 800. The person rectangle 610 and the item rectangle 620 reflect, for example, the size of the person requiring care 500 and the curtain 800, respectively. The person rectangle 610 may reflect the posture of the person requiring care 500 in image 600. The item rectangle 620 may reflect the shape of the curtain 800 in image 600. The information detection unit 213 detects the person rectangle 610 and the item rectangle 620 using, for example, a neural network such as deep learning. Examples of known methods for detecting the person rectangle 610 using a neural network include Faster R-CNN, Fast R-CNN, and R-CNN. The information detection unit 213 may also detect the joint points of the person requiring care 500.

[0044] The destruction detection unit 214 detects the destruction of items within the nursing care facility based on the image information acquired by the acquisition unit 212. Specifically, the destruction detection unit 214 uses the item information and person information detected by the information detection unit 213 to detect the destruction of an item (for example, a curtain 800) specified by the first reception unit 211.

[0045] The destruction detection unit 214 detects the destruction of the curtain 800 when, for example, the item rectangle 620 moves. The movement of the item rectangle 620 can be detected, for example, using the coordinates of the item rectangle 620 in each frame. The destruction detection unit 214 may also detect the destruction of the curtain 800 when the item rectangle 620 moves at a speed greater than a predetermined speed. Alternatively, the destruction detection unit 214 may detect the destruction of the curtain 800 when the arm of the person requiring care 500 and the item rectangle 620 move simultaneously and at a speed greater than a predetermined speed. The position of the arm of the person requiring care 500 can be estimated, for example, using the joint points of the person requiring care 500 detected by the information detection unit 213.

[0046] The destruction detection unit 214 may detect the destruction of the curtain 800 when the time during which the person rectangle 610 and the item rectangle 620 overlap exceeds a predetermined time. Alternatively, the destruction detection unit 214 may detect the destruction of the curtain 800 when the time during which the hand of the person requiring care 500 and the item rectangle 620 overlap exceeds a predetermined time. The position of the hand of the person requiring care 500 can be estimated, for example, using the joint points of the person requiring care 500 detected by the information detection unit 213. The destruction detection unit 214 may also detect the destruction of an item based on image information and audio information.

[0047] The extraction unit 215 extracts image information corresponding to the destruction of the article detected by the destruction detection unit 214 from the image information acquired by the acquisition unit 212. For example, the extraction unit 215 extracts image information corresponding to the time of the article's destruction and the time immediately before and after it. For example, the extraction unit 215 extracts image information corresponding to the time the article's destruction occurred, and image information for one minute before and after this time.

[0048] The storage control unit 216 stores the image information extracted by the extraction unit 215 in the storage unit. The storage control unit 216 stores the image information in association with, for example, a person associated with the destruction of the item. For example, when a care recipient 500 destroys the curtain 800, the storage control unit 216 stores the image information corresponding to the destruction of the curtain 800 in association with the care recipient 500. The storage unit is provided in, for example, the memory unit 230. The storage unit may also be provided on an external server or the like. For example, when a staff member or the like inputs an instruction to the input unit 250, the image information stored in the storage unit is output to the display unit 240, and the video is displayed on the display unit 240.

[0049] Some or all of the functions of the control unit 210 may be performed by the detection unit 100.

[0050] (Mobile phone service 400) Figure 6 is a block diagram showing the configuration of the mobile terminal 400. The mobile terminal 400 is carried by staff, for example, within a nursing care facility. The mobile terminal 400 comprises a control unit 410, a wireless communication unit 420, a display unit 430, an input unit 440, and an audio input / output unit 450. Each component is interconnected by a bus. The mobile terminal 400 may be composed of, for example, a tablet computer, a smartphone, or a mobile phone.

[0051] The control unit 410 has a basic configuration similar to that of the control unit 110 of the detection unit 100, including a CPU, RAM, ROM, and other components.

[0052] The wireless communication unit 420 has the function of performing wireless communication according to standards such as Wi-Fi and Bluetooth (registered trademark), and communicates wirelessly with each device via the access point 310 or directly. The wireless communication unit 420 receives event notifications from the image processing device 200.

[0053] The display unit 430 and input unit 440 are configured, for example, as touch panels, similar to the display unit 240 and input unit 250 of the image processing device 200. The display unit 430 and input unit 440 display event notifications regarding the care recipient 500 to staff members, for example. The display unit 430 and input unit 440 also display an input screen prompting staff members to respond to the event notification regarding the care recipient 500, and accept the staff member's intention to respond to the event notification entered on the input screen.

[0054] The audio input / output unit 450 is, for example, a speaker and a microphone, and enables voice communication between staff members with other mobile terminals 400 via the wireless communication unit 420. The audio input / output unit 450 may also have a function to enable voice communication with the detection unit 100 via the wireless communication unit 420.

[0055] [Processing by Image Processing System 10] Next, a specific example of the processing performed by the image processing system 10, that is, the image processing method of the present invention, will be described using Figure 7. Figure 7 is a flowchart showing the processing performed by the control unit 210. If some or all of the functions shown in Figure 7 are performed by the detection unit 100, this flowchart may be executed by the control unit 110 of the detection unit 100 according to the program.

[0056] The control unit 210 first receives a designation of an item within the nursing care facility (S101). The item is designated by a staff member, for example, via the input unit 250. Information regarding the items within the nursing care facility is stored, for example, in the memory unit 230. The control unit 210 receives a designation, for example, of a curtain 800 installed in the room of a care recipient 500.

[0057] Next, the control unit 210 acquires image information related to the image captured by the camera 130 (for example, image 600) (S102). The control unit 210 also acquires image information related to the video captured by the camera 130 in real time.

[0058] Next, the control unit 210 detects item information and person information for each image based on the image information acquired in step S102 (S103). For example, the control unit 210 detects a person rectangle 610 and an item rectangle 620 from image 600.

[0059] Next, the control unit 210 detects the destruction of the item (for example, the curtain 800) specified in step S101 based on the item information detected in step S103 (S104). The control unit 210 may also detect the destruction of the item based on the item information and person information detected in step S103.

[0060] Next, the control unit 210 extracts image information from the image information acquired in step S101 that corresponds to the time of the destruction of the item detected in step S104 and the time immediately before and after (S105).

[0061] After this, the control unit 210 saves the image information extracted in step S105 to the storage unit (S106) and terminates the process.

[0062] [Effects of Image Processing System 10] In the image processing system 10 according to this embodiment, damage to items within the nursing care facility is detected, and image information corresponding to the damage to the items is extracted. Therefore, staff members can easily confirm the circumstances of the damage to items in the nursing care facility. The effects of this system will be explained below.

[0063] In nursing care facilities, damage to belongings can occur due to falls by residents. For example, using technology that detects falls from images captured by cameras allows staff to visually confirm the circumstances of a fall. If images show damage to belongings during a fall, staff can confirm that the damage was caused by the resident's fall.

[0064] On the other hand, if damage to an item occurs even though a fall by the care recipient has not been detected, it becomes difficult for staff to verify the circumstances of the damage. For example, various situations are possible, such as the care recipient actually falling and damaging the item, but the system failing to detect the fall; the care recipient intentionally damaging the item; or the item being damaged due to other causes.

[0065] In response to this, the image processing device 200 and image processing system 10 detect damage to items within the nursing care facility and extract image information corresponding to the damage. This allows staff to easily review images of the damaged items. Therefore, staff can review the circumstances surrounding the damage and gain a more detailed understanding of the care recipient's condition. Furthermore, the extracted images are stored in the storage unit and can be used as evidence in various situations, such as when explaining the situation to the care recipient's family.

[0066] Furthermore, the image processing device 200 detects the destruction of pre-specified items, thus reducing the occurrence of false detections. For example, this image processing device 200 does not detect changes in the shape of a stuffed animal when a care recipient grasps it, nor does it detect changes in the shape of clothing when a care recipient rolls up clothing; it only detects the destruction of pre-specified items. Moreover, by pre-specifying items, it becomes possible to detect the occurrence of item destruction in real time. As a result, this image processing device 200 does not need to read the vast amount of image information recorded over long periods of time.

[0067] The following describes modified versions of the control unit 210 described in the first embodiment and other embodiments. In order to avoid repetition of the explanation, detailed explanations of configurations similar to those of the control unit 210 described in the first embodiment will be omitted below.

[0068] <Example 1> Figure 8 is a functional block diagram showing a control unit 210 according to Modification 1. This control unit 210 functions as a second receiving unit 217, an acquisition unit 212, an information detection unit 213, a destruction detection unit 214, an extraction unit 215, and a storage control unit 216. This control unit 210 differs from the control unit 210 described in the first embodiment above in that it has the function of a second receiving unit 217 instead of a first receiving unit 211. The control unit 210 may have the functions of both the first receiving unit 211 and the second receiving unit 217.

[0069] The second reception unit 217 accepts designations for areas within the nursing care facility. For example, staff members of the nursing care facility can designate selective areas within the facility via the input unit 250. The second reception unit 217 then accepts these designations for areas within the nursing care facility. For example, staff members may pre-designate areas where damage to items is likely to occur.

[0070] The destruction detection unit 214 detects the destruction of an item in an area designated by the second reception unit 217. The destruction detection unit 214 detects the destruction of an item when, for example, a person rectangle (for example, a person rectangle 610) overlaps with the designated area. The destruction detection unit 214 determines that a person rectangle and a designated area overlap when, for example, a predetermined percentage or more of the person rectangle overlaps with the designated area. The predetermined percentage is, for example, 50%. The destruction detection unit 214 may also detect the destruction of an item when the time during which the person rectangle and the designated area overlap exceeds a predetermined time.

[0071] Figure 9 is a flowchart showing the processes performed by the control unit 210. First, the control unit 210 receives a designation of an area within the nursing care facility (S201). The area is designated, for example, by staff via the input unit 250. Information regarding the area within the nursing care facility is stored, for example, in the memory unit 230.

[0072] After this, the control unit 210 performs the same processing as steps S102 to S106 described in the first embodiment (S202 to S206), and then terminates the processing.

[0073] The image processing system 10 having the control unit 210 according to Modification 1 also detects the destruction of items within the nursing care facility and extracts image information corresponding to the destruction of the items, similar to the image processing system 10 of the first embodiment described above. Therefore, it becomes easier to confirm the circumstances of the destruction of items in the nursing care facility. In addition, since the destruction of items is detected in a pre-designated area, for example, an area where the destruction of items is likely to occur, the occurrence of false detections is suppressed.

[0074] <Modification 2> Figure 10 is a functional block diagram showing a control unit 210 according to modified example 2. This control unit 210 functions as a first receiving unit 211, an acquisition unit 212, an information detection unit 213, a destruction detection unit 214, an extraction unit 215, a storage control unit 216, and a second receiving unit 217, in addition to a third receiving unit 218. This control unit 210 differs from the control unit 210 described in the first embodiment above in that it has the functions of a second receiving unit 217 and a third receiving unit 218.

[0075] The third reception unit 218 accepts the setting of the detection level for the destruction of items. The third reception unit 218 is configured to accept the setting of different detection levels for each imaging time period of the camera 130, for example. The third reception unit 218 is configured to accept the setting of three detection levels, for example, low level, medium level, and high level. For example, staff at a nursing care facility set the detection level via the input unit 250. As a result, the third reception unit 218 accepts the setting of the detection level. For example, the staff may set the detection level to high level when imaging is done from 6am to 8am and from 8pm to 10pm, the detection level to medium level when imaging is done from 10pm to 6am, and the detection level to low level when imaging is done from 8am to 8pm. The third reception unit 218 may be configured to accept the setting of different detection levels for each area within the nursing care facility. The third reception unit 218 may be configured to accept the setting of two detection levels, or four or more detection levels.

[0076] The destruction detection unit 214 detects the destruction of an item based on the detection level set by the third receiving unit 218. For example, at the high level, the destruction detection unit 214 detects the destruction of an item when the person rectangle (e.g., person rectangle 610) and the area specified by the second receiving unit 217 overlap. The destruction detection unit 214 may also determine the overlap between the person rectangle and the specified area by setting a lower threshold than the medium and low levels. Alternatively, the destruction detection unit 214 detects the destruction of an item when the item rectangle (e.g., item rectangle 620) of the item specified by the first receiving unit 211 moves.

[0077] For example, at the medium level, the destruction detection unit 214 detects the destruction of an item when the time during which the person rectangle and the area designated by the second reception unit 217 overlap exceeds a predetermined time. Alternatively, the destruction detection unit 214 detects the destruction of an item when the arm of the person requiring care (for example, person requiring care 500) and the item rectangle move simultaneously and at a speed exceeding a predetermined speed.

[0078] For example, at a low level, the destruction detection unit 214 does not detect the occurrence of item destruction even if the time during which the person rectangle and the area specified by the second reception unit 217 overlap exceeds a predetermined time. The destruction detection unit 214 detects the destruction of an item based on the information about the item specified by the first reception unit 211.

[0079] Figure 11 is a flowchart showing the processes performed by the control unit 210. First, the control unit 210 accepts the setting of the detection level for the occurrence of item damage (S301). The detection level is specified, for example, by a staff member via the input unit 250. Information regarding each detection level is stored, for example, in the storage unit 230.

[0080] Next, the control unit 210 accepts the designation of an area within the nursing care facility (S302). After this, the control unit 210 performs the same processing as steps S101 to S106 described in the first embodiment above (S303 to S308), and then terminates the process.

[0081] The image processing system 10 having the control unit 210 according to Modification 2 also detects the destruction of items within the nursing care facility and extracts image information corresponding to the destruction of the items, similar to the image processing system 10 of the first embodiment described above. Therefore, it becomes easier to confirm the circumstances of the destruction of items in the nursing care facility. In addition, since the detection level for the destruction of items is set in advance, the occurrence of false detections and missed detections is suppressed.

[0082] <Variation 3> Figure 12 is a flowchart showing the processing performed by the control unit 210 according to Modification 3. After the acquired image information is stored, the first receiving unit 211 subsequently accepts the designation of the item. In this respect, the control unit 210 according to Modification 3 differs from the control unit 210 described in the first embodiment above.

[0083] First, the control unit 210 acquires image information in the same manner as in step S102 described in the first embodiment (S401). Next, the control unit 210 stores the image information acquired in step S401 in, for example, the storage unit 230 (S402).

[0084] Next, the control unit 210 receives a designation of an item within the nursing care facility (S403). Staff members, for example, designate an item that has already been destroyed. After this, the control unit 210 detects the item information and person information in the same manner as in step S103 described in the first embodiment above (S404).

[0085] Next, the control unit 210 detects the destruction of the article specified in step S403 (S405) in the same manner as in step S104 described in the first embodiment. At this time, the control unit 210 detects the destruction of the article based on information about the shape of the specified article, for example. Specifically, it detects the destruction of the article using pattern matching. For example, the control unit 210 detects images in the past in which the pattern matching rate is less than or equal to a predetermined value, and in which images in which the destroyed article was captured. This makes it possible to detect the destruction of the article. The control unit 210 may also detect the occurrence of article destruction in the same manner as described in the first embodiment.

[0086] After this, the control unit 210 performs the same processing as described in S105 and S106 in the first embodiment (S406, S407) and then terminates the processing.

[0087] The image processing system 10 having the control unit 210 according to Modification 3 also detects the destruction of items within the nursing care facility and extracts image information corresponding to the destruction of the items, similar to the image processing system 10 of the first embodiment described above. Therefore, it becomes easy to confirm the circumstances of the destruction of items in the nursing care facility. In addition, since items can be specified retrospectively, staff can retrospectively confirm the circumstances of the destruction of items that have already been destroyed.

[0088] The configuration of the image processing system 10 described above is intended to illustrate the main features of the above-described embodiment, and is not limited to the above configuration; various modifications can be made within the scope of the claims. Furthermore, it does not preclude configurations that are common to general image processing systems.

[0089] For example, in the first embodiment described above, an example was described in which the control unit 210 functions as a first receiving unit 211, an acquisition unit 212, an information detection unit 213, a destruction detection unit 214, an extraction unit 215, and a storage control unit 216. However, the control unit 210 does not necessarily have the function of the first receiving unit 211. This control unit 210, for example, detects the occurrence of destruction of all items imaged by the camera 130.

[0090] Furthermore, the detection unit 100, the image processing device 200, and the mobile terminal 400 may each be composed of multiple devices, or any of the multiple devices may be configured as a single device.

[0091] Furthermore, the flowchart described above may omit some steps, and other steps may be added. Also, some steps may be executed simultaneously, and one step may be divided into multiple steps. The order of the steps is just an example and may be changed as appropriate.

[0092] Furthermore, the means and methods for performing the various processing operations in the image processing system 10 described above can be implemented by either a dedicated hardware circuit or a programmed computer. The program may be provided, for example, on a computer-readable recording medium such as a USB memory stick or a DVD (Digital Versatile Disc)-ROM, or it may be provided online via a network such as the Internet. In this case, the program recorded on the computer-readable recording medium is usually transferred to and stored in a storage unit such as a hard disk. The program may also be provided as a standalone application software, or it may be incorporated as a function into the software of a device such as a detection unit. [Explanation of Symbols]

[0093] 10 Image processing systems, 100 detection unit, 110 Control unit, 120 Communications Department, 130 cameras, 140 motion sensors, 200 image processing devices, 210 Control unit, 211 First Reception Desk, 212 Acquisition Department; 213 Information detection unit, 214 Destruction detection unit, 215 Extraction part, 216 Storage control unit, 217 Second Reception Desk, 218 Third Reception Desk, 220 Communications Department, 230 storage section, 240 display section, 250 Input section, 300 communication networks, 310 access points, 400 mobile devices, 500 target individuals, 600 images, 610 person rectangle, 620 Item rectangle.

Claims

1. An acquisition unit that acquires image information related to images captured by an imaging unit installed in a nursing care facility, A destruction detection unit that detects the destruction of items within the nursing care facility based on the acquired image information, An extraction unit extracts image information corresponding to the destruction of the article from the acquired image information. Equipped with, The facility further has a first reception desk that accepts designations for items within the aforementioned nursing care facility, The destruction detection unit is an image processing device that detects the destruction of the specified article.

2. An acquisition unit that acquires image information relating to an image captured by an imaging unit installed in a nursing care facility, A destruction detection unit that detects the destruction of items within the nursing care facility based on the acquired image information, An extraction unit extracts image information corresponding to the destruction of the article from the acquired image information. Equipped with, An image processing apparatus further comprising a storage control unit that stores the extracted image information in a storage unit.

3. The image processing apparatus according to claim 1 or 2, wherein the extraction unit extracts image information corresponding to the time of destruction of the article and the time immediately before and after.

4. The image processing apparatus according to claim 1, wherein the first receiving unit receives the designation of the article in advance.

5. The first reception unit retrospectively accepts the designation of the destroyed article, The image processing apparatus according to claim 1, wherein the destruction detection unit detects the destruction of a specified article based on the image information for a predetermined period stored in the storage unit.

6. The system further includes an information detection unit that detects at least one of item information and person information relating to each of the items and people included in the image, based on the acquired image information. The image processing apparatus according to claim 1 or 2, wherein the destruction detection unit detects the destruction of the article based on at least one of the detected article information and the person information.

7. The image processing apparatus according to claim 1 or 2, wherein the destruction detection unit detects destruction of the article based on information regarding the shape of the article.

8. The facility further has a second reception area that accepts designations for areas within the aforementioned nursing care facility, The image processing apparatus according to claim 1 or 2, wherein the destruction detection unit detects the destruction of the article in the designated area.

9. The system further includes a third receiving unit that accepts the setting of the detection level for the destruction of the aforementioned article, The image processing apparatus according to claim 1 or 2, wherein the destruction detection unit detects destruction of the article based on the set detection level.

10. The image processing apparatus according to claim 9, wherein the third receiving unit is configured to accept the setting of different detection levels for each image acquisition time period.

11. An image processing apparatus according to claim 1 or 2, An image processing system comprising the aforementioned imaging unit.

12. To acquire image information related to images captured by an imaging unit installed in a nursing care facility, Based on the acquired image information, the destruction of items within the nursing care facility is detected, From the acquired image information, extract the image information corresponding to the destruction of the article, Accepting requests for items within the aforementioned nursing care facility. The computer is made to perform a process that includes this, An image processing program for detecting the destruction of specified items within a nursing care facility.

13. To acquire image information relating to an image captured by an imaging unit installed in a nursing care facility, Based on the acquired image information, the destruction of items within the nursing care facility is detected, From the acquired image information, extract the image information corresponding to the destruction of the article, The extracted image information is stored in the storage unit. An image processing program that causes a computer to perform a process that includes [specific processing].

14. A method for having an image processing system perform the task, To acquire image information related to images captured by an imaging unit installed in a nursing care facility, Based on the acquired image information, the destruction of items within the nursing care facility is detected, From the acquired image information, extract the image information corresponding to the destruction of the article, Accepting requests for items within the aforementioned nursing care facility. Includes, An image processing method for detecting the destruction of a specified item within a nursing care facility.

15. A method for causing an image processing system to perform an action, To acquire image information related to images captured by an imaging unit installed in a nursing care facility, Based on the acquired image information, the destruction of items within the nursing care facility is detected, From the acquired image information, extract the image information corresponding to the destruction of the article, The extracted image information is stored in the storage unit. Image processing methods including [specific details omitted].

Images