Monitoring system and monitoring program

Abstract

To provide a monitoring system and a monitoring program, capable of reducing an installation cost.SOLUTION: A monitoring system 1 is a system for monitoring a monitoring target within a monitoring environment. The monitoring system includes: an acquisition part 22a configured to acquire picked-up image information showing a picked-up image imaging the monitoring target with at least one marker attached thereto; a state specification part 22b configured to specify a state of the monitoring target according to a position of the at least one marker in the picked-up image of the picked-up image information acquired by the acquisition part 22a; and a provision part 22c configured to provide state information showing the state of the monitoring target specified by the state specification part 22b.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a monitoring system and a monitoring program.

Background Art

[0002] Conventionally, as one of the systems for identifying the state of a care recipient, a system has been proposed that discriminates the state (posture) of a care recipient based on the body pressure distribution of the care recipient detected by an elastomer sensor disposed in a bedding (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Here, in the above-described conventional system, although an elastomer sensor is used when identifying the state of a care recipient as described above, since the sensor is relatively expensive, when there are a large number of care recipients to be monitored, there is a risk that the installation cost of the system will become excessive. Therefore, from the viewpoint of suppressing the installation cost of the system, there is room for improvement.

[0005] The present invention has been made in view of the above, and an object thereof is to provide a monitoring system and a monitoring program capable of reducing the installation cost.

Means for Solving the Problems

[0006] In order to solve the above-described problems and achieve the object, the monitoring system according to claim 1 is a monitoring system for monitoring a monitoring target in a monitoring environment, comprising: an acquisition means for acquiring imaging image information indicating an imaging image obtained by imaging the monitoring target to which at least one or more markers are attached; a state specifying means for specifying the state of the monitoring target based on the positions of the at least one or more markers in the imaging image of the imaging image information acquired by the acquisition means; and a providing means for providing state information indicating the state of the monitoring target specified by the state specifying means.

[0007] The monitoring system according to claim 2 is the monitoring system according to claim 1, wherein the state specifying means specifies a region in the region of the imaging image acquired by the acquisition means where the at least one or more markers are located, and specifies the state of the monitoring target based on the specified region.

[0008] The monitoring system according to claim 3 is the monitoring system according to claim 1, wherein the imaging image is an image obtained by imaging the monitoring target to which a pair of markers are attached, and the state specifying means calculates a distance between the pair of markers in the imaging image acquired by the acquisition means, and specifies the state of the monitoring target based on the calculated distance.

[0009] The monitoring system according to claim 4 is the monitoring system according to claim 3, wherein the state specifying means specifies the state of the monitoring target based on the length of the calculated distance, the length of the component in the first direction in the distance, and the length of the component in the second direction orthogonal to the first direction in the distance.

[0010] The monitoring system according to claim 5 is the monitoring system according to any one of claims 1 to 4, wherein the monitoring target includes a patient and / or a care recipient, and the at least one or more markers include a pair of markers attached to both shoulders of the monitoring target.

[0011] The monitoring system according to claim 6 is the monitoring system according to any one of claims 1 to 4, further comprising an abnormality degree specifying means for specifying an abnormality degree indicating the degree of possibility that an abnormality occurs in the state of the monitoring target based on the state of the monitoring target specified by the state specifying means, and the providing means provides abnormality degree information indicating the abnormality degree specified by the abnormality degree specifying means together with the state information.

[0012] The monitoring system according to claim 7 is the monitoring system according to any one of claims 1 to 4, further comprising a trend specifying means for specifying a trend of the state of the monitoring target based on a plurality of pieces of the state information having different time series, and the providing means provides trend information indicating the trend of the state of the monitoring target specified by the trend specifying means.

[0013] The monitoring program according to claim 8 is a monitoring program for causing a monitoring system for monitoring a monitoring target in a monitoring environment to execute, and causes a computer to function as an acquisition means for acquiring acquisition image information indicating an acquisition image obtained by imaging the monitoring target to which at least one or more markers are attached, a state specifying means for specifying the state of the monitoring target based on the positions of the at least one or more markers in the acquisition image of the acquisition image information acquired by the acquisition means, and a providing means for providing state information indicating the state of the monitoring target specified by the state specifying means.

Advantages of the Invention

[0014] According to the monitoring system described in claim 1 or the monitoring program described in claim 8, based on the positions of at least one or more markers in the captured image of the captured image information acquired by the acquisition means, there are provided a state specifying means for specifying the state of the monitoring target and a providing means for providing state information. Therefore, compared with the prior art (a technique for determining the state of a person requiring care based on the body pressure distribution of the person requiring care detected by a sensor made of an elastomer), the cost of the means for specifying the state of the monitoring target can be reduced, and the installation cost of the monitoring system can be reduced. Also, based on the positions of at least one or more markers attached to the monitoring target, the state of the monitoring target can be specified, and the accuracy of the specification can be improved.

[0015] According to the monitoring system described in claim 2, the state specifying means specifies the region in the region of the captured image acquired by the acquisition means where at least one or more markers are located, and based on the specified region, specifies the state of the monitoring target. Therefore, the state of the monitoring target can be specified simply and accurately, and the specification can be performed efficiently.

[0016] According to the monitoring system described in claim 3, the state specifying means calculates the distance between a pair of markers in the captured image acquired by the acquisition means, and based on the calculated distance, specifies the state of the monitoring target. Therefore, the state of the monitoring target can be specified simply and accurately, and the specification can be performed efficiently.

[0017] According to the monitoring system described in claim 4, the state specifying means specifies the state of the monitoring target based on the length of the calculated distance, the length of the component in the first direction in the distance, and the length of the component in the second direction orthogonal to the first direction in the distance. Therefore, the state of the monitoring target can be specified in detail, and the details of the state of the monitoring target can be grasped.

[0018] According to the monitoring system described in claim 5, the subject to be monitored includes a patient and / or a care recipient, and at least one or more markers include a pair of markers attached to both shoulders of the subject to be monitored. Therefore, compared with the case where only one marker is attached to the subject to be monitored, the state of the subject to be monitored can be accurately identified, and the specific accuracy can be improved.

[0019] According to the monitoring system described in claim 6, it includes an abnormality degree specifying means for specifying the degree of abnormality based on the state of the subject to be monitored specified by the state specifying means, and the providing means provides the abnormality degree information together with the state information. Therefore, the degree of possibility that an abnormality related to the state of the subject to be monitored occurs can be easily grasped, and appropriate measures can be taken before the abnormality occurs.

[0020] According to the monitoring system described in claim 7, it includes a tendency specifying means for specifying the tendency of the state of the subject to be monitored based on a plurality of pieces of state information with different time series, and the providing means provides the tendency information. Therefore, the tendency of the state of the subject to be monitored can be grasped, and measures can be taken according to the tendency.

Brief Description of the Drawings

[0021]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Embodiments for Carrying Out the Invention

[0022] Hereinafter, with reference to the accompanying drawings, embodiments of the monitoring system and the monitoring program according to the present invention will be described in detail. First, [I] the basic concept of the embodiment will be described, then [II] the specific content of the embodiment will be described, and finally, [III] modifications to the embodiment will be described. However, the present invention is not limited by the embodiments.

[0023] [I] Basic Concept of the Embodiment First, the basic concept of the embodiment will be described. The embodiment generally relates to a monitoring system and a monitoring program for monitoring a monitoring target in a monitoring environment.

[0024] Here, the "monitoring environment" means an environment where the monitoring target is present temporarily or permanently. This monitoring environment includes, for example, a hospital ward in a medical facility, a living room in a nursing facility, a specific room (as an example, a living room) in a general house or an apartment house, a store area in a commercial facility, a work area in a factory facility, etc. In the embodiment, it will be described as a hospital ward in a medical facility where the above patient is admitted and a living room in a nursing facility.

[0025] Also, the "monitoring target" means the object to be monitored. This monitoring target includes, for example, a patient admitted to a medical facility, a care recipient living in a nursing facility, a child or an elderly person in a general house or an apartment house, a customer in a commercial facility, or / and a worker in a factory facility, etc. In the embodiment, it will be described as a patient admitted to a medical facility and a care recipient living in a nursing facility.

[0026] [II] Specific Content of the Embodiment Next, the specific content of the embodiment will be described.

[0027] [Embodiment 1] First, the monitoring system according to Embodiment 1 will be described. This Embodiment 1 is a form of specifying the state of the monitoring target based on the area where the marker described later is located in the captured image described later.

[0028] (Configuration) First, the configuration of the monitoring system according to Embodiment 1 will be described.

[0029] The monitoring system 1 is a system for monitoring a monitoring target (specifically, a patient hospitalized in a medical facility, a care recipient living in a care facility) in a monitoring environment (specifically, a hospital ward in a medical facility, a living room in a care facility). As shown in FIG. 1, it includes a terminal device 10 and a processing device 20.

[0030] Here, in FIG. 1, only one terminal device 10 is shown. Actually, the terminal device 10 is configured to include a plurality of terminal devices 10 held by two or more monitors described later, and a processing device 20 that can communicate with these plurality of terminal devices 10 via a network 2. However, it is not limited to this. For example, there may be only one terminal device 10.

[0031] (Configuration - Terminal Device) First, the configuration of the terminal device 10 will be described.

[0032] The terminal device 10 is a device held by a monitor (not shown) and is a device for communicating various types of information with the processing device 20. This terminal device 10 is communicably connected to the processing device 20 via the network 2, and as shown in FIG. 1, includes a terminal-side communication unit 11, a terminal-side operation unit 12, a terminal-side output unit 13, a terminal-side power supply unit 14, a terminal-side control unit 15, and a terminal-side storage unit 16. However, regarding the configuration of the terminal device 10 that is not particularly noted, the description will be omitted as being the same as that of a known mobile terminal such as a smartphone.

[0033] Note that the "monitor" is a person who monitors the object to be monitored. This monitor is a concept that includes, for example, doctors and nurses in medical facilities, caregivers in nursing facilities, relatives of children and the elderly in general or apartment houses, store clerks in commercial facilities, managers of factory facilities, etc. However, in Embodiment 1, it will be described as doctors and nurses in medical facilities and caregivers in nursing facilities.

[0034] (Configuration - Terminal Device - Terminal-Side Communication Unit) The terminal-side communication unit 11 is terminal-side communication means for performing communication at least with the processing device 20, and is configured using, for example, known communication means for performing wireless communication using a wireless communication network (as an example, communication means using a long-distance wireless communication standard such as 4G, 5G, Wi-Fi, or LTE (registered trademark), etc.). However, it is not limited to this, and for example, it may be configured using communication means for performing wired communication using a wired communication network.

[0035] (Configuration - Terminal Device - Terminal-Side Operation Unit) The terminal-side operation unit 12 is terminal-side operation means for receiving operation inputs to the terminal device 10, and is configured using known operation means such as various switches and touch pads.

[0036] (Configuration - Terminal Device - Terminal-Side Output Unit) The terminal-side output unit 13 is output means for outputting various types of information based on the control of the terminal-side control unit 15, and is configured using, for example, known display means (as an example, a display) or / and audio output means (as an example, a speaker).

[0037] (Configuration - Terminal Device - Terminal - side Power Supply Unit) The terminal - side power supply unit 14 is terminal - side power supply means for supplying power to each part of the terminal device 10.

[0038] (Configuration - Terminal Device - Terminal - side Control Unit) The terminal - side control unit 15 is terminal - side control means for controlling the terminal device 10. Specifically, this terminal - side control unit 15 is a computer configured to include a CPU, various programs (including basic control programs such as an OS and application programs that are interpreted and executed on the CPU and that are launched on the OS to realize specific functions), and an internal memory such as a RAM for storing programs and various data (note that the same applies to the configuration of the processing - side control unit 22 described later).

[0039] Note that the details of the processing executed by this terminal - side control unit 15 will be described later.

[0040] (Configuration - Terminal Device - Terminal - side Storage Unit) The terminal - side storage unit 16 is terminal - side storage means for storing programs and various data necessary for the operation of the terminal device 10. Specifically, this terminal - side storage unit 16 is configured using a rewritable recording medium, and for example, a non - volatile recording medium such as a flash memory can be used (note that the same applies to the configuration of the processing - side storage unit 23 described later).

[0041] (Configuration - Processing Device) Next, the configuration of the processing device 20 will be described.

[0042] The processing device 20 is a device for executing processing related to monitoring a monitoring target in a monitoring environment. This processing device 20 is communicably connected to the terminal device 10 via the network 2, and as shown in FIG. 1, includes a processing - side communication unit 21, a processing - side control unit 22, and a processing - side storage unit 23. However, for the configuration of the processing device 20 that is not specifically noted, the description will be omitted assuming it is the same as a known cloud server.

[0043] (Configuration - Processing Device - Processing - side Communication Unit) The processing - side communication unit 21 is processing - side communication means for communicating with the terminal device 10. For example, it is configured using known communication means for performing wireless communication using a wireless communication network (as an example, communication means using a long - distance wireless communication standard such as 4G, 5G, wireless LAN, or LTE (registered trademark), etc.). However, it is not limited to this. For example, it may be configured using communication means for performing wired communication using a wired communication network.

[0044] (Configuration - Processing Device - Processing - side Control Unit) The processing - side control unit 22 is processing - side control means for controlling each part of the processing device 20. As shown in FIG. 1, conceptually in terms of function, it includes an acquisition unit 22a, a state determination unit 22b, and a provision unit 22c.

[0045] Note that the monitoring program according to Embodiment 1 (specifically, the monitoring program for executing the monitoring process described later) is installed in the processing device 20 via an arbitrary recording medium or the network 2, thereby substantially constituting each part of the processing - side control unit 22.

[0046] (Configuration - Processing Device - Processing - side Control Unit - Acquisition Unit) The acquisition unit 22a is acquisition means for acquiring captured image information.

[0047] Here, the "captured image information" is information indicating a captured image of a monitoring target to which at least one or more markers are attached.

[0048] This captured image information is, for example, a concept including captured image information directly or indirectly obtained from known imaging means (for example, a still - image camera, a moving - image camera, etc.) provided at a predetermined position (as an example, the ceiling part, the wall part, the floor part, etc.) in the monitoring environment. In Embodiment 1, it will be described as captured image information obtained from known imaging means provided on the ceiling of a hospital room or a living room of a nursing facility.

[0049] Here, the "marker" is used to identify the state of the object to be monitored.

[0050] Specifically, this marker is composed of markers that can be identified from the above imaging image. For example, known pattern seals, known light-emitting markers that emit light such as LEDs, non-light-emitting markers, or combinations thereof, etc. are applicable.

[0051] Also, the "at least one or more markers" is described as a pair of markers attached to both shoulders of the object to be monitored in Embodiment 1 (the same applies to other embodiments).

[0052] Thereby, compared with the case where only one marker is attached to the object to be monitored, the state of the object to be monitored can be accurately identified, and the accuracy of the identification can be improved.

[0053] However, it is not limited to this. For example, a pair of markers attached to parts other than both shoulders of the object to be monitored (for example, arms, legs, head, etc.) may be used. Alternatively, three or more markers or only one marker attached to a specific part of the object to be monitored may be used.

[0054] (Configuration - Processing Device - Processing Side Control Unit - State Identification Unit) The state identification unit 22b is a state identification means for identifying the state of the object to be monitored based on the positions of at least one or more markers in the imaging image of the imaging image information acquired by the acquisition unit 22a.

[0055] Here, the "state of the object to be monitored" in Embodiment 1 includes the state where the object to be monitored is sleeping in bed (specifically, the posture state at bedtime and the sleep state at bedtime), the state where the object to be monitored is getting up from the bed (specifically, the posture state at getting up and the movement state at getting up), etc.

[0056] (Configuration - Processing Device - Processing Side Control Unit - Provision Unit) The providing unit 22c is a providing means that provides information indicating the state of the monitoring target specified by the state specifying unit 22b (hereinafter referred to as "state information").

[0057] Details of the processing executed by this processing side control unit 22 will be described later.

[0058] (Configuration - Processing Device - Processing Side Storage Unit) The processing side storage unit 23 is a processing side storage means that records programs and various data necessary for the operation of the processing device 20. As shown in FIG. 1, it includes a first state database (hereinafter, the database is referred to as "DB") 23a.

[0059] (Configuration - Processing Device - Processing Side Storage Unit - First State DB) The first state DB 23a is a state information storage means that stores state information.

[0060] As shown in FIG. 2, this first state DB 23a is configured by associating the item "area information" and the item "state information" with the information corresponding to each item.

[0061] Among these, the information corresponding to the item "area information" is area information indicating an area (hereinafter referred to as "marker area") where at least one or more markers are located among the areas of the captured image acquired by the acquisition unit 22a. As shown in FIG. 2, "the first marker area and the second marker area", etc., which are marker areas, correspond to this.

[0062] Here, in the first embodiment, as shown in FIG. 3, the "marker area" will be described as including the first marker area MA1, the second marker area MA2, the third marker area MA3, the fourth marker area MA4, and the fifth marker area MA5 (in FIG. 3, various marker areas are shown by hatching). However, it is not limited to this. For example, it may further include areas other than the first marker area MA1 to the fifth marker area MA5. Alternatively, any one of the first marker area MA1 to the fifth marker area MA5 may be omitted.

[0063] Among these, as shown in FIG. 3, the first marker region MA1 is a region located on the head side of the bed B (the head side of the monitoring target T) in the captured image and on the left side (the position opposite to the wall side).

[0064] Also, as shown in FIG. 3, the second marker region MA2 is a region located on the head side of the bed B in the captured image and on the right side (the wall side).

[0065] Also, as shown in FIG. 3, the third marker region MA3 is a region located between the head side and the foot side of the bed B in the captured image.

[0066] Also, as shown in FIG. 3, the fourth marker region MA4 is a region located at the left end of the bed B and its vicinity in the captured image.

[0067] Also, as shown in FIG. 3, the fifth marker region MA5 is a region located at the right end of the bed B and its vicinity in the captured image.

[0068] Also, the information corresponding to the item "status information" is status information, and as shown in FIG. 2, the "supine position" or the like, which is the status of the monitoring target, is applicable.

[0069] Note that the method for generating this status information is arbitrary, but for example, it may be generated as follows (note that the method for generating the status information of the second status DB23b described later, the method for generating the abnormality degree information of the abnormality degree DB23c described later, and the method for generating the trend information of the trend DB23d described later are also substantially the same).

[0070] That is, after the processing side control unit 22 of the processing device 20 acquires past captured image information indicating a past captured image and past state information corresponding to the past captured image information by a predetermined method, it determines the causal relationship between the past captured image information and the past state information (for example, the causal relationship between the marker area and the state of the monitoring target) by a known statistical processing method or a known machine learning method. Then, the past state information having a deep causal relationship among the above past state information may be extracted, and the extracted information may be generated as state information.

[0071] Alternatively, the processing side control unit 22 of the processing device 20 may generate information arbitrarily set by the administrator of the processing device 20 as state information.

[0072] (Monitoring Process) Next, the monitoring process executed by the terminal side control unit 15 of the terminal device 10 configured as described above and the processing side control unit 22 of the processing device 20 will be described.

[0073] In the following description, in the description of each process shown in FIG. 4, the steps are abbreviated as "S".

[0074] (Monitoring Process - Introduction) The monitoring process is a process for monitoring a monitoring target in the monitoring environment.

[0075] The timing for executing this monitoring process is arbitrary, but in Embodiment 1, it will be described as being started after the power of the terminal device 10 and the processing device 20 is turned on.

[0076] In Embodiment 1, although the monitoring system 1 includes a plurality of terminal devices 10, the contents of the monitoring process executed by these terminal devices 10 are all the same. Therefore, hereinafter, the monitoring process executed by the target terminal device 10 (hereinafter referred to as the "target terminal device") and the processing device 20 to be described will be described.

[0077] (Monitoring Process - Details of the Process) When the monitoring process is started, as shown in FIG. 4, in SA1, the processing side control unit 22 of the processing device 20 determines whether the timing for providing the state information (hereinafter referred to as "providing timing") has arrived.

[0078] The method for determining whether this providing timing has arrived is arbitrary. However, in the first embodiment, after the monitoring process is started (or after it is determined in SA5 described later that the end timing described later has not arrived), whether a predetermined time (for example, 1 hour, etc.) has elapsed, or information indicating a request to provide state information (hereinafter referred to as "providing request information") has been received from the target terminal device via a dedicated application (or a dedicated website).

[0079] Here, when the above-mentioned predetermined time has elapsed or the above-mentioned providing request information has been received, it is determined that the providing timing has arrived. When the above-mentioned predetermined time has not elapsed and the above-mentioned providing request information has not been received, it is determined that the providing timing has not arrived.

[0080] Then, the processing side control unit 22 of the processing device 20 waits until it is determined that the providing timing has arrived (SA1, No). When it is determined that the providing timing has arrived (SA1, Yes), it proceeds to SA2.

[0081] In SA2, the acquisition unit 22a of the processing device 20 acquires imaging image information.

[0082] Specifically, the acquisition unit 22a of the processing device 20 is an imaging means provided at a predetermined position in the monitoring environment, and directly or indirectly acquires imaging image information from the imaging means that has been previously associated with the target terminal device (specifically, the imaging means that images the monitoring target monitored by the monitor of the target terminal device) (when a plurality of imaging means are provided, imaging image information may be acquired from each imaging means).

[0083] In SA3, the state specifying unit 22b of the processing device 20 specifies the state of the monitoring target.

[0084] The method for specifying the state of the monitoring target is arbitrary, but in the first embodiment, it is specified as follows.

[0085] That is, first, the state specifying unit 22b of the processing device 20 uses a known image analysis method to specify the marker area based on the captured image information acquired in SA2.

[0086] Specifically, the state specifying unit 22b of the processing device 20 specifies, as the marker area to be specified, the area that overlaps with a pair of markers in the captured image among the first marker area MA1 to the fifth marker area MA5 in FIG. 3.

[0087] For example, when a pair of markers in the captured image information acquired in SA2 overlaps with the first marker area MA1, the marker area = the first marker area MA1 may be specified.

[0088] Note that in FIG. 3, a part of the first marker area MA1 and the fourth marker area MA4 overlap. Therefore, for example, when a pair of markers in the captured image information acquired in SA2 overlaps with the first marker area MA1 and the fourth marker area MA4, only the first marker area MA1 may be specified. Alternatively, both the first marker area MA1 and the fourth marker area MA4 may be specified.

[0089] Similarly, when a pair of markers in the captured image information obtained at SA2 overlap with the second marker region MA2 and the fifth marker region MA5, only the second marker region MA2 may be specified (alternatively, the second marker region MA2 and the fifth marker region MA5 may be specified). Also, when a pair of markers in the captured image information obtained at SA2 overlap with the third marker region MA3 and the fourth marker region MA4 (or the fifth marker region MA5), only the third marker region MA3 may be specified (alternatively, the third marker region MA3 and the fourth marker region MA4 (or the fifth marker region MA5) may be specified).

[0090] Then, the state specifying unit 22b of the processing device 20 refers to the information stored in the first state DB23a and specifies the state of the monitoring target based on the specified marker region.

[0091] Specifically, the state specifying unit 22b of the processing device 20 extracts the region information corresponding to the specified marker region from the region information stored in the first state DB23a. Then, the state information corresponding to the extracted region information is extracted from the state information stored in the first state DB23a, and the state of the monitoring target corresponding to the extracted state information is specified as the state to be specified.

[0092] As an example, when the specified marker region = the first marker region MA1, referring to the first state DB23a in FIG. 2, the state of the monitoring target = the left lateral decubitus position (the decubitus position opposite to the wall side) may be specified.

[0093] Also, when the specified marker region = the first marker region MA1 and the second marker region MA2, the state of the monitoring target = the dorsal decubitus position may be specified.

[0094] Also, when the specified marker region = the first marker region MA1 and the fourth marker region MA4, the state of the monitoring target = the left lateral decubitus position (the decubitus position opposite to the wall side), the left end sitting position (the sitting position at the end opposite to the wall side of the bed) may be specified.

[0095] By using such a method for identifying the state of the object to be monitored, the state of the object to be monitored can be simply and accurately identified, and it becomes possible to efficiently perform such identification.

[0096] Returning to FIG. 4, in SA4, the providing unit 22c of the processing device 20 provides state information indicating the state of the object to be monitored identified in SA3.

[0097] Although the method of providing this state information is arbitrary, in Embodiment 1, the above state information is transmitted to the target terminal device, and the transmitted state information is output to the terminal-side output unit 13 (specifically, a display means, an audio output means) of the target terminal device, thereby providing it.

[0098] Thereby, the state information can be presented to the monitor of the target terminal device, and it becomes possible for the monitor to grasp the details of the state of the object to be monitored.

[0099] However, it is not limited to this. For example, the providing unit 22c of the processing device 20 may transmit the above state information to another device other than the target terminal device (for example, another terminal device 10, an external device (as an example, a management device that manages the processing device 20, etc.)), and output the transmitted state information to the output means of the other device, thereby providing it.

[0100] Alternatively, the providing unit 22c of the processing device 20 may provide it only by transmitting the above state information to the target terminal device. In this case, the terminal-side control unit 15 of the target terminal device may output the above state information to the terminal-side output unit 13 at the timing when a predetermined operation is received via the terminal-side operation unit 12.

[0101] In SA5, the processing-side control unit 22 of the processing device 20 determines whether or not the timing to end the monitoring process (hereinafter referred to as the "end timing") has arrived.

[0102] The method for determining whether or not this end timing has arrived is arbitrary. In the first embodiment, it is determined based on whether or not information indicating a request to end the monitoring process (hereinafter referred to as "end request information") has been received from the target terminal device via a dedicated application (or a dedicated website), or whether or not a predetermined monitoring period (for example, one week or the like) has elapsed since the start of the monitoring process.

[0103] Here, when the above end request information is received, or when the above predetermined monitoring period has elapsed, it is determined that the end timing has arrived. When the above end request information has not been received and the above predetermined monitoring period has not elapsed, it is determined that the end timing has not arrived.

[0104] Then, when it is determined that the above end timing has arrived (SA5, Yes), the processing side control unit 22 of the processing device 20 ends the monitoring process. On the other hand, when it is determined that the above end timing has not arrived (SA5, No), the processing side control unit 22 of the processing device 20 proceeds to SA1 and repeats the processing from SA1 to SA5 in the same manner thereafter.

[0105] By such a monitoring process, compared with the prior art (a technique for discriminating the state of a care recipient based on the body pressure distribution of the care recipient detected by a sensor made of an elastomer), the cost of means for specifying the state of the monitoring target can be reduced, and the installation cost of the monitoring system 1 can be reduced. In addition, the state of the monitoring target can be specified based on the positions of at least one or more markers attached to the monitoring target, and the accuracy of the specification can be improved.

[0106] (Effect of the First Embodiment) According to the first embodiment as described above, based on the positions of at least one or more markers in the captured image of the captured image information acquired by the acquisition unit 22a, there are provided a state identification unit 22b that identifies the state of the monitoring target, and a providing unit 22c that provides state information. Therefore, compared with the prior art (a technique for determining the state of a person requiring care based on the body pressure distribution of the person requiring care detected by a sensor made of elastomer), the cost of the means for identifying the state of the monitoring target can be reduced, and the installation cost of the monitoring system 1 can be reduced. Further, based on the positions of at least one or more markers attached to the monitoring target, the state of the monitoring target can be identified, and the accuracy of the identification can be improved.

[0107] Further, the state identification unit 22b identifies the area in the area of the captured image acquired by the acquisition unit 22a where at least one or more markers are located, and based on the identified area, identifies the state of the monitoring target. Therefore, the state of the monitoring target can be identified simply and accurately, and the identification can be performed efficiently.

[0108] Further, the monitoring target includes a patient and / or a person requiring care, and at least one or more markers include a pair of markers attached to both shoulders of the monitoring target. Therefore, compared with the case where only one marker is attached to the monitoring target, the state of the monitoring target can be accurately identified, and the accuracy of the identification can be improved.

[0109] 〔Second Embodiment〕 Next, a monitoring system according to the second embodiment will be described. In the second embodiment, the state of the monitoring target is identified based on the distance between a pair of markers in the captured image. However, the configuration of the second embodiment is substantially the same as the configuration of the first embodiment except in the case where otherwise noted, and for the configuration substantially the same as the configuration of the first embodiment, the same reference numerals and / or names as those used in the first embodiment are attached as necessary, and the description thereof is omitted.

[0110] (Configuration) First, the configuration of the monitoring system according to the second embodiment will be described.

[0111] As shown in FIG. 5, the monitoring system 100 includes a terminal device 10 and a processing device 20.

[0112] (Configuration - Terminal Device) First, the configuration of the terminal device 10 will be described.

[0113] The terminal device 10 according to Embodiment 2 is configured substantially the same as the terminal device 10 according to Embodiment 1.

[0114] (Configuration - Processing Device) Next, the configuration of the processing device 20 will be described.

[0115] The processing device 20 according to Embodiment 2 is configured substantially the same as the processing device 20 according to Embodiment 1. However, regarding the details of the configuration of the processing - side storage unit 23, the following improvements are made.

[0116] (Configuration - Processing Device - Processing - Side Storage Unit) As shown in FIG. 5, the processing - side storage unit 23 includes a second - state DB 23b.

[0117] (Configuration - Processing Device - Processing - Side Storage Unit - Second - State DB) The second - state DB 23b is state - information storage means for storing state information.

[0118] As shown in FIG. 6, this second - state DB 23b is configured by associating the items "first - condition information", "second - condition information", and "state information" with the information corresponding to each item. Further, the item "second - condition information" further includes the items "first - direction condition information" and "second - direction condition information" as items related to the second - condition information.

[0119] Among these, the information corresponding to the item "first - condition information" is first - condition information indicating conditions (hereinafter referred to as "first conditions") for specifying a state in which the monitoring target is in bed and either going to bed or getting up. As shown in FIG. 6, "d≦k1×D" and the like, which are first conditions, are applicable.

[0120] Here, in Embodiment 2, as described below, the "first condition" includes a bedtime condition for specifying the state in which the monitoring target is in bed and a wake-up condition for specifying the state in which the monitoring target is awake, and will be described as such. d ≦ k1 × D ··· (bedtime condition) d > k1 × D ··· (wake-up condition) (Here, d: the distance between a pair of markers (hereinafter referred to as the "distance between markers". See Fig. 7.) k1: coefficient D: the distance between markers when the state of the monitoring target is in the supine position)

[0121] In Embodiment 2, the information indicating k1, the information indicating k2 described later, and the information indicating D will be described as being stored in the processing-side storage unit 23 in advance.

[0122] Also, the information corresponding to the item "second condition information" is second condition information indicating a condition (hereinafter referred to as the "second condition") for specifying the details of the state in which the monitoring target is going to bed or waking up in bed.

[0123] Furthermore, the information corresponding to the item "first direction condition information" is first direction condition information indicating a condition related to the first direction (hereinafter referred to as the "first direction condition") among the second conditions. As shown in Fig. 6, the "d x ≦ k2 × D" etc. of the first direction condition correspond.

[0124] Here, in Embodiment 2, as described below, the "first direction condition" includes a first lying position condition for specifying the state of the lying position (specifically, the supine position, the left lateral lying position, or the right lateral lying position), a first getting-up condition for specifying the getting-up state, and a first sitting position condition for specifying the state of the sitting position (specifically, the left end sitting position or the right end sitting position) for specifying the sitting position, and will be described as such. d x ≦ k2 × D ··· (first lying position condition, first getting-up condition) d x > k2 × D ··· (first sitting position condition) (Here, dx : The length of the component in the first direction (hereinafter referred to as the "first direction length") at the marker distance (see Fig. 7). k2: Coefficient D: Marker distance when the state of the monitoring target is the supine position

[0125] Also, the information corresponding to the item "second direction condition information" is the second direction condition information indicating the condition regarding the second direction (hereinafter referred to as the "second direction condition") among the second conditions. As shown in Fig. 6, the "d y > k2 × D" etc. are applicable.

[0126] Here, the "second direction condition" in Embodiment 2 will be described as including a second supine position condition for specifying the supine position state, a second lateral position condition for specifying the lateral position state, a second getting-up condition for specifying the getting-up state, and a second sitting position condition for specifying the sitting position state for specifying the state of the sitting position, as shown below. d y > k2 × D ··· (Second supine position condition, second getting-up condition) d y ≦ k2 × D ··· (Second lateral position condition, second sitting position condition) (Here, d y : The length of the component in the second direction (hereinafter referred to as the "second direction length") at the marker distance (see Fig. 7). k2: Coefficient D: Marker distance when the state of the monitoring target is the supine position

[0127] Also, the information corresponding to the item "state information" is the state information, and as shown in Fig. 6, the "supine position" etc. which are the states of the monitoring target are applicable.

[0128] (Monitoring process) Next, the monitoring process executed by the terminal-side control unit 15 of the terminal device 10 configured as described above and the process-side control unit 22 of the processing device 20 will be described.

[0129] Regarding the monitoring process according to Embodiment 2, since the processes of SB1, SB2, SB4, and SB5 in FIG. 8 are the same as the processes of SA1, SA2, SA4, and SA5 in FIG. 4, the description of the processes of SB1, SB2, SB4, and SB5 in FIG. 8 is omitted.

[0130] As shown in FIG. 8, in SB3, the state specifying unit 22b of the processing device 20 specifies the state of the monitoring target.

[0131] The method for specifying the state of the monitoring target is arbitrary, but in Embodiment 2, it is specified as follows.

[0132] That is, first, the state specifying unit 22b of the processing device 20 calculates the distance between markers based on the captured image information acquired in SB2 using a known image analysis method.

[0133] Specifically, the state specifying unit 22b of the processing device 20 specifies the positions of each of a pair of markers in the captured image of the captured image information, and calculates the distance between the markers by calculating the difference between the specified positions.

[0134] Next, the state specifying unit 22b of the processing device 20 calculates the first direction length and the second direction length based on the calculated distance between the markers using a known calculation method.

[0135] Specifically, the state specifying unit 22b of the processing device 20 calculates the first direction length by specifying the length of the component in the first direction in the calculated distance between the markers. Also, the second direction length is calculated by specifying the length of the component in the second direction in the calculated distance between the markers.

[0136] Note that the "first direction" means a specific direction of the captured image, and in Embodiment 2, the horizontal direction of the captured image or the like corresponds.

[0137] Also, the "second direction" means a specific direction of the captured image that is orthogonal to the first direction, and in Embodiment 2, the vertical direction of the captured image or the like corresponds.

[0138] Then, the state specifying unit 22b of the processing device 20 refers to the information stored in the second state DB 23b, and specifies the state of the monitoring target based on the calculated marker-to-marker distance (specifically, the calculated marker-to-marker distance, the first direction length, and the second direction length).

[0139] Specifically, the state specifying unit 22b of the processing device 20 extracts the first condition information corresponding to the calculated marker-to-marker distance from among the first condition information stored in the second state DB 23b. Next, the state specifying unit 22b extracts the second condition information corresponding to the calculated first direction length and second direction length from among the second condition information stored in the second state DB 23b. Then, the state specifying unit 22b extracts the state information corresponding to the extracted first condition information and second condition information from among the state information stored in the second state DB 23b, and specifies the state information as the state to be specified for the state of the monitoring target.

[0140] As an example, when the calculated marker-to-marker distance is shorter than k1 (= coefficient) × D (= marker-to-marker distance when the state of the monitoring target is the supine position), the calculated first direction length is shorter than k2 (= coefficient) × D, and the calculated second direction length is shorter than k2 × D, the state of the monitoring target = lateral position (right lateral position or left lateral position) may be specified with reference to the second state DB 23b in FIG. 6.

[0141] By such a method of specifying the state of the monitoring target, the state of the monitoring target can be specified simply and accurately, and the specification can be performed efficiently. Further, since the state of the monitoring target is specified based on the calculated marker-to-marker distance, the first direction length, and the second direction length, the state of the monitoring target can be specified in detail, and the details of the state of the monitoring target can be grasped.

[0142] (Effect of Embodiment 2) According to the second embodiment as described above, the state specifying unit 22b calculates the distance between a pair of markers in the captured image acquired by the acquisition unit 22a, and specifies the state of the monitoring target based on the calculated distance. Therefore, the state of the monitoring target can be specified simply and accurately, and the specification can be performed efficiently.

[0143] In addition, the state specifying unit 22b specifies the state of the monitoring target based on the length of the calculated distance, the length of the component in the first direction in the distance, and the length of the component in the second direction orthogonal to the first direction in the distance. Therefore, the state of the monitoring target can be specified in detail, and the details of the state of the monitoring target can be grasped.

[0144] [Embodiment 3] Next, a monitoring system according to Embodiment 3 will be described. This Embodiment 3 is a form that further includes an abnormality degree specifying unit to be described later and a tendency specifying unit to be described later in addition to the configuration of the monitoring system according to Embodiment 1. However, the configuration of this Embodiment 3 is substantially the same as the configuration of Embodiment 1 except in cases where otherwise specified, and for configurations substantially the same as those of Embodiment 1, the same reference numerals and / or names as those used in this Embodiment 1 are attached as necessary, and the description thereof is omitted.

[0145] (Configuration) First, the configuration of the monitoring system according to Embodiment 3 will be described.

[0146] As shown in FIG. 9, the monitoring system 200 includes a terminal device 10 and a processing device 20.

[0147] (Configuration - Terminal Device) First, the configuration of the terminal device 10 will be described.

[0148] The terminal device 10 according to Embodiment 3 is configured substantially the same as the terminal device 10 according to Embodiment 1.

[0149] (Configuration - Processing Device) Next, the configuration of the processing device 20 will be described.

[0150] The processing device 20 according to Embodiment 3 is configured substantially the same as the processing device 20 according to Embodiment 1. However, regarding the details of the configurations of the processing side control unit 22 and the processing side storage unit 23, the following contrivances are made.

[0151] (Configuration - Processing Device - Processing Side Control Unit) As shown in FIG. 9, the processing side control unit 22 functionally conceptually includes an acquisition unit 22a, a state identification unit 22b, a provision unit 22c, an abnormality degree identification unit 22d, and a trend identification unit 22e.

[0152] (Configuration - Processing Device - Processing Side Control Unit - Abnormality Degree Identification Unit) Among these, the abnormality degree identification unit 22d is an abnormality degree identification means for identifying an abnormality degree indicating the degree of possibility that an abnormality regarding the state of the monitoring target occurs based on the state of the monitoring target identified by the state identification unit 22b.

[0153] Here, the "abnormality regarding the state of the monitoring target" includes, for example, the monitoring target falling or tumbling while in bed or getting up, the monitoring target falling while in the living room, entrance, or staircase, the monitoring target not moving while in the living room, etc. However, in Embodiment 3, it will be described as the monitoring target falling or tumbling while in bed or getting up.

[0154] Also, in Embodiment 3, the "abnormality degree" is described as three degrees (specifically, as shown in FIG. 10, "low possibility of abnormality occurring", "possibility of abnormality occurring", and "high possibility of abnormality occurring" (increasing in the order of description)). However, it is not limited to this, and for example, it may be two degrees or four or more degrees.

[0155] (Configuration - Processing Device - Processing Side Control Unit - Trend Identification Unit) Returning to FIG. 9, the trend identification unit 22e is a trend identification means for identifying the trend of the state of the monitoring target based on a plurality of state information with different time series.

[0156] Here, the "trend of the state of the monitoring target" in Embodiment 3 corresponds to, for example, the tendency for the monitoring target to frequently turn over, the tendency for the monitoring target to have a poor sleeping posture, and the tendency for the monitoring target to frequently wander around.

[0157] (Configuration - Processing Device - Processing - side Storage Unit) As shown in FIG. 9, the processing - side storage unit 23 includes a first state DB 23a, an abnormality degree DB 23c, and a trend DB 23d.

[0158] (Configuration - Processing Device - Processing - side Storage Unit - Abnormality Degree DB) Among these, the abnormality degree DB 23c is an abnormality degree information storage means for storing abnormality degree information.

[0159] Here, the "abnormality degree information" is information indicating the above - mentioned abnormality degree (specifically, the degree of the possibility of falling or tumbling in the state where the monitoring target is going to bed or getting up in bed).

[0160] As shown in FIG. 10, this abnormality degree DB 23c is configured by associating the item "state information" and the item "abnormality degree information" with the information corresponding to each item.

[0161] Among these, the information corresponding to the item "state information" is state information, and as shown in FIG. 10, it corresponds to the state of the monitoring target such as "supine position".

[0162] Also, the information corresponding to the item "abnormality degree information" is abnormality degree information, and as shown in FIG. 10, it corresponds to the above - mentioned abnormality degree such as "there may be an abnormality".

[0163] (Configuration - Processing Device - Processing - side Storage Unit - Trend DB) Returning to FIG. 9, the trend DB 23d is a trend information storage means for storing trend information.

[0164] Here, the "trend information" is information indicating the trend of the state of the above - mentioned monitoring target.

[0165] As shown in FIG. 11, this tendency DB23d is configured by associating the item "status history information", the item "tendency information", and the information corresponding to each item with each other.

[0166] Among these, the information corresponding to the item "status history information" is status history information indicating the time-series history of the status of the monitoring target. As shown in FIG. 11, the time-series history of the status of the monitoring target such as "having performed the right lateral decubitus position or / and the left lateral decubitus position a predetermined number of times or more" is applicable.

[0167] In addition, the information corresponding to the item "tendency information" is tendency information. As shown in FIG. 11, the tendency of the status of the monitoring target such as "the monitoring target has a tendency to frequently turn over" is applicable.

[0168] (Monitoring Process) Next, the monitoring process executed by the terminal-side control unit 15 of the terminal device 10 and the process-side control unit 22 of the processing device 20 configured as described above will be described.

[0169] Regarding the monitoring process according to Embodiment 3, since the processes of SC1 to SC3 in FIG. 12 are the same as the processes of SA1 to SA3 in FIG. 4, the description of the processes of SC1 to SC3 in FIG. 12 will be omitted.

[0170] As shown in FIG. 12, in SC4, the abnormality degree specifying unit 22d of the processing device 20 specifies the abnormality degree.

[0171] The method of specifying this abnormality degree is arbitrary. However, in Embodiment 3, among the status information stored in the abnormality degree DB23c, the status information indicating the status of the monitoring target specified in SC3 is extracted. Then, among the abnormality degree information stored in the abnormality degree DB23c, the abnormality degree information corresponding to the extracted status information is extracted, and the abnormality degree of the extracted abnormality degree information is specified as the abnormality degree to be specified.

[0172] As an example, when the state of the monitoring target specified at SC3 = left lateral position (the position opposite to the wall side), the abnormality degree = "high possibility of occurrence of abnormality" may be specified with reference to the abnormality degree DB23c in FIG. 10.

[0173] Returning to FIG. 12, in SC5, the providing unit 22c of the processing device 20 provides state information indicating the state of the monitoring target specified at SC3 and abnormality degree information indicating the abnormality degree specified at SC4, in substantially the same manner as the processing of SA4.

[0174] Through the processing of SC4 and SC5 as described above, it is possible to easily grasp the degree of possibility of occurrence of an abnormality related to the state of the monitoring target, and it becomes possible to take appropriate measures before the occurrence of the abnormality.

[0175] In SC6, the processing side control unit 22 of the processing device 20 determines whether the timing for providing the trend information (hereinafter referred to as "trend providing timing") has arrived.

[0176] The method for determining whether or not the trend providing timing has arrived is arbitrary. However, in the third embodiment, it is determined based on whether information indicating a request to provide trend information (hereinafter referred to as "trend providing request information") has been received from the target terminal device via a dedicated application (or a dedicated website), or whether the number of executions of the processing of SC4 has reached a predetermined number of times or more (for example, 10 times or more).

[0177] Here, when the trend providing request information has been received, or when the predetermined number of times or more has been reached, it is determined that the trend providing timing has arrived. When the trend providing request information has not been received, and when the predetermined number of times or more has not been reached, it is determined that the trend providing timing has not arrived.

[0178] Note that, for example, even when the trend providing request information has been received, if the predetermined number of times is only once, it may be determined that the trend providing timing has not arrived.

[0179] When it is determined that the tendency provision timing has arrived (SC6, Yes), the processing side control unit 22 of the processing device 20 proceeds to SC7, and when it is determined that the tendency provision timing has not arrived (SC6, No), it proceeds to SC9.

[0180] In SC7, the tendency specifying unit 22e of the processing device 20 specifies the tendency of the state of the monitoring target.

[0181] The method for specifying the tendency of the state of the monitoring target is arbitrary. In the third embodiment, among the state history information stored in the tendency DB 23d, a plurality of state information provided in SC4 up to the time of processing in SC7 (specifically, a plurality of state information with different time series) that matches the state of the monitoring target is extracted. Then, among the tendency information stored in the tendency DB 23d, the tendency information corresponding to the extracted state history information is extracted, and the tendency of the extracted tendency information is specified as the tendency of the state of the monitoring target to be specified.

[0182] As an example, when a plurality of state information (a plurality of state information with different time series) provided in SC4 up to the time of processing in SC7 = "supine position", "right lateral position", "supine position", "right lateral position", "right lateral position", "left lateral position", "right lateral position", "right lateral position", "supine position", "right lateral position", the tendency of the state of the monitoring target = "the tendency for the monitoring target to frequently turn over" may be specified with reference to the tendency DB 23d in FIG. 11.

[0183] Returning to FIG. 12, in SC8, the providing unit 22c of the processing device 20 provides tendency information indicating the tendency of the state of the monitoring target specified in SC7, in substantially the same manner as the processing of SA4.

[0184] Through the processing from SC6 to SC8 like this, the tendency of the state of the monitoring target can be grasped, and it becomes possible to take measures according to the tendency.

[0185] In SC9, the processing side control unit 22 of the processing device 20 determines whether or not the end timing has arrived, in substantially the same manner as the processing of SA5.

[0186] Then, when it is determined that the above end timing has arrived (SC9, Yes), the processing side control unit 22 of the processing device 20 ends the monitoring process. On the other hand, when it is determined that the above end timing has not arrived (SC9, No), the processing side control unit 22 of the processing device 20 shifts to SC1 and repeats the processing from SC1 to SC9 in the same manner thereafter.

[0187] Through such monitoring processing, in addition to the state information, the abnormality degree information and the trend information can be provided, and it becomes possible to effectively monitor the monitoring target.

[0188] (Effect of Embodiment 3) As described above, according to Embodiment 3, an abnormality degree specifying unit 22d that specifies the abnormality degree is provided based on the state of the monitoring target specified by the state specifying unit 22b, and the providing unit 22c provides the abnormality degree information indicating the abnormality degree specified by the abnormality degree specifying unit 22d together with the state information. Therefore, it is possible to easily grasp the degree of possibility that an abnormality related to the state of the monitoring target occurs, and it becomes possible to take appropriate measures before the abnormality occurs.

[0189] Further, a trend specifying unit 22e that specifies the trend of the state of the monitoring target is provided based on a plurality of state information with different time series, and the providing unit 22c provides the trend information indicating the trend of the state of the monitoring target specified by the trend specifying unit 22e. Therefore, it is possible to grasp the trend of the state of the monitoring target, and it becomes possible to take measures according to the trend.

[0190] [III] Modification Examples of the Embodiment The embodiments of the present invention have been described above. However, the specific configurations and means of the present invention can be arbitrarily modified and improved within the scope of the technical idea of each invention described in the claims. Hereinafter, such modification examples will be described.

[0191] (Regarding the problems to be solved and the effects of the invention) First, the problems to be solved by the invention and the effects of the invention are not limited to the above-described content. According to the present invention, it is also possible to solve problems not described above or to achieve effects not described above. Further, it may solve only a part of the described problems or achieve only a part of the described effects.

[0192] (Regarding dispersion and integration) In addition, each of the above-described electrical components is a functional concept and does not necessarily have to be physically configured as shown in the drawings. That is, the specific form of dispersion or integration of each part is not limited to that shown in the drawings, and all or part of it can be functionally or physically dispersed or integrated in any unit according to various loads, usage situations, etc. For example, the processing device 20 may be configured to be dispersed into a plurality of devices that can communicate with each other, a processing-side control unit 22 may be provided in a part of these plurality of devices, and a processing-side storage unit 23 may be provided in another part of these plurality of devices (note that a part of the processing-side control unit 22 (for example, the acquisition unit 22a, etc.) may be configured to be dispersed from another part of the processing-side control unit 22). In this case, the processing-side control unit 22 and the processing-side storage unit 23 may be connected to each other via the network 2.

[0193] (Regarding shape, numerical value, structure, time series) Regarding the components exemplified in the embodiments and the drawings, the shape, numerical value, or the structure or time series mutual relationship of a plurality of components can be arbitrarily modified and improved within the scope of the technical idea of the present invention.

[0194] (Regarding the state of the monitoring target) In the above-described first to third embodiments, it was explained that the state of the monitoring target corresponds to the state in which the monitoring target is sleeping in the bed and the state in which the monitoring target is getting up from the bed, but it is not limited thereto.

[0195] For example, when the monitoring target is a child or an elderly person in a single-family house or an apartment house, the state of the monitoring target may correspond to a state in which the monitoring target is walking or sitting.

[0196] In addition, when the object to be monitored is a customer in a commercial facility, the state of the object to be monitored may correspond to a state in which the object to be monitored is staying in a purchase area or an event area, etc.

[0197] In addition, when the object to be monitored is a worker in a factory facility, the state of the object to be monitored may correspond to a state in which the object to be monitored is working or taking a break, etc.

[0198] (Regarding the monitoring system) In the above-described Embodiment 1, it was described that the monitoring system 1 includes the terminal device 10 and the processing device 20, but it is not limited thereto. For example, the terminal device 10 may be omitted, and only the processing device 20 configured using a stationary personal computer may be provided (note that the same applies to the monitoring system 100 according to Embodiment 2 and the monitoring system 200 according to Embodiment 3).

[0199] In this case, for example, in the process of SA4 of the monitoring process, the providing unit 22c of the processing device 20 may provide the state information via the display means or the audio output means of the processing device 20 (note that the same applies to the processes of SC5 and SC8 according to Embodiment 3).

[0200] In addition, in the above-described Embodiment 1, it was described that the monitoring system 1 includes the first state DB 23a, but it is not limited thereto. For example, the second state DB 23b may be further provided (note that the same applies to the monitoring system 200 according to Embodiment 3).

[0201] In this case, in the process of SA3 of the monitoring process, the state specifying unit 22b of the processing device 20 refers to the information stored in the first state DB 23a, and temporarily specifies the state of the monitoring target based on the marker area specified based on the imaging image information acquired in SA2. Also, referring to the information stored in the second state DB 23b, the state of the monitoring target is temporarily specified based on the distance between markers calculated based on the imaging image information acquired in SA2. And when the two temporarily specified states of the monitoring target match, the temporarily specified state of the monitoring target is specified as the state to be specified. On the other hand, when the two temporarily specified states of the monitoring target do not match, either one of the two arbitrarily specified temporarily specified states of the monitoring target may be specified as the state to be specified.

[0202] However, it is not limited to this. For example, both of the two temporarily specified states of the monitoring target may be specified as the state to be specified.

[0203] Also, in the above-described Embodiment 3, it has been described that the monitoring system 200 includes the abnormality degree specifying unit 22d and the tendency specifying unit 22e. However, it is not limited to this. For example, either one of the abnormality degree specifying unit 22d or the tendency specifying unit 22e may be omitted.

[0204] When omitting the abnormality degree specifying unit 22d, the abnormality degree DB 23c may be omitted, and the processes of SC4 and SC5 of the monitoring process and the process of providing the abnormality degree information may also be omitted.

[0205] Also, when omitting the tendency specifying unit 22e, the tendency DB 23d may be omitted, and the processes from SC6 to SC8 of the monitoring process may also be omitted.

[0206] (Regarding the second state DB) In the above-described Embodiment 2, it has been described that the second condition information is stored in the second state DB 23b. However, it is not limited to this. For example, the second condition information may be omitted.

[0207] In this case, for example, in the process of SB3 of the monitoring process, the state specifying unit 22b of the processing device 20 may specify the state of the monitoring target based only on the calculated marker distance.

[0208] Specifically, the state specifying unit 22b of the processing device 20 extracts the first condition information corresponding to the calculated marker distance from among the first condition information stored in the second state DB 23b. Then, among the state information stored in the second state DB 23b, the state information corresponding to the extracted first condition information is extracted, and the state of the monitoring target corresponding to the extracted state information may be specified as the state to be specified.

[0209] (Regarding the monitoring process) In the above-described first embodiment, it was explained that in the monitoring process, the processes of SA1 and SA5 are executed. However, the present invention is not limited to this, and for example, the processes of SA1 or / and SA5 may be omitted (note that the same applies to the processes of SB1 and SB5 according to the second embodiment and the processes of SC1 and SC9 according to the third embodiment).

[0210] Also, in the above-described first embodiment, in SA3, it was explained that the state specifying unit 22b of the processing device 20 refers to the information stored in the first state DB 23a and specifies the state of the monitoring target based on the marker area specified by a known image analysis method. However, the present invention is not limited to this.

[0211] For example, the acquisition unit 22a of the processing device 20 acquires past imaging image information indicating the past imaging images and past state information corresponding to the past imaging image information, where the past state information indicates the state of the monitoring target in the past imaging images (for example, past state information that matches the state of the monitoring target actually confirmed by the monitor, etc.). Then, the state specifying unit 22b of the processing device 20 performs machine learning based on the past imaging image information and the past state information acquired by the acquisition unit 22a, and may specify the state of the monitoring target with reference to the result of the machine learning (note that the same applies to the process of SB3 according to the second embodiment).

[0212] Here, with reference to the results of the above machine learning, the method for identifying the state of the object to be monitored is arbitrary, but for example, it may be identified as follows.

[0213] That is, first, with reference to the information stored in the first state DB 23a, the state of the object to be monitored is tentatively identified based on the marker area identified by a known image analysis method.

[0214] Next, among the results of the above machine learning, it is determined whether the state of the object to be monitored of the past state information having a high relevance (or high similarity) to the tentatively identified marker area matches (or, it is determined whether the matching ratio is equal to or higher than a threshold value).

[0215] And when it is determined that they match (or when it is determined that the matching ratio is equal to or higher than the threshold value), the tentatively identified state of the object to be monitored may be identified as the state to be specified.

[0216] On the other hand, when it is determined that they do not match (or when it is determined that the matching ratio is not equal to or higher than the threshold value), the tentatively identified state of the object to be monitored may not be identified as the state to be specified. In this case, in the process of SA4, instead of the state information, information indicating that the state of the object to be monitored cannot be identified may be provided.

[0217] By such processing, the state of the object to be monitored can be identified more accurately, and the accuracy of the identification can be further improved.

[0218] Also, in the above-described Embodiment 1, in SA3, it was described that the state identification unit 22b of the processing device 20 identifies the marker area based on the captured image information acquired in SA2 using a known image analysis method, but it is not limited thereto.

[0219] For example, in a state where the imaging image information acquired by SA2 is displayed on the terminal-side output unit 13 of the target terminal device, a predetermined operation by the monitor who possesses the target terminal device is selected from among a plurality of marker regions (for example, a plurality of marker regions set in advance at a specific ratio, etc.) via the terminal-side operation unit 12, and the selected marker region may be specified as the region to be specified.

[0220] As an example, by selecting the marker region corresponding to the region specified by two diagonal points on the screen of the terminal-side output unit 13 designated via the terminal-side operation unit 12, the selected marker region may be specified as the region to be specified.

[0221] Note that the above specific ratio may be changed according to the distance between a pair of markers.

[0222] Also, in the above-described Embodiment 1, in SA5, it was explained that the processing-side control unit 22 of the processing device 20 determines whether the end timing has arrived based on whether the end request information has been received from the target terminal device via a dedicated application (or a dedicated website), but it is not limited to this. For example, when the processing from SA1 to SA4 is being performed, the processing-side control unit 22 of the processing device 20 determines whether end request information has been received from the target terminal device, and if the end request information has been received, the monitoring process may be ended (note that the monitoring process according to Embodiment 2 is substantially the same).

[0223] Also, in the above-described Embodiment 3, in SC4, it was explained that the abnormality degree specifying unit 22d of the processing device 20 specifies the abnormality degree by referring to the information stored in the abnormality degree DB23c, but it is not limited to this. For example, in addition to the information stored in the abnormality degree DB23c, the abnormality degree may be specified by referring to the tendency of the state of the monitoring target specified in SC7.

[0224] As an example, when the state of the monitoring target specified at SC3 = dorsal recumbent position and the state of the monitoring target specified at SC7 = the sleep phase of the monitoring target tends to be poor (or the monitoring target tends to be in a deep sleep state), among the abnormality degree information stored in the abnormality degree DB23c of FIG. 10, even if the abnormality degree information corresponding to the specified state of the monitoring target = "there may be an abnormality", from the perspective of ensuring the safety of the monitoring target, the abnormality degree may be specified as "there is a high possibility of an abnormality".

[0225] Also, when the state of the monitoring target specified at SC3 = dorsal recumbent position and the state of the monitoring target specified at SC7 = the sleep phase of the monitoring target tends to be good, among the abnormality degree information stored in the abnormality degree DB23c of FIG. 10, even if the abnormality degree information corresponding to the specified state of the monitoring target = "there may be an abnormality", from the perspective of ensuring the safety of the monitoring target, the abnormality degree may be specified as "there is a low possibility of an abnormality".

[0226] (Supplementary Note) The monitoring system of Supplementary Note 1 is a monitoring system for monitoring a monitoring target in a monitoring environment, and includes an acquisition means for acquiring imaging image information indicating an imaging image of the monitoring target to which at least one or more markers are attached, a state specifying means for specifying the state of the monitoring target based on the positions of the at least one or more markers in the imaging image of the imaging image information acquired by the acquisition means, and a providing means for providing state information indicating the state of the monitoring target specified by the state specifying means.

[0227] The monitoring system of Supplementary Note 2 is the monitoring system described in Supplementary Note 1, wherein the state specifying means specifies the area in the area of the imaging image acquired by the acquisition means where the at least one or more markers are located, and specifies the state of the monitoring target based on the specified area.

[0228] The monitoring system of Supplementary Note 3 is the monitoring system described in Supplementary Note 1, wherein the captured image is an image of the monitoring target with a pair of markers attached thereto, and the state specifying means calculates the distance between the pair of markers in the captured image acquired by the acquisition means, and specifies the state of the monitoring target based on the calculated distance.

[0229] The monitoring system of Supplementary Note 4 is the monitoring system described in Supplementary Note 3, wherein the state specifying means specifies the state of the monitoring target based on the length of the calculated distance, the length of the component in the first direction of the distance, and the length of the component in the second direction orthogonal to the first direction of the distance.

[0230] The monitoring system of Supplementary Note 5 is the monitoring system described in any one of Supplementary Notes 1 to 4, wherein the monitoring target includes a patient and / or a care recipient, and the at least one or more markers include a pair of markers attached to both shoulders of the monitoring target.

[0231] The monitoring system of Supplementary Note 6 is the monitoring system described in any one of Supplementary Notes 1 to 4, and includes an abnormality degree specifying means for specifying an abnormality degree indicating the degree of possibility of an abnormality occurring in the state of the monitoring target based on the state of the monitoring target specified by the state specifying means, and the providing means provides abnormality degree information indicating the abnormality degree specified by the abnormality degree specifying means together with the state information.

[0232] The monitoring system of Supplementary Note 7 is the monitoring system described in any one of Supplementary Notes 1 to 4, and includes a tendency specifying means for specifying the tendency of the state of the monitoring target based on a plurality of pieces of the state information having different time series, and the providing means provides tendency information indicating the tendency of the state of the monitoring target specified by the tendency specifying means.

[0233] The monitoring program of Supplementary Note 8 is a monitoring program for causing a monitoring system for monitoring a monitoring target in a monitoring environment to execute. The computer is caused to function as an acquisition means for acquiring imaging image information indicating an imaging image obtained by imaging the monitoring target to which at least one or more markers are attached, a state specifying means for specifying the state of the monitoring target based on the positions of the at least one or more markers in the imaging image of the imaging image information acquired by the acquisition means, and a providing means for providing state information indicating the state of the monitoring target specified by the state specifying means.

[0234] (Effect of Supplementary Note) According to the monitoring system described in Supplementary Note 1 or the monitoring program described in Supplementary Note 8, based on the positions of at least one or more markers in the imaging image of the imaging image information acquired by the acquisition means, there are a state specifying means for specifying the state of the monitoring target and a providing means for providing state information. Therefore, compared with the prior art (a technique for discriminating the state of a person requiring care based on the body pressure distribution of a person requiring care detected by a sensor made of an elastomer), the cost of the means for specifying the state of the monitoring target can be reduced, and the installation cost of the monitoring system can be reduced. In addition, the state of the monitoring target can be specified based on the positions of at least one or more markers attached to the monitoring target, and the accuracy of the specification can be improved.

[0235] According to the monitoring system described in Supplementary Note 2, the state specifying means specifies the area in the area of the imaging image acquired by the acquisition means where at least one or more markers are located, and based on the specified area, specifies the state of the monitoring target. Therefore, the state of the monitoring target can be specified simply and accurately, and the specification can be performed efficiently.

[0236] According to the monitoring system described in Supplementary Note 3, the state specifying means calculates the distance between a pair of markers in the imaging image acquired by the acquisition means, and based on the calculated distance, specifies the state of the monitoring target. Therefore, the state of the monitoring target can be specified simply and accurately, and the specification can be performed efficiently.

[0237] According to the monitoring system described in Supplementary Note 4, the state specifying means specifies the state of the monitoring target based on the calculated length of the distance, the length of the component in the first direction at the distance, and the length of the component in the second direction orthogonal to the first direction at the distance. Therefore, the state of the monitoring target can be specified in detail, and it becomes possible to grasp the details of the state of the monitoring target.

[0238] According to the monitoring system described in Supplementary Note 5, the monitoring target includes a patient and / or a care recipient, and at least one or more markers include a pair of markers attached to both shoulders of the monitoring target. Therefore, compared with the case where only one marker is attached to the monitoring target, the state of the monitoring target can be accurately specified, and the accuracy of the specification can be improved.

[0239] According to the monitoring system described in Supplementary Note 6, it includes an abnormality degree specifying means for specifying the degree of abnormality based on the state of the monitoring target specified by the state specifying means, and the providing means provides the abnormality degree information together with the state information. Therefore, it is possible to easily grasp the degree of possibility that an abnormality occurs in the state of the monitoring target, and it becomes possible to take appropriate measures before the abnormality occurs.

[0240] According to the monitoring system described in Supplementary Note 7, it includes a trend specifying means for specifying the trend of the state of the monitoring target based on a plurality of state information with different time series, and the providing means provides the trend information. Therefore, it is possible to grasp the trend of the state of the monitoring target, and it becomes possible to take measures according to the trend.

Explanation of Signs

[0241] 1 Monitoring system 2 Network 10 Terminal device 11 Terminal-side communication unit 12 Terminal-side operation unit 13 Terminal-side output unit 14 Terminal-side power supply unit 15 Terminal-side control unit 16 Terminal-side storage unit 20 Processing device 21 Processing-side communication unit 22 Processing-side control unit 22a Acquisition unit 22b State identification unit 22c Provision unit 22d Abnormality level identification unit 22e Trend identification unit 23 Processing-side memory unit 23a First state DB 23b Second state DB 23c Abnormality level DB 23d Trend DB 100 Monitoring system 200 Monitoring system B Bed MA1 First marker area MA2 Second marker area MA3 Third marker area MA4 Fourth marker area MA5 Fifth marker area T Monitoring target

Claims

1. A monitoring system for monitoring a monitoring target within a monitoring environment, comprising: acquisition means for acquiring imaging image information indicating an imaging image of the monitoring target to which at least one marker is attached; state specifying means for specifying the state of the monitoring target based on the positions of the at least one marker in the imaging image of the imaging image information acquired by the acquisition means; providing means for providing state information indicating the state of the monitoring target specified by the state specifying means; A monitoring system comprising the above.

2. The state specifying means: specifies a region in which the at least one marker is located among the regions of the imaging image acquired by the acquisition means; specifies the state of the monitoring target based on the specified region. The monitoring system according to Claim 1.

3. The imaging image is an image of the monitoring target to which a pair of markers are attached. The state specifying means: calculates the distance between the pair of markers in the imaging image acquired by the acquisition means; specifies the state of the monitoring target based on the calculated distance. The monitoring system according to Claim 1.

4. The state specifying means: specifies the state of the monitoring target based on the length of the calculated distance, the length of the component in the first direction in the distance, and the length of the component in the second direction orthogonal to the first direction in the distance. The monitoring system according to Claim 3.

5. The monitoring target includes a patient and / or a care recipient. The at least one marker includes a pair of markers attached to both shoulders of the monitoring target. The monitoring system according to any one of Claims 1 to 4.

6. An abnormality degree specifying means for specifying an abnormality degree indicating the degree of possibility of an abnormality occurring in the state of the monitoring target based on the state of the monitoring target specified by the state specifying means is provided. The providing means provides abnormality degree information indicating the abnormality degree specified by the abnormality degree specifying means together with the state information. The monitoring system according to any one of Claims 1 to 4.

7. A trend specifying means for specifying the trend of the state of the monitoring target based on a plurality of the state information having different time series is provided. The providing means provides trend information indicating the trend of the state of the monitoring target specified by the trend specifying means. The monitoring system according to any one of Claims 1 to 4.

8. A monitoring program for causing a monitoring system for monitoring a monitoring target present in a monitoring environment to execute, comprising: causing a computer to an acquisition means for acquiring imaging image information indicating an imaging image obtained by imaging the monitoring target to which at least one or more markers are attached; a state specifying means for specifying a state of the monitoring target based on positions of the at least one or more markers in the imaging image of the imaging image information acquired by the acquisition means; a providing means for providing state information indicating the state of the monitoring target specified by the state specifying means; A monitoring program for causing the above functions.

Images