Monitoring systems and programs

Abstract

Allow monitors to be aware of the living conditions of individuals and others within the area. [Solution] The monitoring system is a monitoring system that displays the behavioral history of a subject in a monitoring area, and comprises an acquisition unit and a control unit. The acquisition unit acquires detection data that detects the position and posture of the subject in the monitoring area. The control unit creates and outputs a behavioral history map representing the behavioral history on a map showing the monitoring area, based on the position and posture of the subject detected over a predetermined period, so as to distinguish between different posture types in the subject's behavioral history.

Description

Technical Field

[0001] The present invention relates to a monitoring system for monitoring the living conditions of monitored persons such as the elderly living in a building, and a program therefor.

Background Art

[0002] Conventionally, there has been a system for displaying the movement history of a person or the like.

[0003] For example, in Patent Document 1 below, an imaging image of a target area transmitted from a camera and movement line information regarding a stay position or a passing position of a moving object included in the imaging image are acquired, and the sensitivity when displaying the movement line information is set according to the imaging conditions of the imaging image, and a movement line analysis image (heat map image) in which the movement line information of the moving object according to this is superimposed on the imaging image is generated and displayed on a monitor. A movement line analysis system is disclosed.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, simply displaying the movement history of a person as in the technology of Patent Document 1 above makes it difficult for a monitor to grasp the living conditions (lifestyle, life rhythm) of a person or the like in an area.

[0006] In view of the above circumstances, an object of the present invention is to provide a monitoring system and a program that enable a monitor to grasp the living conditions of a person or the like in an area.

Means for Solving the Problems

[0007] To achieve the above objective, a monitoring system according to one embodiment of the present invention is a monitoring system that displays the behavioral history of a subject in a monitoring area, and comprises an acquisition unit and a control unit. The acquisition unit acquires detection data that detects the position and posture of the subject in the monitoring area. The control unit creates and outputs a behavioral history map representing the behavioral history on a map showing the monitoring area, based on the position and posture of the subject detected over a predetermined period, so as to distinguish between different posture types in the subject's behavioral history.

[0008] This configuration allows the monitoring system to output a behavioral history map that can distinguish the posture type of the subject, enabling the monitor to understand the living conditions of people and other entities within the area. Here, "subject" does not have to be a human; it can also be a pet or a domesticated animal.

[0009] The control unit may create the behavior history map in a manner that distinguishes between the first area and the second area, by defining the locations where the first posture type is detected within the monitoring area during the predetermined period as the first area, and the locations where a second posture type different from the first posture type is detected as the second area.

[0010] This configuration allows the monitoring system to display the type of posture of each subject in a way that distinguishes them by area, enabling the monitor to understand the subject's living situation in each area.

[0011] The subject may be a person being monitored by a caregiver, in which case the control unit may output the behavioral history map showing the behavioral history of the person being monitored to the caregiver's terminal. The first posture type may be a resting posture and the second posture type may be an active posture, in which case the control unit may create the behavioral history map with the first area as a resting area and the second area as an active area.

[0012] This configuration allows the monitoring system to enable the caregiver to understand the living situation of the person being monitored, including which areas of the monitoring area are where they are resting and which areas are where they are active.

[0013] The control unit may determine the locations where the resting posture has been detected for a predetermined period of time or longer as the resting area and create the activity history map.

[0014] This configuration prevents the monitoring system from misinterpreting a moment when the person being monitored briefly sits down, for example, to pick up something that has fallen on the floor, as a resting position.

[0015] The control unit may create the activity history map by designating the area where the rest area and the activity area overlap as the rest area.

[0016] This configuration allows the monitoring system to prioritize displaying rest areas when rest areas and activity areas overlap, making it easy for caregivers to understand where the person being monitored was resting, which is a matter of concern for them.

[0017] When the control unit detects the resting posture of the person being monitored, it may include a first range including the position where the resting posture was detected in the resting area, and when it detects the active posture of the person being monitored, it may include the position where the active posture was detected, or a second range narrower than the first range including the position where the active posture was detected, in the activity area.

[0018] This configuration allows the monitoring system to display the rest area larger than the activity area, making it easy for caregivers to understand where the person being monitored was resting, which is a matter of concern for them.

[0019] The control unit may create the behavior history map by expanding the size of the rest area according to the length of time during which the resting posture was detected.

[0020] This configuration allows the monitoring system to more easily track areas where the person being monitored has been resting for a longer period of time.

[0021] The control unit may create a time-series graph indicating the posture types detected for each time period, and output the created action history map and the time-series graph for the same period.

[0022] With this configuration, in addition to the action history map, the monitoring system can output a time-series graph, enabling the caregiver to more precisely grasp the living situation of the care recipient.

[0023] A program according to another aspect of the present invention causes a computer to acquire action history data including the position and posture of a target person in a monitored area detected during a predetermined period, create an action history map showing the action history of the target person on a map indicating the monitored area so that different posture types in the action history of the target person can be distinguished based on the action history data, and output the created action history map to a display unit.

Advantages of the Invention

[0026] Embodiments of the present invention will be described below with reference to the drawings.

[0027] [System Configuration] Figure 1 is a diagram showing the configuration of the life monitoring system according to this embodiment.

[0028] As shown in the diagram, the life monitoring system provides a monitoring service that detects abnormalities such as intrusion into the building (monitoring area) where the person being monitored is located, and a monitoring service that keeps track of the situation of the person being monitored, such as the elderly. In this monitoring service, information showing the history of the person being monitored's actions detected in their daily life is provided to the monitor, such as a family member (child) who lives separately from the person being monitored. This allows the monitor to be aware of the person being monitored's situation and to keep an eye on them.

[0029] The life monitoring system comprises a server device 100, a user terminal 200, a monitoring device 300, multiple intrusion detection sensors 400, and a monitoring sensor 500. The monitoring device 300, intrusion detection sensors 400, and monitoring sensors 500 are installed in a building such as the residence of the person being monitored and are connected via a network such as a LAN (Local Area Network).

[0030] The server device 100 is installed in a monitoring center operated by a business operator providing monitoring and surveillance services. The server device 100 determines the actions of the person being monitored from the time-series changes in the detected posture and position of the person being monitored received from the monitoring device 300, creates an action history, and provides the person being monitored with an action history map or time-series graph of their living situation (action history). The person being monitored's living situation may also be created as an animated video or other video.

[0031] The user terminal 200 is held by the caregiver and is used by the caregiver to view various information related to the monitoring service, such as information indicating the living situation of the person being monitored. Examples of user terminals 200 include smartphones, mobile phones, personal computers, tablet devices, and wearable devices. The user terminal 200 has an application installed that supports viewing the various information related to the monitoring service (hereinafter also referred to as the "monitoring app").

[0032] The server device 100, the monitoring device 300, and the user terminal 200 are connected via a network 50 that includes the Internet and a mobile communication network.

[0033] The intrusion monitoring sensor 400 detects intruders into a building and outputs detection information. If the building is a residence, the intrusion monitoring sensor 400 includes sensors installed inside the residence (e.g., openings such as front doors and windows, passageways and living rooms within the residence) and sensors installed outside the residence (e.g., gardens and gates). The intrusion monitoring sensor 400 may also be used for monitoring purposes.

[0034] The monitoring sensor 500 is installed in a monitoring area (room or space) within a building, detects the movement (amount of movement and posture) of the person being monitored in that monitoring area, and outputs detection information indicating the detection results.

[0035] Examples of monitoring sensors 500 include radio wave sensors (millimeter wave, microwave, etc.), ultrasonic sensors, TOF sensors, and cameras. When a camera capable of shooting video or a TOF sensor is used as the monitoring sensor 500, the position and posture of the person being monitored are detected for each frame of the captured image. As for posture detection methods, known methods such as pattern matching between a person image extracted from an image using the background subtraction method and images of each posture that have been registered in advance are used, or authentication processing using a trained model that has been trained on images of various postures for posture detection are used. Furthermore, when a radio wave sensor or ultrasonic sensor is used as the monitoring sensor 500, the position and posture of the person being monitored are detected, for example, every second. As for posture detection methods, known methods such as pattern matching between point cloud data obtained from an ultrasonic sensor and point cloud data of each posture that have been registered in advance are used. The monitoring sensor 500 detects the position of a person within the monitoring area and their posture (e.g., standing, sitting, lying down, etc.), and calculates the amount of movement of the person from the changes in the person's position and posture. The amount of movement is calculated by scoring the change in position and the change in posture per unit time, and then adding them together. The monitoring sensor 500 then outputs the calculated amount of movement and posture as detection data. Note that the amount of movement may be calculated from the change in position alone. Alternatively, the presence or absence of movement may be included in the detection data instead of the amount of movement. Furthermore, the monitoring sensor 500 may send the detection results of position and posture to the server device 100, and the server device 100 may calculate the amount of movement. Note that the monitoring sensor 500 may be used for the intrusion monitoring application described above.

[0036] The monitoring device 300 uses the intrusion monitoring sensor 400 to monitor for intrusion into the building where the person being monitored is located, and also uses the monitoring sensor 500 to detect the actions of the person being monitored.

[0037] For example, when an intruder is detected by the intrusion monitoring sensor 400, the monitoring device 300 notifies the server device 100 that an intruder has entered the building. The monitoring device 300 has three security modes, such as an unmanned security mode, a manned security mode, and a deactivation mode.

[0038] Although not shown in the diagram, the monitoring device 300 is connected to a setting unit installed at the entrance or elsewhere to receive commands to set the security mode of the monitoring device 300.

[0039] When the server device 100 receives an abnormal signal from the monitoring device 300, it outputs information about the building and the person being monitored, prompting the controller of the monitoring sensor to check on the person being monitored and security guards to respond to the building. The server device 100 also determines the actions of the person being monitored based on the detection results of the monitoring sensor 500 and provides the user terminal 200 of the person being monitored with information about their actions.

[0040] [Server configuration] Figure 2 shows the configuration of the server device 100. As shown in the figure, the server device 100 includes a CPU (Central Processing Unit) 11, ROM (Read Only Memory) 12, RAM (Random Access Memory) 13, an input / output interface 15, and a bus 14 that connects these to each other.

[0041] The CPU 11 accesses RAM 13 and other memory as needed, performing various calculations and comprehensively controlling all blocks of the server device 100. ROM 12 is a non-volatile memory in which the OS, programs, and firmware such as various parameters to be executed by the CPU 11 are permanently stored. RAM 13 is used as a working area for the CPU 11 and temporarily holds the OS, various running applications, and various data being processed.

[0042] The input / output interface 15 is connected to the display unit 16, the operation reception unit 17, the storage unit 18, the communication unit 19, and the like.

[0043] The display unit 16 is a display device (built-in display) that uses, for example, an LCD (Liquid Crystal Display), an OLED (Organic ElectroLuminescence Display), a CRT (Cathode Ray Tube), etc.

[0044] The operation reception unit 17 is, for example, a touch panel, buttons, keys, or other input device. If the operation reception unit 17 is a touch panel, the touch panel may be integrated with the display unit 16.

[0045] The storage unit 18 is, for example, a flash memory (SSD; Solid State Drive), other solid memory, or a non-volatile memory such as an HDD (Hard Disk Drive). The OS, various applications, and various data are stored in this storage unit 18.

[0046] In particular, in this embodiment, the storage unit 18 stores the detection result data (posture type and location information) of the monitoring sensor 500, as well as programs and data for generating behavioral history information of the person being monitored (behavioral history map and time-series graph) based on the detection data and displaying it on the user terminal 200.

[0047] The communication unit 19 consists of various modules for wireless communication, such as a NIC (Network Interface Card) for Ethernet or a wireless LAN, and is responsible for communication processing between the user terminal 200 and the monitoring device 300 via the network 50.

[0048] [Activity History Information] Next, we will explain the behavioral history information of the person being monitored, which is generated by the server device 100 and displayed on the user terminal 200.

[0049] The server device 100 stores the monitored person's behavior history in chronological order based on detection data acquired from the monitoring sensor 500. The behavior history is categorized based on the type of posture of the monitored person, and consecutive periods with the same posture type are stored separately from periods showing other posture types. Posture types are classified, for example, into standing (including crouching), sitting, lying down, and undetected (a state in which no person is detected).

[0050] The user terminal 200 receives and displays activity history information from the server device 100 via the monitoring application described above. The activity history information is generated as, for example, an activity history map and a time-series graph, as described above. Figure 3 shows an example of the playback screen for the activity history information on the user terminal 200.

[0051] As shown in the figure, the playback screen for the activity history information includes an activity history map 31 and a time-series graph 32.

[0052] The activity history map 31 has icons 33 that indicate the position and posture of the person being monitored within the monitoring area, on an image that mimics the space of the monitoring area. As activity history information over a predetermined period (e.g., 24 hours), the position of the icons 33 changes according to the trajectory of the person being monitored's movement, and the position of the icons 33 is displayed on the map, distinguishing between an activity area 34 and a rest area 35 according to the type of posture of the person being monitored. The predetermined period can also be changed by the user terminal 200 (e.g., 6 hours, 1 week, etc.).

[0053] In other words, the server device 100 defines sitting and lying down as resting positions and standing (including crouching) as an active position. Within the monitoring area, it determines the area where a resting position is detected as a resting area 35 and the area where an active position is detected as an active area 34.

[0054] Specifically, the server device 100 determines a location where a resting posture is detected for a predetermined time (e.g., 5 minutes) or longer within the predetermined period as a resting area 35, while determining a location where an active posture is detected within the predetermined period, regardless of the detection time, as an activity area 34. This is because even if a sitting or lying position is detected, if the detection time is short, there is a high possibility that it is an action other than a resting action, such as picking up a dropped item.

[0055] The server device 100 then displays the determined rest area 35 and activity area 34 on a map, distinguishing them by color (and area shape), as shown in the figure. The area of ​​the rest area 35 is set to be larger than the area of ​​the activity area 34. The two areas may also be distinguished and displayed using solid lines / dashed lines, etc., instead of color.

[0056] The diagram shows an example of how activity history information is displayed when the monitoring area is the living room. However, a button may be provided at the far right of the activity history map 31 to transition to a screen that plays activity history information for other monitoring areas (e.g., the bedroom).

[0057] The time-series graph 32 displays the relationship between the type of posture of the person being monitored and the detection time of the detection data from the monitoring sensor 500 corresponding to that posture type, in a time-series format.

[0058] In the time-series graph 32, the behavioral history from a certain point in time (e.g., the present) up to, for example, 24 hours prior is displayed, color-coded according to the type of posture. A pointer 36 is displayed on the time-series graph 32 at the position indicating the detection time of the monitored person's behavior as played back in the behavioral history map 31, and the position of the pointer 36 moves in synchronization with the playback time in the behavioral history map 31. In addition, for example, the playback time in the behavioral history map 31 is displayed at the top of the time-series graph 32.

[0059] As shown in the legend at the bottom of the time-series graph 32, the types of detected postures displayed in the time-series graph 32 are, like those in the behavior history map 31, for example, standing (including crouching), sitting, lying down (sleeping or lying on one's side), and not detected.

[0060] When the server device 100 receives a request from the monitoring application to play back the behavioral history information, it starts generating and displaying the behavioral history map 31 and the time-series graph 32.

[0061] Furthermore, the above-mentioned activity history map 31 and time-series graph 32 may be created using activity history information from the morning hours (after 6:00, etc.) to the present if the monitoring area is the living room, or from the evening hours (after 18:00, etc.) to the present if the monitoring area is the bedroom.

[0062] [Operation of the Life Monitoring System] Next, the operation of the life monitoring system configured as described above will be explained. This operation is performed through the cooperation of the hardware of the server device 100, such as the CPU 11 and communication unit 19, and the software (monitoring application) stored in the storage unit 18. For convenience, in the following explanation, the CPU 11 of the server device 100 will be considered the main operator.

[0063] Figure 4 is a flowchart showing the flow of the behavioral history map display process by the server device 100 described above.

[0064] As shown in the figure, the CPU 11 of the server device 100 first determines whether or not it has received a request to display the activity history map from the user terminal 200 of the caregiver via the monitoring application (step 41). This request to display the activity history map is sent triggered by the launch of the monitoring application or the pressing of the activity history map display button in the menu of the monitoring application.

[0065] If the CPU determines that it has received the above-mentioned request to display the behavior history map (Yes), the CPU 11 obtains data from the storage unit 18 regarding the posture type and location of the person being monitored for a predetermined period in the past (for example, 24 hours from the present) as detected by the monitoring sensor 500 (step 42).

[0066] Next, the CPU 11 determines whether or not an active posture has been detected in the detection data (step 43).

[0067] If it is determined that an active posture has been detected (Yes in step 43), the CPU 11 creates an activity area 34 that constitutes the activity history map 31 (step 44).

[0068] Specifically, as shown in Figure 5, the CPU 11 first divides the area corresponding to the floor surface of the monitoring area in the behavior history map 31 shown in Figure 3 into blocks of, for example, 10 cm x 10 cm. Each of these blocks is identified by the position data (coordinate data) detected by the monitoring sensor 500.

[0069] Next, the CPU 11 determines the blocks of locations where activity postures were detected during the predetermined period as activity areas, and plots these blocks on the activity history map 31 as activity areas 34 shown in Figure 3.

[0070] Returning to Figure 4, if the above activity area has been created, or if it is determined in step 43 that no activity posture has been detected (No. in step 43), the CPU 11 determines whether or not a resting posture has been detected in the detection data (step 45).

[0071] If it is determined that a resting posture has been detected (Yes in step 45), the CPU 11 determines whether that resting posture has been detected at the same location (block) for a predetermined time (e.g., 5 minutes) or longer (step 46).

[0072] If it is determined that the resting posture has been detected at the same location for a predetermined period of time or longer (Yes in step 46), the CPU 11 creates a resting area 35 at that location (step 47).

[0073] Specifically, as shown in Figure 6(A), the CPU 11 first divides the area corresponding to the floor surface of the monitoring area in the activity history map 31 into blocks of, for example, 10cm x 10cm, similar to when creating the activity area 34, and calculates the time spent in each block during the predetermined period (counting the number of seconds in which sitting or lying down was detected in the same block (approximately the number of detections if the detection interval of the monitoring sensor 500 is 1 second)). Alternatively, the longest period of time among multiple periods in which a resting posture was continuously detected may be used as the time spent in each block.

[0074] Next, as shown in Figure 6(B), the CPU 11 normalizes the calculated stay times so that the block where the user stayed the longest in a resting position is assigned a value of 1, and the blocks where the user did not stay are assigned a value of 0.

[0075] Next, as shown in Figure 6(C), the CPU 11 deletes the blocks with short dwell times (for example, the normalized dwell time value is 0.3 or less). Alternatively, instead of deleting blocks one by one, multiple adjacent blocks with dwell times greater than 0 may be grouped together, and if the sum of the values ​​of the adjacent blocks in that group is 0.3 or less, all the blocks in that group may be deleted.

[0076] Next, as shown in Figure 6(D), the CPU 11 deletes any blocks (isolated blocks) where all the blocks above, below, to the left, or to the right of it are all 0.

[0077] Next, as shown in Figure 6(E), the CPU 11 creates a circle as a rest area 35, with each block whose value is greater than 0 as the origin. In this case, the CPU 11 increases the size of the circle according to the length of stay (for example, a circle with a radius of 0.5M if the value is less than 0.6, and a circle with a radius of 1M if the value is 0.6 or greater). This makes it easier for the caregiver to understand the areas where the person being cared for has rested for a longer period of time. The area of ​​the circle is set to be larger than the area of ​​each block in the activity area 34.

[0078] Alternatively, instead of creating a circle for each block, adjacent blocks may be grouped together, and a circle centered on the group's centroid, with a size appropriate to the values, may be created.

[0079] Returning to Figure 4, if the rest area 35 described above has been created, or if it is determined in steps 45 and 46 that a resting posture for a predetermined time or longer has not been detected (No. in step 43), the CPU 11 superimposes the rest area 35 created in Figure 6(E) onto the map plotting the activity area 34 shown in Figure 5 (step 48) to create an activity history map 31.

[0080] At this point, the CPU 11 determines whether the rest area 35 and the activity area 34 overlap in the same location (block) (step 49).

[0081] If the CPU determines that the rest area 35 and the activity area 34 overlap (Yes in step 49), the CPU 11 hides the activity area 34 in the overlapping portion and displays only the rest area 35. This is because, for the caregiver, where the person being cared for is resting is of greater interest than where they are active, and prioritizing the display of the rest area makes it possible to understand the person's living situation within the cared-for area. This process completes the activity history map 31 as shown in Figure 7.

[0082] The CPU 11 then sends the completed activity history map 31 to the user terminal 200 of the caregiver who made the request, and displays it using the monitoring application (step 51).

[0083] As described above, according to this embodiment, the life monitoring system outputs an activity history map 31 that can distinguish between the type of posture (active posture and resting posture) of the person being monitored, thereby allowing the caregiver to understand the living situation of the person being monitored within the monitoring area (such as where they rested and where they were active, and their daily rhythm). Furthermore, by providing the caregiver with information about the person's living situation without using the video footage itself captured by cameras, the system can allow the caregiver to understand the living situation of the person being monitored within the monitoring area while respecting the privacy of the person being monitored.

[0084] [Differentiation] The present invention is not limited to the embodiments described above, and can be modified in various ways without departing from the spirit of the invention.

[0085] In each of the embodiments described above, the server device 100 determined a location to be a rest area if a resting posture was detected at the same location for a predetermined time (e.g., 5 minutes or more). Alternatively, the server device 100 may determine a location where a resting posture is detected to be a rest area, regardless of the detection time, similar to the activity posture described above.

[0086] In each of the embodiments described above, the server device 100 displayed icons 33 indicating the position and posture of the person being monitored on an image that simulated the space of the monitoring area in the behavior history map 31. Alternatively, if the monitoring sensor 500 is a camera, the server device 100 may create the behavior history map 31 using a background image of the monitoring area captured by the camera.

[0087] In each of the embodiments described above, the server device 100 set the area (radius) of the rest area 35 to be larger in the behavior history map 31 the longer the detection time of the resting posture. Alternatively, the server device 100 may display the rest area 35 with a darker color (density, brightness) the longer the detection time of the resting posture.

[0088] Furthermore, in each of the embodiments described above, the server device 100 displayed the activity area 34 as the same rectangular area in the activity history map 31 regardless of the detection time. Alternatively, the server device 100 may display the activity area 34 with a darker color (density, brightness) the longer the detection time of the activity posture.

[0089] In each of the embodiments described above, the server device 100 displayed only the rest area 35 in the activity history map 31 in areas where the rest area 35 and the activity area 34 overlapped. Alternatively, the server device 100 may also display both areas in areas where the rest area 35 and the activity area 34 overlap, for example by mixing colors, or by displaying one with a dashed line and the other with a solid line.

[0090] In the embodiments described above, the activity area 34 was defined as the position where an active posture was detected. Alternatively, the activity area may include a predetermined range that includes the position where the active posture was detected and extends beyond that position. However, the extended range should be smaller than the extended range for a resting posture. For example, if a resting posture is detected, a first range (e.g., a circle with a radius of 0.5M) including the position where the resting posture was detected is included in the resting area, and if an active posture is detected, a second range (e.g., a circle with a radius of 0.2M) smaller than the first range is included in the activity area to determine the resting area 35 and the activity area 34 for a predetermined period.

[0091] In each of the embodiments described above, the server device 100 determined the activity area and the rest area according to the detected posture type (active posture / resting posture), and displayed the activity area 34 and the resting area 35 in different display modes (rectangle / circle) on the activity history map 31. Alternatively, the server device 100 may plot the posture type detected at each location as points on the activity history map 31 without determining the area from the posture type (using the above blocks). In this case, the server device 100 may display the areas with different colors according to the posture type, such as standing, sitting, and lying down, as shown in Figure 8, for example, and may plot standing as a rectangle and sitting and lying down as circles. Furthermore, if multiple postures are detected in the same area, they may be displayed in overlapping order (mixed colors, etc.), or one of the postures (for example, the posture detected for the longest time among those postures) may be prioritized for display.

[0092] In the embodiments described above, a life monitoring system was explained in which a caregiver monitors the life of a person being monitored, such as an elderly person. However, the present invention is not limited to this, and may be implemented as a system for understanding (monitoring) the behavior of people in places such as stores, offices, and roads. For example, by monitoring the behavior of people near the entrance of a convenience store and creating a behavior history map 31, if it is confirmed that a situation is occurring where many people are sitting together at night and causing a nuisance to other customers or nearby residents, measures to prevent the nuisance (such as installing signs) may be taken. Furthermore, the lives of animals, rather than humans, may be the target of monitoring (such as animals kept in cages at a zoo).

[0093] In the above embodiment, the server device 100 generated the activity history map 31 and transmitted it to the user terminal 200 for display on the user terminal 200. However, the activity history map 31 may also be generated and displayed by the monitoring application on the user terminal 200. That is, the monitoring application may receive detection data (an example of activity history data according to the present invention) of the position and posture of the person being monitored detected by the monitoring sensor 500 for a predetermined period from the server device 100, and a map showing the monitoring area, and create and display the activity history map 31 and a time-series graph 32 based on the detection data and map. In this case, the monitoring application may receive the detection data and map from the monitoring device 300 without going through the server device 100. Alternatively, the server device 100 may determine the locations of the rest area 35 and the activity area 34 within the monitoring area, transmit location data (an example of activity history data according to the present invention) showing the locations of the rest area 35 and the activity area 34 and a map to the monitoring application, and the monitoring application may create and display the activity history map 31 using the received location data and map. In the modified example described above, the monitoring app may be configured to store the map in advance.

[0094] In the embodiment described above, only one server device 100 is shown, but the processing performed by the server device 100 may be distributed and executed across multiple servers. For example, the processing of acquiring detection data output from the monitoring sensor 500 and determining the area based on the posture type, and the processing of plotting the determined area on a map and generating the behavior history map 31 may be executed on separate servers.

[0095] A display device and program according to one embodiment of the present invention can contribute to solving social issues such as extending healthy life expectancy, improving quality of life (QOL), and increasing the number of elderly people living alone in a super-aging society. Furthermore, a display device and program according to one embodiment of the present invention can contribute to achieving Goal 3 of the Sustainable Development Goals (SDGs) adopted by the United Nations, "Ensure healthy lives and promote well-being for all." [Explanation of symbols]

[0096] 11…CPU 16…Display section 18...Storage section 19… Communications Department 31…Activity History Map 32…Time-series graph 33… Icon 34…Activity Area 35… Rest area 36... pointer 100…Server device 200... User terminal 500... Monitoring Sensor

Claims

1. A monitoring system that provides administrators with the activity history of individuals within a monitored area, An acquisition unit that acquires detection data that detects the position and posture of the subject in the aforementioned monitoring area, A control unit that, based on the location and posture of the subject detected during a predetermined period, creates and outputs an action history map representing the action history on a map showing the monitoring area so that different posture types in the subject's action history can be distinguished, A monitoring system equipped with the following features.

2. A monitoring system according to claim 1, The control unit creates the behavior history map so that it can distinguish between the first area and the second area, by defining the locations where the first posture type is detected within the monitoring area during the predetermined period as the first area, and the locations where a second posture type different from the first posture type is detected as the second area. Monitoring system.

3. A monitoring system according to claim 2, The aforementioned subject is a person being watched over by a caregiver. The control unit outputs the behavioral history map showing the behavioral history of the person being monitored to the monitor's terminal. The first posture type is a resting posture, and the second posture type is an active posture. The control unit creates the activity history map with the first area designated as a rest area and the second area as an activity area. Monitoring system.

4. A monitoring system according to claim 3, The control unit determines the location where the resting posture was detected for a predetermined period of time or longer as the resting area and creates the activity history map. Monitoring system.

5. A monitoring system according to claim 3, The control unit creates the activity history map by designating the area where the rest area and the activity area overlap as the rest area. Monitoring system.

6. A monitoring system according to claim 3, When the control unit detects the resting posture of the person being monitored, it includes the first range, which includes the position where the resting posture was detected, in the resting area. When the activity posture of the person being monitored is detected, the activity area is to include the position where the activity posture was detected or a second range that is narrower than the first range including the position where the activity posture was detected. Monitoring system.

7. A monitoring system according to any one of claims 3 to 6, The control unit expands the size of the rest area according to the length of time the resting posture was detected, and then creates the activity history map. Monitoring system.

8. A monitoring system according to any one of claims 3 to 6, The control unit creates a time-series graph showing the posture type detected for each time period, and outputs the behavior history map and the time-series graph created for the same period. Monitoring system.

9. On the computer, The steps include acquiring behavioral history data, including the location and posture of the subject in the monitoring area detected over a predetermined period, and The steps include creating an activity history map representing the subject's activity history on a map showing the monitoring area, based on the activity history data, so that different posture types in the subject's activity history can be distinguished, The steps include outputting the created behavioral history map to the display unit and A program that executes the command.

Images