Method for displaying information, program, and information processing device

Abstract

To provide technology for displaying detailed information for a part of watching objects while certainly displaying changes of states of a plurality of watching objects.SOLUTION: A method for displaying information of a plurality of watching objects comprises the steps of: displaying a first area including information of each of the plurality of watching objects on a display; displaying a second area including additional information about a first watching object among the plurality of watching objects to overlap with at least a part of the first area on the display; and updating display of the display so that change is recognized when a state changes in at least a part of the plurality of watching objects. The change of the state of the watching object corresponding to at least a part of the first area is recognized by the step of updating the display of the display.SELECTED DRAWING: Figure 11

Description

[Technical Field]

[0001] The present disclosure relates to displaying information about a monitored subject. [Background technology]

[0002] Various technologies have been proposed for systems that display information about monitored targets. For example, Japanese Patent Application Laid-Open No. 2017-202058 (Patent Document 1) discloses, in FIG. 6 and other figures, an information processing device that displays a "status window" for displaying information about multiple monitored targets and a pop-up window on top of the status window that displays information about a monitored target whose status change has been detected. The pop-up window is displayed in a position that does not overlap with the status icon displayed in the status window, or in a position that partially overlaps with the status icon so that the status icon is visible. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2017-202058 Summary of the Invention [Problem to be solved by the invention]

[0004] However, conventional technologies have not considered displaying a status icon for a monitoring target whose status has changed after a pop-up window is displayed. If the status of a monitoring target changes after a pop-up window is displayed, there is a possibility that the status icon for the monitoring target will not be visible due to the pop-up window that is already displayed. In this sense, conventional technologies cannot reliably display changes in the status of multiple monitoring targets when displaying detailed information about a target whose status has changed.

[0005] The present disclosure has been devised in consideration of the above-mentioned situation, and its purpose is to provide a technology for reliably displaying changes in the status of multiple monitored targets while displaying detailed information about some of the monitored targets. [Means for solving the problem]

[0006] According to one aspect of the present disclosure, there is provided a method for displaying information about a plurality of monitored subjects, the method comprising the steps of: displaying on a display a first area containing information about each of the plurality of monitored subjects; displaying on the display a second area containing additional information about a first of the plurality of monitored subjects so that the second area overlaps at least a portion of the first area; and updating the display when a change in status occurs in at least some of the plurality of monitored subjects so that the change is recognized, wherein the step of updating the display allows a change in status of the monitored subject corresponding to at least the portion of the first area to be recognized.

[0007] The step of updating the display may include displaying, on the display, a third area showing information about a monitored subject whose status has changed among the plurality of monitored subjects.

[0008] The third region may be located outside the first region and the second region.

[0009] The third region may be located within the second region.

[0010] The step of updating the display may include moving the second region so that it does not overlap the portion of the first region that has been modified in response to the change.

[0011] The step of updating the display may include moving the second area so that it does not overlap with the portion of the first area corresponding to the monitored object whose state had changed before the second area was displayed.

[0012] The step of updating the display may include reducing the first area.

[0013] The step of displaying the second area may include displaying the second area so that at least a portion of the first area overlaps with the second area, and the step of updating the display may include reducing the first area when the second area cannot be displayed in a part of the first area other than a part corresponding to a monitored object whose state has changed before and after the second area is displayed.

[0014] The step of displaying the second region may include displaying the second region outside the first region.

[0015] The method may further comprise transmitting at least a portion of the additional information in the second area to a mobile terminal.

[0016] The method may further include a step of accepting input of a comment for the second area, and the step of transmitting at least a portion of the additional information in the second area to the mobile device may include transmitting the comment to the mobile device.

[0017] The method may further include a step of accepting input of information specifying a mobile terminal as a destination of the additional information.

[0018] The method may further comprise the step of removing the second region from the display, wherein removing the second region may involve enlarging the first region.

[0019] The step of removing the display of the second area from the display may be performed under at least one of the conditions that at least a portion of the additional information in the second area has been transmitted to the mobile terminal and that a given time has elapsed since the display of the second area began.

[0020] The second area may display more detailed information about the watching target than the first area.

[0021] The additional information may include a camera image of the monitored subject.

[0022] The change in state may include a change to getting up or getting out of bed.

[0023] In the first area, information based on biological information of each of the plurality of watched over targets may be displayed as the information of each of the plurality of watched over targets.

[0024] A plurality of squares may be arranged in a matrix in the first area, and information about the target being watched over may be displayed in each of the plurality of squares.

[0025] In the first area, a color of the area corresponding to the watching target may change in accordance with a change in the state of the watching target.

[0026] The second area may be a pop-up window, and updating the display may include displaying a pop-up window separate from the pop-up window.

[0027] The separate pop-up window may include information about the watching target whose status has changed.

[0028] Another pop-up window may include an image of the watched-over target whose status has changed.

[0029] According to yet another aspect of the present disclosure, there is provided a program that, when executed by one or more processors, causes the one or more processors to perform the above-described method.

[0030] According to yet another aspect of the present disclosure, there is provided an information processing device including a memory storing the above program, and one or more processors that execute the program stored in the memory. [Effects of the Invention]

[0031] According to the present disclosure, when the status of at least some of the multiple monitored subjects changes, a step is carried out of updating the display so that the change is recognized, and this step recognizes the change in the status of the monitored subject corresponding to at least some of the first area displayed on the display and containing information about each of the multiple monitored subjects. [Brief explanation of the drawings]

[0032] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of a monitoring system. [Figure 2] FIG. 10 is a diagram illustrating an example of a detection range of a sensor in a living room. [Figure 3] FIG. 2 is a diagram showing an example of the hardware configuration of the equipment in each room 10. [Figure 4] FIG. 2 illustrates an example of a hardware configuration of a client terminal 200. [Figure 5] FIG. 2 is a diagram illustrating an example of a hardware configuration of a mobile terminal 300. [Figure 6] FIG. 2 illustrates an example of a hardware configuration of a management server 400. [Figure 7] 10 is a flowchart of an example of a process for displaying information about a resident. [Figure 8] FIG. 10 is a diagram showing an example of a list display of information on a plurality of residents 20. [Figure 9] FIG. 10 is a diagram illustrating an example of a display mode of a pop-up window. [Figure 10] FIG. 10 is a diagram illustrating an example of updating a list display. [Figure 11] FIG. 10 is a diagram showing an example of a screen after updating in step S60. [Figure 12] FIG. 12 is a diagram showing an example of a screen after updating the screen of FIG. 11. [Figure 13] 10 is a diagram showing an example of a display mode when a change occurs in the list display from the state shown in FIG. 9. FIG. [Figure 14] FIG. 14 is a diagram showing an example of a screen after updating the screen of FIG. 13. [Figure 15] FIG. 10 is a diagram illustrating an example of a list display screen. [Figure 16] FIG. 16 is a diagram showing an example of a screen updated from the state shown in FIG. 15. [Figure 17] 10 is a diagram showing an example of a display mode when a change occurs in the list display from the state shown in FIG. 9. FIG. [Figure 18] FIG. 18 is a diagram showing an example of the state after the display in FIG. 17 is updated. [Figure 19] FIG. 16 is a diagram showing an example of a screen after updating from the state shown in FIG. 15. DETAILED DESCRIPTION OF THE INVENTION

[0033] An embodiment of a monitoring system will be described below with reference to the drawings. In the following description, the same parts and components are denoted by the same reference numerals. Their names and functions are also the same. Therefore, their description will not be repeated.

[0034] [1. Monitoring system configuration] FIG. 1 is a diagram showing a schematic diagram of an example of the configuration of a monitoring system. The monitoring system manages information on two or more patients or residents in a facility such as a hospital or a welfare facility for the elderly. In this specification, the monitoring system is described as a system for managing information on multiple residents (targets of monitoring) in a welfare facility for the elderly, as an example. Note that the facility to which the monitoring system is applied may be a hospital or other type of facility. The target of monitoring may also be changed to a patient in the hospital, for example.

[0035] The monitoring system includes sensor boxes 100A, 100B, etc. installed in each resident's room. The monitoring system also includes a management server 400 that manages the output from each of the sensor boxes 100A, 100B, etc. The management server 400 transfers the output from the sensor boxes 100A, 100B, etc. to two or more client terminals (client terminals 200A, 200B, etc.). Each of the two or more client terminals 200A, 200B, etc. displays the transferred output. In one example, the display is controlled using a web browser installed on each of the two or more client terminals 200A, 200B, etc. Each of the directors 820A, 820B, etc. views the display on each of the client terminals 200A, 200B, etc. and determines whether staff members should be dispatched to each room. The director may also determine which staff members to assign to which rooms.

[0036] The monitoring system includes mobile terminals 300A, 300B, etc. carried by staff members 850A, 850B, etc. When the director inputs information indicating that staff members need to rush to the room, each of the client terminals 200A, 200B, etc. transmits a notification to at least one of the mobile terminals 300A, 300B, etc.

[0037] Upon receiving the notification, each of the mobile terminals 300A, 300B, etc. displays the information contained in the notification. Each of the staff members 850A, 850B, etc. follows the display on the mobile terminal they carry with them to rush to the room or the like and take the necessary action.

[0038] In this specification, when referring to common characteristics among the sensor boxes 100A, 100B..., client terminals 200A, 200B..., mobile terminals 300A, 300B..., staff 850A, 850B..., directors 820A, 820B..., the terms "sensor box 100," "client terminal 200," "mobile terminal 300," "staff 850," and "director 820" are used.

[0039] [2. Acquiring information about the person being monitored] 2 is a diagram illustrating an example of the detection range of a sensor in a living room. In the example of FIG. 2, the sensor box 100 is installed on the ceiling CL of the living room 10.

[0040] 2, a range AR generally represents the detection range of a sensor in the sensor box 100. If the sensor is a Doppler sensor, the Doppler sensor detects activity occurring within the range AR. If the sensor is a camera, the camera captures images within the range AR.

[0041] In the example of FIG. 2, a bed 30 is installed in a room 10, and a sensor in a sensor box 100 generates an output according to the behavior of a resident 20. The resident 20 uses a care call handset 500. The operation contents to the care call handset 500 in each room 10 may be transmitted to the sensor box 100.

[0042] [3. Hardware configuration (equipment in the room)] 3 is a diagram showing an example of the hardware configuration of the equipment in each room 10. A sensor box 100, a care call handset 500, a door sensor 510, a toilet sensor 520, an odor sensor 530, and a vital sensor 540 are installed in each room.

[0043] The sensor box 100 includes a control device 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, a communication interface 104, a camera 105, a Doppler sensor 106, a wireless communication device 107, and a storage device 120.

[0044] The control device 101 controls the sensor box 100. The control device 101 is configured, for example, by at least one integrated circuit. The integrated circuit is configured, for example, by at least one central processing unit (CPU), at least one application specific integrated circuit (ASIC), at least one field programmable gate array (FPGA), or a combination thereof.

[0045] An antenna (not shown) or the like is connected to the communication interface 104. The sensor box 100 exchanges data with an external communication device via the antenna. An example of the external communication device is the management server 400.

[0046] In one implementation, the camera 105 is a near-infrared camera. The near-infrared camera includes an IR (Infrared) projector that projects near-infrared light. By using a near-infrared camera, an image showing the interior of the room 10 can be captured even at night. In another implementation, the camera 105 is a surveillance camera that receives only visible light. In still another implementation, a 3D sensor or a thermography camera may be used as the camera 105. The camera 105 may be configured integrally with the housing of the sensor box 100 or may be configured separately.

[0047] The Doppler sensor 106 is, for example, a microwave Doppler sensor that emits and receives radio waves to detect the behavior (movement) of objects in the room 10. This allows the biological information of the resident 20 in the room 10 to be detected. In one example, the Doppler sensor 106 emits microwaves in the 24 GHz band toward the bed 30 in each room 10 and receives the reflected waves reflected by the resident 20. The reflected waves are Doppler shifted due to the movement of the resident 20. The Doppler sensor 106 can detect the breathing condition and heart rate of the resident 20 from the reflected waves.

[0048] Wireless communication device 107 receives signals from care call handset 500, door sensor 510, toilet sensor 520, odor sensor 530, and vital sensor 540, and transmits the signals to control device 101. For example, care call handset 500 includes care call button 501, and when care call button 501 is operated, it transmits a signal indicating that operation has been performed to wireless communication device 107. Door sensor 510, toilet sensor 520, odor sensor 530, and vital sensor 540 each transmit their respective detection outputs to wireless communication device 107.

[0049] The storage device 120 is a storage medium such as a hard disk or an external storage device. The storage device 120 stores programs executed by the control device 101 and various data used to execute the programs. The various data may include behavioral information of the resident 20.

[0050] At least one of the above programs and data may be stored in a storage device other than the storage device 120 (for example, a storage area of ​​the control device 101 (for example, a cache memory), ROM 102, RAM 103, or an external device (for example, a management server 400)) as long as the storage device is accessible by the control device 101.

[0051] [4. Tenant behavior information] The above behavioral information will now be explained. The behavioral information is, for example, information indicating that the resident 20 has performed a predetermined behavior. In one example, the predetermined behavior includes four behaviors: "getting up" indicating that the resident 20 has woken up, "getting out of bed" indicating that the resident 20 has left the bedding, "falling down" indicating that the resident 20 has fallen down, and "falling over" indicating that the resident 20 has collapsed.

[0052] In one embodiment, the control device 101 generates behavioral information of the resident 20 associated with each room 10 based on images captured by a camera 105 installed in each room 10. For example, the control device 101 detects the head of the resident 20 from the image, and detects whether the resident 20 has "woke up," "got out of bed," "fallen," or "falled" based on changes over time in the size of the detected head of the resident 20. A specific example of generating behavioral information will be described in more detail below.

[0053] First, the storage device 120 stores the area in the room 10 where the bed 30 is located, a first threshold value Th1, a second threshold value Th2, and a third threshold value Th3. The first threshold value Th1 distinguishes the size of the resident's head between when the resident is lying down and when the resident is sitting up within the area where the bed 30 is located. The second threshold value Th2 distinguishes whether the resident is standing up or not based on the size of the resident's head within the room 10 excluding the area where the bed 30 is located. The third threshold value Th3 distinguishes whether the resident is lying down or not based on the size of the resident's head within the room RM excluding the area where the bed 30 is located.

[0054] The control device 101 extracts a moving object region from the target image as the region of the person of the resident 20, for example, by background subtraction or frame subtraction. The control device 101 further extracts the head region of the resident 20 from the extracted moving object region by, for example, a circular or elliptical Hough transform, by pattern matching using a pre-prepared head model, and by using a threshold derived by a neural network trained for head detection. The control device 101 detects "getting up," "getting out of bed," "falling," and "falling down" from the position and size of the extracted head.

[0055] The control device 101 may determine that the action "getting up" has occurred when it detects that the position of the head extracted as described above is within the location area of ​​the bed 30 and that the size of the head extracted as described above has changed from the size of a lying position to the size of a sitting position by using the first threshold value Th1.

[0056] The control device 101 may determine that the action "getting out of bed" has occurred when the position of the head extracted as described above moves from within the area where the bed 30 is located to outside the area where the bed 30 is located, and when it detects that the size of the head extracted as described above has changed from a certain size to the size of a standing position by using the second threshold value Th2.

[0057] The control device 101 may determine that the behavior of "falling" has occurred when the position of the head extracted as described above moves from within the area where the bed 30 is located to outside the area where the bed 30 is located, and when the size of the head extracted as described above changes over time from a certain size to the size of a recumbent position by using the third threshold value Th3.

[0058] The control device 101 may determine that the behavior of "falling" has occurred if it detects that the position of the head extracted as described above is located within the room 10 excluding the area where the bed 30 is located, and that the size of the extracted head has changed from a certain size to the size of a recumbent position by using a third threshold value Th3.

[0059] As described above, in one specific example, the control device 101 of the sensor box 100 generates behavioral information of the resident 20. Note that in the monitoring system, other elements may generate behavioral information of the resident 20 using images of the inside of the room 10.

[0060] [5. Hardware configuration (client terminal)] 4 is a diagram showing an example of the hardware configuration of the client terminal 200. The client terminal 200 includes a control device 201, a ROM 202, a RAM 203, a communication interface 204, a display interface 205, an operation interface 207, and a storage device 220.

[0061] The control device 201 controls the client terminal 200. The control device 201 is configured, for example, by at least one integrated circuit. The integrated circuit is configured, for example, by at least one CPU, at least one ASIC, at least one FPGA, or a combination thereof.

[0062] An antenna (not shown) and the like are connected to the communication interface 204. The client terminal 200 exchanges data with external communication devices via the antenna. The external communication devices include, for example, the sensor box 100.

[0063] The display interface 205 is connected to a display 206, and sends an image signal for displaying an image to the display 206 in accordance with a command from the control device 201 or the like.

[0064] The operation interface 207 is, for example, a USB (Universal Serial Bus) terminal, and is connected to the input device 209. The operation interface 207 receives a signal indicating a user operation from the input device 209. The input device 209 is, for example, a mouse, a keyboard, a touch panel, or any other device capable of receiving an input operation from the user.

[0065] The storage device 220 is, for example, a storage medium such as a hard disk or an external storage device. In one implementation example, the storage device 220 stores a program executed by the control device 201, but the program may be stored in another storage device accessible by the control device 201.

[0066] [6. Hardware Configuration (Mobile Device)] 5 is a diagram showing an example of the hardware configuration of the mobile terminal 300. The mobile terminal 300 includes a control device 301, a RAM 303, a communication interface 304, a display 305, an input device 306, and an internal memory 320.

[0067] The control device 301 controls the mobile terminal 300. The control device 301 is configured, for example, by at least one integrated circuit. The integrated circuit is configured, for example, by at least one CPU, at least one ASIC, at least one FPGA, or a combination thereof.

[0068] An antenna (not shown) and the like are connected to the communication interface 304. The mobile terminal 300 exchanges data with external communication devices via the antenna and an access point AP (FIG. 1). Examples of the external communication devices include the sensor box 100 and the client terminal 200.

[0069] The display 305 is, for example, an organic EL (Electro Luminescence) display. The input device 306 is realized by, for example, a touch sensor overlaid on the display 305. The touch sensor accepts various operations on the mobile terminal 300 by touch operation, and outputs the contents of the operation to the control device 301.

[0070] The built-in memory 320 is a storage medium such as an eMMC (Embedded MultiMediaCard). As an example, the built-in memory 320 stores a program executed by the control device 301, but the program may be stored in a storage device other than the built-in memory 320 as long as the storage device is accessible by the control device 301.

[0071] [7. Hardware Configuration (Management Server)] 6 is a diagram showing an example of the hardware configuration of the management server 400. The management server 400 includes a control device 401, a ROM 402, a RAM 403, a communication interface 404, and a storage device 420.

[0072] The control device 401 controls the management server 400. The control device 401 is configured, for example, by at least one integrated circuit. The integrated circuit is configured, for example, by at least one CPU, at least one ASIC, at least one FPGA, or a combination thereof.

[0073] An antenna (not shown) or the like is connected to the communication interface 404. The management server 400 exchanges data with external communication devices via the antenna. The external communication devices include, for example, the sensor box 100 and the client terminal 200.

[0074] The storage device 420 is, for example, a storage medium such as a hard disk or an external storage device. In one implementation example, the storage device 420 stores a program executed by the control device 401, but the program may be stored in another storage device accessible by the control device 401.

[0075] [8. Processing flow] FIG. 7 is a flowchart of an example of a process for displaying information about residents. In one embodiment, the display of information about each resident 20 is controlled according to the process of FIG. 7. The displayed information is based on the biological information and / or care calls of each resident 20. The biological information includes at least one of vital signs, behavioral information, and excretion information. The process of FIG. 7 is realized, for example, by the CPU of the control device 201 executing a given program. The program may be stored in the recording device 220 or in an external storage device accessible by the CPU of the control device 201.

[0076] 7, in step S10, control device 201 displays a list of information on each of a plurality of residents 20. FIG. 8 is a diagram showing an example of a list display of information on a plurality of residents 20.

[0077] In FIG. 8, the display 206 displays a list display screen 800. The list display screen 800 includes a matrix 810. Each square of the matrix 810 represents the status of each resident 20. 8, the matrix 810 includes a total of 100 squares arranged in 10 columns and 10 rows. In one example, each square is associated with a resident 20. The control device 201 displays each square in a color that corresponds to the status of the associated resident 20.

[0078] In one example, the status of resident 20 includes "normal," "wake up," "get out of bed," "fall," "drop," "abnormal vital signs," and "care call received." "Wake up," "get out of bed," "fall," and "drop" are generated as behavioral information. "Abnormal vital signs" indicates that the detection output of vital signs sensor 540 has indicated an abnormal value. "Care call received" indicates that care call handset 500 has been operated. Another status of resident 20 that is expected to be displayed is "excretion received." "Excretion received" indicates, for example, that the value detected by odor sensor 530 has indicated an abnormal value corresponding to excretion.

[0079] "Normal" indicates a state in which the above behavioral information or abnormal values ​​have not been detected. When the state is "normal," the square is displayed in white, and when the state is other than "normal," the square is displayed in a color other than white. A priority may be assigned to each of two or more states. The types of states to be displayed and the priority for each state may be predetermined or may be set as appropriate by a director or the like.

[0080] 7, in step S20, the control device 201 determines whether the status of any of the residents 20 to be displayed in the list has changed. If the control device 201 determines that the status of none of the residents 20 has changed (NO in step S20), the control proceeds to step S60, and if the control device 201 determines that the status of at least one resident 20 has changed (YES in step S20), the control proceeds to step S30.

[0081] In step S60, control device 201 determines whether or not an operation has been performed on a square in matrix 810. An "operation on a square" is, for example, a click operation or a touch operation on a square on display 206. If control device 201 determines that an operation on a square has been performed (YES in step S60), control proceeds to step S70; otherwise (NO in step S60), control proceeds to step S80.

[0082] In step S70, the control device 201 displays a pop-up window corresponding to the square that was the operation target in step S60. Fig. 9 is a diagram showing an example of the display mode of the pop-up window.

[0083] 9, a pop-up window 910 is displayed above the matrix 810. The pop-up window 910 displays detailed information about the resident 20 associated with the square that is the target of operation out of the 100 squares of the matrix 810.

[0084] The pop-up window 910 includes a field 911 and a field 912. The field 911 shows the number of the room 10 and the name of the resident 20. The field 912 shows the image of the camera 105 installed in the room 10.

[0085] The pop-up window 910 includes a button 914, a comment field 915, buttons 916 and 917, and a field 919. The button 914 is operated to stop the display from changing in accordance with the information from the sensor box 100 for a certain period of time. The control device 201 changes the color of the square corresponding to each resident in accordance with the behavioral information or vital signs abnormalities of each resident or care calls from each resident input from the sensor box 100. By operating the button 914, the control device 201 identifies the resident corresponding to the pop-up window 910 including the button 914, and stops using the input from the sensor box 100 corresponding to that resident to change the display on the display 206 for a certain period of time. During this time, the output of information from the sensor box 100 to the management server 400 and the client terminal 200 may be continued or stopped.

[0086] The behavioral information comment field 915 accepts input of comments. A button 916 is operated to notify the mobile terminal 300 of the information in the pop-up window 910. A button 917 is operated when it is determined that no action is required for the resident 20 corresponding to the pop-up window 910. A field 919 displays icons representing behavioral information generated for the resident and / or care calls from the resident. By checking the type of icon displayed in field 919, the director can easily understand why the squares for the resident are colored.

[0087] Column 918 represents resident information about resident 20 that has been stored in advance in management server 400 or the like. Resident information includes, for example, information regarding the need for care (can walk independently, needs assistance walking, etc.), information regarding care priority, or information regarding medication (take high blood pressure medication after breakfast, take cold medicine after each meal, etc.). The director can refer to the resident information to determine whether to notify staff and / or to determine the content of comments to enter.

[0088] 7, in step S80, control device 201 determines whether or not an operation has been performed on pop-up window 910. More specifically, after displaying pop-up window 910 in step S70, control device 201 returns control to step S20, and then in step S80 determines whether or not an operation has been performed on pop-up window 910 displayed in step S70.

[0089] If control device 201 determines that an operation has been performed on pop-up window 910 (YES in step S80), it proceeds to step S90, and if not (NO in step S80), it returns control to step S20.

[0090] In step S90, the control device 201 accepts a comment input to the comment field 915 of the pop-up window 910. An example of the content of the comment is instructions to staff. Another example is communication of information regarding the resident 20 who is the target of the notification.

[0091] In step S100, the control device 201 accepts designation of the mobile terminal 300 to be notified. For example, a staff member 850 who can assist the resident 20 uses the mobile terminal 300 carried by the staff member 850 to register information indicating that the staff member 850 is available to assist the client terminal 200. The control device 201 may display the IDs of the two or more registered mobile terminals 300, for example, as a pull-down menu, in the pop-up window 910. The director uses the pull-down menu to designate one or more mobile terminals 300 as notification destinations of the information in the pop-up window 910.

[0092] In step S110, the control device 201 notifies the mobile terminal 300 of (at least a part of) the information in the pop-up window 910. The control device 201 may perform the control of step S110 on the condition that an operation on the button 916 is accepted. In one implementation example, the notification includes information specifying the room shown in the pop-up window. The notification may also include the comment accepted in step S90.

[0093] In step S110, the notification is transmitted to the mobile terminal 300 specified in step S100. The specification of the mobile terminal 300 in step S100 may be omitted. In this case, the notification is transmitted to a predetermined mobile terminal 300.

[0094] In step S120, control device 201 erases from display 206 the display of pop-up window 910 that was the target of the operation in step S80. Thereafter, control returns to step S20. In one example, when control device 201 receives a click operation on square 811 in FIG. 8, it displays pop-up window 910 (FIG. 9), and when it receives an operation on button 916, it erases the display of pop-up window 910 from display 206. At the same time that the display of pop-up window 910 is erased, the coloring in square 811 (FIG. 8) may be removed.

[0095] Note that control device 201 may also erase the display of pop-up window 910 from display 206 in response to operation of button 917. That is, when button 917 is operated, the controls of steps S90 to S110 may be omitted, and pop-up window 910 may be erased in step S120.

[0096] Furthermore, control device 201 may also erase pop-up window 910 from display 206 after a given time has elapsed since the start of displaying pop-up window 910. In other words, if a given time has elapsed since the start of displaying pop-up window 910, the controls of steps S90 to S110 may be omitted, and pop-up window 910 may be erased in step S120.

[0097] In step S30, the control device 201 updates the list display (matrix 810). In one example, when the status of a certain resident 20 changes from "normal" to "wake up," the matrix 810 is updated so that the square corresponding to that resident 20 is colored.

[0098] FIG. 10 is a diagram illustrating an example of updating the list display. In the list display screen 1000 of FIG. 10, in addition to the square 811, squares 812 to 814 are colored in the matrix 810. The color of each square is determined according to the status of the resident to which the square corresponds. As shown in squares 813 and 814, the colored squares may include an icon representing the status corresponding to the color assigned to each square. For example, the square corresponding to the status "lit" may include an icon representing the status "lit."

[0099] 7, in step S40, control device 201 determines whether a pop-up window is displayed above the updated square. If control device 201 determines that a pop-up window is displayed above the updated square (YES in step S40), control proceeds to step S50; otherwise (NO in step S40), control proceeds to step S60.

[0100] When the list display changes from FIG. 8 to FIG. 10, no pop-up window is displayed above the updated cells (cells 812 to 814).

[0101] 9, the updated squares (squares 812 to 814) are covered by the pop-up window 910. In other words, the pop-up window 910 is displayed above the updated squares.

[0102] In step S50, the control device 201 updates the screen so that the information to be displayed in the updated grid is displayed on the display 206. Thereafter, control is returned to step S20.

[0103] FIG. 11 is a diagram showing an example of the screen after updating in step S60. The list display screen 1100 in FIG. 11 shows the screen after updating when the squares 812 to 814 are updated from the state shown in FIG. 9. The list display screen 1100 includes a column 1110. The column 1110 is a column for displaying the text. The string "3 items remaining: Room_102_Yamada_falls / Room_202_Yamamoto_wakes up_falls / Room_217_Yamanaka_wakes up" is displayed in the popup window 910. This represents the number of updated squares (squares 812 to 814) in the area allocated to the area. Each of the "n_wake up" boxes represents information about the resident corresponding to each of the squares 812 to 814.

[0104] In the example of FIG. 11 , the character string in the field 1110 is displayed in a position that does not overlap with the matrix 810 and the pop-up window 910. The matrix 810 is an example of a first area that displays information about each of multiple watched over targets. The pop-up window 910 is an example of a second area that displays additional information about the watched over target corresponding to the operated square in the matrix 810. The field 1110 is an example of a third area that displays information about the watched over target whose status has changed after the pop-up window 910 was displayed.

[0105] In one implementation, the second area displays more detailed information about the resident than the first area. In the example of FIG. 11, each square in the matrix 810 represents only the status of each resident by its color. In the matrix 810, the status of each resident may be represented by the display pattern of each square (on, blinking, off, etc.) rather than by color, or in combination with color. Meanwhile, the pop-up window 910 displays an image captured by the camera 105 in a field 912 as detailed information about the resident. Vital information about the resident (body temperature detected by the vital sensor 540, heart rate detected by the Doppler sensor 106, etc.) may also be displayed in a field 918 as detailed information about the resident.

[0106] By displaying column 1110 outside of matrix 810 and pop-up window 910, column 1110 can display information that should be displayed in matrix 810 for a resident whose status has changed since pop-up window 910 was displayed, regardless of whether pop-up window 910 is displayed. That is, if a portion of matrix 810 that should be changed due to a change in the resident's status is not visible due to the display of pop-up window 910, the change is displayed in column 1110.

[0107] The director can add additional information for the resident in column 1110 (for example, Yamada-san in Room_102). To view the relevant information, the user moves the pop-up window 910 to display the square corresponding to the resident in the matrix 810, and clicks on that square. This causes a new pop-up window for the resident to be displayed. When an instruction to send a notification to the mobile terminal 300 is received from the newly displayed pop-up window, the control device 201 sends a notification about the resident (for example, Yamada in Room_102) to the mobile terminal 300, The newly displayed pop-up window is then dismissed, and the display on the display 206 is updated as shown in FIG.

[0108] FIG. 12 is a diagram showing an example of a screen after updating the screen of FIG. 11. Compared to FIG. 11, the display of the column 1110 of the list display screen 1200 of FIG. 12 has been updated. The column 1110 of FIG. 12 displays the character string "2 items remaining: Room_202_Yamamoto_wakeup_fall / Room_217_Yamanaka_wakeup." That is, compared to FIG. 11, the number of remaining items in FIG. 12 is one less, and does not include information about Yamada in Room_102. This is based on the fact that a notification about Yamada in Room_102 has been sent to the mobile terminal 300, as described above. The control device 201 can update the display of the third area in response to the sending of the notification to the mobile terminal 300. Note that the display of the third area may also be updated in response to a "No Action Required" button (button 917 in FIG. 9) on the pop-up window. That is, if the "No action required" button is clicked in the pop-up window of the resident whose status has changed, the third area can be updated so that the information of that resident is deleted.

[0109] [9. Variation (1)] A first modified example of how to respond to a change in the list display after the pop-up window is displayed will be described with reference to Figures 13 and 14. Figure 13 is a diagram showing an example of a display mode when a change occurs in the list display from the state shown in Figure 9.

[0110] In this modification, the third area is displayed in a pop-up window. More specifically, when the display 206 is displaying the pop-up window 910 as shown in Fig. 9, the control device 201 changes the display color of the squares 812 to 814 covered by the pop-up window 910 in step S40, and then displays the list display screen 1300 in Fig. 13 in step S50.

[0111] Compared to the list display screen 1100 of Fig. 11, the list display screen 1300 includes a pop-up window 1310. The pop-up window 1310 includes a column 1311 below the buttons 916 and 917. In the example of Fig. 13, the control device 201 displays in column 1311 the information that was displayed in column 1110 in the example of Fig. 11. That is, when there is a change in the status of a resident corresponding to a square in the matrix 810 that is located in the part covered by the pop-up window 1310, the change in the status of that resident is displayed in column 1311.

[0112] In the example of FIG. 13, column 1311 is an example of the third area. Column 1311 is located within pop-up window 1310. Because pop-up window 1310 is displayed in accordance with the director's operation, it is highly likely that the director is paying attention to pop-up window 1310. By displaying column 1311 within an area (pop-up window 1310) that is highly likely to be the director's attention, the example of FIG. 13 allows the director to more reliably recognize changes in the squares located in the area covered by pop-up window 1310.

[0113] FIG. 14 is a diagram showing an example of a screen after updating the screen of FIG. 13. After displaying the screen of FIG. 13, the control device 201 displays the status of a resident (for example, Yamada in Room_102). When the notification is sent to the mobile terminal 300, the screen shown in FIG. 14 is displayed.

[0114] As explained with reference to Figures 11 and 12, the tenant (Yamada-san in Room_102) When a notification about the status is sent to the mobile terminal 300, the control device 201 deletes the information about the resident from the column 1311. Similarly, in the column 1311 of Fig. 14, the resident (Yamada of Room_102) has been deleted from the column 1311 of Fig. 13.

[0115] [10. Variation (2)] 15 and 16, a second modified example of how to respond to changes in the list display after the pop-up window is displayed will be described. Fig. 15 is a diagram showing an example of a list display screen. List display screen 1500 in Fig. 15 includes a pop-up window 1510.

[0116] In this variation, the pop-up window that is already displayed moves so as not to overlap the square in the list display that corresponds to the resident whose status has changed. More specifically, when the display color of the square covered by the pop-up window 1510 is changed in step S40 while the list display screen 1500 of Fig. 15 is being displayed, the control device 201 updates the display on the display 206 as shown in Fig. 16 in step S50.

[0117] FIG. 16 is a diagram showing an example of a screen updated from the state shown in FIG. 15. The list display screen 1600 in FIG. 16 includes a pop-up window 1510. In FIG. 16, Line frame 1601 represents the position of popup window 1510 in Figure 15. Arrow 1602 represents the direction of movement of the popup window.

[0118] 16, compared to FIG. 15, the matrix 810 displays the squares 815 and 816 in more color. Before the movement (FIG. 15), the square 816 was covered by the pop-up window 1510 (FIG. 15). As the pop-up window 1510 has moved in accordance with the arrow 1602, the square 816 is visible on the list display screen 1600 in FIG. 16.

[0119] Pop-up window 1510 is positioned so that it does not overlap not only square 816, but also squares 811 to 814 that were displayed before the display of pop-up window 1510. This more reliably prevents the display of a pop-up window for one resident from interfering with the display of the status of other residents on the list display screen.

[0120] [11. Variation (3)] A third modified example of how to respond to changes in the list display after the pop-up window is displayed will be described with reference to Figures 17 and 18. Figure 17 is a diagram showing an example of a display mode when a change occurs in the list display from the state shown in Figure 9.

[0121] In this modified example, as shown in Fig. 17, a matrix 810 in a list display screen 1700 is reduced to cause a pop-up display field 1720 to appear. A pop-up window 1721 is displayed in the pop-up display field 1720. More specifically, when the display 206 is displaying the pop-up window 910 as shown in Fig. 9, the control device 201 changes the display color of the squares covered by the pop-up window 910 (squares 812 to 814) in step S40, and then updates the display on the display 206 as shown in Fig. 17 in step S50.

[0122] A plurality of pop-up windows can be displayed in the pop-up display field 1720. Fig. 18 is a diagram showing an example of the state after the display in Fig. 17 has been updated.

[0123] When an operation is performed on any of the squares 811 to 817 in Fig. 17, the control device 201 displays a pop-up window 1821 corresponding to the operated square in the pop-up display field 1720, as shown in Fig. 18. This allows the director to simultaneously view multiple pop-up windows, and thereby determine which staff member should be assigned to which resident while simultaneously viewing the detailed status of multiple residents.

[0124] In this variation, the pop-up windows are displayed outside the matrix 810. This allows the director to concentrate on checking the resident information displayed in each pop-up window without confusing it with the information of other residents.

[0125] [12. Variation (4)] 15, 17, and 19, a fourth variation of how the list display changes after the pop-up window is displayed will be described. In this variation, the pop-up window is displayed within the list display screen as long as it can be displayed without overlapping with the colored squares on the list display screen. Thereafter, when it can no longer be displayed without overlapping with the colored squares on the list display screen, the matrix within the list display screen is reduced and the pop-up window is displayed in the pop-up display field.

[0126] More specifically, when the squares 811 to 814 are colored on the list display screen, the control device 201 displays a pop-up window as shown in FIG. 15 in step S50. Pop-up window 1510 is displayed on list display screen 1500 so that at least a portion of pop-up window 1510 overlaps with matrix 810. In this state, pop-up window 1510 does not overlap any of the colored squares 811 to 814. Therefore, control returns from step S40 to step S20 without proceeding to step S50.

[0127] Thereafter, when the number of colored squares on the list display screen increases, the control device 201 reduces the matrix 810 on the list display screen as shown in FIG. 17 in step S50, and displays a pop-up window 1721 in the pop-up display field 1720.

[0128] Even if the number of colored squares on the list display screen does not increase, the control device 201 may set a pop-up display column when the number of displayed pop-up windows increases. Fig. 19 is a diagram showing an example of a screen after updating from the state shown in Fig. 15. In Fig. 19, squares 811 to 814 are colored on the list display screen 1710, and two pop-up windows 1721 and 1821 are displayed in the pop-up display column 1720.

[0129] When an operation is performed on any of the squares in the state of Fig. 15, the control device 201 updates the display on the display 206 as shown in Fig. 19. More specifically, if the control device 201 determines in step S50 that it is not possible to add a pop-up window to the list display screen 1500 of Fig. 15 so that it does not overlap any of the squares 811 to 814, it displays two pop-up windows in the pop-up display column as shown in Fig. 19.

[0130] In this modification, reduction of the matrix 810 can be avoided as much as possible. On the other hand, if necessary, the matrix 810 is reduced in size so that one or more pop-up windows are displayed so as not to overlap with the colored squares in the matrix 810.

[0131] When it is no longer necessary to display the pop-up window display field 1720, the control device 201 may erase the display of the pop-up window display field 1720 from the display 206. For example, when there are no more pop-up windows to be displayed in the pop-up window display field 1720 due to erasure of the pop-up windows (step S120), it is no longer necessary to display the pop-up window display field 1720.

[0132] Control device 201 may enlarge the display of matrix 810 in conjunction with the elimination of pop-up window display field 1720. For example, on display 206, when the number of pop-up windows increases, matrix 810 may be reduced as shown in Fig. 17 etc., and when the number of pop-up windows decreases, matrix 810 may be enlarged as shown in Fig. 8 etc. In other words, control device 201 may enlarge matrix 810 in conjunction with the elimination of pop-up windows.

[0133] [13. Other features of the monitoring system] The configuration of the monitoring system shown in Fig. 1 is not limited, and it is expected that modifications will be made as appropriate. For example, each of the sensor boxes 100A, 100B, etc. may output data directly to each of the client terminals 200A, 200B, etc., without going through the management server 400. The number of client terminals may be one.

[0134] In the monitoring system, various "programs" may be provided not as standalone programs but as part of any other program. Various "programs" may be realized by a plurality of programs working together. In one example, the control device 101 of the sensor box 100 executes a first program to implement the present invention. When realizing a function described herein, the first program may use some modules of the second program. Even if the first program does not include some modules for realizing the function, it does not deviate from the purpose of being a program for realizing the function if it mainly contributes to realizing the function. Furthermore, some or all of the functions described herein may be realized by dedicated hardware. Furthermore, a device providing the functions described herein may provide some or all of its functions from an external device as a so-called cloud service.

[0135] The embodiments disclosed herein should be considered to be illustrative in all respects and not restrictive. The scope of the present invention is defined by the claims, not by the above description, and is intended to include all modifications within the meaning and scope of the claims. Furthermore, the inventions described in the embodiments and each modification are intended to be practiced, as far as possible, either alone or in combination. [Explanation of symbols]

[0136] 10 Room, 20 Resident, 30 Bed, 100, 100A, 100B Sensor Box, 101, 201, 301, 401 Control Device, 200, 200A, 200B Client Terminal, 300, 300A, 300B Mobile Terminal, 400 Management Server, 500 Care Call Handset, 501 Care Call Button, 800, 900, 1000, 1100, 1200, 1300, 1500, 1600, 1710 List Display Screen, 810 Matrix, 811, 812, 814, 815, 816, 817 Grid, 820, 820A, 820B Director, 850, 850A, 850B Staff, 910, 1310, 1510, 1721, 1821 Pop-up window, 911,912,918,919,1110,1311 column, 914,916,917 button, 915 comment column, 1601 frame, 1602 arrow, 1720 pop-up display column.

Claims

1. A method for displaying information on a plurality of monitoring targets, comprising: Displaying a first area on a display, the first area including information on each of a plurality of monitoring targets; displaying a second area including additional information about a first watching target among the plurality of watching targets on the display so as to overlap at least a portion of the first area; When a state of at least some of the plurality of watching targets changes, updating the display on the display so that the change is recognized; A method characterized in that a step of updating the display recognizes a change in the state of a monitored object corresponding to at least the portion of the first area.

2. The method of claim 1 , wherein the step of updating the display includes displaying a third area on the display representing information about a monitored subject whose status has changed among the plurality of monitored subjects.

3. The method of claim 2 , wherein the third region is located outside the first region and the second region.

4. The method of claim 2 , wherein the third region is located within the second region.

5. 5. The method of claim 1, wherein the step of updating the display includes moving the second region so that it does not overlap the portion of the first region that has been modified in response to the change.

6. The method of claim 5, wherein the step of updating the display includes moving the second area so that it does not overlap the portion of the first area corresponding to the monitored object whose state had changed before the second area was displayed.

7. The method according to any one of claims 1 to 6, wherein the step of updating the display includes reducing the first area.

8. the step of displaying the second region includes displaying the second region so that at least a portion of the first region and the second region overlap; The method of claim 7, wherein the step of updating the display includes reducing the first area when the second area cannot be displayed in a portion of the first area other than a portion corresponding to a monitored target whose state has changed before and after the second area is displayed.

9. The method according to any one of claims 1 to 8, wherein the step of displaying the second area comprises displaying the second area outside the first area.

10. The method according to any one of claims 1 to 9, further comprising the step of transmitting at least a portion of the additional information in the second region to a mobile terminal.

11. The method further includes a step of accepting an input of a comment for the second area, The method of claim 10 , wherein transmitting at least a portion of the additional information in the second area to a mobile device includes transmitting the comment to the mobile device.

12. The method according to claim 10 or 11, further comprising the step of accepting input of information specifying a mobile terminal as a destination of the additional information.

13. removing the second region from the display; The method of any one of claims 1 to 12, wherein the step of removing the display of the second region involves enlarging the first region.

14. 14. The method of claim 13, wherein the step of removing the display of the second region from the display is performed on at least one of the conditions that at least a portion of the additional information in the second region has been transmitted to the mobile terminal and that a given time has elapsed since the display of the second region began.

15. The method according to any one of claims 1 to 14, wherein the second area displays more detailed information about the object of monitoring than the first area.

16. The method according to any one of claims 1 to 15, wherein the additional information comprises a camera image of the monitored subject.

17. The method according to any one of claims 1 to 16, wherein the change in state includes a change to getting up or getting out of bed.

18. A method according to any one of claims 1 to 17, wherein information based on the biometric information of each of the plurality of monitored subjects is displayed in the first area.

19. A method according to any one of claims 1 to 18, wherein a plurality of squares are arranged in a matrix in the first area, and information about the object being monitored is displayed in each of the plurality of squares.

20. The method according to any one of claims 1 to 19, wherein in the first area, the color of the area corresponding to the target of monitoring changes according to a change in the state of the target of monitoring.

21. the second area is a pop-up window; The method according to any one of claims 1 to 20, wherein the step of updating the display includes displaying a pop-up window separate from the pop-up window.

22. The method of claim 21 , wherein the other pop-up window includes information about the watched target whose state has changed.

23. The method of claim 22 , wherein the other pop-up window includes a captured image of the watched target whose state has changed.

24. A program that, when executed by one or more processors, causes the one or more processors to perform the method according to any one of claims 1 to 23.

25. a memory storing the program according to claim 24; and one or more processors that execute programs stored in the memory.

Images