Activity Recording Device

Abstract

Provided is an action record display device comprising a display control unit which displays a time axis in the form of an arc or circle on a display screen, acquires each icon corresponding to each of a plurality of action events extracted from an action record, the icon being acquired from a plurality of types of icon each associated with each of a plurality of types of action event defined in advance, and controls each acquired icon to be displayed at a position on the arc or the circle corresponding to a time zone in which the corresponding action event occurred.

Description

Technical Field

[0001] This specification discloses an action record display device.

Background Art

[0002] Conventionally, there is known a device that monitors the actions of a user and displays the action record on a display screen. For example, Patent Document 1 discloses a device that monitors a person's daily living activities (ADL) and displays a graphic element having a circle including a symbol and a description of the ADL, and an expression of the occurrence timing and duration of an event.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In an action record display device that displays an action record, when a plurality of action events occur, if only the information corresponding to one action event is displayed on one time axis, the user has to check a plurality of time axes later when grasping the action record, making it difficult to grasp the action record.

[0005] The main object of the present disclosure is to make it easier for the user to grasp the action record.

Means for Solving the Problems

[0006] The present disclosure has taken the following means to achieve the above main object.

[0007] The action record display device of the present disclosure is an action record display device that acquires the action record of a user and displays it on a display screen, The gist of the system is to include a display control unit that displays an arc or circle time axis on the display screen, acquires icons corresponding to multiple action events extracted from the action record from a plurality of icons each associated with a predetermined plurality of action events, and controls the display of each acquired icon at the position of the arc or circle corresponding to the time period in which the respective action event occurred.

[0008] The behavioral record display device described in this disclosure displays an arc or circle time axis on the display screen, and displays icons corresponding to multiple behavioral events extracted from the user's behavioral record at the positions of the arc or circle corresponding to the time period in which the behavioral event occurred. As a result, multiple icons corresponding to each behavioral event are displayed on a single time axis, making it easy for the user to check the type of behavioral event that occurred and the time period in which the behavioral event occurred, thus making it easier to understand the behavioral record. [Brief explanation of the drawing]

[0009] [Figure 1] This is a schematic diagram of the behavioral monitoring system. [Figure 2] This is an explanatory diagram showing an example of sensors installed in each room of a residence. [Figure 3] This flowchart shows an example of data measurement processing. [Figure 4] This flowchart shows an example of the measurement data registration process. [Figure 5] This flowchart shows an example of the activity log display process. [Figure 6] This is an explanatory diagram showing an example of an activity log display screen. [Figure 7] This is an explanatory diagram showing an example of an icon. [Figure 8] This is an explanatory diagram showing how the activity record display changes when you swipe clockwise. [Figure 9] This is an explanatory diagram showing how the activity record display changes when you swipe counterclockwise. [Figure 10]This is an explanatory diagram showing how the activity log display changes when you swipe left. [Figure 11] This is an explanatory diagram showing how the activity log display changes when you swipe right. [Figure 12] This is an explanatory diagram showing how the activity log display changes when using a pinch-in gesture. [Figure 13] This is an explanatory diagram showing how the action record display changes when using a pinch-out gesture. [Modes for carrying out the invention]

[0010] Next, the forms for implementing this disclosure will be described with reference to the drawings.

[0011] Figure 1 is a schematic diagram of the behavior monitoring system 10. As shown in Figure 1, the behavior monitoring system 10 comprises a management server 20 that manages the entire system, monitoring devices 30 installed in each of the residences A to C where the monitored person lives to monitor the monitored person, and a portable terminal 50 that can be carried by the monitored person or their manager and displays a record of the monitored person's behavior. Residences A to C are, for example, residences for elderly people or people requiring care to live alone, and for example, as shown in Figure 2, they have an L (living room), D (dining room), K (kitchen), bedroom, washroom, bathroom, toilet, and entrance. The behavior monitoring system 10 can be used, for example, to monitor the behavior of elderly people or people requiring care on behalf of their caregivers and to detect abnormal behavior at an early stage.

[0012] The monitoring device 30 comprises a control unit 31, a communication unit 32, an operation display unit 33, a speaker (not shown), and sensors 40. The control unit 31 is configured as a microprocessor centered on a CPU, and in addition to the CPU, it includes ROM, RAM, etc. The operation display unit 33 and the speaker output various information from the management server 20 via display and sound. The operation display unit 33 is configured as a touch panel display that allows operation input by the operator.

[0013] The sensors 40 are sensors for detecting what the monitored person living in the dwelling is doing and where they are. As shown in FIG. 2, they include motion sensors 41, 42, 43, 44, 45, 46 installed in each room, a sleep sensor 47 installed in the bedroom, a toilet faucet sensor 48 installed in the toilet room, and a door sensor 49 installed in the entrance door.

[0014] The motion sensors 41 to 46 are sensors that detect people in the detection area non - contactly, and are configured as, for example, infrared sensors that sense infrared rays and convert them into electrical signals. The motion sensors 41, 42, 43 are installed in the living, dining, and kitchen areas of the LDK room respectively. Also, the motion sensor 44 is installed in the bedroom, the motion sensor 45 is installed in the bathroom, and further, the motion sensor 46 is installed in the toilet room.

[0015] The sleep sensor 47 is, for example, a sheet - type biological sensor installed under the bed mattress in the bedroom, and acquires biological information such as the pulse and respiration of the person sleeping in the bed. The toilet faucet sensor 48 detects the operation of the cleaning lever or cleaning switch for instructing toilet flushing, and in this embodiment, can detect the large - scale cleaning operation and the small - scale cleaning operation separately. The door sensor 49 detects the opening and closing of the entrance door, and is configured as, for example, a magnet - type opening and closing sensor having a permanent magnet fixed to the door side and a magnetic sensor fixed to the frame side.

[0016] The portable terminal 50 is a portable communication terminal such as a smartphone or a tablet, and as shown in FIG. 1, includes a control unit 51, a communication unit 52, an operation display unit 53, and a storage unit 54. The control unit 51 is configured as a microprocessor centered on a CPU, and includes a ROM, a RAM, etc. in addition to the CPU. The operation display unit 53 is configured as a touch - panel type display that allows touch operations by the operator. In the storage unit 54, various application programs (processing programs), data files, identification information (identification ID) for identifying the portable terminal 50, etc. are stored.

[0017] The management server 20 comprises a processing unit 21, a communication unit 22, and a storage unit 23. The processing unit 21 is configured as a microprocessor centered on a CPU, and in addition to the CPU, it is equipped with ROM, RAM, etc. The communication unit 22 of the management server 20 is connected to the communication units 32 of each monitoring device 30 and the communication unit 52 of the mobile terminal 50 via the network 11, and they exchange data and signals with each other. The storage unit 23 is composed of a hard disk drive (HDD) or solid state drive (SSD), etc., and receives data measured by each monitoring device 30 and stores it for a certain period of time.

[0018] Next, we will explain the operation of the behavioral monitoring system configured in this way. Specifically, we will explain the operation of the monitoring device 30, the management server 20, and the mobile terminal 50.

[0019] The data measurement process involves measuring (collecting) the location of the monitored person from sensors installed in each room of the residence. Figure 3 is a flowchart showing an example of the data measurement process performed by the control unit 31 of each monitoring device 30. This process is repeated at predetermined intervals.

[0020] When the data measurement process is executed, the control unit 31 of the monitoring device 30 first determines whether or not there is a response from the living room motion sensor 41 installed in the living room (step S100). If the control unit 31 determines that there is a response from the living room motion sensor 41, it determines that the person being monitored is in the living room (step S102), and sends the determination result as measurement data to the management server 20 (step S136), and terminates the data measurement process.

[0021] If the control unit 31 determines in step S100 that there is no response from the living room motion sensor 41, it then determines whether or not there is a response from the dining room motion sensor 42 installed in the dining room (step S104). If the control unit 31 determines that there is a response from the dining room motion sensor 41, it determines that the person being monitored is in the dining room (step S106), and sends the determination result as measurement data to the management server 20 (step S136), and ends the data measurement process.

[0022] If the control unit 31 determines in step S104 that there is no response from the motion sensor 42 for the dining area, it then determines whether or not there is a response from the motion sensor 43 installed in the kitchen (step S108). If the control unit 31 determines that there is a response from the motion sensor 43 for the kitchen, it determines that the person being monitored is in the kitchen (step S110), and sends the determination result as measurement data to the management server 20 (step S136), and ends the data measurement process.

[0023] If the control unit 31 determines in step S108 that there is no reaction from the motion sensor 43 for the kitchen, it then determines whether or not there is a reaction from the motion sensor 44 installed in the bedroom (step S112). If the control unit 31 determines that there is a reaction from the motion sensor 44 for the bedroom, it determines that the person being monitored is in the bedroom (step S114). Then, the control unit 31 acquires the detection signal from the sleep sensor 47 (step S116), and sends the determination result and the detection signal from the sleep sensor 47 as measurement data to the management server 20 (step S136), thereby ending the data measurement process.

[0024] If the control unit 31 determines in step S112 that there is no response from the motion sensor 44 for the bedroom, it then determines whether or not there is a response from the motion sensor 45 installed in the bathroom (step S118). If the control unit 31 determines that there is a response from the motion sensor 45 for the bathroom, it determines that the person being monitored is in the bathroom (step S120), and sends the determination result as measurement data to the management server 20 (step S136), and terminates the data measurement process.

[0025] If the control unit 31 determines in step S118 that there is no response from the motion sensor 45 for the bathroom, it then determines whether or not there is a response from the motion sensor 46 installed in the toilet room (step S122). If the control unit 31 determines that there is a response from the motion sensor 46 for the toilet room, it determines that the person being monitored is in the toilet room (step S124). Then, the control unit 31 acquires the detection signal from the toilet faucet sensor 48 (step S126), and sends the determination result and the detection signal from the toilet faucet sensor 48 as measurement data to the management server 20 (step S136), and ends the data measurement process.

[0026] If the control unit 31 determines in step S122 that there is no response from the motion sensor 46 for the toilet room, it then determines whether or not there is a response from the door sensor 49 installed on the front door (step S128). If the control unit 31 determines that there is a response from the door sensor 49, it determines in step S134, described later, whether or not the monitored person is at home (step S130). If the control unit 31 determines that the monitored person is at home, it determines that the monitored person has gone out (step S132), sends the determination result as measurement data to the management server 20 (step S136), and terminates the data measurement process. On the other hand, if the control unit 31 determines that the monitored person is not at home (determined to be out), it determines that the monitored person has returned home, i.e., is at home (step S134), sends the determination result as measurement data to the management server 20 (step S136), and terminates the data measurement process.

[0027] Next, the operation of the management server 20 will be described. Figure 4 is a flowchart showing an example of the measurement data reception process performed by the processing unit 21 of the management server 20. This process is repeated at predetermined intervals.

[0028] When the measurement data reception process is executed, the processing unit 21 of the management server 20 first determines whether or not it has received measurement data from the monitoring device 30 (step S200). If the processing unit 21 determines in step S200 that it has not received measurement data, it proceeds to step S206. On the other hand, if the processing unit 21 determines that it has received measurement data, it accesses a time server via the internet to obtain the current year, month, day, time (hours / minutes / seconds), and day of the week as time information (step S202), stores the obtained time information in the storage unit 23 in association with the measurement data (step S204), and proceeds to step S206. Note that the acquisition of time information may also be performed by reading the current time from the RTC (real-time clock).

[0029] Next, the processing unit 21 determines whether or not a certain period of measurement data (for example, one day's worth) has been stored in the storage unit 23 (step S206). If the processing unit 21 determines that a certain period of measurement data has not been stored, it proceeds to step S212. On the other hand, if the processing unit 21 determines that a certain period of measurement data has been stored, it extracts predetermined behavioral events from the measurement data for that period (step S208) and registers the extracted behavioral events in the storage unit 23 along with their occurrence time (step S210). In this embodiment, behavioral events include waking up, going to bed, eating, urination, defecation, bathing, etc. For example, waking up can be determined based on the detection of a change from a sleep state to a wakeful state by the sleep sensor 47 while the person is in the bedroom. Going to bed can be determined based on the detection of a change from a wakeful state to a sleep state by the sleep sensor 47 while the person is in the bedroom. Eating can be determined based on the determination of movement from the kitchen to the dining room, followed by the determination of staying in the dining room for a certain period of time or longer. Urinary excretion can be determined based on the detection of a small flush operation by the toilet faucet sensor 48 while the toilet room is occupied. Defecation can be determined based on the detection of a large flush operation by the toilet faucet sensor 48 while the toilet room is occupied. Bathing can be determined based on the detection of a stay in the bathroom for a certain period of time or longer.

[0030] Next, the processing unit 21 determines whether or not there has been a request to send an action record from the mobile terminal 50 (step S212). If the processing unit 21 determines that there has been no request to send an action record, it terminates the measurement data registration process. On the other hand, if the processing unit 21 determines that there has been a request to send an action record, it sends the action events stored in the storage unit 23 and their respective occurrence times as an action record to the mobile terminal 50 that made the request (step S214), and terminates the measurement data registration process.

[0031] Next, we will describe the operation of the mobile terminal 50 upon receiving an action event. Figure 5 is a flowchart showing an example of the action record display process executed by the control unit 51 of the mobile terminal 50. This process is executed when a dedicated application installed in the storage unit 54 of the mobile terminal 50 is launched.

[0032] When the activity record display process is executed, the control unit 51 of the mobile terminal 50 first sends an activity record transmission request to the management server 20 (step S300) and waits for the activity record to be received from the management server 20 (step S302). When the control unit 51 receives the activity record, it performs an activity record display, which displays the activity record on the screen of the operation display unit 53 (step S304). Figure 6 is an explanatory diagram showing an example of the activity record display screen. Figure 7 is an explanatory diagram showing an example of icons. As shown in the figures, the activity record display screen displays the user name, the date of the activity record to be displayed, a time axis T with an arc with time scales corresponding to the target time period (time division), and multiple icons I placed on the time axis T. Multiple types of icons I are available. Each icon I is associated with a type of activity event, such as waking up, going to bed, eating, urination, defecation, and bathing, as shown in Figure 7. The activity log display is performed by extracting activity events that occurred during the target time period on the target date and time from the activity log received from the management server 20, selecting an icon I corresponding to the extracted activity event, and displaying (placing) the selected icon I at the position on the time scale corresponding to the time the activity event occurred. This makes it possible for users to easily grasp the activity log of the monitored person during the target time period on the target date and time via the activity log display screen, even on the limited screen size of the mobile terminal 50.

[0033] Next, the control unit 51 determines whether or not an arc swipe operation has been performed on the activity record display screen (step S306). An arc swipe operation is an operation in which the finger touching the screen of the operation display unit 53 is moved in an arc shape along the arc of the time axis while keeping the finger in contact with the screen. There are two types of swipes: a clockwise swipe operation, where the finger is moved clockwise, and a counterclockwise swipe operation, where the finger is moved counterclockwise. If the control unit 51 determines that no arc swipe operation has been performed, it proceeds to step S314. On the other hand, if the control unit 51 determines that an arc swipe operation has been performed, it determines whether or not the arc swipe operation is a clockwise swipe operation (step S308). If the control unit 51 determines that the arc swipe operation is a clockwise swipe operation, it shifts the target time period (time division) in the forward direction (step S310) and proceeds to step S314. Figure 8 is an explanatory diagram showing how the activity record display changes due to a clockwise swipe operation. As shown in the diagram, when a clockwise swipe operation is performed, the time scale on the time axis shifts forward by a fixed amount of time each time the operation is performed. The icon is then displayed (repositioned) at a position corresponding to the time the action event occurred on the time scale of the time axis that has shifted forward. On the other hand, if the control unit 51 determines that the arc swipe operation is a counterclockwise swipe operation and not a clockwise swipe operation, it shifts the target time period (time division) backward (step S312). Figure 9 is an explanatory diagram showing how the action record display changes due to a counterclockwise swipe operation. As shown in the diagram, when a counterclockwise swipe operation is performed, the time scale on the time axis shifts backward by a fixed amount of time each time the operation is performed. The icon is then displayed (repositioned) at a position corresponding to the time the action event occurred on the time scale of the time axis that has shifted backward.

[0034] Next, the control unit 51 determines whether or not a left or right swipe operation has been performed (step S314). A left or right swipe operation is an operation in which the finger touching the screen of the operation display unit 53 is moved in a straight line to the left or right while keeping the finger in contact with the screen. There are left swipes, where the finger is moved to the left, and right swipes, where the finger is moved to the right. If the control unit 51 determines that no left or right swipe operation has been performed, it proceeds to step S322. On the other hand, if the control unit 51 determines that a left or right swipe operation has been performed, it determines whether or not it is a left swipe operation (step S316). If the control unit 51 determines that the left or right swipe operation is a left swipe operation, it shifts the target date and time of the target time period to the previous day (step S318) and proceeds to step S322. Figure 10 is an explanatory diagram showing how the activity record display changes due to a left swipe operation. As shown in the figure, when a left swipe operation is performed, the target date and time shifts to the previous day while the target time period (time scale on the time axis) is maintained each time the operation is performed. The icon is then changed to one that corresponds to the action event that occurred during the time period of the target date and time that was shifted to the previous day. Meanwhile, if the control unit 51 determines that a left or right swipe operation is a right swipe operation and not a left swipe operation, it shifts the target date and time of the target time period to the next day (step S320). Figure 11 is an explanatory diagram showing how the action record display changes due to a right swipe operation. As shown in the figure, each time a right swipe operation is performed, the target date and time shifts to the next day while the target time period (time scale on the time axis) is maintained. The icon is then changed to one that corresponds to the action event that occurred during the time period of the target date and time that was shifted to the next day.

[0035] Next, the control unit 51 determines whether or not a pinch operation has been performed (step S322). A pinch operation is an operation in which two fingers are touched to the screen of the operation display unit 53 and then spread or narrowed while the two fingers are still touching the screen. There are two types of pinch operations: pinch-in, where two fingers are brought together, and pinch-out, where two fingers are spread apart. If the control unit 51 determines that no pinch operation has been performed, it proceeds to step S330. On the other hand, if the control unit 51 determines that a pinch operation has been performed, it determines whether or not the pinch operation is a pinch-in operation (step S324). If the control unit 51 determines that it is a pinch-in operation, it reduces the width of the time scale on the time axis (time scale) (step S326) and proceeds to step S330. Figure 12 is an explanatory diagram showing how the activity record display changes due to a pinch-in operation. As shown in the figure, when a pinch-in operation is performed, the width of the time scale on the time axis is reduced, and the target time period is reduced. The icons are then changed to those corresponding to the activity events that occurred in the reduced target time period. On the other hand, if the control unit 51 determines that the pinch operation is a pinch-out operation and not a pinch-in operation, it expands the width of the time scale on the time axis (time scale) (step S328). Figure 13 is an explanatory diagram showing how the action record display changes due to a pinch-out operation. As shown in the figure, when a pinch-out operation is performed, the width of the time scale on the time axis expands, and the target time period expands. The icons are then changed to those corresponding to the action events that occurred in the expanded target time period.

[0036] The control unit 51 then determines whether or not a termination operation has been performed to end the display. If the control unit 51 determines that a termination operation has not been performed, it returns to step S306 and repeats the process. If it determines that a termination operation has been performed, it terminates the activity record display process.

[0037] Here, the correspondence between the main elements of the embodiment and the main elements of the present disclosure as described in the claims will be explained. Specifically, the mobile terminal 50 of this embodiment is an example of the activity record display device of the present disclosure, and the control unit 51 that performs activity record display processing is an example of a display control unit.

[0038] It goes without saying that this disclosure is not limited in any way to the embodiments described above, and can be implemented in various forms as long as they fall within the technical scope of this disclosure.

[0039] For example, in the embodiment described above, the control unit 51 displays a time axis of an arc on the action record display screen of the operation display unit 53, but it may also display a time axis of a circle.

[0040] Furthermore, in the embodiment described above, an example was shown in which the control unit 51 shifts the target time period forward when it determines that the arc swipe operation is a clockwise swipe operation, and shifts the target time period backward when it determines that the arc swipe operation is a counterclockwise swipe operation. However, for example, the control unit 51 may shift the target time period forward when it determines that the arc swipe operation is a counterclockwise swipe operation, and shift the target time period backward when it determines that the arc swipe operation is a clockwise swipe operation.

[0041] Furthermore, in the embodiment described above, an example was shown in which, if the control unit 51 determines that a left or right swipe operation is a left swipe operation, it shifts the target date and time of the target time period to the previous day, and if it determines that a left or right swipe operation is a right swipe operation, it shifts the target date and time of the target time period to the next day. However, for example, if the control unit 51 determines that a left or right swipe operation is a right swipe operation, it may shift the target date and time of the target time period to the previous day, and if it determines that a left or right swipe operation is a left swipe operation, it may shift the target date and time of the target time period to the next day.

[0042] Furthermore, in the embodiment described above, the management server 20 transmits the monitored person's activity record to the mobile terminal 50, and the mobile terminal 50 displays the activity record on the operation display unit 53 by performing an activity record display process based on the received activity record. However, the management server 20 may also transmit the activity record to the monitoring device 30, and the monitoring device 30 may display the activity record on the operation display unit 33 by performing the same process as the activity record display process described above based on the received activity record.

[0043] As described above, the behavioral record display device of this disclosure displays an arc or circle time axis on the display screen, and displays icons corresponding to multiple behavioral events extracted from the user's behavioral record at the position of the arc or circle corresponding to the time period in which the behavioral event occurred. As a result, multiple icons corresponding to each behavioral event are displayed on a single time axis, making it easy for the user to check the type of behavioral event that occurred and the time period in which the behavioral event occurred, thus making it easier to understand the behavioral record.

[0044] In the behavioral record display device of this disclosure, the display screen is a touch panel type screen, and the display control unit may, by default, display the time axis in predetermined time divisions, and when a swipe operation is performed on the display screen along the arc or circle of the time axis, the time divisions may be controlled to shift forward or backward. In this way, the time divisions of the time axis on which the behavioral record is displayed can be changed by intuitive operation.

[0045] Furthermore, in the behavioral record display device of this disclosure, the display screen is a touch panel type screen, and the display control unit may control the time scale of the time axis to widen or narrow when a pinch operation is performed on the display screen. In this way, the time scale of the time axis displaying the behavioral record can be changed by intuitive operation.

[0046] Furthermore, the behavioral record display device of this disclosure may be installed in a portable mobile device. Because mobile devices have limited screen size, the significance of applying the behavioral record display device of this disclosure becomes even greater.

[0047] This disclosure is not limited to the form of an activity record display device, but can also be in the form of an activity record display method.

[0048] Furthermore, this specification also discloses a technical concept in which "the behavioral record display device described in claim 1" has been changed to "the behavioral record display device described in claim 1 or 2" in claim 3 as of the time of filing. [Industrial applicability]

[0049] This disclosure is applicable to the manufacturing industry of behavioral recording devices. [Explanation of Symbols]

[0050] 10 Behavior monitoring system, 11 Network, 20 Management server, 21 Processing unit, 22 Communication unit, 23 Memory unit, 30 Monitoring device, 31 Control unit, 32 Communication unit, 33 Operation display unit, 40 Sensors, 41, 42, 43, 44, 45, 46 Human presence sensor, 47 Sleep sensor, 48 Toilet faucet sensor, 49 Door sensor, 50 Mobile terminal, 51 Control unit, 52 Communication unit, 53 Operation display unit, 54 Memory unit.

Claims

1. A user activity record display device that acquires user activity records and displays them on a screen, The display screen includes a display control unit that displays an arc-shaped time axis, acquires icons corresponding to multiple action events extracted from the action record from a plurality of icons each associated with a predetermined plurality of action events, and controls the display of each acquired icon at the position of the arc corresponding to the time period in which the respective action event occurred. The aforementioned multiple types of icons have the same external shape, and if a portion of the positions where multiple icons corresponding to multiple adjacent action events should be displayed overlap, the action record display device displays a portion of the multiple icons by overlapping them.

2. An action record display device according to claim 1, The aforementioned display screen is a touch panel type screen. The display control unit, by default, displays the time axis in predetermined time segments, and controls the time segments to shift forward or backward when a swipe operation is performed on the display screen along the arc of the time axis. Activity record display device.

3. An action record display device according to claim 1, The aforementioned display screen is a touch panel type screen. The display control unit controls the time scale of the time axis to widen or narrow when a pinch operation is performed on the display screen. Activity record display device.

4. An action record display device according to any one of claims 1 to 3, Installed in portable mobile devices, Activity record display device.

Images