Life action display device

By arranging or aligning timelines to display multi-day activity records starting from the moment a specific action event occurs, the problem of unintuitive life data in existing technologies is solved, and life activities are made easier to analyze and recognize patterns.

CN121548848APending Publication Date: 2026-02-17FUJI KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202380100649.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-07-28
Publication Date
2026-02-17

AI Technical Summary

Technical Problem

In existing technologies, the comparison and analysis of multi-day life data is not intuitive enough and it is difficult to accurately grasp the user's life behavior patterns.

Method used

By displaying multi-day activity records in a time-series or time-axis alignment, starting from the moment a specific activity event occurs, users can easily compare and analyze their activities.

Benefits of technology

It enables easy comparison and analysis of daily life activities, helping users better understand their lifestyle activity patterns.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121548848A_ABST
    Figure CN121548848A_ABST
Patent Text Reader

Abstract

Provided is a life action display device that starts at a dining start time, a going-out return time, a bathing start time, or a toilet use start time, which is the occurrence time of a specific action event occurring in each of a plurality of days, among action events included in a life action record of a plurality of days. Living action records of a plurality of days are listed and displayed in time series from respective specific action events per day.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This specification discloses a life and movement display device. Background Technology

[0002] Previously, devices for displaying a user's daily activities (life data) over multiple days were known. For example, Patent Document 1 discloses a device that displays daily life data arranged vertically with the horizontal axis as the time axis, in which the wake-up time of each day is placed at the left end of the time axis. Existing technical documents Patent documents

[0003] Patent document 1: International Publication No. 2012 / 008264. Summary of the Invention The problem that the invention aims to solve

[0004] In order to accurately grasp users' daily life activities from multi-day life data, it is important to make the multi-day life data easy to compare, and there is still room for improvement in this regard.

[0005] The main objective of this disclosure is to provide a life activity display device that enables easy comparison of activity events that occur on each day in a device that displays life activity records for multiple days. Methods for solving problems

[0006] To achieve the aforementioned main objectives, the following means were employed in this disclosure.

[0007] The first life activity display device disclosed herein displays a user's life activity record. The main purpose of the life activity display device is to display the life activity record in a time sequence, starting from the occurrence time of a specific action event that occurs on each day of the multi-day life activity record, such as the start time of a meal, the start time of returning from an outing, the start time of taking a bath, or the start time of using the toilet.

[0008] In the first daily activity display device disclosed herein, multi-day daily activity records are displayed in a chronological order, starting from the time of occurrence of a specific daily activity event, such as the start time of a meal, the time of returning from an outing, the time of starting a shower, or the time of starting to use the toilet. This allows users to easily compare the elapsed time of each activity event (meal, returning from an outing, showering, toilet use) over multiple days, helping them to keep track of their daily activities.

[0009] The second lifestyle activity display device disclosed herein is used to display a user's lifestyle activity records. The main purpose of the lifestyle activity display device is to take the occurrence time of a specific action event that occurred on a certain day of the multiple days of lifestyle activity records as the starting point, and display the multiple days of lifestyle activity records in a time sequence arranged by day and with the time axis aligned.

[0010] In the second activity display device disclosed herein, multi-day activity records are arranged in chronological order starting from the occurrence time of a specific activity event on a certain day, and the timelines are aligned for a single view. This allows users to easily compare the occurrence times of various activity events starting from the specific activity event on a certain day over multiple days, which helps in understanding their daily activities. Attached Figure Description

[0011] Figure 1 This is a schematic diagram of the action surveillance system. Figure 2 This is an explanatory diagram showing an example of sensors installed in various rooms of a residence. Figure 3 This is a flowchart illustrating an example of data measurement and processing. Figure 4 This is a flowchart illustrating an example of measurement data registration and processing. Figure 5 This is a flowchart illustrating an example of action log display processing. Figure 6 This is an explanatory diagram showing an example of a display settings screen. Figure 7 This is an explanatory diagram showing an example of a display settings screen. Figure 8 This is an explanatory diagram showing an example of a daily activity record starting from the time of waking up. Figure 9 This is an explanatory diagram showing an example of a daily activity record, starting from the time of return from an outing. Figure 10 This is a flowchart illustrating the action record display process involved in other embodiments. Figure 11 This is an explanatory diagram showing an example of a display settings screen. Figure 12 This is an explanatory diagram showing an example of a daily activity record involving other embodiments. Detailed Implementation

[0012] The implementation of this disclosure will now be described with reference to the accompanying drawings.

[0013] Figure 1 This is a schematic diagram of the action surveillance system 10. (See diagram below.) Figure 1 As shown, the surveillance system 10 includes a management server 20 that manages the entire system, and surveillance devices 30 located in each of the residences A to C where the monitored individuals reside, for monitoring the monitored individuals. Furthermore, residences A to C are, for example, residences for elderly people or people requiring care who live alone, such as... Figure 2 As shown, the room includes an L (living room), D (dining room), K (kitchen), bedroom, washroom, bathroom, toilet, and entryway. The activity monitoring system 10 can, for example, be used to monitor the actions of elderly people or those requiring care, replacing caregivers, thereby detecting abnormal behavior at an early stage.

[0014] The monitoring device 30 includes a control unit 31, a communication unit 32, an operation display unit 33 (a life activity display device), a speaker (not shown), and sensors 40. The control unit 31 is configured as a microprocessor centered on a CPU, and in addition to the CPU, it also includes ROM, RAM, etc. The operation display unit 33 and the speaker output various information from the management server 20 through display and sound. The operation display unit 33 is configured as a touch panel type display that can be operated and input by the operator.

[0015] Sensor type 40 is a sensor used to detect where and what a person residing in a residence is doing, such as... Figure 2 As shown, it has human sensors 41, 42, 43, 44, 45, and 46 installed in each room, a sleep sensor 47 installed in the bedroom, a toilet faucet sensor 48 installed in the bathroom, and a door sensor 49 installed at the entrance door.

[0016] Human sensors 41-46 are sensors that detect people within a detection area using a non-contact method; for example, they are infrared sensors that sense infrared light and convert it into electrical signals. Human sensors 41, 42, and 43 are respectively installed in the living room, dining room, and kitchen of the LDK room. Furthermore, human sensor 44 is installed in the bedroom, and human sensor 45 is installed in the bathroom. Additionally, human sensor 46 is installed in the toilet.

[0017] The sleep sensor 47 is, for example, a sheet-like biosensor placed under the bedroom mattress to acquire biological information such as the pulse and respiration of the person lying on the bed. The toilet flush sensor 48 detects the operation of the flush lever and flush switch indicating toilet flushing; in this embodiment, it detects large flush and small flush operations in a recognizable manner. The door sensor 49 detects the opening and closing of the entrance door; for example, it is configured as a magnetic opening and closing sensor having a permanent magnet fixed to the side of the door and a magnetic sensor fixed to the side of the door frame.

[0018] The management server 20 includes a processing unit 21, a communication unit 22, and a storage unit 23. The processing unit 21 is configured as a CPU-centric microprocessor, and in addition to the CPU, it also includes ROM, RAM, etc. The communication unit 22 of the management server 20 is connected to the communication units 32 of each monitoring device 30 and the communication unit 52 of the mobile terminal 50 via network 11, exchanging data and signals with each other. The storage unit 23 is composed of hard disk drives (HDDs), solid-state drives (SSDs), etc., and receives and stores data measured by each monitoring device 30 for a certain period of time.

[0019] Next, the operation of the action monitoring system 10 configured as described will be explained. Specifically, the operation of the monitoring device 30 and the operation of the management server 20 will be explained separately.

[0020] Data measurement and processing involves using sensors installed in various rooms of a residence to measure (collect) the location of the person being monitored. Figure 3 This is a flowchart of an example of data measurement processing performed by the control unit 31 of each monitoring device 30. This processing is repeated every predetermined time interval.

[0021] When data measurement processing is executed, the control unit 31 of the monitoring device 30 first determines whether the human sensor 41 for the living room, which is installed in the living room, has reacted (step S100). If the control unit 31 determines that the human sensor 41 for the living room has reacted, it determines that the person being monitored is located in the living room (step S102), and sends the determination result as measurement data to the management server 20 (step S136), thus ending the data measurement processing.

[0022] If the control unit 31 determines in step S100 that the human sensor 41 for the living room is not responding, it then determines whether the human sensor 42 for the dining room is responding (step S104). If the control unit 31 determines that the human sensor 42 for the dining room is responding, it determines that the person being monitored is in the dining room (step S106), sends the determination result as measurement data to the management server 20 (step S136), and ends the data measurement process.

[0023] If the control unit 31 determines in step S104 that the human sensor 42 for the restaurant is not responding, it then determines whether the human sensor 43 for the kitchen is responding (step S108). If the control unit 31 determines that the human sensor 43 for the kitchen is responding, it determines that the person being monitored is in the kitchen (step S110), sends the determination result as measurement data to the management server 20 (step S136), and ends the data measurement process.

[0024] If the control unit 31 determines in step S108 that the human sensor 43 in the kitchen is not responding, it then determines whether the human sensor 44 in the bedroom is responding (step S112). If the control unit 31 determines that the human sensor 44 in the bedroom is responding, it determines that the person being monitored is in the bedroom (step S114). Furthermore, the control unit 31 obtains the detection signal from the sleep sensor 47 (step S116), and sends the determination result and the detection signal from the sleep sensor 47 as measurement data to the management server 20 (step S136), thus ending the data measurement process.

[0025] If the control unit 31 determines in step S112 that the human sensor 44 for the bedroom is not responding, it then determines whether the human sensor 45 for the bathroom is responding (step S118). If the control unit 31 determines that the human sensor 45 for the bathroom is responding, it determines that the person being monitored is in the bathroom (step S120), sends the determination result as measurement data to the management server 20 (step S136), and ends the data measurement process.

[0026] If the control unit 31 determines in step S118 that the human sensor 45 for the bathroom is not responding, it then determines whether the human sensor 46 for the bathroom is responding (step S122). If the control unit 31 determines that the human sensor 46 for the bathroom is responding, it determines that the person being monitored is in the bathroom (step S124). Furthermore, the control unit 31 obtains the detection signal from the toilet faucet sensor 48 (step S126), and sends the determination result and the detection signal from the toilet faucet sensor 48 as measurement data to the management server 20 (step S136), thus ending the data measurement process.

[0027] If the control unit 31 determines in step S122 that the human sensor 46 for the bathroom is not responding, it then determines whether the door sensor 49 for the entrance hall is responding (step S128). If the control unit 31 determines that the door sensor 49 for the entrance hall is responding, it then determines whether the person being monitored is at home, as determined in step S134 (step S130). If the control unit 31 determines that the person is at home, it determines that the person being monitored has gone out (step S132), and sends the determination result as measurement data to the management server 20 (step S136), ending the data measurement process. On the other hand, if the control unit 31 determines that the person is not at home (i.e., has been determined to be out), it determines that the person being monitored has returned home (step S134), and sends the determination result as measurement data to the management server 20 (step S136), ending the data measurement process.

[0028] Next, the actions of the management server 20 will be explained. Figure 4 This is a flowchart of an example of measurement data receiving and processing performed by the processing unit 21 of the management server 20. This process is repeated every predetermined time.

[0029] When the measurement data reception and processing is executed, the processing unit 21 of the management server 20 first determines whether measurement data has been received from the monitoring device 30 (step S200). If the processing unit 21 determines in step S200 that no measurement data has been received, it proceeds to step S206. On the other hand, if the processing unit 21 determines that measurement data has been received, it accesses the time server via the Internet to obtain the current year, month, day, time (hour / minute / second), and day of the week as time information (step S202), associates the obtained time information with the measurement data and stores it in the storage unit 23 (step S204), and proceeds to step S206. In addition, the time information can also be obtained by reading the current time from the RTC (Real-Time Clock).

[0030] Next, the processing unit 21 determines whether measurement data for a certain period (e.g., one day) has been accumulated in the storage unit 23 (step S206). If the processing unit 21 determines that measurement data for a certain period has not been accumulated, it proceeds to step S212. On the other hand, if the processing unit 21 determines that measurement data for a certain period has been accumulated, it extracts a pre-set action event from the measurement data for that period (step S208) and registers the extracted action event along with its occurrence time in the storage unit 23 (step S210). Here, in this embodiment, action events include waking up, going to bed, eating, urinating, defecating, and taking a bath. For example, waking up can be determined based on the change from a sleep state to a wakeful state detected by the sleep sensor 47 while in the bedroom. Going to bed can be determined based on the change from a wakeful state to a sleep state detected by the sleep sensor 47 while in the bedroom. Eating can be determined based on determining that after moving from the kitchen to the dining room, the person stays in the dining room for a certain period of time or more. Taking a bath can be determined based on determining that the person stays in the bathroom for a certain period of time or more. Excretion (urination) can be determined based on a small flush operation detected by the toilet faucet sensor 48 while the person is in the toilet. Excretion (defecation) can be determined based on a large flush operation detected by the toilet faucet sensor 48 while the person is in the toilet. Furthermore, excretion (urination) can also be determined based on the determination that the person has been in the toilet for less than a certain period of time, and excretion (defecation) can also be determined based on the determination that the person has been in the toilet for more than a certain period of time. In this case, the faucet sensor 48 can be omitted.

[0031] Next, the processing unit 21 determines whether there is a request to send an action record from the monitoring device 30 (operation display unit 33) (step S212). If the processing unit 21 determines that there is no request to send an action record, it directly ends the measurement data registration process. On the other hand, if the processing unit 21 determines that there is a request to send an action record, it sends the action events stored in the storage unit 23 and their respective times of occurrence as life action records to the monitoring device 30 that issued the sending request (step S214), and ends the measurement data registration process.

[0032] Next, the operation of the monitoring device 30 upon receiving the action event will be explained. Figure 5 This is a flowchart of an example of the action recording and display process performed by the control unit 31 of the monitoring device 30. This process is performed when the user instructs the display unit 33 to display the life activities of the person being monitored.

[0033] When the action record display process is executed, the control unit 31 displays a display setting screen on the operation display unit 33 (step S300). Next, the control unit 31 receives the selection of a specific action event on the display setting screen (step S302), and receives the settings for the display period and display time width (step S304). Here, a specific action event refers to the action event that serves as the starting point for display when daily action events are arranged and displayed in chronological order. Figure 6 and Figure 7 This is an explanatory diagram illustrating an example of a settings screen. In this embodiment, as... Figure 6 As shown, specific action events include waking up, using the toilet, eating, returning from outside, and taking a bath. The selection of a specific action event is made by the user choosing one from these multiple action events and pressing the "Next" button. In this embodiment, meals are divided into breakfast (e.g., 7:00–10:00), lunch (e.g., 11:00–14:00), and dinner (e.g., 17:00–20:00) based on the time period. The selection of a meal is made by the user choosing one from breakfast, lunch, and dinner. The display period and display time width are set by entering values ​​for the start and end dates of the display period, and entering a value for the display time width between 1 and 24, and then pressing the "Confirm" button.

[0034] Next, the control unit 31 retrieves the action events from the life action records during the display period from the management server 20, starting from the occurrence time of the specific action event each day and within the display time width (step S306). For example, when waking up is selected as the specific action event, May 5th to May 8th is set as the display period, and 15 hours is set as the display time width, the control unit 31 retrieves the action events that occurred from the start time to the end time, starting from the wake-up time of each day from May 5th to May 8th. Furthermore, the control unit 31 arranges the retrieved action events in chronological order by day and displays them on the operation display unit 33 in a summary view based on the elapsed time from the specific action event of each day (step S308).

[0035] Figure 8 This is an explanatory diagram showing an example of a daily activity record, starting from the wake-up time. As shown, the daily activity record displayed on the operation display unit 33 includes home status, meals, toileting, bathing, sleep, and sleep status (e.g., sleep depth level in non-REM sleep, REM sleep). When wake-up is selected as a specific activity event, the daily activity record is displayed in a time sequence, starting from the wake-up time of each day, based on the elapsed time from that starting point. Figure 9 This is an explanatory diagram showing an example of a daily activity record, with the return time from an outing as the starting point. When an outing is selected as a specific activity event, the activity record is displayed in chronological order, starting from the return time of each day and arranged daily according to the elapsed time from that starting point. Because the daily activity record is displayed as elapsed time from a specific activity event, it allows users to easily grasp their daily activity patterns based on the records over several days.

[0036] After displaying the overview, control unit 31 determines whether an end operation has been performed (step S310). If control unit 31 determines that no end operation has been performed, it determines whether a return operation has been performed (step S312). If control unit 31 determines that no return operation has been performed, it returns to step S310; if it determines that a return operation has been performed, it returns to step S300. Furthermore, if control unit 31 determines that an end operation has been performed in step S310, it terminates the action record display process.

[0037] Here, the correspondence between the main elements of this embodiment and the main elements of the present disclosure as described in the claims will be explained. That is, the operation display unit 33 of this embodiment is an example of the action recording display device of the present disclosure.

[0038] It should be noted that this disclosure is not limited to the above-described embodiments. It goes without saying that it can be implemented in various ways within the technical scope of this disclosure.

[0039] For example, in the above embodiment, the control unit 31 is configured to start from the occurrence time of the specific action event on each day of the specified display period, arrange the action events occurring within the display time width in a daily time sequence, and display them in a glance based on the elapsed time since the specific action event on each day. However, the control unit 31 may also start from the occurrence time of the specific action event on a particular day of the specified display period, arrange the action events occurring within the display time width in a daily time sequence, and display them in a glance with the time axis aligned. In this case, the control unit 31 executes... Figure 10 The example action log display can be processed. The following is about... Figure 10 The action log shown illustrates the processing. Furthermore, Figure 10 Action logs show that in each of the processes handled, and Figure 5 The same process is labeled with the same step number, and its description is redundant, so it is omitted.

[0040] exist Figure 10 In the action record display process, the control unit 31 receives the selection of a specific action event (step S302), and receives the setting of the display period and the display time width (step S304), and receives the selection of the time as the display start point among the occurrence times of the specific action events that occur on each day of the display period (step S400). Figure 11 This is an explanatory diagram showing an example of a display settings screen. As shown, the time used as the display start point includes the earliest time, the latest time, the average time, the median time, and the time of a specific day specified within the display period. The time is selected by the user from these multiple times and pressing the "Confirm" button. Furthermore, the specific day is selected by entering a value for the year, month, and day to be specified within the display period.

[0041] Next, the control unit 31 retrieves the action events with a display time span from the management server 20, starting from the selected time (step S402). Then, the control unit 31 displays the retrieved action events in a time sequence arranged by day and with the time axis aligned for each day on the operation display unit 33 (step S404), and proceeds to step S310.

[0042] Figure 12This is an explanatory diagram illustrating a display example of a multi-day activity record according to other embodiments. When waking up is selected as a specific activity event, and the time of a specific day (May 8th) is selected as the starting point for display, the activity record is displayed with the occurrence time of the specific activity event on that specific day as the starting point, and each day is displayed in a time-aligned view. Therefore, for days when a specific activity event occurred at a time later than the occurrence time of the specific activity event on a specific day, the remaining time portion of that specific activity event is displayed; for days when a specific activity event occurred at a time earlier than the occurrence time of the specific activity event on a specific day, that specific activity event is not displayed. Since the multi-day activity record is displayed with the time of the specific day as the starting point, it is easy to grasp the daily temporal deviation of activity events. Furthermore, since the starting point is the occurrence time of a specific activity event, it is helpful to understand the activity pattern based on the specific activity event.

[0043] In addition, in the above embodiment, the management server 20 sends the activity records of the monitored person to the monitoring device 30, and the monitoring device 30 performs activity record display processing based on the received activity records, thereby displaying the activity records on the operation display unit 33. However, the management server 20 may also send the activity records to a display terminal (e.g., a tablet terminal) different from the monitoring device 30, and the display terminal performs the same processing as the above-described activity record display processing based on the received activity records, thereby displaying the activity records.

[0044] In the first action record display device of this disclosure described above, the multi-day life action record is displayed in a chronological order, starting from the time of occurrence of a specific action event on each day, such as the start time of a meal, the time of returning from an outing, the time of starting a bath, or the time of starting to use the toilet. Therefore, users can easily compare the elapsed time from the occurrence of each action event (meal, returning from an outing, bathing, toilet use) on each day over multiple days, which helps to keep track of their daily activities.

[0045] Furthermore, in the second action record display device disclosed herein, multi-day activity records are arranged in chronological order starting from the time of occurrence of a specific action event on a certain day, and the timelines are aligned for a single view. This allows users to easily compare the times of occurrence of each action event starting from the specific action event on a certain day over multiple days, which helps in understanding their daily activities.

[0046] In the second action record display device disclosed herein, the earliest occurrence time, the latest occurrence time, the average or median occurrence time of the specific action event occurring on each of the multiple days, or the occurrence time of the specific action event on a specific day specified by the user can be used as a starting point. This allows the user to gain the opportunity to understand their lifestyle and behavior patterns from multiple perspectives.

[0047] Furthermore, in the second action recording display device disclosed herein, the time of occurrence of the specific action event can also be the time of waking up, the time of starting a meal, the time of returning from an outing, the time of starting a shower, or the time of starting toilet use. This allows users to gain the opportunity to understand their daily activity patterns from multiple perspectives. Industrial applicability

[0048] This disclosure can be applied to the manufacturing industry of action recording display devices. Explanation of reference numerals in the attached figures

[0049] 10. Motion monitoring system; 11. Network; 20. Management server; 21. Processing unit; 22. Communication unit; 23. Storage unit; 30. Monitoring device; 31. Control unit; 32. Communication unit; 33. Operation display unit; 40. Sensors; 41, 42, 43, 44, 45, 46. Human sensor; 47. Sleep sensor; 48. Toilet faucet sensor; 49. Door sensor.

Claims

1. A lifestyle activity display device for displaying a user's lifestyle activity records. The lifestyle activity display device takes the occurrence time of a specific action event that occurs on each day of the multi-day lifestyle activity record, such as the start time of a meal, the start time of returning from an outing, the start time of taking a shower, or the start time of using the toilet, as the starting point, and displays the multi-day lifestyle activity record in a time sequence, arranged from the specific action event of each day.

2. A lifestyle activity display device for displaying a user's lifestyle activity records. The lifestyle activity display device takes the occurrence time of a specific activity event on a particular day within the multi-day lifestyle activity record as the starting point, and displays the multi-day lifestyle activity record in a time sequence, with the time axis aligned.

3. The life and movement display device according to claim 2, wherein, The starting point is the earliest occurrence time among the occurrence times of the specific action event on each of the multiple days, the latest occurrence time among the occurrence times of the specific action event on each of the multiple days, the average or median occurrence time of the occurrence times of the specific action event on each of the multiple days, or the occurrence time of the specific action event on a specific day specified by the user.

4. The life and movement display device according to claim 2 or 3, wherein, The specific action event occurs at the time of waking up, the start of a meal, the time of returning from an outing, the start of a shower, or the start of toilet use.

Citation Information

Patent Citations

  • Activity visualization system, server, and activity data processing method

    WO2012008264A1