Information processing device
The information processing device enhances the accuracy of user physical activity data by complementing missing logs with similar past events, ensuring precise life log data acquisition.
Patent Information
- Application Number
- JP2023092742
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-06-05
- Publication Date
- 2024-12-17
- Estimated Expiration
- 2043-06-05
AI Technical Summary
Existing technologies lack accuracy in acquiring information indicating a user's physical activity.
An information processing device that complements missing life logs by associating them with similar events from past life logs, using a control unit to identify and utilize life logs from events with similar categories, locations, or weather conditions.
Improves the accuracy of acquiring information on user physical activity by supplementing missing data with high-probability approximations from past events.
Smart Images

Figure 2024174745000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing device. [Background technology]
[0002] Conventionally, there are known techniques for acquiring information indicating a user's physical activity. For example, Patent Literature 1 discloses a technique for detecting a change in a resident's daily behavior history using a power sensor or the like provided in a house. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2017-091294 A Summary of the Invention [Problem to be solved by the invention]
[0004] There is room for improvement in the accuracy of obtaining information indicative of a user's physical activity.
[0005] The present disclosure has been made in consideration of such circumstances, and aims to improve the accuracy of acquiring information indicating a user's physical activity. [Means for solving the problem]
[0006] An information processing device according to one embodiment of the present disclosure has a memory unit, a communication unit that communicates with a terminal device used by a user, and a control unit that associates event information indicating the user's behavior with a life log indicating the user's physical activity history during the event and stores them in the memory unit, and when the life log corresponding to a first event cannot be obtained, complements the life log of the first event using a life log associated with a second event similar to the first event. Effect of the Invention
[0007] According to the information processing device and the like disclosed herein, it is possible to improve the accuracy of acquiring information indicating a user's physical activity. [Brief description of the drawings]
[0008] [Figure 1] FIG. 1 is a diagram illustrating a configuration of an information processing system. [Diagram 2] 4 is a flowchart showing an operation of the information processing device. [Diagram 3] FIG. 11 is a diagram for explaining event history information. [Figure 4] 4 is a flowchart showing an operation of the information processing device. [Diagram 5] FIG. 11 is a diagram for explaining event history information. [Figure 6] FIG. 13 is a diagram illustrating categories of event history information. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] (First embodiment) 1 is a diagram illustrating a configuration example of an information processing system 1 according to the present embodiment. The information processing system 1 includes an information processing device 10 and a terminal device 20. The information processing device 10 and the terminal device 20 are communicatively connected to a network 30 including, for example, the Internet and a mobile communication network.
[0010] The information processing device 10 is installed in a facility such as a data center, etc. The information processing device 10 is, for example, a server belonging to a cloud computing system or other computing system.
[0011] The terminal device 20 is a mobile device held by a user, such as a mobile phone, a smartphone, a tablet, etc. The terminal device 20 has a function of measuring and recording a life log of the user, such as a pedometer function.
[0012] The network 30 includes the Internet, at least one wide area network (WAN), at least one metropolitan area network (MAN), or a combination thereof. The network 30 may include at least one wireless network, at least one optical network, or a combination thereof. The wireless network may be, for example, an ad-hoc network, a cellular network, a wireless local area network (LAN), a satellite communication network, or a terrestrial microwave network.
[0013] The information processing system 1 supports the acquisition of a user's life log. The life log is information indicating the user's physical activity history, and includes the number of steps, walking distance, calories burned, sleep time, meal time, etc. The life log is measured by the user's terminal device 20. The information processing device 10 receives information indicating the measured life log from the terminal device 20.
[0014] The information processing device 10 includes a control unit 11, a storage unit 12, and a communication unit 13. The control unit 11 stores information on an event indicating the user's behavior in association with a life log during the event in the storage unit 12. When the information processing device 10 cannot obtain a life log corresponding to a first event, the information processing device 10 complements the life log of the first event by using a life log associated with a second event similar to the first event. According to this embodiment, even if the user has forgotten to carry the terminal device 20 and has not been able to measure the life log, the information processing device 10 can select a similar event from past events and complement the life log with the life log associated with the selected event. There is a high probability that the life log corresponding to the similar event is similar to the measured life log. This makes it possible to improve the accuracy of obtaining information indicating the user's physical activity.
[0015] <Configuration example of information processing device 10> The information processing device 10 includes a control unit 11, a storage unit 12, and a communication unit 13.
[0016] The control unit 11 includes at least one processor, at least one dedicated circuit, or a combination of these. The processor is a general-purpose processor such as a central processing unit (CPU) or a graphics processing unit (GPU), or a dedicated processor specialized for a specific process. The dedicated circuit is, for example, a field-programmable gate array (FPGA) or an application specific integrated circuit (ASIC). The control unit 11 executes processes related to the operation of the information processing device 10 while controlling each part of the information processing device 10.
[0017] The storage unit 12 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or a combination of at least two of these. The semiconductor memory is, for example, a random access memory (RAM) or a read only memory (ROM). The RAM is, for example, a static random access memory (SRAM) or a dynamic random access memory (DRAM). The ROM is, for example, an electrically erasable programmable read only memory (EEPROM). The storage unit 12 functions as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 12 stores any information, control / processing programs, etc. used in the operation of the information processing device 10, and information obtained by the operation of the information processing device 10.
[0018] The communication unit 13 includes at least one communication interface. The communication interface includes, for example, a LAN interface. The communication interface includes LTE (Long Term Evolution), 4G (4th Generation), or 5G (5th The communication unit 13 may include an interface compatible with mobile communication standards such as the Universal Mobile Phone (UMP) (International Mobile Phone ...
[0019] <Configuration Example of Terminal Device 20>
[0020] The terminal device 20 includes a control unit 21 , a storage unit 22 , a communication unit 23 , an input / output unit 24 , and a sensor unit 25 .
[0021] The control unit 21 includes at least one processor such as a CPU or an MPU (Micro Processing Unit), at least one dedicated circuit, or a combination of these. The processor is a general-purpose processor or a dedicated processor specialized for a specific process. The dedicated circuit is, for example, an FPGA or an ASIC. The control unit 11 executes processes related to the operation of the information processing device 10 while controlling each part of the information processing device 10.
[0022] The storage unit 22 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or a combination of at least two of these. The semiconductor memory is, for example, a RAM or a ROM. The RAM is, for example, an SRAM or a DRAM. The ROM is, for example, an EEPROM. The storage unit 32 functions as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 22 stores any information, control / processing programs, etc. used in the operation of the terminal device 20, and information obtained by the operation of the terminal device 20.
[0023] The communication unit 23 includes at least one communication interface. The communication interface includes, for example, a LAN interface, and an interface compatible with a mobile communication standard such as LTE (Long Term Evolution), 4G (4th generation), or 5G (5th generation). The communication unit 23 receives data used in the operation of the terminal device 20, and transmits data obtained by the operation of the terminal device 20.
[0024] The input / output unit 24 includes at least one input / output interface. The input / output interface includes a touch screen that is integral with the display. The input / output unit 24 accepts an operation for inputting information used in the operation of the terminal device 20, and outputs information obtained by the operation of the terminal device 20. The input / output unit 24 may be connected to the terminal device 20 as an external input device instead of being provided in the terminal device 20. As a connection method, any method such as USB, HDMI (registered trademark), or Bluetooth (registered trademark) can be used. The input / output unit 24 may be configured by separate input and output units without being integrated. In this case, the input unit includes at least one input interface such as a physical key, a capacitive key, a pointing device, or a microphone. The output unit includes at least one output interface such as a display or a speaker.
[0025] The sensor unit 25 includes sensors that detect the state of the terminal device 20. The sensors are an acceleration sensor, a gyroscope, etc. The sensor unit 25 sends the detected data to the control unit 21.
[0026] The control unit 21 processes data detected by the sensor unit 25 using an arbitrary algorithm, for example, to identify the walking motion of the user, and stores the number of steps in the storage unit 22.
[0027] <Program structure example> The functions of the information processing device 10 or the terminal device 20 are realized by executing the program according to this embodiment on a processor equivalent to the control unit 11 or the control unit 21. The program is a program for causing a computer to function as the information processing device 10 or the terminal device 20. The program can be stored in a non-transitory computer-readable medium such as a ROM. The computer-readable medium may include a magnetic recording device, an optical disk, and a magneto-optical recording medium. The program may be distributed by a portable medium, or may be distributed from a server or the like via a network. Alternatively, the program may be stored in a server or the like, and executed by a so-called ASP (application service provider) type service in which the functions are realized by an execution instruction from the information processing device 10 and result acquisition.
[0028] <Example of operation of information processing device 10> 2 is a flow chart showing an example of an operation procedure of the information processing device 10. The procedure in FIG.
[0029] In step S1, the control unit 11 creates event history information in which the user's events and life logs are associated with each other, and stores the information in the storage unit 12. The event history information is created, for example, for each day. The control unit 11 acquires information on events for one day that the user inputs to the terminal device 20 from the terminal device 20. The events are, for example, information indicating a schedule. Alternatively, the control unit 11 may acquire information indicating a schedule from another server device in which the user has registered a schedule. The control unit 11 also acquires information indicating a life log, i.e., the number of steps, measured during a time period of each schedule from the terminal device 20. An event may be input by the user every time, or may be input once and repeated. As illustrated in FIG. 3, the event history information T1 associates four events, "Going to work," "Visiting a company," "Leaving work," and "ABC yoga school," in different time periods of one day, with the respective life logs, i.e., the number of steps. In this example, the life log for the event "ABC yoga school" is missing.
[0030] In step S2, the control unit 11 determines whether or not there is an event whose life log is missing in the event history information. If there is no missing event, the control unit 11 returns to step S1, and if there is a missing event, the control unit 11 proceeds to step S3. In this example, the life log of the event "ABC Yoga School" is missing, so the control unit 11 proceeds to step S3.
[0031] In step S3, the control unit 11 identifies the event with a missing life log as the first event. In this example, the control unit 11 identifies the event "ABC Yoga School" with a missing life log from the event history information in Table 1 as the first event.
[0032] In step S4, the control unit 11 acquires the user's past event history information. As illustrated in FIG. 3, the past event history information T2 does not include a first event, that is, the life log is associated with all events of one day. In this example, the control unit 11 acquires the past event history information T2 by reading it out from the storage unit 12, but it may also be acquired by receiving the past event history information T2 from the user's terminal device 20. In the past event history information T2, the number of steps is associated with four events in a specific time period of one day: "going to work," "visiting the company," "leaving work," "X gym," "shopping at Y store," and "running along Z river."
[0033] In step S5, the control unit 11 associates each event with information indicating the category of the event and stores it in the storage unit 12, and selects a past event associated with a category common to the category of the first event as the second event. The information may be preset by the user for each event, or may be assigned according to any natural language processing technology. The category may be preset and stored in the storage unit 12, and for example, an event having information such as "gym", "running", and "yoga school" may be classified in association with the "exercise" category, and an event having information such as "meeting" and "client visit" may be classified in association with the "work" category. In this example, the control unit 11 classifies the "ABC yoga school" event into the "exercise" category based on the information "yoga school" assigned by applying a natural language processing algorithm to the event.
[0034] In this example, the control unit 11 specifies, as the second event, an event that is in the same category as the first event and that occurs in the closest time period to the first event among the events indicated by the past event history information. Among the events in the past event history information T2, the events classified in the same "exercise" category as the first event "ABC yoga school" are "X gym" and "Z riverside running". The control unit 11 specifies, as the second event, the event "gym" that occurs in the closest time period to the time period of the "yoga school" from 18:30 to 20:00. Without being limited to this, the control unit 11 may also obtain location information indicating the locations of the venues of the first event and past events, and select, as the second event, a past event that satisfies any number of conditions, such as similarity of the location information. In this case, the control unit 11 may obtain the location information by receiving it from a map server based on the facility name included in the event.
[0035] In step S6, the control unit 11 complements the life log of the first event with the past life log associated with the past event identified in step S4. In this example, the life log of "ABC Yoga School" is complemented with the step count value of 2000 steps, which is the life log associated with the event "X Gym". FIG. 3 shows the complemented event history information T3. The control unit 11 stores the complemented event history information in the storage unit 12. The control unit 11 may transmit the complemented event history information to the terminal device 20. Then, the processing of the control unit 11 ends.
[0036] According to this embodiment, even if all life logs for a certain time period are missing, past events in a common category with the events for that time period can be automatically selected and supplemented with the life logs of the past events. Compared to using life logs of events in completely different categories, it is possible to select events that are more likely to have similar life logs, thereby improving the accuracy of acquiring information indicating the user's physical activity.
[0037] Second embodiment In the second embodiment, when all events on a target day indicated by the event history information are first events, i.e., when all life logs for a day are missing, the control unit 11 complements the event history information with a cumulative total of the life logs for a day, such as the total number of steps for a day.
[0038] The configuration of the information processing system 1 according to this modification and the configuration of each device are similar to those of the first embodiment described above, and therefore description thereof will be omitted.
[0039] Fig. 4 is a flow chart showing an example of an operation procedure of the information processing device 10 according to the second embodiment. The procedure in Fig. 4 is related to information processing executed by the control unit 11 of the information processing device 10. Steps S21, S23, and S27 to S31 in Fig. 4 are similar to steps S1, S4, and S2 to S6 in Fig. 2, respectively, and therefore description thereof will be omitted.
[0040] In step S22, the control unit 11 judges whether or not life logs are missing for all events in the event history information. If it is judged that life logs are missing for all events, the processing operation by the control unit 11 proceeds to step S23, and if it is judged that life logs are missing for only some events, the processing operation by the control unit 11 proceeds to step S27. In the example of the event history information T4 in FIG. 5, in step S23, the control unit 11 judges that life logs are missing for all events, and identifies "Arrival at work", "Visiting the company", and "Leaving work" as a first event group having multiple first events. The processing by the control unit 11 proceeds to step S24.
[0041] In step S24, the control unit 11 associates each event of the first event group with information indicating the category of the event, and stores the information in the storage unit 12, and selects a past event group associated with a category common to the category of each event of the first event group as a second event group having a plurality of second events. For example, the control unit 11 classifies categories using information indicating the category for each of the first event of the event history information and the events of the past event history information, as in the first embodiment described above. The control unit 11 further counts the required time or the number of occurrences of the classified categories, and selects a past event group having the most similar distribution of the counted required time or the number of occurrences as the second event group. More specifically, the past event group having the most similar distribution may be a past event group having the smallest difference in the required time or the number of occurrences of each classified category with respect to the first event group.
[0042] FIG. 5 shows past event history information T5 to T8 relating to four days from April 1 to April 4. In this example, the categories are "commuting", "work", "exercise", and "holiday", and the events "coming to work" and "leaving work" are classified into the category "commuting". The events "regular meeting", "XX meeting", "YY visit to the company", "ZZ shared meeting", and "WW general meeting" are classified into the category "work". The event "gym" is classified into the category "exercise", and the event "day off" is classified into the category "holiday". FIG. 6 shows information T9 indicating the result of the control unit 11 calculating the required time for each category for each event in the past event history information. For example, on April 1, 180 minutes were spent in the categories "commuting" and "work", and 0 minutes were spent in the categories "exercise" and "holiday". FIG. 6 shows information T10 indicating the result of the control unit 11 calculating the required time for each category for each of the events "coming to work", "visiting the company", and "leaving work" indicated in the event history information T4. In this case, the control unit 11 selects, as the second event group, the event group in the past event history information T5 relating to April 1, which has the most similar distribution of required time to that of the information T10.
[0043] In addition to the required time, the control unit 11 may select the second event group by tallying up the number of occurrences of categories in past event history information. Fig. 6 shows information T11 indicating the result of the control unit 11 calculating the number of occurrences for each category for past event history information T5 to T8. The control unit 11 can select the past event group having the most similar distribution of event history information and number of occurrences of categories as the second event group.
[0044] The control unit 11 may specify, as the second event group, a past event group on a day with a common weather as the day of the first event group. The common weather conditions may be preset and stored in the storage unit 12. For example, the control unit 11 may determine that the weather is common when the weather is rain and snow, or when the weather is cloudy and sunny, and may determine that the weather is not common when the weather is sunny or cloudy and rain or snow. Without being limited to this, the control unit 11 may determine that the weather is common when the values of the precipitation, temperature, humidity, wind speed, etc. between the day of the first event group and the day of the past event group are less than a predetermined difference, and may determine that the weather is not common when the values are equal to or greater than the predetermined difference. Information indicating the weather may be included in the event history information acquired in step S21 and the past event history information acquired in step S23, or the control unit 11 may acquire the information from a server provided in a weather information center or the like. This makes it possible to select a life log that is likely to closely resemble the measured life log, for example, if a user's daily activities change depending on the weather, such as taking the bus to work on rainy days and walking to work on sunny days.
[0045] The control unit 11 may specify, as the second event group, a past event group on a day that is the same as the day of the week of the first event group. The condition of the common day of the week may be preset and stored in the storage unit 12. For example, the control unit 11 may determine that the day of the week is common when the weather is Saturday and Sunday, or when both are weekdays, and may determine that the day of the week is not common when the weather is a weekday and Saturday or Sunday. Information indicating the day of the week may be included in the event history information acquired in step S21 and the past event history information acquired in step S23. For example, when the day of the first event group is Sunday, the control unit 11 selects, as the second event group, a past event group on Sunday from the past event history information. This makes it possible to select a life log that is highly likely to approximate the measured life log when the user's daily actions change depending on the day of the week, such as when the user rests at home on Saturdays or holidays and goes to work on weekdays.
[0046] In step S25, the control unit 11 acquires a cumulative life log corresponding to the second event group selected in step S24. Specifically, the control unit 11 reads out and sums up the values of the life logs associated with each of the selected second event groups. In this example, the control unit 11 selects the second event group of the past event history information T5 in step S25. In this case, the control unit 11 acquires 3000 steps, which is the total of the number of steps "1000 steps", "500 steps", "500 steps", and "1000 steps" as the cumulative life log.
[0047] Any method may be used to select the second event group in step S24 and to acquire the cumulative total of the life log in step S25. For example, the control unit 11 may generate a regression model in which the number of occurrences or the required time of a category included in past event history information is an explanatory variable and the total value of the life log for one day is an objective variable, and acquire the calculated value by applying the event category of the event history information acquired in step S21 to the regression model as the cumulative total. For example, the control unit 11 may acquire the total value of the life log for one day of the cluster to which the event history information belongs as the cumulative total of the second event group, based on the result of clustering using any clustering method.
[0048] In step S26, the control unit 11 complements the life log corresponding to the first event group using the cumulative total acquired in step S25. In this example, the control unit 11 complements the cumulative total of the life log corresponding to the first event group in the event history information T4 acquired in step S21 with the cumulative total of the life log of the second event group acquired in step S25, "3000 steps." The control unit 11 stores the complemented event history information in the storage unit 12. The control unit 11 may transmit the complemented event history information to the terminal device 20 via the communication unit 13. Then, the processing of the control unit 11 ends.
[0049] According to this embodiment, even if all the life logs for a certain day are missing, it is possible to select a past life log that is likely to be similar to the measured life log, thereby improving the accuracy of acquiring information indicating the user's physical activity.
[0050] In step S1 of Fig. 2 and step S21 of Fig. 4, the event and the life log may be acquired based on information indicating the user's payment history. For example, the control unit 11 communicates with a server of a card company that manages the user's card payments. When the information indicating the user's payment history acquired from the server indicates a payment at a restaurant, the control unit 11 regards eating and drinking at the restaurant in a predetermined time period including the time of the payment as an event, and generates event history information by associating the event with the meal time, which is a life log. The predetermined time period is set in advance by the user, for example, one hour, and stored in the storage unit 12.
[0051] Although the present invention has been described based on the drawings and examples, it should be noted that those skilled in the art may make various modifications and alterations based on the present disclosure. Therefore, it should be noted that these modifications and alterations are included in the scope of the present invention. For example, the functions included in each component or step can be rearranged so as not to be logically inconsistent, and multiple components or steps can be combined or divided into one. [Explanation of symbols]
[0052] 1. Information Processing Systems 10. Information processing device 11 Control section 12 Storage section 13. Communications Department 20 Terminal Equipment 21 Control section 22 Memory section 23 Communications Department 24 Input / output section 25 Sensor section 30 Network
Claims
1. A storage unit; A communication unit that communicates with a terminal device used by a user; a control unit that stores in the storage unit information on an event indicating the user's behavior and a life log indicating the user's physical activity history during the event in association with each other, and when the life log corresponding to a first event cannot be obtained, complements the life log of the first event using a life log associated with a second event similar to the first event; An information processing device having the above configuration.
2. the control unit associates each event with information indicating a category of the event and stores the associated information in the storage unit, and selects, as the second event, a past event associated with a category common to the category of the first event; The information processing device according to claim 1 .
3. When complementing the life log corresponding to a first event group having a plurality of the first events, the control unit uses a cumulative total of the life log corresponding to a second event group having a plurality of the second events.
3. The information processing device according to claim 1 or 2.
4. the control unit stores, in the storage unit, information indicating a category of each event of the first event group in association with the event; The information processing apparatus according to claim 3 , further comprising: selecting, as the second event group, a past event group associated with a category common to the category of each event in the first event group.
5. The information processing device according to claim 3 , wherein the control unit selects, as the second event group, a past event group that has a common day and weather to the first event group.
Citation Information
Patent Citations
Information processing device, information processing method, and program
JP2015011431A
Complementing method for walking information and walking information management system
JP2015200968A
Life rhythm determination device and life rhythm determination system
JP2017091294A
