Information processing device
The information processing device enhances the accuracy of physical activity tracking by using location and user attributes to estimate missing measurements, addressing inaccuracies in existing methods.
Patent Information
- Application Number
- JP2023092744
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-06-05
- Publication Date
- 2024-12-17
AI Technical Summary
Existing techniques for detecting user physical activity, such as stride length and number of steps, suffer from inaccuracies.
An information processing device that estimates physical activity measurements by utilizing visit information from multiple locations, stride length, and user attributes to supplement missing data from a user's terminal device.
Improves the accuracy of physical activity tracking by estimating missing measurements based on location data and user attributes, even when the terminal device is not worn.
Smart Images

Figure 2024174746000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing device. [Background technology]
[0002] There is known a technique for detecting the number of steps taken by a user using a terminal device having a pedometer function. For example, Patent Document 1 discloses a technique for estimating a stride length and the number of steps based on acceleration detected by a terminal device worn by a user. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2014-059315 A Summary of the Invention [Problem to be solved by the invention]
[0004] There is room for improvement in the accuracy of obtaining information regarding a user's physical activity.
[0005] In view of the above circumstances, the following describes an information processing device and the like that can improve the accuracy of acquiring information related to a user's physical activity. [Means for solving the problem]
[0006] An information processing device according to one embodiment of the present disclosure has a communication unit and a control unit that acquires measurement results of a user's physical activity from a terminal device used by the user via the communication unit, and when the control unit does not acquire the measurement results, estimates the measurement results when the user moves from one location to another based on visit information regarding the locations and types of multiple locations visited by the user and the user's visit time to each location. Effect of the Invention
[0007] According to the information processing device etc. of the present disclosure, it is possible to improve the accuracy of acquiring information regarding the physical activity of a user. [Brief description of the drawings]
[0008] [Figure 1] FIG. 1 is a diagram illustrating a schematic configuration of an information processing system. [Diagram 2] 4 is a flowchart showing an operation of the information processing device. [Diagram 3] 11A and 11B are diagrams for explaining information used to estimate a measurement result. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] 1 is a diagram illustrating an example of the configuration of an information processing system 1 according to the present embodiment. The information processing system 1 includes an information processing device 10, a terminal device 20, a server device 40, a server device 50, and a server device 60. The information processing device 10, the terminal device 20, the server device 40, the server device 50, and the server device 60 are communicatively connected to a network 30 including, for example, the Internet and a mobile communication network.
[0010] The information processing device 10 is a server computer installed in a facility such as a data center, etc. The information processing device 10 is, for example, a server belonging to a cloud computing system or other computing system.
[0011] The terminal device 20 is a mobile device such as a mobile phone, a smartphone, or a tablet held by a user. The terminal device 20 includes a wearable device. The terminal device 20 has a function of recording the measurement results of the user's physical activity, such as a pedometer function. The terminal device 20 has a function of acquiring location information indicating the location of the terminal device 20 using the network 30.
[0012] The network 30 includes the Internet, at least one wide area network (WAN), at least one metropolitan area network (MAN), or a combination thereof. The network 30 may include at least one wireless network, at least one optical network, or a combination thereof. The wireless network may be, for example, an ad-hoc network, a cellular network, a local area network (LAN), a satellite communication network, or a terrestrial microwave network. The network 30 includes public networks and private networks.
[0013] The server device 40, the server device 50, and the server device 60 are server computers installed in a facility such as a data center. The server device 40, the server device 50, and the server device 60 are, for example, servers belonging to a cloud computing system or other computing systems.
[0014] The information processing system 1 assists in obtaining a life log of a user. The life log is a history of the measurement results of the user's physical activity. Specifically, the physical activity is walking, and the measurement result is the number of steps. The life log includes walking distance and calories burned based on the number of steps. The life log may also include sleep time, meal time, and the like as measurement results during inactivity. The physical activity is measured by the user's terminal device 20. In this embodiment, even if the measurement results of the physical activity are not obtained because the user has forgotten to carry the terminal device 20, the information processing system 1 estimates the measurement results, and the life log is supplemented.
[0015] The information processing device 10 includes a communication unit 13 and a control unit 11 that acquires the measurement results of the user's physical activity from the terminal device 20 used by the user through the communication unit 13. When the control unit 11 does not acquire the measurement results, it estimates the measurement results when the user moves from one point to another point based on the visit information related to the positions and types of the multiple points visited by the user and the user's visit time to each point. The number of steps is proportional to the travel distance and is highly likely not to vary significantly depending on the type of each point. Therefore, according to the information processing device 10, even if the number of steps cannot be acquired because the user has forgotten to carry the terminal device 20, the number of steps can be estimated using the distance between the points and the measurement value previously associated with the type of each point. This makes it possible to improve the accuracy of acquiring information related to the user's physical activity.
[0016] <Configuration example of information processing device 10> The information processing device 10 includes a control unit 11, a storage unit 12, and a communication unit 13.
[0017] The control unit 11 includes at least one processor, at least one dedicated circuit, or a combination of these. The processor is a general-purpose processor such as a central processing unit (CPU) or a graphics processing unit (GPU), or a dedicated processor specialized for a specific process. The dedicated circuit is, for example, a field-programmable gate array (FPGA) or an application specific integrated circuit (ASIC). The control unit 11 executes processes related to the operation of the information processing device 10 while controlling each part of the information processing device 10.
[0018] The storage unit 12 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or a combination of at least two of these. The semiconductor memory is, for example, a random access memory (RAM) or a read only memory (ROM). The RAM is, for example, a static random access memory (SRAM) or a dynamic random access memory (DRAM). The ROM is, for example, an electrically erasable programmable read only memory (EEPROM). The storage unit 12 functions as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 12 stores any information, control / processing programs, etc. used in the operation of the information processing device 10, and information obtained by the operation of the information processing device 10.
[0019] The communication unit 13 includes at least one communication interface. The communication interface includes, for example, a LAN interface. The communication interface includes LTE (Long Term Evolution), 4G (4th Generation), or 5G (5th The communication unit 13 may include an interface compatible with mobile communication standards such as the Universal Mobile Phone (UMP) (International Mobile Phone ...
[0020] <Configuration Example of Terminal Device 20>
[0021] The terminal device 20 includes a control unit 21 , a storage unit 22 , a communication unit 23 , an input / output unit 24 , and a sensor unit 25 .
[0022] The control unit 21 includes at least one processor such as a CPU or an MPU (Micro Processing Unit), at least one dedicated circuit, or a combination of these. The processor is a general-purpose processor or a dedicated processor specialized for a specific process. The dedicated circuit is, for example, an FPGA or an ASIC. The control unit 11 executes processes related to the operation of the information processing device 10 while controlling each part of the information processing device 10.
[0023] The storage unit 22 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or a combination of at least two of these. The semiconductor memory is, for example, a RAM or a ROM. The RAM is, for example, an SRAM or a DRAM. The ROM is, for example, an EEPROM. The storage unit 32 functions as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 22 stores any information, control / processing programs, etc. used in the operation of the terminal device 20, and information obtained by the operation of the terminal device 20.
[0024] The communication unit 23 includes at least one communication interface. The communication interface includes, for example, a LAN interface, and an interface compatible with a mobile communication standard such as LTE (Long Term Evolution), 4G (4th generation), or 5G (5th generation). The communication unit 23 receives data used in the operation of the terminal device 20, and transmits data obtained by the operation of the terminal device 20.
[0025] The input / output unit 24 includes at least one input / output interface. The input / output interface includes a touch screen that is integral with the display. The input / output unit 24 accepts an operation for inputting information used in the operation of the terminal device 20, and outputs information obtained by the operation of the terminal device 20. The input / output unit 24 may be connected to the terminal device 20 as an external input device instead of being provided in the terminal device 20. As a connection method, any method such as USB, HDMI (registered trademark), or Bluetooth (registered trademark) can be used. The input / output unit 24 may be configured by separate input and output units without being integrated. In this case, the input unit includes at least one input interface such as a physical key, a capacitive key, a pointing device, or a microphone. The output unit includes at least one output interface such as a display or a speaker.
[0026] The sensor unit 25 includes sensors that detect the state of the terminal device 20. The sensors are an acceleration sensor, a gyroscope, and the like. The sensor unit 25 sends the detected data to the control unit 21. The sensor unit 25 includes one or more GNSS (Global Navigation Satellite System) receivers. The GNSS includes at least one of, for example, GPS (Global Positioning System), QZSS (Quasi-Zenith Satellite System), BeiDou, GLONASS (Global Navigation Satellite System), and Galileo. The sensor unit 25 sends the positioning result to the control unit 21, and the control unit 21 determines the position information of the terminal device 20.
[0027] The control unit 21 processes data detected by the sensor unit 25, for example, using an arbitrary algorithm, identifies the walking movement of the user, and stores in the storage unit 22 the number of steps and the time when the number of steps was measured.
[0028] <Program structure example> The functions of the information processing device 10 or the terminal device 20 are realized by executing the program according to this embodiment on a processor equivalent to the control unit 11 or the control unit 21. The program is a program for causing a computer to function as the information processing device 10 or the terminal device 20. The program can be stored in a non-transitory computer-readable medium such as a ROM. The computer-readable medium may include a magnetic recording device, an optical disk, and a magneto-optical recording medium. The program may be distributed by a portable medium, or may be distributed from a server or the like via a network. Alternatively, the program may be stored in a server or the like, and executed by a so-called ASP (application service provider) type service in which the functions are realized by an execution instruction from the information processing device 10 and result acquisition.
[0029] <Example of operation of information processing device 10> Fig. 2 is a flow chart showing an example of an operation procedure of the information processing device 10. The procedure in Fig. 2 is a procedure related to information processing executed by the control unit 11 of the information processing device 10, and is executed, for example, at intervals of several seconds to several tens of seconds.
[0030] In step S1, the control unit 11 acquires visit information for each user. The visit information is information regarding the location and type of a plurality of locations visited by each user and the visit time to each location. The control unit 11 acquires the location and visit time of a plurality of locations visited by each user by any method, and determines the type of location corresponding to the location of the location using map information. For example, the control unit 11 acquires information on the location of each facility and the entry time of each user, i.e., the visit time, from a server device 40 that manages the entry records of any facility. In each facility, for example, the entry gate detects the visit of the user by reading the ID card of the user entering or by biometric authentication. In addition, for example, the control unit 11 may acquire information on the camera's location and the captured image and the image capture time from a camera installed at any location, recognize the visit of the user from the captured image, and determine the visit time. Furthermore, for example, the control unit 11 may acquire information on the location of the location where the payment was made and the payment time from a server device 50 that manages the payment history of each user's credit card, etc., and use the payment time as the visit time. The visit information may further include the stay time at each location. In this case, the difference between the user's entry time and exit time indicated by the entry / exit history information is included as the stay time. For example, the control unit 11 acquires map information from a server device 60 of a business that provides map information. The types of locations are retail stores, sports facilities, public facilities, etc. Retail stores include supermarkets, department stores, convenience stores, shopping malls, etc. Sports facilities include gyms, swimming pools, etc. Public facilities include stations, schools, libraries, etc. The types of locations may be preset by the user and stored in the memory unit 12.
[0031] In step S2, the control unit 11 judges whether the terminal device 20 held by each user measured physical activity while the user moved from one point to another, that is, walking. If the control unit 11 acquires a measurement result between one visit time and another visit time, it judges that the terminal device 20 measured walking. If the control unit 11 cannot acquire the measurement result, it judges that the terminal device 20 did not measure walking. If it is determined that walking was measured, the processing operation of the control unit 11 proceeds to step S3. If it is determined that walking was not measured, the processing operation of the control unit 11 proceeds to step S5.
[0032] In step S3, the control unit 11 stores the measurement result by the terminal device 20, that is, the number of steps, as a life log in the storage unit 12. As shown in steps S2 and S3, when the terminal device 20 measures walking, the control unit 11 preferentially adopts the number of steps measured by the terminal device 20 as the life log.
[0033] In step S4, the control unit 11 determines whether there is a visit time that the terminal device 20 has not determined whether it has measured among the visit times indicated by the visit information. In this embodiment, when the terminal device 20 measures a life log, the measurement is assumed to be performed continuously between visit times. If there is a visit time that the terminal device 20 has not determined whether it has measured, the processing operation of the control unit 11 returns to step S2. If there is no visit time that the terminal device has not determined whether it has measured, the processing operation of the control unit 11 proceeds to step 5.
[0034] In step S5, the control unit 11 judges whether the user has traveled from one point to another point on foot. The control unit 11 judges whether the value obtained by dividing the distance between the visited places by the difference in the visiting times, that is, the speed of the user's travel, is less than or equal to a predetermined value. The distance from one point to another point is specifically the distance of a route that can be traveled on foot on a map. The control unit 11 may acquire the distance of the route based on the map information acquired from the server device 60 of the business that provides the map information based on the location information included in the visit information. In the case where there are multiple routes, the control unit 11 may calculate and acquire the average distance of the multiple routes. If the speed of the user's travel is less than a predetermined value, the control unit 11 judges that the user has traveled between the points on foot, and if the speed is equal to or greater than the predetermined value, the control unit 11 judges that the user has not traveled between the points on foot because there is a high probability that some means of transportation has been used. In the case where the visit information includes multiple points, the control unit 11 judges whether the user has traveled between all the points on foot. The predetermined value is arbitrarily set in advance and stored in the storage unit 12. Alternatively, the control unit 11 may determine whether the user walked based on the transportation usage history included in the payment history information. In this case, the stations, bus stops, etc. where the user boarded or disembarked from the transportation are included as points indicated by the payment history information. The control unit 11 determines that the user did not walk between the points indicated by the payment history information, from the point indicated by the payment history information, such as the station or bus stop where the user boarded, to the point indicated by the payment history information, such as the station or bus stop where the user disembarked. If it is determined that the user walked, the processing operation of the control unit 11 proceeds to step S6. If it is determined that the user did not walk, the processing operation of the control unit 11 proceeds to step S10.
[0035] If it is determined that the user has traveled between the points on foot, then in step S6, the control unit 11 acquires the user's stride length. The stride length is set in advance and stored in the storage unit 12. In this example, a value of 70 cm is acquired as the stride length.
[0036] In step S7, the control unit 11 further acquires attribute information and adjusts the stride length of the user based on the attribute information. The attribute information is information indicating the attributes of the user, such as gender, age, height, weight, etc. The control unit 11 calculates the stride length of the user using an arbitrary function that calculates the stride length using the attributes as variables. The function is stored in the storage unit 12 in advance. In this example, the control unit 11 changes and adjusts the stride length of "70 cm" acquired in step S5 to the calculated stride length of "60 cm".
[0037] In step S8, the control unit 11 estimates the measurement result when moving from one point to another point by dividing the distance from the one point to the other point by the user's stride length to calculate the number of steps. The control unit 11 obtains the distance of the route from the one point to the other point based on the map information obtained from the server device 60 of the provider that provides the map information based on the location information included in the visit information, and divides the distance by the stride length to derive the number of steps.
[0038] As shown in steps S7 and S8, the control unit 11 can estimate the number of steps of the user between points with higher accuracy by dividing the distance from one point to another by a stride length that is closer to the user's actual stride length.
[0039] The control unit 11 calculates and acquires the number of steps of the user between all points that are determined to have been traveled by the user on foot. FIG. 3 shows visit information T1 acquired by the control unit 11 in this example. The control unit 11 calculates the number of steps when the user moves from Market A to Station B and the number of steps when the user moves from Station C to Club D, which are determined to have been traveled by foot, and estimates the measurement results. In this example, the control unit 11 calculates the number of steps "2000 steps" by dividing the distance from Market A to Station B, 1200 m, by the user's stride of 60 cm, and the number of steps "2500 steps" by dividing the distance from Station C to Fitness Club D, 1500 m, by the stride of 60 cm. The control unit 11 stores the calculated number of steps in the memory unit 12.
[0040] In step S9, the control unit 11 acquires representative measurement results at locations visited by the user. The control unit 11 acquires information in which representative measurement results are recorded in association with the type of location. The control unit 11 acquires such information from the storage unit 12 or the user's terminal device 20. The representative measurement results are the average value of the user's past steps at each location included in an arbitrary type, the latest number of steps, etc. In addition, the control unit 11 may estimate the number of steps taken by the user during movement as a representative measurement result by recognizing an image of the user acquired in advance from an image captured by a camera installed in the facility. Furthermore, the representative measurement results may be associated with the location itself instead of the type of location. FIG. 3 shows information T2 in which representative measurement results associated with the type of location, that is, the number of steps, are recorded. Based on the information T2, the control unit 11 acquires a life log of the number of steps "1000 steps", "500 steps", and "2000 steps" corresponding to each of the types of locations indicated by the visit information T1, namely supermarkets, stations, and gyms.
[0041] When the visit information includes the stay time at each point, the control unit 11 may further read information in which the user's measurement results per unit time are recorded in association with the type of the point, and may multiply the measurement results by a coefficient corresponding to the stay time to derive a representative measurement result. For example, if the information records the user's life log per unit time "500 steps" in association with the type "library" and the visit information indicates that the user's stay time at the point of type "library" is 2 hours, the control unit 11 multiplies 500 steps by a coefficient 2.0 corresponding to 2 hours to calculate the number of steps "1000 steps".
[0042] In step S10, the control unit 11 stores in the memory unit 12 the sum of the measurement results that it determined in step S2 were measured by the terminal device 20, the measurement results estimated in step S8, and the measurement results obtained in step S9.
[0043] In this example, the control unit 11 adds up the 2000 steps and 2500 steps estimated in step S8 and the 1000 steps, 500 steps, and 2000 steps acquired in step S9, and stores the total number of steps "8000 steps" in the storage unit 12. The control unit 11 may transmit the total number of steps to the user's terminal device 20. After that, the operation of the control unit 11 ends.
[0044] The control unit 11 may further calculate calories consumed by the user using the total number of steps acquired in step S10, and store the calculated calories in the storage unit 12 as a life log. The control unit 11 may use any function stored in advance in the storage unit 12, with the number of steps and the user's weight, height, etc. as variables, for the calculation. The control unit 11 may calculate calories based on the attribute information of the user acquired in step S7. The control unit 11 may multiply the total number of steps acquired in step S10 by the stride length of the user to calculate the total moving distance of the user, and store the calculated calories in the storage unit 12 as a life log.
[0045] Although the present invention has been described based on the drawings and examples, it should be noted that those skilled in the art may make various modifications and alterations based on the present disclosure. Therefore, it should be noted that these modifications and alterations are included in the scope of the present invention. For example, the functions included in each component or step can be rearranged so as not to be logically inconsistent, and multiple components or steps can be combined or divided into one. [Explanation of symbols]
[0046] 1. Information Processing Systems 10. Information processing device 11 Control section 12 Storage section 13. Communications Department 20 Terminal Equipment 21 Control section 22 Memory section 23 Communications Department 24 Input / output section 25 Sensor section 30 Network 40,50,60 Server equipment
Claims
1. The Communications Department and a control unit that acquires a measurement result of a user's physical activity from a terminal device used by the user via the communication unit; When the control unit does not acquire the measurement result, the control unit estimates the measurement result when the user moves from one point to another point based on visit information related to the positions and types of a plurality of points visited by the user and the visit time of the user to each point. Information processing device.
2. the physical activity is walking; The measurement result is the number of steps, The control unit estimates the measurement result based on a distance from the one point to the other point and a number of steps corresponding to the type. The information processing device according to claim 1 .
3. The control unit derives the number of steps corresponding to the distance by dividing the distance by a stride length of the user. The information processing device according to claim 2 .
4. The control unit adjusts the stride length of the user according to an attribute of the user. The information processing device according to claim 3 .
5. The control unit records a life log based on a history of the acquired or estimated measurement results. The information processing device according to claim 1 .
Citation Information
Patent Citations
Complementing method for walking information and walking information management system
JP2015200968A
Electronic instrument
JP2014059315A
