Device linkage management method, electronic device, storage medium and program product

Abstract

The present application discloses a device linkage management method, an electronic device, a computer storage medium, and a computer program product. The device linkage management method includes: obtaining the user's current body information and target body information; generating a fitness plan based on the current body information and the target body information, and pushing the fitness plan to the fitness device; and / or generating a diet plan based on the current body information and the target body information, and pushing the diet plan to the diet device. In this way, intelligent device linkage management of fitness and diet can be achieved, and the efficiency and effect of user fitness and diet management can be improved.

Description

Technical Field

[0001] The present application relates to the field of computer vision technology, and in particular to a device linkage management method, electronic equipment, computer storage medium, and computer program product. Background Art

[0002] Users usually manage their health or body shape through exercise or diet control. During this management process, users usually make a fitness plan based on their own health or body shape, or make a diet plan based on their own health or body shape. This management efficiency is low and the effect is not good. Summary of the invention

[0003] The present application provides a device linkage management method, electronic device, computer storage medium and computer program product to realize intelligent device linkage management of fitness diet and improve the efficiency and effect of user fitness diet management.

[0004] In order to solve the above technical problems, the present application proposes a device linkage management method. The device linkage management method includes: obtaining the user's current body information and target body information; generating a fitness plan based on the current body information and the target body information, and pushing the fitness plan to the fitness equipment, and / or generating a diet plan based on the current body information and the target body information, and pushing the diet plan to the diet equipment.

[0005] Among them, the above-mentioned device linkage management method also includes: obtaining user physiological data; the above-mentioned generation of a fitness plan based on the current body information and the target body information includes: generating a fitness plan based on the current body information, the target body information and the user's physiological data; the above-mentioned generation of a diet plan based on the current body information and the target body information includes: generating a diet plan based on the current body information, the target body information and the user's physiological data.

[0006] The dietary plan includes a meal plan and a drinking water plan, and the dietary equipment includes a meal equipment and a drinking water equipment; the above-mentioned pushing the dietary plan to the dietary equipment includes: pushing the dietary plan to the meal equipment, and pushing the drinking water plan to the drinking water equipment.

[0007] Among them, the above-mentioned device linkage management method also includes: obtaining user motion data of the user during the execution of the fitness plan; and / or, obtaining user diet data of the user during the execution of the diet plan; generating fitness suggestions based on the fitness plan and the user motion data, and pushing the fitness suggestions to the fitness equipment; and / or; generating diet suggestions based on the diet plan and the user diet data, and pushing the diet suggestions to the diet equipment.

[0008] The above-mentioned generation of dietary recommendations based on the dietary plan and the user's dietary data includes: obtaining current food information in the dietary equipment; and generating dietary recommendations based on the dietary plan, the user's dietary data, the user's exercise data and the current food information.

[0009] Among them, the above-mentioned device linkage management method also includes: pushing the fitness plan and / or diet plan to the user terminal.

[0010] Among them, the above-mentioned device linkage management method also includes: identifying the sports venue to determine the designated location in the sports venue; and prompting the user to exercise at the designated location; identifying the exercise status of the user at the designated location to obtain the user's exercise data.

[0011] Among them, the above-mentioned device linkage management method also includes: instructing the user to perform a preset action to determine whether the user is suitable for exercise.

[0012] The above-mentioned acquisition of the user's dietary data during the execution of the dietary plan includes: identifying the user's identity and accessing the food information; and determining the user's dietary data according to the user's identity and the accessed food information.

[0013] To solve the above technical problems, the present application proposes an electronic device. The electronic device includes a memory and a processor coupled to each other, the processor is used to execute program data stored in the memory to implement the above device linkage management method.

[0014] In order to solve the above technical problems, the present application proposes a computer storage medium on which program data is stored, and the program data can be executed to implement the above device linkage management method.

[0015] In order to solve the above technical problems, the present application proposes a computer program product. The computer program product includes computer program instructions, and the computer program instructions enable a computer to implement the above device linkage management method.

[0016] The device linkage management method of the present application first obtains the user's current body information and target body information, and generates a fitness plan and / or diet plan based on the user's current body information and target body information, which can not only intelligently generate fitness plans and diet plans, but also associate fitness plans with diet plans, that is, the management of the user's body is achieved through the linkage management of fitness plans and diet plans; then the fitness plan is pushed to the fitness equipment, and the diet plan is pushed to the diet equipment, so that the fitness equipment manages the user's sports fitness based on the fitness plan, and the diet equipment manages the user's daily diet or sports diet based on the diet plan. In this way, the present application can realize the intelligent equipment linkage management of fitness and diet, and can manage the user's sports fitness and diet in a linkage manner, thereby improving the efficiency and effect of the user's fitness and diet management. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work, among which:

[0018] Figure 1 It is a flowchart of an embodiment of the device linkage management method of the present application;

[0019] Figure 2 It is a flowchart of an embodiment of the device linkage management method of the present application;

[0020] Figure 3 It is a flowchart of an embodiment of the device linkage management method of the present application;

[0021] Figure 4 yes Figure 3 A specific flow chart of step S37 in the embodiment;

[0022] Figure 5 It is a flowchart of an embodiment of the device linkage management method of the present application;

[0023] Figure 6 It is a flowchart of an embodiment of the device linkage management method of the present application;

[0024] Figure 7 It is a flowchart of an embodiment of the device linkage management method of the present application;

[0025] Figure 8 It is a flowchart of an embodiment of the device linkage management method of the present application;

[0026] Fig. 9It is a flowchart of an embodiment of the device linkage management method of the present application;

[0027] Fig.10 It is a flowchart of an embodiment of the device linkage management method of the present application;

[0028] Fig.11 This is a result diagram of an embodiment of the device linkage management device of the present application;

[0029] Fig.12 It is a structural schematic diagram of an embodiment of the electronic device of the present application;

[0030] Fig.13 It is a result schematic diagram of an embodiment of the computer storage medium of the present application. DETAILED DESCRIPTION

[0031] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0032] It should be noted that if the embodiments of the present invention involve directional indications (such as up, down, left, right, front, back, etc.), the directional indications are only used to explain the relative position relationship, movement status, etc. between the components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indication will also change accordingly.

[0033] In addition, if there are descriptions involving "first", "second", etc. in the embodiments of the present invention, the descriptions of "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or suggesting their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the ability of ordinary technicians in the field to implement them. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such a combination of technical solutions does not exist and is not within the scope of protection required by the present invention.

[0034] The device linkage management method, electronic device, computer storage medium, and computer program product provided by the present invention are described in detail below in conjunction with the embodiments.

[0035] This application first proposes a device linkage management method, such as Figure 1 As shown, Figure 1This is a flow chart of an embodiment of the device linkage management method of the present application. The device linkage management method of this embodiment specifically includes the following steps:

[0036] Step S11: Obtain the user's current body information and target body information.

[0037] The user's current body information and target body information are obtained through the fitness equipment and / or the user terminal.

[0038] In this embodiment, a depth camera, such as an RGBD camera, can be used to obtain the current depth image information of the user, and a current human body three-dimensional model of the user can be reconstructed based on the current depth image information to form a current human body three-dimensional model similar to the current body shape of the user. Specifically, a deep learning algorithm, such as the HMR algorithm, can be used to obtain the current human body shape parameters (10 parameters of human height, weight, head-to-body ratio, etc.) of the current human body parametric model (such as SMPL) from the current depth image information, and the current human body shape parameters can be used to construct a current human body three-dimensional model that is consistent with or similar to the user; then the current body shape information of the user is obtained based on the current human body three-dimensional model. The current body shape information may include: the user's current chest size data, current waist size data, current trunk height data, and current human body height data.

[0039] The depth camera can be integrated into the fitness equipment and / or the user terminal to realize the integration of the depth camera and the image processing module and improve the efficiency of data processing.

[0040] Of course, in other embodiments, other measurement methods may be used to obtain the user's current body information.

[0041] Step S12: Generate a fitness plan based on the current body information and the target body information, and push the fitness plan to the fitness equipment.

[0042] A fitness plan may be generated based on the difference between various body data in the current body information and the corresponding body data in the target body information, the association between various body information, the relationship between body information and food ingredients, and the like.

[0043] The fitness plan is pushed to the fitness device so that the fitness device manages the user's exercise and fitness based on the fitness plan.

[0044] Step S13: Generate a diet plan based on the current body information and the target body information, and push the diet plan to the diet device.

[0045] A diet plan may be generated based on the difference between various body data in the current body information and the corresponding body data in the target body information, the association between various body information, the relationship between body information and food ingredients, and the like.

[0046] The diet plan is pushed to the diet device so that the diet device manages the user's daily diet or exercise diet based on the fitness plan.

[0047] This embodiment first obtains the user's current body information and target body information, and generates a fitness plan and / or diet plan based on the user's current body information and target body information, which can not only intelligently generate a fitness plan and a diet plan, but also associate the fitness plan with the diet plan, that is, the management of the user's body is achieved through the linkage management of the fitness plan and the diet plan; then the fitness plan is pushed to the fitness equipment, and the diet plan is pushed to the diet equipment, so that the fitness equipment manages the user's sports fitness based on the fitness plan, and the diet equipment manages the user's daily diet or sports diet based on the diet plan. In this way, this embodiment can realize the linkage management of intelligent equipment for fitness and diet, and can manage the user's sports fitness and diet in a linkage manner, thereby improving the efficiency and effect of the user's fitness and diet management.

[0048] In other embodiments, the execution order of the above step S12 and the above step S13 is not limited, or the device linkage management method can omit the above step S12 or the above step S13.

[0049] The dietary plan of this embodiment may include a dietary plan and a drinking water plan, and the dietary equipment includes a dietary equipment and a drinking water equipment, wherein the dietary equipment includes a dietary appliance such as a refrigerator, a rice cooker, and the drinking water equipment includes a dietary appliance such as a water dispenser or a water cup. The dietary plan may be pushed to the dietary equipment, and the drinking water plan may be pushed to the drinking water equipment.

[0050] For example, a fitness plan, a meal plan, and a drinking plan are generated based on the user's current body information and target body information; the fitness plan is pushed to the fitness equipment to manage the user's exercise and fitness, the meal plan is pushed to the refrigerator to manage the ingredients of the user's diet, and the drinking plan is pushed to the water dispenser to manage the user's drinking water.

[0051] In other embodiments, the diet plan may also include a dessert plan, a fruit plan, a beverage plan, etc. These plans may be managed through corresponding devices.

[0052] This application further proposes another embodiment of a device linkage management method, such as Figure 2 As shown, Figure 2 This is a flow chart of an embodiment of the device linkage management method of the present application. The device linkage management method of this embodiment specifically includes the following steps:

[0053] Step S21: Obtain the user's current body information, target body information and user physiological data.

[0054] In this embodiment, the current depth image information of the user can be obtained through a depth camera, and the current human body parameters of the current human body parametric model can be obtained from the current depth image information using a deep learning algorithm, and the current human body parameters can be used to construct a current human body three-dimensional model with a body shape that is consistent or similar to the user; then the current body information of the user is obtained based on the current human body three-dimensional model. The current body information may include: the user's current chest size data, current waist size data, current torso height data, and current human body height data.

[0055] The user's current physiological data, such as blood pressure, pulse, etc., can be obtained through detection equipment.

[0056] Step S22: Generate a fitness plan based on the current body information, target body information and user physiological data, and push the fitness plan to the fitness equipment.

[0057] A fitness plan can be generated based on the difference between each body data in the current body information and the corresponding body data in the target body information, the association between each body information, the relationship between body information and food, the relationship between body information and exercise, user physiological data, and the relationship between user physiological data and exercise and food.

[0058] Step S23: Generate a diet plan based on the current body information, target body information and user physiological data, and push the diet plan to the diet device.

[0059] A diet plan can be generated based on the difference between each body data in the current body information and the corresponding body data in the target body information, the association between each body information, the relationship between body information and food, the relationship between body information and exercise, user physiological data, and the relationship between user physiological data and exercise and food.

[0060] Based on the above embodiments, this embodiment associates the user's physiological data with the fitness plan and diet plan, and can generate a fitness plan and a diet plan based on the user's current body information, target body information and user physiological data, which is more in line with the user's own situation and can further improve the efficiency and effectiveness of the user's fitness and diet management.

[0061] In other embodiments, the execution order of the above step S22 and the above step S23 is not limited, or the device linkage management method can omit the above step S22 or the above step S23.

[0062] This application further proposes another embodiment of a device linkage management method, such as Figure 3 As shown, Figure 3This is a flow chart of an embodiment of the device linkage management method of the present application. The device linkage management method of this embodiment specifically includes the following steps:

[0063] Step S31: Obtain the user's current body information and target body information.

[0064] Step S32: Generate a fitness plan based on the current body information and the target body information, and push the fitness plan to the fitness equipment.

[0065] Step S33: Generate a diet plan based on the current body information and the target body information, and push the diet plan to the diet device.

[0066] Steps S31 to S33 are similar to the above-mentioned steps S11 to S13 and are not described in detail here.

[0067] In other embodiments, it is also possible to use Figure 2 The method described in the embodiment generates a fitness plan and a diet plan.

[0068] Step S34: Obtaining user motion data of the user during the execution of the fitness program.

[0069] The user's motion data during the user's fitness program is obtained through the fitness equipment and / or the user terminal.

[0070] The user motion data may include the number of steps the user walks, motion trajectory, and running mileage during the execution of a fitness program, and may also include motion posture and amplitude, motion content, motion time, motion intensity, motion quality, and energy consumption, etc.

[0071] Furthermore, while the user is executing a fitness program, the user's exercise movements can be displayed on a display screen, etc., and the user's exercise movements can be identified and the movement amplitude analyzed to provide movement guidance and error correction.

[0072] For example, a depth camera can be used to obtain depth image information of a user during a fitness program, and a deep learning algorithm can be used to obtain the user's body shape parameters and posture parameters (including posture parameters and joint point parameters) from the depth image information, and these parameters can be used to drive the above-mentioned human body three-dimensional model to present the user's body shape and movement during the fitness program. The user's movement process can be further analyzed.

[0073] The depth camera can obtain the depth image information of the user at multiple angles, and use the depth image information at multiple angles to drive the human body 3D model; the multiple angles of the human body 3D model respectively show the multiple angles of the user. The human body 3D model can be rotated to show different angles of the human body 3D model; when the historical human body 3D model is driven by the human body parameter set, the historical human body 3D models at different angles can move based on the corresponding human body parameters.

[0074] Two or more identical three-dimensional human body models can be established based on the user's depth image information (one model can be established and then copied), and presented on the same interface to show the user's current body shape, target body shape, and any two or more time points during the execution of the fitness plan.

[0075] In order to increase the comparability of users' multi-angle shapes, multiple angles of the human body three-dimensional model are presented in the same interface.

[0076] It is also possible to simultaneously present multiple angles of the three-dimensional human body model corresponding to multiple time points on the same interface.

[0077] The user's physiological data during the user's fitness program can be further obtained to analyze the user's physiological condition.

[0078] Step S35: Acquire the user's dietary data during the user's dietary regimen.

[0079] The dietary data of the user during the period when the user performs the dietary regimen is obtained through the dietary device.

[0080] User dietary data includes ingredient name, quantity, and eating time, and may also include the nutritional content and calories of the ingredients.

[0081] Step S36: Generate fitness suggestions based on the fitness plan and user motion data, and push the fitness suggestions to the fitness device.

[0082] This embodiment further generates fitness suggestions based on the fitness plan and the user's motion data during the execution of the fitness plan, which can associate the user's actual exercise and fitness status with fitness diet management; the fitness suggestions are pushed to the fitness equipment so that the fitness equipment can reasonably adjust the fitness plan according to the fitness suggestions, thereby improving the effect of the user's fitness diet management.

[0083] Step S37: Generate dietary advice based on the dietary plan and the user's dietary data, and push the dietary advice to the dietary device.

[0084] This embodiment further generates dietary recommendations based on the dietary plan and the user's dietary data during the execution of the dietary plan, which can link the user's actual dietary status to fitness dietary management; the dietary recommendations are pushed to the dietary equipment so that the dietary equipment can reasonably adjust the dietary plan according to the dietary recommendations, thereby improving the effect of the user's fitness dietary management.

[0085] In other embodiments, the execution order of the above steps S34 and S36 and the above steps S35 and S37 is not limited, or the device linkage management method can omit the above steps S34 and S36 or the above steps S35 and S37.

[0086] Optionally, this embodiment may adopt Figure 4 The method shown implements step S37, and the method of this embodiment includes steps S41 to S43.

[0087] Step S41: Acquire current food information in the food equipment.

[0088] Ingredient information includes ingredient name, ingredient quantity, ingredient nutritional composition and calories, etc.

[0089] Step S42: Generate dietary recommendations based on the dietary plan, user dietary data, user exercise data, and current food information.

[0090] This embodiment further associates the current ingredient information with the dietary advice, and can generate dietary advice based on the existing ingredient information, thus avoiding the problem that the dietary advice cannot be executed in real time.

[0091] This embodiment further associates the user's exercise data with dietary recommendations, which can further associate diet with exercise, and can improve the efficiency and effectiveness of fitness diet management.

[0092] Step S43: Push the dietary recommendations to the dietary equipment.

[0093] On the basis of the above embodiments, this embodiment further associates the user's actual exercise and fitness status with fitness and diet management, and associates the user's actual diet status with fitness and diet management, which can improve the effect of the user's fitness and diet management.

[0094] Optionally, the fitness plan and / or diet plan obtained by the above method may also be pushed to a user terminal, so that the user can view the fitness plan and diet plan through the user terminal.

[0095] The user terminal may be a smart phone, etc., and is not specifically limited.

[0096] The above embodiments may be used in user terminals or other linkage management devices.

[0097] This application further proposes a device linkage management method, such as Figure 5 As shown, Figure 5 1 is a flow chart of an embodiment of the device linkage management method of the present application. The device linkage management method of the present embodiment specifically includes the following steps:

[0098] Step S51: Obtain the user's current body information and target body information.

[0099] The fitness device obtains the current body information and target body information of the user to obtain a fitness program according to the current body information and the target body information.

[0100] The fitness equipment may be integrated with a depth camera to obtain the user's current body information and target body information through the depth camera. For specific implementation methods, please refer to the above embodiments.

[0101] The fitness equipment can generate a fitness plan based on the difference between each body data in the current body information and the corresponding body data in the target body information, the association between each body information, the relationship between body information and exercise, etc.

[0102] Step S52: Generate a fitness plan based on the current body information and the target body information, and push the fitness plan to the fitness equipment.

[0103] Fitness equipment gives fitness suggestions based on fitness plans.

[0104] The fitness device can give fitness suggestions according to the fitness plan based on the user's exercise history (actual exercise content, exercise quality, exercise time, calorie consumption, etc.).

[0105] Before executing a fitness program, the fitness device can obtain the current user's physiological data and give fitness suggestions based on the user's physiological data and the fitness program, so that the user can exercise while ensuring physical health.

[0106] For specific implementation manner, please refer to the above embodiments.

[0107] Step S53: Identify the sports field to determine the designated location in the sports field; and prompt the user to exercise at the designated location.

[0108] The fitness device identifies the sports venue to determine a designated location in the sports venue; and prompts the user to exercise at the designated location.

[0109] Fitness equipment can determine the designated location of the sports venue through a positioning system so that users can exercise at the designated location.

[0110] Step S54: Identify the movement of the user at the designated location to obtain user movement data.

[0111] The fitness device identifies the movement of a user at a specified location to obtain the user's movement data.

[0112] Before executing the fitness program, the fitness equipment identifies and locates the sports venue, reminds the user to go to the designated location, and guides the user to warm up before exercise by demonstrating movements, such as moving joints. During the execution of the fitness program, the fitness equipment automatically identifies the user's movement, analyzes the movement range and movement quality (whether the movement is in place); the fitness equipment records the corresponding user movement data, including: movement content, movement time, movement intensity, movement quality, energy consumption and other information.

[0113] Furthermore, when the user does not exercise at the designated location on time, the fitness device pushes a reminder message to the user terminal; when the user's exercise movements are not in place, the fitness device guides the user through the display screen.

[0114] Furthermore, the fitness equipment automatically identifies the user's identity, and if the user is an unregistered user, reminds the user to register his / her identity.

[0115] This application further proposes a device linkage management method, such as Figure 6 As shown, Figure 6 1 is a flow chart of an embodiment of the device linkage management method of the present application. The device linkage management method of the present embodiment specifically includes the following steps:

[0116] Step S61: Obtain the user's current body information and target body information.

[0117] Step S62: Generate a fitness plan based on the current body information and the target body information, and push the fitness plan to the fitness equipment.

[0118] Step S63: Identify the sports field to determine the designated location in the sports field; and prompt the user to exercise at the designated location.

[0119] The specific implementation of steps S61 to S63 may refer to the above embodiments.

[0120] Step S64: instructing the user to perform a preset action to determine whether the user is suitable for exercise.

[0121] The fitness device instructs the user to perform preset actions to determine whether the user is suitable for exercise.

[0122] Step S65: If the user is suitable for exercise, the exercise status of the user at the designated location is identified to obtain user exercise data.

[0123] If the user is suitable for exercise, the fitness device identifies the user's exercise status at the designated location to obtain the user's exercise data.

[0124] Before exercise, the fitness equipment will recognize and analyze the user's face and body shape, analyze the user's physical condition, and determine whether the user is suitable for the corresponding exercise. During exercise, the user's face and body shape will be recognized and analyzed, and if any emergency is found, the corresponding emergency treatment will be carried out.

[0125] For example, fitness equipment instructs users to strike a specific posture facing a display screen at a designated location through action demonstrations (such as users striking a natural posture: such as keeping the angle between the arms and torso at about 30 degrees, or keeping the arms horizontal, hanging down, etc.), or perform a series of turning movements at a designated location (such as users turning around continuously for one or several weeks; during the rotation process, the user pauses every time they rotate a certain angle (such as 90 degrees, 120 degrees, etc.)). The fitness equipment captures the user's face and body video or image, and performs recognition and analysis. If it is determined that the user's physical condition does not allow the corresponding exercise, the user will be given a corresponding alarm.

[0126] This application further proposes a device linkage management method, such as Figure 7 As shown, Figure 7 1 is a flow chart of an embodiment of the device linkage management method of the present application. The device linkage management method of the present embodiment specifically includes the following steps:

[0127] Step S71: Obtain the user's current body information and target body information.

[0128] Step S72: Generate a diet plan based on the current body information and the target body information, and push the diet plan to the diet device.

[0129] The diet equipment may be integrated with a depth camera to obtain the user's current body information and target body information through the depth camera. For specific implementation methods, please refer to the above embodiments.

[0130] The diet device can generate a diet plan based on the difference between each body data in the current body information and the corresponding body data in the target body information, the association between each body information, the relationship between the body information and the food, etc.

[0131] The diet plan includes whether to replenish water, functional drinks, special supplementary foods during exercise, the time and amount of replenishment; the time, frequency, and amount of meals before and after exercise; the content of dietary reinforcement for special purposes; in order to achieve fitness exercise effects, daily food combination arrangements (food calories, salt, cooking oil, business substance intake control), etc.

[0132] Step S73: Identify the user identity and access food information.

[0133] Food equipment identifies the user and stores and accesses food information.

[0134] For example, the refrigerator automatically recognizes the identity of the person who opens the refrigerator door, that is, the user identity, recognizes the names of the ingredients stored in and taken out, records the time when the ingredients are stored in and taken out, records the amount of ingredients used, calculates the nutritional content and calories of the ingredients, etc.

[0135] The refrigerator considers the refrigerator door opener as the user of the corresponding food (the above-mentioned user) by default. If the refrigerator door opener is not the user of the food, the refrigerator door opener needs to specify the user of the food.

[0136] For another example, the water dispenser automatically identifies the identity of the user (the above-mentioned user) and records information such as the time of water extraction and water usage.

[0137] Step S74: Determine the user's dietary data based on the user's identity and the stored and accessed food information.

[0138] The dietary equipment determines the dietary data of the user according to the user identity and the stored and accessed food information.

[0139] Different users have different eating habits or nutritional requirements. The eating device can determine the user's eating data based on the user's identity and the information on stored and accessed ingredients (which reflects the user's eating habits).

[0140] Step S75: Give dietary advice based on the dietary plan and the user's dietary data.

[0141] The diet device gives diet suggestions based on the diet plan and user diet data.

[0142] The dietary device gives dietary suggestions based on the dietary plan formulated above and the user's actual dietary data, so that the dietary suggestions are more in line with the user's identity and user habits, thereby improving the effect of dietary management.

[0143] The diet device can give diet suggestions based on the user's actual eating habits, such as actual drinking time, drinking amount, eating time, food type and portion size, etc. according to the diet plan and diet data.

[0144] Before executing the diet plan, the diet device can obtain the current physiological data of the user and give diet suggestions based on the physiological data of the user and the diet plan, so that the user can eat while ensuring good health.

[0145] The present application further proposes a device linkage management system, which includes a user terminal, fitness equipment, dietary equipment, a drinking water terminal and a processing system, and the processing system can be set on the user terminal.

[0146] Among them, when the user uses the processing system for the first time, the user basic information needs to be registered; various user information can be shared among user terminals, fitness equipment, dietary equipment, and drinking water equipment, and the processing system records the user's login information on the user terminal, fitness equipment, dietary equipment, and drinking water equipment.

[0147] The user terminal can obtain the user's walking steps, movement trajectory, running mileage and other sports data, and can obtain the user's blood pressure, pulse and other data. Fitness equipment, meal equipment, and drinking water equipment can push reminder messages to the user terminal, such as reminding the user through voice alarms.

[0148] The fitness equipment records the user's fitness exercise in real time, displays the fitness exercise in real time through the display screen, and guides and corrects the user's exercise movements. It also has functions such as user identity recognition, exercise process analysis, and physiological condition analysis. For details, please refer to the above embodiments.

[0149] The dietary equipment can store food ingredients and has the functions of user identification, food ingredient identification, food ingredient record, and user food ingredient usage record. The dietary equipment automatically identifies the identity of the person who opens the door, identifies the food ingredients that are stored and taken out, records the storage and retrieval time, records the amount of food ingredients used, and calculates the nutritional content and calories of food ingredients. The dietary equipment considers the person who opens the door to be the user of the corresponding food ingredients by default. If the person who opens the door is not the user of the food ingredients, the person who opens the door needs to specify the user of the food ingredients. The dietary equipment aggregates the information related to the food ingredients and their users into the processing system. When the user fails to collect the food of the dietary plan at the dietary equipment on time, the dietary equipment pushes a prompt message to the user terminal.

[0150] The drinking water equipment has the functions of user identification and user drinking water record. The drinking water equipment automatically identifies the user's identity, records the water collection time and water consumption. The drinking water equipment collects the drinking water and its user-related information into the processing system. When the user fails to collect water from the drinking water equipment on time, the drinking water equipment pushes a reminder message to the user terminal.

[0151] The processing system includes a business logic module and an expert system module, which summarizes and analyzes the user's exercise, physiological information, nutrition and other information, formulates user fitness and diet plans, and pushes the plans to user terminals, fitness equipment, dietary equipment, and drinking water equipment. (The processing system summarizes the user's exercise data collected by the fitness equipment and user terminals in real time, and analyzes and evaluates the user's current exercise volume and exercise energy consumption. The processing system summarizes the user's dietary data collected by the dietary equipment and drinking water equipment in real time, and analyzes and evaluates the user's current diet volume and nutritional composition. The processing system formulates user fitness and diet plans based on the user's current physical, exercise, and diet conditions, and pushes the plans to user terminals, fitness equipment, dietary equipment, and drinking water equipment through messages; after receiving the fitness plan information, the fitness equipment is ready to start supervising and guiding the user's exercise, after receiving the information, the drinking water equipment prepares the corresponding drinking water in advance, and after receiving the information, the dietary equipment prepares the corresponding functional diet in advance, so that the terminal can notify the user to exercise, get water, and get food before the timer expires after receiving the information.

[0152] Among them, the user information involved in this equipment linkage management system includes:

[0153] User basic information: identity, age, gender, etc.

[0154] User's physical condition: historical records of height, weight, blood type, blood pressure, complexion, body shape, etc.

[0155] The fitness information involved in this equipment linkage management system includes:

[0156] Fitness plan: exercise time, exercise content, exercise intensity; exercise content for special purposes.

[0157] Fitness records: blood pressure, pulse, breathing records before, during and after exercise, user's physical condition score (whether suitable for exercise); exercise history records (actual exercise content, exercise quality, exercise time, calorie consumption, etc.).

[0158] The dietary information involved in this equipment linkage management system includes:

[0159] Diet plan: whether to replenish water, functional drinks, special supplementary foods during exercise, the time and amount of replenishment; the time, frequency, and amount of meals before and after exercise; the content of dietary reinforcement for special purposes; in order to achieve fitness exercise effects, daily food combination arrangement plan (food calories, salt, cooking oil, and business substance intake control).

[0160] User diet records: actual drinking time, drinking amount, eating time, food type and portion size.

[0161] In an application scenario, such as Figures 8 to 10As shown, the fitness equipment can be a magic mirror, the dietary equipment can be a refrigerator, and the drinking water equipment can be a water dispenser. The user logs in to the user's personal interface through the face recognition function of the magic mirror; the magic mirror starts to measure the user's body shape, and links the electronic weight scale information (it can match the historical weight data and update the weight scale information to the user's record) to evaluate the body shape; according to the fitness goals entered by the user (such as muscle gain, fat loss, etc.) and the body evaluation of the magic mirror, a personalized overall fitness plan is generated for the user, including a fitness plan, a drinking water plan, and a dietary plan.

[0162] Assume user A is male, 30 years old, and his goal is to gain muscle. Based on the user's body assessment, the fitness plan is as follows:

[0163] Fitness plan: Push-ups, it is recommended to do 30 in a set, about 4 sets; arm flexion and extension, it is recommended to do 10 in a set, about 4 sets; supine dumbbell press, 8-12 in a set, about 4 sets.

[0164] Drinking water plan: The recommended daily water intake needs to reach 1800ml; based on the user's water intake, remind the user to drink water regularly.

[0165] Dietary plan: 300g of meat; 500g of vegetables; 500g of fruit.

[0166] When following a fitness regimen:

[0167] When users are working out, Magic Mirror provides fitness instruction videos and records the duration and content of the workout. After the workout, it calculates the calories consumed, measures the user's body shape, and compares the measurement results with those before the workout to provide fitness advice to the user. Based on the calories consumed by the user, the body measurement results after the workout, the physical condition (blood pressure, pulse, etc.) recorded when the user registered, and the ingredients available in the user's refrigerator, Magic Mirror customizes personalized fitness meals for the user and provides corresponding preparation methods. It reminds users to drink water 10 minutes after the workout to avoid causing some gastrointestinal discomfort.

[0168] When the user receives water, the water dispenser uses the built-in camera of the water dispenser to perform facial recognition to determine the identity of the water receiver, and updates the amount of water received and the time of water received to the user's drinking record. At the same time, the water dispenser will remind the user to drink water at 8:00, 12:00, and 18:00 every day, and broadcast the total amount of water the user drinks today and how many milliliters of water he needs to drink. (Users can also customize the timed broadcast function of the water dispenser).

[0169] When the user opens the refrigerator, the refrigerator uses the built-in camera to perform facial recognition to determine the user's identity. When placing ingredients, the corresponding food type (meat, vegetables, fruits, etc.) is recorded and these ingredients are updated to the existing ingredient records in the user's refrigerator. When taking ingredients, the corresponding ingredient records are updated to used. Nutritional intake is assessed based on the user's daily diet, and dietary recommendations are provided to users based on the fitness status recorded in the linked magic mirror.

[0170] In the processing system, fitness plan = body assessment before fitness + fitness goals + physical condition; drinking plan = body assessment + physical condition; diet plan = calories consumed during fitness + ingredients in the user's refrigerator + body assessment after fitness + physical condition.

[0171] This application further proposes a device linkage management device, such as Fig.11 As shown, Fig.11 It is a structural diagram of an embodiment of the device linkage management device of the present application. The device can adopt software modules or hardware modules, or a combination of the two to become a part of the computer device, and the device includes: an information acquisition module 151, a plan generation module 152 and a plan push module 153, wherein the plan generation module 152 is connected to the information acquisition module 151 and the plan push module 153, the information acquisition module 151 is used to obtain the user's current body information and target body information; the plan generation module 152 is used to generate a fitness plan based on the current body information and the target body information, and / or generate a diet plan based on the current body information and the target body information; the plan push module 153 is used to push the fitness plan to the fitness equipment, and / or push the diet plan to the diet equipment.

[0172] The device can also implement the device linkage management method of the above embodiment.

[0173] For the specific definition of the device linkage management device, please refer to the definition of the device linkage management method above, which will not be repeated here. Each module in the above-mentioned device linkage management device can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

[0174] This application provides a method, system, and device for the linkage management of sports and fitness equipment and healthy diet in a smart home environment. This application records the user's sports status and dietary status, summarizes and analyzes the user's sports information, body information, nutritional information, etc., and then manages and arranges the user's sports diet, daily diet, and sports and fitness in a linkage manner, realizing two-way linkage and automatic message push between sports and fitness and healthy diet, and achieving the purpose of "controlling your mouth and moving your legs".

[0175] This application realizes the intelligent interconnection of furniture and appliances such as smart terminals, smart fitness appliances, smart refrigerators, smart water dispensers, and weight scales in a smart home environment.

[0176] The present application further proposes an electronic device, such as Fig.12 As shown, Fig.12 The electronic device 100 of the present embodiment includes a processor 101 , a memory 102 coupled to the processor 101 , an input / output device 103 , and a bus 104 .

[0177] The processor 101 , the memory 102 , and the input / output device 103 are respectively connected to the bus 104 . The memory 102 stores program data, and the processor 101 is used to execute the program data to implement the above-mentioned device linkage management method.

[0178] The controller in the above embodiment may be integrated into the processor 101 .

[0179] In this embodiment, the processor 101 may also be referred to as a CPU (Central Processing Unit). The processor 101 may be an integrated circuit chip having signal processing capabilities. The processor 101 may also be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. A general-purpose processor may be a microprocessor or the processor 101 may also be any conventional processor, etc.

[0180] The present application further proposes a computer-readable storage medium, such as Fig.13 As shown, the computer readable storage medium 160 of this embodiment is used to store the program data 161 of the above embodiment, and the program data 161 can be executed to implement the above device linkage management method. The program data 161 has been described in detail in the above method embodiment and will not be repeated here.

[0181] The computer-readable storage medium 160 of this embodiment may be, but is not limited to, a USB flash drive, an SD card, a PD optical drive, a mobile hard disk, a large-capacity floppy drive, a flash memory, a multimedia memory card, a server, and the like.

[0182] Different from the prior art, the device linkage management method of the present application first obtains the user's current body information and target body information, and generates a fitness plan and / or diet plan based on the user's current body information and target body information. It can not only intelligently generate fitness plans and diet plans, but also associate fitness plans with diet plans, that is, the management of the user's body is achieved through the linkage management of fitness plans and diet plans; then the fitness plan is pushed to the fitness equipment, and the diet plan is pushed to the diet equipment, so that the fitness equipment manages the user's sports and fitness based on the fitness plan, and the diet equipment manages the user's daily diet or sports diet based on the diet plan. In this way, the present application can realize the intelligent equipment linkage management of fitness and diet, and can manage the user's sports and fitness and diet in a linkage manner, thereby improving the efficiency and effectiveness of the user's fitness and diet management.

[0183] In one embodiment, a computer program product or computer program is provided, the computer program product or computer program includes computer instructions, the computer instructions are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the steps in the above-mentioned method embodiments.

[0184] In addition, if the above functions are implemented in the form of software functions and sold or used as independent products, they can be stored in a storage medium readable by a mobile terminal, that is, the present application also provides a storage device storing program data, the program data can be executed to implement the method of the above embodiment, and the storage device can be, for example, a USB flash drive, an optical disk, a server, etc. In other words, the present application can be embodied in the form of a software product, which includes a number of instructions for enabling a smart terminal to execute all or part of the steps of the method described in each embodiment.

[0185] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0186] Any process or method description in a flowchart or otherwise described herein may be understood to represent a mechanism, segment or portion of a code that includes one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0187] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing the logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (which can be a personal computer, server, network device or other system that can fetch instructions from the instruction execution system, device or apparatus and execute the instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purpose of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or more wires (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.

[0188] The above description is only an implementation method of the present application, and does not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly used in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A device linkage management method, characterized in that: include: Get the user's current body information and target body information; Generate a fitness plan based on the current body information and the target body information, and push the fitness plan to the fitness device; Generate a diet plan based on the current body information and the target body information, and push the diet plan to a diet device; The step of obtaining the user's current body information includes: Use the depth camera to obtain the user's current depth image information; Reconstructing a current three-dimensional human body model of the user based on the depth image information; Obtaining current body information of the user based on the current three-dimensional human body model; The method further comprises: The three-dimensional human body model of the user at present, at target and at multiple time points during the execution of the fitness program is displayed on the same interface.

2. The device linkage management method according to claim 1, characterized in that: Also includes: Obtain user physiological data; The generating a fitness program based on the current body information and the target body information comprises: Generate the fitness program based on the current body information, the target body information and the user's physiological data; The step of generating a diet plan based on the current body shape information and the target body shape information includes: The diet plan is generated based on the current body information, the target body information and the user's physiological data.

3. The device linkage management method according to claim 1, characterized in that: The diet plan includes a meal plan and a drinking water plan, and the diet equipment includes a meal equipment and a drinking water equipment; The step of pushing the diet plan to the diet device comprises: The meal plan is pushed to the meal device, and the drinking water plan is pushed to the drinking water device.

4. The device linkage management method according to claim 1, characterized in that: Also includes: acquiring user motion data of the user during execution of the fitness program; and / or, Acquiring user dietary data of the user during the period of executing the dietary plan; Generate fitness suggestions based on the fitness plan and the user motion data, and push the fitness suggestions to the fitness device; and / or, Based on the diet plan and the user diet data, a diet suggestion is generated, and the diet suggestion is pushed to the diet device.

5. The device linkage management method according to claim 4, characterized in that: The generating a dietary suggestion based on the dietary plan and the user dietary data comprises: Obtaining current food information in the food equipment; The dietary suggestion is generated based on the dietary plan, the user dietary data, the user exercise data and the current food information.

6. The device linkage management method according to claim 1, characterized in that: Also includes: The fitness plan and / or the diet plan are pushed to a user terminal.

7. The device linkage management method according to claim 1, characterized in that: Also includes: Identify the sports venue to determine a designated location in the sports venue; and prompt the user to exercise at the designated location; The movement of the user at the designated location is identified to obtain the user movement data.

8. The device linkage management method according to claim 1, characterized in that: Also includes: Instruct the user to perform preset actions to determine whether the user is suitable for exercise.

9. The device linkage management method according to claim 4, characterized in that: The obtaining of the user's dietary data during the period when the user executes the dietary plan includes: Identify user identities and access food information; The user dietary data is determined according to the user identity and the stored and accessed food information.

10. An electronic device, characterized in that: include: A memory and a processor coupled to each other, wherein the processor is used to execute program data stored in the memory to implement the device linkage management method according to any one of claims 1 to 9.

11. A computer storage medium, characterized in that: Program data is stored thereon, and the program data can be executed to implement the device linkage management method described in any one of claims 1 to 9.

12. A computer program product, characterized in that It includes computer program instructions, and the computer program instructions enable a computer to implement the device linkage management method according to any one of claims 1 to 9.

Images