Health support device, health support system, and method for supporting health

Abstract

To support health by providing useful information on eating according to the need of each person.SOLUTION: A health support device 2 includes an estimation unit 232, a mastication evaluation unit 233, and an information provision unit 239. The estimation unit 232 estimates a food menu on the basis of image data of food that a user eats. The mastication evaluation unit 233 acquires a mastication evaluation value representing the frequency of mastications, the mastication evaluation value corresponding to the menu estimated by the estimation unit 232. The information provision unit 239 provides information based on the mastication evaluation unit acquired by the mastication evaluation unit 233.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a health support device, a health support system, and a health support method. [Background technology]

[0002] With the advent of an aging society, there is a demand for support to extend healthy lifespan so that each individual can stay healthy for as long as possible. Diet has a large impact on maintaining health. There is therefore a device that provides advice on diet for maintaining health (for example, see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2011-221637 A Summary of the Invention [Problem to be solved by the invention]

[0004] In order to maintain good health, in addition to the content of one's diet, it is also important to maintain good oral function for eating. If oral function declines, the ability to chew declines and people tend to eat soft foods, which can lead to a decrease in appetite and malnutrition.

[0005] In view of the above circumstances, an object of the present invention is to provide a health support device, a health support system, and a health support method that can support health by providing useful information about eating tailored to an individual. [Means for solving the problem]

[0006] One aspect of the present invention is a health support device comprising: an estimation unit that estimates a meal menu based on image data of a user's meal; a chewing evaluation unit that acquires a chewing evaluation value corresponding to the menu estimated by the estimation unit, the chewing evaluation value indicating the frequency of chewing; and an information provision unit that provides information based on the chewing evaluation value.

[0007] One aspect of the present invention is the health support device described above, wherein the chewing evaluation unit calculates a total chewing evaluation value indicating the number of chews required to eat the meal based on the chewing evaluation value corresponding to the estimated menu.

[0008] One aspect of the present invention is the health support device described above, further comprising an acquisition unit that acquires food intake information indicating the classification of ingredients or the ingredients used in the menu estimated by the estimation unit, a determination unit that determines one or both of a nutrient sufficiency status and a food intake diversity score sufficiency status for a dietary intake target based on the food intake information acquired by the acquisition unit, and a diet evaluation unit that evaluates a diet using the chewing evaluation value and the sufficiency status.

[0009] One aspect of the present invention is the above-mentioned health support device, wherein the meal evaluation unit evaluates the user's meal using the chewing evaluation value and the satisfaction state based on the image data, and information regarding the user's biological body.

[0010] One aspect of the present invention is the health support device described above, wherein the information regarding the living body includes one or more of weight, appetite, height, body mass index, body fat, skeletal muscle mass, bone mass, and lean body mass.

[0011] One aspect of the present invention is the above-mentioned health support device, further comprising a receiving unit that receives the image data from a terminal device used by the user, and the information providing unit comprises a return unit that returns to the terminal device one or both of the total chewing evaluation value based on the image data received by the receiving unit and the evaluation result by the dietary evaluation unit.

[0012] One aspect of the present invention is the above-mentioned health support device, further comprising a memory unit that stores, for each user, historical information indicating a history of at least a portion of the image data, the total chewing evaluation value, the satisfaction state, and the evaluation results by the diet evaluation unit, and the information providing unit comprises an information output unit that outputs one or both of individual user information obtained from the historical information and information regarding multiple users.

[0013] One aspect of the present invention is the health support device described above, wherein the user-specific information output by the information output unit includes at least one of the image data, the number of times the image data is received, information based on the total chewing evaluation value in a time series, the satisfaction status in a time series, and the evaluation result in a time series.

[0014] One aspect of the present invention is the above-mentioned health support device, further comprising an advice selection unit that selects advice information based on information obtained from the user's historical information, and the information output unit outputs the advice information selected by the advice selection unit.

[0015] One aspect of the present invention is the health support device described above, wherein the advice selection unit selects advice information based on information obtained from the history information of the user and information regarding a biological body of the user.

[0016] One aspect of the present invention is the health support device described above, wherein the information related to a living body used by the advice selection unit is one or both of weight information and appetite information.

[0017] One aspect of the present invention is the health support device described above, wherein the mastication evaluation value and the total mastication evaluation value indicate one of a plurality of stages corresponding to the frequency of mastication.

[0018] One aspect of the present invention is the health support device described above, wherein the chewing evaluation value corresponding to the menu is based on one or more of the number of chews measured for the menu, or the hardness of ingredients included in the menu, the cutting method of ingredients included in the menu, and the cooking method of the menu.

[0019] One aspect of the present invention is a health support system having an estimation unit that estimates a meal menu based on image data of a user's meal, a chewing evaluation unit that acquires a chewing evaluation value corresponding to the menu estimated by the estimation unit, the chewing evaluation value indicating the number of chews, and an information provision unit that provides information based on the chewing evaluation value.

[0020] One aspect of the present invention is a health support method executed by a health support device, the health support method having an estimation step of estimating a meal menu based on image data of a user's meal, a chewing evaluation step of acquiring a chewing evaluation value corresponding to the menu estimated in the estimation step, the chewing evaluation value indicating the frequency of chewing, and an information provision step of providing information based on the chewing evaluation value. Effect of the Invention

[0021] The present invention makes it possible to provide useful information about eating in a personalized manner to support health. [Brief description of the drawings]

[0022] [Figure 1] 1 is a diagram showing an example of the configuration of a health support system according to an embodiment of the present invention; [Diagram 2] FIG. 13 is a diagram showing an example of menu-specific chewing value information according to the embodiment. [Diagram 3] FIG. 11 is a diagram showing an example of history information according to the embodiment. [Figure 4] FIG. 13 is a diagram showing an example of advice selection information according to the embodiment. [Diagram 5] FIG. 2 is a diagram showing the operation of the health support system according to the embodiment. [Figure 6] FIG. 2 is a diagram showing the operation of the health support system according to the embodiment. [Figure 7] FIG. 13 is a diagram showing a screen displayed on a terminal device according to the embodiment. [Figure 8] FIG. 13 is a diagram showing a screen displayed on a terminal device according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0023] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. FIG. 1 is a diagram showing an example of the configuration of a health support system 1 according to an embodiment of the present invention. The health support system 1 shown in the figure includes a health support device 2, a terminal device 3, and a terminal device 4. The health support device 2, the terminal device 3, and the terminal device 4 are each connected to a network 9. The network 9 is a communication network including a public network such as the Internet, and a private network such as an intranet, a LAN (Local Area Network), and a dedicated line. The health support device 2 and the terminal device 3, and the health support device 2 and the terminal device 4 transmit and receive data via the network 9. Although one each of the terminal device 3 and the terminal device 4 are shown in the figure, the number of the terminal devices 3 and the number of the terminal devices 4 are arbitrary.

[0024] For example, a business providing a health support service owns a health support device 2. A user uses a terminal device 3, and an advice provider who gives advice to the user uses a terminal device 4. The users are, for example, but are not limited to, patients at dental clinics, hospitals, clinics, etc., patients with oral hypofunction, patients with oral hypodevelopment, elderly people, people who are concerned about the decline or development of oral function, people who want to prevent the decline of oral function, people who want to promote the development of oral function, etc. In addition, advice providers are, but are not limited to, organizations that provide health guidance in dental clinics, hospitals including oral surgery, etc., hospitals and clinics other than dental clinics, local governments, etc. In the following, an example will be described in which the user is a patient at a dental clinic and the advice provider is a dental clinic.

[0025] A user transmits meal image data, which is image data obtained by photographing a meal using a terminal device 3, to the health support device 2. The health support device 2 estimates a meal menu based on the meal image data, and obtains a mastication evaluation value corresponding to the estimated menu. The mastication evaluation value corresponding to the menu indicates the number of times of mastication required to eat food of that menu. The health support device 2 calculates a total mastication evaluation value, which is a comprehensive mastication evaluation value for one photographed meal, based on the mastication evaluation value for each menu. The total mastication evaluation value indicates the number of times of mastication required to eat a meal of the estimated menu. Furthermore, the health support device 2 calculates a dietary diversity score (DVS) and the intake of various nutrients for the meal of the estimated menu, and calculates the satisfaction level for those goals.

[0026] Each time the health support device 2 receives meal image data from the terminal device 3, it feeds back to the terminal device 3 an evaluation of the meal based on the mastication evaluation value, the satisfaction level of the DVS, the satisfaction level of various nutrients, etc. The overall mastication evaluation value, which is one of the pieces of information based on the mastication evaluation value, may be used to evaluate the meal. In this way, by providing feedback each time the user transmits meal image data, it is possible to motivate the user to try to eat meals that will be well evaluated. Furthermore, the feedback allows the user to enjoy the kind of evaluation he or she will receive in a game-like manner, which encourages the user to continue transmitting meal image data.

[0027] The health support device 2 stores history information indicating each user's meal image data, total mastication evaluation value, DVS sufficiency, various nutrient sufficiency, dietary evaluation, etc. The health support device 2 further stores each user's biological information such as weight and appetite. The health support device 2 acquires information used by the dental clinic to provide advice on eating to the user based on information obtained from the history information, and transmits it to the terminal device 4. The information provided to the dental clinic includes information based on the time series total mastication evaluation value, the time series DVS sufficiency, the time series nutrient sufficiency, the time series weight and appetite, etc. The information provided to the dental clinic further includes advice based on the total mastication evaluation value, the DVS sufficiency, the various nutrient sufficiency, the latest values ​​and time series changes of weight and appetite. The dental clinic refers to the information received by the terminal device 4 to explain oral function and diet to the user and give advice. This allows users to receive advice from dental clinics on how to improve their oral function and how to eat a balanced diet, which helps maintain and improve their health. In addition, it is possible to improve the added value of the dental clinic owned by the user, and to support users in continuing to use the dental clinic on a regular basis.

[0028] The configuration of each device will be described. Health support device 2 is realized by a computer device such as a server computer. Health support device 2 includes a communication unit 21, a storage unit 22, and a processing unit 23. Communication unit 21 transmits and receives information via network 9.

[0029] The storage unit 22 stores various information, such as menu-specific mastication value information, menu-specific classification information, nutrient information, user management information, history information, biological information, advice provider information, and advice selection information.

[0030] The menu-specific chewing value information indicates the chewing evaluation value of each menu. The menu-specific classification information indicates the food classification to which the ingredients used in each menu belong. The food classification indicates the classification of food for calculating DVS. The food classification includes seafood, meat, eggs, milk, soybean products, green and yellow vegetables, seaweed, potatoes, fruits, and oils and fats. Seafood, meat, eggs, milk, and soybean products are classified into the protein group, green and yellow vegetables and seaweed into the vitamin and mineral group, and potatoes, fruits, and oils and fats into the energy group. The storage unit 22 may store menu-specific ingredient information instead of or in addition to the menu-specific classification information. The menu-specific ingredient information indicates the ingredients used in each menu and their amounts. The nutrient information indicates the nutrients contained in each menu or each ingredient and their amounts. The nutrients include energy, protein, lipids, carbohydrates, various vitamins, various minerals, dietary fiber, cholesterol, salt, etc.

[0031] The user management information includes information such as the user ID and name of the user, and the address of the user's terminal device 3. The history information indicates the user ID, the meal image data of each meal, the mastication evaluation value of each menu included in the meal, the total mastication evaluation value, the DVS satisfaction state, the satisfaction state of various nutrients, and the evaluation of the meal. The biological information indicates information about the user's biological body, and includes information such as the user ID, sex, date of birth, weight, appetite, height, body mass index (BMI), body fat, skeletal muscle mass, bone mass, and fat free mass. Age information is obtained from the date of birth information. Age is also one of the information about the user's biological body. The information on weight, appetite, height, BMI, body fat, skeletal muscle mass, bone mass, and fat free mass included in the biological information may be time-series information associated with information on the date and time when each of the information was obtained. In this embodiment, the biological information includes weight history information, which is time-series information on weight, and appetite history information, which is time-series information on appetite. The weight history information includes information in which the date and time are associated with weight. The appetite history information includes information associating date and time with information about the appetite felt by the user. The appetite information is indicated, for example, by one of a number of stages ranging from "very strong appetite" to "no appetite." The advice provider information indicates information such as the ID of the advice provider, and the name and contact information of the advice provider. The advice provider may be a dental clinic, hospital, medical clinic, or an organization that provides health guidance in a local government or the like that provides advice to the user.

[0032] The advice selection information is information that associates advice selection conditions with advice to be given to the user when the selection conditions are met. The advice selection conditions may include information obtained from history information or biometric information. The advice selection conditions may further include information on the date and time when the advice is to be given.

[0033] The processing unit 23 includes a receiving unit 231 , an estimating unit 232 , a chewing evaluation unit 233 , an acquiring unit 234 , a determining unit 235 , a meal evaluation unit 236 , an information updating unit 237 , an advice selecting unit 238 , and an information providing unit 239 .

[0034] The receiving unit 231 receives meal image data from the terminal device 3. The receiving unit 231 also receives an information request from the terminal device 4. The estimating unit 232 estimates a meal menu based on the meal image data. Any conventional technology can be used for estimating the meal menu. The chewing evaluation unit 233 acquires the chewing evaluation value of each menu estimated by the estimating unit 232 from the menu-specific chewing value information. The chewing evaluation unit 233 calculates a total chewing evaluation value of the meal based on the chewing evaluation value of each menu included in the meal. In this embodiment, the chewing evaluation value and the total chewing evaluation value indicate which of multiple stages corresponding to the number of chews is present.

[0035] The acquisition unit 234 acquires the food classification of ingredients used in each menu estimated by the estimation unit 232 from the menu-specific classification information, and sets the food intake information as such. The acquisition unit 234 may acquire ingredients used in each menu estimated by the estimation unit 232 and their amounts from the menu-specific ingredient information, and may sum up the amounts acquired for each ingredient as the food intake information.

[0036] The determination unit 235 determines the DVS and the sufficiency of the DVS based on the food category indicated by the food intake information or the food category to which the food ingredient indicated by the food intake information belongs. The determination unit 235 may determine the sufficiency of various nutrients instead of or in addition to the DVS and the sufficiency. The determination unit 235 obtains the nutrients and their amounts corresponding to each menu from the nutrient information and sums up the amounts of the nutrients for each nutrient. The determination unit 235 compares the total amount and the target intake amount for each nutrient to determine the sufficiency of each nutrient. Alternatively, the determination unit 235 refers to the nutrients and their amounts for each food ingredient indicated by the nutrient information and calculates the intake amount of each nutrient according to the food ingredient and its amount indicated by the food intake information. The determination unit 235 compares the total intake amount for each nutrient with the target intake amount to determine the sufficiency of each nutrient.

[0037] The meal evaluation unit 236 evaluates the meal using the total mastication evaluation value and the satisfaction state determined by the determination unit 235. For this satisfaction state, one or both of the DVS satisfaction state and the sufficiency state of various nutrients are used. The meal evaluation unit 236 may evaluate the meal of the user using information on the user's body in addition to the total mastication evaluation value and the satisfaction state. This information on the body includes at least one or two or more pieces of information obtained from the biometric information, including weight, appetite, height, BMI, body fat, skeletal muscle mass, bone mass, and lean body mass.

[0038] The information update unit 237 updates the history information and biological information of each user. The advice selection unit 238 selects advice information based on information obtained from the user's history information. The advice selection unit 238 may select advice information using information on the user's biological body in addition to or instead of the information obtained from the user's history information. The biological information used by the advice selection unit 238 includes one or both of weight and appetite. In addition, other information obtained from the biological information, such as sex and age, may be used as the biological information used by the advice selection unit 238.

[0039] The information providing unit 239 provides information based on the mastication evaluation value, the DVS sufficiency, and the sufficiency of various nutrients to the terminal device 3 and the terminal device 4. The information providing unit 239 has a return unit 241 and an information output unit 242. The return unit 241 returns to the terminal device 3 one or both of the total mastication evaluation value based on the meal image data received by the receiving unit 231 and the evaluation result by the meal evaluation unit 236. The information output unit 242 outputs one or both of the information for each user obtained from the history information and the information for a plurality of users. The output destination is the terminal device 4, but it may be output to the terminal device 3. The information for each user output by the information output unit 242 includes at least one of the meal image data, the number of times the meal image data is received, information based on the total mastication evaluation value in time series, the sufficiency of the DVS in time series, the sufficiency of nutrients in time series, and the evaluation result of the meal in time series. Furthermore, the information output unit 242 outputs information on the advice selected by the advice selection unit 238. The information on the multiple users is, for example, the average value of the total chewing evaluation value, the DVS satisfaction status, and the nutrient satisfaction status of all users or users belonging to a specific group. The information output unit 242 determines the users belonging to a specific group based on, for example, the total chewing evaluation value.

[0040] The terminal device 3 is a computer device such as a smartphone, a tablet terminal, or a personal computer. The terminal device 3 includes a communication unit 31, an input unit 32, an imaging unit 33, a display unit 34, and a processing unit 35. The communication unit 31 transmits and receives information via the network 9. The input unit 32 is configured using existing input devices such as a button, a touch panel, a keyboard, and a mouse. The input unit 32 is operated by a user when inputting the user's instruction to the terminal device 3. The imaging unit 33 is a camera that captures an image. The display unit 34 is an image display device such as a liquid crystal display or an organic EL (Electro Luminescence) display. The processing unit 35 performs a process of transmitting and receiving information via the communication unit 31 and a process of displaying data on the display unit 34 according to the instruction input by the input unit 32.

[0041] The terminal device 4 is a computer device such as a tablet terminal or a personal computer. The terminal device 4 includes a communication unit 41, an input unit 42, a display unit 43, and a processing unit 44. The communication unit 41 transmits and receives information via the network 9. The input unit 42 is configured using existing input devices such as a button, a touch panel, a keyboard, and a mouse. The input unit 42 is operated by a user of the terminal device 4 when inputting an instruction from the user to the terminal device 4. The display unit 43 is an image display device such as a liquid crystal display or an organic EL display. The processing unit 44 performs a process of transmitting and receiving information via the communication unit 41 and a process of displaying data on the display unit 43 according to the instruction input by the input unit 42. The processing unit 44 also performs a process of instructing the printing device 5 to print information.

[0042] FIG. 2 is a diagram showing an example of menu-specific chewing value information. The menu-specific chewing value information shown in the figure is information in which the menu and the chewing evaluation value are associated with each other. In the figure, the chewing evaluation value is expressed in three stages, "◎", "◯", and "△", in descending order of the number of chews. The number of stages is arbitrary. The chewing evaluation value of each menu is determined based on the measurement value of each ingredient or menu. Specifically, the number of chews that the participants of the experiment, who are different in age and sex, chewed from the time they put a mouthful of food (dish) of the menu for which the chewing evaluation value is to be determined in their mouths until they swallowed it was measured a predetermined number of times, and the chewing evaluation value was determined based on the measurement value. The amount of food in one mouthful was about one curry spoon. The results of the measurements showed that the number of chews differed not only depending on the hardness of the ingredient itself, but also on the way the ingredient was cut and the cooking method. Therefore, the mastication evaluation value of a menu for which no measurement has been performed may be determined based on the ingredients that have actually been measured, the hardness and cutting method of the ingredients, and the cooking method for each menu. In this way, the mastication evaluation value of a menu is based on the actual measurement value (actual measurement value) of the number of chews when eating the food of that menu, or on one or more of the hardness of the ingredients included in that menu, the cutting method of the ingredients included in that menu, and the cooking method of that menu.

[0043] 3 is a diagram showing an example of history information. The history information shown in the figure includes a user ID and one or more pieces of meal information. The meal information includes a date and time, meal image data captured at that date and time, a chewing evaluation value for each meal menu estimated based on the meal image data, and an estimated total chewing evaluation value, DVS sufficiency, nutrient sufficiency, and evaluation for the meal.

[0044] The DVS sufficiency status indicates the score for each food category, the score for each food group and the ratio to the target score, and the DVS and the ratio to the target DVS. For example, the score for each food category is expressed as 1 if the meal contains ingredients of that food category, and 0 if not. The score for each food group is the sum of the scores of the food categories contained in that food group. The DVS is the sum of the scores of each food group. In a radar chart, the area of ​​a polygon obtained by connecting the ratio of the user's food category or food group to the target score may be divided by the area of ​​the polygon when the score of all food categories or food groups is 100 percent of the intake target, to obtain the DVS sufficiency status. The nutrient sufficiency status is indicated by the intake amount of each nutrient and the ratio to the target intake. The nutrient sufficiency status may be expressed by which stage the nutrient is in when the ratio to the target intake is divided into stages. The target intake amount may be the intake amount for any period, for example, one meal, one day, the past 30 days, or six months. Alternatively, it may be the target intake amount for the period from the start of recording food to the present. The start of recording food is obtained from the information of the oldest date and time set in the history information.

[0045] The target score for each food group, the target DVS, and the target nutrient intake may be common to age, sex, weight, and height, or may correspond to one or more of age, sex, weight, and height, or may be for the well-masticating group. Users belonging to the well-masticating group may be selected based on the total chewing evaluation value set in the history information. For example, the determination unit 235 determines that a user who has a predetermined or higher percentage of "◎" in the total chewing evaluation value of meals in a predetermined period belongs to the well-masticating group. Alternatively, the determination unit 235 may determine that a user who has a predetermined or higher average total chewing evaluation value of meals in a predetermined period belongs to the well-masticating group when the total chewing evaluation values ​​of "◎", "◯", and "△" are set to "3 points", "2 points", and "1 point", respectively. In this case, the determination unit 235 calculates the average of the score for each food group, the DVS, and the nutrient intake set in the dietary information in the above-mentioned predetermined period of each user belonging to the well-masticating group as the target.

[0046] FIG. 4 is a diagram showing an example of advice selection information. The advice selection information is information that associates advice selection conditions with advice to be given to the user when the selection conditions are met. The selection conditions can use any information obtained from history information and information on the user's body. In the figure, the selection conditions are set for each category, but any combination of information from multiple categories may be used as the selection conditions. Examples of information used for the selection conditions are shown below.

[0047] (1) The average of the total chewing evaluation value in the most recent specified period (e.g., 30 days), the percentage of the specified total chewing evaluation value, and the number of the specified total chewing evaluation values. The average of the total chewing evaluation value for each period (e.g., each month), the percentage of the specified total chewing evaluation value, and the change over time in the number of the specified total chewing evaluation values. (2) Variation in the overall chewing evaluation score for the most recent specified period, and changes over time in the variance in the overall chewing evaluation score for each period. (3) The number or percentage of menu items with a specified chewing evaluation value in meals during a specified most recent period, or the change over time in the number or percentage of menu items with a specified chewing evaluation value in meals for each period. (4) Recent dietary balance and time series changes in dietary balance over time. Dietary balance is shown by food classification, food group, DVS, nutrients, and their sufficiency. The sufficiency may be compared with a group of users who chew well, or with the average of all users. (5) Appetite for a given period of time and changes in appetite over time. (6) Comparison with ideal weight and changes over time, such as weight gain or loss. (7) The number of times meals were recorded during a recent specified period, the number of consecutive days for which recording occurred, and changes over time in the number of times meals were recorded during each period. Note that recording meals corresponds to transmitting meal image data from the terminal device 3 to the health support device 2. (8) The date and time when the advice was selected. (9) Recent values ​​and changes over time of height, BMI, body fat, skeletal muscle mass, bone mass, and lean mass.

[0048] Next, a description will be given of the operation of health support system 1. Note that processing unit 23 of health support device 2 transmits and receives data via communication unit 21, processing unit 35 of terminal device 3 transmits and receives data via communication unit 31, and processing unit 44 of terminal device 4 transmits and receives data via communication unit 41, but descriptions of these will be omitted below.

[0049] 5 is a diagram showing the operation of the health support system 1 when a user transmits meal image data. The user operates the input unit 32 of the terminal device 3 to capture an image of the meal using the imaging unit 33. The processing unit 35 of the terminal device 3 transmits the meal image data captured by the imaging unit 33 and the user ID to the health support device 2 in accordance with instructions input by the user using the input unit 32. The processing unit 35 of the terminal device 3 may further transmit biological information, such as weight and appetite, input by the user using the input unit 32 to the health support device 2.

[0050] The receiving unit 231 of the health support device 2 receives the meal image data and the user ID transmitted from the terminal device 3 (step S105). The receiving unit 231 identifies the history information by the user ID. The receiving unit 231 also reads out the date of birth from the biometric information identified by the user ID, and calculates the age from the date of birth. The estimation unit 232 analyzes the meal image data received by the receiving unit 231 in step S105, and estimates the meal menu (step S110). The chewing evaluation unit 233 reads out the chewing evaluation value corresponding to each menu estimated by the estimation unit 232 in step S110 from the menu-specific chewing value information stored in the storage unit 22 (step S115).

[0051] The mastication evaluation unit 233 calculates a total mastication evaluation value based on the mastication evaluation value of each menu read out in step S115 (step S120). For example, the best mastication evaluation value among the mastication evaluation values ​​of each menu may be set as the total mastication evaluation value, the average of the mastication evaluation values ​​of each menu may be set as the total mastication evaluation value, or the total mastication evaluation value may be calculated by adding up the mastication evaluation values ​​of each menu.

[0052] For example, the chewing evaluation value is rated in three levels, "◎", "◯", and "△", with "◎" being 3 points, "◯" being 2 points, and "△" being 1 point. Suppose a meal menu is rice, miso soup, grilled fish, and cold tofu, and the chewing evaluation value of the rice is "◯", the chewing evaluation value of the miso soup is "◯", the chewing evaluation value of the grilled fish is "◎", and the chewing evaluation value of the cold tofu is "△". When the best chewing evaluation value is set as the overall chewing evaluation value, the chewing evaluation unit 233 sets the overall chewing evaluation value to "◎".

[0053] On the other hand, when the average of the chewing evaluation values ​​of each menu is set as the total chewing evaluation value, the chewing evaluation unit 233 calculates the average score as (3 points x 1 + 2 points x 2 + 1 point x 1) / 4 = 2 points. If the average score of the chewing evaluation value is a1 or more, the chewing evaluation unit 233 judges the total chewing evaluation value as "◎", if it is a2 or more and less than a1, the total chewing evaluation value as "◯", and if it is less than a2, the total chewing evaluation value as "△". However, 3>a1>a2>1. The chewing evaluation unit 233 may multiply the chewing evaluation value of each menu by a coefficient considering the amount of each menu, and calculate the average score of the chewing evaluation values ​​multiplied by the coefficient.

[0054] When the total mastication evaluation value is calculated by adding up the mastication evaluation values ​​of each menu, the mastication evaluation unit 233 calculates the total score as (3 points x 1 + 2 points x 2 + 1 point x 1) / 4 = 8 points. If the total score is b1 or more, the mastication evaluation unit 233 judges the total mastication evaluation value as "◎", if the total score is b2 or more and less than b1, the total mastication evaluation value as "◯", and if the total score is less than b2, the total mastication evaluation value as "△". However, b1>b2>1. The mastication evaluation unit 233 may multiply the mastication evaluation value of each menu by a coefficient that takes into account the amount of each menu, and calculate the sum of the mastication evaluation values ​​multiplied by the coefficient.

[0055] Next, the acquisition unit 234 acquires the food classification of the ingredients used in each menu estimated by the estimation unit 232 in step S110 from the menu-specific classification information, and sets this as food intake information. Furthermore, the acquisition unit 234 acquires the ingredients used in each menu estimated by the estimation unit 232 and their amounts from the menu-specific ingredient information, and sets the total amount of each ingredient in the food intake information (step S125).

[0056] The determination unit 235 determines the DVS sufficiency and nutrient sufficiency based on the food intake information acquired in step S125 (step S130). Specifically, the acquisition unit 234 assigns 1 point for each food category when the food intake information indicates that the food has been ingested, and 0 point for each food category when the food intake information indicates that the food has not been ingested, and calculates a score by adding up the scores for each food category included in each group for each protein group, vitamin and mineral group, and energy group. The determination unit 235 further calculates the DVS by adding up the scores for each protein group, vitamin and mineral group, and energy group. The determination unit 235 compares the calculated score with the target score for each of the protein group, vitamin and mineral group, energy group, and DVS to determine the sufficiency. The sufficiency may be expressed as a percentage of the target score, or may be expressed by which stage the percentage of the target score is divided into multiple stages. Alternatively, the satisfaction status may be represented by food categories included in the diet and food categories not included in the diet.

[0057] The determination unit 235 also refers to the nutrients and their amounts for each ingredient indicated by the nutrient information, calculates the amounts of various nutrients according to the ingredients and their amounts indicated by the food intake information, and calculates the total intake by adding up the calculated amounts for each nutrient. The determination unit 235 compares the total intake with the target intake for each nutrient to determine the sufficiency of each nutrient with respect to the intake target for the meal.

[0058] The meal evaluation unit 236 evaluates the user's meal using the total mastication evaluation value calculated in step S120, the sufficiency of each nutrient and the sufficiency of the DVS determined in step S130, and one or more pieces of information on the user's weight, appetite, BMI, body fat, skeletal muscle mass, bone mass, and lean mass (step S135). For example, the meal evaluation unit 236 classifies the user's meal according to the classification conditions indicated by the combination of the total mastication evaluation value, the sufficiency of each nutrient, the sufficiency of the DVS, the user's weight, the value representing the user's appetite, and the respective numerical ranges of the BMI, body fat, skeletal muscle mass, bone mass, and lean mass, and sets the meal evaluation result as the meal evaluation result. The return unit 241 returns feedback information indicating the total mastication evaluation value and the meal evaluation result to the terminal device 3 (step S140). The feedback information may include past evaluation results obtained from history information. The processing unit 35 of the terminal device 3 displays the received feedback information on the display unit 34 .

[0059] For example, the processing unit 35 displays on the display unit 34 a screen in which the time series evaluation results using the total chewing evaluation value, the DVS, and the body weight are mapped onto a plane of two axes of the total chewing evaluation value and the DVS. The evaluation results are classified into evaluations A, B1, B2, and C, and the plane on which the evaluation results are mapped shows areas corresponding to the evaluations A, B1, B2, and C. Evaluation A indicates that a well-balanced diet is taken and that the user is able to chew well. Evaluation B1 indicates that the user is able to chew well, but the diet is not well-balanced. Evaluation B2 indicates that the user is able to chew well, but the diet is not well-balanced. Evaluation D indicates that the user is not able to chew well, in addition to having a poorly-balanced diet. The user aims for evaluation A.

[0060] The information update unit 237 adds the meal information to the user's history information (step S145). The meal information includes the image data received in step S105, the mastication evaluation value for each menu read in step S115, the overall mastication evaluation value calculated in step S120, the DVS and nutrient sufficiency status determined in step S130, and the meal evaluation result in step S135. The date and time of the meal information may be set to the date and time of receiving the meal image data from the terminal device 3, or the photographing date and time attached to the meal image data. When information on a biological body such as weight and appetite is received from the terminal device 3, the information update unit 237 adds the information receiving date and time and the received biological body information to the biological information specified by the user ID in association with each other.

[0061] 6 is a diagram showing the operation of the health support system 1 when giving advice to a user. Here, the explanation is given assuming that a dental hygienist in a dental clinic gives the advice, but someone other than a dental hygienist may give the advice to the user. Examples of people other than dental hygienists include, but are not limited to, dentists, dental assistants, other dental medical workers, doctors, nurses, medical assistants, caregivers, nutritionists, care managers, and social workers.

[0062] The processing unit 44 of the terminal device 4 transmits an information request, in which the user ID of the user who is a patient and the ID of the dental clinic are set, to the health support device 2 in accordance with the instructions input by the dental hygienist via the input unit 42. The processing unit 44 of the terminal device 4 may further transmit to the health support device 2 information regarding one or more of the user's biological information input by the dental hygienist via the input unit 42, the user's weight, appetite, height, BMI, body fat, skeletal muscle mass, bone mass, and lean fat mass.

[0063] The receiving unit 231 receives an information request from the terminal device 4 (step S205). The receiving unit 231 identifies the history information, biometric information, and user management information stored in the storage unit 22 by the user ID set in the received information request. Furthermore, the receiving unit 231 identifies the advice provider information stored in the storage unit 22 by the clinic ID set in the information request. When the receiving unit 231 receives information about a biometric body from the terminal device 4, the information update unit 237 adds the received date and time of the information and the received information about the biometric body to the identified biometric information in association with each other.

[0064] The advice selection unit 238 determines whether or not information obtained based on the history information and biological information specified by the receiving unit 231 matches each selection condition of the advice selection information stored in the storage unit 22. The advice selection unit 238 reads out advice information associated with the selection condition that is determined to match from the advice selection information (step S210).

[0065] The information output unit 242 obtains the user-specific information obtained based on the history information and biological information specified by the receiving unit 231, and the statistical information based on the history information and biological information of a plurality of users. The information output unit 242 generates provided information indicating the user-specific information, the statistical information, a comparison between the user-specific information and the statistical information, and the advice information selected by the advice selection unit 238, and transmits the information to the terminal device 4 (step S215). The information output unit 242 may include information such as the user's name read from the user management information, and information such as the name and contact information of the clinic read from the advice provider information, in the provided information. The processing unit 44 of the terminal device 4 displays the received provided information on the display unit 43. The processing unit 44 may instruct the printing device 5 to print the provided information. The dental hygienist refers to the provided information displayed on the display unit 43 and the provided information printed by the printing device 5, and provides explanations and advice to the user, and encourages the user to record meals.

[0066] The information output unit 242 may transmit the provided information to the terminal device 4 in multiple batches. In this case, which information in the provided information is requested from the terminal device 4 may be set in an information request and transmitted to the health support device 2. The information output unit 242 of the health support device 2 transmits the provided information requested by the information request to the terminal device 4.

[0067] 7 and 8 are diagrams showing examples of provided information displayed on the terminal device 4. The screen G1 shown in Fig. 7 includes a display of the user's monthly dietary balance, overall chewing evaluation value (munching score), number of times photographed, and time-series changes in weight and appetite, as well as a display of a list of advice for the user. The information output unit 242 generates screen data for displaying the screen G1 and transmits it to the terminal device 4.

[0068] Regarding the dietary balance, the ratio of the user's intake to the intake target of each food category is shown in the figure. Here, the intake target is the average intake of each food category of users who belong to the group who can chew well. The intake is shown, for example, as the ratio of meals that include that food category to meals for one month. The information output unit 242 calculates the score of the dietary balance of the user by dividing the area of ​​a polygon obtained by connecting the intake ratio of each food category of the user in the figure by the area of ​​the polygon when the intake of all food categories is 100% of the intake target. The information output unit 242 calculates the score of the dietary balance of the user every month, and sets a graph showing the time series change of the calculated score and a figure showing the dietary balance of the user every month in the provided information. Furthermore, the figure shows the ratio of the average intake of each food category of users who belong to the group who cannot chew to the intake target. Note that a user who belongs to the group who cannot chew is a user whose average total chewing evaluation value of meals in a predetermined period is equal to or less than a predetermined value. Furthermore, the information output unit 242 converts the chewing evaluation value for each meal menu into a score, calculates a total score for each meal, and calculates the average of the total scores for each month to calculate an overall chewing evaluation to be used in the provided information.

[0069] The advice information includes advice A1 based on the number of photos taken, advice A2 about seasonal ingredients based on the current date, advice A3 based on DVS, advice A4 based on the food group sufficiency status, advice A5 based on the food category sufficiency status, advice A6 based on the overall chewing evaluation value, and advice A7 based on weight and appetite.

[0070] The screen G2 shown in FIG. 8 shows a list of meal image data taken during a predetermined period. Information on the date and time of photographing is added to each meal image data. The information output unit 242 generates screen data for displaying the screen G2 based on the meal image data and date and time information acquired from the user's history information, and transmits the screen data to the terminal device 4. When an operation to select meal image data is performed by the input unit 42 of the terminal device 4, the information output unit 242 may generate screen data so that detailed information added to the selected meal image data is displayed. The detailed information includes one or more of the chewing evaluation value, total chewing evaluation value, DVS sufficiency status, nutrient sufficiency status, and meal evaluation of each menu set in the history information in association with the meal image data.

[0071] The advice provider may refer to the provided information of each user transmitted from the health support device 2 in step S215 and transmit advice tailored to each user to the terminal device 3 of the user. In the above example, the dental hygienist inputs advice for the user through the input unit 42 by referring to the provided information displayed on the display unit 43 of the terminal device 4 or printed by the printing device 5. When the dental hygienist inputs a transmission instruction to the user through the input unit 42, the processing unit 44 transmits advice notification information in which the input advice is set to the health support device 2. The advice notification information may include all or a part of the provided information. The provided information included in the advice notification information may be determined in advance or may be selected by the dental hygienist through the input unit 42. A user ID may be added to the advice notification information. The information output unit 242 of the health support device 2 reads an address from the user management information identified in step S205 or the user management information identified by the user ID added to the advice notification information, and transmits the advice notification information to the read address. The processing unit 44 of the terminal device 4 may transmit the advice notification information directly to the user's address. The processing unit 35 of the user's terminal device 3 displays the advice notification information received from the health support device 2 or the terminal device 4 on the display unit 34.

[0072] According to the above-mentioned embodiment, it is possible to provide useful information about eating tailored to each individual user and support their health. Since the deterioration of the nutritional state of the elderly is related to the decline of oral function, it is possible to improve malnutrition and maintain and improve oral function mainly in elderly users through the provision of nutritional information in the dental field. Furthermore, from the perspective of preventing frailty, it is possible to provide information useful for improving the health of users, such as dental hygienists and nurses, in dental clinics and medical clinics, which will increase the number of patients visiting the clinic and the frequency of visits, leading to regional cooperation between dental clinics and medical clinics, and increased profits through medical and dental cooperation.

[0073] The health support device 2 may be a system implemented using a plurality of computer devices communicably connected via a network. In this case, it is possible to arbitrarily determine which of the plurality of computer devices is used to realize each functional unit of the health support device 2. Also, the same functional unit may be realized by a plurality of computer devices.

[0074] When the functions of the health support device 2, the terminal device 3, and the terminal device 4 in the above-mentioned embodiment are realized by a computer, a program for realizing the functions may be recorded in a computer-readable recording medium, and the program recorded in the recording medium may be read into a computer system and executed. The term "computer system" as used herein includes hardware such as an OS and peripheral devices. The term "computer-readable recording medium" refers to a portable medium such as a flexible disk, an optical magnetic disk, a ROM, a CD-ROM, and a storage device such as a hard disk built into a computer system. The term "computer-readable recording medium" may also include a medium that dynamically holds a program for a short period of time, such as a communication line when a program is transmitted via a network such as the Internet or a communication line such as a telephone line, and a medium that holds a program for a certain period of time, such as a volatile memory inside a computer system that is a server or client in that case. The above-mentioned program may be a program for realizing a part of the above-mentioned functions, or may be a program that can be realized in combination with a program already recorded in the computer system.

[0075] Although an embodiment of the present invention has been described in detail above with reference to the drawings, the specific configuration is not limited to this embodiment, and designs that do not deviate from the gist of the present invention are also included. [Explanation of symbols]

[0076] 1...health support system, 2...health support device, 3...terminal device, 4...terminal device, 5...printing device, 9...network, 21...communication unit, 22...storage unit, 23...processing unit, 31...communication unit, 32...input unit, 33...imaging unit, 34...display unit, 35...processing unit, 41...communication unit, 42...input unit, 43...display unit, 44...processing unit, 231...receiving unit, 232...estimation unit, 233...chewing evaluation unit, 234...acquisition unit, 235...determination unit, 236...diet evaluation unit, 237...information update unit, 238...advice selection unit, 239...information provision unit, 241...return unit, 242...information output unit

Claims

1. An estimation unit that estimates a menu of a meal based on image data of the meal of a user; a mastication evaluation unit that acquires a mastication evaluation value corresponding to the menu estimated by the estimation unit, the mastication evaluation value indicating a number of times of mastication; An information providing unit that provides information based on the chewing evaluation value; A health support device comprising:

2. the chewing evaluation unit calculates a total chewing evaluation value indicating the number of chews required to eat the meal based on the estimated chewing evaluation value corresponding to the menu. The health support device according to claim 1 .

3. an acquisition unit that acquires food intake information indicating the classification or ingredients of ingredients used in the menu estimated by the estimation unit; A determination unit that determines one or both of a nutrient sufficiency status and a food intake diversity score sufficiency status for a dietary intake goal based on the food intake information acquired by the acquisition unit; a meal evaluation unit that evaluates a meal using the chewing evaluation value and the satisfaction state; The health support device according to claim 2 , further comprising:

4. the meal evaluation unit evaluates the meal of the user by using the chewing evaluation value and the satisfaction state based on the image data and information related to a biological body of the user. The health support device according to claim 3.

5. The information on the living body includes one or more of information on weight, appetite, height, body mass index, body fat, skeletal muscle mass, bone mass, and lean body mass. The health support device according to claim 4.

6. a receiving unit for receiving the image data from a terminal device used by the user, The information providing unit includes a return unit that returns to the terminal device one or both of the overall mastication evaluation value based on the image data received by the receiving unit and the evaluation result by the meal evaluation unit. The health support device according to any one of claims 3 to 5.

7. A storage unit is further provided which stores, for each user, history information indicating a history of at least a part of the image data, the overall mastication evaluation value, the satisfaction state, and the evaluation result by the meal evaluation unit, the information providing unit includes an information output unit that outputs one or both of information about an individual user obtained from the history information and information about a plurality of users; The health support device according to any one of claims 3 to 6.

8. The information for each user output by the information output unit includes at least one of the image data, the number of times the image data is received, information based on the overall chewing evaluation value in time series, the satisfaction status in time series, and the evaluation result in time series. The health support device according to claim 7.

9. An advice selection unit that selects advice information based on information obtained from the user's history information, The information output unit outputs information on the advice selected by the advice selection unit. The health support device according to claim 7 or 8.

10. the advice selection unit selects advice information based on information obtained from the history information of the user and information regarding a biological body of the user. The health support device according to claim 9.

11. The information on the living body used by the advice selection unit is one or both of weight information and appetite information. The health support device according to claim 10.

12. The chewing evaluation value and the total chewing evaluation value indicate which of a plurality of stages corresponding to the number of chewing times is included. The health support device according to any one of claims 2 to 11.

13. The chewing evaluation value corresponding to the menu is based on one or more of the number of chews measured for the menu, the hardness of ingredients included in the menu, the cutting method of ingredients included in the menu, and the cooking method of the menu. The health support device according to any one of claims 2 to 12.

14. An estimation unit that estimates a menu of a meal based on image data of the meal of a user; a mastication evaluation unit that acquires a mastication evaluation value corresponding to the menu estimated by the estimation unit, the mastication evaluation value indicating a number of times of mastication; An information providing unit that provides information based on the chewing evaluation value; A health support system having the above features.

15. A health support method executed by a health support device, comprising: an estimation step of estimating a menu of the meal based on image data of the meal of the user; a mastication evaluation step of acquiring a mastication evaluation value corresponding to the menu estimated in the estimation step, the mastication evaluation value indicating a number of times of mastication; An information providing step of providing information based on the chewing evaluation value; A health support method having the above-mentioned features.

Images