Information processing device, information processing program, and information processing system

Abstract

It realizes behavioral changes such as improving the user's retention rate for an information processing program including a healthcare app related to meals. 【Solution means】A client device 100 including a first transmission means 120 for transmitting a meal image of a dish consumed by a user, a first reception means 130 for receiving estimated meal information including nutrients of the dish estimated by an AI device 300 from the meal image transmitted by the first transmission means 120, and a progress means 150 for progressing a cultivation game based on the estimated meal information received by the first reception means 130, and a server device 200 including a second reception means 210 for receiving the meal image transmitted by the first transmission means 120 and a second transmission means 240 for transmitting the estimated meal information obtained by inputting the meal image received by the second reception means 210 to the AI device 300 to the client device 100 are connected via a network 500.

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing program, and an information processing system, and particularly to an information processing apparatus, an information processing program, and an information processing system for managing the health of a real user through a virtual breeding game.

Background Art

[0002] In Patent Document 1, with the problem of appropriately supporting the health management of users, among the foods imaged in the image of a meal, recommended food information regarding foods recommended for ingestion to the target user is estimated, and an information processing program for providing the recommended food information to the target user is disclosed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, so-called healthcare apps such as the information processing program disclosed in Patent Document 1 are said to have a low continuation rate. According to the website of a support company for the health business service, the continuation rate of a healthcare app 30 days after installation is about 10%, but about 70% of users have already stopped using the app on the day after installation (for example, the website (https: / / healthbizwatch.com / column / hbw-955) where the article "Approaches to Increase the Continuation Rate of Healthcare Apps" of "Health Biz Watch" of Sports Co., Ltd. was published).

[0005] Although a healthcare app was used as an example here, this principle is also applicable to information processing devices and information processing systems with similar functions.

[0006] Therefore, based on these facts, the present invention aims to achieve behavioral changes, such as improving user retention rates, for information processing programs, information processing devices, and information processing systems, including healthcare apps related to meals. [Means for solving the problem]

[0007] To solve the above problems, the information processing apparatus of the present invention is: A means of sending a picture of the food the user is eating, A receiving means that receives estimated meal information, including the nutrients of the dish, estimated by an artificial intelligence device that generates information from a meal image transmitted by the aforementioned transmitting means, A means for progressing the training game based on the estimated meal information received by the receiving means, It is equipped with.

[0008] Furthermore, the system may also include a presentation means for presenting the estimated meal information received by the receiving means to the user.

[0009] Furthermore, the means for promoting growth may be used to grow the target plant according to the type of nutrient.

[0010] Furthermore, the estimated meal information may include the name of the dish, the ingredients of the meal, and / or the calorie count.

[0011] Furthermore, the information processing program of the present invention is A feature that allows users to send images of the food they are eating, The function includes receiving estimated meal information, including the nutrients of the dish, which is estimated by the artificial intelligence device that generates the meal image, A function that progresses the training game based on the aforementioned estimated dietary information, The information processing device is made to execute this.

[0012] Furthermore, the information processing system of the present invention comprises: a first transmission means for transmitting a meal image of a dish consumed by a user; a first reception means for receiving estimated meal information including nutrients of a dish estimated by an artificial intelligence device generated from the meal image transmitted by the first transmission means; and a progress means for progressing a cultivation game based on the estimated meal information received by the first reception means; an information processing device; a second reception means for receiving the meal image transmitted by the first transmission means; and a second transmission means for transmitting the estimated meal information obtained by inputting the meal image received by the second reception means to an artificial intelligence device to the information processing device; a server device; which are connected via a network.

Advantages of the Invention

[0013] According to the present invention, generally, the progress of a game such as acting on a character in a cultivation game is performed using estimated meal information based on a meal image, and the characteristic of the low continuation rate of a healthcare app is complemented by effectively using the characteristic of the high continuity of a game app. Therefore, it is possible to realize behavioral changes such as an improvement in the continuation rate of the user.

Brief Description of the Drawings

[0014] [Figure 1] It is a schematic overview diagram of an information processing system according to an embodiment of the present invention. [Figure 2] It is a functional block diagram of the client device 100 and the server device 200 shown in FIG. 1. [Figure 3] It is a flowchart for explaining the main operations of the information processing system shown in FIG. 1. [Figure 4] It is an example of a front screen of the display of the client device 10 shown in FIG. 1.

Explanation of Reference Numerals

[0015] 100 Client device 110 Request means 120 First transmission means 130 First reception means 140 Progression means 150 Presentation means 200 Server device 210 Second reception means 220 Processing means 230 AI control means 240 Second transmission means 250 Storage means 300 Generation artificial intelligence device (AI device) 400 Database (DB) 500 Embodiment of network invention

[0016] Hereinafter, an information processing apparatus, an information processing program, and an information processing system according to an embodiment of the present invention will be described with reference to the drawings.

[0017] FIG. 1 is a schematic overview diagram of an information processing system according to an embodiment of the present invention. FIG. 1 shows a client device 100, a server device 200, a generation artificial intelligence device (hereinafter referred to as "AI device") 300, a database (hereinafter referred to as "DB") 400, and a network 500, which will be described below.

[0018] The client device 100 is operated by a user. The client device 100 of the present embodiment essentially requires a computing function and a communication function, but preferably has an imaging function in order to transmit an image as will be described later.

[0019] The client device 100 is not limited to these devices, and can be realized by a device capable of communicating with a server device 200, such as a personal computer, a tablet terminal, a smartphone, a PDA (Personal Digital Assistant), etc.

[0020] Hereinafter, the client device 100 will be described as a smartphone on which the information processing program of the embodiment of the present invention is installed. However, it can also be implemented, for example, by a dedicated device with the same program pre-installed.

[0021] The server device 200 is managed by the service provider of the information processing system, etc. In this embodiment, the server device 200 can be implemented using a relatively high-spec business computer or the like in order to provide healthcare services to a large number of users.

[0022] The AI ​​device 300 estimates meal information (for example, the name of the dish, main ingredients, calories per serving, and types and amounts of nutrients) of a meal based on an image of the meal that the user is about to eat (hereinafter referred to as "meal image") transmitted from the client device 100 via the server device 200.

[0023] The AI ​​device 300 is configured using mathematical models such as artificial neural networks. The AI ​​device 300 may be integrated into the server device 200 rather than being a standalone device.

[0024] The AI ​​device 300 can, for example, use existing AI models (such as OpenAI's ChatGPT or Google's Gemini), or it can use models that have been machine-learned based on combinations of meal menus, ingredients, and nutrients, or it can apply ensemble learning, which combines multiple different neural network models, to improve prediction accuracy.

[0025] Furthermore, the AI ​​device 300 should be equipped with identification AI to extract multifaceted data from meal images. For example, by linking it with a medical institution's system, it would be possible to build a system that can obtain feedback from doctors and dietitians.

[0026] The AI ​​device 300 can also be pre-configured by training it with prompts like the examples below, for purposes such as improving the efficiency of prediction processing. This is convenient because it avoids sending the same prompt repeatedly each time a food image is sent.

[0027] An example of a prompt might be: "You possess the nutritional knowledge of a registered dietitian who is well-versed in world cuisine. Please determine the name of the dish, ingredients, nutrients, and calories for a single serving based on the user's meal image."

[0028] Furthermore, the AI ​​device 300 may perform fine-tuning, such as retraining using the "Standard Tables of Food Composition in Japan (8th Revised Edition) Supplement 2023," in order to determine nutrients according to a unified standard, and may include prompts that instruct the device to determine nutrients using the said table.

[0029] Furthermore, the AI ​​device 300 can also be equipped with a mechanism to quantify and output the reliability of the predicted meal information, allowing the user to determine if corrections are necessary. This improves transparency regarding the AI's judgment and enables users to make appropriate corrections. This also helps to reduce user resistance, even when the system performs the process described later, which involves requesting a predetermined answer from the user.

[0030] DB400 is a medium for storing data such as the following for each user: (1) User information: User's name (including nickname), height, weight, medical questionnaire data (e.g., blood pressure, presence or absence of headaches), phone number, email address and other contact information, unique user ID, login password (2) Meal image: An image of the meal that the user will eat, transmitted from the client device 100. (3) Estimated meal information: Meal information estimated by the AI ​​device 300 from the meal image. This information should be stored continuously for each user.

[0031] Network 500 refers to all networks used to interconnect the various devices shown in Figure 1, such as the Internet, mobile phone networks, and fixed-line telephone networks. Network 600 also includes local area networks (LANs) built downstream of the Internet.

[0032] Figure 2 is a functional block diagram of the client device 100 and server device 200 shown in Figure 1. Figure 2(a) shows the configuration of the client device 100, and Figure 2(b) shows the configuration of the server device 200.

[0033] As shown in Figure 2(a), the client device 100 includes a request means 110, a first transmission means 120, a first reception means 130, a progress means 140, and a presentation means 150, which are described below.

[0034] The request means 110 requests the user to send images of the meals they are eating and user information. Specifically, for example, a message such as "Please send a picture of tonight's dinner" could be displayed on the client device 100's screen.

[0035] The timing of this display is not restricted; for example, the user may register a time they wish to request in advance, or the notification may be sent around the time the specified time arrives and the system detects that the user is operating the client device 100, which is a smartphone.

[0036] However, if the interval between sending meal images is too long, it is not effective from the perspective of how often the healthcare app is used. Therefore, one solution would be to limit the interval between sending meal images to a maximum of 20 hours.

[0037] It should be noted that the client device 100 in this embodiment is not required to include a request means 110, and the user may voluntarily send meal images and user information.

[0038] The first transmission means 120 transmits, in response to the request of the request means 110 or spontaneously, the meal image and user information captured or selected by the user to the server device 200 via the network 500.

[0039] The number of meal images varies depending on the type of meal. For example, in the case of set meals, it is usually one image, and in the case of course meals, it is usually multiple images or more. When transmitting multiple meal images, they may be transmitted simultaneously, or for example, they may be transmitted one by one.

[0040] However, in the latter case, it is advisable to transmit them in such a way that it can be specified that they are for one meal. Alternatively, the server device 200 may determine from the Exif (Exchangeable Image File Format) information that is usually attached to the captured images by a digital camera or smartphone.

[0041] The first receiving means 130 receives, via the network 500, from the server device 200 the estimated meal information by the AI device 300 based on the meal image transmitted by the first transmission means 120.

[0042] The estimated meal information may include, for example, based on the meal image, the main ingredients, the calorie per serving, the details of nutrients (including an index indicating the difference from the intake target value of nutrients), and information indicating the intake tendency of nutrients compared with the user's past meal history.

[0043] If the estimated meal information includes an index regarding the excess or deficiency of the estimated nutrients, it becomes possible to present to the user guidelines for meal adjustment according to the user's health condition. Also, the information indicating the intake tendency can be used as a guideline for long-term support for the user's health management. It is preferable to output it as a graph visually showing the bias of nutrition.

[0044] In this embodiment, since nutrients are used for the progress of the growth game, the estimated meal information includes at least nutrients.

[0045] As an example of the estimated dietary information, when a dish of beef curry rice appears in a food image, <Ingredients>Rice, beef, potato, carrot, onion, curry roux, salad oil <Calories>800 kcal <Nutrients>Protein: 20 g, Lipids: 25 g, Carbohydrates: 100 g, Iron: 2.5 g, Potassium: 600 mg, Calcium: 25 mg, Sodium: 1300 mg, Magnesium: 30 mg, Zinc: 3 mg, Vitamin A: 10 mg, Vitamin B: 25 mg, Carotene: 2100 μg, Dietary fiber: 6.5 g, Salt: 2 g It is considered that the information will be as follows.

[0046] The progression means 140 progresses the breeding game based on the dietary information received by the first receiving means 130. The type of the breeding game is not limited, and for example, it can be a role-playing game (RPG).

[0047] The progression means can progress the game either incidentally to the transmission and reception of the food image or the estimated dietary information, or can progress the game independently. Therefore, the user can enjoy, for example, a battle game between users during meals.

[0048] In this embodiment, as a game progression mode, the numerical values of parameters such as "HP", "MP", and "EXP", which are adopted in many RPGs, are increased or decreased according to the nutrients of the food consumed by the user to grow the breeding target such as the character in the game.

[0049] Note that the breeding target may be not only the character in the game but also virtual animals and plants or buildings (growth such as building construction can be considered). However, as a health care app related to diet, it is preferably an object in which the mouth part appears as an image.

[0050] Generally speaking, "HP" refers to Hit Points, which numerically represent the degree of defense a game character can withstand from enemy attacks (hits); "MP" refers to Magic Points, which numerically represent the remaining amount of special attacks (magic) a game character can perform against enemies; and "EXP" refers to Experience Points, which numerically represent the experience a game character can gain by defeating enemies.

[0051] For example, one could increase the "HP" value if carbohydrate and protein intake is appropriate, increase the "MP" value if mineral and vitamin intake is appropriate, increase the "EXP" value if dietary fiber and salt intake is appropriate, and conversely, decrease the value of the corresponding parameter if the intake of each nutrient is inappropriate.

[0052] In this embodiment, when progressing through the training game, roles such as the following can be assigned to "HP," "MP," and "EXP," and these can be used when playing a battle game.

[0053] "HP": Represents the life force of game characters, etc. In battles, which will be explained later, higher HP improves survivability in long battles and against strong enemies, making it easier to clear difficult quests and dungeons. Lower HP increases the risk of being defeated in one hit, making progress more difficult. When HP reaches 0, the character becomes incapacitated, faints, and becomes unusable.

[0054] "MP": This is the resource needed to use magic and skills in battle. Higher MP allows for more frequent use of powerful magic and skills, improving battle efficiency. Conversely, lower HP limits the use of powerful skills and support skills (healing and buffs), potentially prolonging battles and restricting tactical options.

[0055] "EXP": These are points needed for game characters to level up and acquire new skills and abilities. High EXP allows characters to level up quickly, unlocking powerful equipment and skills early and allowing the game to progress smoothly. Low EXP makes leveling up difficult, resulting in insufficient stats against enemies and slowing down progress.

[0056] The presentation means 150 presents to the user, by displaying images on the display and / or outputting sound from the speaker, the meal information received by the first receiving means 130, the progress of the game being played by the progress means 140, and suggestions regarding the user's health management.

[0057] The meal information presented to the user by the presentation means 150 may be obtained by accessing DB 400 to retrieve past data and aggregated over various periods, such as daily, weekly, or monthly.

[0058] As shown in Figure 2(b), the server device 200 includes a second receiving means 210, a processing means 220, an AI control means 230, a second transmitting means 240, and a storage means 250, which are described below.

[0059] The second receiving means 210 receives meal images and user information transmitted by the first transmitting means 120 of the client device 100 via the network 500.

[0060] The processing means 220 performs various processes on the meal image received by the second receiving means 210. For example, the processing means 220 can determine whether the meal image received by the second receiving means 210 is suitable or not.

[0061] The criteria for determining suitability here include whether, for example, 20 hours have passed since the image was taken, and whether the image was taken using the screenshot function of a smartphone, which is the client device 100.

[0062] These can be determined, for example, from Exif information. If it is determined that a meal image is inappropriate because, for example, 20 hours have passed since it was captured, the second transmission means 240 may provide feedback to the client device 100 to that effect.

[0063] Furthermore, the processing means 220 can also perform image processing such as changing the aspect ratio of the meal image received by the second receiving means 210 to 1:1, or compressing it by reducing the number of pixels to a level where even object recognition, such as the contents of the meal, is possible. Since AI generally deals with binary data of 0 / 1, which is unique to computers, the processing burden is reduced if the image to be processed is square.

[0064] The AI ​​control means 230 inputs the meal image processed by the processing means 220 to the AI ​​device 300 and acquires meal information (hereinafter referred to as "predicted meal information") including the prediction results output from the AI ​​device 300. The AI ​​control means 230 may also have a function to improve prediction accuracy by performing ensemble inference by linking multiple AI models.

[0065] The second transmission means 240 transmits the estimated meal information acquired by the AI ​​control means 230 to the client device 100 via the network 500. Furthermore, if the processing means 220 determines that the meal image is inappropriate, it also transmits that fact to the user for presentation.

[0066] The storage means 250 stores user information received by the second receiving means 210 in the DB 400, and stores linked meal images received by the second receiving means 210 and estimated meal information acquired by the AI ​​control means 230 in the DB 400.

[0067] Figure 3 is a flowchart illustrating the main operations of the information processing system shown in Figure 1. The following explanation will refer to Figure 3 to describe the processes performed by the client device 100, server device 200, AI device 300, and DB 400, which constitute the information processing system shown in Figure 1, as well as the transmission and reception of data between them. Note that in the following explanation, it will be assumed that non-essential parts of the present invention, such as the pre-registration of user information, have already been completed.

[0068] Furthermore, some of the steps shown in Figure 3 may be in a different order (for example, step S7 and step S8), and other steps may be included between any two steps.

[0069] First, the client device 100 requests the user to send a picture of their meal by displaying a message on its display, for example, "Please send a picture of tonight's dinner" (step S1).

[0070] In response to this request, suppose the user selects, for example, a picture of beef curry rice that they have already taken. In this case, the client device 100 transmits the picture of the meal to the server device 200 via the network 500 using the first transmission means 120, and the server device 200 receives the picture of the meal using the second receiving means 210 (step S2).

[0071] Next, in the server device 200, in order to reduce the processing load on the AI ​​device 300 and avoid network congestion 500, the processing means 220 performs various processes, including the image processing described above, on the meal images transmitted from the client device 100 (step S3).

[0072] Then, in the server device 200, the AI ​​control means 230 inputs the meal image to the AI ​​device 300 in order to have the AI ​​device 300 estimate the name of the dish, ingredients, nutrients, and calories per serving based on the meal image after image processing performed by the processing means 220 (step S4).

[0073] If the prompts described above are pre-set, the AI ​​device 300 will, in accordance with those prompts, estimate the name of the dish, ingredients, nutrients, and calories per serving from the food image input by the AI ​​control means 230 of the server device 200 (step S5).

[0074] The AI ​​device 300 then outputs the estimated meal information to the server device 200, and the AI ​​control means 230 in the server device 200 acquires the estimated meal information (step S6).

[0075] Next, in the server device 200, the storage means 250 stores the meal image received by the second receiving means 210 and the estimated meal information acquired by the AI ​​control means 230 in the DB 400 (step S7).

[0076] Furthermore, in the server device 200, the second transmission means 240 transmits the estimated meal information acquired by the AI ​​control means 230 to the client device 100 via the network 500, and the first receiving means 130 in the client device 100 receives the estimated meal information (step S8).

[0077] Next, in the client device 100, the progress means 140 updates the game parameters based on the estimated meal information and advances the training game (step S9).

[0078] For example, the nutrients and their amounts obtained from beef curry rice are generally high in energy, protein, fat, vitamin B, and salt, moderate in dietary fiber, and low in vitamin C, calcium, potassium, magnesium, and dietary fiber.

[0079] Therefore, the progression means 140 can, in the example described above, increase the value of "HP" if the intake of carbohydrates and proteins is appropriate, decrease the value of "EXP" if the intake of dietary fiber is slightly insufficient and the intake of salt is slightly too high, and decrease the value of "MP" if the intake of minerals and vitamins is inappropriate.

[0080] These increasing or decreasing values ​​can be mechanically categorized into two levels: good, medium, and bad. For example, "good" could be "+3", "medium" could be "+1", and "bad" could be "-1". Alternatively, the AI ​​device 300 could be prompted with the following prompt: "For the nutrients you have determined, please score the intake of carbohydrates and proteins, minerals and vitamins, and dietary fiber and salt on a scale of 100 points each, and answer in the format 'HP=○ points', 'MP=○ points', 'EXP=○ points', and the results could be reflected in the system.

[0081] By the way, beef curry rice isn't always the same; it can vary depending on who's cooking it, the time of year, and the ingredients available. For example, it might be made with mixed grains instead of white rice, or include tomatoes or mushrooms.

[0082] If such a modified beef curry rice is shown in the food image, the AI ​​device 300 will predict that, compared to regular beef curry rice, it will have more dietary fiber and minerals due to the mixed grain rice, more dietary fiber and vitamin A due to the tomatoes, and more vitamin B due to the mushrooms. Therefore, it will be possible to increase the "EXP" value related to dietary fiber and also increase the "MP" value related to minerals and vitamins.

[0083] Furthermore, one approach would be to display the ingredients predicted by the AI ​​device 300 on the client device 100's display, and also display a message such as, "The AI ​​has determined that these ingredients were used. Do you want to correct the ingredient determination?" on the client device 100's display, prompting the user to input any ingredients that are in excess or insufficient.

[0084] This means that, for example, if tomatoes or mushrooms were not visible on the surface during plating and therefore did not appear in the food image, and the AI ​​device 300 was unable to deduce those ingredients, it would be possible to reflect the actual ingredients in the food information.

[0085] Furthermore, it is difficult for the AI ​​device 300 to predict, for example, whether a dish is a ready-made meal or a homemade meal. Generally, the latter is considered preferable to the former because it does not contain food additives such as preservatives. Therefore, it is possible to present a message inquiring about this and requesting a response, thereby giving a relatively higher evaluation if the dish is the latter than if it is the former.

[0086] However, in order to solve the problem of achieving behavioral changes such as improving user retention rates, forcing users to input information such as ingredients and types could create resistance, and it cannot be said with certainty that this will not make it easier to increase retention rates. For this reason, deliberately not requesting such input is one option.

[0087] Even if, for example, the AI ​​device 300 incorrectly predicts the type of meat used in curry rice, the opposite could also happen with other dishes, so from a macroscopic perspective, it could be said that there is no problem. Also, if the food image shows a creative dish, the AI ​​device 300 has not learned about that dish in the first place, so it is quite possible that it cannot make a reasonable prediction, and therefore it could be said that there is no need to demand excessive accuracy.

[0088] Based on such examination results, it may be a policy not to uniformly require the above-mentioned responses, or it may also be a policy to allow the user to select whether to request a response and then take corresponding actions according to the selection.

[0089] Next, in the client device 100, the presentation means 150 presents to the user the estimated dietary information received by the first reception means 130 and the game progress status processed by the progress means 140 using its display and / or speaker (step S10).

[0090] The above is an explanation of the main operations of the information processing system of this embodiment. Next, more specific examples will also be described.

[0091] FIG. 4 is an example of the front screen of the display of the client device 100 shown in FIG. 1. FIG. 4 includes a notification transition section 1001 for displaying notifications from an operator or other users, a progress display section 1002 for showing the progress of the breeding game using, for example, the amount of coins, an EXP display section 1003 for displaying "EXP" as a numerical value such as a level (here denoted as "××××…"), an HP display section 1004 for showing the numerical value of "HP" (here denoted as "××××…"), an MP display section 1005 for showing the numerical value of "MP", a character display section 1006 for showing the character of the game that the user is virtually breeding, a message display section 1007 for showing the message issued by the character, and an icon group 1008 for transitioning the display content of the screen.

[0092] The notification transition section 1001 can receive notifications such as an update notice of the application from the operator and an application for a battle game from other users, and present them to the user.

[0093] The progress display section 1002 can also provide an incentive for realistic health behaviors by linking the rewards obtained in the breeding game with real-world health devices (step counters and calorie management apps).

[0094] The message display section 1007 shows an example of a message immediately after reflecting the estimated dietary information on a website or the like in this example. Proposals regarding meals and the like can be presented to the user as something spoken by a character through the message display section 1007.

[0095] The functions assigned to the icon group 1008 are as follows, for example. · "Home": In addition to the title of this application, frequently used functions are arranged, and it transitions to a screen for performing login / logout and the like. · "Meal": It transitions to a screen for selecting or sending a meal image. · "Battle": It transitions to a battle screen within the game with other users. When winning against an opponent, the numerical value (coin amount) of the progress display section 1002 increases. · "Ranking": It transitions to a screen where the rankings of the progress (coin amount) of all users of this application are displayed. · "Shop": For example, it transitions to a screen for purchasing weapons and equipment for advancing battles advantageously. · "Menu": It transitions to a screen where the user's player level and a list of weapons and equipment used are displayed and changes and enhancements can be made.

[0096] When using the image example shown in FIG. 4, the prompt to be preset in the AI device 300 may be added with "You are also an excellent pet-type character virtually raised by the user in a breeding game. In this breeding game, you also virtually eat and drink the same dishes as those shown in the meal image of the user and grow." to the ones described above.

[0097] Furthermore, it is also preferable to add a prompt such as "Based on the nutrients that are lacking, please cutely encourage the user about what they want to eat next or what they don't want to eat." Even though in the virtual space, if the user develops an attachment to the character, it will become like a pet, and it is also conceivable that the psychology of the user of "not wanting to let the character that consumes the same beverage as oneself eat unhealthy food" will work. Then, it leads to an increase in motivation for the user in the real space to pay attention to a healthy diet.

[0098] In this way, in this embodiment, by having the game character display a humorous message based on the excessive or insufficient nutrients, the user is made to be conscious of a healthy diet. By doing so, it is considered that it contributes to the user's health management compared to simply presenting an inorganic message such as "○○ is lacking."

[0099] Furthermore, a function can also be added for the character in the breeding game to change its form according to the excess or deficiency of nutrients. For example, it is conceivable to perform effects such as the color of the character becoming lighter when vitamins are lacking, or shining when the nutritional balance is good. Such visual effects can also contribute to enhancing the motivation for the user to select a healthy diet.

[0100] As described above, according to the information processing program, information processing apparatus, and information processing system of this embodiment, by using the meal information inferred from the meal image to carry out the progress of the game such as influencing the character in the breeding game, etc., it makes up for the characteristic of the low continuation rate of the healthcare app by making good use of the characteristic of the high continuity of the game app. Therefore, it is possible to realize a behavioral change such as an improvement in the user's continuation rate.

Claims

1. A means of sending a picture of the food the user is eating, A receiving means that receives estimated meal information, including the nutrients of the dish, estimated by an artificial intelligence device that generates information from a meal image transmitted by the aforementioned transmitting means, A means for progressing the training game based on the estimated meal information received by the receiving means, An information processing device equipped with the following features.

2. The information processing apparatus according to claim 1, further comprising a presentation means for presenting estimated meal information received by the receiving means to the user.

3. The information processing apparatus according to claim 1, wherein the means for promoting growth causes the target to grow according to the type of nutrient.

4. The information processing apparatus according to claim 1, wherein the estimated meal information includes the name of the dish, the ingredients of the meal, and / or the calories of the meal.

5. A feature that allows users to send images of the food they are eating, The function includes receiving estimated meal information, including the nutrients of the dish, which is estimated by the artificial intelligence device that generates the meal image, A function that progresses the training game based on the aforementioned estimated dietary information, An information processing program that causes an information processing device to execute an information processing device.

6. An information processing device comprising: a first transmission means for transmitting a meal image of a dish consumed by a user; a first receiving means for receiving estimated meal information, including the nutrients of the dish, estimated by a generating artificial intelligence device from the meal image transmitted by the first transmission means; and a progress means for advancing a training game based on the estimated meal information received by the first receiving means. A server device comprising: a second receiving means for receiving a meal image transmitted by the first transmitting means; and a second transmitting means for transmitting the estimated meal information obtained by inputting the meal image received by the second receiving means into an artificial intelligence generating device to the information processing device, An information processing system connected via a network.

Images