Food and drink information input method and device

Abstract

The present invention relates to a method and device for inputting food and beverage information, and a method for inputting food and beverage information according to one embodiment of the present invention includes the steps of operating in a shooting mode in which an input guide and input buttons that move along the input guide are displayed on a shooting screen, and inputting at least one piece of food and beverage information using the input guide and the input buttons while operating in the shooting mode.

Description

[Technical Field]

[0001] The present invention relates to a technique for providing convenience for users to input information, and to a method and device for users to easily input food and drink information. [Background technology]

[0002] Recently, as interest in health has increased, the number of people suffering from overweight and obesity has also been increasing, which is a serious problem that can lead to various diseases such as diabetes and high blood pressure.

[0003] Therefore, in order to solve such overweight and obesity, it is necessary to first analyze one's eating habits. Generally, people know what foods they like and dislike, but do not remember the types of food they actually eat or how often. Therefore, in order to analyze one's eating habits, it is necessary to understand the foods that are actually eaten and analyze one's eating habits based on the information about the foods that has been grasped.

[0004] For example, in order to keep track of the food and drink they actually consume, a user must input food and drink information using a mobile device or input device. Here, the user takes a photo of the food using a food-related application or a general photography mode running on the mobile device. At this time, the user must inconveniently search for the image of the food taken using the food-related application and then enter the related food and drink information. Alternatively, when taking a photo using the general photography mode, the user must inconveniently search for the image of the food taken in an album, upload the found image of the food to the food-related application, and then search for the uploaded image of the food and drink again to enter the food and drink information. Therefore, due to the inconvenience of having to take a photo of the food and enter the food and drink information separately, the frequency with which the user uploads food and drink information decreases dramatically after taking a few images of food.

[0005] If a user photographs food and then attempts to enter the food information later, if a long period of time has passed since the food image was photographed, the user may forget the food information they intended to enter when photographing the food and be unable to record the food information, or may upload incorrect food and drink information, resulting in an error in the dietary habit analysis. Furthermore, even if a user attempts to enter various food and drink information for a photographed food image, they are only able to enter a few fixed pieces of food and drink information set for each application. In such cases, the limited number of pieces of food and drink information may result in an inaccurate analysis of the user's dietary habits.

[0006] As a result of these inconveniences, users are becoming less satisfied with the service that analyzes personal eating habits through the input of food and drink information. Summary of the Invention [Problem to be solved by the invention]

[0007] According to one embodiment of the present invention, a method and device for inputting food and drink information can be provided, which allows a user to easily input food and drink information while taking a photo on a photo screen when the user needs to input food and drink information.

[0008] According to another embodiment of the present invention, when food information is input along with photography on a photography screen, a food information input method and device can be provided for easily inputting food information using a user interface (UI) associated with recognized food.

[0009] According to another embodiment of the present invention, a food and drink information input method and device can be provided that automatically takes a photo if a predetermined condition is met while operating in a photo mode.

[0010] The problems to be solved by the present invention are not limited to those mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the following description. [Means for solving the problem]

[0011] According to one embodiment of the present invention, there is provided a food and beverage information input method performed by a food and beverage information input device, the method including the steps of operating in a shooting mode in which an input guide and input buttons that move along the input guide are displayed on a shooting screen, and inputting at least one piece of food and beverage information using the input guide and the input buttons while operating in the shooting mode.

[0012] The step of inputting at least one piece of food and beverage information is performed by inputting food and beverage information according to a position on the input guide where the activated input button is deactivated when the user activates an input button displayed on the shooting screen while operating in the shooting mode.

[0013] The method may further include displaying, on the shooting screen, at least one piece of food information corresponding to a position on the input guide of an input button activated by a user.

[0014] The step of displaying at least one piece of food and drink information on the photographing screen displays the food and drink information corresponding to the position of the input button on the input guide activated by the user on the photographing screen in a size larger than the previously set size.

[0015] The step of inputting at least one piece of food and beverage information involves the user activating an input button displayed on the photographing screen and moving the activated input button to selectively input at least one piece of food and beverage information according to the direction of movement on the inactivated input guide.

[0016] The step of inputting at least one piece of food and beverage information involves the user activating an input button displayed on the photographing screen and moving the activated input button, and selectively inputting at least one piece of food and beverage information according to the distance and direction of movement on the inactivated input guide.

[0017] The at least one piece of food and beverage information may include at least one of information on the amount of food and beverage, information on the type of food and beverage, information on calorie content of food and beverage, nutritional information of food and beverage, information on the menu of food and beverage, information on the consumer, information on intake goals, information on planned intake, information on intake time, information on intake satisfaction, information on time for food and beverage consumption that matches a previously set input purpose, information on the location of food and beverage consumption that matches a previously set input purpose, information on the person who disposes of food and beverage, information on food waste, information on pre-meal input, information on post-meal input, favorite information, and wish list storage information.

[0018] The method may further include a step of displaying at least one of the following related to the at least one input food and beverage information: user allergy impact level, skin nutrition level, growth nutrition level, disease impact level, aging impact level, diet impact level, planned calorie intake compared to target calories, salinity, food and beverage conversion value, food and beverage cost information, food and beverage environmental information, carbon value information, resource value information, carbon emissions, operating expenses loss costs, ingredient information, pre-meal input button, post-meal input button, favorite input button, and wish list save button.

[0019] The method may further include recognizing food or drink displayed on the photographing screen, and the input at least one piece of food or drink information may be related to the recognized food or drink.

[0020] The step of inputting at least one piece of food and drink information changes the unit of food and drink displayed on the input button according to the type of food and drink recognized, and quantity information of the recognized food and drink is input based on the changed unit of food and drink.

[0021] The method may further include displaying an input limit range for the recognized food or beverage.

[0022] The method further includes adjusting a minimum value and a maximum value of the displayed input limit range, and varying an input unit of the food and drink information according to the adjusted minimum value and maximum value of the input limit range.

[0023] The method may further include the steps of calculating and displaying intake goal information taking into account user characteristics according to the recognized foods and beverages, receiving from the user input of planned intake information for the recognized foods and beverages, and displaying a ratio of the input planned intake information to the displayed intake goal information.

[0024] The method may further include a step of displaying whether the user has succeeded in or failed to achieve the intake goal based on the input intake plan information compared to the displayed intake goal information after the user has consumed the recognized food or beverage.

[0025] The method may further include a step of analyzing the recognized food and beverage image to determine whether it is a before-meal or after-meal image, and a step of recording the food and beverage image as a before-meal food and beverage review for the user if it is a before-meal food and beverage image, or recording the food and beverage image as an after-meal food and beverage review for the user if it is an after-meal food and beverage image.

[0026] The method may further include displaying recognizable food candidate types based on the recognized food type.

[0027] The method may further include a step of searching for a restaurant that provides the recognized food and beverage information based on the location of the food and beverage information input device, and a step of correcting and displaying the input food and beverage information based on menu information of the searched restaurant.

[0028] The method may further include a step of searching for a restaurant that provides the recognized food and beverage information based on the location of the food and beverage information input device, and a step of ordering food and beverage corresponding to the input food and beverage information based on menu information of the searched restaurant.

[0029] The method may further include, when the food and drink information is input, providing a user with a preset incentive for the input food and drink information.

[0030] Meanwhile, according to another embodiment of the present invention, there is provided a food and beverage information input method performed by a food and beverage information input device, which includes the steps of operating in a shooting mode in which an input button is displayed on a shooting screen, checking whether pre-set shooting guide conditions are met while operating in the shooting mode, and taking a photo if the pre-set shooting guide conditions are met.

[0031] The method may further include the steps of recognizing food and drink displayed on the photographing screen and inputting food and drink information about the recognized food and drink.

[0032] The pre-set photographing guide conditions may be at least one of a parallel condition between the recognized food and the food information input device, a horizontal condition of the food information input device, a position condition of the food information input device vertically above the recognized food, and a movement condition of the food information input device.

[0033] The method may further include displaying a photographing accuracy on the screen based on a relative tilt between the recognized food and the food information input device.

[0034] The method may further include providing a preset incentive to the user for the photographing action.

[0035] The method may further include a step of analyzing the captured image of the recognized food and drink to determine whether it is before or after a meal, and a step of recording the captured image as a user's food and drink review before a meal if the captured image is of food and drink before a meal, or recording the captured image as a user's food and drink review after a meal if the captured image is of food and drink after a meal.

[0036] The method may further include displaying recognizable food candidate types based on the recognized food type.

[0037] The method may further include a step of searching for a restaurant that provides the recognized food and beverage information based on the location of the food and beverage information input device, and a step of correcting and displaying the input food and beverage information based on menu information of the searched restaurant.

[0038] The method may further include a step of searching for a restaurant that provides the recognized food and beverage information based on the location of the food and beverage information input device, and a step of ordering food and beverage corresponding to the input food and beverage information based on menu information of the searched restaurant.

[0039] Meanwhile, according to another embodiment of the present invention, a camera, a display, a memory for storing one or more programs, and a processor for executing one or more programs are included, and the processor operates in a shooting mode in which an input guide and input buttons that move along the input guide are displayed on the shooting screen via the display, and while operating in the shooting mode, at least one piece of food and drink information can be input via the camera using the input guide and the input buttons.

[0040] Meanwhile, according to another embodiment of the present invention, there is provided a food and beverage information input device including a camera, a display, a memory for storing one or more programs, and a processor for executing the stored one or more programs, wherein the processor operates in a shooting mode in which input buttons are displayed on a shooting screen via the display, and while operating in the shooting mode, checks whether pre-set shooting guide conditions are met, and takes a photo if the pre-set shooting guide conditions are met via the camera.

[0041] In addition, other methods and systems for implementing the present invention, and computer-readable recording media recording a computer program for executing the methods may also be provided. [Effects of the Invention]

[0042] According to an embodiment of the present invention, when a user needs to input food and drink information, the user can easily input the food and drink information while taking a photo on the photo screen.

[0043] According to another embodiment of the present invention, when food and drink information is input along with taking a photo on the photo screen, the food and drink information can be easily input using a user interface (UI) associated with the recognized food and drink.

[0044] According to another embodiment of the present invention, while operating in a photography mode, photography can be automatically performed if a predetermined condition is met.

[0045] The effects of the present invention are not limited to those mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description. [Brief explanation of the drawings]

[0046] [Figure 1] 1 is a diagram showing the configuration of a food and drink information input system according to an embodiment of the present invention. [Figure 2] 2 is a flowchart illustrating a method for inputting food and drink information according to an embodiment of the present invention. [Figure 3] 10 is an exemplary diagram illustrating a food and drink information input operation according to an embodiment of the present invention; [Figure 4] 10 is an exemplary diagram illustrating a food and drink information input operation according to an embodiment of the present invention; [Figure 5] 10 is an exemplary diagram illustrating a food and drink information input operation according to an embodiment of the present invention; [Figure 6] 10 is an exemplary diagram illustrating a food and drink information input operation according to an embodiment of the present invention; [Figure 7] 10 is an exemplary diagram showing an input operation of food and drink information regarding leftover food discharge according to an embodiment of the present invention; [Figure 8] 10 is an exemplary diagram showing an input operation of food and drink information regarding leftover food discharge according to an embodiment of the present invention; [Figure 9] 10 is an exemplary diagram showing an input operation of food and drink information regarding leftover food discharge according to an embodiment of the present invention; [Figure 10] 1 is an exemplary diagram illustrating a food and drink information input operation regarding food and drink intake information according to an embodiment of the present invention; [Figure 11] 1 is an exemplary diagram illustrating a food and drink information input operation regarding food and drink intake information according to an embodiment of the present invention; [Figure 12] 10 is a flowchart illustrating a food and drink information input method according to another embodiment of the present invention. [Figure 13] FIG. 13 is a diagram for explaining the food and drink information input process of FIG. [Figure 14] FIG. 13 is a diagram for explaining the food and drink information input process of FIG. [Figure 15] FIG. 13 is a diagram for explaining the food and drink information input process of FIG. [Figure 16] FIG. 13 is a diagram for explaining the food and drink information input process of FIG. [Figure 17] FIG. 13 is a diagram for explaining the food and drink information input process of FIG. [Figure 18] FIG. 13 is a diagram for explaining the food and drink information input process of FIG. [Figure 19] 10 is a flowchart illustrating a food and drink information input method according to another embodiment of the present invention. [Figure 20] FIG. 10 is a diagram showing an example of a food and drink information input device according to another embodiment of the present invention. [Figure 21] 10A to 10C are diagrams illustrating an example of a photographing operation according to another embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0047] The advantages and features of the present invention, and methods for achieving them, will become apparent from the following detailed description of the embodiments in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, and can be embodied in various different forms. The embodiments are provided solely to ensure that the disclosure of the present invention is complete and to fully convey the scope of the invention to those skilled in the art. The present invention is defined only by the scope of the claims.

[0048] The terms used in this specification are for the purpose of describing the embodiments and are not intended to limit the present invention. In this specification, the singular includes the plural unless otherwise specified. The terms "comprises" and / or "comprising" used in this specification do not exclude the presence or addition of one or more other elements other than the elements listed. The same reference numerals refer to the same elements throughout this specification, and "and / or" includes each and every combination of one or more of the listed elements. While terms such as "first," "second," etc. are used to describe various elements, it should be understood that these elements are not limited by these terms. These terms are used only to distinguish one element from another. Therefore, it should be understood that a first element referred to below may also be a second element within the technical spirit of the present invention.

[0049] Unless otherwise defined, all terms (including technical and scientific terms) used in this specification are used in the sense that they can be commonly understood by a person skilled in the art to which the present invention belongs. Furthermore, terms defined in commonly used dictionaries are not to be interpreted ideally or excessively unless they are clearly and specifically defined.

[0050] FIG. 1 is a diagram showing the configuration of a food and drink information input system according to an embodiment of the present invention.

[0051] First, referring to FIG. 1, a food and drink information input system 10 according to the present invention includes a food and drink information input device 100 and an external server 200 that communicates with the food and drink information input device 100.

[0052] The food and drink information input device 100 includes a communication module 110 , a camera 120 , a display 130 , a memory 140 , and a processor 150 .

[0053] The communication module 110 includes one or more modules that enable communication between the food and drink information input device 100 and a wireless communication system, or between the food and drink information input device 100 and an external server 200. The communication module 110 also includes one or more modules that connect the food and drink information input device 100 to one or more networks.

[0054] The camera 120 captures images or videos in response to a user's operation. Here, the camera 120 can capture images or videos of food and drink before and after eating in response to a user's operation. The camera 120 may be composed of a single camera, multiple cameras, a single image sensor, or multiple image sensors. The camera 120 may be composed of at least one 2D camera, at least one 3D camera, at least one stereo camera, or at least one image sensor.

[0055] The display 130 can be formed as a touch screen by forming an interlayer structure with a touch sensor or by being integrally formed with the display 130. Such a touch screen can provide an input interface between the food and drink information input device 100 and a user, and at the same time, can provide an output interface between the food and drink information input device 100 and a user.

[0056] The memory 140 stores data supporting various functions of the food and drink information input device 100. The memory 140 stores one or more programs, a plurality of application programs or applications, and data and commands for the operation of the food and drink information input device 100, which are run in the food and drink information input device 100. At least some of these application programs can be downloaded from an external server 200 via wireless communication. At least some of these application programs exist for the basic functions of the food and drink information input device 100. Meanwhile, the application programs are stored in the memory 140 and installed on the food and drink information input device 100, and are driven by the processor 150 to perform the operations (or functions) of the food and drink information input device 100.

[0057] In addition to operations related to the application programs, the processor 150 generally controls the overall operation of the food and drink information input device 100. The processor 150 processes signals, data, information, etc. input or output by the above-mentioned components, or runs application programs stored in the memory 140 to provide or process appropriate information or functions to the user.

[0058] In one embodiment, the processor 150 executes one or more programs stored in the memory 140 to operate in a photography mode in which an input guide and input buttons that move along the input guide are displayed on the photography screen via the display 130, and while operating in the photography mode, at least one piece of food and drink information can be input via the camera 120 using the input guide and input buttons.

[0059] In one embodiment, the processor 150 executes one or more programs stored in the memory 140 to operate in a shooting mode in which input buttons are displayed on the shooting screen via the display 130, and while operating in the shooting mode, checks whether the shooting guide conditions already set are met, and can take a photo if the shooting guide conditions already set via the camera 120 are met.

[0060] 1 to operate the application program stored in the memory 140. Furthermore, the processor 150 can operate a combination of at least two or more components included in the food and drink information input device 100 to operate the application program. Here, a detailed description of the processor 150 will be given later with reference to FIGS. 2 to 20.

[0061] The configuration of the food and drink information input system 10 according to the present invention has been described in detail above with reference to Fig. 1. The food and drink information input system 10 may include fewer or more components than those shown in Fig. 1.

[0062] Hereinafter, a method for inputting food and drink information according to an embodiment of the present invention will be described with reference to FIGS.

[0063] FIG. 2 is a flowchart of a method for inputting food and drink information according to an embodiment of the present invention.

[0064] As shown in FIG. 2, the food and drink information input method according to an embodiment of the present invention is performed by at least one processor of the food and drink information input device 100 or a computer that is the food and drink information input device 100.

[0065] First, the food and drink information input device 100 operates in a photographing mode (S110). The food and drink information input device 100 operates in a photographing mode in which an input guide and input buttons that move along the input guide are displayed on the photographing screen of the display 130. The photographing screen may be a photographing screen of a food and drink information input application executed by the food and drink information input device 100 or a photographing screen of a photographing application executed by the food and drink information input device 100, and is not limited to a specific photographing screen.

[0066] Then, while operating in a photographing mode, the food and beverage information input device 100 inputs at least one piece of food and beverage information using the input guide and input buttons (S120). Here, the at least one piece of food and beverage information may include, along with a photographed image or a photographed video, general food and beverage information, leftover food information, or food waste information. For example, the at least one piece of food and beverage information may include, along with the photographed image or photographed video, at least one piece of information among food amount information, food type information, food calorie information, food nutrition information, food menu information, consumer information, intake goal information, planned intake information, intake time information, intake satisfaction information, eating and drinking time information corresponding to a pre-set input purpose, food and beverage location information corresponding to a pre-set input purpose, food disposal information, food waste disposal information, pre-meal input information, post-meal input information, favorite information, and wish list save information.

[0067] To explain the detailed operation of step S120, while the food and drink information input device 100 is operating in the photographing mode, the user activates an input button displayed on the photographing screen (S121).

[0068] Next, the food and drink information input device 100 displays at least one piece of food and drink information corresponding to the position of the input button on the input guide activated by the user on the display (S122). Furthermore, the food and drink information input device 100 can display the food and drink information corresponding to the position of the input button on the input guide activated by the user in a size larger than the pre-set size on the shooting screen. Here, the operation of displaying at least one piece of food and drink information on the display is not a mandatory operation, and the display operation may or may not be performed depending on the user's setting.

[0069] Thereafter, when the user activates an input button, the food and drink information input device 100 inputs at least one piece of food and drink information according to the position on the input guide where the activated input button is deactivated (S123). For example, the user may touch and activate an input button, drag the input button along the input guide, and then release the touch to deactivate the input button. In this way, the food and drink information input device 100 can input food and drink information according to the position on the input guide where the input button is deactivated. Alternatively, when the user touches and activates an input button, the user may release the touch at the position where the user touched the input button without dragging the input button along the input guide to deactivate the input button. In this way, the food and drink information input device 100 inputs food and drink information according to the position on the input guide where the input button is deactivated, i.e., the position where the user touched and then released the touch.

[0070] Meanwhile, the process of inputting food and drink information will be described in detail as follows.

[0071] In some embodiments, the food and beverage information input device 100 may selectively input at least one piece of food and beverage information according to the movement direction on the inactivated input guide when the user activates an input button displayed on the photographing screen and moves the activated input button. For example, different types of food and beverage information may be set for each specific movement direction. The user may selectively input at least one piece of food and beverage information according to the type of food and beverage information set to differ depending on the movement direction on the input guide.

[0072] In some embodiments, the food and drink information input device 100 may selectively input at least one piece of food and drink information according to the movement distance and movement direction on the inactivated input guide when the user activates an input button displayed on the shooting screen and moves the activated input button. For example, different types of food and drink information may be set for each specific movement direction. Also, the information value of the food and drink information may change depending on the movement distance. The user may selectively input the information value of the food and drink information by adjusting the movement distance, taking into account the types of food and drink information set to differ depending on the movement direction on the input guide.

[0073] In some embodiments, the food and drink information input device 100 may selectively input at least one piece of food and drink information according to a combination of at least one of the following: a position on the input guide where the user deactivates an input button displayed on the photographing screen by moving the activated input button; and multimodal interface input information. The multimodal interface input information may include the user's voice, facial expression, gesture, This includes at least one of the following movements: action, gaze, and screen touch.

[0074] Thereafter, the food and beverage information input device 100 can display at least one of the following related to the at least one input food and beverage information: user allergy impact level, skin nutrition level, growth nutrition level, disease impact level, aging impact level, diet impact level, planned calorie intake compared to target calories, salinity, food and beverage conversion value, food and beverage cost information, food and beverage environmental information, carbon value information, resource value information, carbon emissions, operating expenses loss costs, food ingredient information, pre-meal input button, post-meal input button, favorite input button, and wish list save button.

[0075] 3 to 6 are exemplary diagrams showing a food and drink information input operation according to an embodiment of the present invention.

[0076] The food and drink information input device 100 can receive food and drink information through steps 310-330.

[0077] 3, in step 310, the food and drink information input device 100 operates in a photographing mode in which an input guide 302 and input buttons 301 that are moved in accordance with the input guide 302 are displayed on the photographing screen. Here, the input guide 302 displays an input range for the food and drink information. For example, the input guide 302 displays an input range from 0 to 50 servings, which is a unit related to spaghetti. The input button 301 displays an initial input value corresponding to the initial position on the input guide 302 (e.g., 25 servings corresponding to 50%), or an input value previously set by the user.

[0078] In step 320, when the user drags and moves the input button 301 while it is activated, the food and drink information input device 100 can confirm the position of the moved input button on the input guide 302. In addition, the food and drink information input device 100 may display the food and drink information value (e.g., servings for 33 people) corresponding to the position of the input button 301 moved along the input guide 302 in a size larger than the preset size. Here, the food and drink information value corresponding to the position of the moved input button 301 can be displayed in any area of ​​the display or inside the input button 301, and is not limited to a specific display area.

[0079] In step 330, the food and drink information input device 100 may input food and drink information according to the position on the input guide 302 where the activated input button 301 is deactivated when the user activates the input button 301 through step 320. For example, when the user activates the input button 301 through step 320, the user may drag and move the activated input button 301 to a position corresponding to 33 people within a range of 0 to 50 people, and then deactivate the input button 301 at the position corresponding to 33 people. In this case, the food and drink information input device 100 may confirm the position of the input button 301 on the input guide 302 corresponding to the 33 people deactivated by the user, and input food and drink information for 33 people according to the confirmed position.

[0080] Meanwhile, as shown in Fig. 4, in step 310, the camera operates in a shooting mode in which an input guide 302 and input buttons 301 that move along the input guide 302 are displayed on the shooting screen. Here, the input guide 302 can display an input range for food and drink information. For example, the input guide 302 displays an input range from 0 to 50 servings, which is a unit related to spaghetti. The input button 301 displays an initial input value (e.g., 25 servings corresponding to 50%) corresponding to the initial position on the input guide 302, or an input value previously set by the user.

[0081] The food and drink information input device 100 can display an input limit range for the recognized food. The input limit range may be composed of a minimum value 304 and a maximum value 305. The food and drink information input device 100 can adjust the minimum value 304 and the maximum value 305 of the displayed input limit range. The input limit range can be increased or decreased. The input unit of food and drink information can be varied to be wider or narrower depending on the adjusted minimum value 304 and maximum value 305 of the input limit range.

[0082] For example, the food and drink input device 100 displays the minimum value 304 of the input limit range as 0 servings and the maximum value 305 servings. At this time, if the food and drink information input device 100 detects a previously set adjustment action of the input limit range (e.g., pressing the shooting screen), it can adjust the minimum value 304 of the input limit range to 15 servings and the maximum value 305 to 35 servings. The input limit range is adjusted from 50 servings to 20 servings. By adjusting the input limit range from 50 servings to 20 servings, the input unit of food and drink information can be changed more finely.

[0083] On the other hand, as shown in FIG. 5, the food and drink information input device 100 corrects the input food and drink information through steps 340 to 360.

[0084] In step 340, the food and beverage information input device 100 displays the food and beverage information previously input by the user, and the user can modify the previously input food and beverage information by tapping. For example, the user loads the record corresponding to 25 people out of the previously input food and beverage information for 20 people, 15 people, 25 people, and 8 people.

[0085] Then, in step 350, the food and beverage information input device 100 displays the previously input food and beverage information (e.g., servings for 25 people) to the user, and the user corrects the previously input food and beverage information to another food and beverage information value (e.g., servings for 26 people).

[0086] Thereafter, in step 360, the food and drink information input device 100 updates the previously recorded food and drink information (for example, servings for 25 people) to the food and drink information (for example, servings for 26 people) corrected by the user.

[0087] Meanwhile, as shown in FIG. 6, the food and drink information input device 100 completes recording of food and drink information related to the remaining food input by the user through steps 370 to 380.

[0088] In step 370, the food and drink information input device 100 records the food and drink information input through steps 310 to 330. Alternatively, the food and drink information input device 100 modifies previously recorded food and drink information and updates and records the modified food and drink information through steps 340 to 360.

[0089] In step 380, the food and drink information input device 100 sorts the food and drink information by the date the remaining food record was saved and displays it to the user. For example, the food and drink information input device 100 may display food and drink information (e.g., servings for 20 people, servings for 14 people, servings for 25 people, servings for 8 people, servings for 17 people, etc.) entered on July 26, 2021. The user may select other days of the week to view food and drink information entered on other days.

[0090] In this way, food information can be input simultaneously with photographing through activation and deactivation actions by the user in the photographing mode. For example, the activation and deactivation actions can be realized by a single touch and touch release action, drag and drag release action, or push and push release action on the photographing screen, a pre-defined double touch action (or double click action) and double touch and release action (or double click and release action), a simultaneous push and release action of two or more input buttons, or a simultaneous touch action (or simultaneous click action) and simultaneous touch and release action on two or more areas. The activation and deactivation actions may be any activation and deactivation actions for photographing and are not limited to specific activation and deactivation actions. Alternatively, food information can be input simultaneously with photographing through a combination of at least one of the user's activation and deactivation actions and the user's multimodal interface input action in the photographing mode.

[0091] 7 to 9 are exemplary diagrams showing an input operation of food and drink information regarding the discharge of leftover food according to an embodiment of the present invention.

[0092] The food and drink information input device 100 receives input of information on leftover food or food waste to be disposed of via steps 410 to 430.

[0093] figure 7 As shown in FIG. 3, in step 410, the food and drink information input device 100 operates in a photography mode in which an input guide 402 and input buttons 401 that are moved along the input guide 402 are displayed on the photography screen. Here, the input guide 302 shown in FIG. 3 is arranged horizontally, and 7 The input guide 402 shown in Fig. 1 is arranged vertically. The direction of the input guide is preferably aligned with the amount of food and drink that the user can intuitively understand, but is not limited to a specific direction. The input guide 402 may display an input range related to food waste information. For example, the input guide 402 may display an input range of 0L to 120L, which is a unit related to food waste. The input button 401 may display an initial input value (e.g., 60L corresponding to 50%) corresponding to the initial position on the input guide 402, or may display a default input value already set by the user.

[0094] In step 420, when the user drags and moves the input button 401 while it is activated, the food and drink information input device 100 allows the user to confirm the position of the moved button on the input guide 402. In addition, the food and drink information input device 100 can display the food waste information value (e.g., 86.4 L corresponding to 72%) corresponding to the position of the input button 401 moved along the input guide 402 in a size larger than the previously set size. Here, the food waste information value corresponding to the position of the moved input button 401 can be displayed in any area of ​​the display or inside the input button 401, and is not limited to a specific display area.

[0095] In step 430, the food and drink information input device 100 can input food and drink information according to the position on the input guide 402 where the activated input button 401 is deactivated when the user activates the input button 401 through step 420. For example, when the user activates the input button 401 through step 420, the user can drag and move the activated input button 401 to a position of 86.4L within a range of 0L to 120L, and then deactivate the input button 401 at the 86.4L position. Then, the food and drink information input device 100 can confirm the position of the input button 401 on the input guide 402 that corresponds to the deactivated 86.4L by the user, and input food waste information as 86.4L according to the confirmed position.

[0096] Meanwhile, as shown in FIG. 8, the food and drink information input device 100 can correct the input food waste information through steps 440 to 460.

[0097] In step 440, the food and beverage information input device 100 displays the food waste information previously input by the user and allows the user to modify the previously input food waste information by tapping. For example, the user may read the record corresponding to 86.4L out of the previously input food waste information of 50L, 65L, 75L, and 86.4L.

[0098] Then, in step 450, the food and beverage information input device 100 displays the previously input food waste information (e.g., 86.4 L) to the user, and the user corrects the previously input food waste information to another food waste information value (e.g., 86.5 L).

[0099] Thereafter, in step 460, the food and drink information input device 100 updates the previously recorded food waste information (for example, 86.4 L) to the food waste information (for example, 86.5 L) corrected by the user.

[0100] Meanwhile, as shown in FIG. 9, the food and drink information input device 100 completes recording of the food waste information input by the user through steps 470 to 480.

[0101] In step 470, the food and drink information input device 100 records the food waste information input through steps 410 to 430. Alternatively, the food and drink information input device 100 modifies previously recorded food waste information and updates and records the modified food waste information through steps 440 to 460.

[0102] In step 480, the food and beverage information input device 100 saves the food waste discharge record by date selected by the user. In addition, the food and beverage information input device 100 can sort the food waste information by saved date and display it to the user. For example, the food waste information input device 100 can display food waste information (e.g., 50L, 65L, 86.4L, 70L, etc.) entered on July 26, 2021. The user can select another day of the week to check food waste information entered on another day.

[0103] 10 and 11 are exemplary diagrams illustrating a food information input operation related to food intake information according to an embodiment of the present invention.

[0104] The food and drink information input device 100 receives food and drink information related to intake information indicating that food and drink is to be consumed or that food and drink has been consumed, through steps 510 and 520 .

[0105] 10, in step 510, the food and drink information input device 100 operates in a photographing mode in which an input guide 502 related to the input of intake information and an input button 501 that moves along the input guide 502 are displayed on the photographing screen. Here, the input guide 502 displays an input range for intake information. For example, the input button 501 may display at least one of "Manubi," "Ranubi," "Danubi," "Nanubi," etc. as consumer information who plans to consume or has consumed the food and drink displayed on the photographing screen. Alternatively, the input button 501 may display at least one of "Afternoon Snack," "Morning Snack," etc. as menu information who plans to consume or has consumed the food and drink displayed on the photographing screen.

[0106] As shown in FIG. 11, in step 520, the food and drink information input device 100 inputs food and drink information according to the position on the input guide 502 (e.g., consumer "Ranubi") where the activated input button 501 is deactivated, when the user activates the input button 501 at the initial position (e.g., consumer "Danubi") via step 310. For example, when the user activates the input button 501 at the initial position, consumer Danubi, via step 520, the user can drag and move the activated input button 501 to the position of consumer Ranubi, and then deactivate the input button 501 at the position of consumer Ranubi. Then, the food and drink information input device 100 can confirm the position of the input button 501 on the input guide 502 corresponding to consumer "Ranubi" that the user deactivated, and input the consumer information as "Ranubi" according to the confirmed position. Meanwhile, when the pre-meal or post-meal food menu is displayed, the food and drink information input device 100 makes the pre-meal and post-meal food menus different colors so that the user can recognize them.

[0107] Hereinafter, a food and drink information input process according to another embodiment of the present invention will be described in detail with reference to Figures 12 to 17. Figure 12 is a flowchart showing a food and drink information input method according to another embodiment of the present invention, and Figures 13 to 17 are diagrams for explaining the food and drink information input process of Figure 12.

[0108] First, referring to FIGS. 12 to 14, a food and drink information input method according to another embodiment of the present invention is performed by at least one processor of the food and drink information input device 100 or a computer that is the food and drink information input device 100.

[0109] First, the food and drink information input device 100 operates in the photographing mode (S210).

[0110] By operating a food and drink information input application (not shown), the food and drink information input device 100 operates in a photographing mode, and the camera 120 is activated.

[0111] Next, the food and drink information input device 100 determines whether a preset condition is met (S220). For example, the preset condition includes a condition for the camera 120 to accurately capture an image on the display 130 or a condition for the food and drink to be more accurately recognized.

[0112] Next, if a preset condition is met, the food and drink information input device 100 displays a UI on the display 130 (S230).

[0113] When the food and drink information input device 100 does not automatically take a photograph, the food and drink information input device 100 takes a photograph of the food and drink according to the user's photograph input. However, according to another embodiment of the food and drink information input method of the present invention, the user can input food and drink information, including the amount of food and drink consumed, into the food and drink information input device 100 at the same time as taking a photograph of the food and drink.

[0114] For this purpose, the UI displayed on the display 130 may be a UI that allows input of food and beverage information including the amount of food and beverage, and referring to FIG. 13, it may be, for example, a bar-shaped UI 610, but is not limited thereto.

[0115] To take a photograph using the food and drink information input device 100, the user must touch the display 130, for example, and at this time, the user can input food and drink information including the amount of food and drink the user plans to consume through the touched position according to the UI displayed on the display 130. That is, the user can input food and drink information including the amount of food and drink they plan to consume at the same time as taking a photograph by touching the display 130 once, thereby reducing the user's effort of having to separately input food and drink information including the amount of food and drink.

[0116] 13, the bar-shaped UI 610 displays the intake ratio of the food and drink displayed on the display 130. However, without being limited thereto, various UIs may be provided depending on the type of food and drink recognized by the camera 120.

[0117] For example, the unit of food (e.g., piece, piece, etc.) may be displayed on the UI depending on the type of food recognized by the camera 120, and if food divided into pieces is recognized by the camera 120, the piece may be displayed on the UI as the unit of food.

[0118] In some embodiments, a single touch of the display 130 by the user does not input food and beverage information, including the amount of food and beverage to be consumed, at the same time as the photograph input, but a UI for inputting food and beverage information, including the amount of food and beverage to be consumed, may be provided separately from the photograph input.

[0119] In some embodiments, referring to FIG. 14, a potential consumer area 710 for setting a consumer of food or drink may be provided as a UI displayed on the display 130.

[0120] For example, the user may be able to select a consumer of the food or beverage through the consumer candidate area 710, and pre-set consumer candidates other than the owner of the food or beverage information input device 100 may be displayed on the display 130, and recent consumers of the food or beverage or consumers set with a high frequency may be displayed as consumer candidates on the display 130. The user can then use the UI to set multiple consumers of the food or beverage.

[0121] Meanwhile, the UI displayed on the display 130 has an area where direct input and setting can be performed, and if there is no suitable target for intake candidates, the user can select direct input and input the intake person.

[0122] The food and drink information input device 100 is not limited to the form of a smartphone shown in FIG. 15, but is not limited to any mobile form including a camera 120.

[0123] 16, in some embodiments, the food and drink information input device 100 may provide the user with food and drink information related to food and drink selected by the user from among the foods recognized by the camera 120. For example, the user may select and input the food and drink information into the food and drink information input device 100 by touching an image of some of the foods displayed on the display 130, but the method by which the user selects and inputs the food and drink information into the food and drink information input device 100 is not limited thereto.

[0124] In addition, when the food and drink information input device 100 is not used for personal purposes but is used by employees in a cafeteria or the like for an unspecified number of people, the food and drink candidates can be displayed as a group of food and drink candidates. A group of food and drink candidates divided based on at least one characteristic can be displayed on the display 130. For example, the combinations of age and gender can be displayed as teenage females, teenage males, females in their twenties, males in their twenties, etc., but are not limited thereto.

[0125] In some embodiments, when food or drink is recognized via the camera 120, the food and drink information input device 100 displays a UI on the display 130 and at the same time provides the user with food and drink information regarding the recognized food or drink, or the food and drink information input device 100 provides the user with food and drink information regarding the recognized food or drink regardless of displaying a UI on the display 130.

[0126] Specifically, when food and drink is recognized through the camera 120 even before the user takes a photograph, the food and drink information input device 100 can provide the user with food and drink information about the recognized food and drink. That is, when food and drink is recognized through the camera 120, the food and drink information input device 100 can provide the user with food and drink information about the recognized food and drink analyzed in real time. The food and drink information may include, for example, calorie information about the food and drink, type information about the food and drink, and nutritional information about the food and drink, and there is no limit to the type of food and drink information as long as it can be derived based on the image of the recognized food and drink. The food and drink information can be analyzed in the food and drink information input device 100 or the external server 200 based on the image of the recognized food and drink.

[0127] The food and drink information input device 100 can provide food and drink information derived based on the image of the food and drink recognized by the user through visual, auditory, or tactile methods. For example, referring to Fig. 12, the calorie information of the food and drink can be displayed on the display 130 along with the image of the food and drink recognized through the camera 120. The food and drink information input device 100 can also provide nutritional information of the food and drink through a speaker (not shown), such as "The current meal is high in protein and contains a lot of vitamins, so it is good for relieving fatigue."

[0128] However, the food and drink information input device 100 of the present invention is not limited to the form of a smartphone shown in Fig. 12, but is not limited to a mobile form including a camera 120. For example, referring to Fig. 19, the food and drink information input device 100 according to an embodiment of the present invention may not include a display 130.

[0129] Thereafter, the food and drink information input device 100 receives food and drink information input from the user via the UI (S240).

[0130] In some embodiments, a user can photograph a person eating the food or beverage using the food and beverage information input device 100. For example, after food and beverage information is input using the food and beverage information input device 100, the user can photograph a person eating the food or beverage using the food and beverage information input device 100, and the food and beverage information input device 100 can recognize a person who is photographed at a time closest to the time when the food or beverage was photographed as the person eating the food or beverage, or can recognize a person included in an image with a background similar to the background of the photographed food or beverage as the person eating the food or beverage.

[0131] In some embodiments, the food and beverage information input device 100 changes the unit of food and beverage displayed on the input button or at any position according to the type of food and beverage recognized, and quantity information of the recognized food and beverage can be input based on the changed unit of food and beverage.

[0132] In some embodiments, the food and beverage information input device 100 analyzes the food and beverage image of the recognized food and beverage to determine whether it is before or after a meal, and if the food and beverage image is of food and beverage taken before a meal, it can record it as a food and beverage review by the user before a meal, or if the food and beverage image is of food and beverage taken after a meal, it can record it as a food and beverage review by the user after a meal.

[0133] In some embodiments, the food and drink information input device 100 can display recognizable types of food and drink suggestions based on the recognized type of food and drink.

[0134] In some embodiments, the food and beverage information input device 100 can search for recognized restaurants based on the location of the food and beverage information input device, and correct and display the input food and beverage information based on the menu information of the searched restaurants.

[0135] 17, in some embodiments, the food and beverage information input device 100 may search for the recognized restaurant based on the location of the food and beverage information input device, and may order food and beverages corresponding to the input food and beverage information based on the menu information of the searched restaurant. In this case, the food and beverage information input device 100 allows the user to order food and beverages from the restaurant through a payment process, etc., by touching an order button 810 displayed on the photographing screen for the food and beverages recognized as the menu of the searched restaurant.

[0136] In some embodiments, when food and drink information is input, the food and drink information input device 100 may provide a user with a preset incentive for the input food and drink information.

[0137] In some embodiments, the food and beverage information input device 100 calculates and displays intake target information taking into account user characteristics according to the recognized food and beverage, and receives input of planned intake information for the recognized food and beverage from the user, and can display the ratio of the input planned intake information to the displayed intake target information.

[0138] In some embodiments, after the user consumes the recognized food and beverage, the food and beverage information input device 100 may display whether the user has succeeded or failed in the intake goal based on the displayed intake goal information and the input intake plan information.

[0139] As shown in FIG. 18, the food and beverage information input device 100 can diagnose the user's eating habits and provide the user's current nutrition intake status information by period (e.g., by day, month, year, or interval). For example, the current nutrition intake status information includes total calories, carbohydrates, protein, fat, sodium, calcium, iron, vitamin A, thiamine, riboflavin, vitamin C, etc. The user's current nutrition intake status information includes first current nutrition intake status information relative to a target interval in which the target interval is displayed, and second current nutrition intake status information relative to a recommended amount. The food and beverage information input device 100 can calculate and display the first current nutrition intake status information relative to a target interval and the second current nutrition intake status information relative to a recommended amount, taking into account the user's current nutrition intake status information according to the recognized food and beverage.

[0140] Although Figures 13 to 18 are shown in a sequential order, this is merely an illustrative explanation of the technical ideas of other embodiments of the present invention, and a person having ordinary skill in the art to which other embodiments of the present invention pertains can apply various modifications and variations by changing the order shown in Figures 13 to 18 or by performing one or more steps in parallel, within the scope that does not deviate from the essential characteristics of this embodiment, and therefore Figures 13 to 18 are not limited to a chronological order.

[0141] Hereinafter, a food and drink information input process according to another embodiment of the present invention will be described in detail with reference to Figures 19 to 21. Figure 19 is a flowchart showing a food and drink information input method according to another embodiment of the present invention, Figure 20 is a diagram showing an example of a food and drink information input device according to another embodiment of the present invention, and Figure 21 is a diagram showing an example of a photographing operation according to another embodiment of the present invention.

[0142] First, referring to FIGS. 19 to 21, a food and drink information input method according to another embodiment of the present invention can be performed by at least one processor of the food and drink information input device 100 or a computer that is the food and drink information input device 100.

[0143] First, the food and drink information input device 100 operates in a photographing mode (S310). The food and drink information input device 100 operates in the photographing mode by the operation of a food and drink information input application (not shown), and the camera 120 is activated.

[0144] Next, the food and drink information input device 100 provides a photographing guide to the user (S320).

[0145] In order to accurately analyze food information including images, the camera 120 must be positioned parallel to the food to be photographed and photographed from vertically above the food. If the food is not photographed according to the above conditions, it is difficult to perform a highly accurate analysis of the acquired food information.

[0146] For this purpose, the food and drink information input device 100 analyzes whether the food and drink are parallel to the food and drink information input device 100, whether the food and drink information input device 100 or the camera 120 is horizontal, and whether the camera 120 is positioned vertically above the food and drink, and can provide the user with a shooting guide to enable the user to move the position of the food and drink information input device 100 or the camera 120.

[0147] The method of providing the user with the shooting guide may be visual, auditory, or tactile, and may include, but is not limited to, visually displaying the shooting guide on the display 130, outputting the shooting guide through a speaker (not shown), or providing the shooting guide through a vibration module (not shown).

[0148] Next, the food and drink information input device 100 determines whether or not a preset condition is met (S330).

[0149] In some embodiments, when the food and drink information input device 100 operates in a photographing mode and the camera 120 is activated, the food and drink information input device 100 may determine whether a preset condition is met. The preset condition may include at least one of a condition for accurate photographing in the photographing mode, a condition for the food and drink information input device 100 to provide food and drink information to the user, and a condition for food and drink to be recognized through the camera 120.

[0150] Specifically, when food and drink is recognized through the camera 120 even before the user takes a photograph, the food and drink information input device 100 can provide the user with food and drink information about the recognized food and drink. That is, when food and drink is recognized through the camera 120, the food and drink information input device 100 can provide the user with food and drink information about the recognized food and drink analyzed in real time. The food and drink information may include, for example, calorie information of the food and drink, type information of the food and drink, and nutritional information of the food and drink, and there is no limit to the type of food and drink information as long as it can be derived based on the image of the recognized food and drink. The food and drink information can be analyzed in the food and drink information input device 100 or the external server 200 based on the image of the recognized food and drink.

[0151] The food and drink information input device 100 can provide a photographing guide or food and drink information derived based on the image of the food and drink recognized by the user through a visual, auditory, or tactile method. For example, the calorie information of the food and drink can be displayed on the display 130 along with the image of the food and drink recognized through the camera 120. The food and drink information input device 100 can also provide nutritional information of the food and drink through a speaker (not shown), such as "The current meal is high in protein and contains a lot of vitamins, so it is good for relieving fatigue."

[0152] The food and drink information input device 100 according to another embodiment of the present invention is not limited to the smartphone form shown in Fig. 15, but is not limited to a mobile form including a camera 120. For example, referring to Fig. 20, the food and drink information input device 100 according to another embodiment of the present invention may not include a display 130.

[0153] The food and drink information input device 100 automatically takes a photograph when a preset condition is met (S340). That is, when a preset condition is met, the food and drink information input device 100 can automatically take a photograph without any photographing input from the user.

[0154] The preset conditions are optimal conditions for photographing food and drink using the camera 120. For example, the preset conditions may be a condition that the food and drink information input device 100 or the camera 120 is horizontal, a condition that the movement of the food and drink information input device 100 or the camera 120 is equal to or less than a predetermined value, or a condition that food and drink is recognized in an image photographed by the camera 120. Alternatively, the preset conditions may be at least one of a condition that the recognized food and drink information input device 100 are parallel to each other, a horizontal condition of the food and drink information input device 100, a position condition of the food and drink information input device 100 vertically above the recognized food, and a movement condition of the food and drink information input device 100.

[0155] That is, referring to FIG. 21, the food and drink information input device 100 can automatically take a photo when eating and drinking are recognized with the camera 120 level and without shaking of the camera 120.

[0156] According to another embodiment of the food and beverage information input process of the present invention, the food and beverage information input device 100 provides a shooting guide to the user so that the user can find the optimal shooting conditions, and when the optimal shooting conditions are met, the food and beverage information input device 100 automatically takes a photo, thereby increasing the convenience of the user.

[0157] In some embodiments, the food and drink information input device 100 determines whether a preset condition is satisfied (S330), and if the preset condition is satisfied, may not automatically take a photo but may instead notify the user to take a photo. For example, the food and drink information input device 100 may notify the user using at least one of a visual, auditory, or tactile method. The food and drink information input device 100 may notify the user to take a photo by displaying a notification on the display 130, by illuminating a light-emitting device (not shown) included in the food and drink information input device 100, or by using a speaker (not shown) or a vibration module (not shown), but is not limited thereto.

[0158] In some embodiments, a user can photograph a person eating the food or beverage using the food and beverage information input device 100. For example, after automatic photography is performed by the food and beverage information input device 100, the user can photograph a person eating the food or beverage using the food and beverage information input device 100, and the food and beverage information input device 100 may recognize a person photographed at a time closest to the time the food or beverage was photographed as the person eating the food or beverage, or may recognize a person included in an image with a background similar to the background of the photographed food or beverage as the person eating the food or beverage.

[0159] In some embodiments, after a photograph is taken, the food and beverage information input device 100 may request the user to input the amount of food and beverage consumed or a review of the food and beverage consumed, and may adjust the reward provided to the user in accordance with the request, taking into account the time the user entered the information.

[0160] In some embodiments, the food and drink information input device 100 can provide the user with food and drink information recognized from the image when an image is captured automatically or by user input. That is, when a photo of food and drink is captured through the camera 120, the food and drink information input device 100 can provide the user with food and drink information about the food and drink analyzed in real time. The food and drink information may include, for example, calorie information, type information, and nutritional information of the food and drink. There is no limit to the type of food and drink information as long as it can be derived based on the recognized image of the food and drink. The food and drink information can be analyzed in the food and drink information input device 100 or the external server 200 based on the recognized image of the food and drink.

[0161] Meanwhile, a food information input process according to another embodiment of the present invention will be described in detail.

[0162] According to the food and drink information input process according to another embodiment of the present invention, the food and drink information input device 100 can provide various functions to the user after the food and drink information input device 100 takes an image.

[0163] The food and drink information input device 100 has various input methods for various functions from the user, as follows.

[0164] First, a selectable area is provided as a UI on the display 130, and the user's input can be interpreted differently depending on the position where the user touches (or clicks) in the corresponding selectable area.

[0165] Also, when the user drags the image onto the display 130, the food and drink information input device 100 can perform a predetermined function.

[0166] In addition, when there is a double touch input (or double click input), pressing two or more buttons simultaneously, or simultaneous touch input (or click input) to two or more areas, the food and drink information input device 100 can perform a predetermined function accordingly.

[0167] Finally, the user can directly set a mode for executing a corresponding function, so that the food and drink information input device 100 can perform a predetermined function.

[0168] Meanwhile, the food and drink information input device 100 provides the following functions to the user after taking a photograph.

[0169] First, when photographing is performed using the food and drink information input device 100, the user can set a storage space for the photographed image.

[0170] For example, when a photograph is taken using the food and drink information input device 100, the photographed image is analyzed and a suitable folder for saving the photographed image is recommended from among existing folders, and the user can save the photographed image in the corresponding folder by dragging it.

[0171] In addition, users can freely create folders such as places to revisit in the future, dishes I make at home, and highest expectations, and drag and save images they have taken into the corresponding folders.

[0172] In addition, when photographing is performed using the food and drink information input device 100, the user can easily share the photographed image.

[0173] For example, when a user drags a captured image in a specific direction or inputs a sharing command, the image may be shared with other users via SNS, etc. Also, when the food and drink information input device 100 is set to a sharing mode through mode setting, if a captured image includes food and drink, the image may be automatically shared with other users via SNS, etc., without any additional input.

[0174] This allows users to upload images they have taken to an unspecified community and share information about food and drink, making it possible for people who are wondering what type of food to eat, who are looking for images of food and drink, or who are looking for fun to use the images.

[0175] Next, the food and drink information input device 100 receives a pre-intake review or a post-intake review from the user.

[0176] The food and drink information input device 100 analyzes the captured image to determine whether it is an image of food and drink before a meal or an image of food and drink after a meal, and if it is an image of food and drink before a meal, it can record the user's review after the image is captured as a pre-intake review, and if it is an image of food and drink after a meal, it can record the user's review after the image is captured as a post-intake review.

[0177] For example, in the case of a photographed image of food and drink before eating, the food and drink information input device 100 may allow the user to record a pre-ingestion review, and may record a pre-ingestion review such as a maximum pre-ingestion expectation value or a minimum pre-ingestion expectation value according to the direction of the drag input made by the user on the display 130. However, the method of inputting the pre-ingestion review is not limited thereto.

[0178] In addition, in the case of an image of food and drink after eating, the food and drink information input device 100 may allow the user to record a post-eating review. For example, the food and drink information input device 100 may display a post-eating review such as maximum post-eating satisfaction or minimum post-eating satisfaction according to the drag input direction performed by the user on the display 130. rear Reviews can be recorded, but the method of entering reviews after consumption is not limited to this.

[0179] The food and drink information input method according to an embodiment of the present invention can be implemented as a program (or application) and stored in a medium so as to be executed in combination with a hardware device.

[0180] The program may include code written in a computer language such as C, C++, JAVA, or machine language that is read by the computer's processor (CPU) through a computer device interface to cause the computer to load the program and execute the method embodied in the program. This code may include functional code related to functions defining the functions necessary to execute the method, and execution procedure-related control code necessary for the computer's processor to execute the function according to a predetermined procedure. This code may also include memory reference-related code for determining at which location (address) in the computer's internal or external memory additional information or media necessary for the computer's processor to execute the function should be referenced. If the computer's processor needs to communicate with another remote computer or server to execute the function, the code may also include communication-related code for determining how to communicate with the other remote computer or server using the computer's communication module and what information or media should be sent and received during communication.

[0181] The storage medium refers to a medium that stores data semi-permanently and is readable by a device, rather than a medium that stores data for a short time, such as a register, cache, or memory. Specific examples of the storage medium include, but are not limited to, ROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical data storage device. That is, the program can be stored in various recording media on various servers to which the computer can connect, or various recording media on the user's computer. Furthermore, the medium can be distributed among computer systems connected via a network to store computer-readable code in a distributed manner.

[0182] The steps of a method or algorithm described in connection with embodiments of the present invention may be embodied directly in hardware, in a software module executed by hardware, or in a combination thereof. The software module may reside in Random Access Memory (RAM), Read Only Memory (ROM), Erasable Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), Flash Memory, a hard disk, a removable disk, a CD-ROM, or any other form of computer-readable storage medium well known in the art to which the present invention pertains.

[0183] Although the embodiments of the present invention have been described above with reference to the accompanying drawings, those skilled in the art will understand that the present invention can be embodied in other specific forms without changing the technical spirit or essential features thereof. Therefore, it should be understood that the above-described embodiments are illustrative in all respects and are not limiting.

Claims

1. A food and drink information input method performed by a food and drink information input device, operating in a photography mode in which an input guide and input buttons that can be moved along the input guide are displayed on a photography screen; inputting at least one piece of food and drink information using the input guide and the input button while operating in the photography mode; A method for inputting food and beverage information, including:

2. The step of inputting at least one piece of food and drink information includes: The food and beverage information input method according to claim 1, wherein, while operating in the photography mode, the food and beverage information is input according to the position on the input guide where the activated input button is deactivated when the user activates an input button displayed on the photography screen.

3. The food and drink information input method according to claim 1 , further comprising the step of displaying, on the photographing screen, at least one piece of food and drink information corresponding to a position on the input guide of an input button activated by a user.

4. The step of displaying the at least one piece of food and drink information on the photographing screen includes: The food and drink information input method according to claim 3, wherein the food and drink information corresponding to the position of the input button on the input guide activated by the user is displayed on the photographing screen in a size larger than a pre-set size.

5. The step of inputting at least one piece of food and drink information includes: The food and beverage information input method according to claim 1, wherein a user activates an input button displayed on the shooting screen and moves the activated input button, thereby selectively inputting at least one piece of food and beverage information depending on the direction of movement on the inactivated input guide.

6. The step of inputting at least one piece of food and drink information includes: The food and beverage information input method of claim 1, wherein a user activates an input button displayed on the shooting screen and moves the activated input button, thereby selectively inputting at least one piece of food and beverage information according to the distance and direction of movement on the inactivated input guide.

7. 2. The food and beverage information input method of claim 1, further comprising a step of displaying at least one of the following related to the at least one input food and beverage information: user allergy impact level, skin nutrition level, growth nutrition level, disease impact level, aging impact level, diet impact level, planned calorie intake compared to target calories, salinity, food and beverage conversion value, food and beverage cost information, food and beverage environmental information, carbon value information, resource value information, carbon emissions, operating expenses loss costs, ingredient information, pre-meal input button, post-meal input button, favorite input button, and wish list save button.

8. Further, the method includes a step of recognizing food and drink displayed on the photographing screen, The food and drink information input method according to claim 1 , wherein the input at least one piece of food and drink information is related to the recognized food and drink.

9. The step of inputting at least one piece of food and drink information includes: The food and drink information input method according to claim 8, wherein the unit of food and drink displayed on the input button is changed according to the type of food and drink recognized, and quantity information of the recognized food and drink is input based on the changed unit of food and drink.

10. The food and drink information input method according to claim 8 , further comprising the step of displaying an input limit range for the recognized food and drink.

11. adjusting the minimum and maximum values ​​of the displayed input limit range; The food and drink information input method according to claim 10, wherein an input unit of the food and drink information is changed according to the minimum and maximum values ​​of the adjusted input limit range.

12. calculating and displaying intake target information that takes into account the characteristics of the user according to the recognized food and drink; a step of inputting intake plan information for the recognized food and drink from the user; The food and drink information input method according to claim 8 , further comprising the step of displaying a ratio of the input intake plan information to the displayed intake goal information.

13. The food and beverage information input method of claim 12, further comprising a step of displaying whether the user has succeeded in or failed to achieve the intake goal based on the input intake plan information compared with the displayed intake goal information after the user has consumed the recognized food and beverage.

14. analyzing a food image of the recognized food to determine whether it is before or after a meal; The food and beverage information input method of claim 8, further comprising a step of recording the food and beverage image as a user's food and beverage review before eating if the food and beverage image is food and beverage photographed before eating, or recording the food and beverage image as a user's food and beverage review after eating if the food and beverage image is food and beverage photographed after eating.

15. A camera and The display and a memory for storing one or more programs; a processor for executing the one or more stored programs; The processor: The display operates in a photography mode in which an input guide and input buttons that move along the input guide are displayed on the photography screen, The food and drink information input device is configured such that, while operating in the photographing mode, at least one piece of food and drink information is input via the camera using the input guide and the input buttons.

Images