Beverage drinking record system

Abstract

To provide a beverage drinking record system that supports beverage drinking culture of a user.SOLUTION: A beverage drinking record system 10 includes: a user information acquisition unit 28 that acquires user attribute information including a group identifier; a beverage ingestion record reception unit 28a that receives a beverage ingestion record; a storage unit 26 that stores the beverage ingestion record; a statistical processing unit 30a that performs statistical processing on ingestion records of two or more beverages within a predetermined period; an intake quantity output unit 38a that outputs, on the basis of a result of the statistical processing, an ingestion quantity of a predetermined component contained in an ingested drink to a user terminal 16; and a content distribution unit 38 that selects, on the basis of the result of the statistical processing, content information related to the beverage and distributes the selected content information to the user terminal 16. The beverage ingestion record reception unit 28a receives image information 18 photographed by a user at time of ingesting a beverage and / or information regarding emotion of the user.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] This application relates to a food and drink recording system.

Background Art

[0002] In recent years, with the development of information processing technology, health management including the management of alcohol consumption can be performed from a user terminal such as a smartphone or a tablet. For example, Patent Document 1 discloses an alcohol consumption management system including a user terminal and a management server configured to be connectable from the user terminal. The alcohol consumption management system receives information related to the user's alcohol consumption including information related to the user's alcohol consumption amount and context information from the user terminal, transmits the received information to the management server, and aggregates and / or analyzes the information received from the user terminal in the management server. Further, the alcohol consumption management system can feedback the aggregated and / or analyzed result to the user terminal.

[0003] However, such a system is for monitoring and managing the alcohol consumption of a user who is a patient with a disease, the user's relatives, and medical staff, and is not for creating a healthy and cultural life for the user by popularizing a rich alcohol culture, that is, knowledge about good ways of interacting with alcohol. Therefore, it is desirable that the user terminal can be utilized not only for managing the user's alcohol consumption amount but also for developing the alcohol culture.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In consideration of the above problems, an object of the present invention is to provide a food and drink recording system for supporting a user's food and drink culture.

Means for Solving the Problem

[0006] One aspect of the present disclosure is a food and beverage recording system that records a user's beverage intake situation, including a user information acquisition unit that acquires user attribute information including a group identifier, a beverage intake record reception unit that receives a beverage intake record, a storage unit that stores the beverage intake record, a statistical processing unit that performs statistical processing on the intake records of two or more beverages within a predetermined period, an intake amount output unit that outputs to the user terminal the intake amount of a predetermined component contained in the consumed beverage based on the result of the statistical processing, and a content distribution unit that selects content information related to the beverage and distributes the content information to the user terminal based on the result of the statistical processing. The beverage intake record reception unit is characterized by receiving image information at the time of beverage intake taken by the user and / or information related to the user's emotion.

[0007] In addition, in one aspect of the present disclosure, in addition to the image of the beverage at the time of beverage intake, images of food and drink and the beverage intake location may be included.

[0008] Furthermore, in one aspect of the present disclosure, the information related to the user's emotion may include information obtained by indexing at least one of joy, anger, pleasure, and sadness.

[0009] In addition, in one aspect of the present disclosure, the content information distributed to the user terminal may include product information, brand information, or category information related to the beverage.

[0010] Furthermore, in one aspect of the present disclosure, the content information distributed to the user terminal may include information on retail stores where the consumed beverage can be purchased or food and beverage stores where it can be consumed.

[0011] In addition, in one aspect of the present disclosure, the content information distributed to the user terminal may include information on beverages that contain little or no predetermined components according to the frequency of beverage intake.

[0012] Furthermore, in one aspect of the present disclosure, when information regarding a specific emotion is received from a user, it may be configured to distribute content information corresponding to the specific emotion.

Advantages of the Invention

[0013] According to one aspect of the present disclosure, a food and beverage intake recording system includes a user information acquisition unit that acquires user attribute information including a group identifier, a beverage intake record reception unit that receives a beverage intake record, and a storage unit that stores the beverage intake record. Therefore, it is possible to record the beverage intake status of a user who eats and drinks. Further, the food and beverage intake recording system includes a statistical processing unit that performs statistical processing on two or more beverage intake records within a predetermined period, and based on the result of the statistical processing, outputs the intake amount of a predetermined component contained in the consumed beverage from an intake amount output unit to a user terminal, and can select content information regarding the beverage and distribute this from a content distribution unit to the user terminal. Thereby, not only can the food and beverage intake amount of the user be managed, but also the healthy and cultural life of the user can be supported by the spread of knowledge regarding the user's food and beverage culture, that is, the good combination method with beverages. Furthermore, the beverage intake record reception unit can receive image information at the time of beverage intake photographed by the user and / or information regarding the user's emotion. Thereby, for example, it is possible to recommend beverages and drinking methods suitable for the user and / or provide information useful for improving the user's mental health.

[0014] Also, according to one aspect of the present disclosure, in addition to an image of the beverage at the time of beverage intake, it includes images of food and the beverage intake location. Therefore, the food and beverage intake recording system can recommend beverages and drinking methods suitable for the eating and drinking scene, and can support the healthy and cultural life of the user by the spread of knowledge regarding the good combination method with beverages.

[0015] Furthermore, according to one aspect of the present disclosure, the information regarding the user's emotions includes information that indexes at least one of joy, anger, pleasure, and sadness. Therefore, the food and beverage recording system can quantitatively grasp the user's mental state in the food and beverage scene and provide information that helps improve the user's mental health.

[0016] Also, in one aspect of the present disclosure, the content information distributed to the user terminal can include product information, brand information, or category information regarding beverages. Therefore, the user can deepen their knowledge of the beverages they consume and more clearly understand their own beverage preferences. As a result, the food and beverage recording system can contribute not only to the management of the user's food and beverage consumption but also to the development of the user's food and beverage culture.

[0017] Furthermore, in one aspect of the present disclosure, the content information distributed to the user terminal can include information on retail stores where the consumed beverages can be purchased or food and beverage stores where the beverages can be consumed. Therefore, the user can utilize the content information to easily purchase and consume beverages. As a result, the food and beverage recording system can contribute not only to the management of the user's food and beverage consumption but also to the development of the user's food and beverage culture.

[0018] Also, in one aspect of the present disclosure, the content information distributed to the user terminal can include information regarding beverages that contain little or no predetermined components according to the frequency of beverage intake. Therefore, the food and beverage recording system can recommend how to drink beverages suitable for the user's health according to the frequency of the user's beverage intake. As a result, the food and beverage recording system can propose a good way to match with beverages and support the user's healthy and cultural life.

[0019] Furthermore, in one aspect of the present disclosure, when receiving information regarding a specific emotion from a user, it may be configured to distribute content information corresponding to the specific emotion. For this reason, the food and drink recording system can distribute content information that, for example, alleviates a specific emotion or enables a brighter emotion such as happy or delighted to last longer, according to the emotion of the user during eating and drinking. Thereby, the food and drink recording system can propose a good way to pair with beverages and support the user's healthy and cultural life.

Brief Description of the Drawings

[0020]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

DETAILED DESCRIPTION OF THE INVENTION

[0021] Hereinafter, with reference to the accompanying drawings, a food and drink record system according to an embodiment will be described. The same or corresponding elements are denoted by the same reference numerals, and duplicate descriptions will be omitted. For ease of understanding, the scale of the drawings may be changed for the description.

[0022] FIG. 1 shows an exemplary conceptual diagram of a content distribution system 10 (hereinafter referred to as "system 10") incorporating a food and drink record system 10 according to an embodiment. The system 10 includes, for example, a server 12 installed by a merchant providing goods and / or services or by a server operator commissioned by the merchant, a merchant terminal 14 installed and owned by the merchant, and a user terminal 16 owned by a user as a customer who receives the goods and / or services.

[0023] The server 12, the merchant terminal 14, and the user terminal 16 are configured to be communicable via the network NW. The network NW can use, for example, the Internet, a wireless communication system based on a communication standard such as WiFi (registered trademark), Bluetooth (registered trademark), 3G or 5G (3rd, 5th Generation Mobile Communication System), or other communication methods, or any combination thereof, and can use wired, wireless, or a combination thereof. Thereby, as will be described later, the system 10 can distribute content information including information on products or stores recommended by the merchant based on the user attribute information and purchase information input by the user via the user terminal 16 from the server 12. Further, the system 10 can distribute content information including information on beverages and drinking methods suitable for a food and beverage scene and information useful for improving the user's mental health from the server 12.

[0024] As shown in FIG. 2, the server 12 includes, for example, a communication unit 22, a processing unit 24, a storage unit 26, and an input unit (not shown), and these components are electrically connected to each other by, for example, a bus or the like. Note that the server 12 may include components other than the above-described components. Further, instead of using the server 12 to exhibit the functions as in the present embodiment, a computer, a tablet, a smartphone, or a device having other arithmetic processing functions and / or communication functions may be used.

[0025] The communication unit 22 includes a communication interface circuit for connecting the server 12 to the network NW and communicating with the merchant terminal 14 and the user terminal 16. The processing unit 24 is configured to acquire user attribute information and determine content information including information on products or stores recommended to the user, and is configured to include, for example, one or more CPUs (Central Processing Units). Note that the processing unit 24 may alternatively or additionally be configured to include an independent integrated circuit, a microprocessor, and / or firmware.

[0026] The storage unit 26 is configured to store user attribute information and content information, and is configured to include, for example, a storage device such as a ROM (READ ONLY MEMORY), a RAM (RANDOM ACCESS MEMORY), and a hard disk drive. The storage unit 26 is also configured to be able to store various programs executed by the processing unit 24. Note that the programs executed by the processing unit 24 are not limited to being stored in the storage device from the beginning, and may be stored in the storage unit using, for example, a known setup program or the like from a computer-readable portable recording medium such as a CD-ROM or a DVD-ROM.

[0027] As shown in FIG. 1, the merchant terminal 14 is configured to create content information to be distributed to the user or to receive and accumulate content information from outside the merchant terminal 14, and may be, for example, a computer, a server, a tablet, a smartphone, or another communicable device. Note that, hereinafter, the server 12 and the merchant terminal 14 will be described as being separately provided, but this is not a limitation. For example, without providing a server, the merchant terminal may perform all operations from the acquisition of user attribute information to the distribution of content information in a unified manner.

[0028] The user terminal 16 is configured to enable the user to input user attribute information and receive and check content information. For example, it may be a mobile phone such as a smartphone or a feature phone, a tablet, or a personal computer. Further, dedicated application software for inputting user attribute information and receiving and checking content information may be installed in the user terminal 16. Additionally, the user terminal 16 may include, for example, a CPU, a ROM, a RAM, a storage device such as a hard disk drive, and / or an input device and / or a display device such as a touch panel, a mouse, a keyboard, and a liquid crystal display.

[0029] The user attribute information input from the user terminal 16 includes, for example, information such as a user ID, the user's name, the user's gender, date of birth, and location information (address or postal code of the place of residence or work). These user attribute information are used in the processing unit 24 as so-called user identifier information for simply recognizing the user or group identifier information used as an index when segmenting the user. Each user attribute information is defined as user identifier information or group identifier information according to the content of the content information to be distributed and the purpose of distributing the content information.

[0030] In addition, the purchase information of the user input from the user terminal 16 includes history information such as a purchase history including the user's product purchase date and a store visit history including the date of receiving the service, and not limited to expense information, but also includes information related to the products purchased by the user and information related to the stores visited by the user. These product information and store information are used as group identifier information when segmenting users according to the content of the content information to be distributed and the purpose of distributing the content information. The server 12 can identify and acquire purchase information from the text information input by the user from the user terminal 16 and the image information transmitted from the user terminal 16. Specifically, the server 12 is configured to read information from image information such as a photo 18 of a store visited by the user and a product purchased, and a photo 20 of a receipt for payment and product purchase at the store among the images transmitted from the user terminal 16, and to identify product information and store information.

[0031] In FIG. 1, photos 18 and 20 show, as an example of products and services, photos 18 of food and beverages and food and beverage stores, and photos 18 of their receipts. Here, the food and beverages mentioned refer to all foods and beverages (excluding pharmaceuticals, quasi-drugs, and products such as regenerative medicine defined by the Act on Securing Quality, Efficacy, and Safety of Pharmaceuticals, Medical Devices, etc.), regardless of whether they are cooked or not. Also, the beverages mentioned here include both alcoholic beverages and non-alcoholic beverages. The alcoholic beverages include, for example, beer, alcoholic carbonated beverages other than beer, that is, sparkling sake, a sparkling alcoholic beverage with a beer flavor infused with another alcoholic beverage manufactured from raw materials other than malt (so-called third beer), chu-hai, cocktail sour, umeshu soda, spirits soda, sparkling sake, sparkling wine, or highball, and various other beverages. The non-alcoholic beverages include non-alcoholic carbonated beverages, that is, non-alcoholic beer, non-alcoholic spirits, non-alcoholic wine, non-alcoholic sour, non-alcoholic cocktail, or carbonated juice, and various other beverages. Note that these beverages also include concentrated beverages (stock solutions).

[0032] Furthermore, the server 12 is configured to receive and record the beverage intake record input from the user terminal 16. Here, the intake record includes not only the amount of beverage intake, but also information on food and drink and the place of beverage intake at the time of beverage intake, as well as information regarding the user's feelings, etc.

[0033] As shown in FIG. 2, the processing unit 24 of the server 12 includes a user information acquisition unit 28, a user feature calculation unit 30, and a content distribution unit 38. The user information acquisition unit 28 is configured to acquire the user attribute information input by the user on the user terminal 16 and record it in the storage unit 26. The user information acquisition unit 28 further has a beverage intake record reception unit 28a configured to receive the beverage intake record input from the user terminal 16 and record it in the storage unit 26. Also, the user feature calculation unit 30 is configured to determine the content information to be distributed for each segment of the user based on the user attribute information. Furthermore, the content distribution unit 38 is configured to distribute the content information determined by the user feature calculation unit 30 to the user terminals 16 of the users belonging to the segment.

[0034] The storage unit 26 includes a user information storage unit 40, a content information storage unit 42, and a history information storage unit 44. The user information storage unit 40 is configured to store, that is, record, user attribute information, purchase information of the user, and beverage intake records input by the user on the user terminal 16. The content information storage unit 42 is configured to record product information and store information created by merchants for distribution to users. Further, the history information storage unit 44 is configured to record purchase information of the user input from the user terminal 16. Furthermore, the storage unit 26 includes a product information storage unit 46 and a store information storage unit 48. In the product information storage unit 46, information related to products such as product images and JAN codes is stored so that products can be identified from the purchase information of the user input from the user terminal 16. In the store information storage unit 48, information related to stores such as D codes is stored so that stores can be identified from the purchase information of the user input from the user terminal 16.

[0035] The user feature calculation unit 30 includes a score calculation unit 32, a content feature calculation unit 34, and a matching determination unit 36. The score calculation unit 32 defines one or more pieces of information to be used as group identifier information from among the user attribute information and the user's purchase information according to the content of the content information to be distributed and the distribution purpose of the content information. Weighting, that is, scoring, is performed on the group identifier information defined in this way according to the relevance to the distribution purpose, and a score (when using a plurality of pieces of group identifier information, the sum of the scores), that is, a score as a user feature, is calculated. A user whose score exceeds a predetermined value is determined to be a user with a high relevance to the distribution purpose and is extracted as a matching target, that is, segmented (see step S40 in FIG. 3). Further, the content feature calculation unit 34 extracts features along the distribution purpose from the accumulated content information (see step S50 in FIG. 3) and quantifies these features, that is, calculates feature values. Here, the user features for calculating the feature values include, as specific examples, area information, category information, purchase segment information, and purchase brand information. The area information can include the location of the store where the user purchased the product and the store where the user visited (for example, Shibaura 3-chome, Minato-ku, Tokyo, etc.). Also, the category information can include, for example, the category information of the product (beverage) that the user purchased or consumed from among the pre-defined product category information such as alcoholic beverages or non-alcoholic beverages (for example, alcoholic beverages, etc.). Furthermore, the purchase segment information can include, for example, the purchase segment information of the product (beverage) that the user purchased or consumed from among the pre-defined purchase segment information such as beers / chu-hais / shochus / wines / sakes / health teas / (for example, high-quality beers among beers, etc.). Also, the purchase brand information can include, for example, the purchase brand information of the product (beverage) that the user purchased or consumed from among the pre-defined purchase brand information such as S-class (ultra-high quality) / A-class (high quality) / B-class (superior quality) / C-class (mass production quality) (for example, ultra-high quality beers among S-class (ultra-high quality), etc.).

[0036] Furthermore, the matching determination unit 36 quantitatively determines whether the combination of the segmented user groups and the content information matches the distribution purpose by using the scores and feature values. Based on this, the content information to be distributed to the segmented user groups is determined (see step S60 in FIG. 3). A series of processes executed by the user feature calculation unit 30 in this way can be executed by any method of machine learning (AI), a program other than machine learning created in advance, or manual calculation by a merchant. The content distribution unit 38 distributes the content information determined by the user feature calculation unit 30 to the segmented user groups (see step S70 in FIG. 3) and ends the process (see step S80 in FIG. 3).

[0037] The user feature calculation unit 30 includes a statistical processing unit 30a, and is configured to perform statistical processing on the beverage intake records when a beverage is consumed two or more times within a predetermined period (for example, one week, one month, etc.). Specifically, the number of days of consuming beverages containing a predetermined component, that is, alcohol, a large amount of sugar, purines, etc. (the number of drinking days), and the total amount of alcohol, sugar, and purines contained in the consumed beverages are calculated to obtain the alcohol intake amount, sugar intake amount, and purine intake amount within a predetermined period. The content distribution unit 38 includes an intake amount output unit 38a, and outputs the intake amounts of these components from the intake amount output unit 38a to the user terminal 16 (see FIG. 18).

[0038] The statistical processing unit 30a is also configured to identify the types of beverages and dishes and the types of beverage consumption locations (for example, restaurants, homes, party venues, etc.) from the images of the food and beverages consumed and the beverage consumption locations included in the intake records recorded in the user information storage unit 40 of the storage unit 26, and then perform statistical analysis on these. Furthermore, the statistical processing unit 30a is configured to extract dishes that seem to match the identified beverages or beverages that seem to match the identified dishes, and extract food and beverages that seem to match the identified beverage consumption locations. The content distribution unit 38 can recommend the food and beverages extracted in this way to the user through the user terminal 16 as beverages and drinking methods suitable for the eating and drinking scenes.

[0039] Further, the statistical processing unit 30a is configured to quantitatively grasp the user's mental state in the eating and drinking scene by statistically analyzing the information related to the user's emotion at the time of beverage intake included in the intake record recorded in the user information storage unit 40 of the storage unit 26 in combination with the food and drink and the beverage intake location at the time of beverage intake. Further, the statistical processing unit 30a is configured to extract information useful for improving the user's mental health corresponding to the mental state of the specified user. The content distribution unit 38 can distribute the information useful for improving the mental health extracted in this way to the user through the user terminal 16.

[0040] The flow of distributing the content information in the system 10 will be described while associating the flowchart of the processing of the content information in the server 12 shown in FIGS. 3, 7, and 10 with the display screen 50 of the user terminal 16 shown in FIGS. 4 to 18.

[0041] FIG. 4 shows the display screen 50 of the user terminal 16 on which the start screen of the application software related to the system 10 is displayed. In this embodiment, the eating and drinking record system 10 is incorporated in the content distribution system 10 including information on products or stores recommended by merchants. When the user activates this application software, the processing flow of the server 12 shifts to step S10 shown in FIG. 3.

[0042] When the user inputs the user ID and logs in, the server 12 shifts to step S20 and acquires the attribute information of the user (information such as the user's gender, date of birth, place of residence, or address and postal code of the place of work, etc.) registered at the first activation of the application software.

[0043] The logged-in user can input purchase information and food and beverage consumption history via the display screen 50 (menu screen) shown in FIG. 5. In the example shown in FIG. 5, the menu screen 50 is formed with a point display section D1 that displays points given by the merchant when the user inputs purchase information, etc., and input buttons B1 to B5 for inputting purchase information, etc. The input buttons B1 to B5 are configured such that when purchase information, etc. is input via them, points are given to the user by the merchant. Therefore, the incentive for the user to input purchase information and food and beverage consumption history can be enhanced. Here, the menu screen 50 is provided with an input button B1 for recording the purchase history of goods by utilizing the receipt image, and an input button B2 for recording the store visit history by inputting or selecting the store where food and beverage was consumed.

[0044] Furthermore, the menu screen 50 is provided with an input button B3 for recording the participation history and participation registration in events planned and proposed by the merchant. Also, when the user achieves a target pre-registered by the user and approved by the merchant or a target proposed by the merchant (for example, participating in a full marathon, climbing Mount Fuji, etc.), an input button B4 for recording the implementation history to receive points is provided. Furthermore, the menu screen 50 is provided with an input button B5 for recording the food and beverage consumption history.

[0045] Figs. 6(a) and 6(b) show the acceptance screen for purchase item records. When the user taps the input button B1 (see Fig. 5) for recording the purchase history of the items on the menu screen 50, the server 12 proceeds to step S30 (see Fig. 3) and displays, as shown in Fig. 6(a), the input screen for the purchased items on the display screen 50 of the user terminal 16. The user can select the type of beverage purchased from among the types of beverages (beverages) displayed under the display of "Input of Purchased Items". Also, on the input screen, items (beverages) for which the user has had a high purchase opportunity based on the user's purchase history are displayed. For this reason, the user can easily select the type of purchased item (purchased beverage). When the type of purchased beverage is selected, an acceptance screen for an image of the receipt for the purchased beverage as shown in Fig. 6(b) is displayed on the display screen 50 of the user terminal 16. The user can tap the user terminal 16 in accordance with the display content of the display screen 50 and take a picture of the receipt for the purchased beverage (an example is shown in Fig. 6(c)).

[0046] Fig. 7 shows, as a flowchart, a specific example of the processing corresponding to steps S30 to S60 of the flowchart shown in Fig. 3 in the case of processing purchase item records. Also, Figs. 8(a) to 8(c) show the confirmation screen for purchase item records and the registration screen for purchase item records. The acceptance of purchase item records is started in step S110, and in step S120, the server 12 receives the image (photo 20) of the receipt for the purchased item (Fig. 6(c)) taken by the user.

[0047] The user information acquisition unit 28 acquires an image and analyzes the receipt image (photo 20) using an image processing program other than AI or machine learning (for example, OCR reading), or visual inspection by a merchant, etc. As a result, from the purchase information such as product name, price, and purchase date and time displayed on the receipt, store / chain store name information, purchase / eating area information, product purchase date and time information, purchased product / brand information, etc. are identified, and it is confirmed whether it matches the product selected by the user. Further, after associating the identified information as group identifier information, it is recorded (stored) in the user information storage unit 40. At this time, on the user terminal 16, a screen notifying that the receipt is being confirmed as shown in FIG. 8(a) is displayed. The user information acquisition unit 28 also checks, in step S130, whether the acquired purchased product / brand information includes a product that is a target of content distribution, or whether the acquired store / chain store name information includes a store / chain store that is a target of content distribution. The user information acquisition unit 28 further associates (links) the purchased product / brand information or store / chain store name information that is a target of content distribution with the user identifier information in step S140. When these processes are completed, as shown in FIG. 8(b), it is displayed on the display screen 50 of the user terminal 16 that the confirmation is completed, and subsequently, as shown in FIG. 8(c), it is displayed that the merchant has given points to the user along with the registration of the purchased product record.

[0048] System 10 proceeds to step S150 shown in FIG. 7, determines store information and product information related to the visited store (food and beverage store) and the products consumed, and provides (distributes) these to the user. For this purpose, System 10 proceeds to step S160 and step S70 of the flowchart in FIG. 3 corresponding thereto. The information distributed to the user includes, for example, as corresponding to area information, store information such as stores newly opened in the neighboring area, stores highly evaluated by the user, stores during a campaign, and the like. Also, as corresponding to category information and purchase segment information, information about stores that provide beverages belonging to the same category or purchase segment can be mentioned. Furthermore, as corresponding to purchase brand information, information about high-class stores (expert stores) that provide beverages of the same brand can be mentioned. These stores include food and beverage stores that the user has never visited and stores other than food and beverage stores such as supermarkets. In the example shown in FIG. 8(c), on the registration screen of the purchase product record of the user terminal 16, in addition to the registration of the purchase product record, advertisements for new products (new beverages) combined with privilege information such as the present of a gift card and guidance on events held by merchants can be displayed. Thus, the information to guide, that is, recommend, the user is specified by the user feature calculation unit 30 based on the user's purchase information. Based on the analysis by the user feature calculation unit 30 (processing from step S40 to step S60 in FIG. 3), System 10 can recommend not only products with a purchase history of the user but also products without a purchase history (including new products) and non-product items such as food and beverage stores (processing of step S70 and step S80 in FIG. 3). For this reason, System 10 can distribute product information or store information while broadly promoting the potential needs of the user, and can enhance the affinity with the user's preferences.

[0049] Figs. 9(a) and 9(b) show the reception screen of the store visit record. When the user taps the input button B2 (see Fig. 5) for recording the store visit history on the menu screen 50, the server 12 proceeds to step S30 (see Fig. 3), and as shown in Fig. 9(a), displays an input screen for the image of the food and beverage store visited and the beverage consumed at the time of the store visit on the display screen 50 of the user terminal 16. The user can input the image of the beverage taken at the time of the store visit during or after the store visit. Also, when the user taps "Select the store where I drank", the user proceeds to the input screen as shown in Fig. 9(b). If the user is currently at the store, the user can utilize the GPS function incorporated in the user terminal 16 to search for and identify the food and beverage store visited from the current location of the store visited, or if the user is during or after the store visit, from the keywords related to the food and beverage store, and input (transmit) it to the server 12. Also, on the input screen, based on the user's store visit history, food and beverage stores that the user has visited frequently are displayed. Therefore, the user can easily select the food and beverage store visited.

[0050] Fig. 10 shows, as a flowchart, a specific example of the processing from step S30 to step S60 of the flowchart shown in Fig. 3 when processing the store visit record. Also, Figs. 11(a) and 11(b) show the confirmation screen and the registration screen of the store visit record. In step S210, the reception of the store visit record is started, and in step S220, the server 12 receives the store visit information and the image of the beverage consumed (Fig. 11(a)) transmitted by the user.

[0051] The user information acquisition unit 28 acquires the visited store information and images, and analyzes the images of the beverages consumed during the visit using an image processing program other than AI and machine learning (e.g., OCR reading), or visual inspection by a merchant, etc. As a result, store / chain store name information, purchase / dining area information, product purchase date and time information, purchased product / brand information, etc. are identified, and it is confirmed whether it matches the input dining store. Furthermore, after associating the identified information as group identifier information, it is recorded (stored) in the user information storage unit 26. FIG. 12 shows an example of the visited store record stored in the user information storage unit 26. In this example, the visited store record is classified for each dining store, each visit history (visited store history), and each retail store where products are purchased. The user information acquisition unit 28 also checks, in step S230, whether the products included in the acquired visited store record include products that are targets of content distribution, or whether the acquired store / chain store name information includes stores / chain stores that are targets of content distribution. The user information acquisition unit 28 further associates, in step S240, the purchased product / brand information that is the target of content distribution, or the store / chain store name information with the user identifier information. When these processes are completed, as shown in FIG. 11(b), it is displayed on the user's display screen 50 that the confirmation is completed, and that the merchant has awarded points to the user with the registration of the visited store record.

[0052] System 10 proceeds to step S250 shown in FIG. 10, determines store information and product information related to the visited store (food and beverage store) and the products consumed, and can proceed to step S260 and step S70 of the flowchart in FIG. 3 to provide (distribute) this information to the user. The information distributed to the user includes, for example, information about beverages of the same brand as shown in the example of FIG. 13(a) as corresponding to the purchased brand information. Also, as corresponding to the category information and purchase segment information, information about products (such as new product information) that offer beverages belonging to the same category or purchase segment can be cited. For this reason, these products (beverages) also include products (beverages) that the user has not purchased and consumed. Furthermore, as corresponding to the area information, store information such as stores newly opened in the neighboring area, stores highly evaluated by the user, and stores during a campaign as shown in the example of FIG. 13(b) can be cited. These stores also include food and beverage stores that the user has not visited and stores other than food and beverage stores such as supermarkets. Also, as shown in FIG. 13(b), the content information distributed to the user can include privilege information (such as "skewer cutlets for 100 yen" in the figure). Furthermore, in the example shown in FIG. 11(b), recommendations for products, food and beverage stores, and events can be displayed on the registration screen for the visited store record. Here, the information to guide, that is, recommend to the user, is specified by the user feature calculation unit 30 based on the user's purchase information. System 10 can recommend not only food and beverage stores with the user's store visit history but also food and beverage stores without a store visit history and products (beverages) instead of food and beverage stores based on the analysis by the user feature calculation unit 30 (processing from step S40 to step S60 in FIG. 3) (processing in step S70 and step S80 in FIG. 3). For this reason, System 10 can distribute product information or store information while widely promoting the user's potential needs, and can enhance the affinity with the user's preferences.

[0053] FIG. 14(a) shows a reception screen for event participation records or event participation registrations, and FIG. 14(b) shows a registration screen for event participation records and event participation wishes. When the user taps the input button B3 (see FIG. 5) for recording the participation history in the event on the menu screen 50, the server 12 shifts to step S30 (see FIG. 3), and displays on the display screen 50 of the user terminal 16 a selection screen for event information as shown in FIG. 14(a). The user can select the event information that the user has participated in or the event information that the user wishes to participate in from the events displayed on the display screen 50. Also, on the selection screen, based on the user's event participation history, events that are in progress or scheduled to be held and that the user is likely to be interested in can be displayed (recommended) (the processing from step S40 to step S80 in FIG. 3).

[0054] As shown in FIG. 14(b), when the event that the user has participated in or the event that the user wishes to participate in is selected, it is displayed on the display screen 50 that the registration has been completed, and subsequently, it is displayed that the merchant has awarded points to the user along with the registration of the event. The system 10, in the user feature calculation unit 30, by performing analysis including the location information included in the user attribute information in the group identifier (the processing from step S40 to step S60 in FIG. 3), for example, not only within the activity range of the user's daily life, but also content information related to food and beverages and food and beverage stores and content information related to events at locations outside the activity range of the user's daily life can be distributed (the processing in steps S70 and S80 in FIG. 3). For this reason, the system 10 can distribute product information or store information while broadly inferring the potential needs of the user, and can enhance the affinity with the user's preferences.

[0055] Figure 15(a) shows the acceptance and confirmation screen for eating and drinking records, and Figure 15(b) shows the registration screen for eating and drinking records. Also, Figures 16(a) and 16(b) show the confirmation screen for the entered eating and drinking records. When the user taps the input button B5 (see Figure 5) for recording the eating and drinking history on the menu screen 50, the server 12 proceeds to step S30 (see Figure 3) and displays on the display screen 50 of the user terminal 16 the acceptance and confirmation screen for eating and drinking records as shown in Figure 15(a). When the user taps the acceptance screen for eating and drinking records, an input screen for eating and drinking records as shown in Figure 15(b) is displayed. The user can input from the input screen for eating and drinking records the date of eating and drinking, the type of beverage (here, alcohol) consumed, and the amount of beverage consumed. Here, in addition to these pieces of information, as shown in Figures 16(a) and 16(b), a photo (image) taken during eating and drinking can also be input (recorded). For this reason, the system 10 can analyze the drinking situation including the atmosphere of the user during eating and drinking from the image taken during eating and drinking. The analysis result can be utilized to grasp the mental state of the user in the eating and drinking scene, and as will be described later, information useful for improving the user's mental health can be appropriately provided.

[0056] Furthermore, the user can input information regarding the user's emotion during eating and drinking, that is, information obtained by quantifying the user's feeling of joy (in the example in Figure 15(b), it is quantified with definitions such as "happy", "joyful", "ordinary", "relaxed"). Furthermore, text input for explaining or supplementing this emotion-related information can also be performed. For this reason, the mental state of the user in the eating and drinking scene can be quantitatively grasped, and information useful for improving the user's mental health can be appropriately provided. Note that here, as information regarding the user's emotion, it has been described as inputting the feeling of joy, but it is not limited to this, and other feelings such as anger, pleasure, and sadness may be input together with or instead of the feeling of joy.

[0057] When the user completes the input from the registration screen shown in Fig. 15(b), a confirmation screen for eating and drinking records as shown in Figs. 16(a) and 16(b) is displayed on the display screen 50, and the user can confirm the input. When the user's confirmation is completed, the input information is recorded in the user information storage unit 40 of the storage unit 26. Also, on the display screen 50 of the user terminal 16, as shown in Fig. 17, it is displayed that the registration of eating and drinking records is completed, and that the merchant has awarded points to the user along with the registration of the store visit record.

[0058] When the user's drinking record is registered, the statistical processing unit 30a can perform statistical processing on the beverage intake record when the user has consumed beverages two or more times within a predetermined period (for example, one week, one month, etc.). Therefore, for example, the number of days of consuming beverages containing alcohol, a large amount of sugar, purines, etc. (the number of eating and drinking days) and the total amount of alcohol, sugar, etc. contained in the consumed beverages can be calculated, and the alcohol intake amount, sugar intake amount, and purine intake amount within a predetermined period can be calculated (in the embodiment, alcohol). The user can tap the confirmation screen for eating and drinking records (see Fig. 15(a)) to display such statistical analysis results as information on the eating and drinking history, as shown in the display example of the eating and drinking history in Fig. 18. As a result, the number of days of consuming alcohol (the number of eating and drinking days) and the total amount of alcohol contained in the consumed beverages can be confirmed, which can be used for the user's own eating and drinking management. Also, the statistical processing unit 30a is configured to compare the calculated intake amounts of alcohol, sugar, purines, etc. with a predetermined threshold value to determine whether the intake is excessive. When the statistical processing unit 30a determines that the user has excessive intake of these, it can extract (select) beverages that contain little or no these components and distribute (recommend) them to the user as content information.

[0059] Furthermore, the statistical processing unit 30a identifies the types of beverages and dishes and the types of beverage intake locations (e.g., restaurants, homes, party venues, etc.) from the images of food and beverages and beverage intake locations at the time of beverage intake included in the intake records recorded in the user information storage unit 40 of the storage unit 26 (see FIGS. 16(a) and 16(b)), and is configured to perform statistical analysis on these. For this reason, the statistical processing unit 30a can extract dishes that seem to match the identified beverages or beverages that seem to match the identified dishes, or extract food and beverages that seem to match the identified beverage intake locations. The information on beverages and food and beverages extracted in this way includes not only product information regarding beverages but also brand information and category information. The content distribution unit 38 can distribute (recommend) the content information extracted in this way to the user through the user terminal 16. Furthermore, the statistical processing unit 30a extracts information on retail stores where the beverages included in the intake records or the beverages and food and beverages included in the extracted content information can be purchased or information on restaurants where they can be consumed as content information, and can distribute (recommend) it to the user through the user terminal 16.

[0060] Also, the statistical processing unit 30a can quantitatively grasp the user's mental state in the eating and drinking scene by performing statistical analysis by combining information regarding the user's emotions at the time of beverage intake (see FIGS. 16(a) and 16(b)) included in the intake records recorded in the user information storage unit 40 of the storage unit 26 with the food and beverages and beverage intake locations at the time of beverage intake (see FIG. 11(a)). Furthermore, the content distribution unit 38 can distribute (display) information useful for improving the user's mental health to the user terminal 16 together with the display of the drinking history shown in FIG. 18 or individually corresponding to the mental state of the user identified by the statistical processing unit 30a. Specifically, content information that relieves emotions such as sadness and loneliness and leads the user to positive emotions or content information that can make bright emotions such as happiness and joy more sustainable can be selected and distributed.

[0061] Subsequently, the operation and effects of the system 10 according to the present embodiment will be described.

[0062] According to the system 10 according to this embodiment, the system 10 includes a user information acquisition unit 28 that acquires user attribute information including a group identifier, a beverage intake record reception unit 28a that receives a beverage intake record, and a storage unit 26 that stores the beverage intake record. Therefore, the intake status of the user's beverages can be recorded. Further, the system 10 includes, for example, a statistical processing unit 30a that performs statistical processing on the intake records of two or more beverages within a predetermined period such as one month or one week. Based on the result of the statistical processing, the intake amount of a predetermined component contained in the consumed beverage is output from the intake amount output unit 38a to the user terminal, and content information regarding the beverage is selected and distributed from the content distribution unit 38 to the user terminal 16. Thereby, not only the management of the user's drinking amount but also the popularization of knowledge regarding the user's drinking culture, that is, the good combination with beverages, can support the user's healthy and cultural life. Furthermore, the beverage intake record reception unit 28a can receive image information at the time of beverage intake photographed by the user and / or information regarding the user's emotion. Thereby, for example, it is possible to recommend beverages and drinking methods suitable for the user and / or provide information useful for improving the user's mental health.

[0063] Furthermore, according to the system 10 according to this embodiment, in addition to the image of the beverage at the time of beverage intake, images of food and drink and the beverage intake location can be included. Therefore, the eating and drinking record system can recommend beverages and drinking methods suitable for the eating and drinking scene, and support the user's healthy and cultural life by the popularization of knowledge regarding the good combination with beverages.

[0064] Also, according to the system 10 according to this embodiment, the information regarding the user's emotion can include information obtained by indexing at least one of joy, anger, pleasure, and sadness. Therefore, the eating and drinking record system can quantitatively grasp the user's mental state in the eating and drinking scene and provide information useful for improving the user's mental health.

[0065] Moreover, according to the system 10 according to the present embodiment, the content information distributed to the user terminal 16 can include product information, brand information, or category information related to beverages. Therefore, the user can deepen their knowledge of the beverages they consume and more clearly understand their own beverage preferences. As a result, the system 10 can contribute not only to the management of the user's eating and drinking but also to the development of the user's eating and drinking culture.

[0066] Furthermore, according to the system 10 according to the present embodiment, the content information distributed to the user terminal 16 can include retail store information where the consumed beverages can be purchased or food and beverage store information where the beverages can be consumed. Therefore, the user can easily purchase and consume beverages by utilizing the content information. As a result, the system 10 can contribute not only to the management of the user's eating and drinking but also to the development of the user's eating and drinking culture.

[0067] Moreover, according to the system 10 according to the present embodiment, the content information distributed to the user terminal 16 can include information about beverages that contain little or no predetermined components according to the frequency of beverage intake. Therefore, the system 10 can recommend how to drink beverages suitable for the user's health according to the frequency of the user's beverage intake. As a result, the system 10 can propose a good way to match with beverages and support the user's healthy and cultural life.

[0068] Furthermore, according to the system 10 according to the present embodiment, when receiving information about a specific emotion from the user, it may be configured to distribute content information corresponding to the specific emotion. Therefore, the system 10 can distribute content information that, for example, relieves a specific emotion or enables a brighter emotion such as happy or delighted to last longer according to the emotion of the user when eating and drinking. As a result, the system 10 can propose a good way to match with beverages and support the user's healthy and cultural life.

[0069] As described above, the system 10 according to the present embodiment can support the user's eating and drinking culture.

[0070] Furthermore, according to the system 10 according to the present embodiment, the system 10 can acquire user attribute information including a group identifier by the user information acquisition unit 28, and record the purchase information of the user in association with the group identifier by the history information storage unit 44. Also, the system 10 can calculate the user characteristics of the user based on the purchase information and group identifier of the user by the user characteristic calculation unit 30. Furthermore, the content distribution unit 38 can determine content information that is presumed to be of interest to the user from among the content information including information on products or stores recommended to the user stored here, based on the user characteristics calculated by the user characteristic calculation unit 30, and distribute it to the user terminal 16 of the user. Therefore, it is possible to distribute content information while estimating the potential needs of the user, including not only within the range of the user's purchase information but also outside this range. As a result, it is possible to distribute product information or store information related to the customer's purchase history information while enhancing the affinity with the user's preferences.

[0071] Although the embodiment of the eating and drinking recording system 10 has been described above, the present invention is not limited to the above embodiment. It is considered that those skilled in the art can understand that various modifications of the above embodiment are possible.

Explanation of Reference Numerals

[0072] 10 Eating and Drinking Recording System (Content Distribution System, System) 16 User Terminal 26 Storage Unit 28 User Information Acquisition Unit 28a Beverage Intake Recording Reception Unit 30a Statistical Processing Unit 38 Content Distribution Unit 38a Intake Output Unit

Claims

1. A food and drink recording system for recording a user's beverage intake situation, a user information acquisition unit that acquires user attribute information including a group identifier, a beverage intake record reception unit that receives a beverage intake record, a storage unit that stores the beverage intake record, a statistical processing unit that performs statistical processing on the intake records of two or more of the beverages within a predetermined period, an intake amount output unit that outputs to a user terminal the intake amount of a predetermined component included in the consumed beverage based on the result of the statistical processing, a content distribution unit that selects content information related to the beverage based on the result of the statistical processing and distributes the content information to the user terminal, and the beverage intake record reception unit receives image information at the time of beverage intake taken by the user and / or information regarding the user's emotion, characterized in that it is a food and drink recording system.

2. The food and drink recording system according to claim 1, wherein the image information includes an image of the food and drink and an image of the beverage intake location in addition to the image of the beverage at the time of beverage intake.

3. The food and drink recording system according to claim 1, wherein the information regarding the user's emotion includes information obtained by indexing at least one of joy, anger, pleasure, and sadness.

4. The food and drink recording system according to claim 1, wherein the content information distributed to the user terminal includes product information, brand information, or category information related to the beverage.

5. The food and drink recording system according to claim 1, wherein the content information distributed to the user terminal includes retail store information where the consumed beverage can be purchased or food and drink store information where the beverage can be consumed.

6. The drinking record system according to claim 1, wherein the content information to be distributed to the user terminal includes information about a beverage that contains almost no or no predetermined components according to the intake frequency of the beverage.

7. The drinking record system according to claim 1, configured to distribute content information corresponding to a specific emotion when information about the specific emotion is received from the user.

Images