Control device, control method, and program

Abstract

A control device (100) for presenting presentation information to a user is provided with: a reception unit (an operation history reception unit (101), a log information extraction unit (106), and a time reception unit (102)) for receiving log information and / or time information from a device (11) communicatively connected via a network; a presentation information creation unit (109) that determines the presentation form of the presentation information on the basis of the received log information and / or time information, and creates the presentation information on the basis of the determined presentation form; and a transmission unit (presentation information transmission unit (104)) that transmits the created presentation information to a presentation device (presentation device (14)) that is communicatively connected via a network, thereby presenting the presentation information to a user.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to a control device, a control method executed by the control device, and a program. BACKGROUND

[0002] Conventionally, a technique of playing back a voice or the like to a user from a device so as to exert an influence (i.e., a presentation of information) on the user from the device side has been used. For example, Patent Literature 1 discloses a voice server that synthesizes and plays back a voice with a speaking characteristic corresponding to a user attribute.

[0003] PRIOR ART LITERATURE PATENT LITERATURE Patent Literature 1: Japanese Patent Application Publication No. 2015-164251 SUMMARY

[0004] PROBLEMS TO BE SOLVED BY THE INVENTION On the other hand, when an influence is exerted on a user from a device side as disclosed in the above-described related art, the user's current situation is not sufficiently taken into consideration, and thus information that is meaningless or annoying to the user is sometimes presented. Thus, the present disclosure provides a control device and the like that can present appropriate information to a user in view of the above-described situation.

[0005] MEANS FOR SOLVING THE PROBLEMS A control device according to one embodiment of the present disclosure is a control device for presenting presentation information to a user, including: a reception unit that receives at least one of log information and time information from a device that is communicatively connected via a network; a presentation information creation unit that decides a presentation form of the presentation information in accordance with at least one of the received log information and the time information, and creates the presentation information in accordance with the decided presentation form; and a transmission unit that transmits the created presentation information to a presentation device that is communicatively connected via the network, so as to cause the presentation information to be presented to the user.

[0006] A control method according to one embodiment of the present disclosure is a control method executed by a control device for presenting presentation information to a user, including: a reception step of receiving at least one of log information and time information from a device that is communicatively connected via a network; a presentation information creation step of deciding a presentation form of the presentation information in accordance with at least one of the received log information and the time information, and creating the presentation information in accordance with the decided presentation form; and a transmission step of transmitting the created presentation information to a presentation device that is communicatively connected via the network, so as to cause the presentation information to be presented to the user.

[0007] A program according to one embodiment of the present disclosure is a program that causes a computer to execute the above-described control method.

[0008] EFFECT OF THE INVENTION The control device according to the present disclosure can present information appropriate for a user. BRIEF DESCRIPTION OF DRAWINGS

[0009] Figure 1 is a block diagram showing a functional configuration of a presentation system including a control device according to the embodiment.

[0010] Figure 2 is a block diagram showing a functional configuration of a storage section according to the embodiment.

[0011] Figure 3 is a diagram showing an example of an inventory database according to the embodiment.

[0012] Figure 4A is a diagram showing an example of a preference database according to the embodiment.

[0013] Figure 4B is a diagram showing an example of a preference database according to the embodiment.

[0014] Figure 5A is a diagram showing an example of a sentence pattern database according to the embodiment.

[0015] Figure 5B is a diagram showing an example of a sentence pattern database according to the embodiment.

[0016] Figure 6 is a diagram showing an example of a phrase database according to the embodiment.

[0017] Figure 7 is a diagram showing an example of a recipe database according to the embodiment.

[0018] Figure 8 is a flowchart showing an example of an operation of a control device according to the embodiment.

[0019] Figure 9 is a diagram showing an example of an event database according to the embodiment.

[0020] Figure 10 is a diagram showing a situation of information presentation according to a modified example of the embodiment. DETAILED DESCRIPTION

[0021] The control device according to the first aspect of the present disclosure is a control device for presenting presentation information to a user, and includes: a reception unit that receives at least one of log information and time information from a device communicatively connected via a network; a presentation information creation unit that determines a presentation form of the presentation information based on at least one of the received log information and the time information, and creates the presentation information based on the determined presentation form; and a transmission unit that transmits the created presentation information to a presentation device communicatively connected via the network, thereby causing the presentation information to be presented to the user.

[0022] This control device can determine a presentation form corresponding to at least one of the log information and the time information, and create the presentation information in the presentation form. As long as the presentation form is determined based on the log information and the time information of the user, appropriate information suitable for the user can be presented.

[0023] In addition, the control device according to the second aspect of the present disclosure, in the control device according to the first aspect, the presentation information creation unit generates profile information of the user based on log information received at a plurality of time points, respectively, and determines the presentation form based on at least one of the received log information and the time information, and the generated profile information.

[0024] Thus, the presentation form can be further determined based on the profile information.

[0025] In addition, the control device according to the third aspect of the present disclosure, in the control device according to the first or second aspect, the presentation information creation unit generates profile information of the user based on log information received at a plurality of time points, respectively, and determines a presentation content included in the presentation information based on at least one of the received log information and the time information, and the generated profile information.

[0026] Thus, the presentation content included in the presentation form can be further determined based on the profile information.

[0027] In addition, the control device according to the fourth aspect of the present disclosure, in the control device according to the second or third aspect, the profile information includes a structure database in which a presentation structure in the presentation form is set in advance for a plurality of time periods, and the presentation information creation unit determines the presentation form to use a presentation structure set for a time period corresponding to a time indicated by the received time information among the plurality of time periods.

[0028] Thus, a presentation structure in an appropriate presentation form for each time period can be determined.

[0029] Further, the control device according to a fifth aspect of the present disclosure, in any of the control devices according to the second to fourth aspects, the profile information includes a stock database of the article held by the user, the plurality of time periods includes a replenishment time period in which the article can be replenished and a consumption time period in which the article cannot be replenished, and the prompt information creation section allows creation of the prompt information on the premise of replenishment of the article when the time period corresponding to the time indicated by the received time information among the plurality of time periods is the replenishment time period, and does not allow creation of the prompt information on the premise of replenishment of the article when the time period corresponding to the time indicated by the received time information among the plurality of time periods is the consumption time period.

[0030] Thus, it is possible to manage the stock of the article and create the prompt information corresponding to the stock. Further, when creating the prompt information, it is possible to create the prompt information with or without taking into account replenishment of the article depending on whether the time period is the replenishment time period or the consumption time period.

[0031] Further, the control device according to a sixth aspect of the present disclosure, in any of the control devices according to the second to fifth aspects, the profile information includes one or more preferences of the user and a weight score assigned to each of the one or more preferences, and the prompt information creation section uses, as the prompt information, a candidate having a larger total value of the weight scores assigned to the preferences suitable in the candidate among the one or more preferences, from among candidates of the prompt information.

[0032] Thus, it is possible to determine the candidate to be used preferentially for the prompt information from among the candidates using the weight scores assigned to the one or more preferences of the user.

[0033] Further, the control device according to a seventh aspect of the present disclosure, in any of the control devices according to the second to sixth aspects, the prompt information creation section determines a prompt form of the prompt information to be an abnormal time form when new received log information deviates from a normal time condition set based on past received log information, and creates the prompt information in accordance with the determined abnormal time form.

[0034] Thus, it is possible to set the prompt form of the prompt information to the abnormal time form when the normal time condition is deviated from.

[0035] Further, the control device according to an eighth aspect of the present disclosure, in any of the control devices according to the first to seventh aspects, the prompt information is recipe information for cooking a dish.

[0036] Thus, it is possible to present the recipe information for cooking the dish as the prompt information.

[0037] Further, the control device according to the ninth aspect of the present disclosure, in any of the first to eighth aspects, presents the presentation information to the user as speech.

[0038] Thus, the presentation information can be presented to the user as speech.

[0039] Further, the control device according to the tenth aspect of the present disclosure, in the control device according to the ninth aspect, the determination of the presentation form includes determining at least one of an utterance sentence pattern and a voice characteristic of the voice when the presentation information is presented, and at least one of the utterance sentence pattern and the voice characteristic of the voice when the presentation information is presented is different between one presentation information created based on at least one of one log information and one time information received and other presentation information created based on at least one of other log information and other time information received.

[0040] Thus, by determining the presentation form, at least one of the utterance sentence pattern and the voice characteristic of the voice when the presentation information is presented can be changed and presented to the user.

[0041] Further, the control device according to the eleventh aspect of the present disclosure, in any of the first to eighth aspects, presents the presentation information to the user as an image.

[0042] Thus, the presentation information can be presented to the user as an image.

[0043] Further, the control device according to the twelfth aspect of the present disclosure, in the control device according to the eleventh aspect, the determination of the presentation form includes determining at least one of a display layout of the image when the presentation information is presented and a sentence pattern of a sentence included in the image, and at least one of the display layout of the image when the presentation information is presented and the sentence pattern of the sentence is different between one presentation information created based on at least one of one log information and one time information received and other presentation information created based on at least one of other log information and other time information received.

[0044] Thus, by determining the presentation form, at least one of the display layout of the image when the presentation information is presented and the sentence pattern of the sentence can be changed and presented to the user.

[0045] In addition, a control method according to a thirteenth aspect of the present disclosure is a control method executed by a control device for presenting presentation information to a user, including: a reception step of receiving at least one of log information and time information from a device communicatively connected via a network; a presentation information creation step of deciding a presentation form of the presentation information based on the at least one of the received log information and the time information, and creating the presentation information based on the decided presentation form; and a transmission step of transmitting the created presentation information to a presentation device communicatively connected via the network, so that the presentation information is presented to the user.

[0046] Thus, the same effects as those of the above-described control device can be obtained.

[0047] In addition, a program according to a fourteenth aspect of the present disclosure is a program for causing a computer to execute the above-described control method.

[0048] Thus, the same effects as those of the above-described control device can be obtained using a computer.

[0049] In addition, these general or specific aspects can also be achieved by a system, a method, an integrated circuit, a computer program, or a recording medium such as a CD-ROM, and any combination of the system, the method, the integrated circuit, the computer program, and the recording medium.

[0050] In addition, the embodiments described below are merely examples of the general or specific aspects. Numerical values, shapes, constituent elements, arrangement positions of constituent elements, connection forms, steps, orders of steps, and the like shown in the following embodiments are examples, and the gist of the present disclosure is not limited to them. In addition, among the constituent elements in the following embodiments, constituent elements not recited in the independent claims are described as arbitrary constituent elements.

[0051] In addition, each drawing is a schematic view and is not necessarily strictly illustrated. Furthermore, in each drawing, the same reference signs are given to substantially the same structures, and repetitive description is omitted or simplified.

[0052] (Embodiment) Hereinafter, the control device according to the present embodiment will be described with reference to Figures 1-10 The control device according to the present embodiment will be described.

[0053] [Structure] First, the structure of the presentation system according to the present embodiment will be described with reference to Figures 1-7 The structure of the presentation system according to the present embodiment will be described. Figure 1 is a block diagram showing the functional structure of the presentation system according to the present embodiment including the control device. In addition, Figure 2is a block diagram showing a functional structure of a storage section according to the present embodiment, that is, various databases stored in the storage section. The control device 100 according to the present embodiment controls information output by the presentation device 14 by creating information (hereinafter referred to as presentation information) presented in the presentation device 14 for presenting information to a user. That is, the control device 100 is a device for presenting appropriate information to a user by using the presentation device 14 to present appropriate presentation information. In the present embodiment, the presentation system is provided with the control device 100, the equipment 11, the terminal device 12, the time server 13, and the presentation device 14. Some of the constituent elements constituting the presentation system can be integrated. Therefore, any one of the control device 100, the equipment 11, the terminal device 12, the time server 13, and the presentation device 14 other than the control device 100 can be integrated with another device.

[0054] The presentation system is, for example, a voice presentation system introduced into a user's home, which presents by playing presentation information as a voice. In addition, the presentation system is not limited to a system that presents presentation information by playing a voice. With respect to presentation systems other than a voice presentation system, other examples of the embodiment are described. The presentation system is not limited to being introduced into a user's home, and can be introduced into, for example, an office building, a rental space, a public facility, and the like. The presentation system is capable of presenting appropriate presentation information to a user who uses such an introduced facility.

[0055] The equipment 11 is a home appliance or the like, which is arranged in a user's home for use by the user. The equipment 11 is, for example, present in a plurality of numbers in the home. The equipment 11 includes cooking equipment, equipment related to housework such as cleaning equipment, equipment related to entertainment such as audio equipment and image output equipment, and equipment related to life such as lighting and air conditioning. It can be considered that when a user uses equipment related to housework, the user is busy, and when the user uses equipment related to entertainment, the user is in a state of being less busy. In addition, based on the content of operation according to whether the equipment being used is cooking equipment, or according to the use history (log information) of the equipment, it is possible to estimate that the user is in a state of being in the middle of cooking, or that the user is in a state of being in the middle of cleaning during a period when cleaning equipment is being used, and thus it is possible to estimate the state of the user. In addition, based on the arrangement area and use history of equipment related to life, it is possible to estimate the state of the presence or absence of a user in each area. In this way, by the use history (log information) of the equipment 11, it is possible to estimate whether the user is busy or not busy, and the state of the user. In the present embodiment, by acquiring the log information of a plurality of pieces of equipment 11 in the home, information required for estimating the state of the user (for example, a time period of being busy or the state of housework in each time period, or both) is estimated, and the presentation device 14 is controlled so as to present presentation information in an appropriate presentation form according to the time period.

[0056] Further, the log information can include information indicating not only whether the device 11 is being used but also how the device 11 is used. For example, the log information includes information indicating whether the refrigerator, which is the device 11, is being used based on whether the door of the refrigerator is opened or closed. Further, if the refrigerator is configured to acquire information on contents, such information can also be used as the log information. In addition, the terminal device 12 described later can also be included in the device 11. In other words, the device 11 can also be the terminal device 12.

[0057] The terminal device 12 is an information terminal such as a smartphone, a tablet terminal, and a PC. The terminal device 12 belongs to a user (in other words, the user owns the terminal device 12). Therefore, an operation on the terminal device 12 can be regarded as an operation by the user. The user can access various information using the terminal device 12. For example, the user can search for a recipe of a dish to be cooked on the day, or investigate food materials recommended from a health point of view, or investigate appropriate living habits, and the like. Then, based on information accessed by the user like this, the prompting system decides prompting information to be recommended to the user, and prompts by the prompting device 14. That is, information corresponding to (information in which the user is interested in) information accessed by the terminal device 12 is selectively prompted as prompting information. Hereinafter, an example in which recipe information of a recipe of a dish to be cooked on the day is prompted as an example of prompting information will be described, but as described above, the prompting information is not limited to the recipe information, and various information such as food material information, information on living habits, news information, recommended store information near the user's home, or other information, and the like can be used.

[0058] The time server 13 is a server that provides time information indicating the current time, and can be a time information server on the Internet or a simple clock, or the like. The time server 13 can also be implemented by the terminal device 12.

[0059] The prompting device 14 is a device for prompting information to a user, and is an example of a prompting device. Here, as long as a speaker capable of playing a voice to a user is provided, it can be used as the prompting device 14. The prompting device 14 can use an audio device or a television capable of network connection, a smartphone, a tablet terminal, or a PC, or the like. Therefore, the terminal device 12 can also be used as the prompting device 14. In this way, the device 11, the terminal device 12, the time server 13, and the prompting device 14 can also be implemented only by the terminal device 12.

[0060] In addition, when there are a plurality of the prompting devices 14, one or more of the prompting devices 14 can be selected, and information can be prompted to the user from the one or more of the prompting devices 14. The one or more of the prompting devices 14 is selected by the control device 100, for example. When the one or more of the prompting devices 14 is selected, the control device 100 can detect the actual position of the user at the target date and time, and select one or more of the prompting devices 14 disposed in the area to which the position belongs, or in a case where the position of the user cannot be detected, one or more of the prompting devices 14 disposed in the area in which the user is estimated to be present at the target date and time can be selected using the state of presence or absence of the user and the like in each area estimated in advance.

[0061] The control device 100 is a device that creates voice data representing recipe information as prompting information based on information received from the device 11, the terminal device 12, and the timepiece server 13, and transmits the voice data to the prompting device 14. The control device 100 is implemented as a cloud server for information processing constructed on the Internet, for example, or an edge server disposed in the user's home. The prompting information (voice data representing recipe information) transmitted by the control device 100 is prompted to the user by the prompting device 14, and thus the control device 100 can also be referred to as a device that causes prompting information to be prompted.

[0062] The control device 100 includes an operation history receiving section 101, a time receiving section 102, a prompting candidate management section 103, a prompting information transmitting section 104, a storage section 105, a log information extracting section 106, a profile generating section 107, a candidate selecting section 108, and a prompting information creating section 109.

[0063] The operation history receiving section 101 is a functional section that receives the operation history of the device 11 or the operation history of the terminal device 12 from these devices. The operation history receiving section 101 outputs the received operation history to the log information extracting section 106.

[0064] The log information extracting section 106 is a processing section that extracts information collected as log information from the operation history. The operation history receiving section 101 and the log information extracting section 106 can also be regarded as part of the function of the receiving section that receives log information. The content of the log information extracted in the log information extracting section 106 differs depending on the form of the prompting information, but here, from the viewpoint of creating recipe information, information necessary to estimate the state of the user (for example, the time period during which the user is busy or the state of housework in each time period, or both) is extracted as log information. In addition, from the viewpoint of creating recipe information, the log information extracting section 106 extracts inventory information of items held by the user that can be used for cooking, that is, food materials used in recipes, as log information. Furthermore, the log information extracting section 106 extracts information related to the preference of the user as log information in order to make the preference of the recipe suitable for the user.

[0065] Among the extracted log information, some is directly used to create recipe information, but some is used to generate profile information of the user based on log information received at a plurality of time points respectively. The generation of the profile information uses the profile generation section 107. The profile generation section 107 is a processing section that generates profile information indicating the user's tendency based on the extracted log information at a plurality of time points. The profile information will be described later. Further, in the generation of the profile information, either the log information alone, both the log information and the time information, or the time information alone can be used.

[0066] On the other hand, the time reception section 102 is a processing section that receives time information indicating the current time from the time server 13. The time reception section 102 is a part of the function of the reception section that receives the time information.

[0067] The prompt candidate management section 103 is a processing section that manages candidates of the prompt information, i.e., candidates of the created recipe information, by cooperating with the storage section 105 and the candidate selection section 108, which will be described later. The prompt candidate management section 103 reads the candidates of the prompt information from the storage section 105 and outputs them to the candidate selection section 108. The candidate selection section 108 selects a recipe from the candidates of the prompt information according to a predetermined criterion and decides the prompt to be used.

[0068] The prompt information creation section 109 is a processing section that decides the prompt form of the prompt information based on at least one of the log information and the time information and the profile information, and creates the prompt information according to the decided prompt form. The decision of the prompt form of the prompt information and the like will be described later.

[0069] The prompt information transmission section 104 is a processing section that transmits the created prompt information to the prompting device 14 and causes it to prompt.

[0070] Here, the storage section 105 includes, in addition to a database that stores the candidates of the above-described recipe information, i.e., a recipe database, as shown in Figure 2 indicated, a stock database 111, a preference database 112, a sentence pattern database 113, a diction database 114, and an event database 115.

[0071] First, the stock database 111 will be described. Figure 3 is a diagram indicating an example of the stock database according to the present embodiment. The stock database 111 is included in the profile information and is a database generated from the log information. The stock database 111 stores information of food materials held by the user. Specifically, as shown in Figure 3 indicated, the stock database 111 includes the name of a food material held as a stock (column 1), the remaining amount of the food material (column 2), the storage state (column 3), and the purchase date and the use-by date (column 4, a date already determined such as the shelf life of the food material or a date arbitrarily set by the user), and the like.

[0072] The inventory database 111 contains, in addition to the information received as log information, information input by the user on the application program of the terminal device 12, and the like. Also, in the inventory database 111, the order of priority of use of the ingredients set as entries and the like is decided, and when the consumption of the inventory is prompted later, the appropriate ingredients are used preferentially, such as the ingredients with the expiration date approaching, the ingredients with a large remaining amount, or the ingredients that are preferred by the user and are used frequently. In addition, as to which of the above-mentioned ingredients with the expiration date approaching, the ingredients with a large remaining amount, or the ingredients that are preferred by the user and are used frequently is used preferentially, the rule set by the user can be used, or automatic switching can be performed according to the degree of approaching of the expiration date, the degree of the remaining amount, and the like. In addition, although not shown here, a replenishment period during which replenishment of ingredients and the like is possible and a consumption period during which replenishment of ingredients is not possible can be set, and when it is the replenishment period, the creation of the prompt information that is premised on the replenishment of ingredients is permitted, and when it is the consumption period, the creation of the prompt information that is premised on the replenishment of ingredients is not permitted. Furthermore, the ingredients contained in the inventory can also be more than four.

[0073] Figure 4A is a diagram showing an example of a preference database according to the embodiment. The preference database 112 is included in the profile information of the user, and stores information on the preferences of a certain user with respect to the recipe information. The preference database 112 is constructed for each user. As shown in Figure 4A , the preference database 112 contains the characteristics of the preferred recipes (column 1) and the weight scores of the respective preferences of the user (column 2), and the like. For example, in the diagram, low calorie, time saving, seasonality, and frequently used ingredients are listed as the preferences of the user. Therefore, the user tends to prefer recipes with low calorie, recipes that save time, recipes that use seasonal ingredients, and recipes that use ingredients that are used frequently.

[0074] In addition, as to these preferences, the weight scores indicate which preference is more valued by the user. For example, the larger the value of the weight score, the more the preference is valued. In such a preference database 112, the entries of "low calorie", "time saving", and "seasonality" are classified based on the tags (for example, automatically assigned by character recognition) assigned to the recipes accessed by the user using the terminal device 12, and are constructed according to the frequency of access and the like. In addition, in the preference database 112, the entry of "frequently used ingredients" is constructed based on information on the ingredients that are frequently registered in the inventory database and have a remaining amount reduced by a certain amount or more, and the like.

[0075] In the present embodiment, when creating the prompt information, from among the candidates of the prompt information, a candidate that is suitable for the user's preference is selected with reference to the user's preference database 112, and is used as the prompt information. At this time, using the weight score, in the case where the candidates are suitable for the preference (have the same recipe characteristics), a weight score corresponding to the suitable recipe characteristics is given, and the candidate for which the total value of the finally given weight scores is the largest is used as the prompt information with priority. Thereby, it is possible to sequentially prompt the prompt information from the prompt information that is suitable for the user's preference and for which the degree of suitability is the largest, and thus it is possible to easily attract the user's interest and not easily prompt information that is meaningless for the user.

[0076] Further, here as Figure 4A As an example of the preference database 112 shown in FIG. 12, an example in which one preferred recipe characteristic (column 1) and a weight score of each of the preferred recipe characteristics (column 2) are constructed for each user is shown, but these preferred weight scores can also be changed according to a log analysis, a survey result, general knowledge (in other words, a tendency that is generalized in a majority of users), and the like, in correspondence with each time period, day of the week, and workday / weekend classification, and the like, and the weight score of each characteristic is changed according to each time period or day of the week, and the like. That is, the log information of the user used when constructing the preference database 112 is sometimes personal log information of one user, and sometimes general log information of a plurality of users.

[0077] Alternatively, it is also possible to consider that the time information includes information of which group of time groups corresponding to a one-day life cycle of a general person the time belongs to, in addition to the information of the time itself. In addition, it is known that what kind of state a general person exhibits in each of the time groups in a one-day life cycle of a person (in other words, a tendency that is generalized in a majority of users). Therefore, it is also possible to consider that the time information includes information of the state estimated from the one-day life cycle of a general person at the time, in addition to the information of the time itself. That is, it is also possible to consider that by such an interpretation of the time information, it is possible to construct the profile information of the preference database 112 and the like based on the information of the state of the person at the time from the time information.

[0078] Figure 4B is a diagram showing an example of a change of the weight score of the preference database according to the embodiment. As shown in Figure 4BAs shown, for example, based on log analysis, survey results, general knowledge, it is known that more people eat light dishes in the morning, and therefore, as a recipe feature, the weight score of low calorie and stock can be set relatively high, and in particular, the weight score of low calorie can be set even higher, in a manner that easily fits the conditions of light dishes. In addition, an example of changing the recipe feature or weight score corresponding to the time period is described here, but the recipe feature or weight score can also be changed using the features possessed by the attributes of the day, such as the day of the week, workday / weekend classification, and the day before a holiday. For example, based on log analysis, survey results, general knowledge, based on the knowledge that there is a tendency to be short of time on weekdays, the weight score of stock or time saving can also be set high. In addition, considering that there is a tendency to have relatively ample time on weekends, the weight level of time saving or stock can be set low, or the weight score of a recipe feature that requires time or uses recommended ingredients can be set high. In this way, the user preference database 112 can also change the weight score corresponding to the recipe feature based on the knowledge of general user behavior possessed by the attributes of the day, such as the time period, and the day of the week, workday / weekend classification. It can also be used as a preference database common to all users or a user group of several people.

[0079] Figure 5A FIG. 1 is a diagram showing an example of a sentence database according to the embodiment. The sentence database 113 is an example of a structure database, and is included in the user profile information. It stores information of the prompt structure in the prompt information as a prompt form. Specifically, as shown in FIG. 1, the sentence database 113 is provided with different sentences for each time period when 1 day is divided into a plurality of time periods. The sentence database 113 is a database for prompting the appropriate length (or amount of information) of prompt information according to the degree of busyness of the user in each time period. The sentences set in the sentence database 113 contain variables for insertion of the expressions of the expression database 114 described later. That is, the prompt information is created by inserting the expressions of the expression database 114 into the sentences of the sentence database 113. Figure 5A

[0080] Figure 5A ​​As shown, the sentence database 113 includes time periods (column 1) and sentences (column 2). The sentence database 113 is also a database unique to a certain user, and is constructed separately for each user. For the user of this example, it is known from log information that the time period from 6:00 to 11:00 is the busiest, and the shortest sentence "{α-1} {recipe name} how?" is set. Also, for the user of this example, it is known from log information that the time period from 11:00 to 16:00 is the least busy, and the longest sentence "{α-1} {recipe name} how? {β-3} {γ-2}" is set. Also, for the user of this example, it is known from log information that the time period from 16:00 to 18:00 is moderately busy, and a sentence of intermediate length "{α-1} {recipe name} how? {γ-2}" is set. Further, the parts of these sentences enclosed in braces ({α-1}, {β-3}, {γ-2}, and {recipe name}) are variables as described above, for insertion of the phrases described later. Also, the sentences are not limited to those of this example. Sentences that are more formal than the sentences shown can be set, and sentences that are more colloquial can also be set.

[0081] The variables {α-1}, {β-3}, {γ-2} in the above sentences are for insertion of the reason for the prompt (i.e., the reason for recommending such a recipe). The α, β, and γ of each variable indicate the position in the sentence, and 1, 2, and 3 indicate the order of recommendation. For example, the variable {α-1} indicates a variable that is inserted first in the α position in the sentence. Also, if {α-1}, {β-3}, {γ-2} are replaced by {α-3}, {β-2}, {γ-1}, respectively, a sentence can be set in which the order of insertion of the variables is different, while the positions in which the variables are inserted remain the same.

[0082] The reason for the prompt is made into a database as a phrase, is selected from among several candidates based on the characteristics of the recipe, and is inserted into the position of the variable in the sentence. Here, the priority of {α-1}, {γ-2}, {β-3} is high to low in that order. That is, even in the case of a busy user, {α-1} is prompted, but {γ-2} and {β-3} are variables that are omitted according to the degree of busyness. In this way, the amount of information that is prompted is minimized according to the user's situation, and thus has the advantage of not easily annoying the user. Also, according to the situation, {α-1} can not be prompted. In this case, in the sentence database 113, a sentence without {α-1} can be set for the time period that is the busiest ("How about {recipe name}?" and the like). Also, more than four variables than {γ-2} can be included in the sentence.

[0083] As Figure 5BAs shown, in addition to the sentence pattern database 113, a voice characteristic database can also be maintained. The voice characteristic database is included in the user's profile information, and stores voice characteristic information as parameters at the time of voice synthesis for each time period when 1 day is divided into a plurality of time periods. The voice characteristics include reading speed, volume, tone quality, and the like. In addition, these voice characteristics included in the voice characteristic database are examples, and a voice characteristic database with other voice characteristics added as appropriate can also be constructed.

[0084] In addition, here as Figure 5A As an example of the sentence pattern database 113 shown, an example is shown in which the sentence pattern database 113 is a database unique to the user and is constructed separately for each user, but the sentence pattern database 113 can also be changed in accordance with conditions such as each time period, day of the week, and workday / weekend, based on log analysis, survey results, general knowledge, and the like. That is, it is also possible to change the information of the sentence pattern database 113, which is the information of the prompting structure as the prompting form in the prompting information, for each time period, day of the week, classification of workday / weekend, and the like. Figure 5A For example, based on log analysis, survey results, general knowledge that there are many busy people in the morning on weekdays, the shortest sentence pattern "{a-1} {recipe name} how?" is set. On the other hand, considering that the time on a weekend or the night before a weekend is relatively ample, the longest sentence pattern "{a-1} {recipe name} how? {b-3} {g-2}" or the like can be set. In this way, the sentence pattern database 113 can also change the prompting form in accordance with general user behavior knowledge of the time period, day of the week, workday / weekend, and the like, and can be used as a sentence pattern database 113 common to all users or a user group of several people.

[0085] Figure 6 is a diagram showing an example of a phrase database involved in the embodiments. The phrase database 114 is a database unique to the user or generalized among a plurality of users, and stores information of what kind of phrase is inserted into the variable portion in the sentence pattern for each recipe characteristic. The phrase database 114 is as shown in Figure 6As shown, the recipe characteristics (column 1), parameters (column 2), recommended phrase a (column 3), recommended phrase b (column 4), recommended phrase c (column 5), and the like are included. For example, for the recipe characteristic "low calorie", an association with a specific number of kcal is established in the parameter. The value (or string) of the parameter is sometimes used as part of the recommended phrase. In addition, "{calorie} and healthy, " is set in the recommended phrase a, "low calorie, " is set in the recommended phrase b, and "low calorie and healthy recipe" is set in the recommended phrase c. Thus, the recommended phrase a is a phrase inserted before a certain sentence. In addition, the recommended phrase b is a phrase inserted as another sentence after the sentence. The recommended phrase a is, for example, a phrase inserted into the part of the variable {a-1} in the sentence, and the recommended phrase b and the recommended phrase c are phrases inserted into the parts of {β-3} and {γ-2}, respectively. In addition, other recommended phrases can be set in addition to the recommended phrase a, the recommended phrase b, and the recommended phrase c.

[0086] Figure 7 is a diagram showing an example of a recipe search result involved in the embodiment. The recipe search result is an example of data that is a candidate for the prompt information, and stores recipes extracted from a recipe database and recipe characteristics and their priority orders that match the search conditions created based on the weight score. For example, as shown in Figure 7 , the recipe search result includes the recipe name (column 1), the recipe characteristics that match the search conditions (column 2), the parameters corresponding to the recipe characteristics (column 3), and the prompt order corresponding to the weight score (column 4). Figure 7 The recipe search result of Figure 4A is an example of a search result based on the preference data of . The user tends to prefer recipes with low calorie, recipes that save time, recipes that use seasonal ingredients, and recipes that use ingredients that are frequently used in daily life. As a result of searching based on the weight score, "stir-fried pork" with the highest total value of the weight score is output. Here, as a parameter related to low calorie, the calorie information (300 kcal) of the recipe data of this recipe is output. The same is true for other characteristics, and the prompt order is output in order from high to low in the weight score. In addition, with respect to time saving, the recipe data does not match, and therefore the parameter and the prompt order are not output. As described above, by including the recipe characteristics or related data that match the search conditions in the recipe search result, information why the recipe is recommended can be prompted.

[0087] The recipe search result described here is obtained by extraction from a recipe database or the like not shown. That is, in the recipe database, a plurality of the same information as the above-described recipe search result corresponding to recipes that are not extracted is also stored.

[0088] In addition, the event database 115 will be described later in connection with the description of the operation of the control device 100.

[0089] [Operation] Next, the operation of the control device 100 described above will be described. Figure 8 The operation of the control device 100 described above will be described. Figure 8 is a flowchart showing an example of the operation of the control device according to the embodiment. As shown in Figure 8 first, the operation history receiving section 101 and the log information extracting section 106 receive and accumulate log information if the operation of the control device 100 is started (step Sll). The profile generating section 107 generates profile information based on log information acquired at a certain time point or a plurality of time points, or time information and log analysis, survey results, general knowledge, and the like. More specifically, the profile generating section 107 generates or re-generates the profile information by performing generation of various databases included in the profile information or update of the already generated databases.

[0090] Next, the time receiving section 102 receives time information from the time server 13 (step S12). Step Sll and step S12 are sometimes collectively referred to as a receiving step, and can also be performed simultaneously as a composite step. Here, the prompt information creating section 109 determines whether or not a trigger for creating and prompting prompt information is detected based on the log information and the time information (step S13). The detection of the trigger means determination of whether or not at least one of the received log information and the time information satisfies a condition. In the case where the prompt information creating section 109 determines that the trigger is detected (S13: Yes), the prompt information creating section 109 further determines whether or not the newly received log information deviates from a usual condition set based on past received log information (step S14). The deviation from the usual condition means satisfaction of a deviation condition set in advance in correspondence with the log information. For example, it is the number of opening and closing of a refrigerator reaching a predetermined number or more, the viewing time of a television reaching a predetermined time or more, or the number of accesses to a recipe using the terminal device 12 reaching a predetermined number or more, and the like. Further, these conditions are examples, and can be appropriately set in correspondence with the log information and the condition corresponding to the log information. In addition, although the detection of the trigger in step S13 and the determination of whether or not the usual condition is deviated in step S14 are performed separately in the above description, the usual condition itself can be detected as a trigger for creating and prompting prompt information in a deviated time form. That is, a composite step in which step S13 is included in step S14 can be performed. In this case, the composite step is performed before the detection of the trigger in the usual form, that is, step S13, and step S14 is omitted. In the case where the trigger is not detected through the determination and the like described above (S13: No), the processing is repeated from step Sll.

[0091] On the other hand, in a case where the trigger is detected by the above-described determination or the like (S13: Yes), first, the candidate selection section 108 cooperates with the prompt candidate management section 103 and the storage section 105 (particularly, the recipe database not shown) to select a prompt message from the candidates (step S15). Here, a case where "stir-fried pork" included in the recipe database is selected from the candidates as a candidate having the highest total value of weight scores is described. The time indicated by the received time information is 17:00. Then, the prompt message creation section 109 refers to the sentence pattern database 113 in the profile information of the storage section 105, particularly, to decide a sentence pattern corresponding to the time period (step S16). Since the time period corresponding to 16:00 to 18:00, the decided sentence pattern is "{a-1} {recipe name} how? {γ-2}". Next, the prompt message creation section 109 refers to the expression database 114 in the profile information of the storage section 105, particularly, to decide expressions to be inserted into {a-1} and {γ-2} (step S17). Here, as shown in the table, the expressions corresponding to "frequently used ingredients" and "low calorie" are decided in accordance with the priority order among the recipe features. Figure 7

[0092] That is, the prompt message creation section 109 decides "use {ingredient name}," as an expression to be substituted into {a-1}, and decides "it is a low-calorie and healthy recipe." as an expression to be substituted into {γ-2}. The "pork belly" is inserted into {ingredient name} as the ingredient. The prompt message creation section 109 creates a prompt message in accordance with the decided sentence pattern and expressions (prompt message creation step S18). The created prompt message is "use pork belly,'stir-fried pork' how? It is a low-calorie and healthy recipe." Then, the prompt message transmission section 104 converts the created prompt message from text data into synthetic speech. At this time, the voice characteristics can also be changed as with the sentence pattern. The voice characteristics are characteristics other than the expressions in the speech, such as reading speed, volume, and tone quality. After that, the prompt message transmission section 104 transmits the created prompt message to the prompting device 14 (transmission step S19).

[0093] Here, Figure 9 is a diagram showing an example of an event database according to the embodiment. In a case where the prompt message creation section 109 decides that the deviation from the usual condition (S14: Yes), the prompt message is created in a deviation time form including a deviation time sentence pattern and a deviation time expression. The following is a detailed description. In the table, the "deviation time" is a time period in which the user deviates from the usual condition. The "deviation time sentence pattern" is a sentence pattern to be used in the deviation time. The "deviation time expression" is an expression to be used in the deviation time. Figure 9 ​In this case, the root side of the arrow ar shows the sentence pattern before the event occurs and the weight score corresponding to the recipe feature, and the tip side of the arrow ar shows an example of the event database 115. In the case where the event occurs, the weight score of the preference database 112 and the sentence pattern of the sentence pattern database 113 corresponding to the time zone change. For example, the event database 115 includes a condition (column 1) that is determined as a condition deviating from the usual condition (i.e., "Yes" in step S13), the recipe feature and the weight score of the preference database 112 used at the time of the event (column 2), and the sentence pattern of the sentence pattern database 113 used at the time of the event (column 3).

[0094] For example, if the wake-up time is 6:00, the wake-up time satisfying the event condition is before 6:00 (assuming that the wake-up time under the usual condition, i.e., the time condition, is 7:00), which is a time deviating from the usual time, and thus can be considered to be more ample in time than the usual time. Therefore, the weight score in the preference database changes, and the weight score of "season" becomes large as 7, and the weight score of "time saving" becomes small as 2. As a result, the candidate selection section 108 selects the prompt information from the candidates in cooperation with the prompt candidate management section 103 and the storage section 105 (in particular, the recipe database not shown), but a different candidate from the candidate selected in step S15 is selected as the prompt information (step S20).

[0095] Further, as shown in Figure 9 " {a-1} {recipe name} how? {g-2} " (deviation time sentence pattern, step S21) is selected, which is longer than " {a-1} {recipe name} how? " set for 6:00 to 11:00. Then, the expression is determined in accordance with the weight score corresponding to the above event (deviation time expression, step S22). Thereafter, the process proceeds to step S18, and the voice synthesis is performed. As the voice characteristic, "slow" slower than "normal" set for 6:00 to 11:00 is selected. The subsequent operation is the same as the usual time, and thus the description is omitted.

[0096] Thus, in the present embodiment, in accordance with the occurrence of the event of suddenness, the prompt information is created in a deviation time form different from the previous prompt form. Therefore, even in the irregular case of the deviation time, it is possible to alleviate the user's discomfort due to the creation of the same prompt information as the usual time. In other words, even in the irregular case, it is possible to set an appropriate prompt form, and thus it is possible to prompt more appropriate information for the user. In addition, by using the present structure, by specifying a specific date or time or the like as a deviation condition, it is also possible to set the utterance content in correspondence with the target day of the seasonal event such as a holiday, a memorial day, and the target time of the event.

[0097] Furthermore, the event conditions shown in event database 115 are just examples; they can be added to or deleted as appropriate. Also, event database 115 may not necessarily include all the examples shown. Figure 9 All structures can also be composed of a portion of the structure.

[0098] [Variation Example] The following uses Figure 10 Explain variations of the implementation method. Figure 10 This diagram illustrates the information prompts related to a variation of the implementation method. In the following description, descriptions of structures substantially equivalent to the implementation method are omitted, and the focus is on the differences.

[0099] exist Figure 10 This section describes an example of using an image-based prompting device 14a instead of a voice-based prompting device 14. Furthermore, the image here is, for example, information about the brightness values ​​of each pixel in a two-dimensional format, and is information such as characters, graphics, symbols, and colors that are combined by the brightness values ​​of each pixel for user recognition. The prompting device 14a can be any device that can prompt the user by displaying an image. Examples of prompting devices 14a include display devices with a screen and projectors that project images onto a projection surface.

[0100] like Figure 10 As shown, the prompt information can also be displayed as an image to prompt the user. In this case, the control device 100 has a layout database instead of a sentence database 113, so that the layout of the information contained in the image for each time period is different in a way that corresponds to the amount of information in the image according to the user's level of activity. Furthermore, instead of the prompt information sending unit 104, a prompt information sending unit is provided that converts the text data prompt information into an image and sends it. For example, in... Figure 10 In the example, the image includes a recipe name 51, a recipe image 52, a recipe description 53, and a recommendation label 54. The recipe description 53 can be adjusted by changing the sentence structure or the wording, for example, to fit within a single line. Therefore, even on terminal devices 12, such as smartphones, where the information that can be displayed at one time is limited, the recipe description 53 can be prevented from becoming too lengthy, thus efficiently displaying the information. Furthermore, during less busy periods for the user, additional explanations (not shown) can be added to each recommendation label; during busier periods, the recipe description 53 and recommendation label 54 can be omitted, changing the layout.

[0101] (Other implementation methods) The control devices and the like involved in the embodiments of this disclosure have been described above, but this disclosure is not limited to these embodiments.

[0102] For example, the method of creating prompt information considering the sentence pattern corresponding to the time from among the sentence pattern database 113 in the recipe search result and the profile information according to the recipe database not illustrated held by the control device involved in the above-described embodiment is explained, but as long as the sentence pattern or the length of the prompt information corresponding to the user's situation or the situation of the housework or the like can be controlled, it is not limited to the content. For example, in the background of the evolution of the generative AI such as the current ChatGPT, a method of utilizing a large amount of knowledge information held by these generative AI as the profile information can also be assumed. In this case, it can also be assumed that the result of inputting and generating to the generative AI using any one or two or more combinations of the information specifying the length of the prompt information such as the time-based sentence pattern information or the number of characters, and the user information as the prompt (i.e., prompt), is used as the prompt information. Here, the user information can be attribute information of the user acquired separately, or information acquired based on log information acquired at a certain time point or a plurality of time points (for example, the user's situation or the situation of the housework, or the like). In addition, it can be instructed to insert the information specified at the beginning of the output result generated by the generative AI such as the recommendation reason. In addition, it can be instructed to limit the number of characters, and the like, and the Figure 10 The application example illustrated above is also generated in a manner that the recipe introduction phrase 53 is accommodated within one line.

[0103] In addition, each processing section provided in the control device involved in the above-described embodiment is typically implemented as an LSI as an integrated circuit. They can be implemented as one chip respectively, or as one chip in a manner including a part or all of them.

[0104] In addition, the integrated circuit is not limited to the LSI, and can be implemented with a dedicated circuit or a general-purpose processor. It is also possible to use an FPGA (Field Programmable Gate Array) programmable after the LSI is manufactured, or a reconfigurable processor capable of reconfiguring the connection or the setting of the circuit units inside the LSI.

[0105] In addition, in the above-described embodiment and the like, each constituent element can be constituted by a dedicated hardware, or can be implemented by executing a software program suitable for each constituent element. Each constituent element can also be implemented by a program execution section such as a CPU or a processor reading and executing a software program recorded in a recording medium such as a hard disk or a semiconductor memory.

[0106] In addition, one aspect of the present disclosure can also be implemented as a control method or the like executed by the control device and controlling the prompting device. In addition, one aspect of the present disclosure can also be a computer program that causes a computer to execute each step characteristic of the control method.

[0107] In addition, the control device according to the above-described embodiment and the like can be implemented as a single device or by a plurality of devices. When the control device is implemented by a plurality of devices, how each constituent element of the control device is distributed to the plurality of devices is not particularly limited. For example, the control device can be implemented by a portable terminal. In addition, for example, at least one of the functional structures of the control device can be implemented by the portable terminal or a server (for example, a cloud server) capable of communicating with the portable terminal. When the control device is implemented by a plurality of devices, the communication method between the plurality of devices is not particularly limited and can be wireless communication or wired communication. In addition, wireless communication and wired communication can be used in combination between the devices.

[0108] In addition, the division of the functional blocks in the block diagram is an example, and a plurality of functional blocks can be implemented as one functional block, one functional block can be divided into a plurality of functional blocks, or a part of the functions can be transferred to another functional block. In addition, the functions of a plurality of functional blocks having similar functions can be processed in parallel or time-division by a single hardware or software.

[0109] In addition, the order of execution of each step in the flowchart is exemplified for the purpose of specifically describing the present disclosure, and can be in another order. In addition, a part of the above-described steps can be executed simultaneously (in parallel) with other steps.

[0110] The present disclosure is not limited to the above-described one or more modes, and a mode obtained by applying various modifications conceivable by those skilled in the art to the present embodiment, or a mode obtained by combining constituent elements in different embodiments, can also be included in the range of one or more modes, as long as the mode does not depart from the spirit of the present disclosure.

[0111] Industrial Applicability The present disclosure can be applied to a presentation system and the like in which presentation information is appropriately presented.

[0112] Explanation of Signs 11 Apparatus 12 Terminal device 13 Time server 14, 14a Presentation device 51 Recipe name 52 Recipe image 53 Recipe introduction phrase 54 Recommendation reason tag 100 Control device 101 Operation history reception section 102 Time reception section 103 Presentation candidate management section 104 Presentation information transmission section 105 Storage section 106 log information extraction section 107 profile generation section 108 candidate selection section 109 prompt information creation section 111 inventory database 112 preference database 113 sentence database 114 expression database 115 event database

Claims

1. A control device for prompting a user with prompt information, comprising: a reception section that receives at least one of log information and time information from a device communicatively connected via a network; a prompt information creation section that decides a prompt form of the prompt information based on at least one of the received log information and the time information, and creates the prompt information based on the decided prompt form; and a transmission section that transmits the created prompt information to a prompting device communicatively connected via the network, thereby causing the prompt information to be prompted to the user.

2. The control device according to claim 1, the prompt information creation section generates profile information of the user based on the log information received at a plurality of time points respectively, decides the prompt form based on at least one of the received log information and the time information, and the generated profile information.

3. The control device according to claim 1, the prompt information creation section generates profile information of the user based on the log information received at a plurality of time points respectively, decides a prompt content included in the prompt information based on at least one of the received log information and the time information, and the generated profile information.

4. The control device according to claim 2 or 3, a structure database of prompt structures in the prompt form is set in advance for each of a plurality of time periods, the prompt information creation section decides the prompt form to use the prompt structure set for a time period corresponding to a time indicated by the received time information among the plurality of time periods.

5. The control device according to claim 2 or 3, the profile information includes a stock database of an article held by the user, the plurality of time periods include a replenishment time period in which the article can be replenished, and a consumption time period in which the article cannot be replenished; The profile information includes: the prompt information creation section: allows the prompt information premised on replenishment of the article to be created in a case where the time period corresponding to the time indicated by the received time information among the plurality of time periods is the replenishment time period, does not allow the prompt information premised on replenishment of the article to be created in a case where the time period corresponding to the time indicated by the received time information among the plurality of time periods is the consumption time period.

6. The control device according to claim 2 or 3, the profile information includes one or more preferences of the user, and a weight score respectively assigned to the one or more preferences, the prompt information creation section prioritizes, from among candidates for the prompt information, a candidate in which a total value of the weight scores assigned to preferences suitable in the candidate among the one or more preferences is large, as the prompt information.

7. The control device according to claim 2 or 3, the prompt information creation section: decides the prompt form of the prompt information to be a deviation time form in a case where newly received log information deviates from a usual condition set based on past received log information, ​ ​ ​ ​ ​ The prompt information is created in accordance with the decided form of presentation.

8. The control device according to any one of claims 1 to 3, The prompt information is recipe information for cooking a dish.

9. The control device according to any one of claims 1 to 3, The prompt information is presented to the user as speech.

10. The control device according to claim 9, The decision of the prompt form includes: At least one of the utterance pattern and the voice characteristic of the speech at the time when the prompt information is presented is decided, At least one of the utterance pattern and the voice characteristic of the speech at the time when the prompt information is presented is different between one of the prompt information created in accordance with one of the received log information and the time information and the other of the prompt information created in accordance with the other of the received log information and the time information.

11. The control device according to any one of claims 1 to 3, The prompt information is presented to the user as an image.

12. The control device according to claim 11, The decision of the prompt form includes: At least one of the display layout of the image and the sentence pattern of the sentence included in the image at the time when the prompt information is presented is decided, At least one of the display layout of the image and the sentence pattern of the sentence included in the image at the time when the prompt information is presented is different between one of the prompt information created in accordance with one of the received log information and the time information and the other of the prompt information created in accordance with the other of the received log information and the time information.

13. A control method executed by a control device for presenting prompt information to a user, comprising: a receiving step of receiving at least one of log information and time information from a device communicatively connected via a network; a prompt information creating step of deciding a presentation form of the prompt information in accordance with at least one of the received log information and the time information, and creating the prompt information in accordance with the decided presentation form; and a sending step of sending the created prompt information to a presentation device communicatively connected via the network, thereby causing the prompt information to be presented to the user.

14. A program for causing a computer to execute the control method according to claim 13.

Images