Stand, information processing method, and program

Abstract

To provide pleasure relating to food and drink.SOLUTION: A game device acquires a plurality of pieces of image information relating to a surface of a drink when another liquid is poured into the drink stored in a container, and executes processing relating to a game by using transition of the other liquid appearing on the surface of the drink contained in the plurality of pieces of image information. An electronic device acquires a plurality of pieces of image information relating to a surface of a drink when another liquid is poured into the drink stored in a container, and executes processing for outputting content from an output unit by using transition of the other liquid appearing on the surface of the drink contained in the plurality of pieces of image information.SELECTED DRAWING: Figure 44

Description

Technical Field

[0005] , ,

[0001] The present invention stand relates to an information processing method and a program, and particularly to using information obtained about food and drink stand relates to an information processing method and a program.

Background Art

[0002] Throughout the world, various beverages such as coffee, black tea, and green tea are consumed. There are numerous devices for brewing these beverages (extraction devices). For example, there is a coffee dripper for extracting coffee (e.g., Patent Document 1). Also, throughout the world, there are various foods such as curry rice, ramen, and meat dishes. There are numerous devices (e.g., pots, frying pans) for cooking these foods. Also, there are numerous devices (e.g., plates, bowls) for serving these foods.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the prior art, using various devices, it is possible to cook and serve food and drink according to an individual's preference. Therefore, it is considered that the enjoyment of food can be increased if some information can be provided to the person cooking the food, the person eating the food, etc., using information that can be obtained at the timing of cooking or serving the food.

[0005] Therefore, an object of the present invention is to provide enjoyment related to food and drink.

Means for Solving the Problems

[0006] One embodiment of the present invention is a stand for supporting a sensor capable of acquiring information about a beverage stored in a container located at the bottom, comprising: a refilling machine that contains another liquid to be poured into the beverage and supplies the other liquid to the container through a tube; and a processing unit that acquires information about the beverage from the sensor when the other liquid is poured into the beverage from the refilling machine and processes the information transition to output content from an output unit. The present invention also includes a processing method for performing each of these processes and a program for causing a computer to execute the method. Furthermore, one embodiment of the present invention is a stand for supporting a sensor capable of acquiring information about a beverage stored in a container installed at the bottom, comprising: a refilling machine that contains another liquid to be poured into the beverage and supplies the other liquid to the container through a tube; and a processing unit that acquires information about the beverage from the sensor when the other liquid is poured into the beverage from the refilling machine, and uses the transition of said information to cause the game machine to execute processing related to the game of the game machine. Also, a processing method for executing each of these processes and a program for causing a computer to execute the method are also provided. Furthermore, one embodiment of the present invention is a stand for supporting a sensor capable of acquiring information about a beverage stored in a container installed at the bottom, comprising: a refilling machine that contains another liquid to be poured into the beverage and supplies the other liquid to the container through a tube; and a processing unit that acquires information about the beverage from the sensor when the other liquid is poured into the beverage from the refilling machine, and uses the transition of said information to perform a process to output content unrelated to the beverage from an output unit. Also, a processing method for performing each of these processes and a program for causing a computer to perform the method are also provided. Also, One embodiment of the present invention is an electronic device that acquires multiple image pieces of information relating to the surface of a beverage stored in a container, and performs game-related processing using the transitions of natural phenomena appearing on the surface of the beverage contained in the multiple image pieces of information. The present invention also includes a processing method for controlling the electronic device and a program for causing a computer to execute the method. Furthermore, one embodiment of the present invention is an electronic device that uses at least one of the following to acquire information about a beverage stored in a container, and uses that information to perform processing related to a game. Also, the present invention includes a processing method for controlling the electronic device and a program for causing a computer to execute the method. Furthermore, one embodiment of the present invention is an electronic device that uses at least one of the following to acquire multiple pieces of information about a beverage stored in a container: a temperature sensor capable of measuring temperature, an odor sensor capable of measuring odor, an audio sensor capable of measuring sound, a weight sensor capable of measuring weight, and a taste sensor capable of measuring taste, and uses the transitions of the multiple pieces of information to perform processing related to a game. Also, the present invention includes a processing method for controlling the same and a program for causing a computer to execute the method. Furthermore, one embodiment of the present invention is an electronic device that performs game-related processing using information about the beverage being collected in a container, acquired at multiple predetermined timings when a user manually dispenses a beverage. Also, the present invention includes a processing method for controlling this method and a program for causing a computer to execute this method. Furthermore, one embodiment of the present invention is an electronic device that performs game-related processing using the presence of a container newly placed in the predetermined location, the presence of a container removed from the predetermined location, and the transition of food and beverages in each container, among the container and food and beverages placed in the container and the container and food and beverages placed in the container that are captured at a plurality of predetermined timings. Also, a processing method for controlling the electronic device and a program for causing a computer to execute the method are also provided. Furthermore, one embodiment of the present invention is an electronic device that acquires a plurality of image information relating to a container placed in a predetermined location and food and beverages placed in the container, and performs game-related processing using the presence of a container newly placed in the predetermined location, the presence of a container removed from the predetermined location, and the transition of food and beverages in each container, among the container and food and beverages included in the plurality of image information. Also, a processing method for controlling this and a program for causing a computer to execute this method are also provided. One embodiment of the present invention is an electronic device that controls the output of content from an output unit by utilizing the transition of image information related to food and beverages. The invention also includes a processing method for performing this control and a program for causing a computer to execute this method. Furthermore, one embodiment of the present invention is an electronic device that uses the transition of image information relating to food and beverages to control the execution of at least one process from among a plurality of processes different from the processes relating to the evaluation and production of said food and beverages. Also, the present invention relates to a processing method for performing such control and a program for causing a computer to execute such method. Furthermore, in these configurations, the electronic device may be equipped with an image acquisition unit that acquires the image information. Furthermore, in these configurations, the image acquisition unit may acquire image information relating to the surface of the food or beverage placed in the container, and the electronic device may perform the control based on the transitions of the surface of the food or beverage.

[0007] One embodiment of the present invention is an information processing device that acquires image information relating to food and beverages for each food and beverage placed in a plurality of containers, and controls the provision of content determined based on the acquired image information to the electronic devices of each person associated with the plurality of containers. The present invention also includes a processing method for performing such control and a program for causing a computer to execute such method. Furthermore, one embodiment of the present invention is an information processing device that acquires image information relating to food and beverages for each food and beverage placed in a plurality of containers, and controls the electronic devices of each person associated with the plurality of containers to execute a process determined based on the acquired image information. Also, the present invention includes a processing method for performing such control and a program for causing a computer to execute such a method. Furthermore, in these configurations, the information processing device may obtain determination information for each food item based on image information relating to the surface of the food item, and perform the control using the determination information.

[0008] One embodiment of the present invention is an extractor comprising: a dripper for dropping a liquid poured into a substance for extracting a beverage; a container for collecting the liquid that falls from the dripper; and an electronic device positioned and used between the dripper and the container, which acquires information about the liquid collected in the container and uses the information to output content from an output unit. The present invention also includes a processing method for controlling the extractor and a program for causing a computer to execute the method.

[0009] Furthermore, in this configuration, the electronic device may have a hole for allowing the liquid that has fallen from the dripper to pass through, and an annular portion corresponding to the shape of the opening of the container, and when in use, it may be sandwiched between the dripper and the container, supported by the opening of the container and supporting the dripper.

[0010] Furthermore, in that configuration, the electronic device may include an image acquisition unit that acquires image information relating to the liquid stored in the container, and the image acquisition unit may be attached to the electronic device such that when the electronic device is installed in the container, the lens faces the surface of the liquid stored in the container.

[0011] Furthermore, in this configuration, the image acquisition unit may acquire image information relating to the surface of the liquid stored in the container, and the electronic device may determine the content to be output from among multiple contents based on the transition of at least one of the colors, patterns, and bubbles that appear on the surface of the liquid. Furthermore, in that form, the content may be content unrelated to both the beverage and the extraction of the beverage, and may consist of information relating to at least one of the following: anime characters, animals, people, plants, or geographical features. Furthermore, in that configuration, the electronic device may output at least one of audio information and image information as content.

[0012] One embodiment of the present invention is an annular electronic device that, when in use, is sandwiched between a dripper that drops liquid poured into a substance for extracting beverages and a container that collects the liquid that falls from the dripper, and is supported at the opening of the container and also supports the dripper, and is an electronic device that acquires information about the liquid collected in the container and uses the information to output content from an output unit. Also, a processing method for controlling the same and a program that causes a computer to execute the method are also provided.

[0013] One embodiment of the present invention is an information processing device that acquires information about the generated beverage for each of the multiple containers of beverage, at any of the following stages: during the generation of the beverage, when the generated beverage is placed in the container, or after the generated beverage has been placed in the container; and provides content determined from among multiple contents based on the analysis of the acquired information to the electronic devices of each person associated with the multiple containers. The present invention also includes a determination method for making such determinations, a content provision method for providing the determined content, and a program for causing a computer to execute each of these methods.

[0014] Furthermore, in this configuration, the information processing device may obtain determination information for each beverage based on information relating to natural phenomena occurring with respect to the beverage, and use this determination information to determine which content to provide to the electronic device from among the multiple contents.

[0015] For example, when a beverage is produced by a substance and liquid for producing a beverage and then stored in a container, at least one of the following timings—during production, when the produced beverage is placed in the container, and after the produced beverage has been placed in the container—electronic devices connected to (or near) each of the multiple containers acquire information about the beverage placed in the container (information about natural phenomena occurring with respect to the beverage). Next, each electronic device uses its communication function to transmit the acquired information (information about natural phenomena occurring with respect to the beverage) to an information processing device. The information processing device acquires each piece of information thus transmitted (information about natural phenomena occurring with respect to the beverage). Next, based on the analysis of each piece of acquired information, the information processing device determines comparable judgment information for each beverage. Next, using this judgment information, the information processing device determines which content to provide to each electronic device (the electronic device of each person associated with the multiple containers that acquired the information) from among multiple contents. Next, the information processing device provides the determined content to the electronic device of each person associated with the multiple containers that acquired the information.

[0016] One aspect of the present invention is an extractor having a storage unit that stores a substance for extracting a drink and is provided with a hole for dropping a liquid poured into the stored substance, a container that stores the liquid dropping from the storage unit, an acquisition unit that acquires information regarding the liquid stored in the container, and a control unit that performs control to output content based on the information acquired by the acquisition unit. It is also a processing method for performing the control and a program for causing a computer to execute the method.

[0017] Further, the acquisition unit may be an image acquisition unit that acquires image information regarding the liquid stored in the container via a lens, and the acquisition unit may be attached such that the optical axis direction of the lens faces the surface of the liquid.

[0018] Further, the container may be a transparent container, the acquisition unit may be an image acquisition unit that acquires image information regarding the liquid stored in the container via a lens, and the acquisition unit may be attached at a position where the image information regarding the liquid stored in the container can be acquired from the outside of the container.

[0019] Further, an electronic device including the acquisition unit and the control unit may be made removable from the extractor.

[0020] Further, the control unit may perform control to transmit information for causing another device capable of outputting the content to output the content.

[0021] Further, the content may be content unrelated to both the drink and the extraction of the drink, and may be information regarding at least one of an anime character, an animal, a person, a plant, and a ground feature.

[0022] Further, the control unit may select at least one content from a plurality of contents as an output target based on the information acquired by the acquisition unit.

[0023] Furthermore, one embodiment of the present invention is an electronic device used sandwiched between a storage section, which contains a substance for extracting a beverage and has a hole through which the liquid poured into the storage section falls, and a container for collecting the liquid falling from the storage section, characterized in that it has a sensor for acquiring information about the liquid collected in the container.

[0024] Furthermore, the electronic device may have an annular portion having a shape corresponding to the shape of the flange portion provided in the housing and the shape of the opening of the container, wherein the lower surface of the flange portion is in contact with the upper surface of the annular portion, and the rim of the opening is in contact with the lower surface of the annular portion, and the electronic device may be installed such that the sensor is positioned inside the opening.

[0025] Furthermore, the annular portion may be provided with a gripping portion. The annular portion may also have a shape in which a part of the annular shape is missing, or it may be U-shaped, Y-shaped, or it may be a polygon, trapezoid, ellipse, or the like.

[0026] Furthermore, one embodiment of the present invention is an information processing device that determines content based on information obtained regarding a generated beverage when the beverage, which is generated from a substance and liquid for generating a beverage, is stored in a container, when the generated beverage is placed in the container, or after the generated beverage has been placed in the container. Also, the present invention includes a determination method for making such determinations, a content provision method for providing the determined content, and a program for causing a computer to execute each of these methods.

[0027] Furthermore, one embodiment of the present invention is an information processing device that acquires information regarding a beverage, which is produced by a substance and liquid for producing a beverage, when the beverage is collected in a container, when the beverage is collected in a container, or after the beverage has been collected in a container, for each beverage in a plurality of containers, and determines content to be provided to each person associated with the plurality of containers based on the acquired information. Also, the present invention includes a determination method for making such a determination, a content provision method for providing the determined content, and a program for causing a computer to execute each of these methods. [Effects of the Invention]

[0028] According to the present invention, the effect is to provide enjoyment related to food and beverages. [Brief explanation of the drawing]

[0029] [Figure 1] This figure shows an example of the external configuration of the coffee brewer 1 to which the electronic device 20 in the first embodiment is attached. [Figure 2] This figure shows an example of the external configuration of the dripper 10, electronic device 20, and container 30 in the first embodiment. [Figure 3] This figure shows an example of the external configuration of the dripper 10 and electronic device 20 in the first embodiment. [Figure 4] This is a block diagram showing an example of the functional configuration of the electronic device 20 in the first embodiment. [Figure 5] This figure shows an example of the transition of an image (an image of the surface of coffee accumulating in container 30) that can be acquired by the electronic device 20 in the first embodiment. [Figure 6] This figure shows an example of various types of information used when determining the information to be output by the electronic device 20 in the first embodiment. [Figure 7] This figure shows an example of various types of information used when determining the information to be output by the electronic device 20 in the first embodiment. [Figure 8] This figure shows the relationship between the image that can be acquired by the electronic device 20 in the first embodiment (an image of the surface of the coffee accumulating in the container 30) and regions A to I shown in Figure 6(1). [Figure 9] This figure shows an example of how the electronic device 20 in the first embodiment determines the information to be output. [Figure 10] This figure shows a simplified example of how audio information is output from the electronic device 20 in the first embodiment. [Figure 11] This flowchart shows an example of audio output processing by the electronic device 20 in the first embodiment. [Figure 12] This figure shows an example of various types of information used when determining the information to be output by the electronic device 20 in the first embodiment. [Figure 13] This is a perspective view showing an example of the external configuration of the coffee brewer 200 to which the electronic device 220 in the second embodiment is attached. [Figure 14] Block diagram showing an example of the functional configuration of the electronic device 220 in the second embodiment. [Figure 15] This figure shows an example of the information to be output by the electronic device 220 in the second embodiment. [Figure 16] This figure shows an example of how the electronic device 220 determines the information to be output in the second embodiment. [Figure 17] This figure shows a simplified example of how audio and image information can be output from the electronic device 220 in the second embodiment. [Figure 18] This flowchart shows an example of information output processing by the electronic device 220 in the second embodiment. [Figure 19] This is a block diagram showing an example of the functional configuration of the electronic device 320 in the third embodiment. [Figure 20] This is a perspective view showing an example of the external configuration of the external equipment (electronic devices 350, 360) in the third embodiment. [Figure 21]This is a diagram showing an example of the functional configuration of the electronic device 350 in the third embodiment. [Figure 22] This is a flowchart showing an example of communication processing by electronic devices 320 and 350 in the third embodiment. [Figure 23] This figure shows a simplified example of how audio and image information can be output from devices other than the electronic device 220 (electronic devices 350, 360) in the third embodiment. [Figure 24] This is a flowchart showing an example of communication processing by electronic devices 320 and 350 in the fourth embodiment. [Figure 25] This figure shows an example of the system function configuration of the communication system 400 in the fifth embodiment. [Figure 26] This is a block diagram showing an example of the functional configuration of the electronic device 431 in the fifth embodiment. [Figure 27] This is a block diagram showing an example of the functional configuration of the server 410 in the fifth embodiment. [Figure 28] This figure shows an example of management information stored in the memory unit 413 in the fifth embodiment. [Figure 29] This figure shows an example of how information about electronic devices 431, 441, and 451 is stored in the fifth embodiment, and an example of the content provided to electronic devices 431, 441, and 451. [Figure 30] This flowchart shows an example of communication processing by the electronic device 431 and the server 410 in the fifth embodiment. [Figure 31] This flowchart shows an example of communication processing by the electronic device 431 and the server 410 in the fifth embodiment. [Figure 32] This figure shows an example in which the server 410 provides content to electronic devices 431, 442, 443, and 452 in the fifth embodiment. [Figure 33] This flowchart shows an example of the transmission process by the electronic device 431 in the fifth embodiment. [Figure 34]This flowchart shows an example of content output processing by the electronic device 431 in the fifth embodiment. [Figure 35] This flowchart shows an example of content provision processing by the server 410 in the fifth embodiment. [Figure 36] This flowchart shows an example of communication processing by the server 410 and the electronic device 431 in the fifth embodiment. [Figure 37] This figure shows examples of sensor mounting for a coffee brewer or electronic device in the first to fifth embodiments. [Figure 38] This figure shows examples of sensor mounting for electronic devices 700, 710, 720, and 725 in the first to fifth embodiments. [Figure 39] This figure shows the appearance of a modified version (coffee brewer 730) of the coffee brewer 1 in the first embodiment. [Figure 40] This figure shows the appearance of a modified version (coffee brewer 730) of the coffee brewer 1 in the first embodiment. [Figure 41] This figure shows a simplified example of how information acquired by the electronic device 700 in the sixth embodiment can be output. [Figure 42] This figure shows an example of the transition of an image (an image of the surface of coffee in a coffee cup when milk is poured into it) that can be acquired by an electronic device in the seventh embodiment. [Figure 43] This figure shows an example of various types of information used when determining the information to be output by an electronic device in the seventh embodiment. [Figure 44] This is a side view showing an example of the external configuration of the installation equipment 830 on which the electronic equipment 810 in the seventh embodiment is installed. [Figure 45] This figure shows a simplified example of when content is output from the electronic device 840 in the eighth embodiment. [Figure 46] This figure shows a simplified example of the configuration of the communication system 40 in the ninth embodiment. [Figure 47]This figure shows an example of the correspondence between the provided information OI, determined using the judgment information by the electronic devices 900, 901-904 in the ninth embodiment, and the provided information 921. [Figure 48] This figure shows an example of an operation to add a tool 75 to the character A displayed on the display unit 911 of the display device 910 using the electronic device 900 in the ninth embodiment. [Figure 49] This figure shows a simplified example of a story game displayed on the display unit 950 of the electronic device 900 in the ninth embodiment. [Figure 50] This figure shows an example of the correspondence between the provided information OI, determined using the judgment information by the electronic device 900 in the ninth embodiment, and the provided information 941, 942, and 943. [Figure 51] This figure shows an example of how information is displayed on the display unit 950 of the electronic device 900 in the ninth embodiment. [Figure 52] This figure shows a simplified example of the transitions in the nurturing game displayed on the display unit 950 of the electronic device 900 in the ninth embodiment. [Figure 53] This figure shows an example of the correspondence between the provided information OI, determined using the judgment information by the electronic device 900 in the ninth embodiment, and the provided information 961, 962, and 963. [Figure 54] This figure shows a simplified example of the transitions in a wandering game displayed on the display unit 950 of the electronic device 900 in the ninth embodiment. [Figure 55] This figure shows an example of the correspondence between the provided information OI, determined using the judgment information by the electronic device 900 in the ninth embodiment, and the provided information 971, 972, and 973. [Figure 56] This flowchart shows an example of the information provision determination process by the electronic device 900 in the ninth embodiment. [Figure 57] This figure shows an example of the transition of images (images of food and beverages arranged on table 1010) that can be acquired by the electronic device in the tenth embodiment. [Figure 58]This figure shows an example of various types of information used when determining the information to be output by an electronic device in the tenth embodiment. [Figure 59] This figure shows the relationship between the image that can be acquired by the electronic device in the tenth embodiment (an image of food and beverages arranged on table 1010) and the regions A to P shown in Figure 58(1). [Figure 60] This figure shows an example of a decision-making process in which an electronic device determines the information to be output in the tenth embodiment. [Modes for carrying out the invention]

[0030] Next, embodiments of the present invention will be described in detail with reference to the drawings.

[0031] [First embodiment: An example of providing audio information using the colors and patterns formed when brewing coffee] [Example of external configuration of coffee brewing machine and electronic equipment] Figure 1 shows an example of the external configuration of the coffee brewer 1 to which the electronic device 20 is attached in the first embodiment. Figure 1(1) shows a perspective view of the coffee brewer 1 to which the electronic device 20 is attached, and Figure 1(2) shows a side view of the coffee brewer 1 to which the electronic device 20 is attached.

[0032] Figure 2 shows an example of the external configuration of the dripper 10, electronic device 20, and container 30 in the first embodiment. Figure 2(1) shows a perspective view of the coffee extractor 1 shown in Figure 1 with the electronic device 20 removed, and Figure 2(2) shows a side view of the dripper 10.

[0033] Figure 3 shows an example of the external configuration of the dripper 10 and electronic device 20 in the first embodiment. Figure 3(1) shows a top view of the dripper 10 and electronic device 20 with the electronic device 20 attached to the lower part of the flange portion 12, and Figure 3(2) shows a bottom view of the dripper 10 and electronic device 20 with the electronic device 20 attached to the lower part of the flange portion 12. Figure 3(3) shows a top view of the electronic device 20, and Figure 3(4) shows a bottom view of the electronic device 20.

[0034] The coffee brewer 1 comprises a dripper 10, electronic equipment 20, and a container 30. The coffee brewer 1 may also be referred to as a beverage extractor, beverage filter, beverage generating device, etc.

[0035] The dripper 10 has a housing section 11, a flange section 12, and leg sections 13, and is a coffee dripper used by being placed in the opening 32 of the container 30. An electronic device 20 is attached to the lower part of the flange section 12.

[0036] The storage section 11 is a storage section that houses ground coffee beans, and a hole 14 (a vertically penetrating hole 14) is provided at the bottom for the hot water poured into the storage section 11 to flow down. Thus, the storage section 11 has an upper opening for pouring hot water onto the ground coffee beans from above, and a hole 14 (lower opening, dispensing spout) for dropping the hot water poured onto the ground coffee beans into the container 30. The storage section 11 is also a device that pours hot water poured onto the ground coffee beans stored inside into the container 30 located below the storage section 11, via the ground coffee beans. In Figure 1, although not shown, various components such as handles may be provided on the outer surface of the storage section 11.

[0037] For example, the storage section 11 can be funnel-shaped and serve as a storage section for holding a paper filter that filters the liquid extracted (filtered out) from the coffee beans. Alternatively, the storage section 11 may be made of a metal filter, or it may be made as a storage section for holding a cloth filter. Furthermore, the shape of the storage section 11 can be various, such as trapezoidal, conical, or basket-shaped.

[0038] The flange portion 12 is a disc-shaped flange portion that widens outward from the lower part of the housing portion 11 in the horizontal direction. The flange portion 12 is also provided at the lower part of the housing portion 11 and stably supports the housing portion 11 when it is installed in the opening 32 of the container 30.

[0039] The leg portion 13 is a ring-shaped projection provided on the lower surface of the flange portion 12, and supports the dripper 10 when it is placed directly on a part of the container 30 other than the opening 32. The leg portion 13 corresponds to the bottom, base, or tail of a ceramic bowl (for example, a tea bowl or soup bowl). Figures 2 and 3 show an example where the leg portion 13 is a ring-shaped projection, but the leg portion 13 may also be made up of three or more projections (for example, multiple projections arranged around the circumference) so that it can support the dripper 10.

[0040] The housing portion 11, flange portion 12, and leg portion 13 may be integrally constructed from heat-resistant glass, ceramic, resin, etc., or they may be constructed individually and joined together. The leg portion 13 may be omitted.

[0041] Container 30 is a container (coffee server) that collects the coffee extract flowing down from the dripper 10. Container 30 also has an opening 32 for receiving the coffee extract flowing down from the dripper 10, and supports the dripper 10 placed in the opening 32. Container 30 can be made of heat-resistant glass. Alternatively, container 30 may be made of a material with enhanced heat retention (e.g., a stainless steel server), or it may be made of ceramic. Furthermore, the shape of container 30 can be various shapes other than that shown in Figure 1. Although not shown in Figure 1, various components such as handles may be provided on the outer surface of container 30.

[0042] The electronic device 20 is an electronic or information processing device that is installed so as to be sandwiched between the flange portion 12 of the dripper 10 and the opening 32 of the container 30. In other words, the electronic device 20 is an electronic or information processing device that is used sandwiched between the flange portion 12 of the dripper 10 and the opening 32 of the container 30. Furthermore, for example, the electronic device 20 can be realized by housing each component (each part shown in Figure 4) in a housing (case) made of heat-resistant glass, ceramics, metal, resin, wood, etc.

[0043] The electronic device 20 is composed of a rectangular (flat) portion (gripping portion 27) and a ring-shaped (annular) portion (annular portion 28). The annular portion 28 has a ring-like shape when viewed from above and has an upper surface (upper part) 71 on which the dripper 10 is installed, a lower surface (lower part) 72 installed in the opening 32 of the container 30, an inner surface (inner wall) 73 facing the leg portion 13 on the lower surface of the flange portion 12, and an outer surface (outer wall, peripheral wall) 74. Thus, the annular portion 28 has a donut shape with a hollow portion (hole 29), and is positioned so as to be sandwiched between the flange portion 12 of the dripper 10 and the opening 32 of the container 30, with the upper surface (upper part) 71 in contact with the dripper 10 and the lower surface (lower part) 72 in contact with the rim of the opening 32 of the container 30. Furthermore, the electronic device 20 has a shape in which a rectangular part (grip part 27) is joined to a ring-shaped (annular) part (annular part 28), and has a shape similar to, for example, a magnifying glass or a goldfish scooping game. The annular part 28 has an inner diameter (size of the hole 29) that is larger than the diameter (outer diameter) of the leg part 13 on the lower surface of the flange part 12 of the dripper 10. The annular part 28 also has an outer diameter that is smaller than the diameter of the lower surface of the flange part 12 of the dripper 10.

[0044] Furthermore, as shown in Figure 3(2), the electronic device 20 is mounted so as to be sandwiched between the flange portion 12 of the dripper 10 and the opening 32 of the container 30, with the legs 13 of the flange portion 12 fitting into the holes 29 of the annular portion 28. In other words, the electronic device 20 is supported by the opening 32 of the container 30, and the dripper 10 is supported by the annular portion 28 of the electronic device 20. For example, as shown in Figures 1(2) and 3(2), by setting the shape of the annular portion 28 of the electronic device 20 to match the shape of the opening 32 (rim) of the container 30, and also to match the shape of the flange portion 12 of the dripper 10, the electronic device 20 and the dripper 10 are stably supported by the container 30 even when the electronic device 20 is mounted so as to be sandwiched between the flange portion 12 of the dripper 10 and the opening 32 of the container 30.

[0045] Thus, the annular portion 28 has a shape that corresponds to the annular shape of the flange portion 12 and the annular shape of the opening 32 of the container 30. Furthermore, the lower surface of the flange portion 12 is in contact with the upper surface 71 of the annular portion 28, and the rim of the opening 32 of the container 30 is in contact with the lower surface 72 of the annular portion 28, and the electronic equipment 20 is installed such that the lens 21 is positioned inside the opening 32.

[0046] Furthermore, when installing or removing the electronic device 20, the user can hold the gripping part 27 in their hand and perform each operation. Therefore, the gripping part 27 functions as a gripping part for the electronic device 20. In addition, since the gripping part 27 is equipped with an operating part 26, the gripping part 27 also functions as an operating part for the electronic device 20. In addition, since the gripping part 27 is equipped with an audio output part 25, the gripping part 27 also functions as an output part for the electronic device 20.

[0047] In this way, by making the electronic device 20 into a shape like a magnifying glass or a goldfish scooping game, it is easy to attach and detach the electronic device 20. Furthermore, the electronic device 20 can be stably installed on the coffee brewer 1.

[0048] The shapes of the gripping portion 27 and the annular portion 28 are not limited to these. For example, the outer diameter of the annular portion 28 may be made larger than the diameter of the lower surface of the flange portion 12 of the dripper 10. Also, the shape of the annular portion 28 may be other shapes as long as it can be stably positioned in the opening 32 of the container 30 and stably support the dripper 10. For example, it may be a shape in which a part of the ring-shaped portion is missing, or in a top view it may be U-shaped, Y-shaped, polygonal, trapezoidal, elliptical, etc. (having a portion corresponding to a hole that is at least larger in size than the diameter (outer diameter) of the leg portion 13). A modified example of the annular portion 28 is shown in Figure 38.

[0049] The electronic device 20 also includes a lens 21, an audio output unit 25, and an operation unit 26. The functional configuration of the lens 21, the audio output unit 25, and the operation unit 26 will be explained in detail with reference to Figure 4.

[0050] Furthermore, the lens 21 of the electronic device 20 is positioned on the lower part (lower surface (bottom surface 72)) of the annular portion 28. Also, when the dripper 10 and the electronic device 20 are set in the container 30, the optical axis of the lens 21 is positioned so that it faces the surface of the coffee extract that accumulates in the container 30.

[0051] Furthermore, when hot water is poured into the dripper 10 or when removing the electronic device 20, it is conceivable that water or other liquids may adhere to the entire electronic device 20 or its various parts (lens 21, audio output unit 25, operation unit 26). Therefore, it is preferable to apply a waterproof coating to the entire electronic device 20 or its various parts (lens 21, audio output unit 25, operation unit 26).

[0052] Furthermore, it is expected that the dripper 10 and container 30 will become hot when hot water is poured into the dripper 10. Therefore, it is preferable to enclose each component built into the electronic device 20 with an insulating material or to apply an insulating treatment so that it is not affected by the heat from the dripper 10 and container 30. For example, insulating materials such as foam or felt may be used, or two or more of these materials may be combined. Also, for example, each component other than the lens 21 and image acquisition unit 22 (each component shown in Figure 4) can be installed inside the gripping unit 27 so that it is not affected by the heat from the dripper 10 and container 30.

[0053] Furthermore, when hot water is poured into the dripper 10, steam is expected to be generated from the coffee (liquid) accumulating in the container 30, causing the lens 21 to fog up. Therefore, it is preferable to apply an anti-fog treatment to the surface of the lens 21. Alternatively, the entire lens 21 may be covered with a transparent material that has been treated with an anti-fog treatment. In addition, to prevent the effects of heat, it is preferable to apply an insulating treatment to the lens 21 itself or to the transparent material that has been treated with an anti-fog treatment.

[0054] [Example of electronic device functional configuration] Figure 4 is a block diagram showing an example of the functional configuration of the electronic device 20 in the first embodiment.

[0055] The electronic device 20 includes a lens 21, an image acquisition unit 22, a control unit 23, a storage unit 24, an audio output unit 25, and an operation unit 26. The electronic device 20 may have a built-in or attached battery and use the battery as its power source, or it may not have a built-in battery and use an external power source.

[0056] Lens 21 is composed of multiple lenses that collect light from the subject. The light from the subject collected by lens 21 is then incident on the image sensor (provided by the image acquisition unit 22).

[0057] The image acquisition unit 22 captures an image of a subject and generates an image (image data) based on the control of the control unit 23, and outputs the generated image to the control unit 23. The image acquisition unit 22 is composed of, for example, an image sensor that receives light from a subject focused by the lens 21, and an image processing unit that performs predetermined image processing on the image data generated by the image sensor. As the image sensor, for example, a CCD (Charge Coupled Device) type or a CMOS (Complementary Metal Oxide Semiconductor) type image sensor can be used. The lens 21 may also be configured so that each part (for example, a zoom lens, a focus lens, and an aperture) is controlled based on the control of the control unit 23.

[0058] The control unit 23 controls each part of the electronic device 20 based on the control program stored in the memory unit 24. The control unit 23 is implemented, for example, by a CPU (Central Processing Unit). The CPU is a central processing unit (electronic device) consisting of a control unit (control circuit) and an arithmetic unit (arithmetic circuit).

[0059] The storage unit 24 is a memory that stores various types of information. For example, the storage unit 24 stores various types of information necessary for the electronic device 20 to perform various processes (for example, control programs, information for determining the information to be output (for example, the information shown in Figures 6(1)(2) and 7)). The storage unit 24 also stores information determined based on images (image data) acquired by the image acquisition unit 22 (for example, shown in Figure 9(1)).

[0060] The audio output unit 25 is an audio output unit (for example, a speaker) that outputs various types of sounds based on the control of the control unit 23.

[0061] The operation unit 26 receives operation input for operating the electronic device 20. In the first embodiment, for the sake of simplicity, the operation unit 26 is assumed to be a switch for turning on the power of the electronic device 20. Although only a simplified operation unit 26 is shown in Figures 1 to 3, other operating members may be provided.

[0062] [Examples of surface changes in coffee accumulated in a container] Figure 5 shows an example of the transition of an image (an image of the surface of the coffee accumulating in the container 30) that can be acquired by the electronic device 20 in the first embodiment. In Figure 5, for the sake of ease of explanation, the coffee liquid and the bubbles that form on the surface of the coffee are simplified and shown as circles, etc.

[0063] Figure 5(1) shows the state in which the extracted coffee (liquid) 41 has fallen to the bottom 31 of the container 30. First, the user sets the dripper 10 on top of the container 30, places a paper filter inside the housing 11 of the dripper 10, and puts coffee grounds into the paper filter. Next, the user pours a small amount of water, which has been boiled and then cooled to about 90 degrees Celsius, onto the coffee grounds set in the dripper 10 and lets it steep for about 20 to 30 seconds. During this steeping stage, only a small amount of water is poured onto the coffee grounds, and the water is absorbed by the coffee grounds, so the extracted coffee (liquid) 41 often does not fall to the bottom 31 of the container 30.

[0064] Once the steeping period is over, the user pours their desired amount of hot water onto the steeped coffee grounds (the coffee grounds set in the dripper 10) at their preferred timing. When hot water is poured onto the coffee grounds in this way, as shown in Figure 5(1), the coffee grounds cannot absorb all of the water, and the coffee (liquid) 41 falls to the bottom 31 of the container 30. In this case, the position (position at the bottom 31), size (size at the bottom 31), and shape (planar shape at the bottom 31) of the coffee (liquid) 41 that falls to the bottom 31 of the container 30 change depending on the amount of hot water poured onto the coffee grounds and the position where the water is poured (the position of the coffee grounds set in the dripper 10). For example, as shown in Figures 5(1) and 5(2), the first coffee (liquid) 41 falls near the center of the bottom 31 of the container 30, and thereafter the coffee (liquid) 41 accumulates and spreads in one direction or another.

[0065] Furthermore, as shown in Figure 5(3), when the extracted coffee (liquid) 41 accumulates to a certain extent at the bottom 31 of the container 30, foam 42 often appears on the surface of the coffee (liquid) 41 accumulated in the container 30. Note that in Figure 5, the foam 42 is shown in a simplified form with white outlines. Also, as the user continues to pour hot water over the coffee grounds until the desired amount is reached, the surface area of ​​the coffee (liquid) 41 shrinks to conform to the shape of the container 30, as shown in Figures 5(3) to (8).

[0066] As shown in Figures 5(1) to 5(8), when hot water is poured over the coffee grounds set in the dripper 10, various colors and patterns are formed on the bottom 31 of the container 30 (including the surface of the coffee (liquid) 41 accumulated in the container 30), such as the color of the coffee (dark) and the color of the foam (whitish). The colors and patterns formed in this way often differ depending on the person brewing the coffee and the environment in which the coffee is brewed. Furthermore, it is assumed that the colors and patterns formed in this way are unlikely to be identical or nearly identical even if the same person brews coffee in the same environment. Therefore, in the first embodiment, an example is shown in which various information is provided using the colors and patterns formed when brewing coffee.

[0067] [Example of judgment information used to determine the output target information using the colors and patterns formed when brewing coffee] Figures 6 and 7 show examples of various types of information used when determining the information to be output by the electronic device 20 in the first embodiment.

[0068] Figure 6(1) shows an example of regions A to I used when acquiring information about the coffee accumulating in the container 30 (for example, the surface of the coffee (liquid) 41 accumulated in the container 30). The circular region shown in Figure 6(1) is the region corresponding to the circular shape of the bottom 31 of the container 30 in the image acquired by the image acquisition unit 22 of the electronic device 20 (for example, the rectangular image acquired by the image sensor). Furthermore, the circular region shown in Figure 6(1) is divided into nine regions A to I. For example, regions A to I can be set so that each area is approximately the same. Note that the division of the circular region shown in Figure 6(1) is just one example, and the circular region may be divided into multiple regions by other division methods. For example, the circular region may be divided into four regions by two straight lines (straight lines with the same diameter) passing through the center of the circle, or into six regions by three straight lines (straight lines with the same diameter) passing through the center of the circle, or into eight regions by four straight lines (straight lines with the same diameter) passing through the center of the circle. Alternatively, multiple regions (closed regions) of irregular shapes (e.g., polygons (e.g., triangles, quadrilaterals, pentagons), circles, ellipses) can be arranged within a circular region without overlapping, and these regions (closed regions, regions outside the closed regions) can be used to define multiple regions.

[0069] Figure 6(2) shows an example of judgment information (table) used when determining the information to be output based on the information acquired using regions A to I shown in Figure 6(1). The judgment information shown in Figure 6(2) is information that shows the correspondence between the transitions of information about the coffee accumulating in container 30 (for example, the surface of the coffee (liquid) 41 accumulated in container 30) and the information to be output OI. For example, all combinations (patterns) of A to I are defined in the judgment information shown in Figure 6(2). For example, the pattern "A, A, ..., A, A" is defined for the information to be output OI1 where all are A. Also, the pattern "A, B, A, ..., A, A" is defined for the information to be output OI2 where all but one (time t2 is "B") is A. Also, the pattern "A, B, B, A, ..., A, A" is defined for the information to be output OI2 where all but two (times t2 and t3 are "B") are A. The same definition applies thereafter, and all OIM information to be output will have the pattern "I, I, ..., I, I" defined for each element.

[0070] In Figure 6(2), times t1, ..., tn (where n is a positive integer) are values ​​indicating the elapsed time when brewing coffee using the coffee extractor 1. For example, if the interval for acquiring information about the coffee accumulating in container 30 is 20 seconds, then time t1 = 20 seconds elapsed, time t2 = 40 seconds elapsed, time t3 = 60 seconds elapsed, ..., with 20-second intervals. Then, for each of times t1, ..., tn, the control unit 23 sequentially determines the region with the highest proportion of black among regions A to I shown in Figure 6(1), and based on the determination result, determines the information OI (OI1 to OIM (where M is a positive integer)) to be output. For example, if for each of times t1, ..., tn, the control unit 23 determines OI1 as the information OI to be output if all of the regions with the highest proportion of black among regions A to I shown in Figure 6(1) are A (region A shown in Figure 6(1)). Furthermore, for example, the control unit 23 determines OIM as the information to be output OI if, at each of the times t1, ..., tn, the region with the highest proportion of black among regions A to I shown in Figure 6(1) is I (region I shown in Figure 6(1)).

[0071] The intervals between time t1, ..., tn, and the value of n may be set in advance, or the user may set a value of their choice through user operation. The value of M is determined based on the number of regions that divide the circular shape corresponding to the surface of the coffee (liquid) 41 accumulated in the container 30, and the value of n. For example, if the number of regions that divide the circular shape is 4 and the value of n is 4, then it is determined to be 256 (= 4 × 4 × 4 × 4). However, depending on the number of regions and the value of n, the value of M may become too large, making it impossible to prepare the information to be output (for example, the audio information 61 shown in Figure 7). For this reason, if the value of M is greater than the number of pieces of information to be output (for example, the audio information 61 shown in Figure 7), the same piece of audio information 61 may be assigned to different pieces of information (information to be output OI).

[0072] Figure 7 shows an example of the correspondence between the information OI to be output, determined using the judgment information shown in Figure 6(2), and the output information (audio information 61). For example, if OI1 is determined as the information OI to be output, then information about Santa will be output as audio information 61. The information about Santa is, for example, the information used to output the audio "Today, let's dream of our beloved Santa." Note that in Figure 7, only the characters that are the target of audio output are shown in a simplified manner for ease of explanation. For further explanation of these output examples, please refer to Figure 10.

[0073] [An example of determining information to be output using the colors and patterns formed when brewing coffee] Figure 8 shows the relationship between the image that can be acquired by the electronic device 20 in the first embodiment (an image of the surface of the coffee accumulating in the container 30) and regions A to I shown in Figure 6(1). Note that the images of the surface of the coffee accumulating in the container 30 shown in Figures 8(1) to (8) are the same as the images shown in Figures 5(1) to (8).

[0074] Figure 9 shows an example of a decision made by the electronic device 20 in the first embodiment to determine the information to be output. Figures 8 and 9 show an example where time t1 to t8 is used as the elapsed time when brewing coffee using the coffee extractor 1. In this case, the value of M becomes 43046721, so it is conceivable that it may not be possible to prepare this many audio information 61 (and also not be able to store them in the storage unit 24). In such cases, it is possible to duplicate and associate some of the audio information 61 with the same output target information OI.

[0075] The images of the surface of the coffee accumulating in container 30 shown in Figures 8(1) to (8) were taken at times t1 to t8.

[0076] Figure 9(1) shows an example of memory where, for each of the time intervals t1 to t8, the region with the highest proportion of black among regions A to I shown in Figure 6(1) is associated with and stored in memory.

[0077] First, the power to the electronic device 20 is turned on. This power on / off can be performed manually by the user by providing a switch (operation unit 26) on the electronic device 20 for turning the power on and off. Alternatively, some kind of sensor (e.g., a sound sensor) may be provided on the electronic device 20, and the power on / off may be performed automatically based on the sensor. Furthermore, a wireless communication unit may be provided on the electronic device 20, and the power on / off may be performed based on the operation of an external device (e.g., a smartphone).

[0078] Thus, after the power of the electronic device 20 is turned on, the image acquisition unit 22 (shown in Figure 4) of the electronic device 20 sequentially acquires images (including image data) of the coffee accumulating in the container 30 based on the control unit 23 (shown in Figure 4) of the electronic device 20.

[0079] Furthermore, the control unit 23 (shown in Figure 4) of the electronic device 20 sequentially acquires images (images of the coffee accumulating in the container 30 (including image data)) acquired by the image acquisition unit 22 (shown in Figure 4) of the electronic device 20.

[0080] Here, after the power of the electronic device 20 is turned on, the information to be determined first (the image of the surface of the coffee accumulating in the container 30) may be determined based on the passage of time, based on changes in the image, or based on external operation. For example, after the power of the electronic device 20 is turned on, time t1 can be defined as the timing when a predetermined time (e.g., 1 to 20 seconds, the steeping time) has elapsed since a change occurred in the image of the surface of the coffee accumulating in the container 30. Note that the change in the image of the surface of the coffee accumulating in the container 30 is, for example, a change caused by the first dropping of coffee liquid to the bottom 31 of the container 30 (in other words, a change caused by the development of the color (black) of the coffee liquid).

[0081] Thus, the control unit 23 uses the image acquired at time t1 (an image of the surface of the coffee accumulating in the container 30) as the first target for determination. The control unit 23 then determines the circular region in the image acquired at time t1 (the circular region corresponding to the surface of the coffee (liquid) 41 accumulated in the container 30). Note that the circular region in the image acquired at time t1 is often the same size (or approximately the same size) as the bottom 31 of the container 30, because there is usually very little coffee accumulated in the container 30.

[0082] Here, the circular region in the image acquired by the control unit 23 becomes smaller over time. That is, as the amount of coffee (liquid) 41 accumulating in the container 30 increases, the surface of the coffee (liquid) 41 rises, and the surface area (circular region) of the coffee (liquid) 41 becomes smaller to match the shape of the container 30. For this reason, as shown in Figures 8(1) to (8), the control unit 23 changes the size of regions A to I to match the determined circular region (the circular region corresponding to the surface of the coffee (liquid) 41 accumulated in the container 30). Note that the size of regions A to I may be fixed and not changed during the determination process.

[0083] Next, the control unit 23 acquires feature quantities for the images contained within the circular region (the circular region corresponding to the surface of the coffee (liquid) 41 accumulated in the container 30) in the image acquired at time t1. Specifically, the control unit 23 acquires feature quantities for each image contained within the circular region in the image acquired at time t1 (each image contained within regions A to I shown in Figure 6(1)). For example, the control unit 23 obtains information about the color of the coffee as a feature quantity for each image contained within regions A to I. For example, the control unit 23 determines whether each pixel in each image contained in the image acquired by the image acquisition unit 22 is either a black region or a white region. For example, this can be determined by binarization processing (for example, setting a threshold in advance, and determining if the pixel value is greater than the threshold to be white, and if it is less than the threshold to be black). It is preferable to set the threshold used in the binarization processing to a value that can distinguish between coffee and foam. Then, the control unit 23 obtains the ratio of black regions and white regions in each image contained within regions A to I as a feature quantity.

[0084] Next, the control unit 23 determines the region with the highest proportion of black areas from among the images included in regions A to I. In the example shown in Figure 8(1), among the images included in regions A to I, region A has the highest proportion of black areas. Therefore, the control unit 23 determines region A as the region with the highest proportion of black areas in the image acquired at time t1.

[0085] Similarly, the control unit 23 determines the region with the highest proportion of black areas for each image (image of the surface of coffee accumulating in the container 30) acquired at time t2 to t8. Then, the control unit 23 sequentially stores the determined feature quantities (regions with the highest proportion of black areas) for each image acquired at time t1 to t8 in the storage unit 24, associating them with time t1 to t8. An example of this storage is shown in Figure 9(1). In other words, the storage example shown in Figure 9(1) is a storage example for the example shown in Figures 8(1) to (8).

[0086] Figure 9(2) shows an example of extracting features that match the features shown in Figure 9(1) (information relating time t1~t8 and regions A~I) from the judgment information shown in Figure 6(2). Note that the judgment information shown in Figure 9(2) is the same as the judgment information shown in Figure 6(2), with some of the judgment information from Figure 6(2) omitted.

[0087] Next, the control unit 23 determines the information to be output from the audio output unit 25 based on the acquired feature quantities. Specifically, the control unit 23 extracts feature quantities that match the acquired feature quantities (information relating time t1~t8 and region A~I shown in Figure 9(1)) from the judgment information shown in Figure 6(2). For example, as shown in Figure 9(2), the feature quantities shown in Figure 9(1) match the feature quantities shown within the dashed rectangle 51. Therefore, the control unit 23 extracts the feature quantities shown within the dashed rectangle 51 from the judgment information shown in Figure 9(2) as feature quantities that match the feature quantities shown in Figure 9(1). The control unit 23 also determines OIX1 as the information (information to be output) OI corresponding to the extracted feature quantities.

[0088] Next, the control unit 23 outputs audio from the audio output unit 25 based on the audio information 61 stored in the storage unit 24 in association with the OIX1 which has been determined as the information OI to be output. For example, as shown in Figure 9(3), the audio output unit 25 outputs the audio "Let's wait patiently like a snowman today" based on the audio information 61 associated with OIX1 (shown within the dashed rectangle 52). An example of this output is shown in Figure 10.

[0089] [Example of outputting audio information from an electronic device when brewing coffee] Figure 10 is a simplified diagram showing an example of outputting audio information from the electronic device 20 in the first embodiment. The example shown in Figure 10 shows an example of outputting audio information determined by the examples shown in Figures 8 and 9.

[0090] As described above, the control unit 23 outputs the voice message "Let's wait patiently like a snowman today" from the voice output unit 25 based on the voice information associated with OIX1 (within the dashed rectangle 52 shown in Figure 9(3)). This allows user P1, who is brewing coffee using the coffee brewer 1, to hear a voice message based on the features acquired during the brewing process after brewing their ideal cup of coffee. For example, whether user P1 is a coffee brewing expert or a novice, the color and pattern that appear on the surface of the coffee accumulating in the container 30 are likely to be different each time. Therefore, by utilizing these characteristics of coffee when brewing, users can enjoy not only the pleasure of drinking the brewed coffee but also voice information (information unrelated to coffee or its brewing) based on the features acquired during the brewing process.

[0091] [Example of operation that outputs audio information] Figure 11 is a flowchart showing an example of audio output processing by the electronic device 20 in the first embodiment. Figure 11 shows an example of operation after the power of the electronic device 20 is turned on by the operation of the control unit 26, and after a change occurs in the image of the surface of the coffee accumulating in the container 30.

[0092] First, the image acquisition unit 22 (shown in Figure 4) of the electronic device 20 sequentially acquires images (including image data) of the coffee accumulating in the container 30 based on the control unit 23 (shown in Figure 4) of the electronic device 20 (step S101). The control unit 23 also sequentially acquires the images (images (including image data)) acquired by the image acquisition unit 22 (step S101).

[0093] Next, the control unit 23 analyzes the acquired image information to obtain feature quantities (step S102). For example, the control unit 23 determines a circular region in the acquired image (a circular region corresponding to the surface of the coffee (liquid) 41 accumulated in the container 30). Next, the control unit 23 obtains feature quantities for the images included in the determined circular region. Specifically, the control unit 23 obtains feature quantities (ratio of black regions to white regions) for each image included in the circular region of the acquired image (each image included in regions A to I shown in Figure 6(1)). Next, the control unit 23 determines the region with the highest ratio of black regions from among the images included in regions A to I.

[0094] Next, the control unit 23 stores the acquired feature quantities in the storage unit 24 in association with the elapsed time (step S103). For example, as shown in Figure 9(1), the control unit 23 stores the determined feature quantities (the region with the highest proportion of black areas) for each image acquired at time t1 to t8 in the storage unit 24 in association with time t1 to t8.

[0095] Next, the control unit 23 determines whether or not the termination condition is met (step S104). If the termination condition is not met, the process returns to step S101; if the termination condition is met, the process proceeds to step S105.

[0096] Here, as a criterion for determining whether the termination condition is met, for example, whether a predetermined time has elapsed or whether there is no (or almost no) change in the acquired image information can be used. The predetermined time can be determined, for example, based on the elapsed time since the power of the electronic device 20 was turned on, or the elapsed time since a change occurred in the image of the surface of the coffee accumulating in the container 30 after the power of the electronic device 20 was turned on. The predetermined time may also be a pre-set time, or it may be set according to the user's preference through user operation. For example, as shown in the examples in Figures 8 and 9, when acquiring image information at the timings t1 to t8, the predetermined time will be time t8 (or after time t8 has elapsed). Furthermore, whether there is no change in the acquired image information can be determined, for example, by analyzing the acquired image information and comparing consecutive images in a time series, and determining whether the time during which the difference is less than or equal to a predetermined value continues for a predetermined period. In other words, whether there is no change in the acquired image information can be determined by whether a predetermined time has elapsed during which there is no change in the image of the surface of the coffee accumulating in the container 30. Note that it is also possible that no change will be determined due to the lens 21 fogging up.

[0097] If the termination condition is met (step S104), the control unit 23 determines the information to be output from the audio output unit 25 based on the acquired feature quantities (step S105). For example, the control unit 23 extracts a feature quantity that matches the acquired feature quantity (for example, information relating time t1~t8 and region A~I shown in Figure 9(1)) from the determination information shown in Figure 6(2). Next, the control unit 23 determines the information (information to be output) OI corresponding to the extracted feature quantity, and determines the audio information 61 (shown in Figure 7) stored in the storage unit 24 in association with the determined information (information to be output OI).

[0098] Next, the control unit 23 outputs sound from the sound output unit 25 based on the determined sound information (step S106). For example, as shown in Figure 10, sound is output from the sound output unit 25.

[0099] [Examples of using other judgment information] The above example shows how to determine the audio information to be output using the judgment information shown in Figure 6. However, other judgment information may also be used to determine the audio information to be output. Therefore, here we will show an example using other judgment information.

[0100] Figure 12 shows an example of various types of information used when determining the information to be output by the electronic device 20 in the first embodiment.

[0101] Figure 12(1) shows an example of an image pattern relating to the surface of coffee accumulating in container 30. As shown in Figure 12(1), the image pattern expected to occur on the surface of coffee accumulating in container 30 is stored in the storage unit 24 as determination information. Note that in Figure 12(1), the image pattern is simplified for ease of explanation. The number of image patterns N (where N is a positive integer) may be increased or decreased according to the storage capacity of the storage unit 24.

[0102] Figure 12(2) shows an example of judgment information (table) used when determining the information to be output based on the information obtained using the judgment information (image patterns PA1~PAN) shown in Figure 12(1). The judgment information shown in Figure 12(2) is information that shows the correspondence between the transition of information about the coffee accumulating in container 30 (for example, the surface of the coffee (liquid) 41 accumulated in container 30) and the information to be output OI. Note that the judgment information shown in Figure 12(2) corresponds to the judgment information shown in Figure 6(2), and since the parts that are common with Figure 6(2) are the same as in Figure 6(2), the explanation here is omitted.

[0103] For example, the control unit 23 (shown in Figure 4) determines a circular region in the image acquired from the image acquisition unit 22 (shown in Figure 4) (a circular region corresponding to the surface of the coffee (liquid) 41 accumulated in the container 30). Next, the control unit 23 compares the image contained in the determined circular region with each image pattern PA1 to PAN in the judgment information shown in Figure 12(1), and extracts the image pattern with the highest degree of similarity as a feature.

[0104] For example, each pixel in each image pattern PA1 to PAN represents a binary value (black or white). The control unit 23 then determines each pixel in the image contained within the determined circular region to be either a black region or a white region (for example, binarization). Next, the control unit 23 compares each pixel (black or white) in the image contained within the determined circular region with each pixel (black or white) in each image pattern PA1 to PAN, comparing corresponding pixels (pixels at the same position in the circular region) and calculating the number of matching pixels for each image pattern PA1 to PAN. Next, the control unit 23 extracts the image pattern PA1 to PAN with the largest number of matching pixels as the image pattern with the highest degree of similarity.

[0105] Next, the control unit 23 stores the extracted image patterns PA1 to PAN in the storage unit 24, associating them with the elapsed time. For example, the control unit 23 stores the determined feature quantities (image patterns PA1 to PAN) for each image acquired at time intervals t1 to t8 in the storage unit 24, associating them with time intervals t1 to t8.

[0106] Next, the control unit 23 determines the information to be output from the audio output unit 25 based on the acquired feature quantities. For example, the control unit 23 extracts feature quantities that match the acquired feature quantities (for example, information relating time t1 to t8 to image patterns PA1 to PAN) from the determination information (table) shown in Figure 12(2). Next, the control unit 23 determines the information (information to be output) OI corresponding to the extracted feature quantities and determines the audio information stored in the storage unit 24 in relation to the determined information (information to be output OI).

[0107] [Example of using drip speed as judgment information] For example, the size transition of the circular region corresponding to the surface of the coffee (liquid) 41 accumulating in container 30 can be used as determination information. In other words, the dripping speed can be used as determination information.

[0108] For example, multiple sizes of circular regions corresponding to the surface of the coffee (liquid) 41 accumulated in container 30 are stored in the storage unit 24 as judgment information. The control unit 23 (shown in Figure 4) then compares the size of the circular region (the circular region corresponding to the surface of the coffee (liquid) 41 accumulated in container 30) in the image acquired from the image acquisition unit 22 (shown in Figure 4) with the multiple sizes stored in the storage unit 24, and extracts the size with the highest degree of similarity as a feature. Next, the control unit 23 stores the extracted size in the storage unit 24 in association with elapsed time. Next, the control unit 23 determines the information to be output from the audio output unit 25 based on the acquired feature. For example, the control unit 23 extracts a feature that matches the acquired feature (for example, information associating time t1~t8 with size) from the judgment information corresponding to Figures 6(2) and 12(2). Next, the control unit 23 determines the information (information to be output) OI corresponding to the extracted feature quantity, and determines the audio information stored in the storage unit 24 in association with the determined information (information to be output OI).

[0109] Alternatively, the height of the coffee (liquid) 41 accumulating in the container 30 may be used as judgment information. In this case, a sensor (for example, an ultrasonic distance sensor, or an image sensor that acquires an image of the side of the transparent container 30) for acquiring the height of the coffee (liquid) 41 accumulating in the container 30 is provided on the electronic device 20 or the coffee extractor 1, and the height of the coffee (liquid) 41 accumulating in the container 30 is acquired using this sensor.

[0110] [Example of using the direction of ripples and water droplets as information for determination] For example, various pieces of information such as the ripples created by water droplets (coffee) falling onto the surface of the coffee (liquid) 41 accumulating in container 30, the direction in which the water droplets (coffee) travel across the surface of the coffee (liquid) 41 accumulating in container 30, the length of their travel, and the amount of foam generated by the water droplets (coffee) falling onto the surface of the coffee (liquid) 41 accumulating in container 30 can be used as judgment information. In other words, natural phenomena occurring during the dripping process can be used as judgment information.

[0111] For example, when detecting ripples caused by water droplets (coffee) falling onto the surface of coffee (liquid) 41 accumulating in container 30, one or more ripple image patterns for identifying the ripples are stored in the storage unit 24. The control unit 23 (shown in Figure 4) then detects the occurrence of ripples when it finds an image matching a ripple image pattern among the images of a circular region (a circular region corresponding to the surface of the coffee (liquid) 41 accumulating in container 30) in the image acquired from the image acquisition unit 22 (shown in Figure 4). In this case, the control unit 23 can store the type of ripple (identifiable by the ripple image pattern), the location where the ripple occurred (the location in the circular region corresponding to the surface of the coffee (liquid) 41 accumulating in container 30), and the timing of the ripple occurrence (elapsed time) in the storage unit 24 in relation to the elapsed time. Next, the control unit 23 determines the information to be output from the audio output unit 25 based on the acquired feature quantities. For example, various pieces of information such as whether or not ripples occur, the number of times ripples occur, the type of ripples, the time of ripple occurrence, and the location of ripples can be stored in association with the information to be output OI. Based on this information, the information to be output OI can be determined, and the audio information stored in the storage unit 24 can be determined in association with the determined information (information to be output OI).

[0112] Furthermore, for example, when detecting the direction and length of movement of a water droplet (coffee) that has fallen onto the surface of the coffee (liquid) 41 accumulated in the container 30, the storage unit 24 stores judgment information for detecting the water droplet (for example, information for detecting an object moving in a straight line in each image in a time series). The control unit 23 (shown in Figure 4) then detects that a water droplet has occurred moving across the surface from the image of a circular region (a circular region corresponding to the surface of the coffee (liquid) 41 accumulated in the container 30) in the image acquired from the image acquisition unit 22 (shown in Figure 4). In this case, the control unit 23 can store in the storage unit 24 the position where the water droplet occurred (position in the circular region corresponding to the surface of the coffee (liquid) 41 accumulated in the container 30), the length of the water droplet that has moved across the surface, and the timing (elapsed time) when the water droplet occurred, associating these with the elapsed time. Next, the control unit 23 determines the information to be output from the audio output unit 25 based on the acquired feature quantities. For example, various pieces of information such as whether or not water droplets are moving across the surface, the number of times water droplets are moving across the surface, the total length of water droplets moving across the surface, the time it takes for water droplets to be formed, and the position of water droplets moving across the surface can be stored in association with the information to be output OI. Based on this various information, the information to be output OI can be determined, and the audio information stored in the storage unit 24 can be determined in association with the determined information (information to be output OI).

[0113] Furthermore, for example, when detecting the amount of foam generated by water droplets (coffee) falling onto the surface of the coffee (liquid) 41 accumulating in container 30, instead of the image pattern shown in Figure 12(1), multiple image patterns for detecting the amount of foam are stored in the storage unit 24. Then, audio information can be determined in the same way as the determination method using the judgment information shown in Figure 12(1).

[0114] The judgment information described above is merely an example, and other judgment information may be used. For example, the position (position on the surface) of a water droplet (coffee) falling onto the surface of the coffee (liquid) 41 accumulating in the container 30, the extent to which the water droplet spreads on the surface, the density of the surface of the coffee (liquid) 41 accumulating in the container 30 (for example, the degree of coffee color), the distribution of bubbles generated by the water droplet (coffee) falling onto the surface of the coffee (liquid) 41 accumulating in the container 30, the proportion of the surface occupied by those bubbles, and natural phenomena that occur during dripping, such as the transitions between these, can be used as judgment information. Furthermore, the judgment may be made by combining the judgment information described above. For example, the ripples created by the falling water droplet and the direction in which the water droplet travels can be combined for judgment.

[0115] Furthermore, while the first embodiment shows an example where the electronic device 20 is configured as a single unit, the electronic device 20 may also be composed of multiple components. For example, the lens 21 and image acquisition unit 22 may be configured separately from the other parts, and image information may be transmitted from the image acquisition unit 22 to the control unit 23 by wire or wireless. Also, the position in which the electronic device 20 is installed is not limited to the positions shown in Figures 1 and 3. For example, it may be installed in other locations as long as an image of the surface of the coffee (liquid) 41 accumulating in the container 30 can be acquired via the lens 21. For example, the electronic device 20 may be installed on the outside of the transparent container 30 so that the lens 21 faces the surface of the coffee (liquid) 41 accumulating in the container 30. However, it is preferable to apply heat insulation treatment with heat insulating material or the like to prevent the effects of heat generated in the container 30.

[0116] [Second embodiment: An example of providing audio and image information using the colors and patterns formed when brewing coffee] In the first embodiment, an example was shown in which audio information is provided using the colors and patterns formed when coffee is brewed, but it is also possible to provide other information. Therefore, in the second embodiment, an example is shown in which audio information and image information are provided using the colors and patterns formed when coffee is brewed. Note that the second embodiment is a modification of the first embodiment, and some of the explanations of parts common to the first embodiment will be omitted.

[0117] [Example of the external configuration of a coffee brewing machine] Figure 13 is a perspective view showing an example of the external configuration of the coffee brewer 200 to which the electronic device 220 in the second embodiment is attached. Figure 13(1) shows a side view of the coffee brewer 200, and Figure 13(1) shows a side view of the coffee brewer 200 (a side view as seen from the direction of arrow A shown in Figure 13(1)).

[0118] The coffee brewer 200 comprises a dripper 210, an electronic device 220 (shown in Figure 14), a container 230, and a stand 240. The coffee brewer 200 is similar to the coffee brewer 1 shown in Figure 1, but with the electronic device 220 mounted on the stand 240 instead of the electronic device 20 mounted on the dripper 10. The container 230 is the same as the container 30 shown in Figure 1. The dripper 210 is substantially the same as the dripper 10 shown in Figures 1 and 3. This explanation will focus on the differences between the coffee brewer 200 and the coffee brewer 1 in the first embodiment.

[0119] The stand 240 is a support base for the dripper 210, and can be formed from a flat plate-shaped member in a U-shape (as shown in Figure 13(1)). For example, the upper part of the stand 240 (the part where the flange portion 212 shown in Figure 13(1) is installed) is provided with a hole that is larger in diameter than the lower leg portion 213 of the dripper 210 and smaller in diameter than the flange portion 212 of the dripper 210 (for example, circular). When installing the dripper 210 on the stand 240, it can be installed so that the lower leg portion 213 of the dripper 210 fits into the hole in the stand 240.

[0120] Furthermore, the lens 221 is positioned outside the hole in the upper part of the stand 240 (the part where the flange portion 212 shown in Figure 13(1) is installed). It is preferable to install the lens 221 in a position where it is not exposed to the liquid (coffee) falling from the hole of the dripper 210 (inside the leg portion 213) and is not significantly affected by the heat of that liquid.

[0121] Furthermore, a user interface 229 is located on the middle (rear) part of the stand 240. The user interface 229 can be configured, for example, as a touch panel that displays various information and accepts user input. The stand 240 can be made from materials such as heat-resistant glass, ceramics, metal, resin, or wood.

[0122] [Example of electronic device functional configuration] Figure 14 is a block diagram showing an example of the functional configuration of the electronic device 220 in the second embodiment.

[0123] The electronic device 220 includes a lens 221, an image acquisition unit 222, a control unit 223, a storage unit 224, an audio output unit 225, and a user interface 229. The electronic device 220 is the same as the electronic device 20 shown in Figure 4, but with the addition of the user interface 229. Therefore, this explanation will focus on the differences between the electronic device 20 and the electronic device 20 shown in Figure 4. As shown in Figure 13, the lens 221 and image acquisition unit 222 are mounted on the top of the stand 240, and the user interface 229 is mounted on the middle (rear) of the stand 240. The other components may be mounted together with the user interface 229 on the middle (rear) of the stand 240, or they may be mounted on the bottom or top of the stand 240.

[0124] The user interface 229 consists of an input unit (operation reception unit) 226 and a display unit 227.

[0125] The input unit 226 is an operation reception unit that receives operation inputs made by the user and outputs operation information corresponding to the received operation inputs to the control unit 223. The input unit 226 can be implemented by, for example, a touch panel, keyboard, mouse, or sensor (for example, a touch interface).

[0126] The display unit 227 is a display unit that outputs various information based on the control of the control unit 223. For example, the display unit 227 can be an OLED (Electro-Luminescence) panel, an LCD (Liquid Crystal Display) panel, or other display panel. Thus, the input unit 226 and the display unit 227 can be integrated using a touch panel that allows the user to perform operation input by touching or bringing their finger close to the display surface. However, the input unit 226 and the display unit 227 may be configured as separate components, and the input unit 226 may accept operation via an operating member. Alternatively, an operating member separate from the user interface 229, such as a touch panel, may be provided, and operation may be accepted via this operating member.

[0127] [Example of information to be output] Figure 15 shows an example of information to be output by the electronic device 220 in the second embodiment. In this example, the judgment information shown in Figures 6(1) and 6(2) is used.

[0128] Figure 15 shows an example of output information (information to be output) determined using the judgment information shown in Figure 6(2). For example, if OI1 is determined as the output information OI, then information related to Santa (audio information 61, image information 62) will be output. Information related to Santa includes, for example, information for outputting the audio "Today let's dream of our beloved Santa" (audio information 61) and information for displaying a picture or graphic image of Santa (image information 62). In Figure 15, for the sake of clarity, the characters to be output as audio and the images to be displayed are simply shown. For more detailed examples of these outputs, please refer to Figure 17.

[0129] [An example of determining information to be output using the colors and patterns formed when brewing coffee] Figure 16 shows an example of a decision made by the electronic device 220 in the second embodiment to determine the information to be output. The example shown in Figure 16, like the example shown in Figure 9, shows an example in which time t1 to t8 is used as the elapsed time when brewing coffee using the coffee extractor 200. Also, Figures 16(1) and 16(2) are the same as Figures 9(1) and 16(2).

[0130] As shown in the first embodiment, the control unit 223 (shown in Figure 14) extracts the feature quantities shown within the dashed rectangle 51 from the determination information shown in Figure 16(2) as feature quantities that match the feature quantities shown in Figure 16(1). The control unit 223 also determines OIX1 as the information (information to be output) OI corresponding to the extracted feature quantities.

[0131] Next, the control unit 223 outputs audio from the audio output unit 225 based on the audio information 61 stored in the storage unit 224 in association with the OIX1 determined to be the information OI to be output. The control unit 223 also displays an image on the display unit 227 based on the image information 62 stored in the storage unit 224 in association with the OIX1 determined to be the information OI to be output.

[0132] For example, as shown in Figure 16(3), based on the audio information 61 associated with OIX1 (shown within the dashed rectangle 54), the audio output unit 225 outputs the phrase "Today, let's wait patiently like a snowman." Also, as shown in Figure 16(3), based on the image information 62 associated with OIX1 (shown within the dashed rectangle 54), an image of Santa is displayed on the display unit 227. An example of this output is shown in Figure 17.

[0133] [Example of outputting audio and image information from an electronic device when brewing coffee] Figure 17 is a simplified diagram showing an example of outputting audio and image information from the electronic device 220 in the second embodiment. The example shown in Figure 17 shows an example of outputting audio information determined by the examples shown in Figures 8 and 16.

[0134] As described above, the control unit 223 outputs the voice message "Let's wait patiently like a snowman today" from the voice output unit 25 based on the voice information 61 associated with OIX1 (within the dashed rectangle 54 shown in Figure 16(3)). The control unit 223 also displays an image of Santa on the display unit 227 based on the image information 62 associated with OIX1 (within the dashed rectangle 54 shown in Figure 16(3)). As a result, user P1, who is brewing coffee using the coffee brewer 200, can enjoy the voice and image based on the features obtained from the brewing process after brewing their ideal cup of coffee. In this way, by displaying an image along with the voice, user P1 can also visually enjoy the information based on the features obtained from the brewing process. Note that Figure 17 shows an example where voice and image are output simultaneously, but the voice and image may be output at different times, or only the image may be output.

[0135] [Example of operation that outputs audio and image information] Figure 18 is a flowchart showing an example of information output processing by the electronic device 220 in the second embodiment. Steps S112 to S115 shown in Figure 18 correspond to steps S101 to S104 shown in Figure 11. Therefore, this explanation will focus on the differences from the example shown in Figure 11.

[0136] First, the control unit 223 of the electronic device 220 determines whether or not a start operation has occurred (step S111). For example, it determines whether or not the start button (shown in Figure 13(2)) on the user interface 229 has been touched. If a start operation has occurred (step S111), the process proceeds to step S112. If no start operation has occurred (step S111), monitoring continues.

[0137] As described above, steps S112 to S115 correspond to steps S101 to S104 shown in Figure 11.

[0138] Here, as a criterion for determining whether or not the termination condition of step S115 is met, in addition to the criterion shown in the first embodiment, it is also possible to determine, for example, whether or not a termination operation has been performed by the user. For example, the termination button may be displayed after the start button (shown in Figure 13(2)) is touched on the user interface 229, and it may be determined that the termination condition is met when this termination button is touched.

[0139] If the termination condition is met (step S115), the control unit 223 determines the information to be output based on the acquired feature quantities (step S116). That is, the control unit 223 determines the audio information and image information stored in the storage unit 224 in association with the determined information (information to be output OI).

[0140] Next, the control unit 223 outputs sound from the sound output unit 225 based on the determined sound information, and displays an image on the user interface 229 (display unit 227) based on the determined image information (step S117). For example, as shown in Figure 17, sound is output from the sound output unit 225 and an image is displayed on the user interface 229 (display unit 227).

[0141] [Third Embodiment: An example of outputting audio and image information using an external device] In the first and second embodiments, examples were shown in which audio and image information is output by an electronic device attached to a coffee maker. However, audio and image information may also be output from a device other than a coffee maker. This eliminates the need to provide an audio output unit and a display unit in the electronic device attached to the coffee maker, thereby reducing the manufacturing cost of the electronic device. The third embodiment is a modification of the first and second embodiments, and some parts of the explanation of the parts common to the first and second embodiments will be omitted.

[0142] [Example of electronic device functional configuration] Figure 19 is a block diagram showing an example of the functional configuration of the electronic device 320 in the third embodiment.

[0143] The electronic device 320 includes a lens 321, an image acquisition unit 322, a control unit 323, a storage unit 324, and a communication unit 325. The electronic device 320 is the same as the electronic device 20 shown in Figure 4, but with the communication unit 325 added and the audio output unit 25 omitted. Other parts are common to the electronic device 20 shown in Figure 4 and the electronic device 220 shown in Figure 14. Therefore, this explanation will focus on the differences between the electronic device 320 and the electronic device 20 shown in Figure 4 and Figure 14. Note that although not shown in Figure 19, an audio output unit and a user interface may also be provided.

[0144] The communication unit 325, based on the control of the control unit 323, exchanges various types of information with other devices via wired or wireless lines. For example, when exchanging various types of information using wireless communication, the communication unit 325 transmits and receives radio waves via an antenna (not shown). For example, the communication unit 325 can perform wireless communication using wireless LAN (Local Area Network) (e.g., Wi-Fi (Wireless Fidelity)), NFC (Near Field Communication), Bluetooth (registered trademark), infrared, mobile phone radio waves, etc. The communication unit 325 can be implemented by, for example, a communication module equipped with an antenna and wireless communication function, or a communication module equipped with wired communication function.

[0145] [Example of external equipment configuration] Figure 20 is a perspective view showing an example of the external configuration of external devices (electronic devices 350, 360) in the third embodiment. Figure 20(1) shows a portable electronic device 350. The electronic device 350 is a portable information processing device, such as a smartphone, tablet terminal, or personal computer. Figure 20(2) shows a stationary electronic device 360. The electronic device 360 ​​is a stationary speaker device, such as an AI speaker equipped with artificial intelligence (AI), or a speaker with wireless communication capabilities.

[0146] [Example of electronic device functional configuration] Figure 21 is a block diagram showing an example of the functional configuration of the electronic device 350 in the third embodiment. Note that the functional configuration of the electronic device 360 ​​shown in Figure 20 is substantially the same as that of the electronic device 350, and therefore its explanation is omitted here.

[0147] The electronic device 350 includes a communication unit 351, a control unit 352, a storage unit 353, an audio output unit 354, a user interface 357 (input unit 355, display unit 356), and a location information acquisition unit 358. Each unit in the electronic device 350 corresponds to the unit with the same name in the electronic device 20 shown in Figure 4 and the electronic device 220 shown in Figure 14. Therefore, this explanation will focus on the differences between the electronic device 350 and the electronic device 20 shown in Figure 4 and the electronic device 220 shown in Figure 14. The communication unit 351 in the electronic device 350 can perform wireless communication with electronic devices within a predetermined range, and can also perform wireless communication by connecting to a predetermined network (e.g., the Internet) via a base station installed by a telecommunications carrier such as a mobile phone company.

[0148] The location information acquisition unit 358 acquires location information relating to the location of the electronic device 350 and outputs the acquired location information to the control unit 352. The location information acquisition unit 358 can be implemented, for example, by a GPS receiver that receives GPS (Global Positioning System) signals and calculates location information based on those GPS signals. The calculated location information includes various location data such as latitude, longitude, and altitude at the time of receiving the GPS signal. Alternatively, a location information acquisition device that acquires location information using other methods may be used. For example, a location information acquisition device that derives location information using access point information from a nearby wireless LAN (Local Area Network) and acquires this location information may be used.

[0149] [Communication when outputting audio and image information from external devices other than electronic devices] Figure 22 is a flowchart showing an example of communication processing by electronic devices 320 and 350 in the third embodiment. Steps S122 to S126 shown in Figure 22 correspond to steps S112 to S116 shown in Figure 18. Therefore, this explanation will focus on the differences from the example shown in Figure 18. It is also assumed that electronic devices 320 and 350 have applications (programs) pre-configured to implement each of the processes shown in Figure 22.

[0150] First, the control unit 323 of the electronic device 320 detects a start instruction (step S121). If the electronic device 320 is equipped with a start operation member (not shown), this start instruction is detected when the user operates the start operation member. Alternatively, the user can perform a start operation using the electronic device 350, and the electronic device 350 can transmit start instruction information to the electronic device 320 in response to this start operation. In this case, the start instruction is detected when the start instruction information from the electronic device 350 is received. Furthermore, the electronic device 320 may be equipped with sensors for detecting start instructions (e.g., a human detection sensor, a temperature sensor, a water droplet sensor, a vibration sensor), and the start instruction may be automatically detected by these sensors.

[0151] As described above, steps S122 to S126 correspond to steps S112 to S116 shown in Figure 18.

[0152] The control unit 323 determines the information to be output (voice information and image information) (step S126). Next, the communication unit 325 transmits the determined voice information and image information to the electronic device 350 based on the control unit 323 (step S127).

[0153] The communication unit 351 of the electronic device 350 receives information (voice information and image information) transmitted from the electronic device 320 (step S128). Next, the control unit 352 of the electronic device 350 stores the received information (voice information and image information) in the storage unit 353 (step S129). Then, the control unit 352 of the electronic device 350 outputs the received information (voice information and image information) (step S129). That is, the control unit 352 of the electronic device 350 outputs voice from the voice output unit 354 based on the received voice information, and displays an image on the user interface 357 (display unit 356) based on the received image information (step S129). For example, as shown in Figure 23(1), voice is output from the voice output unit 354 and an image is displayed on the user interface 357 (display unit 356).

[0154] [Example of outputting audio and image information from a device other than an electronic device attached to a coffee maker] Figure 23 is a simplified diagram showing an example of outputting audio and image information from devices other than the electronic device 220 (electronic devices 350, 360) in the third embodiment. Figure 23(1) shows an example of outputting audio and image information from electronic device 350. Figure 23(2) shows an example of outputting audio and image information from electronic device 360. Note that the examples shown in Figure 23 show examples of outputting audio information determined by the examples shown in Figures 8 and 16.

[0155] Furthermore, it is assumed that electronic devices 350 and 360 have pre-configured applications (programs) for implementing each of the processes shown in Figure 22.

[0156] As shown in the second embodiment, the control unit 323 of the electronic device 320 determines that the audio information 61 (within the dashed rectangle 54 shown in Figure 16(3)) and image information 62 (within the dashed rectangle 54 shown in Figure 16(3)) associated with OIX1 are to be output. Next, the control unit 323 of the electronic device 320 controls the wireless transmission of the audio information 61 (within the dashed rectangle 54 shown in Figure 16(3)) and image information 62 (within the dashed rectangle 54 shown in Figure 16(3)) determined to be output to an external device via the communication unit 325.

[0157] For example, when outputting audio and image information from the electronic device 350, the control unit 323 of the electronic device 320 controls the wireless transmission of the audio information 61 (within the dashed rectangle 54 shown in Figure 16(3)) and image information 62 (within the dashed rectangle 54 shown in Figure 16(3)), which have been determined as the information to be output, from the communication unit 325 to the electronic device 350. Upon receiving this information, the control unit 352 of the electronic device 350 outputs the audio "Let's wait patiently like a snowman today" from the audio output unit 354 based on the received audio information. The control unit 352 also displays an image of Santa on the user interface 357 (display unit 356) based on the received image information. As a result, user P1, who is brewing coffee using the coffee brewer 300, can enjoy the audio and images based on the features acquired during the brewing process, even when away from the coffee brewer 300, while savoring the coffee after brewing their ideal cup. Furthermore, for example, user P1 can store the audio output and the displayed image of Santa in the memory unit 353 of the electronic device 350 and enjoy them later.

[0158] Furthermore, for example, when outputting audio information from the electronic device 360, the control unit 323 of the electronic device 320 controls the wireless transmission of the audio information 61 (within the dashed rectangle 54 shown in Figure 16(3)), which has been determined as the information to be output, from the communication unit 325 to the electronic device 360. Upon receiving this audio information, the control unit of the electronic device 360 ​​outputs the voice "Today, let's wait patiently like a snowman" from the audio output unit based on the received audio information. As a result, user P1, who is brewing coffee using the coffee brewer 300, can enjoy the audio based on the features acquired during the brewing process, even when away from the coffee brewer 300, while savoring the coffee after brewing his ideal cup.

[0159] The above describes an example of outputting audio and images from electronic devices 350 and 360 that can directly communicate wirelessly with electronic device 320. However, audio and images may also be output from devices that cannot directly communicate wirelessly with electronic device 320. For example, in electronic device 320, each piece of information (audio information, image information) determined to be output is wirelessly transmitted from the communication unit 325 to electronic devices 350 and 360. Electronic devices 350 and 360, having received this information (audio information, image information), then forward the information (audio information, image information) received from electronic device 320 to a predetermined device (for example, a device instructed as a destination by electronic device 320, or a device pre-set as a destination). For example, electronic devices 350 and 360 can use wireless communication to connect to a predetermined network (for example, the Internet) and transmit the information (audio information, image information) received from electronic device 320 to a predetermined destination. This allows, for example, user P1, who is brewing coffee using coffee brewer 300, to provide audio and images based on the features acquired during the brewing process to a person located far away from the coffee brewer 300 after brewing their ideal cup of coffee (for example, from an electronic device owned by that person).

[0160] [Fourth embodiment: An example of having a portion of the processing performed by an electronic device attached to a coffee brewer be handled by another electronic device.] In the first to third embodiments, examples were shown in which the information to be output is determined by an electronic device attached to a coffee brewer. Here, it is also conceivable that the electronic device attached to the coffee brewer perform only relatively simple processing, and other processing is performed by other devices with higher processing capabilities. Therefore, in the fourth embodiment, an example is shown in which some of the processing performed by the electronic device attached to the coffee brewer is performed by other electronic devices.

[0161] The fourth embodiment will be described with reference to the electronic device 320 (shown in Figure 19) and electronic device 350 (shown in Figure 21) shown in the third embodiment.

[0162] For example, an electronic device 320 (shown in Figure 19) attached to a coffee extractor 300 (shown in Figure 23) performs the process of acquiring an image of the surface of the coffee (liquid) accumulating in a container 330 (shown in Figure 23). The electronic device 320 then sequentially transmits the acquired image information (image of the surface of the coffee (liquid) accumulating in the container 330) from a communication unit 325 (shown in Figure 19) to an electronic device 350, either periodically or irregularly.

[0163] The storage unit 353 (shown in Figure 21) of the electronic device 350 stores the determination information shown in the first to third embodiments (for example, the determination information shown in Figures 6(1) and 6(2), and the determination information shown in Figures 12(1) and 12(2)) and the output target information (for example, the output target information shown in Figure 7 and Figure 15). The control unit 352 (shown in Figure 21) of the electronic device 350 sequentially stores the image information (image of the surface of the coffee (liquid) accumulating in the container 330) received from the electronic device 320 via the communication unit 351 in the storage unit 353. Next, the control unit 352 (shown in Figure 21) of the electronic device 350 uses the determination information stored in the storage unit 353 to perform a determination process for the output target information regarding the image information (image of the surface of the coffee (liquid) accumulating in the container 330) received from the electronic device 320. Next, the control unit 352 of the electronic device 350 outputs each piece of information determined by the determination process.

[0164] For example, as shown in Figure 23(1), the control unit 352 of the electronic device 350 outputs the voice message "Let's wait patiently like a snowman today" from the voice output unit 354 based on the voice information determined by the decision process. The control unit 352 also displays an image of Santa on the user interface 357 (display unit 356) based on the image information determined by the decision process.

[0165] [Example of communication when performing a series of processes using multiple electronic devices] Figure 24 is a flowchart showing an example of communication processing by electronic devices 320 and 350 in the fourth embodiment. Steps S131, S133, S135, and S143-S146 shown in Figure 24 correspond to steps S121-S126 shown in Figure 22. Therefore, this explanation will focus on the differences from the example shown in Figure 22.

[0166] When the control unit 323 of the electronic device 320 detects a start instruction (step S131), it transmits start information from the communication unit 325 to the electronic device 350 to notify it of the start of operation (step S132).

[0167] When the control unit 352 of the electronic device 350 receives the start information via the communication unit 351, it recognizes that the electronic device 320 has started operating (step S141).

[0168] The control unit 323 of the electronic device 320 acquires the image acquired by the image acquisition unit 322 (an image of the coffee accumulating in the container 330 (including image data)) (step S133), and transmits the acquired image information to the electronic device 350 (step S134). In this case, the transmission of image information from the electronic device 320 to the electronic device 350 may be performed periodically or irregularly.

[0169] Step S135 shown in Figure 24 corresponds to step S125 shown in Figure 22.

[0170] When the control unit 352 of the electronic device 350 receives image information from the electronic device 320 (step S142), it analyzes the received image information and obtains feature quantities (step S143). Steps S143 to S146 shown in Figure 24 correspond to steps S123 to S126 shown in Figure 22.

[0171] Here, as a criterion for determining whether or not the termination condition in step S145 is met, in addition to the criterion shown in the first to third embodiments, for example, the criterion for determining whether or not image information has not been received from the electronic device 320 for a predetermined period of time or longer may be used. For example, if image information has not been received from the electronic device 320 for a predetermined period of time or longer, the control unit 352 of the electronic device 350 can determine that the termination condition is met (step S145).

[0172] The control unit 352 of the electronic device 350 determines the information to be output (audio information and image information) (step S146). Next, the control unit 352 of the electronic device 350 outputs the determined audio information and image information (step S147). That is, the control unit 352 of the electronic device 350 outputs audio from the audio output unit 354 based on the determined audio information, and displays an image on the user interface 357 (display unit 356) based on the determined image information (step S147). For example, as shown in Figure 23, audio is output from the audio output unit 354 and an image is displayed on the user interface 357 (display unit 356).

[0173] The above examples show how the judgment information shown in Figures 6 and 12, and the output target information shown in Figures 7 and 15, are pre-stored in the memory units 24, 224, and 324 of the electronic devices 20, 220, and 320. However, this information may also be acquired and used from an external source. For example, a communication unit (e.g., the communication unit 325 shown in Figure 19) capable of communicating with other devices via a wired or wireless line may be provided in the electronic device, and this communication unit may be connected to an external device (or a predetermined network (e.g., the Internet)) to acquire all or part of the information from the external device. In this case, the information may be acquired and used each time the coffee maker (electronic device) is used, or it may be acquired and used periodically or irregularly.

[0174] Furthermore, the above examples illustrate how the various determination information shown in Figures 6 and 12, and the output target information shown in Figures 7 and 15, are pre-stored in the memory units 24, 224, and 324 of electronic devices 20, 220, and 320 (or other nearby devices), and how the electronic devices 20, 220, and 320 (or other nearby devices) perform the various processes necessary to output the content. However, it is also possible to store this information in an external device located remotely (for example, a server), have that external device perform the various processes necessary to output the content, and have the electronic devices 20, 220, and 320 (or other nearby devices) only acquire information related to coffee extraction and output the content.

[0175] Alternatively, for example, a system could partner with a specific service provider (e.g., a company that provides specific content or discount coupons) to output the target image. For instance, a system could receive a specific image transition (e.g., an image pattern (shown in Figure 12(1))) from a specific service provider, and if this matches, the system could output information provided by the specific service provider (e.g., discount coupons, specific content) from the electronic device. An example of this display is shown in Figure 45.

[0176] Alternatively, users can register information to be output, and the system can determine which information to output from the registered information through a decision process. For example, the user can register (remember) the information to be output on the day they brewed coffee using the coffee maker (e.g., Santa) in association with their activity history for that day (e.g., went to an amusement park, took an English exam, etc.). Then, later, when the user brews coffee using the coffee maker, if the information determined to be output is the same as the registered information to be output (e.g., Santa), the system will output that information (e.g., Santa) and the information related to their activity history for that day (e.g., went to an amusement park, took an English exam, etc.). This allows the user to enjoy the taste of coffee while recalling what they did on days when they brewed coffee with the same pattern in the past. It also allows the user to enjoy coffee while feeling the same emotions as on days when they brewed coffee with the same pattern in the past, and reflecting on various things.

[0177] Alternatively, artificial intelligence (AI) can be used to determine the content to be output. For example, machine learning can be used to generate judgment information based on the pattern of brewing coffee using a coffee maker (e.g., the pattern of changes on the surface of the coffee) and the user's mood and physical condition on that day (e.g., determined by search and movement history on a smartphone, etc.), and this generated judgment information can be used to determine the content to be output. For example, content showing a smile could be output when the user is in a good mood, and content that cheers them up could be output when they are in a bad mood. In this way, content can be output using some feature quantity related to the surface of coffee brewed when the user is in a good mood and the surface of coffee brewed when the user is in a bad mood, and the user's mood at that time can be estimated.

[0178] [Fifth Embodiment: An Example of Aggregating Information from Multiple Coffee Makers] In the first to fourth embodiments, examples were shown of outputting audio and image information using information acquired by a single coffee brewer (information related to coffee brewing). In recent years, coffee brewers have become widespread in homes around the world. And in each home, coffee is brewed according to each family's preferences. Therefore, it is thought that if information about the coffee brewed in each home can be collected and some kind of information can be provided to each home based on this information, the enjoyment of brewing coffee can be enhanced. Similarly, it is thought that if information about coffee brewed outside the home, such as in the workplace or school, can be collected and some kind of information can be provided to the relevant parties based on this information, the enjoyment of brewing coffee can be enhanced. Therefore, in the fifth embodiment, an example is shown of aggregating and using information from multiple coffee brewers.

[0179] [Example of a communication system configuration] Figure 25 is a diagram showing an example of the system function configuration of the communication system 400 in the fifth embodiment.

[0180] The communication system 400 includes a server 410, a network 420, and electronic devices 431, 441, 442, 451, and 452. While base stations and access points for wireless communication may also be considered as components of the communication system 400, their illustrations and descriptions are omitted here.

[0181] Server 410 is an information processing device that aggregates and manages information transmitted from electronic devices 431, 441, and 451, and uses the managed information to provide various types of information to electronic devices 431, 441, 442, 451, and 452.

[0182] Network 420 refers to networks such as public telephone networks and the Internet.

[0183] Electronic device 431 is attached to coffee brewer 430, electronic device 441 is attached to coffee brewer 440, and electronic device 451 is attached to coffee brewer 450. Electronic device 442 communicates wirelessly with electronic device 441, and electronic device 452 communicates wirelessly with electronic device 451.

[0184] Furthermore, electronic device 431 has a communication unit (corresponding to the communication unit 325 shown in Figure 19) and can connect to the network 420 using wireless communication to exchange information. Also, electronic devices 441 and 451 each have a communication unit (corresponding to the communication unit 325 shown in Figure 19) and can exchange information with other devices (electronic devices 442 and 452) using wireless communication. And electronic devices 441 and 451 each can connect to the network 420 via other devices (electronic devices 442 and 452) using wireless communication to exchange information.

[0185] [Example of electronic device functional configuration] Figure 26 is a block diagram showing an example of the functional configuration of the electronic device 431 in the fifth embodiment. Note that the functional configurations of the electronic devices 441 and 451 shown in Figure 25 are substantially the same as those of electronic device 431, except that they do not have a user interface, and therefore their explanation is omitted here. Similarly, the functional configurations of the electronic devices 442 and 452 shown in Figure 25 are substantially the same as those of electronic device 431, and therefore their explanation is omitted here.

[0186] The electronic device 431 includes a lens 481, an image acquisition unit 482, a control unit 483, a storage unit 484, an audio output unit 485, a user interface 488 (input unit 486, display unit 487), and a communication unit 489. Each part of the electronic device 431 corresponds to the parts with the same names in the electronic device 20 shown in Figure 4, the electronic device 220 shown in Figure 14, and the electronic device 320 shown in Figure 19. Therefore, this explanation will focus on the differences between the electronic device 431 and the electronic device 20 shown in Figure 4, the electronic device 220 shown in Figure 14, and the electronic device 320 shown in Figure 19. The communication unit 489 in the electronic device 431 can perform wireless communication with electronic devices within a predetermined range, and can also connect to a predetermined network (e.g., the Internet) via a base station installed by a telecommunications carrier such as a mobile phone company to communicate.

[0187] The location information setting unit 490 sets location information relating to the location where the electronic device 431 is located and outputs the set location information to the control unit 483. The location information setting unit 490 stores, for example, location information relating to the location where the coffee maker 430 to which the electronic device 431 is attached is installed (for example, latitude and longitude, region name (country, administrative division)). For example, location information relating to the location where the coffee maker 430 is installed is acquired by user operation or by a location information acquisition unit (for example, a built-in GPS receiver).

[0188] [Example of server functional configuration] Figure 27 is a block diagram showing an example of the functional configuration of the server 410 in the fifth embodiment.

[0189] The server 410 includes a communication unit 411, a control unit 412, and a storage unit 413.

[0190] The communication unit 411, based on the control of the control unit 412, exchanges various types of information with other devices via wired or wireless lines. For example, the communication unit 411 exchanges various types of information with electronic devices 431, 441, 442, 451, and 452 via the network 420.

[0191] The control unit 412 controls each part of the server 410 based on the control program stored in the memory unit 413. The control unit 412 is implemented, for example, by a CPU (Central Processing Unit).

[0192] The storage unit 413 is a memory that stores various types of information. For example, the storage unit 413 stores various types of information (e.g., control programs) necessary for the server 410 to perform various processes. The storage unit 413 also stores management information for managing the information acquired by the communication unit 411 via the network 420 (information transmitted from electronic devices 431, 441, and 451). Furthermore, the storage unit 413 stores content to be provided to each electronic device (electronic devices 431, 441, and 451) connected via the network 420.

[0193] [Example of management information structure] Figure 28 shows an example of management information stored in the storage unit 413 in the fifth embodiment. Figure 28(1) shows an example of management information to be managed by the server 410. Figure 28(2) shows an example of content provided from the server 410 to each electronic device.

[0194] The management information shown in Figure 28(1) consists of terminal identification information 461, reception time 462, reception information 463, judgment result information 464, and provided content information 465. This information (terminal identification information 461, reception time 462, reception information 463) is transmitted from each electronic device connected to the server 410 and sequentially stored in the storage unit 413 by the control unit 412.

[0195] Terminal identification information 461 is identification information (e.g., device-specific ID (identification), MAC (Media Access Control) address) used to identify each electronic device. For example, terminal identification information 461 is identification information used to identify the electronic device to which content will be sent. In Figure 28, for the sake of simplicity, terminal identification information is represented by a simplified combination of letters and numbers.

[0196] The reception time 462 is information about the time when information was received from each electronic device connected to the server 410. The management information shown in Figure 28(1) sequentially stores each piece of information received during a predetermined time period (for example, one day based on a specific location on Earth).

[0197] The received information 463 is information transmitted from each electronic device connected to the server 410. This received information is, for example, information transmitted from each electronic device based on a predetermined rule. For example, if a determination process is performed using the determination information shown in Figure 6 as the predetermined rule, then a portion of the information shown within the dashed rectangle 51 in Figure 9(2) (for example, the information to be output OI(OIX1)) is transmitted. In this case, the information to be output OI(OIX1) is stored as the received information 463. Other information (for example, the information shown in Figure 9(1) (the letters A, A, D, E, F, E, I, F and their order)) may also be transmitted and stored in the received information 463.

[0198] The determination result information 464 stores the result determined by the control unit 412 based on the information stored in the received information 463. For example, the control unit 412 of the server 410 (shown in Figure 27) determines identification information (e.g., a serial number) to be assigned to each electronic device based on the information stored in the received information 463. For example, the control unit 412 can convert the information stored in the received information 463 (received information of each electronic device) into comparable numerical values ​​(for example, numerical values ​​(1, 2, 3, ...) in the order of the output target information OI shown in Figure 6(2) (OI1, OI2, OI3, ...)) based on a predetermined rule, and determine identification information (e.g., a serial number) to be assigned to each electronic device based on a comparison of these numerical values.

[0199] Alternatively, identification information (e.g., a serial number) to be assigned to each electronic device may be determined based on other rules. For example, the control unit 412 can determine identification information (e.g., a serial number) to be assigned to each electronic device based on the information stored in the reception time 462 and reception information 463. For example, the control unit 412 can determine a value to multiply the numerical value specified by the reception information 463 based on the reception time 462 (for example, 1, 2, 3, ... in order of earliest reception time), and then determine identification information (e.g., a serial number) to be assigned to each electronic device based on the results of these calculations. Furthermore, for example, the control unit 412 can perform calculations on the information stored at the reception time 462 based on a predetermined rule (for example, in the case of 20171204 07:56, simply adding the digits together to get "35"), and determine identification information (e.g., a serial number) to be assigned to each electronic device based on the calculation result (e.g., multiplication, addition, subtraction, division) between this calculation result and the number specified by the reception information 463. In this way, a rule is set that allows identification information (e.g., a serial number) to be assigned to each electronic device, and the identification information (e.g., a serial number) to be assigned to each electronic device is determined based on this rule. Thus, the identification information (e.g., a serial number) assigned to each electronic device does not indicate superiority of the electronic device (or its user, or the coffee brewed by that user), but rather represents identification information for assigning content.

[0200] The provided content information 465 is information for identifying content determined based on the information stored in the judgment result information 464. If the number of electronic devices to be managed is the same as the number of content items that can be provided to those devices, or if the number of content items that can be provided to those devices is greater than the number of electronic devices to be managed, then there is a one-to-one correspondence between the values ​​in the judgment result information 464 and the information in the provided content information 465. However, if the number of content items that can be provided to those electronic devices is less than the number of electronic devices to be managed, then one piece of information in the provided content information 465 will correspond to multiple values ​​in the judgment result information 464. In other words, the same content may be provided to multiple electronic devices. The provided content information 465 corresponds to the provided content information 471 shown in Figure 28(2).

[0201] The content management information shown in Figure 28(2) consists of provided content information 471 and content 472.

[0202] Content 472 is content provided to the electronic device that transmitted the information to be stored in the received information 463. The content can be, for example, content consisting only of audio, content consisting of audio and images, content consisting of audio and video, content related to smell, taste, touch, etc. Also, as shown in Figure 28(2), the content can be each of the characters A, B, C, ..., XYZ of an anime that has multiple types of characters. In this case, each character may be provided in a way that prevents duplicate provision so that the same character is not provided to different electronic devices, or some characters may be provided in a way that prevents duplicate provision so that the same character is provided to some electronic devices.

[0203] Furthermore, the content may include information about at least one movie from among multiple types of movie information (e.g., movie promotional videos, brochures). Furthermore, the content may include information about at least one music from among multiple types of music (e.g., singer videos, concert videos). Furthermore, the content may include information about at least one travel destination (e.g., Kusatsu Onsen, Ikaho Onsen) from among multiple types of travel destination information (places, landmarks, transportation, discount coupons, etc.). Furthermore, the content may include at least one of multiple discount coupons, vouchers, or discount coupons usable on the internet. Furthermore, the content may include information about at least one store from among multiple store discount coupons, vouchers, or discount coupons. Furthermore, the content may include information about point programs at at least one store from among multiple store point programs. Furthermore, the content may include information about fortune-telling (e.g., today's coffee fortune-telling). Thus, the content can be information about one or more of the following: anime characters, animals (e.g., animals appearing in a movie, an amusement park at the travel destination), people (e.g., characters in a movie, celebrities at the travel destination), plants (e.g., local specialties at the travel destination, flowers of interest), local features (e.g., maps of the travel destination, buildings at the travel destination, tourist attractions at the travel destination), music, etc. Furthermore, the content may be provided using, for example, AR (Augmented Reality). For example, each piece of content can be overlaid and displayed on an image (photograph) generated by an electronic device's camera (e.g., a smartphone camera). These pieces of content may also be output targets in the first to fourth embodiments.

[0204] [Examples of information storage for each electronic device and examples of content provided for each electronic device] Figure 29 shows an example of information storage for electronic devices 431, 441, and 451 in the fifth embodiment, and an example of content provided to electronic devices 431, 441, and 451. Note that Figure 29(1) corresponds to Figure 28(1), and Figure 29(2) corresponds to Figure 28(2).

[0205] In the memory example shown in Figure 29(1), terminal identification information 461 "EX0431" indicates the terminal identification information of electronic device 431, terminal identification information 461 "EX0441" indicates the terminal identification information of electronic device 441, and terminal identification information 461 "EX0451" indicates the terminal identification information of electronic device 451. Furthermore, each piece of information shown in Figure 29 will be explained with reference to Figures 30 to 32.

[0206] [Example of communication when server 410 acquires information from electronic device 431] Figure 30 is a flowchart showing an example of communication processing by the electronic device 431 and the server 410 in the fifth embodiment. Steps S151 to S155 shown in Figure 30 correspond to steps S121 to S125 shown in Figure 22. Therefore, this explanation will focus on the differences from the example shown in Figure 22. Furthermore, it is assumed that the electronic device 431 is pre-configured with a program for accessing the server 410 and performing various communications with the server 410. In other words, it is assumed that the electronic device 431 is pre-configured with applications (programs) for realizing each of the processes shown in Figure 30.

[0207] As described above, steps S151 to S155 correspond to steps S121 to S125 shown in Figure 22.

[0208] The control unit 483 of the electronic device 431 (shown in Figure 26) determines the information to be output (for example, the information to be output OI (OIX1) shown in Figure 9(2)) (step S156). Next, the communication unit 489 (shown in Figure 26) transmits the determined information to the server 410 based on the control of the control unit 483 (step S157).

[0209] The communication unit 411 of the server 410 receives information transmitted from the electronic device 431 (step S158). Next, the control unit 412 of the server 410 stores the received information in the storage unit 413 (step S159). For example, as shown in Figure 29(1), the received information (OIX1 (shown as "X1" in Figure 29(1))) is stored as received information 463, associated with the terminal identification information 461 "EX0431". Also, as shown in Figure 29(1), information regarding the time when that information (OIX1) was received from the electronic device 431 is stored as received time 462, associated with the terminal identification information 461 "EX0431".

[0210] As shown in Figure 25, information regarding the electronic device 441 is transmitted from the electronic device 441 to the server 410 via the electronic device 442. In this case, the electronic device 442 transmits terminal identification information related to the electronic device 441 to the server 410 along with the information (Y3) transmitted by the electronic device 441. Then, as shown in Figure 29(1), the information (Y3) transmitted by the electronic device 441 is stored as received information 463 in association with the terminal identification information 461 "EX0441", and information regarding the time when that information (Y3) was received from the electronic device 441 is stored as received time 462.

[0211] Furthermore, as shown in Figure 25, information regarding the electronic device 451 is transmitted from the electronic device 451 to the server 410 via the electronic device 452. In this case, the electronic device 452 transmits terminal identification information regarding the electronic device 451 to the server 410 along with the information (Z7) transmitted by the electronic device 451. Then, as shown in Figure 29(1), the information (Z7) transmitted by the electronic device 451 is stored as received information 463 in association with the terminal identification information 461 "EX0451", and information regarding the time when that information (Z7) was received from the electronic device 451 is stored as received time 462.

[0212] Furthermore, since information regarding electronic device 441 is transmitted to server 410 via electronic device 442, terminal identification information 461 may record terminal identification information for electronic device 442 instead of "EX0441". Alternatively, terminal identification information for both electronic device 441 and electronic device 442 (identification information for both electronic device 441 and electronic device 442, or information indicating that electronic device 442 has transferred information for electronic device 441) may be recorded instead of "EX0441". The same applies to information regarding electronic device 451.

[0213] [Example of communication when server 410 provides content to electronic device 431] Figure 31 is a flowchart showing an example of communication processing by the electronic device 431 and the server 410 in the fifth embodiment. The server 410 transmits information to the electronic device 431 based on terminal identification information 461 (shown in Figure 29(1)).

[0214] First, the control unit 412 of the server 410 determines whether or not the transmission conditions are met (step S161). If the transmission conditions are not met, it waits until the transmission conditions are met (step S161).

[0215] Here, the transmission conditions can be set as follows: for example, if content is provided on a daily basis, the condition could be that it is 12:00 PM (midnight) at a specific location in the world. For example, if server 410 is located in Japan, the transmission condition can be determined to be met when it is 12:00 PM (midnight) Japan time. Also, if content is provided only within a limited area, the condition could be that it is the end of the activity time in that area (for example, 9:00 PM). However, it is assumed that some users may want to see the character related to coffee immediately after brewing it. Therefore, even when providing content on a daily basis, the transmission condition can be determined to be met at smaller intervals (for example, every minute, every 10 minutes, every hour) and the content can be provided accordingly. This way, a user who brews coffee in the morning can see the character that same morning.

[0216] If the transmission conditions are met (step S161), the control unit 412 of the server 410 determines the content to be provided to each electronic device based on the information stored in the management information (step S162). Specifically, the control unit 412 of the server 410 determines the identification information (e.g., a serial number) to be assigned to each electronic device based on the information stored in the reception information 463, and stores the result in the determination result information 464. Then, the control unit 412 of the server 410 determines the content to be provided to each electronic device based on the information stored in the determination result information 464, and stores the information to identify that content in the provided content information 465.

[0217] For example, if it is determined that the transmission conditions are met at short intervals (e.g., every minute, every 10 minutes, every hour), then identification information (e.g., a serial number) is assigned in order to each electronic device that transmitted information during that period. For example, consider a case where it is determined that the transmission conditions are met at 10-minute intervals. In this case, suppose that 3 electronic devices transmitted information in the first 10 minutes, 5 electronic devices transmitted information in the next 10 minutes, and 4 electronic devices transmitted information in the following 10 minutes. In this case, identification information (e.g., a serial number) 1 to 3 is assigned to each electronic device that transmitted information in the first 10 minutes, identification information (e.g., a serial number) 4 to 8 is assigned to each electronic device that transmitted information in the next 10 minutes, and identification information (e.g., a serial number) 9 to 12 is assigned to each electronic device that transmitted information in the following 10 minutes.

[0218] Next, the communication unit 411 of the server 410 transmits content corresponding to the information stored in the provided content information 465 to each electronic device based on the control of the control unit 412 (step S163). For example, as shown in Figure 29, content corresponding to the information "CT67" stored in the provided content information 465 (content related to "character ABC") is transmitted to electronic device 431. Also, content corresponding to the information "CT217" stored in the provided content information 465 (content related to "character EFG") is transmitted to electronic device 442 (electronic device 441). Furthermore, content corresponding to the information "CT347" stored in the provided content information 465 (content related to "character HIJK") is transmitted to electronic device 452 (electronic device 451).

[0219] The communication unit 489 of the electronic device 431 receives content transmitted from the server 410 (step S164). Next, the control unit 483 of the electronic device 431 stores the received content in the storage unit 484 (step S165). Next, the control unit 483 of the electronic device 431 outputs the received content (step S166). An example of this output is shown in Figure 32.

[0220] [Example of server 410 providing content to electronic devices 431, 442, 443, and 452] Figure 32 shows an example in which the server 410 provides content to electronic devices 431, 442, 443, and 452 in the fifth embodiment.

[0221] Server 410 transmits content to each electronic device based on the management information shown in Figure 29(1). For example, as shown in Figure 29(1), based on the provided content information 465 "CT67" associated with the terminal identification information 461 "EX0431", Server 410 transmits content related to "Character ABC" to electronic device 431. Also, based on the provided content information 465 "CT217" associated with the terminal identification information 461 "EX0441", Server 410 transmits content related to "Character EFG" to electronic device 441 (or electronic device 442). Also, based on the provided content information 465 "CT347" associated with the terminal identification information 461 "EX0441", Server 410 transmits content related to "Character HIJK" to electronic device 451 (or electronic device 452).

[0222] Electronic devices that receive content perform output related to the received content. For example, as shown in Figure 32, electronic device 431, which receives content related to "character ABC," displays an image related to "character ABC" on the user interface 488 (display unit 487) (shown in Figure 26). Electronic device 431 also outputs audio related to "character ABC" from the audio output unit 485 (shown in Figure 26). Electronic device 442, which receives content related to "character EFG," transmits that content to electronic device 443 (equipped with a display unit), and displays an image related to "character EFG" on the display unit of electronic device 443. Electronic device 442 also outputs audio related to "character EFG" from its audio output unit. Electronic device 452, which receives content related to "character HIJK," displays an image related to "character HIJK" on its display unit. Electronic device 452 also outputs audio related to "character HIJK" from its audio output unit.

[0223] [Example of sending acquired information to a server] Figure 33 is a flowchart showing an example of the transmission process by the electronic device 431 in the fifth embodiment. Steps S171 to S177 shown in Figure 33 correspond to steps S151 to S157 shown in Figure 30. Therefore, this explanation will focus on the differences from the example shown in Figure 30.

[0224] First, the control unit 483 of the electronic device 431 determines whether or not a start instruction has been detected (step S171). If a start instruction is detected (step S171), the process proceeds to step S172. If no start instruction is detected (step S171), monitoring continues.

[0225] [Example of operation that outputs content provided by the server] Figure 34 is a flowchart showing an example of content output processing by the electronic device 431 in the fifth embodiment. Steps S181 to S183 shown in Figure 34 correspond to steps S164 to S166 shown in Figure 31. Therefore, this explanation will focus on the differences from the example shown in Figure 31.

[0226] First, the control unit 483 of the electronic device 431 determines whether or not it has received content from the server 410 (step S181). If it has received content from the server 410 (step S181), it proceeds to step S182. If it has not received content from the server 410 (step S181), it continues monitoring.

[0227] [Example of providing content to each electronic device] Figure 35 is a flowchart showing an example of content provision processing by the server 410 in the fifth embodiment. Steps S193 to S197 shown in Figure 35 correspond to steps S158, S159, and S161 to S163 shown in Figures 30 and 31. Therefore, this explanation will focus on the differences from the examples shown in Figures 30 and 31.

[0228] First, the control unit 412 of the server 410 determines whether the start condition is met (step S191). If the start condition is met (step S191), the process proceeds to step S192. If the start condition is not met (step S191), the process proceeds to step S193.

[0229] Here, the start condition can be, for example, if content is provided on a daily basis, it can be set as 0:00 AM at a certain location in the world. For example, if server 410 is located in Japan, the start condition can be determined to be met when it becomes 0:00 AM Japan time. Alternatively, if content is provided only within a limited area, the condition can be set as the start of the activity time in that area (for example, 4:00 AM).

[0230] When the start condition is satisfied (step S191), the control unit 412 of the server 410 erases the content of the management information in the storage unit 413 (step S192). Thereby, new content (characters) can be provided to each electronic device based on new information.

[0231] Next, the control unit 412 of the server 410 determines whether it has received information from the electronic device (for example, information to be an output target determined by the determination process (for example, information OI (OIX1) to be an output target shown in FIG. 9(2))) (step S193). If information has been received from the electronic device (step S193), the process proceeds to step S194. If information has not been received from the electronic device (step S193), monitoring continues.

[0232] If information has been received from the electronic device (step S193), the control unit 412 of the server 410 stores the received information in the storage unit 413 in association with the electronic device that transmitted the information (step S194).

[0233] Next, the control unit 412 of the server 410 determines whether the transmission condition is satisfied (step S195). If the transmission condition is not satisfied, the process returns to step S193.

[0234] If the transmission condition is satisfied (step S195), the control unit 412 of the server 410 determines the content to be provided to each electronic device based on each information stored in the management information (step S196).

[0235] Next, the communication unit 411 of the server 410 transmits the content corresponding to the information stored in the provided content information 465 to each electronic device based on the control of the control unit 412 (step S197).

[0236] [Operation example when the server performs each process] The above examples illustrate how an electronic device attached to a coffee brewer performs a decision process to determine the information to be output, and transmits the information determined by this decision process to a server 410. However, as shown in the fourth embodiment, it is also possible to have the electronic device attached to the coffee brewer perform only relatively simple processing, while other processing is performed by the server 410, which has higher processing capabilities. Therefore, Figure 36 shows an example in which the electronic device attached to the coffee brewer only acquires and transmits image information of the surface of the coffee accumulating in the container, while other processing is performed by the server 410.

[0237] [Example of communication when performing a series of processes using multiple electronic devices] Figure 36 is a flowchart showing an example of communication processing by the server 410 and electronic device 431 in the fifth embodiment. Steps S501 to S504 shown in Figure 36 correspond to steps S131 and S133 to S135 shown in Figure 24. Also, steps S515 and S516 shown in Figure 36 correspond to steps S161 and S162 shown in Figure 31. Therefore, this explanation will focus on the differences from the examples shown in Figures 24 and 31.

[0238] When the control unit 483 of the electronic device 431 detects a start instruction (step S501), it acquires the image acquired by the image acquisition unit 482 (an image of the coffee accumulating in the container (including image data)) (step S502), and transmits the acquired image information to the server 410 (step S503). In this case, the transmission of image information from the electronic device 431 to the server 410 may be performed periodically or irregularly.

[0239] Step S504 shown in Figure 36 corresponds to step S135 shown in Figure 24.

[0240] When the control unit 412 of the server 410 receives image information from the electronic device 431 (step S511), it analyzes the received image information and obtains feature quantities (step S512). Next, the control unit 412 of the server 410 stores the obtained feature quantities in the storage unit 413, associating them with the electronic device 431 (step S513). In this way, until the termination condition is met, the received image information is analyzed, and the feature quantities obtained through this analysis (for example, each piece of information shown in Figure 9(1), each piece of information shown in Figure 16(1)) are sequentially stored in the storage unit 413, associating them with the electronic device 431 (steps S511 to S514). For example, each process shown in the first to fourth embodiments (for example, each process in steps S102 to S105 shown in Figure 11, each process in steps S112 to S115 shown in Figure 18, each process in steps S123 to S126 shown in Figure 22, each process in steps S143 to S146 shown in Figure 24, each step in steps S153 to S156 shown in Figure 30, and each step in steps S173 to S176 shown in Figure 33) is performed, and the processing results (feature quantities) are associated with elapsed time and stored in the storage unit 413 in association with the electronic device 431 (for example, each piece of information shown in Figure 9(1) and each piece of information shown in Figure 16(1)).

[0241] Furthermore, if the transmission conditions are met (step S515), the control unit 412 of the server 410 determines the content to be provided to each electronic device based on the information stored in the management information (step S516).

[0242] Next, the communication unit 411 of the server 410 sends a notification to the electronic device 431 that content is available, based on the control of the control unit 412 (step S517). For example, notification means such as email, SNS (Social Networking Service), or notification on the internet can be used. In step S517, all or part of the content may also be sent (for example, attached to an email, sent via SNS, or sent over the internet).

[0243] Furthermore, when the communication unit 489 of the electronic device 431 receives a notification from the server 410, it notifies the user of that fact (step S505). For example, the notification can be made by outputting an audio message, displaying an audio message, vibrating, lighting or flashing a lamp, etc. Upon seeing this notification, the user can access the server 410 by operating the electronic device 431 (or another electronic device), connect the electronic device 431 (or another electronic device) and the server 410, and receive content from the server 410 (steps S518, S506). As a result, the control unit 483 of the electronic device 431 can output audio from the audio output unit 485 based on the provided content, and display an image on the user interface 488 (display unit 487) based on the provided content (step S506). For example, as shown in Figure 32, audio is output from the audio output unit and an image is displayed on the user interface.

[0244] Furthermore, in the example shown in Figure 36, it is conceivable that not all image information from the electronic device 431 may be received due to some reason (e.g., lens fogging, interruption of wireless communication). It is also conceivable that information with different extraction times may be transmitted from multiple electronic devices. Moreover, it is conceivable that image information transmitted from multiple electronic devices may not be transmitted according to a unified rule.

[0245] For example, it is conceivable that image information relating to 5 images is transmitted from electronic device 431, image information relating to 3 images is transmitted from electronic device 441, and image information relating to 1 image is transmitted from electronic device 451. In such a case, the control unit 412 of server 410 analyzes the image information received from electronic devices 431, 441, and 451 to obtain comparable information based on the features of each image. For example, when using the judgment information shown in Figures 6(1) and 6(2), the control unit 412 of server 410 analyzes the image information received from electronic devices 431, 441, and 451 to obtain feature quantities (A to I) based on each image. Then, the control unit 412 of server 410 calculates a comparable numerical value based on the obtained feature quantities (A to I) and the number of images received. For example, suppose the features based on five images received from electronic device 431 are A, A, B, C, A in order of reception; the features based on three images received from electronic device 441 are A, C, D in order of reception; and the feature based on one image received from electronic device 451 is G. In this case, a multiplier (5~1) is determined based on the maximum number of received images (5), and this is multiplied by each feature to calculate a comparable value. Specifically, features A to I are quantified, and features A, A, B, C, A related to electronic device 431 are converted to 1, 1, 2, 3, 1; features A, C, D related to electronic device 441 are converted to 1, 3, 4; and feature G related to electronic device 451 is converted to 7. Then, the multiplier (5~1) is applied in order of reception and the values ​​are added together to calculate a comparable value. Specifically, for electronic device 431, 22 (=1×5+1×4+2×3+3×2+1×1) is calculated; for electronic device 441, 29 (=1×5+3×4+4×3) is calculated; and for electronic device 451, 35 (=7×5) is calculated. In this case, 22 (electronic device 431) < 29 (electronic device 441) < 35 (electronic device 451), so the identification numbers (sequential numbers) are determined in this order. That is, 1 is assigned to electronic device 431, 2 to electronic device 441, and 3 to electronic device 451. It is also conceivable that the calculated values, which are comparable numerical values, may be the same for multiple electronic devices. In this case, for example, the identification numbers (sequential numbers) can be determined based on the reception time.For example, electronic devices can be numbered sequentially, starting with those that received the data earliest.

[0246] In this way, even when image information transmitted from multiple electronic devices is not transmitted according to a unified rule, identification information (e.g., a serial number) can be determined to be assigned to each electronic device, and content can be provided to each electronic device. This makes it possible to provide content to users, for example, who take a picture of the surface of coffee in a coffee shop with an electronic device (e.g., a smartphone) and send that image to the server 410. In other words, users who drink coffee brewed using a coffee maker at home or in the workplace, users who drink coffee brewed using instant coffee, and users who drink coffee brewed by someone else in a coffee shop can all participate in a service that provides at least one piece of content from among multiple pieces of content and enjoy the provided content. Thus, in the fifth embodiment, content can be determined and provided by comparing relative information.

[0247] Furthermore, it is conceivable that image information transmitted from multiple electronic devices may be identical (or have the same pattern) or similar (approximate) (or similar (approximate) patterns). In such cases, each electronic device that transmitted identical (or identical pattern) or similar (approximate) (or similar (approximate) patterns) image information may be given some kind of benefit or privilege in addition to the content determined by the processes described above. For example, if the control unit 412 of the server 410 provides content on a daily basis, it can determine, based on the information stored in the management information, whether or not there are electronic devices that transmitted identical (or identical pattern) or similar (or similar pattern) image information at 12 p.m. (24:00) at the reference point. If there are electronic devices that transmitted identical (or identical pattern) or similar (or similar pattern) image information, the control unit 412 of the server 410 may provide each of those electronic devices with other content (for example, a special character, a main character from an anime, or a specific service) in addition to the determined content. This means that users who receive regular content will have an even greater enjoyment by receiving other content (such as some kind of perks or benefits) in addition to that content.

[0248] In the example shown in Figure 36, the server 410 performs a series of processes based on image information from the electronic device 431. However, some of the processes performed by the server 410 may be performed by other devices (one or more devices). In this case, an information processing system composed of multiple devices will perform each of the processes shown in Figure 36 (each of the processes performed by the server 410).

[0249] Thus, the server 410 (or multiple devices comprising it) is an example of an information processing device, information processing system, and communication system that, when coffee is produced by mixing a substance for producing coffee (e.g., coffee beans, ground coffee, instant coffee) with hot water and storing the coffee in containers, acquires information about the produced coffee (information obtained from the coffee) for each of the multiple containers of coffee, at the time of production, when the produced coffee is placed in the containers, or after the produced coffee has been placed in the containers, and determines content (e.g., information unrelated to the coffee) to be provided to each person associated with the multiple containers based on the acquired information.

[0250] Furthermore, server 410 (or multiple devices comprising it) is an example of an information processing device, information processing system, and communication system that acquires information about the extracted coffee when the extracted coffee is placed in a container, or after the extracted coffee has been placed in a container, for each of the multiple containers of coffee, and determines the content to be provided to each person associated with the multiple containers based on the acquired information.

[0251] Furthermore, the server 410 (or the multiple devices comprising it) can use feature quantities as information about the extracted coffee, for example, when the extracted coffee is placed in a container, or regarding changes in the surface of the extracted coffee in the container after it has been placed in the container (e.g., color, pattern, foam formation). Also, the server 410 (or the multiple devices comprising it) can determine the content to be assigned to each person associated with multiple containers by comparing the information obtained for each coffee placed in multiple containers.

[0252] [Examples using other sensors] Note that, in the above, mainly examples of acquiring various types of information (e.g., surface transitions) when generating coffee or after generating coffee using an image sensor have been shown. However, various types of information may also be acquired when generating coffee or after generating coffee using other sensors. Fig. 37 shows an example of attaching various sensors to a coffee extractor (electronic device).

[0253] Fig. 37 is a diagram showing an example of attachment of sensors attached to a coffee extractor or an electronic device in the first to fifth embodiments. Note that the coffee extractors 600, 610, 620, 630, 640 shown in Fig. 37(1) to (5) have stands 602, 612, 622, 632, 642, which are substantially the same as the coffee extractor 200 shown in Fig. 13. Also, the coffee extractor 650 shown in Fig. 37(6) does not have a stand, which is substantially the same as the coffee extractor 1 shown in Fig. 1. Further, the coffee extractors 600, 610, 620, 630, 640, 650 have drippers 601, 611, 621, 631, 641, 651 and containers 603, 613, 623, 633, 643, 652. Note that each of the sensors 604, 614, 624, 634, 644, 661 will be described in the following description of each sensor. Also, for the sensor 634 that enters the liquid (coffee) and the sensor 624 that may receive steam, it is preferable to perform waterproofing. Also, for sensors affected by the temperature of hot water, it is preferable to perform heat insulation treatment and heat resistance treatment.

[0254] For example, a temperature sensor capable of measuring temperature can be used. For example, a temperature sensor can be attached to a position where the temperature of the liquid (coffee) accumulated in the container in the coffee extractor can be measured, and the temperature transition from the start to the end of coffee extraction can be acquired by this temperature sensor. For example, a temperature sensor can be attached to the positions of each of the sensors 604, 614, 624, 634, 644 shown in Fig. 37(1) to (5). And based on the temperature transition, the content to be output can be determined.

[0255] Furthermore, for example, an odor sensor capable of measuring odors can be used. This odor sensor may be, for example, a sensor capable of detecting a specific odor, or a sensor capable of outputting some kind of information depending on the odor. For example, an odor sensor can be attached to a position in a coffee brewer where the odor of the liquid (coffee) accumulating in the container can be measured, and the transition of the odor from the start to the end of coffee brewing can be obtained using this odor sensor. The position where the odor sensor is attached can be, for example, inside the container or at the bottom of the dripper (so that it is inside the container). For example, an odor sensor can be attached to the positions of sensors 624 and 634 shown in Figures 37(3) and (4). Based on the transition of the odor, the content to be output can be determined. For example, the information on each odor acquired in time series can be quantified and calculated (for example, added, multiplied) to obtain comparable values, and the content to be output can be determined by comparing these values.

[0256] Furthermore, a sound sensor capable of measuring sound (e.g., a microphone) can be used. For example, a sound sensor can be attached to a position in a coffee brewer where it can measure the sound emitted from the liquid (coffee) accumulating in the container, and the transition of sound generated from the start to the end of coffee brewing can be obtained using this sound sensor. The sound sensor can be attached to various locations, such as inside the container, below the dripper (so that it is inside the container), or outside the container. For example, sound sensors can be attached to the positions 604, 614, 624, 634, and 644 shown in Figures 37(1) to (5). Based on the transition of sound, the content to be output can be determined. For example, the information on each sound acquired in time series can be quantified and calculated (e.g., added, multiplied) to obtain comparable values, and by comparing these values, the content to be output can be determined.

[0257] Furthermore, a weight sensor capable of measuring weight can be used. For example, a weight sensor can be attached to a location in a coffee brewer where the weight of the liquid (coffee) accumulating in the container can be measured (for example, at the bottom of the container), and the weight transition from the start to the end of coffee brewing can be obtained using this weight sensor. The location where the weight sensor is attached can be, for example, the bottom of the container. For example, a weight sensor can be attached to the position of sensor 644 shown in Figure 37(5). Based on the weight transition, the content to be output can be determined. For example, by calculating (for example, adding, multiplying) the numerical values ​​of each weight obtained in a time series to obtain comparable values, the content to be output can be determined by comparing these values.

[0258] Furthermore, for example, a taste sensor capable of measuring taste can be used. For instance, a taste sensor can be attached to a position in a coffee brewer where it can measure the taste of the liquid (coffee) that accumulates in the container, and this taste sensor can be used to acquire the transition of taste from the start to the end of coffee brewing. The taste sensor can be attached to, for example, the inside of the container or the bottom of the dripper (so that it is inside the container). For example, a taste sensor can be attached to the position of sensor 634 shown in Figure 37(4) (for example, a sensor attached to the opening of container 633 in a clip-type). Based on the transition of taste, the content to be output can be determined. For example, the information on each taste acquired in time series can be quantified and calculated (for example, added, multiplied) to obtain comparable values, and by comparing these values, the content to be output can be determined.

[0259] The sensors described above are merely examples, and other sensors that acquire different information may be used. Furthermore, any sensor capable of acquiring some kind of information (for example, whether the temperature is 75 degrees or higher, the presence or absence of a specific smell, the presence or absence of a specific sound, the presence or absence of a specific taste) can be used. In other words, sensors capable of acquiring comparable information for each extraction can also be used. In addition, as shown in Figure 37(6), a sensor 661 provided by an electronic device 660 installed outside the coffee extractor 650 may be used. For example, an electronic device 660 (e.g., a smartphone) can be installed outside the container 652 of the coffee extractor 650 so that image information about the liquid (coffee) accumulating in the container 652 can be acquired. Then, the sensor 661 (e.g., a camera) of the electronic device 660 can be used to acquire image information about the liquid (coffee) accumulating in the container 652 of the coffee extractor 650, and this image information can be used. In this case, the electronic device 660 functions as an electronic device (an electronic device attached to a coffee extractor) as shown in the first to fifth embodiments. Alternatively, a mounting section (for example, a smartphone mounting section) for mounting the electronic device 660 may be provided on the stand (mounting stand 653) on which the container 652 is installed, and the electronic device 660 may be attached to this mounting section. Alternatively, other sensors (for example, a vibration sensor, a microphone) of the electronic device 660 (for example, a smartphone) may be used to acquire various information (for example, vibrations generated by the falling liquid, sounds generated by the falling liquid) regarding the liquid (coffee) accumulating in the container 652 of the coffee extractor 650, and this information may be used. This makes it easy for anyone to install the electronic device 660 and enjoy the content output shown in the first to fifth embodiments.

[0260] [Example using multiple sensors] In addition, the above examples show how to acquire various information when coffee is being produced or after it has been produced using various sensors. However, it is also possible to acquire various information when coffee is being produced or after it has been produced using multiple sensors from among the various sensors. Figure 38 shows an example of attaching multiple sensors to an electronic device.

[0261] Figure 38 shows examples of sensor mounting for electronic devices 700, 710, 720, and 725 in the first to fifth embodiments. Note that the electronic devices 700, 710, 720, and 725 shown in Figures 38(1) to (4) are modified versions of the electronic device 20 shown in Figures 1 to 3. Furthermore, the electronic device 700 shown in Figure 38(1) has a modified shape of the gripping portion 27 of the electronic device 20. Furthermore, the electronic devices 710 and 720 shown in Figures 38(2) and (3) have a modified shape of the annular portion 28 of the electronic device 20. Furthermore, the electronic device 725 shown in Figure 38(4) omits the gripping portion 27 of the electronic device 20 and has a modified shape of the annular portion 28. Also, Figures 38(1) to (4) show bottom views of the electronic devices 700, 710, 720, and 725, similar to Figure 3(4).

[0262] The electronic device 700 shown in Figure 38(1) is the same as the electronic device 20 shown in Figure 3(4), but with four sensors 701 to 704 instead of the lens 21. Furthermore, a recess 705 (indentation) is provided in the gripping portion to make it easier for the user to hold the electronic device 700.

[0263] The electronic device 710 shown in Figure 38(2) is a U-shaped version of the annular portion 28 of the electronic device 20 shown in Figure 3(4), and is equipped with three sensors 711 to 713.

[0264] The electronic device 720 shown in Figure 38(3) is a rectangular version of the annular portion 28 of the electronic device 20 shown in Figure 3(4), and is equipped with four sensors 721 to 724.

[0265] The electronic device 725 shown in Figure 38(4) is an elliptical version of the annular portion 28 of the electronic device 20 shown in Figure 3(4), and is equipped with four sensors 726 to 729. Furthermore, the gripping portion 27 of the electronic device 20 is omitted. Note that the components that would normally be located on the gripping portion 27 of the electronic device 20 (for example, the operating portion 26 and the audio output portion 25) can be located on other parts (for example, the side, or the portion extending from the flange (for example, the portion indicated by reference numeral 706)).

[0266] Regarding the sensors 701-704 shown in Figure 38(1), multiple sensors of the same type may be provided, or all of them may be different sensors. For example, sensors 701-704 can be at least one of the sensors described above. Also, multiple sensors of the same type (e.g., image sensors) may be provided to improve the accuracy of the sensors. The same applies to sensors 711-713 shown in Figure 38(2), sensors 721-724 shown in Figure 38(3), and sensors 726-729 shown in Figure 38(4). Furthermore, the location of the sensors is not limited to the example shown in Figure 38, and they can be installed in a location where the sensors can perform to their full potential. In addition, for the electronic equipment attached to the coffee maker, the configuration of control units and other components other than the sensors may be omitted. In this case, the information from the sensors can be transmitted to other electronic equipment via a wired line or the like.

[0267] [Modified coffee brewing machine] Figures 39 and 40 show the external appearance of a modified version (coffee extractor 730) of the coffee extractor 1 in the first embodiment. Figure 39 shows a perspective view of the coffee extractor 1. Figure 40(1) shows a top view of the dripper 740 with the electronic equipment 750 attached to the flange portion 742, and Figure 40(2) shows a bottom view of the dripper 740 with the electronic equipment 750 attached to the flange portion 742. Note that in Figure 40(1), the housing portion 741 is omitted for the sake of clarity. Figure 40(3) shows a bottom view of the electronic equipment 750 removed from the flange portion 742, and Figure 40(4) shows a bottom view of the electronic equipment 750 removed from the flange portion 742.

[0268] The coffee brewer 730 comprises a dripper 740, electronic equipment 750, and a container 760. The dripper 740, electronic equipment 750, and container 760 correspond to the dripper 10, electronic equipment 20, and container 30 shown in Figures 1 to 3, respectively. Therefore, the following explanation will focus on the differences between the dripper 730 and the dripper 10, electronic equipment 20, and container 30.

[0269] The dripper 740 has a housing section 741 and a flange section 742, and is a coffee dripper used by being placed at the opening of the container 760. An electronic device 750 is attached to the flange section 742.

[0270] The electronic device 750 is an electronic device that is detachably attached to the flange portion 742 and includes an audio output unit 755, a lens 751, and a mounting portion 757. The electronic device 750 is mounted by sliding into a recess in the mounting portion 745 of the flange portion 742 (a recess corresponding to the shape of the protrusion of the mounting portion 757). Alternatively, the electronic device 750 can be realized by housing each component (for example, the parts shown in Figure 4) in a housing (case) made of heat-resistant glass, ceramics, metal, resin, wood, etc.

[0271] The mounting portion 757 is a part for attaching to a notch (mounting portion 745) provided in a part of the flange portion 742. The mounting portion 757 is a convex portion corresponding to the shape of the recess in the mounting portion 745, and is formed to fit into the recess of the mounting portion 745. Alternatively, contrary to the example shown in Figure 40, the mounting portion 757 may be made into a recess, and the mounting portion 745 of the flange portion 742 may be made into a convex portion (a convex portion corresponding to the shape of the recess in the mounting portion 757), and the mounting portion 757 may be formed to fit into the convex portion of the mounting portion 745. In this example, a part of the flange portion 742 is made into a notch (mounting portion 745), and an example of attaching the electronic device 750 to the mounting portion 745 is shown, but other mounting methods may be used.

[0272] For example, when attaching the electronic device 750 to the flange portion 742, the protrusion of the mounting portion 757 is aligned with the recess of the mounting portion 745 of the flange portion 742, and the electronic device 750 is pushed and slid in the direction of arrow 2 (Figure 40(3)). When removing the electronic device 750 from the flange portion 742, the electronic device 750 is slid outwards from the flange portion 742 (in the direction of arrow 3 (Figure 40(3))). Note that a locking member for securing the electronic device 750 to the flange portion 742 may be provided on at least one of the mounting portion 745 of the flange portion 742 and the mounting portion 757 of the electronic device 750.

[0273] In this way, by using a sliding mounting system for the electronic device 750, installation and removal of the electronic device 750 are made easy.

[0274] Furthermore, the lens 751 of the electronic device 750 is positioned on the lower surface of the flange portion 742. In addition, when the dripper 740 is set in the container 760, the optical axis of the lens 751 is positioned so that it faces the surface of the coffee extract that accumulates in the container 760.

[0275] Furthermore, it is preferable to apply heat insulation and waterproofing treatments to each component built into the electronic device 750. It is also preferable to apply an anti-fog treatment to the lens 751.

[0276] Thus, various methods can be used for attaching electronic devices to a coffee brewer.

[0277] [Example of obtaining and using other information about the liquid (coffee)] The above examples illustrate how to acquire and use information about the liquid (coffee) that accumulates in the container of a coffee brewer. However, other information about the liquid (coffee) may also be acquired and used. For example, when liquid (hot water) is poured into a dripper containing coffee grounds, the coffee grounds and liquid (hot water) in the dripper's container will change depending on how the water is poured. For example, the transition will differ depending on whether the coffee beans are finely ground or coarsely ground (for example, a depression may form in the middle or a mound may form). Also, the transition may differ depending on the speed at which the liquid (hot water) is poured (for example, the container may be filled with hot water, or hot water may only be present in the depressions of the grounds). For example, depending on how the water is poured and the degree of grinding, the coffee grounds in the dripper's container may be filled with liquid (hot water), and then bubbles may form. For example, depending on the degree of grinding, the coffee grounds in the dripper's container may swell or become flat. Therefore, when brewing coffee, or after brewing coffee, various sensors may be used to acquire various information about the coffee grounds and liquid (hot water) in the dripper's storage compartment. For example, as shown in Figure 37(3), an image sensor (image sensor, imaging element) can be installed above the dripper's storage compartment to acquire and use image information about the coffee grounds and liquid (hot water) in the dripper's storage compartment.

[0278] Furthermore, other information related to the liquid (coffee) may be acquired and used, for example, information regarding the grinding of coffee beans using a coffee mill (a machine for grinding coffee beans). For example, information regarding the sounds emitted when grinding coffee beans with a coffee mill may be acquired and used. Alternatively, information acquired regarding the coffee mill may be combined with information acquired by the coffee brewer.

[0279] [Examples of using time and location information along with information about a liquid (coffee)] The above examples illustrate how to acquire various types of information about a liquid (coffee) and use this information to determine the content to be provided. An example was also shown where the content to be provided is determined based on image information and time information related to the liquid (coffee). However, if an electronic device can use location information (for example, if the electronic device is equipped with a location information acquisition unit 358 as shown in Figure 21 or a location information acquisition unit 490 as shown in Figure 26), that location information can be used. For example, an electronic device (an electronic device attached to a coffee maker, or an electronic device that transfers information from an electronic device attached to a coffee maker) can transmit location information about itself (e.g., latitude and longitude, information to identify the region) along with information about the liquid (coffee) to the server 410. In this case, the control unit 412 of the server 410 can determine the content to be provided based on information about the liquid (coffee) (e.g., image information, sound information, etc.) and location information. For example, multiple content items can be classified into multiple groups (e.g., the number of countries to which the content is provided), and the groups assigned to each country can be changed sequentially each day. For example, each electronic device in a country A is provided with content selected from the content belonging to the group assigned to country A on that day.

[0280] Furthermore, the control unit 412 of the server 410 may determine the content to be provided based on location information and time information, along with information about the liquid (coffee). For example, the control unit 412 of the server 410 can quantify the information about the liquid (coffee), as well as the location information and time information, and calculate comparable values ​​by performing calculations (e.g., basic arithmetic operations) on each of these values ​​to determine the content to be provided. Location information may be assigned numerical values ​​on a country-by-country basis, for example, 1 for country A, 2 for country B, etc., or it may be assigned numerical values ​​on a regional basis within a country (e.g., prefecture). Alternatively, numerical values ​​may be calculated by performing calculations on latitude and longitude (e.g., basic arithmetic operations (e.g., simple addition of each value)).

[0281] [Examples of obtaining and using information about beverages other than coffee] The above examples illustrate how to output content using information obtained about extracted coffee when it is placed in a container, or after it has been placed in a container. Specifically, examples were shown where content is output using information obtained when ground beans are steeped in liquid until the liquid becomes flavorful. However, the first to fifth embodiments can also be applied to beverages other than coffee. For example, content can be output using information obtained when a substance other than coffee beans is steeped in liquid until the liquid becomes flavorful. For example, the first to fifth embodiments can also be applied to various beverages such as black tea, Japanese tea (e.g., green tea, roasted green tea, brown rice tea, sencha, bancha, gyokuro), Chinese tea (e.g., Eucommia tea, oolong tea), herbal tea, medicinal tea, cocoa, and hot chocolate. For example, when brewing tea using a teapot (e.g., a teapot), content can be output using information acquired about the hot water (tea) poured over the tea leaves when the hot water is poured into the teapot, or after the hot water has been poured into the teapot. In this case, at least one of the sensors described above can be attached to or near the teapot to acquire the information described above. The server 410 can also maintain management information for each type (category) of beverage, perform the processing described above for each type (category) of beverage, and provide content for each type (category) of beverage. In this case, for example, the same content may be provided to an electronic device that transmits information about coffee and an electronic device that transmits information about black tea. The server 410 can also perform the processing described above for electronic devices that transmit information about beverages, regardless of the type (category) of beverage, and provide content. In this case, for example, the same judgment processing, decision processing, etc. can be performed for each electronic device that transmits information about different beverages, and different content can be provided.

[0282] [Sixth Embodiment: Example of acquiring and outputting information about beverages] The above examples illustrate how to output content using information obtained about the extracted beverage when it is placed in a container, or after it has been placed in a container. However, it is also possible to output the information obtained about the extracted beverage itself (or information that has undergone some processing (e.g., audio amplification)) when it is placed in a container, or after it has been placed in a container. Therefore, the sixth embodiment shows an example in which the information obtained about the extracted beverage itself is output when it is placed in a container, or after it has been placed in a container.

[0283] As mentioned above, conventional technology allows for the preparation of beverages according to individual preferences using various devices. However, preparing beverages using these devices takes a certain amount of time. Therefore, it is believed that if various information could be acquired at the time of preparation (extraction) using these devices and provided to the person preparing the beverage, the enjoyment of preparing beverages would increase. Thus, the sixth embodiment aims to provide the enjoyment of preparing beverages.

[0284] Figure 41 is a simplified diagram showing an example of outputting information acquired by the electronic device 700 in the sixth embodiment. The electronic device 700 corresponds to the electronic device 700 shown in Figure 38(1). However, the electronic device 700 is assumed to include a communication unit (corresponding to the communication unit 325 shown in Figure 19).

[0285] Figure 41(1) shows an example of outputting information acquired by the electronic device 700 from the electronic device 700. As shown in Figure 38(1), the electronic device 700 is equipped with four sensors 701 to 704. The four sensors 701 to 704 are, for example, a sound sensor, an image sensor, a temperature sensor, and an odor sensor.

[0286] For example, the control unit of the electronic device 700 can output information acquired by each of the sensors 701 to 704 from the electronic device 700. For example, if the electronic device 700 is equipped with an audio output unit, as shown in Figure 41(1), it can amplify and output the sound generated during coffee extraction, which is acquired by the sound sensor. This allows user P1, who is brewing coffee using the coffee extractor 760, to brew coffee while listening to the sounds generated during the brewing process (for example, the amplified sound of coffee droplets falling into the container). Furthermore, after brewing the coffee, user P1 can enjoy content based on the features acquired during the extraction process while savoring the coffee.

[0287] Furthermore, if the electronic device 700 is equipped with a display unit, an image of the coffee brewing process (the surface of the coffee in the container) acquired by the image sensor can be displayed on the display unit. This allows user P1, who is brewing coffee using the coffee brewer 760, to brew coffee while observing the transitions (the transitions of the coffee surface in the container) during the brewing process. After brewing the coffee, user P1 can enjoy the coffee while savoring content based on the features acquired during the brewing process.

[0288] Furthermore, if the electronic device 700 includes an audio output unit and a display unit, it can amplify and output the sound generated during coffee extraction, acquired by the sound sensor, and display an image of the coffee extraction process (the surface of the coffee in the container), acquired by the image sensor, on the display unit. It may also display and output the temperature value acquired by the temperature sensor during coffee extraction, and display and output information about the smell acquired by the smell sensor during coffee extraction. This allows user P1, who is brewing coffee using the coffee brewer 760, to enjoy the coffee extraction process even more. The same output can also be provided when other sensors are used.

[0289] Figure 41(2) shows an example of outputting information acquired by electronic device 700 from another electronic device (electronic device 350). The example shown in Figure 41(2) is the same as the example shown in Figure 41(1), except that the information acquired by electronic device 700 is output from another electronic device (electronic device 350).

[0290] Figure 41(3) shows an example of outputting information acquired by electronic device 700 from another electronic device (electronic device 360). Note that the example shown in Figure 41(3) is the same as the example shown in Figure 41(1), except that the information acquired by electronic device 700 is output from another electronic device (electronic device 360).

[0291] The above examples illustrate how to perform predetermined processing (e.g., sound amplification, display image (video) generation) on information acquired by one or more sensors during coffee brewing and output it. However, it is also possible to perform predetermined processing (e.g., sound amplification, display image (video) generation) on information acquired by multiple sensors during coffee brewing and output it as a single piece of information. For example, the information acquired by each sensor and musical scales such as Do-Re-Mi-Fa-So-La-Ti-Do may be quantified (e.g., 0, 1, 2, ...), predetermined calculation processing may be applied to the information acquired by each sensor, and the values ​​calculated based on the calculation results may be sequentially applied to the numerical values ​​of the musical scale and output as sound. For example, the image information acquired by the image sensor is quantified as the percentage of black in a circular image (e.g., 0, 1, 2, ...), the sound information acquired by the sound sensor is quantified as the loudness of the sound (e.g., 0, 1, 2, ...), the temperature information acquired by the temperature sensor is converted into a numerical value of temperature (or other numerical value) (e.g., 0, 1, 2, ...), and the odor information acquired by the odor sensor is quantified as the intensity of the odor (e.g., 0, 1, 2, ...). Next, a predetermined operation (e.g., arithmetic operation) is performed on each of the numerical values ​​calculated for each of these sensors to calculate a numerical value for conversion to a musical scale. Then, based on the calculated numerical value (musical scale), sound is output. Similarly, image output can be performed based on a value calculated by applying a predetermined arithmetic process to the information acquired by each sensor. Note that these audio and image outputs can also be understood as examples of outputting content based on information acquired by each sensor, similar to the first to fifth embodiments. Furthermore, these processes may be performed by other devices, and the output may be generated by those other devices. For example, as shown in Figures 41(2)(3), information regarding coffee extraction acquired by multiple sensors may be sequentially transmitted to electronic devices 350 and 360, causing the electronic devices 350 and 360 to perform each process and output the information.Furthermore, as shown in the fifth embodiment, information regarding coffee extraction acquired by multiple sensors may be sequentially transmitted to the server 410 via the network 420, the server 410 may perform each process, and the output information based on that process may be sequentially received from the server 410 and output on the device itself (or another device).

[0292] [Seventh Embodiment: An example of acquiring and using information about beverages containing other food items] The above examples illustrate how to output content using information obtained about beverages. In these cases, other foods are often added to the generated beverages. For example, milk, sugar, etc., are often added to coffee and tea according to individual preferences. Furthermore, when other foods are added to a beverage in this way, the information about that beverage (e.g., surface, smell) often changes. An example of this is shown in Figure 42. Note that the seventh embodiment is a modified version of some of the first to sixth embodiments, and some of the explanations of parts common to the first to sixth embodiments are omitted.

[0293] [Example of surface changes in coffee after milk has been poured over it] Figure 42 shows an example of the transition of an image (an image of the surface of coffee in a coffee cup when milk is poured into it) that can be acquired by the electronic device in the seventh embodiment. In Figure 42, an example is shown where the surface of the coffee in the coffee cup is viewed from above. Also, in Figure 42, for the sake of ease of explanation, the surface of the coffee in the coffee cup is shown as a circle and simplified, and the surface of the coffee and milk are also shown in a simplified manner.

[0294] Figure 42(1) shows the case where milk 801 is poured into coffee 800 in a coffee cup. For example, it shows an example where the user stirs (rotates) the coffee 800 in the coffee cup with a spoon or the like and pours milk 801 into a portion of the coffee 800.

[0295] As shown in Figure 42(2), when milk 801 is poured while coffee 800 is rotating in the coffee cup, the milk 801 flows along the flow of coffee 800 in the coffee cup. Then, as shown in Figures 42(3) to (6), the milk 801 expands on the surface of coffee 800. In addition, as the milk 801 expands in the coffee 800, the coffee 800 and milk 801 mix together, and the color of the surface of coffee 800 changes from black to whitish.

[0296] As shown in Figures 42(1) to 42(6), when milk 801 is poured into coffee 800 in a coffee cup, various colors and patterns are formed on the surface of the coffee 800 in the coffee cup, such as the color of the coffee (dark) and the color of the milk (whitish). The colors and patterns formed in this way often differ depending on the person pouring the milk and the environment in which the milk is poured. Furthermore, it is assumed that the colors and patterns formed in this way are unlikely to be identical or nearly identical even if the same person pours the milk in the same environment. Therefore, in the seventh embodiment, an example is shown in which various information is provided using the colors and patterns formed when milk 801 is poured into coffee 800 in a coffee cup.

[0297] [Example of judgment information] Figure 43 shows an example of various types of information used when determining the information to be output by an electronic device in the seventh embodiment.

[0298] Figure 43(1) shows an example of an image pattern relating to the surface of coffee when milk is poured into a coffee cup. As shown in Figure 43(1), the image pattern that is expected to occur on the surface of coffee when milk is poured into a coffee cup is stored as judgment information in the memory of the electronic device. Note that in Figure 43(1), the image pattern is shown in a simplified manner for ease of explanation. The number of image patterns N (where N is a positive integer) may be increased or decreased according to the memory capacity of the memory of the electronic device. Note that the image pattern shown in Figure 43(1) corresponds to the image pattern shown in Figure 12(1).

[0299] Figure 43(2) shows an example of judgment information (table) used when determining the information to be output based on the information obtained using the judgment information (image patterns PPA1~PPAN) shown in Figure 43(1). The judgment information shown in Figure 43(2) shows the correspondence between the transition of information related to coffee (for example, the surface of coffee when milk is poured into coffee in a coffee cup) and the information to be output OI. Note that the judgment information shown in Figure 43(2) corresponds to the judgment information shown in Figure 12(2).

[0300] [Example of the external configuration of installed equipment] Figure 44 is a side view showing an example of the external configuration of the installation equipment 830 on which the electronic device 810 in the seventh embodiment is installed. The electronic device 810 is an electronic device or information processing device such as a smartphone or tablet terminal. The image acquisition unit 811 is a camera (for example, a camera capable of acquiring video and still images) provided in the electronic device 810. The display unit 812 is a user interface (for example, a touch panel that allows operation input along with display) provided in the electronic device 810.

[0301] The installation device 830 is a device for acquiring information about the surface of the coffee in the coffee cup 820 by placing the coffee cup 820 at the bottom and the electronic device 810 on top of it. In other words, the installation device 830 is a support stand for supporting the electronic device 810, and can be formed from a flat plate-shaped member in a U-shape when viewed from the side. Also, for example, the top of the installation device 830 (the part where the electronic device 810 is installed) is provided with a hole that is larger than the diameter of the lens of the image acquisition unit 811 of the electronic device 810 and smaller than the housing of the electronic device 810 (for example, circular). A transparent member (for example, glass) may be provided in this hole for waterproofing, etc. The user then installs the electronic device 810 so that the lens of the image acquisition unit 811 of the electronic device 810 faces the surface of the coffee in the coffee cup 820 through this hole. The user can install the electronic device 810 while looking at the display unit 812 of the electronic device 810, for example.

[0302] Furthermore, the installation device 830 may be equipped with a milk refiller 831. The milk refiller 831 comprises a milk storage section 832, an operating member 833, and a milk supply section 834. The milk storage section 832 contains milk to be poured into the coffee in the coffee cup 820 installed on the installation device 830. The operating member 833 is an adjustment valve for adjusting the amount of milk supplied from the milk storage section 832 to the milk supply section 834 through a pipe. The milk supply section 834 is a spout that supplies the milk supplied from the milk storage section 832 through the pipe to the coffee in the coffee cup 820 installed on the installation device 830. It is preferable that the milk supply section 834 be movable relative to the coffee cup 820 installed on the installation device 830. The user can then place the coffee cup 820 containing the coffee on the installation device 830 and pour the desired amount of milk into the coffee in the coffee cup 820 by operating the operating member 833. In this case, the way the milk spreads across the surface of the coffee in the coffee cup 820 will differ depending on the position of the coffee cup 820 placed on the installation device 830 (or the position of the spout of the milk supply unit 834) and the amount of milk poured from the milk replenisher 831 (determined by the user's operation of the control member 833). In other words, by adjusting the position of the coffee cup 820 placed on the installation device 830 (or the position of the spout of the milk supply unit 834) and the amount of milk poured from the milk replenisher 831 (determined by the user's operation of the control member 833), the user can enjoy the changing patterns of the milk spreading across the surface of the coffee in the coffee cup 820. For example, the installation device 830 can be made of heat-resistant glass, ceramics, metal, resin, wood, etc.

[0303] For example, the control unit of the electronic device 810 determines a circular region in the image acquired from the image acquisition unit 811 (a circular region corresponding to the surface of the coffee (liquid) in the coffee cup 820). Next, the control unit of the electronic device 810 compares the image contained in the determined circular region with each image pattern PPA1 to PPAN in the judgment information shown in Figure 43(1), and extracts the image pattern with the highest degree of similarity as a feature.

[0304] For example, each pixel in each image pattern PPA1 to PPAN represents a binary value (black or white). The control unit of the electronic device 810 determines each pixel in the image contained within the determined circular region to be either a black region or a white region (for example, binarization). Next, the control unit of the electronic device 810 compares each pixel (black or white) in the image contained within the determined circular region with each pixel (black or white) in each image pattern PPA1 to PPAN, comparing corresponding pixels (pixels at the same position in the circular region) and calculating the number of matching pixels for each image pattern PPA1 to PPAN. Next, the control unit of the electronic device 810 extracts the image pattern PPA1 to PPAN with the largest number of matching pixels as the image pattern with the highest degree of similarity.

[0305] Next, the control unit of the electronic device 810 stores the extracted image patterns PPA1 to PPAN in the memory unit of the electronic device 810, associating them with the elapsed time. For example, the control unit of the electronic device 810 stores the feature quantities (image patterns PPA1 to PPAN) determined for each image acquired at time intervals t1 to t8 in the memory unit of the electronic device 810, associating them with time intervals t1 to t8.

[0306] Next, the control unit of the electronic device 810 determines the information to be output from the audio output unit based on the acquired feature quantities. For example, the control unit of the electronic device 810 extracts feature quantities that match the acquired feature quantities (for example, information relating time t1 to t8 to image patterns PPA1 to PPAN) from the determination information (table) shown in Figure 43(2). Next, the control unit of the electronic device 810 determines the information (information to be output) OI corresponding to the extracted feature quantities, and determines the audio information stored in the memory unit of the electronic device 810 in relation to the determined information (information to be output OI).

[0307] Thus, to acquire information about the surface of coffee when milk is poured into a coffee cup, an electronic device 810 (for example, a smartphone, tablet, or other device) equipped with an image acquisition unit 811 can be used. For example, the user can use the electronic device 810 at the timing of pouring the milk (before pouring, at the moment of pouring, or after pouring) to acquire information about the surface of the coffee with the milk poured in. In Figure 44, an example is shown in which image information is acquired with the electronic device 810 fixed using the mounting device 830, but the user may also acquire the image information while holding the electronic device 810 in their hand.

[0308] Furthermore, while the above examples show the use of the judgment information shown in Figure 43, other judgment information (for example, the judgment information shown in the first to sixth embodiments) may also be used. Also, while the above examples show the electronic device 810 that acquired the image information outputting content, as shown in the third and fourth embodiments, the content may also be output from other devices. Also, as shown in the fifth embodiment, information from multiple electronic devices may be aggregated and content may be output from each device based on the aggregation result. Also, as shown in the sixth embodiment, the information acquired regarding the beverage itself may be output. Also, while the above examples show the acquisition and use of image information regarding a beverage containing other food (for example, milk), information regarding a beverage containing other food (for example, sound, temperature, smell) may also be acquired and used using other sensors (for example, sound sensor, temperature sensor, smell sensor) as described above. Furthermore, two or more of these sensors, or two or more types of sensors, may also be used.

[0309] [Eighth Embodiment: An example of outputting specific content or discount coupons from an electronic device] As described above, it is possible to partner with a specific service provider (for example, a company that provides specific content or discount coupons) to output target images. For example, by receiving a specific image transition (for example, an image pattern (shown in Figures 12(1) and 43(1))) from a specific service provider, if it matches, the information provided by the specific service provider (for example, a discount coupon, specific content) can be output from the electronic device. Therefore, Figure 45 shows an example of such output. Note that the eighth embodiment is an example that modifies a part of the first to seventh embodiments, and some of the explanations of parts common to the first to seventh embodiments will be omitted.

[0310] Figure 45 is a simplified diagram showing an example of outputting content from the electronic device 840 in the eighth embodiment. The electronic device 840 is an electronic device or information processing device such as a smartphone or tablet terminal. The electronic device 840 may acquire and use information related to beverages (e.g., image information) using sensors built into the device, or it may use information acquired by other devices.

[0311] When deciding whether or not to enter a restaurant, people often consider their own preferences, budget, and the restaurant's menu. Similarly, after entering a restaurant, people often consider their own preferences, budget, and the restaurant's menu when deciding what to order. Therefore, to suit each user's preferences, content may be provided in multiple stages, as shown in Figure 45.

[0312] Figure 45(1) shows an example of when the electronic device 840 outputs a discount coupon (content (display screen and audio information)) related to store A.

[0313] As shown in Figure 45(1), the control unit of the electronic device 840 outputs the voice message "Welcome. Your special offer for today is ready." from the voice output unit 841 based on voice information (not shown) determined based on information about the beverage. The control unit of the electronic device 840 also displays the text "Welcome. Your special offer for today is ready." along with a "Special Offer Output" button 851 and a "Back" button 852 on the display unit 850 based on image information (not shown) determined based on information about the beverage.

[0314] As shown in Figure 45(1), the user can be notified that a special offer (content) can be output using audio and image information. When the user understands this notification and presses the "Output Special Offer" button 851, the display screen shown in Figure 45(2) is displayed. If the "Back" button 852 is pressed, the user returns to the previous screen. For example, the user can return to the waiting screen or the screen for performing the special offer decision process again.

[0315] Figure 45(2) shows an example of the content (display screen and audio information) that is output after the "Priority Output" button 851 is pressed on the display screen shown in Figure 45(1).

[0316] As shown in Figure 45(2), the control unit of the electronic device 850 outputs the voice message "Welcome. Today, the whitebait rice bowl is half price." from the voice output unit 841 based on voice information determined based on the information about the beverage. The control unit of the electronic device 850 also displays the text "Welcome. Today, the whitebait rice bowl is half price." along with an image related to store A, a menu for store A (an image showing whitebait), a "More Discounts" button 853, and an "End" button 854 on the display unit 850, based on image information determined based on the information about the beverage.

[0317] After the content shown in Figure 45(2) is output, if the user presses the "More Special Offers" button 853, the display screen shown in Figure 45(3) will be displayed. If the "End" button 854 is pressed, the content output process will end and the display screen will return to normal.

[0318] Figure 45(3) shows an example of the content (display screen and audio information) that is output after the "More Special Offers" button 853 is pressed on the display screen shown in Figure 45(2).

[0319] As shown in Figure 45(3), the control unit of the electronic device 850 outputs the voice message "This is a discount coupon for store A's specialty" from the voice output unit 841 based on voice information determined based on information about the beverage. The control unit of the electronic device 840 also displays the text "This is a discount coupon for store A's specialty," along with the "30% off pickled celery" button 855, the "30% off shrimp curry" button 856, the "Save" button 857, and the "Exit" button 858 on the display unit 850 based on image information determined based on information about the beverage. The "30% off pickled celery" button 855 is the button to initiate the operation to receive a discount (30% off) on the food and beverage "pickled celery" offered by store A. The "30% off shrimp curry" button 856 is the button to initiate the operation to receive a discount (30% off) on the food and beverage "shrimp curry" offered by store A.

[0320] For example, when at least one of the "30% off pickled celery" button 855 and the "30% off shrimp curry" button 856 is pressed, the pressed button becomes selected (for example, the button's color changes). Then, when the "Save" button 857 is pressed while the button is selected, the process of receiving a discount for the food or drink corresponding to the selected button is initiated. For example, an image showing a 30% discount on pickled celery or an image showing a 30% discount on shrimp curry is saved. The user can then go to store A and show the saved image to receive the respective discount. The buttons displayed after pressing the "More Discounts" button 853 (for example, the "30% off pickled celery" button 855 and the "30% off shrimp curry" button 856) may be related to the content displayed with the "More Discounts" button 853 (for example, content about whitebait rice bowls) (for example, ingredients to eat with whitebait rice bowls), or they may be unrelated to that content (for example, today's recommended items). Furthermore, information that displays buttons after pressing the "More Discounts" button 853 (for example, the "30% Off Pickled Celery" button 855, the "30% Off Shrimp Curry" button 856) is also stored as provided information.

[0321] In this way, when a user enters store A, they can receive content related to store A. In this case, the information provided may change depending on the coffee the user orders, allowing them to enjoy the unexpected output of the content.

[0322] Note that while Figure 45 shows an example of outputting content in three stages, the content may also be output in one or two stages, or in four or more stages. Furthermore, while Figure 45(3) explains the case where there are two buttons to select, the number of buttons to select is not limited to this; it may be one, three or more, or any number of buttons.

[0323] [Ninth Embodiment: Application to Games] Applying the technology described above, for example, it is conceivable to provide various information related to a game when playing a game. Therefore, the ninth embodiment shows an example of providing various information related to a game when playing a game. Note that the ninth embodiment is a modified version of some of the first to eighth embodiments, and some of the explanations of parts common to the first to eighth embodiments will be omitted.

[0324] [Example of providing information related to a character battle game displayed on an outdoor display device] Figure 46 is a simplified diagram showing an example of the configuration of the communication system 40 in the ninth embodiment. Figure 46 shows an example of wireless communication between electronic devices 900, 901-904 and a display device 910. Furthermore, the electronic devices 900, 901-904 are held by users P0-P4, and the display device 910 is shown as being permanently installed.

[0325] Electronic devices 900, 901-904 are electronic devices that can display characters on the display unit 911 of the display device 910 and control each character based on user operation. Examples of electronic devices 900, 901-904 are smartphones, tablet devices, and game devices.

[0326] Furthermore, Character A is a character controlled by electronic device 900, Character B is a character controlled by electronic device 901, Character C is a character controlled by electronic device 902, and Character D is a character controlled by electronic device 903. Note that the character controlled by electronic device 904 is not yet displayed on the display unit 911 of the display device 910.

[0327] The display device 910 is a display device (information processing device, electronic device) comprising a communication unit (not shown) capable of wireless communication, a control unit (not shown) that controls each unit, and a display unit 911. For example, the control unit (not shown) of the display device 910 controls the display of the display unit 911 based on information transmitted from electronic devices 900, 901 to 904. Specifically, the control unit (not shown) of the display device 910 causes the display unit 911 to display character A based on information transmitted from electronic device 900, the display unit 911 to display character B based on information transmitted from electronic device 901, the display unit 911 to display character C based on information transmitted from electronic device 902, and the display unit 911 to display character D based on information transmitted from electronic device 903. Furthermore, the control unit (not shown) of the display device 910 controls the operation of character A on the display unit 911 based on information transmitted from the electronic device 900, controls the operation of character B on the display unit 911 based on information transmitted from the electronic device 901, controls the operation of character C on the display unit 911 based on information transmitted from the electronic device 902, and controls the operation of character D on the display unit 911 based on information transmitted from the electronic device 903.

[0328] Furthermore, the control unit (not shown) of the display device 910 adds various information to characters A to D on the display unit 911 and displays them based on information transmitted from electronic devices 900, 901 to 903. For example, the control unit (not shown) of the display device 910 adds tool 71 to character A on the display unit 911 and displays it based on information transmitted from electronic device 900, adds tool 72 to character B on the display unit 911 and displays it based on information transmitted from electronic device 901, adds tool 73 to character C on the display unit 911 and displays it based on information transmitted from electronic device 902, and adds tool 74 to character D on the display unit 911 and displays it based on information transmitted from electronic device 903.

[0329] [Examples of information provided to characters in a fighting game] Figure 47 shows an example of the correspondence between the provided information OI, determined using the judgment information by the electronic devices 900, 901-904 in the ninth embodiment, and the provided information 921. The judgment information (table) used when determining the provided information can be any of the judgment information described above (Figures 6, 12, and 43). This information is stored in the memory unit of each electronic device.

[0330] Figure 47 shows an example where the provided information determines the tools each character uses, but other information (for example, experience points, attributes, etc., to be assigned to each character) may also be determined. Furthermore, multiple pieces of information may be provided.

[0331] For example, if OIXY1 is determined as the provided information OI, then item 71 (held by character A in Figure 46) will be provided. Also, if OIYY2 is determined as the provided information OI, then item 74 (held by character D in Figure 46) will be provided. Furthermore, if OIYZ1 is determined as the provided information OI, then item 72 (held by character B in Figure 46) will be provided. Furthermore, if OIZZ7 is determined as the provided information OI, then item 73 (held by character C in Figure 46) will be provided.

[0332] [Example of operation when a character displayed on a device acquires an item] Figure 48 shows an example of an operation to add a tool 75 to the character A displayed on the display unit 911 of the display device 910 using the electronic device 900 in the ninth embodiment.

[0333] Figure 48(1) shows an example of output when notification information is output to inform the user that a new tool can be acquired. The display unit 950 of the electronic device 900 displays that a new tool can be acquired, and the voice output unit 960 also outputs a voice message indicating that a new tool can be acquired. In addition, the display unit 950 of the electronic device 900 displays the operation button group 81 and the "Acquire" button 82.

[0334] The operation button group 81 consists of buttons (indicated by circles and triangles) used to control character A displayed on the display unit 911 of the display device 910. For example, by pressing a desired button from the operation button group 81, user P0 can cause character A displayed on the display unit 911 of the display device 910 to perform a predetermined action (e.g., move forward, move backward, attack, defend).

[0335] The "Acquire" button 82 is a button that appears when a new tool is available for acquisition. When user P0 presses the "Acquire" button 82, the display screen shown in Figure 48(2) is displayed on the display unit 950 of the electronic device 900.

[0336] Figure 48(2) shows an example of output when notification information is output to inform the user that a new tool has been acquired. The display unit 950 of the electronic device 900 displays a message indicating that a new tool has been acquired, along with an image of the newly acquired tool, and the voice output unit 960 outputs a voice message indicating that a new tool has been acquired. In addition, the display unit 950 of the electronic device 900 displays the operation button group 81 and the "Use" button 83.

[0337] The "Use" button 83 is displayed when a new item is acquired by pressing the "Acquire" button 82. The newly acquired item may be used immediately, or it may be used at a desired time (for example, when it is actually used in the game).

[0338] When user P0 presses the "Use" button 83, as shown in Figure 48(3), tool 75 is added to the display of character A on the display unit 911 of the display device 910. That is, the control unit of the electronic device 900 transmits information about the acquired provided information (tool 75) (information to display tool 75 on the display unit 911 of the display device 910 and make it available for use) to the display device 910 based on the operation of pressing the "Use" button 83. Then, the control unit of the display device 910 adds tool 75 to the display of character A on the display unit 911 based on the information received from the electronic device 900.

[0339] As shown in Figure 48(3), when item 75 is added to the display of character A on the display unit 911 of the display device 910, character A can possess items 71 and 75, giving it an advantage in battles against other characters. In this example, the character is shown being displayed on an external device (display device 910), but the same method can be applied to games played by users of each electronic device by displaying the character on the display unit of each electronic device.

[0340] [Example of providing information related to story games] Figure 49 is a simplified diagram showing an example of a story game displayed on the display unit 950 of the electronic device 900 in the ninth embodiment. Figure 49 shows an example in which a user displays a story game on the display unit 950 of the electronic device 900 and plays the story game.

[0341] Here, a narrative game is a game played using predetermined signs in order to achieve a predetermined objective. For example, in a narrative game, characters (predetermined signs) playing various roles progress towards a destination while experiencing various things (e.g., adventure, exploration, battle). Figure 49 illustrates this with an example of a game in which character X (shown in the lower part) progresses towards XX Castle (shown in the upper part) as their destination, experiencing various things (e.g., battles with other characters, progress through each path). Note that in Figure 49, for the sake of clarity, an example is shown where the entire narrative game is displayed on the display screen of the display unit 950 of the electronic device 900. However, the area of ​​the narrative game may be wider than the display screen of the display unit 950, or multiple screens (e.g., screens with a hierarchical structure) may be used to play the narrative game. Thus, narrative games can be called objective-achievement games, character progression games, adventure games, exploration games, etc.

[0342] The control unit of the electronic device 900 displays a story game on the display unit 950 based on a program (for example, a story game application) stored in the memory unit. The control unit of the electronic device 900 also controls various actions of character X based on user operations (for example, user operations on the operation unit, user operations based on user voice input, and operations based on changes in the posture of the electronic device 900).

[0343] Furthermore, the control unit of the electronic device 900 adds various information to the character X on the display unit 950 and displays it based on information related to the beverage. For example, the control unit of the electronic device 900 adds tools 933 and 934 (shown in Figure 51) to the character X on the display unit 950 and displays them based on multiple pieces of information related to the beverage.

[0344] [Examples of information to provide to characters in a story game] Figure 50 shows an example of the correspondence between the provided information OI determined by the electronic device 900 using the judgment information in the ninth embodiment and the provided information 941, 942, and 943. The judgment information (table) used when determining the provided information can be any of the judgment information described above (Figures 6, 12, and 43). Each of these pieces of information is stored in the memory unit of the electronic device 900.

[0345] Note that while Figure 50 shows an example of providing three or more pieces of information, it is also acceptable to provide only one or two pieces of information.

[0346] For example, if OIJK1 is selected as the provided information OI, the items provided will be "Tool (rectangular tool)", "House 108", and "Money 99". If OIGT3 is selected as the provided information OI, the items provided will be "Experience Points 89", "Tool (T-shaped tool)", and "Money 67". If OIMU9 is selected as the provided information OI, the items provided will be "Tool (sword-shaped tool)", "Money 678", and "Experience Points 2". If OIPO6 is selected as the provided information OI, the items provided will be "Tank 7", "Money 100", and "Tool (rod-shaped tool)".

[0347] For example, if the provided information is a tool, that tool is provided to character X, and character X can use that tool. Also, for example, if the provided information is experience points, calculations (e.g., addition) of the experience point values ​​are performed sequentially, and character X can perform various actions based on the experience points resulting from those calculations. Also, for example, if the provided information is money, calculations (e.g., addition) of the money values ​​are performed sequentially, and character X can perform various purchases, etc., based on the total amount based on those calculations. Also, for example, if the provided information is a car, house, tank, airplane, etc., calculations (e.g., addition) of the values ​​of those items are performed sequentially, and character X can use various vehicles, properties, etc., based on the total value of each item based on those calculations.

[0348] [Example of display of provided information] Figure 51 is a diagram showing an example of display when provided information is displayed on the display unit 950 of the electronic device 900 in the ninth embodiment. Figure 51 shows an example of displaying provided information acquired over a predetermined period on the screen of a story game on the display unit 950 of the electronic device 900.

[0349] The control unit of the electronic device 900 can output (e.g., audio output, image display, transmission to other devices) the provided information acquired during a predetermined period (e.g., the period since the last display of provided information) at a predetermined output timing (e.g., when a story game is started, when instructed by user operation, or when a predetermined time arrives). For example, the control unit of the electronic device 900 sequentially stores the provided information acquired during the predetermined period in the memory unit. Then, when the predetermined output timing arrives, the control unit of the electronic device 900 can display a list of the provided information acquired during the predetermined period in the provided information display area 932. For example, for experience points, money, houses, vehicles, etc., each item and its calculation result (e.g., total value) are displayed. Also, for tools, an image representing the tool is displayed.

[0350] [Example of providing information related to a game where you raise or raise a child] Figure 52 is a simplified diagram showing an example of the transitions in a fish-raising game displayed on the display unit 950 of the electronic device 900 in the ninth embodiment. In Figure 52, the transitions in the growth of a fish in a fish-raising game displayed on the display unit 950 of the electronic device 900 are shown in chronological order.

[0351] Here, "raising games" refer to games in which animals, plants, etc. are raised. For example, in raising games, characters (designated symbols) such as animals and plants grow by taking on various roles and experiencing various things (for example, adventure, exploration, battles). Figure 52 shows a game in which fish grow.

[0352] FIG. 52(1) shows an example in which a newly born fish (fry) is displayed in the raising game. FIG. 52(2) shows an example in which a somewhat grown fish is displayed in the raising game. FIG. 52(3) shows an example in which a greatly grown fish is displayed in the raising game. In FIG. 52, for ease of explanation, an example is shown in which the entire raising game is displayed on the display screen of the display unit 950 of the electronic device 900. However, the field of the raising game may be set to a region wider than the display screen of the display unit 950, or the raising game may be played using a plurality of screens (for example, screens having a hierarchical structure). Also, in FIG. 52, an example of a game for raising one fish is shown, but a plurality of fish may be raised, or a plurality of types of fish, different types of animals, plants, etc. may be raised. Also, displacement (for example, displacement from a fish to a cow) may occur during the raising. Thus, the raising game can be referred to as a breeding game, a watching game, a raising game, a pet game, etc.

[0353] The control unit of the electronic device 900 causes the display unit 950 to display the raising game based on a program (for example, an application for the raising game) stored in the storage unit. Also, the control unit of the electronic device 900 controls various operations for raising the fish based on a user operation (for example, a user operation at the operation unit, a user operation based on the user's voice input, an operation based on a change in the posture of the electronic device 900).

[0354] Also, the control unit of the electronic device 900 adds and displays various information to the fish on the display unit 950 based on information regarding the drink. For example, the control unit of the electronic device 900 adds and displays food and a foreign enemy to the fish on the display unit 950 based on a plurality of information regarding the drink.

[0355] [Examples of Information to be Provided to the Characters in the Raising Game] Figure 53 is a diagram showing an example of the correspondence between the provided information OI determined by the electronic device 900 using the judgment information in the ninth embodiment and the provided information 961, 962, and 963. The judgment information (table) used when determining the provided information can be any of the judgment information described above (Figures 6, 12, and 43). Each of these pieces of information is stored in the memory unit of the electronic device 900.

[0356] Note that while Figure 53 shows an example of providing three or more pieces of information, it is also acceptable to provide only one or two pieces of information.

[0357] For example, if OIHH1 is determined as the information to be provided OI, then the information to be provided will be "attacked by a shark," "caught," and "turned into a taiyaki." In this case, the user may select one or two of the three pieces of information to be provided through user operation, or the fish may experience all three pieces of information (for example, in the order of 1st to 3rd). For example, when providing the information to be "attacked by a shark," the shark is displayed on the display unit 950 along with the fish being raised, and the fish escaping from the shark is displayed sequentially. Also, for example, when providing the information to be "caught," the fish being caught by a person is displayed on the display unit 950, and the fish escaping from the fishing rod is displayed sequentially. Also, for example, when providing the information to be "turned into a taiyaki," the fish being turned into a taiyaki is displayed on the display unit 950, and the fish waking up from its dream of being a taiyaki is displayed sequentially.

[0358] Thus, in a game where you raise fish, images related to the information provided are displayed simultaneously or sequentially. Alternatively, in a game where you raise fish, audio information related to the information provided may be output simultaneously or sequentially.

[0359] For example, in a game where you raise fish, when a user performs an action to start the game, the eggs or juvenile fish of the target fish are displayed on the display unit 950. After that, the fish can be automatically raised until they grow large. For example, if a user brews coffee every day, the information provided is acquired sequentially according to the brewing. Then, when the user performs a display command operation for the game where you raise fish, the fish that have grown based on the acquired information provided are displayed on the display unit 950. Alternatively, after the user performs a display command operation for the game where you raise fish, the growth progression of the fish based on the acquired information provided may be displayed sequentially on the display unit 950. Furthermore, the fish may be grown based on user operations.

[0360] The control unit of the electronic device 900 can perform processing (for example, height increases, friends are made) based on the information provided during a predetermined period (for example, the period since the last display of the raising game) at a predetermined timing (for example, when a display instruction operation for the raising game is performed, or when a predetermined time arrives). For example, the control unit of the electronic device 900 sequentially stores the information provided during the predetermined period in the memory unit. Then, when a predetermined output timing arrives, the control unit of the electronic device 900 performs processing based on the information provided during the predetermined period.

[0361] [Example of providing information related to wandering games] Figure 54 is a simplified diagram showing an example of the transitions in the wandering game displayed on the display unit 950 of the electronic device 900 in the ninth embodiment. In Figure 54, the transitions in the wandering game displayed on the display unit 950 of the electronic device 900, in which the main character sheep travels around the world, are shown in chronological order.

[0362] Here, a wandering game is a game in which the user enjoys raising and moving animals, plants, etc. For example, in a wandering game, characters such as animals and plants (designated symbols) travel around the world, taking on various roles (e.g., travelers) and experiencing various things (e.g., taking commemorative photos at tourist spots, sightseeing at tourist spots). Figure 54 shows a game in which a sheep travels.

[0363] Figure 54(1) shows an example where the main character, a sheep, is displayed in a wandering game. Figures 54(2) and (3) show examples where the sheep is displayed after traveling to a predetermined location in a wandering game. In Figure 54, for the sake of clarity, an example is shown where the entire wandering game is displayed on the display screen of the display unit 950 of the electronic device 900. However, the field of the wandering game may be made to be a larger area than the display screen of the display unit 950, and the wandering game may be played using multiple screens (for example, screens with a hierarchical structure). Also, Figure 54 shows an example of a game in which one sheep wanders, but multiple sheep may be made to wander, and multiple types of animals, different species of animals, plants, etc. may be raised. Furthermore, the animal may be transformed during the wandering (for example, transformed from a sheep to a cow). Thus, a wandering game can be called an idle game or the like.

[0364] The control unit of the electronic device 900 displays the wandering game on the display unit 950 based on a program (for example, a wandering game application) stored in the memory unit. The control unit of the electronic device 900 also controls various actions to make the sheep wander based on user operations (for example, user operations on the operation unit, user operations based on user voice input, and operations based on changes in the posture of the electronic device 900).

[0365] Furthermore, the control unit of the electronic device 900 adds various information to the sheep on the display unit 950 based on information related to the beverage. For example, the control unit of the electronic device 900 adds information such as feed, travel preparations, food, souvenirs from the travel destination, and photographs from the travel destination to the sheep on the display unit 950 based on multiple pieces of information related to the beverage.

[0366] [Examples of information to provide to a character in a wandering game] Figure 55 is a diagram showing an example of the correspondence between the provided information OI determined by the electronic device 900 using the judgment information in the ninth embodiment and the provided information 971, 972, and 973. The judgment information (table) used when determining the provided information can be any of the judgment information described above (Figures 6, 12, and 43). Each of these pieces of information is stored in the memory unit of the electronic device 900.

[0367] Note that while Figure 55 shows an example of providing three or more pieces of information, it is also acceptable to provide only one or two pieces of information.

[0368] For example, if OIHK9 is determined as the information to be provided, then the information to be provided will be "acquire a camera," "acquire 10 kg of grass," and "have some of its wool shorn." In this case, the user may select one or two of the three pieces of information to be provided through user operation, or all three pieces of information to be provided (for example, in the order of 1st to 3rd) may be made to experience the sheep according to a predetermined rule (for example, 1st information → 2nd information → 3rd information). For example, when providing the information to the sheep "acquire a camera," the display unit 950 will show the sheep with the acquired camera around its neck. Then, when the sheep goes on a journey after this, it can be set to acquire a photograph taken with that camera and bring it back. Also, for example, when providing the information to the sheep "acquire 10 kg of grass," the display unit 950 will show the sheep eating the acquired grass at home. Then, the user may be given the option to use the remaining grass as a lunch for the journey. Furthermore, for example, if the information provided is "part of the wool is shorn," the display unit 950 will show someone shorn the sheep's wool, and from then until a predetermined time has elapsed, the sheep will be shown sequentially with some of its wool missing.

[0369] Thus, in a wandering game, images related to the provided information are displayed simultaneously or sequentially. Alternatively, audio information related to the provided information may be output simultaneously or sequentially in a wandering game.

[0370] For example, in the wandering game, when a user performs an action to start the game, the main character, a sheep, is displayed on the display unit 950. After that, based on various information attached to the sheep, the sheep can automatically embark on a wandering journey to various parts of the world. For example, if the user brews coffee every day, the information provided will be acquired sequentially according to the brewing. Then, when the user performs an operation to instruct the wandering game to be displayed, the display unit 950 will display the sheep in the area where it is wandering and the sheep that has returned home, based on the acquired information provided. Alternatively, after the user performs an operation to instruct the wandering game to be displayed, the display unit 950 may sequentially display historical information of the places the sheep has traveled to in the past (for example, commemorative photos taken at tourist spots) based on the acquired information provided. For example, when the "Travel History" button 981 shown in Figures 54(2)(3) is pressed, the display unit 950 will display historical information of the sheep's past travels (for example, places traveled to (e.g., tourist spot names, place names, country names), and the date and time of the travel). Furthermore, for example, if the “Travel Photos” button 982 shown in Figures 54(2)(3) is pressed, photographic information of places the sheep has traveled to in the past (for example, commemorative photos taken at the places it has traveled to) will be displayed on the display unit 950. Also, for example, if the “Souvenirs” button 983 shown in Figures 54(2)(3) is pressed, souvenir information of places the sheep has traveled to in the past (for example, images of local products, famous items, etc. from the places it has traveled to, and descriptions of the souvenirs) will be displayed on the display unit 950. Alternatively, the sheep may be made to travel based on user operations.

[0371] The control unit of the electronic device 900 can perform processing (for example, traveling to Gunma, traveling to Okinawa) based on the information provided during a predetermined period (for example, the period since the last display of the wandering game) at a predetermined timing (for example, when a display instruction operation for the wandering game is performed, or when a predetermined time arrives). For example, the control unit of the electronic device 900 sequentially stores the information provided during the predetermined period in the memory unit. Then, when a predetermined output timing arrives, the control unit of the electronic device 900 performs processing based on the information provided during the predetermined period.

[0372] [Example of game operation] Figure 56 is a flowchart illustrating an example of the information provision determination process by the electronic device 900 in the ninth embodiment. This example shows a case where information regarding beverages is stored in the memory unit of the electronic device 900 through the processes described above. For example, the electronic device 900 may acquire and store information regarding beverages (e.g., image information) using its own sensors, or it may acquire and store information (information regarding beverages (e.g., image information)) acquired by other devices.

[0373] First, the control unit of the electronic device 900 determines whether or not a user operation has been performed (step S1001). For example, if any of the operation buttons 81 shown in Figure 48(1) are pressed, it is determined that a user operation has been performed. If no user operation is performed, the process proceeds to step S223.

[0374] If a user operation is performed (step S1001), the control unit of the electronic device 900 performs processing based on that user operation (step S1002). For example, if any of the operation buttons 81 shown in Figure 48(1) are pressed, the control unit of the electronic device 900 transmits information to the display device 910 to cause character A to perform the action corresponding to the pressed button.

[0375] Next, the control unit of the electronic device 900 determines whether the supply conditions are met (step S1003). If the supply conditions are not met, the operation ends; if the supply conditions are met, the process proceeds to step S1004.

[0376] Here, as criteria for determining whether the provision conditions are met, for example, it is possible to use whether a predetermined time has elapsed, whether desired provision information (e.g., desired tools, desired experiences) can be determined as the provision target, whether a predetermined user operation (e.g., pressing operation of the "acquire" button 82 shown in FIG. 48(1)) has been performed, and whether new provision information (e.g., desired tools, desired experiences) can be acquired. Note that the predetermined time can be determined based on, for example, the elapsed time since the power of the electronic device 900 was turned on, or the elapsed time since the immediately preceding information (provision information) was provided after the power of the electronic device 900 was turned on. Also, the predetermined time may be a preset time, or may be set to a time according to the user's preference by a user operation.

[0377] When the provision conditions are met (step S1003), the control unit of the electronic device 900 determines the information to be provided as the provision target based on the information (information regarding beverages) held in the storage unit (step S1004).

[0378] Next, the control unit of the electronic device 900 stores the information determined as the provision target in the storage unit (step S1005). In this way, the provision information stored in the storage unit can be used, for example, based on a user operation. For example, by performing a pressing operation of the "use" button 83 shown in FIG. 48(2), the acquired tool can be used.

[0379] In this way, the control unit of the electronic device 900 can determine at least one content to be provided to the user from among a plurality of contents (e.g., a plurality of information given to characters in a battle game, a plurality of information given to characters in a story game, a plurality of information given to characters in a raising game, a plurality of information given to characters in a wandering game) based on the information regarding beverages.

[0380] Furthermore, the control unit of the electronic device 900 can select and execute at least one process from among several processes different from the process related to the beverage (e.g., extraction process) (e.g., a process to advance the game, a process to assign information to the game character) based on information about the beverage. Note that these games are just examples, and the same can be applied to other games.

[0381] Furthermore, as shown in the fifth embodiment, the server may aggregate information from multiple electronic devices and determine the information to be provided to each device based on the aggregation results.

[0382] [Tenth Embodiment: Application Examples to Other Food and Beverages] The above examples mainly show how to perform each process (e.g., content output, game processing) based on information obtained regarding beverages. However, it is also possible to perform each process (e.g., content output, game processing) based on information obtained regarding other food and beverages. Therefore, the following examples show how to perform each process (e.g., content output, game processing) based on information obtained regarding food and beverages. Note that the 10th embodiment is a modified version of some of the first to 9th embodiments, and some of the explanations of parts common to the first to 9th embodiments will be omitted.

[0383] For example, information about the ingredients inside a pot of food can be acquired and used. For example, image information about the ingredients inside the pot can be acquired sequentially, and various processes (e.g., content output, game processing) can be performed based on that image information (or the transition of that image information). For example, an electronic device equipped with an image acquisition unit (e.g., a smartphone or tablet) can be used to photograph the inside of a pot of food. In this case, the shooting range is the ingredients in the pot of food, and the shooting period can be determined according to the user's preference. In this case, for example, if the pot is round, the aforementioned judgment information (Figures 6, 12, and 43) can be used. Alternatively, other judgment information (e.g., judgment using various colors instead of white and black, judgment using the arrangement of each color) can be used to perform various processes (e.g., content output, game processing).

[0384] Furthermore, for example, information about multiple dishes arranged on a table (or dishes on the table being prepared) can be acquired and used. For example, image information about each dish can be acquired sequentially, and various processes (e.g., content output, game processing) can be performed based on that image information (or the transition of that image information). For example, an electronic device equipped with an image acquisition unit (e.g., a smartphone, tablet device) can be used to photograph multiple dishes arranged on a table (or dishes on the table being prepared). In this case, the shooting range can be a range preferred by the user, and the shooting period can be determined by the user's preference. In this case, for example, if the shooting range is a circular area, the judgment information described above (Figures 6, 12, and 43) can be used. Alternatively, other judgment information (e.g., judgment using various colors instead of white and black judgment, judgment using the arrangement of each color) can be used to perform various processes (e.g., content output, game processing). Also, for example, if the shooting range is a rectangular area, the image information of the rectangular area can be used instead of the judgment information described above (Figures 6, 12, and 43). An example of this is shown in Figures 57 to 60. Note that the examples shown in Figures 57 to 60 are modified versions of the examples shown in Figures 5 to 12, and some of the explanations for the common parts will be omitted.

[0385] [Examples of food and beverage changes on a table] Figure 57 shows an example of the transition of images (images of food and beverages arranged on table 1010) that can be acquired by the electronic device in the tenth embodiment. In Figure 57, for the sake of ease of explanation, table 1010 is shown as a simplified rectangle, and the food and beverages arranged on table 1010 are also shown in a simplified manner.

[0386] Figure 57(1) shows a state where there is no food or drink on table 1010 other than the condiment container 1016. Figure 57(2) shows a state on table 1010 where container 1016 has been removed and the dish served on plate 1011 (fried egg and seaweed) and the dish served on plate 1012 (bread) are placed side by side. Figure 57(3) shows a state on table 1010 where the dish served on plate 1013 (salad) and the dish served on plate 1014 (soup) are further placed side by side. Figure 57(4) shows a state on table 1010 where the dish served on plate 1014 (squid ink pasta) is further placed side by side.

[0387] Figure 57(5) shows a state in which some of the various dishes arranged on table 1010 have been eaten. Figure 57(6) shows a state in which almost all of the various dishes arranged on table 1010 have been eaten.

[0388] [Example of judgment information for determining the information to be output using image information of food and beverages placed on a table] Figure 58 shows an example of various types of information used when determining the information to be output by an electronic device in the tenth embodiment.

[0389] Figure 58(1) shows an example of regions A to P used when acquiring information about food and beverages placed on a table (for example, image information of food and beverages placed on table 1010). The rectangular region shown in Figure 58(1) is the region of the image acquired by the image acquisition unit of the electronic device (for example, a rectangular image acquired by an image sensor) that corresponds to the rectangle of the table. Furthermore, the rectangular region shown in Figure 58(1) is divided into 16 regions, which are designated as regions A to P. For example, regions A to P can be set so that each area is approximately the same. Note that the division of the rectangular region shown in Figure 58(1) is just one example, and the rectangular region may be divided into multiple regions using other division methods. For example, the rectangular region may be divided into 4 regions, 6 regions, or 8 regions. Alternatively, multiple regions (closed regions) of irregular shapes (e.g., polygons (e.g., triangles, quadrilaterals, pentagons), circles, ellipses) can be arranged within a rectangular region without overlapping, and these regions (closed regions, regions outside the closed regions) can be used to define multiple regions.

[0390] Figure 58(2) shows an example of judgment information (table) used when determining the information to be output based on the information acquired using regions A to P shown in Figure 58(1). The judgment information shown in Figure 58(2) is information that shows the correspondence between the transitions of information about food and beverages to be placed in the table (for example, image information of food and beverages placed in table 1010) and the information to be output OI. For example, all combinations (patterns) of A to P are defined in the judgment information shown in Figure 58(2). For example, the pattern "A, A, ..., A, A" is defined for the information to be output OI1 where all are A. Also, the pattern "A, B, A, ..., A, A" is defined for the information to be output OI2 where all but one (time t2 is "B") is A. Also, the pattern "A, B, B, A, ..., A, A" is defined for the information to be output OI2 where all but two (times t2 and t3 are "B") are A. The same definition applies thereafter, and all OIM information to be output will have the pattern "P, P, ..., P, P" defined for P.

[0391] In Figure 58(2), times t1, ..., tn (where n is a positive integer) are values ​​indicating the elapsed time when acquiring image information using the image acquisition unit of the electronic device. For example, if the interval for acquiring image information is 20 seconds, then time t1 = 20 seconds elapsed, time t2 = 40 seconds elapsed, time t3 = 60 seconds elapsed, ..., with 20-second intervals. The control unit of the electronic device then sequentially determines the region with the highest proportion of black among regions A to P shown in Figure 58(1) at each of times t1, ..., tn, and determines the information OI (OI1 to OIM (where M is a positive integer)) to be output based on the determination result. For example, if, at each of times t1, ..., tn, the region with the highest proportion of black among regions A to P shown in Figure 58(1) is all A (region A shown in Figure 58(1)), the control unit of the electronic device determines OI1 as the information OI to be output. Furthermore, for example, the control unit of an electronic device determines OIM as the information OI to be output if, at each of the times t1, ..., tn, the region with the highest proportion of black among regions A to P shown in Figure 58(1) is P (region P shown in Figure 58(1)).

[0392] The intervals between time intervals t1, ..., tn, and the value of n may be pre-set, or users may set their preferred values ​​through user interaction. The value of M is determined based on the number of regions that divide the rectangle corresponding to the table on which the food and drinks are arranged, and the value of n.

[0393] [Example of determining output information using image information of food and beverages placed on a table] Figure 59 shows the relationship between the images that can be acquired by the electronic device in the tenth embodiment (images of food and beverages arranged on table 1010) and regions A to P shown in Figure 58(1). Note that the images of food and beverages arranged on table 1010 shown in Figures 59(1) to (6) are the same as the images shown in Figures 57(1) to (6).

[0394] Figure 60 shows an example of a decision in which the electronic device determines the information to be output in the tenth embodiment. Figures 59 and 60 show an example in which time t1 to t6 is used as the elapsed time when acquiring image information using the image acquisition unit of the electronic device.

[0395] The images of the food and beverages arranged in table 1010 shown in Figures 59(1) to (6) were taken between times t1 and t6.

[0396] Figure 60(1) shows an example of memory storage where, for each of the times t1 to t6, the region with the highest proportion of black among regions A to P shown in Figure 58(1) is associated with and stored in memory.

[0397] The control unit of the electronic device acquires feature quantities for images contained within a rectangular region (corresponding to the rectangular region in Table 1010) in the image acquired at time t1. Specifically, the control unit of the electronic device acquires feature quantities for each image contained within the rectangular region in the image acquired at time t1 (each image contained in regions A to P shown in Figure 58(1)). For example, the control unit of the electronic device obtains information about a specific color (e.g., black) as a feature quantity for each image contained in regions A to P. For example, the control unit of the electronic device determines whether each pixel in each image contained in the image acquired by the image acquisition unit is in a black region or a white region. For example, this can be determined by binarization processing (for example, setting a threshold in advance, and determining if the pixel value is greater than the threshold to be white, and if it is less than the threshold to be black). Then, the control unit of the electronic device obtains the ratio of black regions and white regions in each image contained in regions A to P as a feature quantity.

[0398] Next, the control unit of the electronic device determines the region with the highest proportion of black areas from among the images included in regions A to P. In the example shown in Figure 59(1), among the images included in regions A to P, the region with the highest proportion of black areas is region M, because only container 1016 exists in table 1010. Therefore, the control unit of the electronic device determines region M as the region with the highest proportion of black areas in the image acquired at time t1.

[0399] Similarly, the control unit of the electronic device determines the region with the highest proportion of black areas for each image (image of food and beverages arranged on table 1010) acquired at time t2 to t6. Then, the control unit of the electronic device sequentially stores the determined feature quantities (regions with the highest proportion of black areas) for each image acquired at time t1 to t6 in the memory unit, associating them with time t1 to t6. An example of this storage is shown in Figure 60(1). In other words, the storage example shown in Figure 60(1) is a storage example for the example shown in Figures 59(1) to (6).

[0400] Figure 60(2) shows an example of extracting features that match the features shown in Figure 60(1) (information relating time t1~t6 and region A~P) from the judgment information shown in Figure 58(2). Note that the judgment information shown in Figure 60(2) is the same as the judgment information shown in Figure 58(2), and only a portion of the judgment information shown in Figure 58(2) is omitted.

[0401] Next, the control unit of the electronic device determines the information to be output based on the acquired features. Specifically, the control unit extracts features that match the acquired features (information relating time t1~t6 and region A~P shown in Figure 60(1)) from the judgment information shown in Figure 58(2). For example, as shown in Figure 60(2), the features shown in Figure 60(1) match the features shown within the dashed rectangle 1021. Therefore, the control unit of the electronic device extracts the features shown within the dashed rectangle 1021 from the judgment information shown in Figure 60(2) as features that match the features shown in Figure 60(1). The control unit of the electronic device also determines OITT1 as the information (information to be output) OI corresponding to the extracted features.

[0402] Next, the control unit of the electronic device outputs content based on the information stored in the memory unit, associated with OITT1, which has been determined as the information OI to be output.

[0403] The above example uses black as the specific color, but other colors may also be used. Furthermore, if multiple colors can be distinguished, multiple colors may be used to determine the information to be output. For example, for the image acquired at time t1 (images of food and beverages arranged in table 1010), the region with the highest proportion of the first color (e.g., red) may be determined; for the image acquired at time t2, the region with the highest proportion of the second color (e.g., green) may be determined; for the image acquired at time t3, the region with the highest proportion of the third color (e.g., blue) may be determined; and for the image acquired at time t4, the region with the highest proportion of the fourth color (e.g., yellow) may be determined. Similarly, different or identical colors can be used to determine the region of a specific color.

[0404] Furthermore, other judgment information may be used to determine the audio information to be output. For example, image patterns as shown in Figures 12 and 43 may be used. In addition, content may be output using information obtained about other beverages (e.g., soft drinks, carbonated drinks, beer, alcohol) other than beverages produced by steeping substances such as coffee beans or tea in a liquid until the liquid becomes tasty (e.g., coffee, tea). For example, content can be determined based on the transition of image information (e.g., surface image, side image) related to a beverage poured into a container (cup).

[0405] Furthermore, while the above examples mainly show how to acquire information about food and beverages (e.g., surface transitions) using image sensors, other sensors may also be used to acquire information about food and beverages. For example, as explained with reference to Figure 37, various sensors (e.g., temperature sensors capable of measuring temperature, odor sensors capable of measuring smell, sound sensors capable of measuring sound (e.g., microphones), weight sensors capable of measuring weight, and taste sensors capable of measuring taste) may be used to acquire and utilize information about food and beverages. For example, the content to be output can be determined based on the transitions of each acquired piece of information.

[0406] Thus, the electronic devices and information processing devices (for example, the server 410 (or a plurality of devices comprising it)) shown in the first to tenth embodiments are examples of information processing devices, information processing systems, and communication systems that control the output of content from an output unit using transitions of information related to food and beverages. Furthermore, the electronic devices and information processing devices (for example, the server 410 (or a plurality of devices comprising it)) shown in the first to tenth embodiments are examples of information processing devices, information processing systems, and communication systems that control the execution of at least one process from a plurality of processes (for example, content output, game processing) that are different from processes related to the evaluation of food and beverages (for example, processes that generate evaluation information such as delicious, good appearance, and beautiful presentation, and processes that output such evaluation information) and processes related to the production of food and beverages (for example, processes that generate information for providing cooking advice, and processes that output such advice), using transitions of information related to food and beverages. These controls are performed, for example, by the control units provided in each device.

[0407] Furthermore, as shown in the fifth embodiment, the server may aggregate information from multiple electronic devices and determine the information to be provided to each device based on the aggregation results. For example, a user can use an electronic device to acquire image information about a dish in a single container (e.g., ramen or beef bowl in a bowl, or a dish served on a plate (e.g., pasta, meat dish, fish dish)) and send it to the server, and the server can determine the content to provide to that user based on that image information and send it to the electronic device. In this case, the server can determine the content to provide to each user based on the image information sent from multiple users and send it to each user's electronic device. In other words, the electronic devices and information processing devices (e.g., server 410 (or multiple devices comprising it)) shown in the first to tenth embodiments are examples of electronic devices, information processing devices, information processing systems, and communication systems that acquire information about food and beverages for each food and beverage in multiple containers, and control the provision of content determined based on the acquired information to the electronic devices of each person associated with the multiple containers. Furthermore, the electronic devices and information processing devices (for example, the server 410 (or a plurality of devices comprising it)) shown in the first to tenth embodiments are examples of electronic devices, information processing devices, information processing systems, and communication systems that acquire information about food and beverages for each food and beverage placed in a plurality of containers, and control the electronic devices of each person associated with the plurality of containers to execute the processing determined based on the acquired information.

[0408] As described above, each electronic device and information processing device (e.g., server 410) shown in the first to tenth embodiments is an example of an electronic device, information processing device, information processing system, and communication system that determines content (e.g., information unrelated to the beverage) based on information obtained regarding the beverage (information obtained from the beverage) when a beverage produced from a substance for producing a beverage (e.g., a powdered substance, a liquid substance, a solid substance) and a liquid is stored in a container, during the production of the beverage, when the produced beverage is placed in the container, or after the produced beverage has been placed in the container.

[0409] Furthermore, each electronic device and information processing device (e.g., server 410) shown in the first to tenth embodiments is an example of an electronic device, information processing device, information processing system, and communication system that acquires and uses information about the liquid collected in a container that collects the liquid dripping from a beverage dispenser. For example, the information about the liquid can be used to determine the content to be provided to the user.

[0410] Furthermore, the server 410 (or multiple devices comprising it) shown in the fifth embodiment is an example of an information processing device, information processing system, and communication system that, when a beverage is produced from a substance for producing a beverage (e.g., a powdered substance, a liquid substance, a solid substance) and a liquid and stored in a container, acquires information about the produced beverage (information acquired from the beverage) for each beverage placed in multiple containers, during the production of the beverage, when the produced beverage is placed in the container, or after the produced beverage is placed in the container, and determines content (e.g., information unrelated to the beverage) to be provided to each person associated with the multiple containers based on the acquired information.

[0411] Furthermore, the server 410 (or multiple devices comprising it) shown in the fifth embodiment is an example of an information processing device, information processing system, and communication system that acquires information about the extracted beverage when the extracted beverage is placed in a container, or after the extracted beverage has been placed in a container, for each beverage placed in multiple containers, and determines the content to be provided to each person associated with the multiple containers based on the acquired information.

[0412] Furthermore, each control operation shown in the first to tenth embodiments is executed based on a program that causes a computer to execute each processing procedure, and each control operation can also be understood as a method or program invention. For example, each control operation shown in the first to tenth embodiments can be realized by storing the program related to each control operation shown in the first to tenth embodiments in a storage medium of an information processing device such as an electronic device or a server, reading the program from this storage medium, and having the information processing device execute the read program. Alternatively, the program may be stored and used on an external storage medium (for example, a CD (Compact Disc), DVD (Digital Versatile Disc), memory card), etc., of the information processing device.

[0413] The first to tenth embodiments are merely examples of how to realize the invention described in the claims, and are not limited thereto. Various modifications can be made without departing from the spirit of the invention. [Explanation of Symbols]

[0414] 1, 200, 600, 610, 620, 630, 640, 650 Coffee brewers 10, 210, 601, 611, 621, 631, 641, 651 drippers 11,211 containment units 12, 212 Flange section 20, 220, 320, 350, 360, 431, 441, 442, 443, 451, 452, 660, 700, 710, 720, 725, 750, 810, 840, 900~904 Electronic equipment 21, 221, 321, 481 lenses 22, 222, 322, 482, 811 Image acquisition unit 23, 223, 323, 352, 412, 483 Control Unit 24, 224, 324, 353, 413, 484 storage section 25, 225, 354, 361, 485, 841, 960 Audio output section 30, 603, 613, 623, 633, 643, 652 containers 40 Communication Systems 213 Legs 226, 355, 486 Input section 227, 356, 487, 812, 850, 911, 950 Display section 229, 357, 488 User Interfaces 240, 602, 612, 622, 632, 642 stands 325, 351, 411 Communications Department 358 Location information acquisition unit 400 Communication Systems 410 Servers 420 Network 490 Location information setting section 604, 614, 624, 634, 644, 661 sensors 653 Installation stand 820 Coffee Cups 830 Installation equipment 910 Display device

Claims

1. A stand for supporting a sensor capable of acquiring information about the beverage stored in a container installed at the bottom, A refilling machine that contains other liquids to be poured into the beverage and supplies the other liquids to the container through a tube, A processing unit that obtains information about the beverage from the sensor when the other liquid is poured into the beverage from the refilling machine, and uses the transition of said information to perform processing to output content from the output unit. A stand with a handle.

2. The stand according to claim 1, wherein the sensor is provided in the upper part of the lower part where the container is installed, and is supported by a connecting part connected to the lower part.

3. The stand according to claim 2, wherein a flat plate-shaped member is formed in a U-shape when viewed from the side, and the lower part, the connecting part, and the upper part are formed accordingly.

4. The aforementioned sensor is an image acquisition sensor, The upper part is provided with a hole that is larger than the diameter of the lens of the image acquisition sensor and smaller than the housing of the image acquisition device having the image acquisition sensor. The stand according to either claim 2 or 3.

5. The image acquisition device is installed in the upper part such that the lens of the image acquisition device is pointed toward the container installed in the lower part, In the image acquisition device, a user interface capable of display and operation input is provided on the surface opposite to the surface on which the lens is installed. The stand according to claim 4.

6. The stand according to claim 2 or 3, wherein the replenishment machine is fixed to the connecting portion by passing the pipe through it.

7. The stand according to claim 6, wherein the refilling machine comprises a storage section for storing the other liquid, an adjustment section for adjusting the amount of the other liquid supplied from the storage section by user operation, and a supply section for supplying the other liquid, whose quantity has been adjusted by the adjustment section, to a beverage stored in the container installed at the bottom.

8. A stand for supporting a sensor capable of acquiring information about the beverage stored in a container installed at the bottom, A refilling machine that contains other liquids to be poured into the beverage and supplies the other liquids to the container through a tube, A processing unit that obtains information about the beverage from the sensor when the other liquid is poured into the beverage from the refilling machine, and uses the transition of said information to cause the game machine to execute a game-related process of the game machine. A stand with a handle.

9. A stand for supporting a sensor capable of acquiring information about the beverage stored in a container installed at the bottom, A refilling machine that contains other liquids to be poured into the beverage and supplies the other liquids to the container through a tube, A processing unit that acquires information about the beverage from the sensor when the other liquid is poured into the beverage from the refilling machine, and uses the transition of this information to output content unrelated to the beverage from the output unit. A stand with a handle.

10. An information processing method to be performed by a computer on a stand supporting a sensor capable of acquiring information about a beverage stored in a container installed at the bottom, An information processing method that obtains information about the beverage from a sensor when the other liquid is poured into the beverage from a refilling machine that contains another liquid for pouring into the beverage and supplies the other liquid to the container through a tube, and uses the transition of said information to output content from an output unit.

11. An information processing method to be performed by a computer on a stand supporting a sensor capable of acquiring information about a beverage stored in a container installed at the bottom, An information processing method that obtains information about the beverage from a sensor when the other liquid is poured into the beverage from a refilling machine that contains another liquid for pouring into the beverage and supplies the other liquid to the container through a tube, and uses the transition of said information to cause the game machine to execute processing related to the game of the game machine.

12. An information processing method to be performed by a computer on a stand supporting a sensor capable of acquiring information about a beverage stored in a container installed at the bottom, An information processing method that obtains information about the beverage from a sensor when the other liquid is poured into the beverage from a refilling machine that contains another liquid to be poured into the beverage and supplies the other liquid to the container through a tube, and uses the transition of said information to output content unrelated to the beverage from an output unit.

13. A program to be run on a computer in a stand that supports a sensor capable of acquiring information about the beverage stored in a container located at the bottom, A program that obtains information about the beverage from a sensor when the other liquid is poured into the beverage from a refilling machine that contains another liquid to be poured into the beverage and supplies the other liquid to the container through a tube, and causes a computer to execute a process to output content from an output unit using the transition of said information.

14. A program to be run on a computer in a stand that supports a sensor capable of acquiring information about the beverage stored in a container located at the bottom, A program that obtains information about the beverage from a sensor when the other liquid is poured into the beverage from a refilling machine that contains another liquid to be poured into the beverage and supplies the other liquid to the container through a tube, and uses the transition of this information to cause a computer to execute a process that causes the game machine to execute a game-related process of the game machine.

15. A program to be run on a computer in a stand that supports a sensor capable of acquiring information about the beverage stored in a container located at the bottom, A program that obtains information about the beverage from a sensor when the other liquid is poured into the beverage from a refilling machine that contains another liquid to be poured into the beverage and supplies the other liquid to the container through a tube, and uses the transition of this information to cause a computer to execute a process to output content unrelated to the beverage from an output unit.

Images