Communication system, information processing device, information processing method, and program
The information processing device and system analyze beverage surface phenomena to provide interactive content, addressing the time-consuming nature of brewing and enhancing user experience.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- 高桥 绫子
- Filing Date
- 2024-09-27
- Publication Date
- 2026-05-12
AI Technical Summary
Existing drink brewing devices require significant time and lack interactive elements to enhance user experience.
An information processing device and system that captures and analyzes natural phenomena on the surface of brewed beverages, using sensors to provide content based on the beverage's transition, such as image, temperature, odor, sound, and weight changes, and outputs this information through audio or display.
Enhances user enjoyment by providing interactive and engaging content related to the brewing process, leveraging sensory data to create a more immersive experience.
Smart Images

Figure 0007857033000001 
Figure 0007857033000002 
Figure 0007857033000003
Abstract
Description
Technical Field
[0001] The present invention Communication system, information processing device, information processing method, and program relates to, in particular, using information obtained about a drink to, when extracting the drink. Communication system, information processing device, information processing method, and program It relates thereto.
Background Art
[0002] Around the world, various drinks such as coffee, black tea, and green tea are consumed. Also, there are numerous devices (extraction devices) for brewing these drinks. For example, there is a coffee dripper for extracting coffee (for example, Patent Document 1).
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] In the prior art, it is possible to brew a drink according to an individual's preference using various devices. Also, when brewing a drink using various devices, it takes a certain amount of time. Therefore, when making a drink using various devices, if it is possible to provide some information to the person making the drink, etc., using information that can be obtained at the timing of making the drink, it is considered that the enjoyment of making the drink will increase.
[0005] Therefore, an object of the present invention is to provide enjoyment related to drinks.
Means for Solving the Problems
[0006] One embodiment of the present invention is an information processing device, communication system, information processing method, and program that, after a beverage produced from a substance and liquid for producing a beverage is placed in a container, obtains information on the transition of natural phenomena appearing on the surface of the produced beverage for each beverage placed in a plurality of containers, obtains judgment information for each beverage based on the obtained information, and provides content determined from a plurality of contents based on the comparison results obtained by comparing the judgment information for each beverage to the electronic devices of each person associated with the plurality of containers. Furthermore, one embodiment of the present invention is an information processing device, communication system, information processing method, and program that, after a beverage produced from a substance and liquid for producing a beverage is placed in a container, acquires image information or transitions of feature quantities related to the image information for each beverage placed in a plurality of containers, obtains judgment information for each beverage based on the acquired image information or transitions of feature quantities related to the image information, and provides content determined from a plurality of contents based on the comparison results obtained by comparing the judgment information for each beverage to the electronic devices of each person associated with the plurality of containers. In this case, the information processing device obtains the judgment information based on information regarding the transitions of natural phenomena appearing on the surface of the beverage. One embodiment of the present invention is a stand for supporting a dripper that houses a substance for extracting a beverage in a storage compartment and allows a user to manually pour the liquid into the substance and drop it into a container, the stand comprising a sensor on the upper side of the storage compartment and performing processing to output content from an output unit using the transitions of a plurality of pieces of information about the liquid acquired by the sensor, an information processing method including the processing, and a program for a computer to implement the information processing method. Furthermore, one embodiment of the present invention is a stand for supporting a dripper that houses a substance for extracting a beverage in a storage section and allows a user to manually pour the liquid into the substance and drop it into a container, the stand being equipped with a sensor on the upper side of the storage section, and using information about the liquid acquired by the sensor to perform processing to output content from an output section to the user, an information processing method including the processing, and a program for a computer to implement the information processing method. Furthermore, one embodiment of the present invention is a stand for supporting a dripper that houses a substance for extracting a beverage in a storage section and allows a user to manually pour the liquid into the substance and drop it into a container, the stand being equipped with a sensor on the upper side of the storage section, and performing a process to output content unrelated to both the beverage and the extraction of the beverage from an output section using information about the liquid acquired by the sensor, an information processing method including the process, and a program for a computer to implement the information processing method. The stand may also be equipped with the aforementioned output unit. Furthermore, the sensor may be at least one of the following: an image sensor that captures an image of a subject and generates image data; a temperature sensor capable of measuring temperature; an odor sensor capable of measuring odor; an audio sensor capable of measuring sound; a weight sensor capable of measuring weight; and a taste sensor capable of measuring taste. One embodiment of the present invention is a dripper that contains a substance for extracting a beverage and allows the liquid poured onto the substance to fall into a container, and which performs processing to output content from an output unit by utilizing the transition of multiple pieces of information regarding the liquid accumulated in the container. Furthermore, one embodiment of the present invention is a dripper that contains a substance for extracting a beverage and allows the liquid poured onto the substance to fall into a container, and uses information about the liquid accumulated in the container to perform a process to output content from an output unit that is unrelated to both the beverage and the extraction of the beverage. Furthermore, one embodiment of the present invention is a dripper that contains a substance for extracting a beverage and allows a user to manually pour the liquid onto the substance into a container, and uses information about the liquid accumulated in the container to perform a process to output content from an output unit to the user. Furthermore, one embodiment of the present invention is a dripper that contains a substance for extracting beverages and allows a user to manually pour liquid onto the substance and drop it into a container, and the dripper is equipped with a circuit that uses information about the liquid accumulated in the container to control the output unit to output content to the user. Furthermore, one embodiment of the present invention is a dripper that contains a substance for extracting a beverage and allows the liquid poured onto the substance to fall into a container, and is equipped with a circuit that controls the output of a content selected from among multiple contents to the user by utilizing the transition of natural phenomena that appear on the surface of the beverage, which are contained in a plurality of image information relating to the liquid stored in the container. Furthermore, one embodiment of the present invention is a dripper that contains a substance for extracting a beverage and allows a user to manually pour the liquid onto the substance into a container, and is equipped with an audio output unit that uses information about the liquid collected in the container to output content to the user as audio. Furthermore, one embodiment of the present invention is a dripper that contains a substance for extracting beverages and allows a user to manually pour liquid onto the substance and drop it into a container, and is equipped with a communication unit that transmits information about the liquid collected in the container to another device using wireless communication. Furthermore, these drippers may be equipped with a circuit that uses the aforementioned information to control the output of content from the output section of the other device. Furthermore, in these drippers, the communication unit may be provided in an electronic device that is removable from the dripper. Furthermore, one embodiment of the present invention is a dripper that contains a substance for extracting beverages and allows a user to manually pour liquid onto the substance and drop it into a container, the dripper comprising a circuit that transmits information about the liquid collected in the container to another device using wireless communication and controls the output unit of the other device to output the information. Furthermore, one embodiment of the present invention is a dripper that contains a substance for extracting a beverage and allows a user to manually pour the liquid onto the substance into a container, and is equipped with an image acquisition unit that acquires image information relating to the liquid collected in the container. Furthermore, one embodiment of the present invention is a dripper that contains a substance for extracting a beverage and allows the liquid poured onto the substance to fall into a container, comprising an image acquisition unit that acquires a plurality of image information relating to the liquid collected in the container, and a dripper that determines the content to be output from the output unit from among a plurality of contents by utilizing the transition of natural phenomena that appear on the surface of the beverage included in the plurality of image information. Furthermore, these drippers may be equipped with a circuit that uses the transition of the image information to control the output of content from the output unit. Furthermore, in these drippers, the image acquisition unit may be provided in an electronic device that is removable from the dripper. Furthermore, in these drippers, the circuit may be provided in an electronic device that is removable from the dripper. Furthermore, in these drippers, the output unit may consist of at least one of a display unit that displays the content and an audio output unit that outputs the content as sound. Furthermore, in these drippers, the output unit may be provided in an electronic device that is removable from the dripper. Furthermore, in these drippers, the content to be output may be determined from among multiple contents by utilizing the transitions of natural phenomena that appear on the surface of the beverage, which are included in multiple pieces of image information. Furthermore, in these drippers, the content to be output may be determined from among multiple contents based on the transition of at least one of the colors, patterns, and bubbles that appear on the surface of the beverage. Furthermore, in these drippers, the content may be information relating to at least one of the following: anime characters, animals, people, plants, or geographical features. Furthermore, in these drippers, the dripper may be one that allows the liquid poured onto the substance by the user to fall into the container. Furthermore, one embodiment of the present invention is a method for extracting a beverage, which is performed by pouring a liquid onto the substance by the user using the above-described dripper, and which provides the user with the content based on the processing of the dripper. One embodiment of the present invention is an extractor comprising: a dripper for dropping a liquid poured into a substance for extracting a beverage; a container for collecting the liquid that falls from the dripper; and an electronic device positioned and used between the dripper and the container, which acquires information about the liquid collected in the container and uses the information to output content from an output unit. The present invention also includes a processing method for controlling the extractor and a program for causing a computer to execute the method.
[0007] Furthermore, in this configuration, the electronic device may have a hole for allowing the liquid that has fallen from the dripper to pass through, and an annular portion corresponding to the shape of the opening of the container, and when in use, it may be sandwiched between the dripper and the container, supported by the opening of the container and supporting the dripper.
[0008] Also, in that form, the electronic device may include an image acquisition unit that acquires image information regarding the liquid stored in the container, and the image acquisition unit may be attached to the electronic device such that the lens faces the surface of the liquid stored in the container when the electronic device is installed on the container.
[0009] Also, in that form, the image acquisition unit may acquire image information regarding the surface of the liquid stored in the container, and the electronic device may determine the content to be output from among a plurality of contents based on at least one transition of the color, pattern, or bubbles appearing on the surface of the liquid.
[0010] Also, in that form, the content may be content unrelated to both the drink and the extraction of the drink, and may be information regarding at least one of anime characters, animals, people, plants, and landscapes.
[0011] Also, in that form, the electronic device may output at least one of audio information and image information as the content.
[0012] One form of the present invention is an annular electronic device that is sandwiched between a dropper that drops a liquid poured into a substance for extracting a drink and a container that stores the liquid dropping from the dropper, is supported at the opening of the container, and supports the dropper. The electronic device acquires information regarding the liquid stored in the container and outputs content from an output unit using the information. It is also a processing method for performing the control and a program for causing a computer to execute the method.
[0013] One aspect of the present invention is an information processing apparatus that, at any one of the time of generating a drink produced by a substance and a liquid for generating the drink, storing the generated drink in a container, putting the generated drink into the container, and after putting the generated drink into the container, acquires information regarding the generated drink for each drink contained in a plurality of containers, and provides, to an electronic device of each person associated with the plurality of containers, content determined from among a plurality of contents based on analysis of each of the acquired information. It is also a determination method for making the determination, a content providing method for providing the determined content, and a program for causing a computer to execute each of these methods.
[0014] Also, in that aspect, the information processing apparatus may obtain determination information for each drink based on information regarding a natural phenomenon occurring with respect to the drink, and determine the content to be provided to the electronic device from among the plurality of contents using the determination information.
[0015] For example, at at least one timing of generating a drink produced by a substance and a liquid for generating the drink, storing the generated drink in a container, putting the generated drink into the container, and after putting the generated drink into the container, an electronic device connected (or in proximity) to each of a plurality of containers acquires information regarding the drink contained in the container (information regarding a natural phenomenon occurring with respect to the drink). Next, each electronic device transmits the acquired information (information regarding a natural phenomenon occurring with respect to the drink) to the information processing apparatus using a communication function. The information processing apparatus acquires each information transmitted in this way (information regarding a natural phenomenon occurring with respect to the drink). Next, the information processing apparatus obtains comparable determination information for each drink based on analysis of each of the acquired information. Next, the information processing apparatus determines the content to be provided to each electronic device (the electronic device of each person associated with the plurality of containers from which the information was acquired) from among the plurality of contents using the determination information. Next, the information processing apparatus provides the determined content to the electronic device of each person associated with the plurality of containers from which the information was acquired.
[0016] One embodiment of the present invention is an extractor comprising: a storage section for containing a substance for extracting a beverage and having a hole through which a liquid poured into the storage section falls; a container for collecting the liquid falling from the storage section; an acquisition section for acquiring information about the liquid collected in the container; and a control section for performing control to output content based on the information acquired by the acquisition section. The present invention also includes a processing method for performing this control and a program for causing a computer to execute this method.
[0017] Alternatively, the acquisition unit may be an image acquisition unit that acquires image information relating to the liquid stored in the container via a lens, and the acquisition unit may be mounted so that the optical axis direction of the lens faces the surface of the liquid.
[0018] Alternatively, the container may be a transparent container, the acquisition unit may be an image acquisition unit that acquires image information relating to the liquid stored in the container via a lens, and the acquisition unit may be mounted in a position where image information relating to the liquid stored in the container can be acquired from outside the container.
[0019] Furthermore, the electronic device comprising the acquisition unit and the control unit may be made detachable from the extractor.
[0020] Furthermore, the control unit may also perform control to transmit information for outputting the content to another device capable of outputting the content.
[0021] Furthermore, the content may be content unrelated to both the beverage and the extraction of the beverage, and may consist of information relating to at least one of the following: anime characters, animals, people, plants, or local features.
[0022] Furthermore, the control unit may select at least one content from among multiple contents to be output based on the information acquired by the acquisition unit.
[0023] Furthermore, one embodiment of the present invention is an electronic device used sandwiched between a storage section, which contains a substance for extracting a beverage and has a hole through which the liquid poured into the storage section falls, and a container for collecting the liquid falling from the storage section, characterized in that it has a sensor for acquiring information about the liquid collected in the container.
[0024] Furthermore, the electronic device may have an annular portion having a shape corresponding to the shape of the flange portion provided in the housing and the shape of the opening of the container, wherein the lower surface of the flange portion is in contact with the upper surface of the annular portion, and the rim of the opening is in contact with the lower surface of the annular portion, and the electronic device may be installed such that the sensor is positioned inside the opening.
[0025] Furthermore, the annular portion may be provided with a gripping portion. The annular portion may also have a shape in which a part of the annular shape is missing, or it may be U-shaped, Y-shaped, or it may be a polygon, trapezoid, ellipse, or the like.
[0026] Furthermore, one embodiment of the present invention is an information processing device that determines content based on information obtained regarding a generated beverage when the beverage, which is generated from a substance and liquid for generating a beverage, is stored in a container, when the generated beverage is placed in the container, or after the generated beverage has been placed in the container. Also, the present invention includes a determination method for making such determinations, a content provision method for providing the determined content, and a program for causing a computer to execute each of these methods.
[0027] Furthermore, one embodiment of the present invention is an information processing device that acquires information regarding a beverage, which is produced by a substance and liquid for producing a beverage, when the beverage is collected in a container, when the beverage is collected in a container, or after the beverage has been collected in a container, for each beverage in a plurality of containers, and determines content to be provided to each person associated with the plurality of containers based on the acquired information. Also, the present invention includes a determination method for making such a determination, a content provision method for providing the determined content, and a program for causing a computer to execute each of these methods. [Effects of the Invention]
[0028] According to the present invention, the effect is to provide enjoyment related to beverages. [Brief explanation of the drawing]
[0029] [Figure 1] This figure shows an example of the external configuration of the coffee brewer 1 to which the electronic device 20 in the first embodiment is attached. [Figure 2] This figure shows an example of the external configuration of the dripper 10, electronic device 20, and container 30 in the first embodiment. [Figure 3] This figure shows an example of the external configuration of the dripper 10 and electronic device 20 in the first embodiment. [Figure 4] This is a block diagram showing an example of the functional configuration of the electronic device 20 in the first embodiment. [Figure 5] This figure shows an example of the transition of an image (an image of the surface of coffee accumulating in container 30) that can be acquired by the electronic device 20 in the first embodiment. [Figure 6] This figure shows an example of various types of information used when determining the information to be output by the electronic device 20 in the first embodiment. [Figure 7] This figure shows an example of various types of information used when determining the information to be output by the electronic device 20 in the first embodiment. [Figure 8] This figure shows the relationship between the image that can be acquired by the electronic device 20 in the first embodiment (an image of the surface of the coffee accumulating in the container 30) and regions A to I shown in Figure 6(1). [Figure 9] This figure shows an example of how the electronic device 20 in the first embodiment determines the information to be output. [Figure 10] This figure shows a simplified example of how audio information is output from the electronic device 20 in the first embodiment. [Figure 11] This flowchart shows an example of audio output processing by the electronic device 20 in the first embodiment. [Figure 12] This figure shows an example of various types of information used when determining the information to be output by the electronic device 20 in the first embodiment. [Figure 13] This is a perspective view showing an example of the external configuration of the coffee brewer 200 to which the electronic device 220 in the second embodiment is attached. [Figure 14] Block diagram showing an example of the functional configuration of the electronic device 220 in the second embodiment. [Figure 15] This figure shows an example of the information to be output by the electronic device 220 in the second embodiment. [Figure 16] This figure shows an example of how the electronic device 220 determines the information to be output in the second embodiment. [Figure 17] This figure shows a simplified example of how audio and image information can be output from the electronic device 220 in the second embodiment. [Figure 18] This flowchart shows an example of information output processing by the electronic device 220 in the second embodiment. [Figure 19] This is a block diagram showing an example of the functional configuration of the electronic device 320 in the third embodiment. [Figure 20] This is a perspective view showing an example of the external configuration of the external equipment (electronic devices 350, 360) in the third embodiment. [Figure 21]This is a diagram showing an example of the functional configuration of the electronic device 350 in the third embodiment. [Figure 22] This is a flowchart showing an example of communication processing by electronic devices 320 and 350 in the third embodiment. [Figure 23] This figure shows a simplified example of how audio and image information can be output from devices other than the electronic device 220 (electronic devices 350, 360) in the third embodiment. [Figure 24] This is a flowchart showing an example of communication processing by electronic devices 320 and 350 in the fourth embodiment. [Figure 25] This figure shows an example of the system function configuration of the communication system 400 in the fifth embodiment. [Figure 26] This is a block diagram showing an example of the functional configuration of the electronic device 431 in the fifth embodiment. [Figure 27] This is a block diagram showing an example of the functional configuration of the server 410 in the fifth embodiment. [Figure 28] This figure shows an example of management information stored in the memory unit 413 in the fifth embodiment. [Figure 29] This figure shows an example of how information about electronic devices 431, 441, and 451 is stored in the fifth embodiment, and an example of the content provided to electronic devices 431, 441, and 451. [Figure 30] This flowchart shows an example of communication processing by the electronic device 431 and the server 410 in the fifth embodiment. [Figure 31] This flowchart shows an example of communication processing by the electronic device 431 and the server 410 in the fifth embodiment. [Figure 32] This figure shows an example in which the server 410 provides content to electronic devices 431, 442, 443, and 452 in the fifth embodiment. [Figure 33] This flowchart shows an example of the transmission process by the electronic device 431 in the fifth embodiment. [Figure 34]This flowchart shows an example of content output processing by the electronic device 431 in the fifth embodiment. [Figure 35] This flowchart shows an example of content provision processing by the server 410 in the fifth embodiment. [Figure 36] This flowchart shows an example of communication processing by the server 410 and the electronic device 431 in the fifth embodiment. [Figure 37] This figure shows examples of sensor mounting for a coffee brewer or electronic device in the first to fifth embodiments. [Figure 38] This figure shows examples of sensor mounting for electronic devices 700, 710, 720, and 725 in the first to fifth embodiments. [Figure 39] This figure shows the appearance of a modified version (coffee brewer 730) of the coffee brewer 1 in the first embodiment. [Figure 40] This figure shows the appearance of a modified version (coffee brewer 730) of the coffee brewer 1 in the first embodiment. [Figure 41] This figure shows a simplified example of how information acquired by the electronic device 700 in the sixth embodiment can be output. [Modes for carrying out the invention]
[0030] Next, embodiments of the present invention will be described in detail with reference to the drawings.
[0031] [First embodiment: An example of providing audio information using the colors and patterns formed when brewing coffee] [Example of external configuration of coffee brewing machine and electronic equipment] Figure 1 shows an example of the external configuration of the coffee brewer 1 to which the electronic device 20 is attached in the first embodiment. Figure 1(1) shows a perspective view of the coffee brewer 1 to which the electronic device 20 is attached, and Figure 1(2) shows a side view of the coffee brewer 1 to which the electronic device 20 is attached.
[0032] Figure 2 shows an example of the external configuration of the dripper 10, electronic device 20, and container 30 in the first embodiment. Figure 2(1) shows a perspective view of the coffee extractor 1 shown in Figure 1 with the electronic device 20 removed, and Figure 2(2) shows a side view of the dripper 10.
[0033] Figure 3 shows an example of the external configuration of the dripper 10 and electronic device 20 in the first embodiment. Figure 3(1) shows a top view of the dripper 10 and electronic device 20 with the electronic device 20 attached to the lower part of the flange portion 12, and Figure 3(2) shows a bottom view of the dripper 10 and electronic device 20 with the electronic device 20 attached to the lower part of the flange portion 12. Figure 3(3) shows a top view of the electronic device 20, and Figure 3(4) shows a bottom view of the electronic device 20.
[0034] The coffee brewer 1 comprises a dripper 10, electronic equipment 20, and a container 30. The coffee brewer 1 may also be referred to as a beverage extractor, beverage filter, beverage generating device, etc.
[0035] The dripper 10 has a housing section 11, a flange section 12, and leg sections 13, and is a coffee dripper used by being placed in the opening 32 of the container 30. An electronic device 20 is attached to the lower part of the flange section 12.
[0036] The storage section 11 is a storage section that houses ground coffee beans, and a hole 14 (a vertically penetrating hole 14) is provided at the bottom for the hot water poured into the storage section 11 to flow down. Thus, the storage section 11 has an upper opening for pouring hot water onto the ground coffee beans from above, and a hole 14 (lower opening, dispensing spout) for dropping the hot water poured onto the ground coffee beans into the container 30. The storage section 11 is also a device that pours hot water poured onto the ground coffee beans stored inside into the container 30 located below the storage section 11, via the ground coffee beans. In Figure 1, although not shown, various components such as handles may be provided on the outer surface of the storage section 11.
[0037] For example, the storage section 11 can be funnel-shaped and serve as a storage section for holding a paper filter that filters the liquid extracted (filtered out) from the coffee beans. Alternatively, the storage section 11 may be made of a metal filter, or it may be made as a storage section for holding a cloth filter. Furthermore, the shape of the storage section 11 can be various, such as trapezoidal, conical, or basket-shaped.
[0038] The flange portion 12 is a disc-shaped flange portion that widens outward from the lower part of the housing portion 11 in the horizontal direction. The flange portion 12 is also provided at the lower part of the housing portion 11 and stably supports the housing portion 11 when it is installed in the opening 32 of the container 30.
[0039] The leg portion 13 is a ring-shaped projection provided on the lower surface of the flange portion 12, and supports the dripper 10 when it is placed directly on a part of the container 30 other than the opening 32. The leg portion 13 corresponds to the bottom, base, or tail of a ceramic bowl (for example, a tea bowl or soup bowl). Figures 2 and 3 show an example where the leg portion 13 is a ring-shaped projection, but the leg portion 13 may also be made up of three or more projections (for example, multiple projections arranged around the circumference) so that it can support the dripper 10.
[0040] The housing portion 11, flange portion 12, and leg portion 13 may be integrally constructed from heat-resistant glass, ceramic, resin, etc., or they may be constructed individually and joined together. The leg portion 13 may be omitted.
[0041] Container 30 is a container (coffee server) that collects the coffee extract flowing down from the dripper 10. Container 30 also has an opening 32 for receiving the coffee extract flowing down from the dripper 10, and supports the dripper 10 placed in the opening 32. Container 30 can be made of heat-resistant glass. Alternatively, container 30 may be made of a material with enhanced heat retention (e.g., a stainless steel server), or it may be made of ceramic. Furthermore, the shape of container 30 can be various shapes other than that shown in Figure 1. Although not shown in Figure 1, various components such as handles may be provided on the outer surface of container 30.
[0042] The electronic device 20 is an electronic or information processing device that is installed so as to be sandwiched between the flange portion 12 of the dripper 10 and the opening 32 of the container 30. In other words, the electronic device 20 is an electronic or information processing device that is used sandwiched between the flange portion 12 of the dripper 10 and the opening 32 of the container 30. Furthermore, for example, the electronic device 20 can be realized by installing each component (each part shown in Figure 4) inside a housing (case). For example, the housing (case) can be made of heat-resistant glass, ceramics, metal, resin, wood, etc.
[0043] The electronic device 20 is composed of a rectangular (flat) portion (gripping portion 27) and a ring-shaped (annular) portion (annular portion 28). The annular portion 28 has a ring-like shape when viewed from above and has an upper surface (upper part) 71 on which the dripper 10 is installed, a lower surface (lower part) 72 installed in the opening 32 of the container 30, an inner surface (inner wall) 73 facing the leg portion 13 on the lower surface of the flange portion 12, and an outer surface (outer wall, peripheral wall) 74. Thus, the annular portion 28 has a donut shape with a hollow portion (hole 29), and is positioned so as to be sandwiched between the flange portion 12 of the dripper 10 and the opening 32 of the container 30, with the upper surface (upper part) 71 in contact with the dripper 10 and the lower surface (lower part) 72 in contact with the rim of the opening 32 of the container 30. Furthermore, the electronic device 20 has a shape in which a rectangular part (grip part 27) is joined to a ring-shaped (annular) part (annular part 28), and has a shape similar to, for example, a magnifying glass or a goldfish scooping game. The annular part 28 has an inner diameter (size of the hole 29) that is larger than the diameter (outer diameter) of the leg part 13 on the lower surface of the flange part 12 of the dripper 10. The annular part 28 also has an outer diameter that is smaller than the diameter of the lower surface of the flange part 12 of the dripper 10.
[0044] Furthermore, as shown in Figure 3(2), the electronic device 20 is mounted so as to be sandwiched between the flange portion 12 of the dripper 10 and the opening 32 of the container 30, with the legs 13 of the flange portion 12 fitting into the holes 29 of the annular portion 28. In other words, the electronic device 20 is supported by the opening 32 of the container 30, and the dripper 10 is supported by the annular portion 28 of the electronic device 20. For example, as shown in Figures 1(2) and 3(2), by setting the shape of the annular portion 28 of the electronic device 20 to match the shape of the opening 32 (rim) of the container 30, and also to match the shape of the flange portion 12 of the dripper 10, the electronic device 20 and the dripper 10 are stably supported by the container 30 even when the electronic device 20 is mounted so as to be sandwiched between the flange portion 12 of the dripper 10 and the opening 32 of the container 30.
[0045] Thus, the annular portion 28 has a shape that corresponds to the annular shape of the flange portion 12 and the annular shape of the opening 32 of the container 30. Furthermore, the lower surface of the flange portion 12 is in contact with the upper surface 71 of the annular portion 28, and the rim of the opening 32 of the container 30 is in contact with the lower surface 72 of the annular portion 28, and the electronic equipment 20 is installed such that the lens 21 is positioned inside the opening 32.
[0046] Furthermore, when installing or removing the electronic device 20, the user can hold the gripping part 27 in their hand and perform each operation. Therefore, the gripping part 27 functions as a gripping part for the electronic device 20. In addition, since the gripping part 27 is equipped with an operating part 26, the gripping part 27 also functions as an operating part for the electronic device 20. In addition, since the gripping part 27 is equipped with an audio output part 25, the gripping part 27 also functions as an output part for the electronic device 20.
[0047] In this way, by making the electronic device 20 into a shape like a magnifying glass or a goldfish scooping game, it is easy to attach and detach the electronic device 20. Furthermore, the electronic device 20 can be stably installed on the coffee brewer 1.
[0048] The shapes of the gripping portion 27 and the annular portion 28 are not limited to these. For example, the outer diameter of the annular portion 28 may be made larger than the diameter of the lower surface of the flange portion 12 of the dripper 10. Also, the shape of the annular portion 28 may be other shapes as long as it can be stably positioned in the opening 32 of the container 30 and stably support the dripper 10. For example, it may be a shape in which a part of the ring-shaped portion is missing, or in a top view it may be U-shaped, Y-shaped, polygonal, trapezoidal, elliptical, etc. (having a portion corresponding to a hole that is at least larger in size than the diameter (outer diameter) of the leg portion 13). A modified example of the annular portion 28 is shown in Figure 38.
[0049] Furthermore, the electronic device 20 includes a lens 21, an audio output unit 25, and an operation unit 26. The functional configuration of the lens 21, the audio output unit 25, and the operation unit 26 will be explained in detail with reference to Figure 4.
[0050] Furthermore, the lens 21 of the electronic device 20 is positioned on the lower part (lower surface (bottom surface 72)) of the annular portion 28. Also, when the dripper 10 and the electronic device 20 are set in the container 30, the optical axis of the lens 21 is positioned so that it faces the surface of the coffee extract that accumulates in the container 30.
[0051] Furthermore, when hot water is poured into the dripper 10 or when removing the electronic device 20, it is conceivable that water or other liquids may adhere to the entire electronic device 20 or its various parts (lens 21, audio output unit 25, operation unit 26). Therefore, it is preferable to apply a waterproof coating to the entire electronic device 20 or its various parts (lens 21, audio output unit 25, operation unit 26).
[0052] Furthermore, it is expected that the dripper 10 and container 30 will become hot when hot water is poured into the dripper 10. Therefore, it is preferable to enclose each component built into the electronic device 20 with an insulating material or to apply an insulating treatment so that it is not affected by the heat from the dripper 10 and container 30. For example, insulating materials such as foam or felt may be used, or two or more of these materials may be combined. Also, for example, each component other than the lens 21 and image acquisition unit 22 (each component shown in Figure 4) can be installed inside the gripping unit 27 so that it is not affected by the heat from the dripper 10 and container 30.
[0053] Furthermore, when hot water is poured into the dripper 10, steam is expected to be generated from the coffee (liquid) accumulating in the container 30, causing the lens 21 to fog up. Therefore, it is preferable to apply an anti-fog treatment to the surface of the lens 21. Alternatively, the entire lens 21 may be covered with a transparent material that has been treated with an anti-fog treatment. In addition, to prevent the effects of heat, it is preferable to apply an insulating treatment to the lens 21 itself or to the transparent material that has been treated with an anti-fog treatment.
[0054] [Example of electronic device functional configuration] Figure 4 is a block diagram showing an example of the functional configuration of the electronic device 20 in the first embodiment.
[0055] The electronic device 20 includes a lens 21, an image acquisition unit 22, a control unit 23, a storage unit 24, an audio output unit 25, and an operation unit 26. The electronic device 20 may have a built-in battery or an attached battery to use the battery as a power source, or it may not have a built-in battery and may use an external power source.
[0056] Lens 21 is composed of multiple lenses that collect light from the subject. The light from the subject collected by lens 21 is then incident on the image sensor (provided by the image acquisition unit 22).
[0057] The image acquisition unit 22 captures an image of a subject and generates an image (image data) based on the control of the control unit 23, and outputs the generated image to the control unit 23. The image acquisition unit 22 is composed of, for example, an image sensor that receives light from a subject focused by the lens 21, and an image processing unit that performs predetermined image processing on the image data generated by the image sensor. As the image sensor, for example, a CCD (Charge Coupled Device) type or a CMOS (Complementary Metal Oxide Semiconductor) type image sensor can be used. The lens 21 may also be configured so that each part (for example, a zoom lens, a focus lens, and an aperture) is controlled based on the control of the control unit 23.
[0058] The control unit 23 controls each part of the electronic device 20 based on the control program stored in the memory unit 24. The control unit 23 is implemented, for example, by a CPU (Central Processing Unit). The CPU is a central processing unit (electronic device) consisting of a control unit (control circuit) and an arithmetic unit (arithmetic circuit).
[0059] The storage unit 24 is a memory that stores various types of information. For example, the storage unit 24 stores various types of information necessary for the electronic device 20 to perform various processes (for example, control programs, information for determining the information to be output (for example, the information shown in Figures 6(1)(2) and 7)). The storage unit 24 also stores information determined based on images (image data) acquired by the image acquisition unit 22 (for example, shown in Figure 9(1)).
[0060] The audio output unit 25 is an audio output unit (for example, a speaker) that outputs various types of sounds based on the control of the control unit 23.
[0061] The operation unit 26 receives operation input for operating the electronic device 20. In the first embodiment, for the sake of simplicity, the operation unit 26 is assumed to be a switch for turning on the power of the electronic device 20. Although only a simplified operation unit 26 is shown in Figures 1 to 3, other operating members may be provided.
[0062] [Examples of surface changes in coffee accumulated in a container] Figure 5 shows an example of the transition of an image (an image of the surface of the coffee accumulating in the container 30) that can be acquired by the electronic device 20 in the first embodiment. In Figure 5, for the sake of ease of explanation, the coffee liquid and the bubbles that form on the surface of the coffee are simplified and shown as circles, etc.
[0063] Figure 5(1) shows the state in which the extracted coffee (liquid) 41 has fallen to the bottom 31 of the container 30. First, the user sets the dripper 10 on top of the container 30, places a paper filter inside the housing 11 of the dripper 10, and puts coffee grounds into the paper filter. Next, the user pours a small amount of water, which has been boiled and then cooled to about 90 degrees Celsius, onto the coffee grounds set in the dripper 10 and lets it steep for about 20 to 30 seconds. During this steeping stage, only a small amount of water is poured onto the coffee grounds, and the water is absorbed by the coffee grounds, so the extracted coffee (liquid) 41 often does not fall to the bottom 31 of the container 30.
[0064] Once the steeping period is over, the user pours their desired amount of hot water onto the steeped coffee grounds (the coffee grounds set in the dripper 10) at their preferred timing. When hot water is poured onto the coffee grounds in this way, as shown in Figure 5(1), the coffee grounds cannot absorb all of the water, and the coffee (liquid) 41 falls to the bottom 31 of the container 30. In this case, the position (position at the bottom 31), size (size at the bottom 31), and shape (planar shape at the bottom 31) of the coffee (liquid) 41 that falls to the bottom 31 of the container 30 change depending on the amount of hot water poured onto the coffee grounds and the position where the water is poured (the position of the coffee grounds set in the dripper 10). For example, as shown in Figures 5(1) and 5(2), the first coffee (liquid) 41 falls near the center of the bottom 31 of the container 30, and thereafter the coffee (liquid) 41 accumulates and spreads in one direction or another.
[0065] Furthermore, as shown in Figure 5(3), when the extracted coffee (liquid) 41 accumulates to a certain extent at the bottom 31 of the container 30, foam 42 often appears on the surface of the coffee (liquid) 41 accumulated in the container 30. Note that in Figure 5, the foam 42 is shown in a simplified form with white outlines. Also, as the user continues to pour hot water over the coffee grounds until the desired amount is reached, the surface area of the coffee (liquid) 41 shrinks to conform to the shape of the container 30, as shown in Figures 5(3) to (8).
[0066] As shown in Figures 5(1) to 5(8), when hot water is poured over the coffee grounds set in the dripper 10, various colors and patterns are formed on the bottom 31 of the container 30 (including the surface of the coffee (liquid) 41 accumulated in the container 30), such as the color of the coffee (dark) and the color of the foam (whitish). The colors and patterns formed in this way often differ depending on the person brewing the coffee and the environment in which the coffee is brewed. Furthermore, it is assumed that the colors and patterns formed in this way are unlikely to be identical or nearly identical even if the same person brews coffee in the same environment. Therefore, in the first embodiment, an example is shown in which various information is provided using the colors and patterns formed when brewing coffee.
[0067] [Example of judgment information used to determine the output target information using the colors and patterns formed when brewing coffee] Figures 6 and 7 show examples of various types of information used when determining the information to be output by the electronic device 20 in the first embodiment.
[0068] Figure 6(1) shows an example of regions A to I used when acquiring information about the coffee accumulating in the container 30 (for example, the surface of the coffee (liquid) 41 accumulated in the container 30). The circular region shown in Figure 6(1) is the region corresponding to the circular shape of the bottom 31 of the container 30 in the image acquired by the image acquisition unit 22 of the electronic device 20 (for example, the rectangular image acquired by the image sensor). Furthermore, the circular region shown in Figure 6(1) is divided into nine regions A to I. For example, regions A to I can be set so that each area is approximately the same. Note that the division of the circular region shown in Figure 6(1) is just one example, and the circular region may be divided into multiple regions by other division methods. For example, the circular region may be divided into four regions by two straight lines (straight lines with the same diameter) passing through the center of the circle, or into six regions by three straight lines (straight lines with the same diameter) passing through the center of the circle, or into eight regions by four straight lines (straight lines with the same diameter) passing through the center of the circle. Alternatively, multiple regions (closed regions) of irregular shapes (e.g., polygons (e.g., triangles, quadrilaterals, pentagons), circles, ellipses) can be arranged within a circular region without overlapping, and these regions (closed regions, regions outside the closed regions) can be used to define multiple regions.
[0069] Figure 6(2) shows an example of judgment information (table) used when determining the information to be output based on the information acquired using regions A to I shown in Figure 6(1). The judgment information shown in Figure 6(2) is information that shows the correspondence between the transitions of information about the coffee accumulating in container 30 (for example, the surface of the coffee (liquid) 41 accumulated in container 30) and the information to be output OI. For example, all combinations (patterns) of A to I are defined in the judgment information shown in Figure 6(2). For example, the pattern "A, A, ..., A, A" is defined for the information to be output OI1 where all are A. Also, the pattern "A, B, A, ..., A, A" is defined for the information to be output OI2 where all but one (time t2 is "B") is A. Also, the pattern "A, B, B, A, ..., A, A" is defined for the information to be output OI2 where all but two (times t2 and t3 are "B") are A. The same definition applies thereafter, and all OIM information to be output will have the pattern "I, I, ..., I, I" defined for each element.
[0070] In Figure 6(2), times t1, ..., tn (where n is a positive integer) are values indicating the elapsed time when brewing coffee using the coffee extractor 1. For example, if the interval for acquiring information about the coffee accumulating in container 30 is 20 seconds, then time t1 = 20 seconds elapsed, time t2 = 40 seconds elapsed, time t3 = 60 seconds elapsed, ..., with 20-second intervals. Then, for each of times t1, ..., tn, the control unit 23 sequentially determines the region with the highest proportion of black among regions A to I shown in Figure 6(1), and based on the determination result, determines the information OI (OI1 to OIM (where M is a positive integer)) to be output. For example, if for each of times t1, ..., tn, the control unit 23 determines OI1 as the information OI to be output if all of the regions with the highest proportion of black among regions A to I shown in Figure 6(1) are A (region A shown in Figure 6(1)). Furthermore, for example, the control unit 23 determines OIM as the information to be output OI if, at each of the times t1, ..., tn, the region with the highest proportion of black among regions A to I shown in Figure 6(1) is I (region I shown in Figure 6(1)).
[0071] The intervals between time t1, ..., tn, and the value of n may be set in advance, or the user may set a value of their choice through user operation. The value of M is determined based on the number of regions that divide the circular shape corresponding to the surface of the coffee (liquid) 41 accumulated in the container 30, and the value of n. For example, if the number of regions that divide the circular shape is 4 and the value of n is 4, then it is determined to be 256 (= 4 × 4 × 4 × 4). However, depending on the number of regions and the value of n, the value of M may become too large, making it impossible to prepare the information to be output (for example, the audio information 61 shown in Figure 7). For this reason, if the value of M is greater than the number of pieces of information to be output (for example, the audio information 61 shown in Figure 7), the same piece of audio information 61 may be assigned to different pieces of information (information to be output OI).
[0072] Figure 7 shows an example of the correspondence between the information OI to be output, determined using the judgment information shown in Figure 6(2), and the output information (audio information 61). For example, if OI1 is determined as the information OI to be output, then information about Santa will be output as audio information 61. The information about Santa is, for example, the information used to output the audio "Today, let's dream of our beloved Santa." Note that in Figure 7, only the characters that are the target of audio output are shown in a simplified manner for ease of explanation. For further explanation of these output examples, please refer to Figure 10.
[0073] [An example of determining information to be output using the colors and patterns formed when brewing coffee] Figure 8 shows the relationship between the image that can be acquired by the electronic device 20 in the first embodiment (an image of the surface of the coffee accumulating in the container 30) and regions A to I shown in Figure 6(1). Note that the images of the surface of the coffee accumulating in the container 30 shown in Figures 8(1) to (8) are the same as the images shown in Figures 5(1) to (8).
[0074] Figure 9 shows an example of a decision made by the electronic device 20 in the first embodiment to determine the information to be output. Figures 8 and 9 show an example where time t1 to t8 is used as the elapsed time when brewing coffee using the coffee extractor 1. In this case, the value of M becomes 43046721, so it is conceivable that it may not be possible to prepare this many audio information 61 (and also not be able to store them in the storage unit 24). In such cases, it is possible to duplicate and associate some of the audio information 61 with the same output target information OI.
[0075] The images of the surface of the coffee accumulating in container 30 shown in Figures 8(1) to (8) were taken at times t1 to t8.
[0076] Figure 9(1) shows an example of memory where, for each of the time intervals t1 to t8, the region with the highest proportion of black among regions A to I shown in Figure 6(1) is associated with and stored in memory.
[0077] First, the power to the electronic device 20 is turned on. This power on / off can be performed manually by the user by providing a switch (operation unit 26) on the electronic device 20 for turning the power on and off. Alternatively, some kind of sensor (e.g., a sound sensor) may be provided on the electronic device 20, and the power on / off may be performed automatically based on the sensor. Furthermore, a wireless communication unit may be provided on the electronic device 20, and the power on / off may be performed based on the operation of an external device (e.g., a smartphone).
[0078] Thus, after the power of the electronic device 20 is turned on, the image acquisition unit 22 (shown in Figure 4) of the electronic device 20 sequentially acquires images (including image data) of the coffee accumulating in the container 30 based on the control unit 23 (shown in Figure 4) of the electronic device 20.
[0079] Furthermore, the control unit 23 (shown in Figure 4) of the electronic device 20 sequentially acquires images (images of the coffee accumulating in the container 30 (including image data)) acquired by the image acquisition unit 22 (shown in Figure 4) of the electronic device 20.
[0080] Here, after the power of the electronic device 20 is turned on, the information to be determined first (the image of the surface of the coffee accumulating in the container 30) may be determined based on the passage of time, based on changes in the image, or based on external operation. For example, after the power of the electronic device 20 is turned on, time t1 can be defined as the timing when a predetermined time (e.g., 1 to 20 seconds, the steeping time) has elapsed since a change occurred in the image of the surface of the coffee accumulating in the container 30. Note that the change in the image of the surface of the coffee accumulating in the container 30 is, for example, a change caused by the first dropping of coffee liquid to the bottom 31 of the container 30 (in other words, a change caused by the development of the color (black) of the coffee liquid).
[0081] Thus, the control unit 23 uses the image acquired at time t1 (an image of the surface of the coffee accumulating in the container 30) as the first target for determination. The control unit 23 then determines the circular region in the image acquired at time t1 (the circular region corresponding to the surface of the coffee (liquid) 41 accumulated in the container 30). Note that the circular region in the image acquired at time t1 is often the same size (or approximately the same size) as the bottom 31 of the container 30, because there is usually very little coffee accumulated in the container 30.
[0082] Here, the circular region in the image acquired by the control unit 23 becomes smaller over time. That is, as the amount of coffee (liquid) 41 accumulating in the container 30 increases, the surface of the coffee (liquid) 41 rises, and the surface area (circular region) of the coffee (liquid) 41 becomes smaller to match the shape of the container 30. For this reason, as shown in Figures 8(1) to (8), the control unit 23 changes the size of regions A to I to match the determined circular region (the circular region corresponding to the surface of the coffee (liquid) 41 accumulated in the container 30). Note that the size of regions A to I may be fixed and not changed during the determination process.
[0083] Next, the control unit 23 acquires feature quantities for the images contained within the circular region (the circular region corresponding to the surface of the coffee (liquid) 41 accumulated in the container 30) in the image acquired at time t1. Specifically, the control unit 23 acquires feature quantities for each image contained within the circular region in the image acquired at time t1 (each image contained within regions A to I shown in Figure 6(1)). For example, the control unit 23 obtains information about the color of the coffee as a feature quantity for each image contained within regions A to I. For example, the control unit 23 determines whether each pixel in each image contained in the image acquired by the image acquisition unit 22 is either a black region or a white region. For example, this can be determined by binarization processing (for example, setting a threshold in advance, and determining if the pixel value is greater than the threshold to be white, and if it is less than the threshold to be black). It is preferable to set the threshold used in the binarization processing to a value that can distinguish between coffee and foam. Then, the control unit 23 obtains the ratio of black regions and white regions in each image contained within regions A to I as a feature quantity.
[0084] Next, the control unit 23 determines the region with the highest proportion of black areas from among the images included in regions A to I. In the example shown in Figure 8(1), among the images included in regions A to I, region A has the highest proportion of black areas. Therefore, the control unit 23 determines region A as the region with the highest proportion of black areas in the image acquired at time t1.
[0085] Similarly, the control unit 23 determines the region with the highest proportion of black areas for each image (image of the surface of coffee accumulating in the container 30) acquired at time t2 to t8. Then, the control unit 23 sequentially stores the determined feature quantities (regions with the highest proportion of black areas) for each image acquired at time t1 to t8 in the storage unit 24, associating them with time t1 to t8. An example of this storage is shown in Figure 9(1). In other words, the storage example shown in Figure 9(1) is a storage example for the example shown in Figures 8(1) to (8).
[0086] Figure 9(2) shows an example of extracting features that match the features shown in Figure 9(1) (information relating time t1~t8 and regions A~I) from the judgment information shown in Figure 6(2). Note that the judgment information shown in Figure 9(2) is the same as the judgment information shown in Figure 6(2), with some of the judgment information from Figure 6(2) omitted.
[0087] Next, the control unit 23 determines the information to be output from the audio output unit 25 based on the acquired feature quantities. Specifically, the control unit 23 extracts feature quantities that match the acquired feature quantities (information relating time t1~t8 and region A~I shown in Figure 9(1)) from the judgment information shown in Figure 6(2). For example, as shown in Figure 9(2), the feature quantities shown in Figure 9(1) match the feature quantities shown within the dashed rectangle 51. Therefore, the control unit 23 extracts the feature quantities shown within the dashed rectangle 51 from the judgment information shown in Figure 9(2) as feature quantities that match the feature quantities shown in Figure 9(1). The control unit 23 also determines OIX1 as the information (information to be output) OI corresponding to the extracted feature quantities.
[0088] Next, the control unit 23 outputs audio from the audio output unit 25 based on the audio information 61 stored in the storage unit 24 in association with the OIX1 which has been determined as the information OI to be output. For example, as shown in Figure 9(3), the audio output unit 25 outputs the audio "Let's wait patiently like a snowman today" based on the audio information 61 associated with OIX1 (shown within the dashed rectangle 52). An example of this output is shown in Figure 10.
[0089] [Example of outputting audio information from an electronic device when brewing coffee] Figure 10 is a simplified diagram showing an example of outputting audio information from the electronic device 20 in the first embodiment. The example shown in Figure 10 shows an example of outputting audio information determined by the examples shown in Figures 8 and 9.
[0090] As described above, the control unit 23 outputs the voice message "Let's wait patiently like a snowman today" from the voice output unit 25 based on the voice information associated with OIX1 (within the dashed rectangle 52 shown in Figure 9(3)). This allows user P1, who is brewing coffee using the coffee brewer 1, to hear a voice message based on the features acquired during the brewing process after brewing their ideal cup of coffee. For example, whether user P1 is a coffee brewing expert or a novice, the color and pattern that appear on the surface of the coffee accumulating in the container 30 are likely to be different each time. Therefore, by utilizing these characteristics of coffee when brewing, users can enjoy not only the pleasure of drinking the brewed coffee but also voice information (information unrelated to coffee or its brewing) based on the features acquired during the brewing process.
[0091] [Example of operation that outputs audio information] Figure 11 is a flowchart showing an example of audio output processing by the electronic device 20 in the first embodiment. Figure 11 shows an example of operation after the power of the electronic device 20 is turned on by the operation of the control unit 26, and after a change occurs in the image of the surface of the coffee accumulating in the container 30.
[0092] First, the image acquisition unit 22 (shown in Figure 4) of the electronic device 20 sequentially acquires images (including image data) of the coffee accumulating in the container 30 based on the control unit 23 (shown in Figure 4) of the electronic device 20 (step S101). The control unit 23 also sequentially acquires the images (images (including image data)) acquired by the image acquisition unit 22 (step S101).
[0093] Next, the control unit 23 analyzes the acquired image information to obtain feature quantities (step S102). For example, the control unit 23 determines a circular region in the acquired image (a circular region corresponding to the surface of the coffee (liquid) 41 accumulated in the container 30). Next, the control unit 23 obtains feature quantities for the images included in the determined circular region. Specifically, the control unit 23 obtains feature quantities (ratio of black regions to white regions) for each image included in the circular region of the acquired image (each image included in regions A to I shown in Figure 6(1)). Next, the control unit 23 determines the region with the highest ratio of black regions from among the images included in regions A to I.
[0094] Next, the control unit 23 stores the acquired feature quantities in the storage unit 24 in association with the elapsed time (step S103). For example, as shown in Figure 9(1), the control unit 23 stores the determined feature quantities (the region with the highest proportion of black areas) for each image acquired at time t1 to t8 in the storage unit 24 in association with time t1 to t8.
[0095] Next, the control unit 23 determines whether or not the termination condition is met (step S104). If the termination condition is not met, the process returns to step S101; if the termination condition is met, the process proceeds to step S105.
[0096] Here, as a criterion for determining whether the termination condition is met, for example, whether a predetermined time has elapsed or whether there is no (or almost no) change in the acquired image information can be used. The predetermined time can be determined, for example, based on the elapsed time since the power of the electronic device 20 was turned on, or the elapsed time since a change occurred in the image of the surface of the coffee accumulating in the container 30 after the power of the electronic device 20 was turned on. The predetermined time may also be a pre-set time, or it may be set according to the user's preference through user operation. For example, as shown in the examples in Figures 8 and 9, when acquiring image information at the timings t1 to t8, the predetermined time will be time t8 (or after time t8 has elapsed). Furthermore, whether there is no change in the acquired image information can be determined, for example, by analyzing the acquired image information and comparing consecutive images in a time series, and determining whether the time during which the difference is less than or equal to a predetermined value continues for a predetermined period. In other words, whether there is no change in the acquired image information can be determined by whether a predetermined time has elapsed during which there is no change in the image of the surface of the coffee accumulating in the container 30. Note that it is also possible that no change will be determined due to the lens 21 fogging up.
[0097] If the termination condition is met (step S104), the control unit 23 determines the information to be output from the audio output unit 25 based on the acquired feature quantities (step S105). For example, the control unit 23 extracts a feature quantity that matches the acquired feature quantity (for example, information relating time t1~t8 and region A~I shown in Figure 9(1)) from the determination information shown in Figure 6(2). Next, the control unit 23 determines the information (information to be output) OI corresponding to the extracted feature quantity, and determines the audio information 61 (shown in Figure 7) stored in the storage unit 24 in association with the determined information (information to be output OI).
[0098] Next, the control unit 23 outputs sound from the sound output unit 25 based on the determined sound information (step S106). For example, as shown in Figure 10, sound is output from the sound output unit 25.
[0099] [Examples of using other judgment information] The above example shows how to determine the audio information to be output using the judgment information shown in Figure 6. However, other judgment information may also be used to determine the audio information to be output. Therefore, here we will show an example using other judgment information.
[0100] Figure 12 shows an example of various types of information used when determining the information to be output by the electronic device 20 in the first embodiment.
[0101] Figure 12(1) shows an example of an image pattern relating to the surface of coffee accumulating in container 30. As shown in Figure 12(1), the image pattern expected to occur on the surface of coffee accumulating in container 30 is stored in the storage unit 24 as determination information. Note that in Figure 12(1), the image pattern is simplified for ease of explanation. The number of image patterns N (where N is a positive integer) may be increased or decreased according to the storage capacity of the storage unit 24.
[0102] Figure 12(2) shows an example of judgment information (table) used when determining the information to be output based on the information obtained using the judgment information (image patterns PA1~PAN) shown in Figure 12(1). The judgment information shown in Figure 12(2) is information that shows the correspondence between the transition of information about the coffee accumulating in container 30 (for example, the surface of the coffee (liquid) 41 accumulated in container 30) and the information to be output OI. Note that the judgment information shown in Figure 12(2) corresponds to the judgment information shown in Figure 6(2), and since the parts that are common with Figure 6(2) are the same as in Figure 6(2), the explanation here is omitted.
[0103] For example, the control unit 23 (shown in Figure 4) determines a circular region in the image acquired from the image acquisition unit 22 (shown in Figure 4) (a circular region corresponding to the surface of the coffee (liquid) 41 accumulated in the container 30). Next, the control unit 23 compares the image contained in the determined circular region with each image pattern PA1 to PAN in the judgment information shown in Figure 12(1), and extracts the image pattern with the highest degree of similarity as a feature.
[0104] For example, each pixel in each image pattern PA1 to PAN represents a binary value (black or white). The control unit 23 then determines each pixel in the image contained within the determined circular region to be either a black region or a white region (for example, binarization). Next, the control unit 23 compares each pixel (black or white) in the image contained within the determined circular region with each pixel (black or white) in each image pattern PA1 to PAN, comparing corresponding pixels (pixels at the same position in the circular region) and calculating the number of matching pixels for each image pattern PA1 to PAN. Next, the control unit 23 extracts the image pattern PA1 to PAN with the largest number of matching pixels as the image pattern with the highest degree of similarity.
[0105] Next, the control unit 23 stores the extracted image patterns PA1 to PAN in the storage unit 24, associating them with the elapsed time. For example, the control unit 23 stores the determined feature quantities (image patterns PA1 to PAN) for each image acquired at time intervals t1 to t8 in the storage unit 24, associating them with time intervals t1 to t8.
[0106] Next, the control unit 23 determines the information to be output from the audio output unit 25 based on the acquired feature quantities. For example, the control unit 23 extracts feature quantities that match the acquired feature quantities (for example, information relating time t1 to t8 to image patterns PA1 to PAN) from the determination information (table) shown in Figure 12(2). Next, the control unit 23 determines the information (information to be output) OI corresponding to the extracted feature quantities and determines the audio information stored in the storage unit 24 in relation to the determined information (information to be output OI).
[0107] [Example of using drip speed as judgment information] For example, the size transition of the circular region corresponding to the surface of the coffee (liquid) 41 accumulating in container 30 can be used as determination information. In other words, the dripping speed can be used as determination information.
[0108] For example, multiple sizes of circular regions corresponding to the surface of the coffee (liquid) 41 accumulated in container 30 are stored in the storage unit 24 as judgment information. The control unit 23 (shown in Figure 4) then compares the size of the circular region (the circular region corresponding to the surface of the coffee (liquid) 41 accumulated in container 30) in the image acquired from the image acquisition unit 22 (shown in Figure 4) with the multiple sizes stored in the storage unit 24, and extracts the size with the highest degree of similarity as a feature. Next, the control unit 23 stores the extracted size in the storage unit 24 in association with elapsed time. Next, the control unit 23 determines the information to be output from the audio output unit 25 based on the acquired feature. For example, the control unit 23 extracts a feature that matches the acquired feature (for example, information associating time t1~t8 with size) from the judgment information corresponding to Figures 6(2) and 12(2). Next, the control unit 23 determines the information (information to be output) OI corresponding to the extracted feature quantity, and determines the audio information stored in the storage unit 24 in association with the determined information (information to be output OI).
[0109] Alternatively, the height of the coffee (liquid) 41 accumulating in the container 30 may be used as judgment information. In this case, a sensor (for example, an ultrasonic distance sensor, or an image sensor that acquires an image of the side of the transparent container 30) for acquiring the height of the coffee (liquid) 41 accumulating in the container 30 is provided on the electronic device 20 or the coffee extractor 1, and the height of the coffee (liquid) 41 accumulating in the container 30 is acquired using this sensor.
[0110] [Example of using the direction of ripples and water droplets as information for determination] For example, various pieces of information such as the ripples created by water droplets (coffee) falling onto the surface of the coffee (liquid) 41 accumulating in container 30, the direction in which the water droplets (coffee) travel across the surface of the coffee (liquid) 41 accumulating in container 30, the length of their travel, and the amount of foam generated by the water droplets (coffee) falling onto the surface of the coffee (liquid) 41 accumulating in container 30 can be used as judgment information. In other words, natural phenomena occurring during the dripping process can be used as judgment information.
[0111] For example, when detecting ripples caused by water droplets (coffee) falling onto the surface of coffee (liquid) 41 accumulating in container 30, one or more ripple image patterns for identifying the ripples are stored in the storage unit 24. The control unit 23 (shown in Figure 4) then detects the occurrence of ripples when it finds an image matching a ripple image pattern among the images of a circular region (a circular region corresponding to the surface of the coffee (liquid) 41 accumulating in container 30) in the image acquired from the image acquisition unit 22 (shown in Figure 4). In this case, the control unit 23 can store the type of ripple (identifiable by the ripple image pattern), the location where the ripple occurred (the location in the circular region corresponding to the surface of the coffee (liquid) 41 accumulating in container 30), and the timing of the ripple occurrence (elapsed time) in the storage unit 24 in relation to the elapsed time. Next, the control unit 23 determines the information to be output from the audio output unit 25 based on the acquired feature quantities. For example, various pieces of information such as whether or not ripples occur, the number of times ripples occur, the type of ripples, the time of ripple occurrence, and the location of ripples can be stored in association with the information to be output OI. Based on this information, the information to be output OI can be determined, and the audio information stored in the storage unit 24 can be determined in association with the determined information (information to be output OI).
[0112] Furthermore, for example, when detecting the direction and length of movement of a water droplet (coffee) that has fallen onto the surface of the coffee (liquid) 41 accumulated in the container 30, the storage unit 24 stores judgment information for detecting the water droplet (for example, information for detecting an object moving in a straight line in each image in a time series). The control unit 23 (shown in Figure 4) then detects that a water droplet has occurred moving across the surface from the image of a circular region (a circular region corresponding to the surface of the coffee (liquid) 41 accumulated in the container 30) in the image acquired from the image acquisition unit 22 (shown in Figure 4). In this case, the control unit 23 can store in the storage unit 24 the position where the water droplet occurred (position in the circular region corresponding to the surface of the coffee (liquid) 41 accumulated in the container 30), the length of the water droplet that has moved across the surface, and the timing (elapsed time) when the water droplet occurred, associating these with the elapsed time. Next, the control unit 23 determines the information to be output from the audio output unit 25 based on the acquired feature quantities. For example, various pieces of information such as whether or not water droplets are moving across the surface, the number of times water droplets are moving across the surface, the total length of water droplets moving across the surface, the time it takes for water droplets to be formed, and the position of water droplets moving across the surface can be stored in association with the information to be output OI. Based on this various information, the information to be output OI can be determined, and the audio information stored in the storage unit 24 can be determined in association with the determined information (information to be output OI).
[0113] Furthermore, for example, when detecting the amount of foam generated by water droplets (coffee) falling onto the surface of the coffee (liquid) 41 accumulating in container 30, instead of the image pattern shown in Figure 12(1), multiple image patterns for detecting the amount of foam are stored in the storage unit 24. Then, audio information can be determined in the same way as the determination method using the judgment information shown in Figure 12(1).
[0114] The judgment information described above is merely an example, and other judgment information may be used. For example, the position (position on the surface) of a water droplet (coffee) falling onto the surface of the coffee (liquid) 41 accumulating in the container 30, the extent to which the water droplet spreads on the surface, the density of the surface of the coffee (liquid) 41 accumulating in the container 30 (for example, the degree of coffee color), the distribution of bubbles generated by the water droplet (coffee) falling onto the surface of the coffee (liquid) 41 accumulating in the container 30, the proportion of the surface occupied by those bubbles, and natural phenomena that occur during dripping, such as the transitions between these, can be used as judgment information. Furthermore, the judgment may be made by combining the judgment information described above. For example, the ripples created by the falling water droplet and the direction in which the water droplet travels can be combined for judgment.
[0115] Furthermore, while the first embodiment shows an example where the electronic device 20 is configured as a single unit, the electronic device 20 may also be composed of multiple components. For example, the lens 21 and image acquisition unit 22 may be configured separately from the other parts, and image information may be transmitted from the image acquisition unit 22 to the control unit 23 by wire or wireless. Also, the position in which the electronic device 20 is installed is not limited to the positions shown in Figures 1 and 3. For example, it may be installed in other locations as long as an image of the surface of the coffee (liquid) 41 accumulating in the container 30 can be acquired via the lens 21. For example, the electronic device 20 may be installed on the outside of the transparent container 30 so that the lens 21 faces the surface of the coffee (liquid) 41 accumulating in the container 30. However, it is preferable to apply heat insulation treatment with heat insulating material or the like to prevent the effects of heat generated in the container 30.
[0116] [Second embodiment: An example of providing audio and image information using the colors and patterns formed when brewing coffee] In the first embodiment, an example was shown in which audio information is provided using the colors and patterns formed when coffee is brewed, but it is also possible to provide other information. Therefore, in the second embodiment, an example is shown in which audio information and image information are provided using the colors and patterns formed when coffee is brewed. Note that the second embodiment is a modification of the first embodiment, and some of the explanations of parts common to the first embodiment will be omitted.
[0117] [Example of the external configuration of a coffee brewing machine] Figure 13 is a perspective view showing an example of the external configuration of the coffee brewer 200 to which the electronic device 220 in the second embodiment is attached. Figure 13(1) shows a side view of the coffee brewer 200, and Figure 13(1) shows a side view of the coffee brewer 200 (a side view as seen from the direction of arrow A shown in Figure 13(1)).
[0118] The coffee brewer 200 comprises a dripper 210, an electronic device 220 (shown in Figure 14), a container 230, and a stand 240. The coffee brewer 200 is similar to the coffee brewer 1 shown in Figure 1, but with the electronic device 220 mounted on the stand 240 instead of the electronic device 20 mounted on the dripper 10. The container 230 is the same as the container 30 shown in Figure 1. The dripper 210 is substantially the same as the dripper 10 shown in Figures 1 and 3. This explanation will focus on the differences between the coffee brewer 200 and the coffee brewer 1 in the first embodiment.
[0119] The stand 240 is a support base for the dripper 210, and can be formed from a flat plate-shaped member in a U-shape (as shown in Figure 13(1)). For example, the upper part of the stand 240 (the part where the flange portion 212 shown in Figure 13(1) is installed) is provided with a hole that is larger in diameter than the lower leg portion 213 of the dripper 210 and smaller in diameter than the flange portion 212 of the dripper 210 (for example, circular). When installing the dripper 210 on the stand 240, it can be installed so that the lower leg portion 213 of the dripper 210 fits into the hole in the stand 240.
[0120] Furthermore, the lens 221 is positioned outside the hole in the upper part of the stand 240 (the part where the flange portion 212 shown in Figure 13(1) is installed). It is preferable to install the lens 221 in a position where it is not exposed to the liquid (coffee) falling from the hole of the dripper 210 (inside the leg portion 213) and is not significantly affected by the heat of that liquid.
[0121] Furthermore, a user interface 229 is located on the middle (rear) part of the stand 240. The user interface 229 can be configured, for example, as a touch panel that displays various information and accepts user input. The stand 240 can be made from materials such as heat-resistant glass, ceramics, metal, resin, or wood.
[0122] [Example of electronic device functional configuration] Figure 14 is a block diagram showing an example of the functional configuration of the electronic device 220 in the second embodiment.
[0123] The electronic device 220 includes a lens 221, an image acquisition unit 222, a control unit 223, a storage unit 224, an audio output unit 225, and a user interface 229. The electronic device 220 is the same as the electronic device 20 shown in Figure 4, but with the addition of the user interface 229. Therefore, this explanation will focus on the differences between the electronic device 20 and the electronic device 20 shown in Figure 4. As shown in Figure 13, the lens 221 and image acquisition unit 222 are mounted on the top of the stand 240, and the user interface 229 is mounted on the middle (rear) of the stand 240. The other components may be mounted together with the user interface 229 on the middle (rear) of the stand 240, or they may be mounted on the bottom or top of the stand 240.
[0124] The user interface 229 consists of an input unit (operation reception unit) 226 and a display unit 227.
[0125] The input unit 226 is an operation reception unit that receives operation inputs made by the user and outputs operation information corresponding to the received operation inputs to the control unit 223. The input unit 226 can be implemented by, for example, a touch panel, keyboard, mouse, or sensor (for example, a touch interface).
[0126] The display unit 227 is a display unit that outputs various information based on the control of the control unit 223. For example, the display unit 227 can be an OLED (Electro-Luminescence) panel, an LCD (Liquid Crystal Display) panel, or other display panel. Thus, the input unit 226 and the display unit 227 can be integrated using a touch panel that allows the user to perform operation input by touching or bringing their finger close to the display surface. However, the input unit 226 and the display unit 227 may be configured as separate components, and the input unit 226 may accept operation via an operating member. Alternatively, an operating member separate from the user interface 229, such as a touch panel, may be provided, and operation may be accepted via this operating member.
[0127] [Example of information to be output] Figure 15 shows an example of information to be output by the electronic device 220 in the second embodiment. In this example, the judgment information shown in Figures 6(1) and 6(2) is used.
[0128] Figure 15 shows an example of output information (information to be output) determined using the judgment information shown in Figure 6(2). For example, if OI1 is determined as the output information OI, then information related to Santa (audio information 61, image information 62) will be output. Information related to Santa includes, for example, information for outputting the audio "Today let's dream of our beloved Santa" (audio information 61) and information for displaying a picture or graphic image of Santa (image information 62). In Figure 15, for the sake of clarity, the characters to be output as audio and the images to be displayed are simply shown. For more detailed examples of these outputs, please refer to Figure 17.
[0129] [An example of determining information to be output using the colors and patterns formed when brewing coffee] Figure 16 shows an example of a decision made by the electronic device 220 in the second embodiment to determine the information to be output. The example shown in Figure 16, like the example shown in Figure 9, shows an example in which time t1 to t8 is used as the elapsed time when brewing coffee using the coffee extractor 200. Also, Figures 16(1) and 16(2) are the same as Figures 9(1) and 16(2).
[0130] As shown in the first embodiment, the control unit 223 (shown in Figure 14) extracts the feature quantities shown within the dashed rectangle 51 from the determination information shown in Figure 16(2) as feature quantities that match the feature quantities shown in Figure 16(1). The control unit 223 also determines OIX1 as the information (information to be output) OI corresponding to the extracted feature quantities.
[0131] Next, the control unit 223 outputs audio from the audio output unit 225 based on the audio information 61 stored in the storage unit 224 in association with the OIX1 determined to be the information OI to be output. The control unit 223 also displays an image on the display unit 227 based on the image information 62 stored in the storage unit 224 in association with the OIX1 determined to be the information OI to be output.
[0132] For example, as shown in Figure 16(3), based on the audio information 61 associated with OIX1 (shown within the dashed rectangle 54), the audio output unit 225 outputs the phrase "Today, let's wait patiently like a snowman." Also, as shown in Figure 16(3), based on the image information 62 associated with OIX1 (shown within the dashed rectangle 54), an image of Santa is displayed on the display unit 227. An example of this output is shown in Figure 17.
[0133] [Example of outputting audio and image information from an electronic device when brewing coffee] Figure 17 is a simplified diagram showing an example of outputting audio and image information from the electronic device 220 in the second embodiment. The example shown in Figure 17 shows an example of outputting audio information determined by the examples shown in Figures 8 and 16.
[0134] As described above, the control unit 223 outputs the voice message "Let's wait patiently like a snowman today" from the voice output unit 25 based on the voice information 61 associated with OIX1 (within the dashed rectangle 54 shown in Figure 16(3)). The control unit 223 also displays an image of Santa on the display unit 227 based on the image information 62 associated with OIX1 (within the dashed rectangle 54 shown in Figure 16(3)). As a result, user P1, who is brewing coffee using the coffee brewer 200, can enjoy the voice and image based on the features obtained from the brewing process after brewing their ideal cup of coffee. In this way, by displaying an image along with the voice, user P1 can also visually enjoy the information based on the features obtained from the brewing process. Note that Figure 17 shows an example where voice and image are output simultaneously, but the voice and image may be output at different times, or only the image may be output.
[0135] [Example of operation that outputs audio and image information] Figure 18 is a flowchart showing an example of information output processing by the electronic device 220 in the second embodiment. Steps S112 to S115 shown in Figure 18 correspond to steps S101 to S104 shown in Figure 11. Therefore, this explanation will focus on the differences from the example shown in Figure 11.
[0136] First, the control unit 223 of the electronic device 220 determines whether or not a start operation has occurred (step S111). For example, it determines whether or not the start button (shown in Figure 13(2)) on the user interface 229 has been touched. If a start operation has occurred (step S111), the process proceeds to step S112. If no start operation has occurred (step S111), monitoring continues.
[0137] As described above, steps S112 to S115 correspond to steps S101 to S104 shown in Figure 11.
[0138] Here, as a criterion for determining whether or not the termination condition of step S115 is met, in addition to the criterion shown in the first embodiment, it is also possible to determine, for example, whether or not a termination operation has been performed by the user. For example, the termination button may be displayed after the start button (shown in Figure 13(2)) is touched on the user interface 229, and it may be determined that the termination condition is met when this termination button is touched.
[0139] If the termination condition is met (step S115), the control unit 223 determines the information to be output based on the acquired feature quantities (step S116). That is, the control unit 223 determines the audio information and image information stored in the storage unit 224 in association with the determined information (information to be output OI).
[0140] Next, the control unit 223 outputs sound from the sound output unit 225 based on the determined sound information, and displays an image on the user interface 229 (display unit 227) based on the determined image information (step S117). For example, as shown in Figure 17, sound is output from the sound output unit 225 and an image is displayed on the user interface 229 (display unit 227).
[0141] [Third Embodiment: An example of outputting audio and image information using an external device] In the first and second embodiments, examples were shown in which audio and image information is output by an electronic device attached to a coffee maker. However, audio and image information may also be output from a device other than a coffee maker. This eliminates the need to provide an audio output unit and a display unit in the electronic device attached to the coffee maker, thereby reducing the manufacturing cost of the electronic device. The third embodiment is a modification of the first and second embodiments, and some parts of the explanation of the parts common to the first and second embodiments will be omitted.
[0142] [Example of electronic device functional configuration] Figure 19 is a block diagram showing an example of the functional configuration of the electronic device 320 in the third embodiment.
[0143] The electronic device 320 includes a lens 321, an image acquisition unit 322, a control unit 323, a storage unit 324, and a communication unit 325. The electronic device 320 is the same as the electronic device 20 shown in Figure 4, but with the communication unit 325 added and the audio output unit 25 omitted. Other parts are common to the electronic device 20 shown in Figure 4 and the electronic device 220 shown in Figure 14. Therefore, this explanation will focus on the differences between the electronic device 320 and the electronic device 20 shown in Figure 4 and Figure 14. Note that although not shown in Figure 19, an audio output unit and a user interface may also be provided.
[0144] The communication unit 325, based on the control of the control unit 323, exchanges various types of information with other devices via wired or wireless lines. For example, when exchanging various types of information using wireless communication, the communication unit 325 transmits and receives radio waves via an antenna (not shown). For example, the communication unit 325 can perform wireless communication using wireless LAN (Local Area Network) (e.g., Wi-Fi (Wireless Fidelity)), NFC (Near Field Communication), Bluetooth (registered trademark), infrared, mobile phone radio waves, etc. The communication unit 325 can be implemented by, for example, a communication module equipped with an antenna and wireless communication function, or a communication module equipped with wired communication function.
[0145] [Example of external equipment configuration] Figure 20 is a perspective view showing an example of the external configuration of external devices (electronic devices 350, 360) in the third embodiment. Figure 20(1) shows a portable electronic device 350. The electronic device 350 is a portable information processing device, such as a smartphone, tablet terminal, or personal computer. Figure 20(2) shows a stationary electronic device 360. The electronic device 360 is a stationary speaker device, such as an AI speaker equipped with artificial intelligence (AI), or a speaker with wireless communication capabilities.
[0146] [Example of electronic device functional configuration] Figure 21 is a block diagram showing an example of the functional configuration of the electronic device 350 in the third embodiment. Note that the functional configuration of the electronic device 360 shown in Figure 20 is substantially the same as that of the electronic device 350, and therefore its explanation is omitted here.
[0147] The electronic device 350 includes a communication unit 351, a control unit 352, a storage unit 353, an audio output unit 354, a user interface 357 (input unit 355, display unit 356), and a location information acquisition unit 358. Each unit in the electronic device 350 corresponds to the unit with the same name in the electronic device 20 shown in Figure 4 and the electronic device 220 shown in Figure 14. Therefore, this explanation will focus on the differences between the electronic device 350 and the electronic device 20 shown in Figure 4 and the electronic device 220 shown in Figure 14. The communication unit 351 in the electronic device 350 can perform wireless communication with electronic devices within a predetermined range, and can also perform wireless communication by connecting to a predetermined network (e.g., the Internet) via a base station installed by a telecommunications carrier such as a mobile phone company.
[0148] The location information acquisition unit 358 acquires location information relating to the location of the electronic device 350 and outputs the acquired location information to the control unit 352. The location information acquisition unit 358 can be implemented, for example, by a GPS receiver that receives GPS (Global Positioning System) signals and calculates location information based on those GPS signals. The calculated location information includes various location data such as latitude, longitude, and altitude at the time of receiving the GPS signal. Alternatively, a location information acquisition device that acquires location information using other methods may be used. For example, a location information acquisition device that derives location information using access point information from a nearby wireless LAN (Local Area Network) and acquires this location information may be used.
[0149] [Communication when outputting audio and image information from external devices other than electronic devices] Figure 22 is a flowchart showing an example of communication processing by electronic devices 320 and 350 in the third embodiment. Steps S122 to S126 shown in Figure 22 correspond to steps S112 to S116 shown in Figure 18. Therefore, this explanation will focus on the differences from the example shown in Figure 18. It is also assumed that electronic devices 320 and 350 have applications (programs) pre-configured to implement each of the processes shown in Figure 22.
[0150] First, the control unit 323 of the electronic device 320 detects a start instruction (step S121). If the electronic device 320 is equipped with a start operation member (not shown), this start instruction is detected when the user operates the start operation member. Alternatively, the user can perform a start operation using the electronic device 350, and the electronic device 350 can transmit start instruction information to the electronic device 320 in response to this start operation. In this case, the start instruction is detected when the start instruction information from the electronic device 350 is received. Furthermore, the electronic device 320 may be equipped with sensors for detecting start instructions (e.g., a human detection sensor, a temperature sensor, a water droplet sensor, a vibration sensor), and the start instruction may be automatically detected by these sensors.
[0151] As described above, steps S122 to S126 correspond to steps S112 to S116 shown in Figure 18.
[0152] The control unit 323 determines the information to be output (audio information and image information) (step S126). Next, the communication unit 325 transmits the determined audio information and image information to the electronic device 350 based on the control unit 323 (step S127).
[0153] The communication unit 351 of the electronic device 350 receives information (voice information and image information) transmitted from the electronic device 320 (step S128). Next, the control unit 352 of the electronic device 350 stores the received information (voice information and image information) in the storage unit 353 (step S129). Then, the control unit 352 of the electronic device 350 outputs the received information (voice information and image information) (step S129). That is, the control unit 352 of the electronic device 350 outputs voice from the voice output unit 354 based on the received voice information, and displays an image on the user interface 357 (display unit 356) based on the received image information (step S129). For example, as shown in Figure 23(1), voice is output from the voice output unit 354 and an image is displayed on the user interface 357 (display unit 356).
[0154] [Example of outputting audio and image information from a device other than an electronic device attached to a coffee maker] Figure 23 is a simplified diagram showing an example of outputting audio and image information from devices other than the electronic device 220 (electronic devices 350, 360) in the third embodiment. Figure 23(1) shows an example of outputting audio and image information from electronic device 350. Figure 23(2) shows an example of outputting audio and image information from electronic device 360. Note that the examples shown in Figure 23 show examples of outputting audio information determined by the examples shown in Figures 8 and 16.
[0155] Furthermore, it is assumed that electronic devices 350 and 360 have pre-configured applications (programs) for implementing each of the processes shown in Figure 22.
[0156] As shown in the second embodiment, the control unit 323 of the electronic device 320 determines that the audio information 61 (within the dashed rectangle 54 shown in Figure 16(3)) and image information 62 (within the dashed rectangle 54 shown in Figure 16(3)) associated with OIX1 are to be output. Next, the control unit 323 of the electronic device 320 controls the wireless transmission of the audio information 61 (within the dashed rectangle 54 shown in Figure 16(3)) and image information 62 (within the dashed rectangle 54 shown in Figure 16(3)) determined to be output to an external device via the communication unit 325.
[0157] For example, when outputting audio and image information from the electronic device 350, the control unit 323 of the electronic device 320 controls the wireless transmission of the audio information 61 (within the dashed rectangle 54 shown in Figure 16(3)) and image information 62 (within the dashed rectangle 54 shown in Figure 16(3)), which have been determined as the information to be output, from the communication unit 325 to the electronic device 350. Upon receiving this information, the control unit 352 of the electronic device 350 outputs the audio "Let's wait patiently like a snowman today" from the audio output unit 354 based on the received audio information. The control unit 352 also displays an image of Santa on the user interface 357 (display unit 356) based on the received image information. As a result, user P1, who is brewing coffee using the coffee brewer 300, can enjoy the audio and images based on the features acquired during the brewing process, even when away from the coffee brewer 300, while savoring the coffee after brewing their ideal cup. Furthermore, for example, user P1 can store the audio output and the displayed image of Santa in the memory unit 353 of the electronic device 350 and enjoy them later.
[0158] Furthermore, for example, when outputting audio information from the electronic device 360, the control unit 323 of the electronic device 320 controls the wireless transmission of the audio information 61 (within the dashed rectangle 54 shown in Figure 16(3)), which has been determined as the information to be output, from the communication unit 325 to the electronic device 360. Upon receiving this audio information, the control unit of the electronic device 360 outputs the voice "Today, let's wait patiently like a snowman" from the audio output unit based on the received audio information. As a result, user P1, who is brewing coffee using the coffee brewer 300, can enjoy the audio based on the features acquired during the brewing process, even when away from the coffee brewer 300, while savoring the coffee after brewing his ideal cup.
[0159] The above describes an example of outputting audio and images from electronic devices 350 and 360 that can directly communicate wirelessly with electronic device 320. However, audio and images may also be output from devices that cannot directly communicate wirelessly with electronic device 320. For example, in electronic device 320, each piece of information (audio information, image information) determined to be output is wirelessly transmitted from the communication unit 325 to electronic devices 350 and 360. Electronic devices 350 and 360, having received this information (audio information, image information), then forward the information (audio information, image information) received from electronic device 320 to a predetermined device (for example, a device instructed as a destination by electronic device 320, or a device pre-set as a destination). For example, electronic devices 350 and 360 can use wireless communication to connect to a predetermined network (for example, the Internet) and transmit the information (audio information, image information) received from electronic device 320 to a predetermined destination. This allows, for example, user P1, who is brewing coffee using coffee brewer 300, to provide audio and images based on the features acquired during the brewing process to a person located far away from the coffee brewer 300 after brewing their ideal cup of coffee (for example, from an electronic device owned by that person).
[0160] [Fourth embodiment: An example of having a portion of the processing performed by an electronic device attached to a coffee brewer be handled by another electronic device.] In the first to third embodiments, examples were shown in which the information to be output is determined by an electronic device attached to a coffee brewer. Here, it is also conceivable that the electronic device attached to the coffee brewer perform only relatively simple processing, and other processing is performed by other devices with higher processing capabilities. Therefore, in the fourth embodiment, an example is shown in which some of the processing performed by the electronic device attached to the coffee brewer is performed by other electronic devices.
[0161] The fourth embodiment will be described with reference to the electronic device 320 (shown in Figure 19) and electronic device 350 (shown in Figure 21) shown in the third embodiment.
[0162] For example, an electronic device 320 (shown in Figure 19) attached to a coffee extractor 300 (shown in Figure 23) performs the process of acquiring an image of the surface of the coffee (liquid) accumulating in a container 330 (shown in Figure 23). The electronic device 320 then sequentially transmits the acquired image information (image of the surface of the coffee (liquid) accumulating in the container 330) from a communication unit 325 (shown in Figure 19) to an electronic device 350, either periodically or irregularly.
[0163] The storage unit 353 (shown in Figure 21) of the electronic device 350 stores the determination information shown in the first to third embodiments (for example, the determination information shown in Figures 6(1) and 6(2), and the determination information shown in Figures 12(1) and 12(2)) and the output target information (for example, the output target information shown in Figure 7 and Figure 15). The control unit 352 (shown in Figure 21) of the electronic device 350 sequentially stores the image information (image of the surface of the coffee (liquid) accumulating in the container 330) received from the electronic device 320 via the communication unit 351 in the storage unit 353. Next, the control unit 352 (shown in Figure 21) of the electronic device 350 uses the determination information stored in the storage unit 353 to perform a determination process for the output target information regarding the image information (image of the surface of the coffee (liquid) accumulating in the container 330) received from the electronic device 320. Next, the control unit 352 of the electronic device 350 outputs each piece of information determined by the determination process.
[0164] For example, as shown in Figure 23(1), the control unit 352 of the electronic device 350 outputs the voice message "Let's wait patiently like a snowman today" from the voice output unit 354 based on the voice information determined by the decision process. The control unit 352 also displays an image of Santa on the user interface 357 (display unit 356) based on the image information determined by the decision process.
[0165] [Example of communication when performing a series of processes using multiple electronic devices] Figure 24 is a flowchart showing an example of communication processing by electronic devices 320 and 350 in the fourth embodiment. Steps S131, S133, S135, and S143-S146 shown in Figure 24 correspond to steps S121-S126 shown in Figure 22. Therefore, this explanation will focus on the differences from the example shown in Figure 22.
[0166] When the control unit 323 of the electronic device 320 detects a start instruction (step S131), it transmits start information from the communication unit 325 to the electronic device 350 to notify it of the start of operation (step S132).
[0167] When the control unit 352 of the electronic device 350 receives the start information via the communication unit 351, it recognizes that the electronic device 320 has started operating (step S141).
[0168] The control unit 323 of the electronic device 320 acquires the image acquired by the image acquisition unit 322 (an image of the coffee accumulating in the container 330 (including image data)) (step S133), and transmits the acquired image information to the electronic device 350 (step S134). In this case, the transmission of image information from the electronic device 320 to the electronic device 350 may be performed periodically or irregularly.
[0169] Step S135 shown in Figure 24 corresponds to step S125 shown in Figure 22.
[0170] When the control unit 352 of the electronic device 350 receives image information from the electronic device 320 (step S142), it analyzes the received image information and obtains feature quantities (step S143). Steps S143 to S146 shown in Figure 24 correspond to steps S123 to S126 shown in Figure 22.
[0171] Here, as a criterion for determining whether or not the termination condition in step S145 is met, in addition to the criterion shown in the first to third embodiments, for example, the criterion for determining whether or not image information has not been received from the electronic device 320 for a predetermined period of time or longer may be used. For example, if image information has not been received from the electronic device 320 for a predetermined period of time or longer, the control unit 352 of the electronic device 350 can determine that the termination condition is met (step S145).
[0172] The control unit 352 of the electronic device 350 determines the information to be output (audio information and image information) (step S146). Next, the control unit 352 of the electronic device 350 outputs the determined audio information and image information (step S147). That is, the control unit 352 of the electronic device 350 outputs audio from the audio output unit 354 based on the determined audio information, and displays an image on the user interface 357 (display unit 356) based on the determined image information (step S147). For example, as shown in Figure 23, audio is output from the audio output unit 354 and an image is displayed on the user interface 357 (display unit 356).
[0173] The above examples show how the judgment information shown in Figures 6 and 12, and the output target information shown in Figures 7 and 15, are pre-stored in the memory units 24, 224, and 324 of the electronic devices 20, 220, and 320. However, this information may also be acquired and used from an external source. For example, a communication unit (e.g., the communication unit 325 shown in Figure 19) capable of communicating with other devices via a wired or wireless line may be provided in the electronic device, and this communication unit may be connected to an external device (or a predetermined network (e.g., the Internet)) to acquire all or part of the information from the external device. In this case, the information may be acquired and used each time the coffee maker (electronic device) is used, or it may be acquired and used periodically or irregularly.
[0174] Furthermore, the above examples illustrate how the various determination information shown in Figures 6 and 12, and the output target information shown in Figures 7 and 15, are pre-stored in the memory units 24, 224, and 324 of electronic devices 20, 220, and 320 (or other nearby devices), and how the electronic devices 20, 220, and 320 (or other nearby devices) perform the various processes necessary to output the content. However, it is also possible to store this information in an external device located remotely (for example, a server), have that external device perform the various processes necessary to output the content, and have the electronic devices 20, 220, and 320 (or other nearby devices) only acquire information related to coffee extraction and output the content.
[0175] Alternatively, for example, a system could partner with a specific service provider (e.g., a company that provides specific content or discount coupons) to output the target image. For example, a system could receive a specific image transition (e.g., an image pattern (shown in Figure 12(1))) from a specific service provider, and if it matches, the system could output information provided by the specific service provider (e.g., discount coupons, specific content) from the electronic device.
[0176] Alternatively, users can register information to be output, and the system can determine which information to output from the registered information through a decision process. For example, the user can register (remember) the information to be output on the day they brewed coffee using the coffee maker (e.g., Santa) in association with their activity history for that day (e.g., went to an amusement park, took an English exam, etc.). Then, later, when the user brews coffee using the coffee maker, if the information determined to be output is the same as the registered information to be output (e.g., Santa), the system will output that information (e.g., Santa) and the information related to their activity history for that day (e.g., went to an amusement park, took an English exam, etc.). This allows the user to enjoy the taste of coffee while recalling what they did on days when they brewed coffee with the same pattern in the past. It also allows the user to enjoy coffee while feeling the same emotions as on days when they brewed coffee with the same pattern in the past, and reflecting on various things.
[0177] Alternatively, artificial intelligence (AI) can be used to determine the content to be output. For example, machine learning can be used to generate judgment information based on the pattern of brewing coffee using a coffee maker (e.g., the pattern of changes on the surface of the coffee) and the user's mood and physical condition on that day (e.g., determined by search and movement history on a smartphone, etc.), and this generated judgment information can be used to determine the content to be output. For example, content showing a smile could be output when the user is in a good mood, and content that cheers them up could be output when they are in a bad mood. In this way, content can be output using some feature quantity related to the surface of coffee brewed when the user is in a good mood and the surface of coffee brewed when the user is in a bad mood, and the user's mood at that time can be estimated.
[0178] [Fifth Embodiment: An Example of Aggregating Information from Multiple Coffee Makers] In the first to fourth embodiments, examples were shown of outputting audio and image information using information acquired by a single coffee brewer (information related to coffee brewing). In recent years, coffee brewers have become widespread in homes around the world. And in each home, coffee is brewed according to each family's preferences. Therefore, it is thought that if information about the coffee brewed in each home can be collected and some kind of information can be provided to each home based on this information, the enjoyment of brewing coffee can be enhanced. Similarly, it is thought that if information about coffee brewed outside the home, such as in the workplace or school, can be collected and some kind of information can be provided to the relevant parties based on this information, the enjoyment of brewing coffee can be enhanced. Therefore, in the fifth embodiment, an example is shown of aggregating and using information from multiple coffee brewers.
[0179] [Example of a communication system configuration] Figure 25 is a diagram showing an example of the system function configuration of the communication system 400 in the fifth embodiment.
[0180] The communication system 400 includes a server 410, a network 420, and electronic devices 431, 441, 442, 451, and 452. While base stations and access points for wireless communication may also be considered as components of the communication system 400, their illustrations and descriptions are omitted here.
[0181] Server 410 is an information processing device that aggregates and manages information transmitted from electronic devices 431, 441, and 451, and uses the managed information to provide various types of information to electronic devices 431, 441, 442, 451, and 452.
[0182] Network 420 refers to networks such as public telephone networks and the Internet.
[0183] Electronic device 431 is attached to coffee brewer 430, electronic device 441 is attached to coffee brewer 440, and electronic device 451 is attached to coffee brewer 450. In addition, electronic device 442 communicates wirelessly with electronic device 441, and electronic device 452 communicates wirelessly with electronic device 451.
[0184] Furthermore, electronic device 431 has a communication unit (corresponding to the communication unit 325 shown in Figure 19) and can connect to the network 420 using wireless communication to exchange information. Also, electronic devices 441 and 451 each have a communication unit (corresponding to the communication unit 325 shown in Figure 19) and can exchange information with other devices (electronic devices 442 and 452) using wireless communication. And electronic devices 441 and 451 each can connect to the network 420 via other devices (electronic devices 442 and 452) using wireless communication to exchange information.
[0185] [Example of electronic device functional configuration] Figure 26 is a block diagram showing an example of the functional configuration of the electronic device 431 in the fifth embodiment. Note that the functional configurations of the electronic devices 441 and 451 shown in Figure 25 are substantially the same as those of electronic device 431, except that they do not have a user interface, and therefore their explanation is omitted here. Similarly, the functional configurations of the electronic devices 442 and 452 shown in Figure 25 are substantially the same as those of electronic device 431, and therefore their explanation is omitted here.
[0186] The electronic device 431 includes a lens 481, an image acquisition unit 482, a control unit 483, a storage unit 484, an audio output unit 485, a user interface 488 (input unit 486, display unit 487), and a communication unit 489. Each part of the electronic device 431 corresponds to the parts with the same names in the electronic device 20 shown in Figure 4, the electronic device 220 shown in Figure 14, and the electronic device 320 shown in Figure 19. Therefore, this explanation will focus on the differences between the electronic device 431 and the electronic device 20 shown in Figure 4, the electronic device 220 shown in Figure 14, and the electronic device 320 shown in Figure 19. The communication unit 489 in the electronic device 431 can perform wireless communication with electronic devices within a predetermined range, and can also connect to a predetermined network (e.g., the Internet) via a base station installed by a telecommunications carrier such as a mobile phone company to communicate.
[0187] The location information setting unit 490 sets location information relating to the location where the electronic device 431 is located and outputs the set location information to the control unit 483. The location information setting unit 490 stores, for example, location information relating to the location where the coffee maker 430 to which the electronic device 431 is attached is installed (for example, latitude and longitude, region name (country, administrative division)). For example, location information relating to the location where the coffee maker 430 is installed is acquired by user operation or by a location information acquisition unit (for example, a built-in GPS receiver).
[0188] [Example of server functional configuration] Figure 27 is a block diagram showing an example of the functional configuration of the server 410 in the fifth embodiment.
[0189] The server 410 includes a communication unit 411, a control unit 412, and a storage unit 413.
[0190] The communication unit 411, based on the control of the control unit 412, exchanges various types of information with other devices via wired or wireless lines. For example, the communication unit 411 exchanges various types of information with electronic devices 431, 441, 442, 451, and 452 via the network 420.
[0191] The control unit 412 controls each part of the server 410 based on the control program stored in the memory unit 413. The control unit 412 is implemented, for example, by a CPU (Central Processing Unit).
[0192] The storage unit 413 is a memory that stores various types of information. For example, the storage unit 413 stores various types of information (e.g., control programs) necessary for the server 410 to perform various processes. The storage unit 413 also stores management information for managing the information acquired by the communication unit 411 via the network 420 (information transmitted from electronic devices 431, 441, and 451). Furthermore, the storage unit 413 stores content to be provided to each electronic device (electronic devices 431, 441, and 451) connected via the network 420.
[0193] [Example of management information structure] Figure 28 shows an example of management information stored in the storage unit 413 in the fifth embodiment. Figure 28(1) shows an example of management information to be managed by the server 410. Figure 28(2) shows an example of content provided from the server 410 to each electronic device.
[0194] The management information shown in Figure 28(1) consists of terminal identification information 461, reception time 462, reception information 463, judgment result information 464, and provided content information 465. This information (terminal identification information 461, reception time 462, reception information 463) is transmitted from each electronic device connected to the server 410 and sequentially stored in the storage unit 413 by the control unit 412.
[0195] Terminal identification information 461 is identification information (e.g., device-specific ID (identification), MAC (Media Access Control) address) used to identify each electronic device. For example, terminal identification information 461 is identification information used to identify the electronic device to which content will be sent. In Figure 28, for the sake of simplicity, terminal identification information is represented by a simplified combination of letters and numbers.
[0196] The reception time 462 is information about the time when information was received from each electronic device connected to the server 410. The management information shown in Figure 28(1) sequentially stores each piece of information received during a predetermined time period (for example, one day based on a specific location on Earth).
[0197] The received information 463 is information transmitted from each electronic device connected to the server 410. This received information is, for example, information transmitted from each electronic device based on a predetermined rule. For example, if a determination process is performed using the determination information shown in Figure 6 as the predetermined rule, then a portion of the information shown within the dashed rectangle 51 in Figure 9(2) (for example, the information to be output OI(OIX1)) is transmitted. In this case, the information to be output OI(OIX1) is stored as the received information 463. Other information (for example, the information shown in Figure 9(1) (the letters A, A, D, E, F, E, I, F and their order)) may also be transmitted and stored in the received information 463.
[0198] The determination result information 464 stores the result determined by the control unit 412 based on the information stored in the received information 463. For example, the control unit 412 of the server 410 (shown in Figure 27) determines identification information (e.g., a serial number) to be assigned to each electronic device based on the information stored in the received information 463. For example, the control unit 412 can convert the information stored in the received information 463 (received information of each electronic device) into comparable numerical values (for example, numerical values (1, 2, 3, ...) in the order of the output target information OI shown in Figure 6(2) (OI1, OI2, OI3, ...)) based on a predetermined rule, and determine identification information (e.g., a serial number) to be assigned to each electronic device based on a comparison of these numerical values.
[0199] Alternatively, identification information (e.g., a serial number) to be assigned to each electronic device may be determined based on other rules. For example, the control unit 412 can determine identification information (e.g., a serial number) to be assigned to each electronic device based on the information stored in the reception time 462 and reception information 463. For example, the control unit 412 can determine a value to multiply the numerical value specified by the reception information 463 based on the reception time 462 (for example, 1, 2, 3, ... in order of earliest reception time), and then determine identification information (e.g., a serial number) to be assigned to each electronic device based on the results of these calculations. Furthermore, for example, the control unit 412 can perform calculations on the information stored at the reception time 462 based on a predetermined rule (for example, in the case of 20171204 07:56, simply adding the digits together to get "35"), and determine identification information (e.g., a serial number) to be assigned to each electronic device based on the calculation result (e.g., multiplication, addition, subtraction, division) between this calculation result and the number specified by the reception information 463. In this way, a rule is set that allows identification information (e.g., a serial number) to be assigned to each electronic device, and the identification information (e.g., a serial number) to be assigned to each electronic device is determined based on this rule. Thus, the identification information (e.g., a serial number) assigned to each electronic device does not indicate superiority of the electronic device (or its user, or the coffee brewed by that user), but rather represents identification information for assigning content.
[0200] The provided content information 465 is information for identifying content determined based on the information stored in the judgment result information 464. If the number of electronic devices to be managed is the same as the number of content items that can be provided to those devices, or if the number of content items that can be provided to those devices is greater than the number of electronic devices to be managed, then there is a one-to-one correspondence between the values in the judgment result information 464 and the information in the provided content information 465. However, if the number of content items that can be provided to those electronic devices is less than the number of electronic devices to be managed, then one piece of information in the provided content information 465 will correspond to multiple values in the judgment result information 464. In other words, the same content may be provided to multiple electronic devices. The provided content information 465 corresponds to the provided content information 471 shown in Figure 28(2).
[0201] The content management information shown in Figure 28(2) consists of provided content information 471 and content 472.
[0202] Content 472 is content provided to the electronic device that transmitted the information to be stored in the received information 463. The content can be, for example, content consisting only of audio, content consisting of audio and images, content consisting of audio and video, content related to smell, taste, touch, etc. Also, as shown in Figure 28(2), the content can be each of the characters A, B, C, ..., XYZ of an anime that has multiple types of characters. In this case, each character may be provided in a way that prevents duplicate provision so that the same character is not provided to different electronic devices, or some characters may be provided in a way that prevents duplicate provision so that the same character is provided to some electronic devices.
[0203] Furthermore, the content may include information about at least one movie from among multiple types of movie information (e.g., movie promotional videos, brochures). Furthermore, the content may include information about at least one music from among multiple types of music (e.g., singer videos, concert videos). Furthermore, the content may include information about at least one travel destination (e.g., Kusatsu Onsen, Ikaho Onsen) from among multiple types of travel destination information (places, landmarks, transportation, discount coupons, etc.). Furthermore, the content may include at least one of multiple discount coupons, vouchers, or discount coupons usable on the internet. Furthermore, the content may include information about at least one store from among multiple store discount coupons, vouchers, or discount coupons. Furthermore, the content may include information about point programs at at least one store from among multiple store point programs. Furthermore, the content may include information about fortune-telling (e.g., today's coffee fortune-telling). Thus, the content can be information about one or more of the following: anime characters, animals (e.g., animals appearing in a movie, an amusement park at the travel destination), people (e.g., characters in a movie, celebrities at the travel destination), plants (e.g., local specialties at the travel destination, flowers of interest), local features (e.g., maps of the travel destination, buildings at the travel destination, tourist attractions at the travel destination), music, etc. Furthermore, the content may be provided using, for example, AR (Augmented Reality). For example, each piece of content can be overlaid and displayed on an image (photograph) generated by an electronic device's camera (e.g., a smartphone camera). These pieces of content may also be output targets in the first to fourth embodiments.
[0204] [Examples of information storage for each electronic device and examples of content provided for each electronic device] Figure 29 shows an example of information storage for electronic devices 431, 441, and 451 in the fifth embodiment, and an example of content provided to electronic devices 431, 441, and 451. Note that Figure 29(1) corresponds to Figure 28(1), and Figure 29(2) corresponds to Figure 28(2).
[0205] In the memory example shown in Figure 29(1), terminal identification information 461 "EX0431" indicates the terminal identification information of electronic device 431, terminal identification information 461 "EX0441" indicates the terminal identification information of electronic device 441, and terminal identification information 461 "EX0451" indicates the terminal identification information of electronic device 451. Furthermore, each piece of information shown in Figure 29 will be explained with reference to Figures 30 to 32.
[0206] [Example of communication when server 410 acquires information from electronic device 431] Figure 30 is a flowchart showing an example of communication processing by the electronic device 431 and the server 410 in the fifth embodiment. Steps S151 to S155 shown in Figure 30 correspond to steps S121 to S125 shown in Figure 22. Therefore, this explanation will focus on the differences from the example shown in Figure 22. Furthermore, it is assumed that the electronic device 431 is pre-configured with a program for accessing the server 410 and performing various communications with the server 410. In other words, it is assumed that the electronic device 431 is pre-configured with applications (programs) for realizing each of the processes shown in Figure 30.
[0207] As described above, steps S151 to S155 correspond to steps S121 to S125 shown in Figure 22.
[0208] The control unit 483 of the electronic device 431 (shown in Figure 26) determines the information to be output (for example, the information to be output OI (OIX1) shown in Figure 9(2)) (step S156). Next, the communication unit 489 (shown in Figure 26) transmits the determined information to the server 410 based on the control of the control unit 483 (step S157).
[0209] The communication unit 411 of the server 410 receives information transmitted from the electronic device 431 (step S158). Next, the control unit 412 of the server 410 stores the received information in the storage unit 413 (step S159). For example, as shown in Figure 29(1), the received information (OIX1 (shown as "X1" in Figure 29(1))) is stored as received information 463, associated with the terminal identification information 461 "EX0431". Also, as shown in Figure 29(1), information regarding the time when that information (OIX1) was received from the electronic device 431 is stored as received time 462, associated with the terminal identification information 461 "EX0431".
[0210] As shown in Figure 25, information regarding the electronic device 441 is transmitted from the electronic device 441 to the server 410 via the electronic device 442. In this case, the electronic device 442 transmits terminal identification information related to the electronic device 441 to the server 410 along with the information (Y3) transmitted by the electronic device 441. Then, as shown in Figure 29(1), the information (Y3) transmitted by the electronic device 441 is stored as received information 463 in association with the terminal identification information 461 "EX0441", and information regarding the time when that information (Y3) was received from the electronic device 441 is stored as received time 462.
[0211] Furthermore, as shown in Figure 25, information regarding the electronic device 451 is transmitted from the electronic device 451 to the server 410 via the electronic device 452. In this case, the electronic device 452 transmits terminal identification information regarding the electronic device 451 to the server 410 along with the information (Z7) transmitted by the electronic device 451. Then, as shown in Figure 29(1), the information (Z7) transmitted by the electronic device 451 is stored as received information 463 in association with the terminal identification information 461 "EX0451", and information regarding the time when that information (Z7) was received from the electronic device 451 is stored as received time 462.
[0212] Furthermore, since information regarding electronic device 441 is transmitted to server 410 via electronic device 442, terminal identification information 461 may record terminal identification information for electronic device 442 instead of "EX0441". Alternatively, terminal identification information for both electronic device 441 and electronic device 442 (identification information for both electronic device 441 and electronic device 442, or information indicating that electronic device 442 has transferred information for electronic device 441) may be recorded instead of "EX0441". The same applies to information regarding electronic device 451.
[0213] [Example of communication when server 410 provides content to electronic device 431] Figure 31 is a flowchart showing an example of communication processing by the electronic device 431 and the server 410 in the fifth embodiment. The server 410 transmits information to the electronic device 431 based on terminal identification information 461 (shown in Figure 29(1)).
[0214] First, the control unit 412 of the server 410 determines whether or not the transmission conditions are met (step S161). If the transmission conditions are not met, it waits until the transmission conditions are met (step S161).
[0215] Here, the transmission conditions can be set as follows: for example, if content is provided on a daily basis, the condition could be that it is 12:00 PM (midnight) at a specific location in the world. For example, if server 410 is located in Japan, the transmission condition can be determined to be met when it is 12:00 PM (midnight) Japan time. Also, if content is provided only within a limited area, the condition could be that it is the end of the activity time in that area (for example, 9:00 PM). However, it is assumed that some users may want to see the character related to coffee immediately after brewing it. Therefore, even when providing content on a daily basis, the transmission condition can be determined to be met at smaller intervals (for example, every minute, every 10 minutes, every hour) and the content can be provided accordingly. This way, a user who brews coffee in the morning can see the character that same morning.
[0216] If the transmission conditions are met (step S161), the control unit 412 of the server 410 determines the content to be provided to each electronic device based on the information stored in the management information (step S162). Specifically, the control unit 412 of the server 410 determines the identification information (e.g., a serial number) to be assigned to each electronic device based on the information stored in the reception information 463, and stores the result in the determination result information 464. Then, the control unit 412 of the server 410 determines the content to be provided to each electronic device based on the information stored in the determination result information 464, and stores the information to identify that content in the provided content information 465.
[0217] For example, if it is determined that the transmission conditions are met at short intervals (e.g., every minute, every 10 minutes, every hour), then identification information (e.g., a serial number) is assigned in order to each electronic device that transmitted information during that period. For example, consider a case where it is determined that the transmission conditions are met at 10-minute intervals. In this case, suppose that 3 electronic devices transmitted information in the first 10 minutes, 5 electronic devices transmitted information in the next 10 minutes, and 4 electronic devices transmitted information in the following 10 minutes. In this case, identification information (e.g., a serial number) 1 to 3 is assigned to each electronic device that transmitted information in the first 10 minutes, identification information (e.g., a serial number) 4 to 8 is assigned to each electronic device that transmitted information in the next 10 minutes, and identification information (e.g., a serial number) 9 to 12 is assigned to each electronic device that transmitted information in the following 10 minutes.
[0218] Next, the communication unit 411 of the server 410 transmits content corresponding to the information stored in the provided content information 465 to each electronic device based on the control of the control unit 412 (step S163). For example, as shown in Figure 29, content corresponding to the information "CT67" stored in the provided content information 465 (content related to "character ABC") is transmitted to electronic device 431. Also, content corresponding to the information "CT217" stored in the provided content information 465 (content related to "character EFG") is transmitted to electronic device 442 (electronic device 441). Furthermore, content corresponding to the information "CT347" stored in the provided content information 465 (content related to "character HIJK") is transmitted to electronic device 452 (electronic device 451).
[0219] The communication unit 489 of the electronic device 431 receives content transmitted from the server 410 (step S164). Next, the control unit 483 of the electronic device 431 stores the received content in the storage unit 484 (step S165). Next, the control unit 483 of the electronic device 431 outputs the received content (step S166). An example of this output is shown in Figure 32.
[0220] [Example of server 410 providing content to electronic devices 431, 442, 443, and 452] Figure 32 shows an example in which the server 410 provides content to electronic devices 431, 442, 443, and 452 in the fifth embodiment.
[0221] Server 410 transmits content to each electronic device based on the management information shown in Figure 29(1). For example, as shown in Figure 29(1), based on the provided content information 465 "CT67" associated with the terminal identification information 461 "EX0431", Server 410 transmits content related to "Character ABC" to electronic device 431. Also, based on the provided content information 465 "CT217" associated with the terminal identification information 461 "EX0441", Server 410 transmits content related to "Character EFG" to electronic device 441 (or electronic device 442). Also, based on the provided content information 465 "CT347" associated with the terminal identification information 461 "EX0441", Server 410 transmits content related to "Character HIJK" to electronic device 451 (or electronic device 452).
[0222] Electronic devices that receive content perform output related to the received content. For example, as shown in Figure 32, electronic device 431, which receives content related to "character ABC," displays an image related to "character ABC" on the user interface 488 (display unit 487) (shown in Figure 26). Electronic device 431 also outputs audio related to "character ABC" from the audio output unit 485 (shown in Figure 26). Electronic device 442, which receives content related to "character EFG," transmits that content to electronic device 443 (equipped with a display unit), and displays an image related to "character EFG" on the display unit of electronic device 443. Electronic device 442 also outputs audio related to "character EFG" from its audio output unit. Electronic device 452, which receives content related to "character HIJK," displays an image related to "character HIJK" on its display unit. Electronic device 452 also outputs audio related to "character HIJK" from its audio output unit.
[0223] [Example of sending acquired information to a server] Figure 33 is a flowchart showing an example of the transmission process by the electronic device 431 in the fifth embodiment. Steps S171 to S177 shown in Figure 33 correspond to steps S151 to S157 shown in Figure 30. Therefore, this explanation will focus on the differences from the example shown in Figure 30.
[0224] First, the control unit 483 of the electronic device 431 determines whether or not a start instruction has been detected (step S171). If a start instruction is detected (step S171), the process proceeds to step S172. If no start instruction is detected (step S171), monitoring continues.
[0225] [Example of operation that outputs content provided by the server] Figure 34 is a flowchart showing an example of content output processing by the electronic device 431 in the fifth embodiment. Steps S181 to S183 shown in Figure 34 correspond to steps S164 to S166 shown in Figure 31. Therefore, this explanation will focus on the differences from the example shown in Figure 31.
[0226] First, the control unit 483 of the electronic device 431 determines whether or not it has received content from the server 410 (step S181). If it has received content from the server 410 (step S181), it proceeds to step S182. If it has not received content from the server 410 (step S181), it continues monitoring.
[0227] [Example of providing content to each electronic device] Figure 35 is a flowchart showing an example of content provision processing by the server 410 in the fifth embodiment. Steps S193 to S197 shown in Figure 35 correspond to steps S158, S159, and S161 to S163 shown in Figures 30 and 31. Therefore, this explanation will focus on the differences from the examples shown in Figures 30 and 31.
[0228] First, the control unit 412 of the server 410 determines whether the start condition is met (step S191). If the start condition is met (step S191), the process proceeds to step S192. If the start condition is not met (step S191), the process proceeds to step S193.
[0229] Here, the start condition can be, for example, if content is provided on a daily basis, it can be set as 0:00 AM at a certain location in the world. For example, if server 410 is located in Japan, the start condition can be determined to be met when it becomes 0:00 AM Japan time. Alternatively, if content is provided only within a limited area, the condition can be set as the start of the activity time in that area (for example, 4:00 AM).
[0230] If the starting conditions are met (step S191), the control unit 412 of the server 410 erases the contents of the management information in the storage unit 413 (step S192). This allows new content (characters) to be provided to each electronic device based on the new information.
[0231] Next, the control unit 412 of the server 410 determines whether or not it has received information from the electronic device (for example, information to be output determined by the decision process (for example, the information to be output OI(OIX1) shown in Figure 9(2))) (step S193). If information has been received from the electronic device (step S193), the process proceeds to step S194. If no information has been received from the electronic device (step S193), monitoring continues.
[0232] When information is received from an electronic device (step S193), the control unit 412 of the server 410 stores the received information in the storage unit 413, associating it with the electronic device that transmitted the information (step S194).
[0233] Next, the control unit 412 of the server 410 determines whether or not the transmission conditions are met (step S195). If the transmission conditions are not met, the process returns to step S193.
[0234] If the transmission conditions are met (step S195), the control unit 412 of the server 410 determines the content to be provided to each electronic device based on the information stored in the management information (step S196).
[0235] Next, the communication unit 411 of the server 410 transmits content corresponding to the information stored in the provided content information 465 to each electronic device based on the control of the control unit 412 (step S197).
[0236] [Example of operation when the server performs each process] The above examples illustrate how an electronic device attached to a coffee brewer performs a decision process to determine the information to be output, and transmits the information determined by this decision process to a server 410. However, as shown in the fourth embodiment, it is also possible to have the electronic device attached to the coffee brewer perform only relatively simple processing, while other processing is performed by the server 410, which has higher processing capabilities. Therefore, Figure 36 shows an example in which the electronic device attached to the coffee brewer only acquires and transmits image information of the surface of the coffee accumulating in the container, while other processing is performed by the server 410.
[0237] [Example of communication when performing a series of processes using multiple electronic devices] Figure 36 is a flowchart showing an example of communication processing by the server 410 and electronic device 431 in the fifth embodiment. Steps S501 to S504 shown in Figure 36 correspond to steps S131 and S133 to S135 shown in Figure 24. Also, steps S515 and S516 shown in Figure 36 correspond to steps S161 and S162 shown in Figure 31. Therefore, this explanation will focus on the differences from the examples shown in Figures 24 and 31.
[0238] When the control unit 483 of the electronic device 431 detects a start instruction (step S501), it acquires the image acquired by the image acquisition unit 482 (an image of the coffee accumulating in the container (including image data)) (step S502), and transmits the acquired image information to the server 410 (step S503). In this case, the transmission of image information from the electronic device 431 to the server 410 may be performed periodically or irregularly.
[0239] Step S504 shown in Figure 36 corresponds to step S135 shown in Figure 24.
[0240] When the control unit 412 of the server 410 receives image information from the electronic device 431 (step S511), it analyzes the received image information to obtain feature amounts (step S512). Next, the control unit 412 of the server 410 associates the obtained feature amounts with the electronic device 431 and stores them in the storage unit 413 (step S513). Thus, until the end condition is satisfied, analysis processing is performed on the received image information, and the feature amounts (for example, each piece of information shown in FIG. 9(1) and each piece of information shown in FIG. 16(1)) obtained by this analysis processing are sequentially stored in the storage unit 413 in association with the electronic device 431 (steps S511 to S514). For example, each process shown in the first to fourth embodiments (for example, each process of steps S102 to S105 shown in FIG. 11, each process of steps S112 to S115 shown in FIG. 18, each process of steps S123 to S126 shown in FIG. 22, steps S143 to S146 shown in FIG. 24, steps S153 to S156 shown in FIG. 30, steps S173 to S176 shown in FIG. 33) is performed, and the processing results (feature amounts) are associated with the elapsed time and stored in the storage unit 413 in association with the electronic device 431 (for example, each piece of information shown in FIG. 9(1) and each piece of information shown in FIG. 16(1)).
[0241] Also, when the transmission condition is satisfied (step S515), the control unit 412 of the server 410 determines the content to be provided to each electronic device based on each piece of information stored in the management information (step S516).
[0242] Next, the communication unit 411 of the server 410 transmits a notification indicating that there is content to be provided to the electronic device 431 based on the control of the control unit 412 (step S517). For example, notification means such as an e-mail, SNS (Social Networking Service), or a notification on the Internet can be used. Also, in step S517, all or part of the content may be transmitted (for example, attached to an e-mail and transmitted, transmitted on SNS, or transmitted on the Internet).
[0243] Furthermore, when the communication unit 489 of the electronic device 431 receives a notification from the server 410, it notifies the user of that fact (step S505). For example, the notification can be made by outputting an audio message, displaying an audio message, vibrating, lighting or flashing a lamp, etc. Upon seeing this notification, the user can access the server 410 by operating the electronic device 431 (or another electronic device), connect the electronic device 431 (or another electronic device) and the server 410, and receive content from the server 410 (steps S518, S506). As a result, the control unit 483 of the electronic device 431 can output audio from the audio output unit 485 based on the provided content, and display an image on the user interface 488 (display unit 487) based on the provided content (step S506). For example, as shown in Figure 32, audio is output from the audio output unit and an image is displayed on the user interface.
[0244] Furthermore, in the example shown in Figure 36, it is conceivable that not all image information from the electronic device 431 may be received due to some reason (e.g., lens fogging, interruption of wireless communication). It is also conceivable that information with different extraction times may be transmitted from multiple electronic devices. Moreover, it is conceivable that image information transmitted from multiple electronic devices may not be transmitted according to a unified rule.
[0245] For example, it is conceivable that image information relating to 5 images is transmitted from electronic device 431, image information relating to 3 images is transmitted from electronic device 441, and image information relating to 1 image is transmitted from electronic device 451. In such a case, the control unit 412 of server 410 analyzes the image information received from electronic devices 431, 441, and 451 to obtain comparable information based on the features of each image. For example, when using the judgment information shown in Figures 6(1) and 6(2), the control unit 412 of server 410 analyzes the image information received from electronic devices 431, 441, and 451 to obtain feature quantities (A to I) based on each image. Then, the control unit 412 of server 410 calculates a comparable numerical value based on the obtained feature quantities (A to I) and the number of images received. For example, suppose the features based on five images received from electronic device 431 are A, A, B, C, A in order of reception; the features based on three images received from electronic device 441 are A, C, D in order of reception; and the feature based on one image received from electronic device 451 is G. In this case, a multiplier (5~1) is determined based on the maximum number of received images (5), and this is multiplied by each feature to calculate a comparable value. Specifically, features A to I are quantified, and features A, A, B, C, A related to electronic device 431 are converted to 1, 1, 2, 3, 1; features A, C, D related to electronic device 441 are converted to 1, 3, 4; and feature G related to electronic device 451 is converted to 7. Then, the multiplier (5~1) is applied in order of reception and the values are added together to calculate a comparable value. Specifically, for electronic device 431, 22 (=1×5+1×4+2×3+3×2+1×1) is calculated; for electronic device 441, 29 (=1×5+3×4+4×3) is calculated; and for electronic device 451, 35 (=7×5) is calculated. In this case, 22 (electronic device 431) < 29 (electronic device 441) < 35 (electronic device 451), so the identification numbers (sequential numbers) are determined in this order. That is, 1 is assigned to electronic device 431, 2 to electronic device 441, and 3 to electronic device 451. It is also conceivable that the calculated values, which are comparable numerical values, may be the same for multiple electronic devices. In this case, for example, the identification numbers (sequential numbers) can be determined based on the reception time.For example, electronic devices can be numbered sequentially, starting with those that received the data earliest.
[0246] In this way, even when image information transmitted from multiple electronic devices is not transmitted according to a unified rule, identification information (e.g., a serial number) can be determined to be assigned to each electronic device, and content can be provided to each electronic device. This makes it possible to provide content to users, for example, who take a picture of the surface of coffee in a coffee shop with an electronic device (e.g., a smartphone) and send that image to the server 410. In other words, users who drink coffee brewed using a coffee maker at home or in the workplace, users who drink coffee brewed using instant coffee, and users who drink coffee brewed by someone else in a coffee shop can all participate in a service that provides at least one piece of content from among multiple pieces of content and enjoy the provided content. Thus, in the fifth embodiment, content can be determined and provided by comparing relative information.
[0247] Furthermore, it is conceivable that image information transmitted from multiple electronic devices may be identical (or have the same pattern) or similar (approximate) (or similar (approximate) patterns). In such cases, each electronic device that transmitted identical (or identical pattern) or similar (approximate) (or similar (approximate) patterns) image information may be given some kind of benefit or privilege in addition to the content determined by the processes described above. For example, if the control unit 412 of the server 410 provides content on a daily basis, it can determine, based on the information stored in the management information, whether or not there are electronic devices that transmitted identical (or identical pattern) or similar (or similar pattern) image information at 12 p.m. (24:00) at the reference point. If there are electronic devices that transmitted identical (or identical pattern) or similar (or similar pattern) image information, the control unit 412 of the server 410 may provide each of those electronic devices with other content (for example, a special character, a main character from an anime, or a specific service) in addition to the determined content. This means that users who receive regular content can enjoy it even more by receiving other content (such as some kind of perks or benefits) in addition to that content.
[0248] In the example shown in Figure 36, the server 410 performs a series of processes based on image information from the electronic device 431. However, some of the processes performed by the server 410 may be performed by other devices (one or more devices). In this case, an information processing system composed of multiple devices will perform each of the processes shown in Figure 36 (each of the processes performed by the server 410).
[0249] Thus, the server 410 (or multiple devices comprising it) is an example of an information processing device, information processing system, and communication system that, when coffee is produced by mixing a substance for producing coffee (e.g., coffee beans, ground coffee, instant coffee) with hot water and stored in containers, acquires information about the produced coffee (information obtained from the coffee) for each of the multiple containers of coffee, during the production process, when the produced coffee is placed in the containers, or after the produced coffee has been placed in the containers, and determines content (e.g., information unrelated to the coffee) to be provided to each person associated with the multiple containers based on the acquired information.
[0250] Furthermore, server 410 (or multiple devices comprising it) is an example of an information processing device, information processing system, and communication system that acquires information about the extracted coffee when the extracted coffee is placed in a container, or after the extracted coffee has been placed in a container, for each of the multiple containers of coffee, and determines the content to be provided to each person associated with the multiple containers based on the acquired information.
[0251] Furthermore, the server 410 (or the multiple devices comprising it) can use feature quantities as information about the extracted coffee, for example, when the extracted coffee is placed in a container, or regarding changes in the surface of the extracted coffee in the container after it has been placed in the container (e.g., color, pattern, foam formation). Also, the server 410 (or the multiple devices comprising it) can determine the content to be assigned to each person associated with multiple containers by comparing the information obtained for each coffee placed in multiple containers.
[0252] [Examples using other sensors] The above examples mainly show how to acquire various information (e.g., surface transitions) during or after coffee production using an image sensor (image sensor, imaging element). However, other sensors may also be used to acquire various information during or after coffee production. Figure 37 shows examples of attaching various sensors to a coffee extractor (electronic device).
[0253] Figure 37 shows examples of sensor mounting for coffee brewers or electronic devices in the first to fifth embodiments. The coffee brewers 600, 610, 620, 630, and 640 shown in Figures 37(1) to (5) have stands 602, 612, 622, 632, and 642, similar to the coffee brewer 200 shown in Figure 13. The coffee brewer 650 shown in Figure 37(6) does not have a stand, similar to the coffee brewer 1 shown in Figure 1. The coffee brewers 600, 610, 620, 630, 640, and 650 also have drippers 601, 611, 621, 631, 641, and 651, and containers 603, 613, 623, 633, 643, and 652. Sensors 604, 614, 624, 634, 644, and 661 will be described in the respective sensor descriptions below. Furthermore, it is preferable to waterproof sensor 634, which will be submerged in liquid (coffee), and sensor 624, which may be exposed to steam. In addition, it is preferable to apply heat insulation and heat-resistant treatment to sensors that are affected by the temperature of the hot water.
[0254] For example, a temperature sensor capable of measuring temperature can be used. For instance, a temperature sensor can be installed in a position in a coffee brewer where the temperature of the liquid (coffee) accumulating in the container can be measured, and the temperature transition from the start to the end of coffee brewing can be obtained using this temperature sensor. For example, temperature sensors can be installed at the positions of sensors 604, 614, 624, 634, and 644 shown in Figures 37(1) to (5). Based on this temperature transition, the content to be output can be determined.
[0255] Furthermore, for example, an odor sensor capable of measuring odors can be used. This odor sensor may be, for example, a sensor capable of detecting a specific odor, or a sensor capable of outputting some kind of information depending on the odor. For example, an odor sensor can be attached to a position in a coffee brewer where the odor of the liquid (coffee) accumulating in the container can be measured, and the transition of the odor from the start to the end of coffee brewing can be obtained using this odor sensor. The position where the odor sensor is attached can be, for example, inside the container or at the bottom of the dripper (so that it is inside the container). For example, an odor sensor can be attached to the positions of sensors 624 and 634 shown in Figures 37(3) and (4). Based on the transition of the odor, the content to be output can be determined. For example, the information on each odor acquired in time series can be quantified and calculated (for example, added, multiplied) to obtain comparable values, and the content to be output can be determined by comparing these values.
[0256] Furthermore, a sound sensor capable of measuring sound (e.g., a microphone) can be used. For example, a sound sensor can be attached to a position in a coffee brewer where it can measure the sound emitted from the liquid (coffee) accumulating in the container, and the transition of sound generated from the start to the end of coffee brewing can be obtained using this sound sensor. The sound sensor can be attached to various locations, such as inside the container, below the dripper (so that it is inside the container), or outside the container. For example, sound sensors can be attached to the positions 604, 614, 624, 634, and 644 shown in Figures 37(1) to (5). Based on the transition of sound, the content to be output can be determined. For example, the information on each sound acquired in time series can be quantified and calculated (e.g., added, multiplied) to obtain comparable values, and by comparing these values, the content to be output can be determined.
[0257] Furthermore, a weight sensor capable of measuring weight can be used. For example, a weight sensor can be attached to a location in a coffee brewer where the weight of the liquid (coffee) accumulating in the container can be measured (for example, at the bottom of the container), and the weight transition from the start to the end of coffee brewing can be obtained using this weight sensor. The location where the weight sensor is attached can be, for example, the bottom of the container. For example, a weight sensor can be attached to the position of sensor 644 shown in Figure 37(5). Based on the weight transition, the content to be output can be determined. For example, by calculating (for example, adding, multiplying) the numerical values of each weight obtained in a time series to obtain comparable values, the content to be output can be determined by comparing these values.
[0258] Furthermore, for example, a taste sensor capable of measuring taste can be used. For instance, a taste sensor can be attached to a position in a coffee brewer where it can measure the taste of the liquid (coffee) that accumulates in the container, and this taste sensor can be used to acquire the transition of taste from the start to the end of coffee brewing. The taste sensor can be attached to, for example, the inside of the container or the bottom of the dripper (so that it is inside the container). For example, a taste sensor can be attached to the position of sensor 634 shown in Figure 37(4) (for example, a sensor attached to the opening of container 633 in a clip-type). Based on the transition of taste, the content to be output can be determined. For example, the information on each taste acquired in time series can be quantified and calculated (for example, added, multiplied) to obtain comparable values, and by comparing these values, the content to be output can be determined.
[0259] The sensors described above are merely examples, and other sensors that acquire different information may be used. Furthermore, any sensor capable of acquiring some kind of information (for example, whether the temperature is 75 degrees or higher, the presence or absence of a specific smell, the presence or absence of a specific sound, the presence or absence of a specific taste) can be used. In other words, sensors capable of acquiring comparable information for each extraction can also be used. In addition, as shown in Figure 37(6), a sensor 661 provided by an electronic device 660 installed outside the coffee extractor 650 may be used. For example, an electronic device 660 (e.g., a smartphone) can be installed outside the container 652 of the coffee extractor 650 so that image information about the liquid (coffee) accumulating in the container 652 can be acquired. Then, the sensor 661 (e.g., a camera) of the electronic device 660 can be used to acquire image information about the liquid (coffee) accumulating in the container 652 of the coffee extractor 650, and this image information can be used. In this case, the electronic device 660 functions as an electronic device (an electronic device attached to a coffee extractor) as shown in the first to fifth embodiments. Alternatively, a mounting section (for example, a smartphone mounting section) for mounting the electronic device 660 may be provided on the stand (mounting stand 653) on which the container 652 is installed, and the electronic device 660 may be attached to this mounting section. Alternatively, other sensors (for example, a vibration sensor, a microphone) of the electronic device 660 (for example, a smartphone) may be used to acquire various information (for example, vibrations generated by the falling liquid, sounds generated by the falling liquid) regarding the liquid (coffee) accumulating in the container 652 of the coffee extractor 650, and this information may be used. This makes it easy for anyone to install the electronic device 660 and enjoy the content output shown in the first to fifth embodiments.
[0260] [Example using multiple sensors] In addition, the above examples show how to acquire various information when coffee is being produced or after it has been produced using various sensors. However, it is also possible to acquire various information when coffee is being produced or after it has been produced using multiple sensors from among the various sensors. Figure 38 shows an example of attaching multiple sensors to an electronic device.
[0261] FIG. 38 is a diagram showing an example of attachment of sensors attached to the electronic devices 700, 710, 720, and 725 in the first to fifth embodiments. Note that the electronic devices 700, 710, 720, and 725 shown in FIGS. 38(1) to (4) are modified examples of the electronic device 20 shown in FIGS. 1 to 3. Further, the electronic device 700 shown in FIG. 38(1) is a modification of the shape of the grip portion 27 of the electronic device 20. Also, the electronic devices 710 and 720 shown in FIGS. 38(2) and (3) are modifications of the shape of the annular portion 28 of the electronic device 20. Further, the electronic device 725 shown in FIG. 38(4) omits the grip portion 27 of the electronic device 20 and modifies the shape of the annular portion 28. Also, FIGS. 38(1) to (4) show bottom views of the electronic devices 700, 710, 720, and 725, similar to FIG. 3(4).
[0262] The electronic device 700 shown in FIG. 38(1) is provided with four sensors 701 to 704 instead of the lens 21 of the electronic device 20 shown in FIG. 3(4). Also, a concave portion 705 (indentation) is provided in the grip portion so that the user can easily hold the electronic device 700.
[0263] The electronic device 710 shown in FIG. 38(2) has the shape of the annular portion 28 of the electronic device 20 shown in FIG. 3(4) as a U-shaped shape, and is provided with three sensors 711 to 713.
[0264] The electronic device 720 shown in FIG. 38(3) has the shape of the annular portion 28 of the electronic device 20 shown in FIG. 3(4) as a rectangular shape, and is provided with four sensors 721 to 724.
[0265] The electronic device 725 shown in FIG. 38(4) has the shape of the annular portion 28 of the electronic device 20 shown in FIG. 3(4) as an elliptical shape, and is provided with four sensors 726 to 729. Also, the grip portion 27 of the electronic device 20 is omitted. Note that each part (for example, the operation portion 26, the audio output portion 25) provided in the grip portion 27 of the electronic device 20 can be provided in other parts (for example, the side surface, the portion extending from the flange portion (for example, the portion indicated by reference numeral 706)).
[0266] Regarding the sensors 701-704 shown in Figure 38(1), multiple sensors of the same type may be provided, or all of them may be different sensors. For example, sensors 701-704 can be at least one of the sensors described above. Also, multiple sensors of the same type (e.g., image sensors) may be provided to improve the accuracy of the sensors. The same applies to sensors 711-713 shown in Figure 38(2), sensors 721-724 shown in Figure 38(3), and sensors 726-729 shown in Figure 38(4). Furthermore, the location of the sensors is not limited to the example shown in Figure 38, and they can be installed in a location where the sensors can perform to their full potential. In addition, for the electronic equipment attached to the coffee maker, the configuration of control units and other components other than the sensors may be omitted. In this case, the information from the sensors can be transmitted to other electronic equipment via a wired line or the like.
[0267] [Modified coffee brewing machine] Figures 39 and 40 show the external appearance of a modified version (coffee extractor 730) of the coffee extractor 1 in the first embodiment. Figure 39 shows a perspective view of the coffee extractor 1. Figure 40(1) shows a top view of the dripper 740 with the electronic equipment 750 attached to the flange portion 742, and Figure 40(2) shows a bottom view of the dripper 740 with the electronic equipment 750 attached to the flange portion 742. Note that in Figure 40(1), the housing portion 741 is omitted for the sake of clarity. Figure 40(3) shows a bottom view of the electronic equipment 750 removed from the flange portion 742, and Figure 40(4) shows a bottom view of the electronic equipment 750 removed from the flange portion 742.
[0268] The coffee brewer 730 comprises a dripper 740, electronic equipment 750, and a container 760. The dripper 740, electronic equipment 750, and container 760 correspond to the dripper 10, electronic equipment 20, and container 30 shown in Figures 1 to 3, respectively. Therefore, the following explanation will focus on the differences between the dripper 730 and the dripper 10, electronic equipment 20, and container 30.
[0269] The dripper 740 has a housing section 741 and a flange section 742, and is a coffee dripper used by being placed at the opening of the container 760. An electronic device 750 is attached to the flange section 742.
[0270] The electronic device 750 is an electronic device that is detachably attached to the flange portion 742 and includes an audio output unit 755, a lens 751, and a mounting portion 757. The electronic device 750 is mounted by sliding into a recess of the mounting portion 745 of the flange portion 742 (a recess corresponding to the shape of the protrusion of the mounting portion 757). Alternatively, the electronic device 750 can be realized by installing each component (for example, the parts shown in Figure 4) inside a housing (case). For example, the housing (case) can be made of heat-resistant glass, ceramics, metal, resin, wood, etc.
[0271] The mounting portion 757 is a part for attaching to a notch (mounting portion 745) provided in a part of the flange portion 742. The mounting portion 757 is a convex portion corresponding to the shape of the recess in the mounting portion 745, and is formed to fit into the recess of the mounting portion 745. Alternatively, contrary to the example shown in Figure 40, the mounting portion 757 may be made into a recess, and the mounting portion 745 of the flange portion 742 may be made into a convex portion (a convex portion corresponding to the shape of the recess in the mounting portion 757), and the mounting portion 757 may be formed to fit into the convex portion of the mounting portion 745. In this example, a part of the flange portion 742 is made into a notch (mounting portion 745), and an example of attaching the electronic device 750 to the mounting portion 745 is shown, but other mounting methods may be used.
[0272] For example, when attaching the electronic device 750 to the flange portion 742, the protrusion of the mounting portion 757 is aligned with the recess of the mounting portion 745 of the flange portion 742, and the electronic device 750 is pushed and slid in the direction of arrow 2 (Figure 40(3)). When removing the electronic device 750 from the flange portion 742, the electronic device 750 is slid outwards from the flange portion 742 (in the direction of arrow 3 (Figure 40(3))). Note that a locking member for securing the electronic device 750 to the flange portion 742 may be provided on at least one of the mounting portion 745 of the flange portion 742 and the mounting portion 757 of the electronic device 750.
[0273] In this way, by using a sliding mounting system for the electronic device 750, installation and removal of the electronic device 750 are made easy.
[0274] Furthermore, the lens 751 of the electronic device 750 is positioned on the lower surface of the flange portion 742. In addition, when the dripper 740 is set in the container 760, the optical axis of the lens 751 is positioned so that it faces the surface of the coffee extract that accumulates in the container 760.
[0275] Furthermore, it is preferable to apply heat insulation and waterproofing treatments to each component built into the electronic device 750. It is also preferable to apply an anti-fog treatment to the lens 751.
[0276] Thus, various methods can be used for attaching electronic devices to a coffee brewer.
[0277] [Example of obtaining and using other information about the liquid (coffee)] The above examples illustrate how to acquire and use information about the liquid (coffee) that accumulates in the container of a coffee brewer. However, other information about the liquid (coffee) may also be acquired and used. For example, when liquid (hot water) is poured into a dripper containing coffee grounds, the coffee grounds and liquid (hot water) in the dripper's container will change depending on how the water is poured. For example, the transition will differ depending on whether the coffee beans are finely ground or coarsely ground (for example, a depression may form in the middle or a mound may form). Also, the transition may differ depending on the speed at which the liquid (hot water) is poured (for example, the container may be filled with hot water, or hot water may only be present in the depressions of the grounds). For example, depending on how the water is poured and the degree of grinding, the coffee grounds in the dripper's container may be filled with liquid (hot water), and then bubbles may form. For example, depending on the degree of grinding, the coffee grounds in the dripper's container may swell or become flat. Therefore, when brewing coffee, or after brewing coffee, various sensors may be used to acquire various information about the coffee grounds and liquid (hot water) in the dripper's storage compartment. For example, as shown in Figure 37(3), an image sensor (image sensor, imaging element) can be installed above the dripper's storage compartment to acquire and use image information about the coffee grounds and liquid (hot water) in the dripper's storage compartment.
[0278] Furthermore, other information related to the liquid (coffee) may be acquired and used, for example, information regarding the grinding of coffee beans using a coffee mill (a machine for grinding coffee beans). For example, information regarding the sounds emitted when grinding coffee beans with a coffee mill may be acquired and used. Alternatively, information acquired regarding the coffee mill may be combined with information acquired by the coffee brewer.
[0279] [Examples of using time and location information along with information about a liquid (coffee)] The above examples illustrate how to acquire various types of information about a liquid (coffee) and use this information to determine the content to be provided. An example was also shown where the content to be provided is determined based on image information and time information related to the liquid (coffee). However, if an electronic device can use location information (for example, if the electronic device is equipped with a location information acquisition unit 358 as shown in Figure 21 or a location information acquisition unit 490 as shown in Figure 26), that location information can be used. For example, an electronic device (an electronic device attached to a coffee maker, or an electronic device that transfers information from an electronic device attached to a coffee maker) can transmit location information about itself (e.g., latitude and longitude, information to identify the region) along with information about the liquid (coffee) to the server 410. In this case, the control unit 412 of the server 410 can determine the content to be provided based on information about the liquid (coffee) (e.g., image information, sound information, etc.) and location information. For example, multiple content items can be classified into multiple groups (e.g., the number of countries to which the content is provided), and the groups assigned to each country can be changed sequentially each day. For example, each electronic device in a country A is provided with content selected from the content belonging to the group assigned to country A on that day.
[0280] Furthermore, the control unit 412 of the server 410 may determine the content to be provided based on location information and time information, along with information about the liquid (coffee). For example, the control unit 412 of the server 410 can quantify the information about the liquid (coffee), as well as the location information and time information, and calculate comparable values by performing calculations (e.g., basic arithmetic operations) on each of these values to determine the content to be provided. Location information may be assigned numerical values on a country-by-country basis, for example, 1 for country A, 2 for country B, etc., or it may be assigned numerical values on a regional basis within a country (e.g., prefecture). Alternatively, numerical values may be calculated by performing calculations on latitude and longitude (e.g., basic arithmetic operations (e.g., simple addition of each value)).
[0281] [Examples of obtaining and using information about beverages other than coffee] The above examples illustrate how to output content using information acquired about the extracted coffee when it is placed in a container, or after it has been placed in a container. However, the first to fifth embodiments can also be applied to beverages other than coffee. For example, the first to fifth embodiments can also be applied to various types of tea such as black tea, Japanese tea (e.g., green tea, roasted green tea, brown rice tea, sencha, bancha, gyokuro), Chinese tea (e.g., Eucommia tea, oolong tea), herbal tea, medicinal tea, cocoa, and hot chocolate. For example, when brewing tea in a teapot (e.g., a teapot), content can be output using information acquired about the hot water (tea) poured over the tea leaves when the hot water is poured into the teapot, or after the hot water has been poured into the teapot. In this case, at least one of the sensors described above can be attached to or near the teapot to acquire the information described above. Furthermore, the server 410 can maintain management information for each type (category) of beverage, perform the aforementioned processing for each type (category) of beverage, and provide content for each type (category) of beverage. In this case, for example, the same content may be provided to an electronic device that transmits information about coffee and an electronic device that transmits information about tea. In addition, the server 410 can perform the aforementioned processing for electronic devices that transmit information about beverages, regardless of the type (category) of beverage, and provide content. In this case, for example, the same judgment processing, decision processing, etc., can be performed for each electronic device that transmits information about different beverages, and different content can be provided.
[0282] [Sixth Embodiment: Example of acquiring and outputting information about beverages] The above examples illustrate how to output content using information obtained about the extracted beverage when it is placed in a container, or after it has been placed in a container. However, it is also possible to output the information obtained about the extracted beverage itself (or information that has undergone some processing (e.g., audio amplification)) when it is placed in a container, or after it has been placed in a container. Therefore, the sixth embodiment shows an example in which the information obtained about the extracted beverage itself is output when it is placed in a container, or after it has been placed in a container.
[0283] As mentioned above, conventional technology allows for the preparation of beverages according to individual preferences using various devices. However, preparing beverages using these devices takes a certain amount of time. Therefore, it is believed that if various information could be acquired at the time of preparation (extraction) using these devices and provided to the person preparing the beverage, the enjoyment of preparing beverages would increase. Thus, the sixth embodiment aims to provide the enjoyment of preparing beverages.
[0284] Figure 41 is a simplified diagram showing an example of outputting information acquired by the electronic device 700 in the sixth embodiment. The electronic device 700 corresponds to the electronic device 700 shown in Figure 38(1). However, the electronic device 700 is assumed to include a communication unit (corresponding to the communication unit 325 shown in Figure 19).
[0285] Figure 41(1) shows an example of outputting information acquired by the electronic device 700 from the electronic device 700. As shown in Figure 38(1), the electronic device 700 is equipped with four sensors 701 to 704. The four sensors 701 to 704 are, for example, a sound sensor, an image sensor, a temperature sensor, and an odor sensor.
[0286] For example, the control unit of the electronic device 700 can output information acquired by each of the sensors 701 to 704 from the electronic device 700. For example, if the electronic device 700 is equipped with an audio output unit, as shown in Figure 41(1), it can amplify and output the sound generated during coffee extraction, which is acquired by the sound sensor. This allows user P1, who is brewing coffee using the coffee extractor 760, to brew coffee while listening to the sounds generated during the brewing process (for example, the amplified sound of coffee droplets falling into the container). Furthermore, after brewing the coffee, user P1 can enjoy content based on the features acquired during the extraction process while savoring the coffee.
[0287] Furthermore, if the electronic device 700 is equipped with a display unit, an image of the coffee brewing process (the surface of the coffee in the container) acquired by the image sensor can be displayed on the display unit. This allows user P1, who is brewing coffee using the coffee brewer 760, to brew coffee while observing the transitions (the transitions of the coffee surface in the container) during the brewing process. After brewing the coffee, user P1 can enjoy the coffee while savoring content based on the features acquired during the brewing process.
[0288] Furthermore, if the electronic device 700 includes an audio output unit and a display unit, it can amplify and output the sound generated during coffee extraction, acquired by the sound sensor, and display an image of the coffee extraction process (the surface of the coffee in the container), acquired by the image sensor, on the display unit. It may also display and output the temperature value acquired by the temperature sensor during coffee extraction, and display and output information about the smell acquired by the smell sensor during coffee extraction. This allows user P1, who is brewing coffee using the coffee brewer 760, to enjoy the coffee extraction process even more. The same output can also be provided when other sensors are used.
[0289] Figure 41(2) shows an example of outputting information acquired by electronic device 700 from another electronic device (electronic device 350). The example shown in Figure 41(2) is the same as the example shown in Figure 41(1), except that the information acquired by electronic device 700 is output from another electronic device (electronic device 350).
[0290] Figure 41(3) shows an example of outputting information acquired by electronic device 700 from another electronic device (electronic device 360). Note that the example shown in Figure 41(3) is the same as the example shown in Figure 41(1), except that the information acquired by electronic device 700 is output from another electronic device (electronic device 360).
[0291] The above examples illustrate how to perform predetermined processing (e.g., sound amplification, display image (video) generation) on information acquired by one or more sensors during coffee brewing and output it. However, it is also possible to perform predetermined processing (e.g., sound amplification, display image (video) generation) on information acquired by multiple sensors during coffee brewing and output it as a single piece of information. For example, the information acquired by each sensor and musical scales such as Do-Re-Mi-Fa-So-La-Ti-Do may be quantified (e.g., 0, 1, 2, ...), predetermined calculation processing may be applied to the information acquired by each sensor, and the values calculated based on the calculation results may be sequentially applied to the numerical values of the musical scale and output as sound. For example, the image information acquired by the image sensor is quantified as the percentage of black in a circular image (e.g., 0, 1, 2, ...), the sound information acquired by the sound sensor is quantified as the loudness of the sound (e.g., 0, 1, 2, ...), the temperature information acquired by the temperature sensor is converted into a numerical value of temperature (or other numerical value) (e.g., 0, 1, 2, ...), and the odor information acquired by the odor sensor is quantified as the intensity of the odor (e.g., 0, 1, 2, ...). Next, a predetermined operation (e.g., arithmetic operation) is performed on each of the numerical values calculated for each of these sensors to calculate a numerical value for conversion to a musical scale. Then, based on the calculated numerical value (musical scale), sound is output. Similarly, image output can be performed based on a value calculated by applying a predetermined arithmetic process to the information acquired by each sensor. Note that these audio and image outputs can also be understood as examples of outputting content based on information acquired by each sensor, similar to the first to fifth embodiments. Furthermore, these processes may be performed by other devices, and the output may be generated by those other devices. For example, as shown in Figures 41(2)(3), information regarding coffee extraction acquired by multiple sensors may be sequentially transmitted to electronic devices 350 and 360, causing the electronic devices 350 and 360 to perform each process and output the information.Furthermore, as shown in the fifth embodiment, information regarding coffee extraction acquired by multiple sensors may be sequentially transmitted to the server 410 via the network 420, the server 410 may perform each process, and the output information based on that process may be sequentially received from the server 410 and output on the device itself (or another device).
[0292] As described above, the electronic devices 20, 220, 320, 350, 360, 431, 441, 442, 443, 451, 452, 660, 700, 710, 720, 725, 750 and the information processing device (e.g., server 410) shown in the first to sixth embodiments are examples of information processing devices, information processing systems, and communication systems that determine content (e.g., information unrelated to the beverage) based on information obtained regarding the beverage (information obtained from the beverage) when a beverage is produced from a substance (e.g., a powdered substance, a liquid substance, a solid substance) and a liquid and stored in a container.
[0293] Furthermore, the electronic devices 20, 220, 320, 350, 360, 431, 441, 442, 443, 451, 452, 660, 700, 710, 720, 725, 750 and the information processing device (e.g., server 410) shown in the first to sixth embodiments are examples of electronic devices, information processing devices, information processing systems, and communication systems that acquire and use information about a liquid collected in a container that collects liquid dripping from a beverage dispenser. For example, information about the liquid can be used to determine the content to be provided to the user.
[0294] Furthermore, the server 410 (or multiple devices comprising it) shown in the fifth embodiment is an example of an information processing device, information processing system, and communication system that, when a beverage is produced from a substance for producing a beverage (e.g., a powdered substance, a liquid substance, a solid substance) and a liquid and stored in a container, acquires information about the produced beverage (information acquired from the beverage) for each beverage placed in multiple containers, during the production of the beverage, when the produced beverage is placed in the container, or after the produced beverage is placed in the container, and determines content (e.g., information unrelated to the beverage) to be provided to each person associated with the multiple containers based on the acquired information.
[0295] Furthermore, the server 410 (or multiple devices comprising it) shown in the fifth embodiment is an example of an information processing device, information processing system, and communication system that acquires information about the extracted beverage when the extracted beverage is placed in a container, or after the extracted beverage has been placed in a container, for each beverage placed in multiple containers, and determines the content to be provided to each person associated with the multiple containers based on the acquired information.
[0296] Furthermore, each control operation shown in the first to sixth embodiments is executed based on a program that causes a computer to execute each processing procedure, and each control operation can also be understood as an invention of a method or program. For example, each control operation shown in the first to sixth embodiments can be realized by storing the program related to each control operation shown in the first to sixth embodiments in a storage medium of an information processing device such as an electronic device or a server, reading the program from this storage medium, and having the information processing device execute the read program. Alternatively, the program may be stored and used on an external storage medium (for example, a CD (Compact Disc), DVD (Digital Versatile Disc), memory card), etc., of the information processing device.
[0297] The first to sixth embodiments are merely examples of how to realize the invention described in the claims, and are not limited thereto. Various modifications can be made without departing from the spirit of the invention. For example, the following configurations (configuration examples 1 to 19) can be adopted. For example, it can be configured as a stand, electronic equipment, communication system, information processing device, information processing method, and program. [Configuration Example 1] A stand for supporting a dripper that contains a substance for extracting beverages and allows the liquid poured into the substance to fall into a container, A stand equipped with a sensor on the upper side of the aforementioned housing section. [Configuration Example 2] A stand for supporting a dripper that contains a substance for extracting beverages and allows the liquid poured into the substance to fall into a container, A stand equipped with a sensor that acquires information about the liquid stored in the aforementioned container. [Configuration Example 3] A stand for supporting a dripper that contains a substance for extracting beverages and allows the liquid poured into the substance to fall into a container, A stand equipped with a user interface that outputs information about the liquid stored in the aforementioned container. [Configuration Example 4] It can be used by placing it between a dripper, which allows the liquid poured by the user to fall into a substance for extracting beverages, and a container that collects the liquid that falls from the dripper. An electronic device that uses information about the liquid stored in the container to perform processing from an output unit to provide content to the user. [Configuration Example 5] It can be used by placing it between a dripper, which allows liquid poured into a substance for extracting beverages to fall, and a container that collects the liquid that falls from the dripper. An electronic device comprising at least one of the following: a temperature sensor capable of measuring the temperature of a liquid stored in the container; an odor sensor capable of measuring the odor of the liquid; an audio sensor capable of measuring the sound of the liquid; a weight sensor capable of measuring the weight of the liquid; and a taste sensor capable of measuring the taste of the liquid. [Configuration Example 6] It can be used by placing it between a dripper, which allows liquid poured into a substance for extracting beverages to fall, and a container that collects the liquid that falls from the dripper. An electronic device comprising a control unit that uses information about the liquid stored in the aforementioned container to control the output of content from the output unit. [Configuration Example 7] It can be used by placing it between a dripper, which allows liquid poured into a substance for extracting beverages to fall, and a container that collects the liquid that falls from the dripper. An electronic device comprising a communication unit that exchanges information for outputting content from an output unit using information related to the liquid stored in the aforementioned container. [Configuration Example 8] It can be used by placing it between a dripper, which allows liquid poured into a substance for extracting beverages to fall, and a container that collects the liquid that falls from the dripper. An electronic device equipped with a communication unit that exchanges information about the liquid stored in the aforementioned container with other devices. [Configuration Example 9] An electronic device that, when a user dispenses a beverage, acquires information about the beverage being stored in the container at multiple predetermined timings, and uses the multiple pieces of information to perform processing for providing content to the user. [Configuration Example 10] A communication system that provides content to multiple users who drink each of the beverages contained in each of multiple containers, Multiple electronic devices that acquire information about the beverage placed in the container and transmit it to an information processing device, An information processing device that obtains determination information for each beverage based on information about each beverage transmitted from the plurality of electronic devices, determines content to be assigned to the electronic device related to the determination information based on the determination information, and performs processing to provide the determined content to the electronic device. A communication system that includes this. [Configuration Example 11] An information processing device that provides content to multiple users who drink each of the beverages, using information about each beverage contained in each of multiple containers, Information regarding the aforementioned beverages is obtained for each beverage contained in multiple containers. Based on the acquired information regarding the beverage, determine the judgment information for each beverage. Based on the judgment information, the content to be assigned to the beverage related to the judgment information is determined. The system includes a control unit that provides the determined content to the user's electronic device related to the beverage. Information processing device. [Configuration Example 12] The information relating to the beverage is information relating to the beverage at any of the following points: when the beverage is produced and stored in a container; when the produced beverage is placed in the container; or after the produced beverage has been placed in the container. The information processing device described in Configuration Example 11. [Configuration Example 13] An information processing device that provides content to multiple users who drink each of the beverages, using image information relating to the surface of each beverage placed in each of multiple containers, Image information relating to the surface of the beverage or feature quantities relating to said image information are obtained for each beverage in multiple containers. Based on the acquired image information or the features related to said image information, determination information for each beverage is obtained. Based on the judgment information, the content to be assigned to the beverage related to the judgment information is determined. The system includes a control unit that provides the determined content to the user's electronic device related to the beverage. Information processing device. [Configuration Example 14] The image information relating to the surface of the beverage is image information relating to the surface of the beverage at any of the following times: when the beverage is being produced and placed in a container; when the produced beverage is being placed in the container; or after the produced beverage has been placed in the container. The information processing device described in Configuration Example 13. [Configuration Example 15] The control unit is an information processing device according to any one of the configuration examples 11 to 14, which determines the determination information based on information regarding natural phenomena occurring on the surface of the beverage. [Configuration Example 16] An information processing method that provides content to multiple users who drink each of the beverages contained in each of multiple containers, A process to obtain information about the beverages for each beverage contained in multiple containers, A process to obtain determination information for each beverage based on the acquired information about the beverage, Based on the said determination information, a process is performed to determine the content to be assigned to the beverage related to said determination information, The process of providing the determined content to the user's electronic device related to the beverage. Information processing methods including [Configuration Example 17] An information processing method that provides content to multiple users who drink each of the beverages, using image information relating to the surface of each beverage in each of the multiple containers, A process to acquire image information or feature quantities related to the surface of the beverage for each beverage in multiple containers, A process to obtain determination information for each beverage based on the acquired image information or the features related to said image information, Based on the said determination information, a process is performed to determine the content to be assigned to the beverage related to said determination information, The process of providing the determined content to the user's electronic device related to the beverage. Information processing methods including [Configuration Example 18] A program for a computer to implement an information processing function that provides content to multiple users who drink each of the beverages contained in each of multiple containers, A function to obtain information about the aforementioned beverages for each beverage contained in multiple containers, A function to obtain determination information for each beverage based on the acquired information about the beverage, Based on the said judgment information, a function is provided to determine the content to be assigned to the beverage related to said judgment information, The function of providing the determined content to the user's electronic device related to the beverage. A program to make a computer realize this. [Configuration Example 19] An information processing method that provides content to multiple users who drink each of the beverages, using image information relating to the surface of each beverage in each of the multiple containers, A function to acquire image information or feature quantities related to the surface of the beverage for each beverage in multiple containers, A function to obtain determination information for each beverage based on the acquired image information or the features related to said image information, Based on the said judgment information, a function is provided to determine the content to be assigned to the beverage related to said judgment information, The function of providing the determined content to the user's electronic device related to the beverage. A program to make a computer realize this.
[0298] Furthermore, the following configurations (configuration examples 1 to 11) can also be adopted. For example, it can be configured as a stand, an information processing method, and a program. [Configuration Example 1] A stand for supporting a dripper that houses a substance for extracting beverages in a container and allows the user to manually pour the liquid into the substance and then drop it into a container, A sensor is provided on the upper side of the aforementioned housing section. A stand that performs processing to output content from an output unit using the transitions of multiple pieces of information about the liquid acquired by the aforementioned sensor. [Configuration Example 2] A stand for supporting a dripper that houses a substance for extracting beverages in a container and allows the user to manually pour the liquid into the substance and then drop it into a container, A sensor is provided on the upper side of the aforementioned housing section. A stand that uses information about the liquid acquired by the sensor to perform processing to output content from the output unit to the user. [Configuration Example 3] A stand for supporting a dripper that houses a substance for extracting beverages in a container and allows the user to manually pour the liquid into the substance and then drop it into a container, A sensor is provided on the upper side of the aforementioned housing section. A stand that uses information about the liquid acquired by the sensor to perform processing to output content from an output unit that is unrelated to both the beverage and the extraction of the beverage. [Configuration Example 4] A stand according to any of the configuration examples 1 to 3, which includes the output unit. [Configuration Example 5] The stand according to any one of Configuration Examples 1 to 4, wherein the sensor is at least one of the following: an image sensor that captures an image of a subject and generates image data; a temperature sensor capable of measuring temperature; an odor sensor capable of measuring odor; an audio sensor capable of measuring sound; a weight sensor capable of measuring weight; and a taste sensor capable of measuring taste. [Configuration Example 6] A stand for supporting a dripper that houses a substance for extracting a beverage in a storage compartment and allows a user to manually pour the liquid into the substance and drop it into a container, and an information processing method to be performed by the stand which is equipped with a sensor on the upper side of the storage compartment, An information processing method including a process for outputting content from an output unit using the transitions of multiple pieces of information about the liquid acquired by the sensor. [Configuration Example 7] A stand for supporting a dripper that houses a substance for extracting a beverage in a storage compartment and allows a user to manually pour the liquid into the substance and drop it into a container, and an information processing method to be performed by the stand which is equipped with a sensor on the upper side of the storage compartment, An information processing method that includes processing to cause the user to output content from an output unit using information about the liquid acquired by the sensor. [Configuration Example 8] A stand for supporting a dripper that houses a substance for extracting a beverage in a storage compartment and allows a user to manually pour the liquid into the substance and drop it into a container, and an information processing method to be performed by the stand which is equipped with a sensor on the upper side of the storage compartment, An information processing method including a process for outputting content unrelated to both the beverage and the extraction of the beverage from an output unit, using information about the liquid acquired by the sensor. [Configuration Example 9] A stand for supporting a dripper that houses a substance for extracting beverages in a storage compartment and allows the user to manually pour the liquid into the substance and drop it into a container, and a program to be executed on the computer of the stand which is equipped with a sensor on the upper side of the storage compartment, A program that uses the transitions of multiple pieces of information about the liquid acquired by the sensor to execute a process for outputting content from the output unit. [Configuration Example 10] A stand for supporting a dripper that houses a substance for extracting beverages in a storage compartment and allows the user to manually pour the liquid into the substance and drop it into a container, and a program to be executed on the computer of the stand which is equipped with a sensor on the upper side of the storage compartment, A program that uses the information about the liquid obtained by the sensor to perform a process to output content from the output unit to the user. [Configuration Example 11] A stand for supporting a dripper that houses a substance for extracting beverages in a storage compartment and allows the user to manually pour the liquid into the substance and drop it into a container, and a program to be executed on the computer of the stand which is equipped with a sensor on the upper side of the storage compartment, A program that uses the information about the liquid acquired by the sensor to cause the output unit to execute a process to output content unrelated to both the beverage and the extraction of the beverage. [Explanation of Symbols]
[0299] 1, 200, 600, 610, 620, 630, 640, 650 Coffee brewers 10, 210, 601, 611, 621, 631, 641, 651 drippers 11,211 containment units 12, 212 Flange section 20, 220, 320, 350, 360, 431, 441, 442, 443, 451, 452, 660, 700, 710, 720, 725, 750 Electronic equipment 21, 221, 321, 481 lenses 22, 222, 322, 482 Image acquisition unit 23, 223, 323, 352, 412, 483 Control Unit 24, 224, 324, 353, 413, 484 storage section 25, 225, 354, 361, 485 Audio output section 30, 603, 613, 623, 633, 643, 652 containers 213 Exit 226, 355, 486 Input section 227, 356, 487 display section 229, 357, 488 User Interfaces 240, 602, 612, 622, 632, 642 stands 325, 351, 411 Communications Department 358 Location information acquisition unit 400 Communication Systems 410 Servers 420 Network 490 Location information setting section 604, 614, 624, 634, 644, 661 sensors 653 Installation stand
Claims
1. After the beverage, which is produced by a substance and liquid for creating a beverage, is placed in a container, information regarding the transition of natural phenomena appearing on the surface of the produced beverage is obtained for each beverage in multiple containers. Based on the acquired information, determine the judgment information for each beverage. The process involves comparing the judgment information for each beverage, and then performing a process to provide the content determined from among multiple contents, which is then provided to the electronic devices of each person associated with the multiple containers. Information processing device.
2. After the beverage, which is produced by a substance and liquid for producing a beverage, is placed in a container, image information of the surface of the produced beverage or the transition of feature quantities related to said image information is obtained for each beverage placed in multiple containers. Based on the acquired image information or the transition of features related to said image information, determination information for each beverage is obtained. The process involves comparing the judgment information for each beverage, and then performing a process to provide the content determined from among multiple contents, which is then provided to the electronic devices of each person associated with the multiple containers. Information processing device.
3. The information processing device obtains the determination information based on information regarding the transition of natural phenomena occurring on the surface of the beverage. The information processing apparatus according to claim 2.
4. A process to obtain information regarding the transition of natural phenomena appearing on the surface of a beverage, after the beverage has been produced by a substance and liquid for producing a beverage has been placed in a container, for each beverage placed in multiple containers. Based on the acquired information, determination information for each beverage is obtained, and based on the comparison results obtained by comparing the determination information for each beverage, the content determined from among multiple contents is provided to the electronic devices of each person associated with the multiple containers. Information processing methods including
5. A function to acquire information regarding the transition of natural phenomena appearing on the surface of a beverage after it has been produced by a substance and liquid for producing a beverage and placed in a container, for each beverage placed in multiple containers. Based on the acquired information, the system obtains judgment information for each beverage, compares the judgment information for each beverage with each other, and provides the selected content from among multiple contents to the electronic devices of each person associated with the multiple containers. A program to make a computer realize this.
6. A plurality of electronic devices that, after a beverage produced from a substance and liquid for producing a beverage is placed in a container, acquire information on the transition of natural phenomena appearing on the surface of the produced beverage and transmit it to an information processing device, An information processing device that obtains determination information for each beverage based on information about each beverage in multiple containers transmitted from the multiple electronic devices, and performs processing to provide content determined from among multiple contents to the electronic devices of each person associated with the multiple containers based on the comparison results obtained by comparing the determination information for each beverage. A communication system that includes this.