Beverage supply device
The beverage supply device uses imaging and detection units to accurately classify cups as hot or cold and determine beverage types, addressing the challenge of transparent cups and multiple beverage options, ensuring precise dispensing.
Patent Information
- Application Number
- JP2021022836
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-02-16
- Publication Date
- 2025-08-13
- Estimated Expiration
- 2041-02-16
AI Technical Summary
Existing beverage dispensers struggle to accurately determine the type of beverage to be dispensed, especially when cups for cold beverages are made of transparent materials and the number of beverage types increases, leading to low accuracy in identification.
A beverage supply device that includes an imaging unit to capture cup images with bands, a determination unit to detect the presence and number of bands, and a control unit to generate and supply beverages based on these detections, using edge extraction and color information to classify cups as hot or cold and determine beverage types.
The device achieves high accuracy in determining beverage types even with increasing numbers of options, ensuring precise dispensing of hot or cold beverages based on cup characteristics.
Smart Images

Figure 0007721909000001 
Figure 0007721909000002 
Figure 0007721909000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to a beverage dispenser that can accurately determine the type of beverage to be dispensed into a cup even when the number of types of beverage to be dispensed into a cup increases. [Background technology]
[0002] Conventionally, beverage dispensers such as coffee machines have been installed in stores such as convenience stores. When a customer selects a beverage, the beverage dispenser prepares the beverage by, for example, grinding coffee beans and performing an extraction process such as dripping, and then dispenses the beverage from a nozzle constituting the beverage dispenser into a cup placed in the beverage dispenser (see, for example, Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2009-274767 Summary of the Invention [Problem to be solved by the invention]
[0004] Conventionally, when dispensing a beverage into a cup placed on a beverage dispenser's mounting section, an image of the cup placed on the mounting section is captured, the cup is identified based on color information, brightness information, etc., and the beverage of the type corresponding to the identified cup is dispensed into the cup. Some systems also determine the type of beverage by identifying characters printed on the cup. Furthermore, the type of beverage also includes the cup size, and the cup size is determined by detecting the height of the cup using multiple optical sensors of different heights.
[0005] However, many cups specifically for cold beverages are made of transparent material, such as colorless, transparent resin, with ice inside, so the accuracy of the beverage type determination method described above is inevitably low.
[0006] On the other hand, the number of types of beverages to be dispensed into cups is increasing, not only for cold beverages but also for hot beverages, and there is a need to be able to determine the various types of beverages with even greater accuracy.
[0007] The present invention has been made in consideration of the above, and aims to provide a beverage supply device that can accurately determine the type of beverage to be supplied to a cup even when the number of types of beverage to be supplied to a cup increases. [Means for solving the problem]
[0008] In order to solve the above-mentioned problems and achieve the object, the present invention is a beverage supply device that supplies a beverage produced in a beverage production unit to a cup placed in a beverage supply unit, and is characterized by comprising: an imaging unit that acquires a cup image of the cup including one or more bands displayed in a ring on the outer surface depending on the type of beverage in the cup; a determination unit that detects the presence or absence of the bands and the number of the bands in the cup image acquired by the imaging unit and determines the type of beverage in the cup including the presence or absence of the bands and the number of the bands; and a beverage supply control unit that generates a beverage corresponding to the type of beverage determined by the determination unit and controls the supply to the cup.
[0009] In addition, in the above invention, the present invention is characterized in that the judgment unit generates an edge extraction image of the cup image, detects straight lines of a predetermined length or longer and the number of such straight lines, and detects the presence or absence of the bands and the number of the bands.
[0010] In the present invention, the determination unit determines the different beverage types based on the presence or absence of the bands and the number of the bands.
[0011] Furthermore, in the above invention, the present invention is characterized in that the judgment unit performs a labeling process on the edge extraction image, detects straight lines that are equal to or longer than the predetermined length and the number of such straight lines, and detects the presence or absence of the bands and the number of the bands.
[0012] Furthermore, in the above invention, the present invention is characterized in that the judgment unit sets up a band judgment frame in the image area where the band is displayed, and detects straight lines of a predetermined length or more and the number of such straight lines within the band judgment frame to detect the presence or absence of the band and the number of such bands.
[0013] In addition, in the above invention, the present invention is characterized in that the cup has a color band of a predetermined color displayed in a ring shape on the outer surface depending on the type of beverage in the cup, and the determination unit determines the type of beverage in the cup based on the presence or absence of the band, the number of the bands, and color information of the predetermined color of the color band.
[0014] In addition, in the above invention, the present invention is characterized in that the judgment unit sets a color band judgment frame in the image area where the color band is displayed, and detects the specified color of the color band based on color information within the color band judgment frame.
[0015] In addition, in the above invention, the present invention is characterized in that a correction mark or correction hole is provided on the beverage supply device body in the area imaged by the imaging unit, the imaging unit acquires a cup image including the correction mark or the correction hole, and the judgment unit corrects the position of the band judgment frame on the cup image based on the position on the image of the correction mark or the correction hole.
[0016] In addition, the present invention is characterized in that, in the above invention, a correction mark or correction hole is provided on the beverage supply device body in the area imaged by the imaging unit, the imaging unit acquires a cup image including the correction mark or the correction hole, and the judgment unit corrects the position of the color band judgment frame on the cup image based on the position on the image of the correction mark or the correction hole.
[0017] Furthermore, in the above invention, the present invention is characterized in that the predetermined color is detected based on whether or not the color information is included in any of a plurality of predetermined judgment areas on a color space, and the judgment unit stores positive detection points of the predetermined color and performs a learning process to change the predetermined judgment area in accordance with a change in the set of positive detection points within the predetermined judgment area.
[0018] In addition, in the above invention, the present invention includes a mounting section that, when the cup is placed on it, changes between an inclined position in which the central axis of the cup is inclined toward the dispensing direction of the nozzle that dispenses the beverage, and an upright position in which the central axis of the cup is parallel to the dispensing direction of the nozzle, due to the cup's own weight, and an attitude detection section that detects whether the mounting section is in the inclined position or the upright position when the cup is placed on the mounting section, and the determination section makes a classification determination that classifies the cup as a cup exclusively for hot beverages when the detection result of the attitude detection section is the inclined position, and classifies the cup as a cup exclusively for cold beverages when the detection result of the attitude detection section is the upright position, and determines the type of beverage including the classification determination. [Effects of the Invention]
[0019] According to the present invention, even if the number of types of beverages to be dispensed into cups increases, the type of beverage can be determined with high accuracy. [Brief explanation of the drawings]
[0020] [Figure 1] FIG. 1 is a perspective view showing the external configuration of a beverage dispenser according to an embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram showing a schematic configuration of a control system of the beverage dispenser. [Figure 3] FIG. 3 is an exploded perspective view showing an enlarged view of the main part of the beverage dispenser. [Figure 4] FIG. 4 is a perspective view showing the placement unit shown in FIG. [Figure 5] 5 is a cross-sectional side view of the mounting portion shown in FIG. 3 in a state where a cup is placed on the mounting portion and the mounting portion is in an inclined position. [Figure 6] 6 is a cross-sectional side view of the mounting portion shown in FIG. 3 in a state where a cup is placed on the mounting portion and the mounting portion is in an upright position. [Figure 7] FIG. 7 is an enlarged perspective view showing a state in which the detection state of the attitude detection unit is on. [Figure 8]FIG. 8 is an enlarged perspective view showing a state in which the detection state of the attitude detection unit is off. [Figure 9] FIG. 9 is an explanatory diagram showing an example of determining the type of beverage using a band attached to the top of a cup. [Figure 10] FIG. 10 is an explanatory diagram for explaining the labeling process within the band determination frame. [Figure 11] FIG. 11 is a flowchart showing the procedure of the beverage supply control process performed by the control unit. [Figure 12] FIG. 12 is a flowchart illustrating an example of a procedure for determining the type of beverage in a cup. [Figure 13] FIG. 13 is an explanatory diagram illustrating the beverage type determination process according to the first modification. [Figure 14] FIG. 14 is an explanatory diagram illustrating the beverage type determination process according to the second modification. [Figure 15] FIG. 15 is an explanatory diagram illustrating the position correction of the band determination frame W1 according to the third modification. [Figure 16] FIG. 16 is an explanatory diagram illustrating the correction process of the color determination reference data according to the fourth modification. DETAILED DESCRIPTION OF THE INVENTION
[0021] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings.
[0022] <Overall structure> Fig. 1 is a perspective view showing the external configuration of a beverage dispenser 1 according to an embodiment of the present invention, and Fig. 2 is a block diagram showing a schematic configuration of a control system of the beverage dispenser 1.
[0023] The beverage dispenser 1 illustrated here is a coffee machine installed in a store such as a convenience store, which performs an extraction process, for example, by grinding coffee beans and dripping, and dispenses various types of coffee beverages, including milk beverages such as caffè latte, into a cylindrical cup C with a bottom. The types of coffee beverages include different coffee beans, different blends of coffee beans, and different types of coffee bean grinding and dripping. The coffee beverages also include cold and hot beverages, and the cup sizes (beverage dispensing capacity) may be different. Furthermore, the beverage dispenser is not limited to coffee beverages, and may dispense only milk, for example.
[0024] In this embodiment, the cups C are divided into those specifically for cold beverages and those specifically for hot beverages. The cups C specifically for cold beverages are made of a transparent material, such as a colorless and transparent resin, and have ice (not shown) placed inside before the beverage is dispensed. These cups C specifically for cold beverages are stored frozen in a freezer to prevent the ice inside from melting. The cups C specifically for hot beverages are made of opaque paper, for example, in a color such as white, brown, navy blue, or orange, and are formed in approximately the same shape and size as the cups C specifically for cold beverages. These cups C specifically for hot beverages are stored at room temperature with the inside empty.
[0025] The beverage dispenser 1 includes a main body cabinet 10 and a front door 20. The main body cabinet 10 has a generally rectangular parallelepiped shape with an open front. Inside the main body cabinet 10, there is provided a beverage preparation unit 11 that prepares a beverage (for example, a coffee beverage such as a cafe latte).
[0026] The front door 20 is a door body large enough to close the opening on the front of the main cabinet 10. The front door 20 is provided at one side edge on the front side of the main cabinet 10 so as to be able to swing around the central axis of an axis part (not shown) that extends in the vertical direction, and is capable of opening and closing the opening on the front of the main cabinet 10.
[0027] The front of the front door 20 forms the customer service surface and is provided with a display unit 21 and an opening / closing door 22. The display unit 21 is configured, for example, with a liquid crystal touch panel, and displays various information and has an input unit 21a that allows input operations such as touch operations.
[0028] The opening / closing door 22 is made of a light-transmitting material such as a transparent resin, and is large enough to cover the entrance 24 of the beverage supply unit 23, as shown in Fig. 3. The left end of this opening / closing door 22 is pivotally supported by the front door 20, and the opening / closing door 22 is capable of swinging in the front-to-rear direction. That is, the opening / closing door 22 can swing in the front-to-rear direction toward and away from the beverage supply unit 23, and can close the entrance 24 of the beverage supply unit 23 when swinging rearward toward the beverage supply unit 23, and can open the entrance 24 when swinging forward away from the beverage supply unit 23.
[0029] The beverage supply unit 23 is configured by providing a recess below the display unit 21. The beverage supply unit 23 has a nozzle 25, a stage 26, a rear wall 27, a side wall 28, and a placing portion 29.
[0030] The nozzle 25 ejects the beverage produced in the beverage production unit 11 vertically downward. The stage 26 is provided in a region below the nozzle 25. This stage 26 is formed with a passage hole 26a that allows the beverage that has been ejected from the nozzle 25 but not supplied to the cup C to pass through, and a tray (not shown) for storing the beverage is provided below the passage hole 26a. The rear wall 27 covers the rear surface of the stage 26. The side walls 28 cover both side surfaces of the stage 26.
[0031] As shown in Figure 4, the mounting portion 29 is molded from, for example, a resin material, and is mounted on the side wall 28 with a swaying shaft member 29b that passes through mounting holes formed in mounting pieces 29a that protrude upward in a pair on the left and right, so that the mounting portion 29 is capable of swinging together with the swaying shaft member 29b around the central axis of the swaying shaft member 29b.
[0032] The placing portion 29 has a bottom portion 29c and rear wall portions 29d, 29e. The bottom portion 29c is for placing the cup C thereon. The rear wall portions 29d, 29e are provided in a pair on the left and right sides of the bottom portion 29c, spaced apart from each other. The rear wall portions 29d, 29e are provided so that the distance between them gradually increases toward the front. An opening 30 is formed between the rear wall portions 29d, 29e and behind the cup C to be placed thereon. In addition, a connecting portion 29f is provided above the opening 30, connecting the rear wall portions 29d, 29e.
[0033] In a normal state, the mounting portion 29 is biased by a biasing means (not shown) or by its own weight to assume an inclined position in which the bottom portion 29c gradually tilts upward as it moves forward, as shown in Fig. 5. The mounting portion 29 maintains its inclined position even when a cup C for a hot beverage is placed on the bottom portion 29c, as shown in Fig. 5. In other words, the mounting portion 29 assumes the inclined position when the placed cup C is empty.
[0034] 5, when a cup C for a hot beverage is placed on the mounting portion 29, the bottom portion 29c contacts the bottom surface of the cup C. Furthermore, the rear wall portions 29d and 29e are provided so that the distance between them gradually increases toward the front, and each contacts a part of the outer wall portion of the cup C. This allows the mounting portion 29 to hold the cup C in a position that prevents it from rolling in an inclined position, i.e., to position the cup C.
[0035] When the mounting portion 29 is in an inclined position, the bottom 29c is inclined at an inclination angle α with respect to the horizontal plane G. That is, since the nozzle 25 dispenses beverage vertically downward, the central axis C1 of the cup C dedicated to hot beverages is inclined backward at an inclination angle α (for example, 5°) with respect to the dispensing direction (vertical direction) H of the nozzle 25. When the mounting portion 29 is in an inclined position at the inclination angle α, the beverage dispensed from the nozzle 25 is allowed to come into contact with any location on the inner peripheral wall of the cup C.
[0036] 6, when a cup C exclusively for cold beverages, i.e., a cup C with a weight equal to or greater than a predetermined value (for example, approximately 100 g; hereinafter also referred to as the predetermined value), is placed on bottom 29c of placing portion 29, placing portion 29 assumes an upright position in which central axis C1 of cup C is parallel to discharge direction H (vertical direction) of nozzle 25. Furthermore, when beverage is poured into cup C exclusively for hot beverages from nozzle 25, and the weight of cup C exceeds a predetermined value as the poured amount increases, placing portion 29 assumes an upright position in which central axis C1 of cup C is parallel to discharge direction H of nozzle 25.
[0037] That is, the mounting portion 29 is provided so as to be able to swing between an inclined position and an upright position, and assumes an inclined position when the cup C is empty, while assuming an upright position when the weight of the cup C exceeds a predetermined value. As shown in Figure 4, etc., a damper member 29g is connected to the left end portion of the swing shaft member 29b, so that the swing speed is reduced when swinging from the inclined position to the upright position.
[0038] 5 and 6, an inclined plate 50 is disposed behind the connecting portion 29f, and a correction hole 51 is formed in the inclined plate 50. The correction hole 51 may be a through hole, or instead of the correction hole 51, a correction mark may be attached on the inclined plate 50.
[0039] Also, the rear wall 27 is provided with an imaging unit 60 that captures an image of the cup C and the inclined plate 50 from the rear wall 27 side through the opening 30, and light irradiating units 61, 62 such as LEDs that irradiate the cup C and the inclined plate 50 with light. The light intensity of the light irradiating units 61, 62 is set to be greater than the light intensity of ambient light.
[0040] As shown in FIG. 2, the beverage dispenser 1 includes a cup detection unit 31, a posture detection unit 32, a door open / close detection unit 33, a door open / close lock mechanism 34, an imaging unit 60, light irradiation units 61 and 62, and a control unit 40.
[0041] The cup detection unit 31 is configured with, for example, an optical sensor, and detects whether or not a cup C is placed in the beverage supply unit 23, i.e., whether or not a cup C is placed on the placement unit 29. The cup detection unit 31 provides the control unit 40 with the detection result of the presence or absence of the cup C.
[0042] The posture detection unit 32 detects whether the placement unit 29 is in an inclined posture or an upright posture. Specifically, the posture detection unit 32 is configured with, for example, an optical sensor, and is provided in a rear region of the placement unit 29, specifically, on the rear wall 27, as shown in FIGS. 7 and 8. When the placement unit 29 is in an inclined posture, the posture detection unit 32 is turned on because the detection target 32c of the placement unit 29 is not interposed between the light-emitting unit 32a and the light-receiving unit 32b, as shown in FIG. 7, and sends a posture detection signal to the control unit 40. On the other hand, when the placement unit 29 is in an upright posture, the detection target 32c is interposed between the light-emitting unit 32a and the light-receiving unit 32b, as shown in FIG. 8, and the posture detection unit 32 is turned off, and stops outputting the posture detection signal to the control unit 40.
[0043] The door open / close detection unit 33 is provided near the entrance 24 of the beverage supply unit 23 and is composed of, for example, an optical sensor. The door open / close detection unit 33 detects whether the entrance 24 is opened or closed by the opening / closing door 22, and more specifically, detects whether the entrance 24 is closed, i.e., whether the opening / closing door 22 is closed. The door open / close detection unit 33 provides the control unit 40 with the detection result of whether the opening / closing door 22 is closed or not.
[0044] The door lock mechanism 34 is provided near the entrance 24 of the beverage dispenser 23. The door lock mechanism 34 is capable of switching between a locked state in which the door 22 that closes the entrance 24 is kept closed and the door 22 is prevented from swinging forward, and an unlocked state in which the door 22 is allowed to swing forward. The door lock mechanism 34 is switched in response to a command given by the control unit 40.
[0045] The control unit 40 is electrically connected to the beverage production unit 11, display unit 21, cup detection unit 31, posture detection unit 32, door opening / closing detection unit 33, door opening / closing lock mechanism 34, imaging unit 60, and light irradiation units 61, 62, and controls the overall operation of each of these units in accordance with the programs and data stored in the memory unit 41, which is also electrically connected.
[0046] The control unit 40 may be realized, for example, by having a processing device such as a CPU (Central Processing Unit) execute a program, i.e., by software, or by hardware such as an IC (Integrated Circuit), or by a combination of software and hardware.
[0047] The control unit 40 controls the entire device and includes a determination unit 40a and a beverage supply control unit 40b. The determination unit 40a classifies the cup C as a cup for hot beverages only if the posture detection unit 32 detects an inclined posture, and as a cup for cold beverages only if the posture detection unit 32 detects an upright posture. The determination unit 40a then determines the type of beverage based on the cup image acquired by the imaging unit 60, including this classification. In particular, the cup C displays one or more circular bands on the outer periphery of the top of the cup C as a means of determining the type of beverage contained in the cup C. The determination unit 40a detects the presence or absence of bands and the number of bands in the cup image, and determines the type of beverage based on the presence or absence and number of bands. The bands are, for example, white at maximum brightness. When the imaging unit 60 captures an image, the control unit 40 irradiates the cup C and the inclined plate 50 with light from the light irradiators 61 and 62.
[0048] The beverage supply control unit 40b generates a beverage corresponding to the type of beverage determined by the determination unit 40a and controls the supply of the beverage to the cup C.
[0049] <Beverage type determination> FIG. 9 is an explanatory diagram showing an example of beverage type determination using a band S attached to the top of a cup C. FIG. 5(a) shows a cup image D captured by the imaging unit 60. The cup image D captures the entire cup C, as well as the white band S at the top of the cup C and the letter M at the bottom of the cup C. The top of the cup image D also shows the back surface of the inclined plate 50, and also captures the correction hole 51. The correction hole 51 is a hole that opens to the back side (+X direction), and is captured as a group of pixels with low brightness relative to the inclined plate 50.
[0050] The determination unit 40a performs edge extraction processing on the cup image D to generate the edge-extracted image D1 shown in Fig. 9(b). The determination unit 40a then detects lines S1 and S2 of a predetermined length or more and the number of lines S1 and S2 within a band determination frame W1 that is set in advance to correspond to the position of the band S in the image area of the edge-extracted image D1, and detects the presence or absence of a band S and the number of bands S. Note that the edge extraction processing may be performed only within the band determination frame W1.
[0051] Because the brightness of the band S is higher than that of the areas above and below the band S, two straight lines S1 and S2 in the Y direction corresponding to the top and bottom edges of the band S are displayed in the edge extraction image D1. When there is one band S, the presence or absence of the band S is determined when two straight lines of a predetermined length or more are detected within the band determination frame W1. The reason for using the band S is that it is believed that the only straight lines S1 and S2 of a predetermined length or more appearing in the edge extraction image D1 are the band S. Therefore, it is not necessary to use the band determination frame W1 to detect the straight lines S1 and S2.
[0052] Meanwhile, the determination unit 40a recognizes the character M within a character determination frame W2 that is set in advance in correspondence with the position of the character M in the image area of the edge extraction image D1, and acquires character information about the character M. Note that this character recognition may be performed directly on the cup image D, rather than on the edge extraction image D1. The character M is displayed in a ring shape on the outer peripheral surface of the lower part of the cup C.
[0053] The determination unit 40a determines the classification of the cup C based on the detection result of the orientation detection unit 32, the presence or absence of the detected band S, the number of bands S, and the type of beverage based on the detected character information. In addition to determining the classification of the cup C, for example, if the character M indicates either "coffee" or "cafe latte," and if the band S is present, the cup size is regular size, and if the band S is absent, the cup size is large size, the determination unit 40a determines that the type of beverage is regular size coffee if the character M is "coffee" and the band S is present.
[0054] It is preferable to detect straight lines S1 and S2 of a predetermined length or more within the band detection frame W1 by performing a labeling process on the edge extraction image within the band detection frame W1. The following is an explanatory diagram illustrating the labeling process within the band detection frame W1. In FIG. 10, pixels labeled as "1" and "2" are acquired for the straight lines S1 and S2, respectively. The determination unit 40a detects the presence of a straight line if the maximum number of connected labeled pixels in the Y direction corresponds to a predetermined length or more, and determines the presence of a band S if it detects the presence of two straight lines S1 and S2.
[0055] Moreover, although the band S is white with maximum brightness, it is not limited to this and may be black with minimum brightness, for example, as long as the edge can be extracted.
[0056] <Beverage supply control processing> Next, the beverage supply control process performed by the control unit 40 will be described with reference to the flowchart shown in FIG.
[0057] 7, the control unit 40 first determines whether or not the cup detection unit 31 has detected that the cup C has been placed on the placement unit 29 (step S110). That is, the cup detection unit 31 detects whether or not the cup C has been placed on the placement unit 29. If the presence of the cup C is not detected (step S110: No), the determination process of step S110 is repeated.
[0058] If the presence of cup C is detected (step S110: Yes), the control unit 40 determines whether the opening / closing door 22 is closed (step S120) based on the detection result of the door opening / closing detection unit 33. If the opening / closing door 22 is not closed (step S120: No), the determination process of step S120 is repeated.
[0059] On the other hand, if the opening / closing door 22 is closed (step S120: Yes), the control unit 40 determines whether or not an attitude detection signal has been input from the attitude detection unit 32 (step S130). If an attitude detection signal has been input (step S130: Yes), the control unit 40 determines that the placed cup C is for hot beverages only (step S140). On the other hand, if an attitude detection signal has not been input (step S130: No), the control unit 40 determines that the placed cup C is for cold beverages only (step S150).
[0060] Thereafter, the control unit 40 instructs the imaging unit 60 to acquire a cup image including the cup C under light irradiation by the light irradiation units 61 and 62, and acquires the cup image D (step S160). Thereafter, the determination unit 40a performs a beverage type determination process for the cup to determine the beverage type (step S170).
[0061] Thereafter, the control unit 40 causes the display unit 21 to display the beverage to be dispensed into the cup C according to the determined beverage type, and to display a guide to touch the input unit 21a on which a confirmation message is displayed (step S180).
[0062] The control unit 40 then determines whether the input unit 21a has been touched (step S90). If the input unit 21a has not been touched (step S190: No), the control unit 40 repeats the determination process of step S190. On the other hand, if the input unit 21a has been touched (step S190: Yes), the control unit 40 locks the open / close door 22 in a closed state using the door lock mechanism 34 (step S200) and causes the beverage preparation unit 11 to prepare and dispense the beverage to be dispensed (step S210). Note that the tilt angle α of the placement unit 29 is approximately 5° when no cup C is placed on it. This is to facilitate the placement of the cup C. If the orientation detection unit 32 detects that the cup is a hot beverage cup, the tilt angle α may be increased to, for example, 25° after capturing the cup image D and before dispensing the beverage, and then the beverage may be dispensed. Increasing this tilt angle α can prevent the occurrence of foam when dispensing the beverage.
[0063] Thereafter, the control unit 40 determines whether or not the beverage supply by the beverage preparation unit 11 has finished (step S220). If the beverage supply has not finished (step S220: No), the control unit 40 returns to step S210 and continues the process of preparing and supplying the beverage.
[0064] On the other hand, if the beverage supply has finished (step S220: Yes), the control unit 40 unlocks the door 22 from the closed state by the door lock mechanism 34 (step S230), and ends this process. The above process is repeated at predetermined intervals.
[0065] <Example of cup beverage type determination process> 12 is a flowchart showing an example of a beverage type determination process for cup C. As shown in FIG. 12, the determination unit 40a first performs character recognition within the character determination frame W2 (step S310). Then, the determination unit 40a determines whether the character recognition result is coffee or cafe latte (step S320).
[0066] If the character recognition result indicates coffee (step S320: coffee), the determination unit 40a performs a process to detect a band S based on the edge extraction process and labeling process (step S330). Then, it determines whether a band S is present (step S340). If it is determined that a band S is present (step S340: Yes), it further determines whether the cup is for hot beverages only (step S350) based on the determination results of steps S140 and S150. If the cup is for hot beverages only (step S350: Yes), it finally determines the beverage type as regular-sized hot coffee (step S360) and returns to step S170. On the other hand, if the cup is not for hot beverages only (step S350: No), it is determined that the cup is for cold beverages only, and finally determines the beverage type as regular-sized iced coffee (step S370) and returns to step S170.
[0067] On the other hand, if it is determined that there is no band S (step S340: No), it is further determined whether the cup is for hot beverages only based on the results of the determinations in steps S140 and S150 (step S380). If it is a cup for hot beverages only (step S380: Yes), the beverage type is finally determined to be a large-sized hot coffee (step S390) and the process returns to step S170. On the other hand, if the cup is not for hot beverages only (step S380: No), the cup is for cold beverages only, and the beverage type is finally determined to be a large-sized iced coffee (step S400) and the process returns to step S170.
[0068] On the other hand, if the character recognition result is determined to be a caffè latte (step S320: caffè latte), the determination unit 40a performs a process to detect a band S based on the edge extraction process and labeling process (step S410). Then, it determines whether or not a band S is present (step S420). If it is determined to be a band S (step S420: Yes), it further determines whether or not the cup is for hot beverages only based on the determination results of steps S140 and S150 (step S430). If it is a cup for hot beverages only (step S430: Yes), it finally determines the beverage type as a regular-sized hot caffè latte (step S440) and returns to step S170. On the other hand, if it is not a cup for hot beverages only (step S430: No), it is a cup for cold beverages only, and finally determines the beverage type as a regular-sized iced caffè latte (step S450) and returns to step S170.
[0069] On the other hand, if it is determined that there is no band S (step S420: No), it is further determined whether the cup is for hot beverages only based on the results of the determinations in steps S140 and S150 (step S460). If it is a cup for hot beverages only (step S460: Yes), the beverage type is finally determined to be a large-sized hot cafe latte (step S470) and the process returns to step S170. On the other hand, if the cup is not for hot beverages only (step S460: No), the cup is for cold beverages only, and the beverage type is finally determined to be a large-sized iced cafe latte (step S480) and the process returns to step S170.
[0070] 12, the cup size, i.e., whether it is a regular size or a large size, is determined by determining whether there is a band S (steps S340, S420). However, whether the coffee bean blend is a special blend or a normal blend may also be determined by determining whether there is a band S. In this case, the cup size may be determined by providing a new optical sensor that detects the passage and interruption of light that crosses a height that exceeds the height of a regular-size cup and is less than the height of a large-size cup, and this optical sensor may be used to detect whether the cup size is regular or large. Specifically, if light is transmitted and received, the cup is determined to be regular size, and if light is interrupted, the cup is determined to be large size.
[0071] In this embodiment, a ring-shaped band S is attached to the outer periphery of the cup C, and the presence or absence of the band S and the number of bands S are detected by detecting straight lines S1, S2 of a predetermined length or more and the number of straight lines S1, S2 in an edge extraction image D1 of the band S, which would not be present on a normal cup C. This ensures reliable detection of the band S, and by combining the presence or absence and number of bands S with other beverage type determination elements, it is possible to accurately determine a wide variety of beverage types. Note that, as will be described later, by having multiple bands S, multiple beverage types can also be determined using the bands S alone.
[0072] In the above embodiment, the device includes a mounting unit 29 that, when cup C is placed on it, changes position between an inclined position, in which the central axis of cup C is inclined relative to the dispensing direction of nozzle 25, and an upright position, in which the central axis of cup C is parallel to the dispensing direction of nozzle 25, due to the weight of cup C, and a position detecting unit 32 that detects whether mounting unit 29 is in an inclined or upright position when cup C is placed on mounting unit 29. Determining unit 40a classifies cup C as a cup for hot beverages only if position detecting unit 32 detects an inclined position, and as a cup for cold beverages only if position detecting unit 32 detects an upright position. This classification is included in the beverage type determination. However, the device may not include a mounting unit and position detecting unit 32 that allow the cup to assume an inclined or upright position, and instead determines whether the cup is for hot beverages only or cold beverages only by using cup image D. In this case, for example, the number of bands S may be increased, or the character indicating whether the cup is for hot beverages or cold beverages may be included in the text.
[0073] <Variation 1> FIG. 13 is an explanatory diagram illustrating the beverage type determination process according to Modification 1. In Modification 1, as shown in FIG. 13(a), multiple bands S, S10 are displayed in a ring shape on the outer peripheral surface of a cup C. Then, as shown in FIG. 13(b), straight lines S1, S2, S11, S12 of a predetermined length or more are detected within a single band determination frame W10 on an edge-extracted image D1, and their number is detected. The determination unit 40a determines that one band exists when there are two straight lines of the predetermined length or more, and determines that two bands exist when there are four straight lines of the predetermined length or more. This allows one more beverage type to be added.
[0074] Furthermore, by providing separate band determination frames for the lines S1 and S2 and for the lines S11 and S12, and combining this with the position information of each band determination frame to create binary bit information, three more beverage types can be added. Also, while the above example shows two bands, this is not limiting, and three or more bands may be provided for detection. By adding multiple bands in this way, it is possible to accurately determine a variety of beverage types using only the bands.
[0075] <Variation 2> Figure 14 is an explanatory diagram illustrating the beverage type determination process according to Modification 2. In Modification 2, as shown in Figure 14(a), a circular color band CS is further displayed on the outer peripheral surface of the cup C, and color information of the color band CS is detected using a color band determination frame W3 in the area within this color band CS.
[0076] The type of beverage corresponding to the predetermined color can be determined based on the determination result of the color information of the color band CS by this color band determination frame W3. In this case, the type of beverage is determined by adding the information of the band S described above.
[0077] <Variation 3> 15 is an explanatory diagram illustrating the position correction of the band determination frame W1 according to Modification 3. The band determination frame W1 is placed on the cup image D or edge extraction image D1, and if the position of the cup C in the captured cup image D or edge extraction image D1 is misaligned, the positions of the band determination frame W1 and the band S will be misaligned, and the band S may not be correctly determined (see FIG. 15(a)). Therefore, in Modification 3, the position of the band determination frame W1 is corrected using the position of the correction hole 51.
[0078] As shown in FIG. 15, the angle of view of the imaging unit 60 is set so that the correction hole 51 is always captured in the cup image D. The correction hole 51 forms a recess and is captured with a lower brightness than the surrounding inclined plate 50. Therefore, the determination unit 40a generates a binarized image D2 of the cup image D using a pixel value between the brightness of the correction hole 51 and the brightness of the inclined plate 50 as a threshold value. The determination unit 40a detects the position of the correction hole 51 based on this binarized image D2. The determination unit 40a then corrects the position of the band determination frame W1 to correspond to the position of the correction hole 51 (see FIG. 15(b)). As a result, the position of the band determination frame W1 is corrected as the band determination frame W1'. Note that if the brightness of the correction hole 51 is close to the brightness of the inclined plate 50, an appropriate binarized image D2 may be obtained by repeatedly binarizing an image in which the pixel values of the cup image D are increased to increase the brightness difference between the brightness of the correction hole 51 and the brightness of the inclined plate 50. Furthermore, the band determination frame W1 may be corrected in advance at a time other than the beverage type determination process for cup C, or may be corrected for each beverage type determination process.
[0079] Similarly to the band determination frame W1, the position of the character determination frame W2 is also corrected as a character determination frame W2' based on the position of the correction hole 51. Furthermore, the position of the color band determination frame W3 is also corrected in the same way.
[0080] In the above example, parallel position correction is performed in the YZ plane, but two or more correction holes 51 may be provided to correct the rotational position of a judgment frame such as the band judgment frame W1.
[0081] When the cup C is in a tilted or upright position due to the placement unit 29, the initial position correction of the band detection frame W1 and the like is performed in a tilted position where the cup C is not present, and thereafter, the initial position correction is maintained and no position correction is performed regardless of the tilted or upright position of the cup C. This is because the tilt angle α is about 5°, and the positional deviation of the band detection frame W1 and the like in the Z direction due to the tilted and upright positions is small, so it is sufficient to provide a margin in the width of the band detection frame W1 so that the band S fits within the width in the Y direction.
[0082] <Variation 4> 16 is an explanatory diagram illustrating the correction process of the color judgment reference data according to the modified example 4. In the color judgment according to the modified example 2, a predetermined color is determined based on the color judgment reference data. The color judgment reference data forms a plurality of predetermined judgment regions for each predetermined color in the color space, and the predetermined color is determined based on whether or not the detected color information is included in any of the predetermined judgment regions.
[0083] FIG. 16(a) shows an example of color judgment reference data. Predetermined judgment areas WA, WB, WC, and WD for four predetermined colors (brown, navy blue, dark red, and white) are defined in a color space (color area) formed by the color elements hue and saturation. In FIG. 16(a), the predetermined judgment areas WA, WB, WC, and WD are rectangular. If the detected color information is within any of the predetermined judgment areas WA, WB, WC, and WD, the judgment unit 40a judges the color information as the predetermined color of that area. Therefore, as shown in FIG. 16(a), the color information for positions P1 and P2 is not within any of the predetermined judgment areas WA, WB, WC, and WD, resulting in an error output indicating that the color was not detected. In this case, the display unit 21 displays guidance such as repositioning the cup C several times. If the color is still not detected, the beverage type must be manually specified via the input unit 21a of the display unit 21.
[0084] The judgment unit 40a sequentially stores the positive detection points of a predetermined color and performs a learning process to change the predetermined judgment area in accordance with changes in the set of positive detection points within the predetermined judgment area. When the distance between the lower frame LA of the brown predetermined judgment area WA in Figure 16(a) and the positive detection points within the predetermined judgment area WA becomes less than a predetermined distance, the judgment unit 40a lowers the lower frame LA to a lower frame LA' so that the distance is equal to or greater than the predetermined distance.
[0085] In the above, correction is performed when the distance between the lower frame LA of the predetermined judgment area WA and the positive detection points within the predetermined judgment area WA becomes less than a predetermined distance, but this is not limited to this, and the frame of the predetermined judgment area WA may be changed or corrected based on the distance between the center of gravity of the set of positive detection points and the frame of the predetermined judgment area WA.
[0086] Furthermore, if the lower frame LA of the predetermined judgment area WA and the upper frame LD of the predetermined judgment area WD are less than a certain distance apart, a portion of the upper frame LD of the predetermined judgment area WA may be corrected to a lowered upper frame LD' so as not to affect past positive detection points.
[0087] Furthermore, in the above description, the predetermined determination areas WA, WB, WC, and WD are rectangular areas, but they are not limited to this and may be areas of any shape. For example, they may be areas of any shape extending a predetermined distance from the past correct detection point.
[0088] In the above, the predetermined color is determined based on color information in a color space formed by the color elements hue and saturation, but the present invention is not limited to this, and the predetermined color may be determined based on color information in a color space that includes other color elements, such as lightness. Furthermore, the color elements may be any color elements that are compatible with various color spaces.
[0089] Note that the configurations illustrated in the above embodiments and modifications are merely functional schematics and are not necessarily physically configured as shown. In other words, the distribution and integration of each device and component is not limited to that illustrated, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various usage situations, etc. [Explanation of symbols]
[0090] 1 Beverage dispensing equipment 10 Main cabinet 11 Beverage production department 20 Front door 21 Display section 21a Input section 22 Opening and closing doors 23 Beverage supply section 24 Entrance 25 nozzles 26 Stages 26a Passing hole 27 Back wall 28 Side wall 29 Placement section 29a Mounting piece 29b Swing shaft member 29c bottom 29d,29e Rear wall 29f Connecting part 29g Damper material 30 Opening 31 Cup detector 32 Attitude detection unit 32a Light-emitting part 32b Light receiving section 32c Detected part 33 Door opening / closing detector 34 Door opening / closing lock mechanism 40 Control Unit 40a Judgment part 40b Beverage supply control unit 41 Storage section 50 Inclined plate 51 Compensation hole 60 Imaging unit 61,62 Light irradiation unit C cup C1 center axis CS color belt D cup images D1 Edge extracted image D2 binarized image G horizontal plane H Discharge direction LA,LA´ bottom frame LD,LD´ Upper frame M letter P1,P2 position S, S10 belt S1,S2,S11,S12 straight line W1, W1', W10 belt determination frame W2,W2´ Character detection frame W3 color band judgment frame WA, WB, WC, WD Predetermined judgment area α Tilt angle
Claims
1. A beverage supply device that supplies a beverage prepared in a beverage preparation unit to a cup placed in a beverage supply unit, an imaging unit for acquiring a cup image of the cup; a determination unit that generates an edge extraction image of the cup image acquired by the imaging unit and detects straight lines of a predetermined length or more and the number of said straight lines, thereby detecting the presence or absence of bands displayed in an annular shape on the outer periphery of the cup according to the type of beverage in the cup and the number of said bands, and determines the type of beverage in the cup based on the presence or absence of said bands and the number of said bands; a beverage supply control unit that generates a beverage corresponding to the beverage type determined by the determination unit and controls the beverage to be supplied to the cup; Equipped with the determination unit sets a band determination frame in an image area where the band is displayed, and detects straight lines having a length equal to or greater than the predetermined length and the number of straight lines within the band determination frame to detect the presence or absence of the band and the number of the bands, a correction mark or a correction hole is provided on the beverage supply device body in the area imaged by the imaging unit; the imaging unit acquires a cup image including the correction mark or the correction hole, The beverage dispenser is characterized in that the determination unit corrects the position of the band determination frame on the cup image based on the position of the correction mark or the correction hole on the image.
2. A beverage supply device that supplies a beverage prepared in a beverage preparation unit to a cup placed in a beverage supply unit, an imaging unit for acquiring a cup image of the cup; a determination unit that detects the presence or absence of bands displayed circularly on the outer periphery of the cup according to the type of beverage in the cup and the number of the bands from the cup image acquired by the imaging unit, and determines the type of beverage in the cup based on the presence or absence of the bands and the number of the bands; a beverage supply control unit that generates a beverage corresponding to the beverage type determined by the determination unit and controls the beverage to be supplied to the cup; Equipped with The cup has a predetermined color band annularly displayed on the outer circumferential surface according to the type of beverage in the cup, The determination unit determines the type of beverage in the cup based on the presence or absence of the bands, the number of the bands, and color information of the predetermined color of the color bands. The determination unit sets a color band determination frame in an image area where the color bands are displayed, and detects the predetermined color of the color bands based on the color information within the color band determination frame. a correction mark or a correction hole is provided on the beverage supply device body in the area to be imaged by the imaging unit; the imaging unit acquires a cup image including the correction mark or the correction hole, The beverage dispenser is characterized in that the judgment unit corrects the position of the color band judgment frame on the cup image based on the position of the correction mark or the correction hole on the image.
3. A beverage supply device that supplies a beverage prepared in a beverage preparation unit to a cup placed in a beverage supply unit, an imaging unit for acquiring a cup image of the cup; a determination unit that detects the presence or absence of bands displayed circularly on the outer periphery of the cup according to the type of beverage in the cup and the number of the bands from the cup image acquired by the imaging unit, and determines the type of beverage in the cup based on the presence or absence of the bands and the number of the bands; a beverage supply control unit that generates a beverage corresponding to the beverage type determined by the determination unit and controls the beverage to be supplied to the cup; a mounting portion that, when the cup is placed on it, changes due to the weight of the cup between an inclined position in which the central axis of the cup is inclined relative to the dispensing direction of the nozzle that dispenses the beverage and an upright position in which the central axis of the cup is parallel to the dispensing direction of the nozzle; a posture detection unit that detects whether the placement unit is in the tilted posture or the upright posture when the cup is placed on the placement unit; Equipped with The beverage supply device is characterized in that the determination unit makes a classification determination in which, if the detection result of the posture detection unit is the inclined posture, it classifies the cup as a cup for hot beverages only, and, if the detection result of the posture detection unit is the upright posture, it classifies the cup as a cup for cold beverages only, and determines the beverage type including this classification determination.
4. The beverage supply device described in claim 2 or claim 3, characterized in that the judgment unit generates an edge extraction image of the cup image, detects straight lines of a predetermined length or more and the number of such straight lines, and detects the presence or absence of the band and the number of the bands.
5. 5. The beverage dispenser according to claim 1, wherein the determining unit determines the different beverage types based on the presence or absence of the band and the number of the bands.
6. The beverage supply device according to claim 4, characterized in that the determination unit performs a labeling process on the edge extraction image, detects straight lines having a length equal to or greater than the predetermined length and the number of such straight lines, and detects the presence or absence of the band and the number of the bands.
7. The beverage supply device described in claim 4, characterized in that the judgment unit sets up a band judgment frame in the image area where the band is displayed, and detects straight lines of a predetermined length or more and the number of such straight lines within the band judgment frame to detect the presence or absence of the band and the number of the bands.
8. The cup has a predetermined color band annularly displayed on the outer circumferential surface according to the type of beverage in the cup, The beverage dispenser according to claim 3 , wherein the determination unit determines the type of beverage in the cup based on the presence or absence of the band, the number of the bands, and color information of the predetermined color of the color band.
9. The beverage supply device according to claim 8, characterized in that the judgment unit sets a color band judgment frame in the image area where the color band is displayed, and detects the predetermined color of the color band based on color information within the color band judgment frame.
10. the predetermined color is detected based on whether the color information is included in any one of a plurality of predetermined determination areas in a color space; The beverage supply device according to claim 2, characterized in that the judgment unit stores positive detection points of a predetermined color and performs a learning process to change the predetermined judgment area in accordance with changes in the set of positive detection points within the predetermined judgment area.
Citation Information
Patent Citations
Pattern recognition device with position and rotation deviation correcting function
JP1989273188A
Correcting device for position of body to be worked
JP1990152747A
Beverage feeder
JP2003128188A
Beverage dispenser
JP2009274767A
Beverage spouting device
JP2010189053A