Processing device, processing method, and processing program including beverage can image, and processing device including object image

Abstract

The invention provides a processing device, a processing method, and a processing program for obtaining an image including a beverage can with excellent analysis accuracy of the beverage can included in the image. Provided is a processing device for obtaining an image including an object having excellent analysis accuracy of the object included in the image. A processing device for an image including a beverage can according to one embodiment of the present disclosure is characterized by comprising: an image acquisition unit for acquiring an image including a beverage can; an angle calculation unit that calculates, by analyzing the image, an angle formed by a first straight line and a second straight line set on the basis of an outer contour feature of the beverage can; and an angle output unit that outputs the angle formed by the first straight line and the second straight line.

Description

Technical Field

[0001] The present disclosure relates to a processing device, a processing method, and a processing program for an image including a beverage can, and a processing device for an image including an object. Background Art

[0002] Patent document 1 describes a drunk driving prevention device having an individual identification information reading unit, a position estimation unit, and a drunk driving suppression control unit. The individual identification information reading unit is capable of reading individual identification information from a container of an alcoholic beverage in a vehicle. The position estimation unit estimates the position of the alcoholic beverage in the vehicle based on the output of the individual identification information reading unit. The drunk driving suppression control unit performs a prescribed control for suppressing drunk driving based on the position of the alcoholic beverage estimated by the position estimation unit. In addition, in Patent document 1, an RFID reader is illustrated as a specific example of a device for reading individual identification information of an alcoholic beverage. Furthermore, Patent document 1 describes that the device for reading individual identification information of an alcoholic beverage is not limited to a device using wireless communication, and for example, a barcode may be photographed and the individual identification information of the alcoholic beverage may be read by image recognition.

[0003] Patent document 2 describes a notification control system, which includes a user information receiving unit, a store information receiving unit, a matching unit, and a purchase information notification unit. The user information receiving unit accepts submissions of user information related to beverages from users. The store information receiving unit accepts store information related to the purchase of beverages in a physical store or a virtual store. The matching unit matches the user information and store information about the attributes of the beverage. The purchase information notification unit notifies the user of the purchase information based on the user information and store information matched by the matching unit. In addition, Patent document 1 describes that the matching unit performs image recognition of the image data of the user information to determine the attributes of the beverage. In this case, the image recognition of the image data of the user information to determine the attributes of the beverage can also be performed using a known image recognition technology (OCR technology or shape determination technology, etc.).

[0004] Prior art literature

[0005] Patent Literature

[0006] Patent Document 1: Japanese Patent Application Publication No. 2009-258855

[0007] Patent Document 2: Japanese Patent Application Publication No. 2017-091343 Summary of the invention

[0008] Problems to be solved by the invention

[0009] However, the prior art including Patent Documents 1 and 2 has room for improvement from the perspective of analysis accuracy of beverage cans included in images.

[0010] Therefore, one of the purposes of the present disclosure is to obtain a processing device, a processing method and a processing program for obtaining an image containing a beverage can with excellent resolution accuracy of the beverage can contained in the image. In addition, one of the purposes of the present disclosure is to obtain a processing device for obtaining an image containing an object with excellent resolution accuracy of the object contained in the image.

[0011] Technical solutions to solve problems

[0012] A processing device for an image containing a beverage can according to one embodiment of the present invention is characterized in that it comprises: an image acquisition unit, which acquires an image containing a beverage can; an angle calculation unit, which calculates an angle formed by a first and a second straight line set based on an outer contour feature portion of the beverage can by analyzing the image; and an angle output unit, which outputs the angle formed by the first straight line and the second straight line.

[0013] Effects of the Invention

[0014] According to one embodiment of the present invention, a processing device, a processing method and a processing program can obtain an image containing beverage cans with excellent resolution accuracy. In addition, a processing device can obtain an image containing objects with excellent resolution accuracy. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 This is a diagram showing an example of the configuration of a system including a processing device for an image including a beverage can.

[0016] Figure 2 This is a diagram showing an example of the structure of a user terminal.

[0017] Figure 3 FIG. 1 is a diagram showing an example of an image including a beverage can.

[0018] Figure 4 This is a diagram showing an example of the concept of a beverage can image analysis application service based on an image including a beverage can.

[0019] Figure 5 This is a diagram showing an example of the structure of an image processing device.

[0020] Figure 6 This is a diagram showing an example of first and second straight lines and their angles set based on the characteristic portion of the outer contour of a beverage can.

[0021] Figure 7 This is a diagram showing an example of the concept of a beverage can image analysis application service based on an image including a beverage can.

[0022] Figure 8 This is a diagram showing an example of the flow of a method for processing an image including a beverage can.

[0023] Fig. 9 This is a diagram showing an example of a functional configuration including a user terminal and a beverage can image processing device.

[0024] Fig.10 This is a diagram showing an example of the hardware configuration of a device including a user terminal and a beverage can image processing device. DETAILED DESCRIPTION

[0025] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings.

[0026] Figure 1 This is a diagram showing an example of the structure of a system 1 including a processing device 20 for processing images including beverage cans. The "processing device for processing images including beverage cans" may also be replaced by "processing system for processing images including beverage cans" (the two may also be made synonymous). "Beverage cans" are included in "objects". In addition, the processing method and processing program for images including beverage cans can be implemented by causing a computer (CPU: Central Processing Unit) included in the system 1 (user terminal 10, processing device 20 for processing images including beverage cans) to execute various processing steps.

[0027] like Figure 1 As shown, the system 1 includes a user terminal 10, a processing device for processing images of beverage cans (hereinafter referred to as an "image processing device") 20, and a network 30 connecting the user terminal 10 and the image processing device 20. Figure 1 In the figure, the user terminal 10 and the image processing device 20 are simplified as a single structure for the convenience of drawing. In fact, the user terminal 10 and the image processing device 20 have more than 100 hardware structures and software structures. Figure 1 For example, the image processing device 20 may include a plurality of servers, databases, and the like.

[0028] The system 1 may be considered as a structure including the user terminal 10 and the image processing device 20, or may be considered as a structure including only the image processing device 20 without including the user terminal 10. That is, in the system 1, the user terminal 10 is not an essential structural element (it is sufficient that the image of the beverage can described later is input into the image processing device 20).

[0029] The user terminal 10 is, for example, a portable terminal (mobile communication terminal) such as a mobile phone, a smart phone, or a tablet terminal. That is, the user terminal 10 in this specification is a communication device that can perform various communications with the image processing device 20. The user terminal 10 can be connected to the image processing device 20 via wired and / or wireless (for example, Long Term Evolution (LTE), 5G), or other communication methods. th The user terminal 10 communicates with a network (such as the Internet) using 5G NR, Wi-Fi (registered trademark), etc. The user terminal 10 executes a browser and other various applications (especially the beverage can image analysis application service described later) through user operations.

[0030] The image processing device 20 may be any communication device capable of performing various communications with the user terminal 10, and may be replaced by a device, a circuit, etc. Specifically, the image processing device 20 analyzes an image containing a beverage can obtained (photographed) by the user terminal 10, and performs various communications with the user terminal 10 to provide various application services (beverage can image analysis application services) based on the analysis results.

[0031] Figure 2 1 is a diagram showing an example of the structure of the user terminal 10. The user terminal 10 includes a photographing unit (image acquisition unit) 11, an image transmission unit 12, and a beverage can image analysis application unit 13. Figure 2 In addition to the components shown, the device also has components generally installed in a user terminal, such as a display, a speaker, a microphone, etc.

[0032] The photographing unit 11 is a camera system mounted on the user terminal 10, and photographs (acquires) an image including a beverage can. The image sending unit 12 sends the image including the beverage can photographed by the photographing unit 11 to the image processing device 20. The beverage can image analysis application unit 13 performs various processes for utilizing the beverage can image analysis application service based on the image including the beverage can sent from the image sending unit 12 to the image processing device 20.

[0033] For example, when the camera of the shooting unit 11 is started, it is also possible to determine whether the beverage can in the image received by the shooting element (CCD: Charge Coupled Device) is of a specified brand and take a photo. In order to achieve a more comfortable UX (User Experience) than taking an image alone, the determination process of the beverage can can also be segmented. In the determination process, for example, it is also possible to analyze whether the image received by the shooting element contains a logo of a specified brand of the beverage can or the upper surface of the beverage can, the outer shape and appearance design of the beverage can. At this time, the probability (reliability score) that the beverage can received by the shooting element is a specified brand can also be calculated, and shooting is performed when the probability is above a specified value (for example, above 50%). Here, the above-mentioned specified value for determining whether to perform photography has a degree of freedom, and various design changes can be made. Of course, the 1 / 0 mark can also be used to detect whether the beverage can received by the shooting element is a specified brand.

[0034] Figure 3 : is a diagram showing an example of an image including a beverage can. A beverage can is a container for holding any beverage, such as alcoholic beverages, mineral water, carbonated water, soft drinks, corn soup, etc. The beverage can has a circular upper surface when viewed from above, a circular lower surface when viewed from above, and a cylindrical side surface that is annular when viewed from above and connects the upper surface and the lower surface. On the upper surface of the beverage can, a drinking spout and a pull ring for opening the drinking spout are provided on one side and the other side sandwiching the center portion (in the Figure 3 In the beverage can, a drinking opening is provided on the left side of the center portion of the upper surface of the beverage can, and a pull ring is provided on the right side of the center portion). On the side of the beverage can, the manufacturer and product name (brand) of the beverage can are drawn as a display portion. Figure 3 In , XYZ is drawn as the manufacturer of the beverage can, and ABCDE is drawn as the brand name of the beverage can. Figure 3 In order to facilitate drawing, the display portion (manufacturer and product name) on the side of the beverage can is drawn in a normal font, but in fact the display portion (manufacturer and product name) on the side of the beverage can is distorted in the photograph due to the roundness of the side of the beverage can.

[0035] Figure 4 A to C in 4 are diagrams showing an example of the concept of a beverage can image analysis application service based on an image containing a beverage can. The beverage can image analysis application service aims to attract fans of the brand based on the experience of capturing a beverage can with a camera, while providing rewards (value-added experience). In order to accept the provision of the beverage can image analysis application service, the user needs to indicate the willingness to participate after confirming and agreeing to the terms of use and privacy policy through the user terminal 10. In addition, in the beverage can image analysis application service, the event name, application period, target product (type or size of beverage can, etc.), gifts, number of awards, required points, etc. are set.

[0036] exist Figure 4 In A, the beverage can that the user is drinking is photographed (scanned) by the photographing unit 11 of the user terminal 10, and the photographed image is sent to the image processing device 20. Here, Figure 4 The capture and transmission of the beverage can image of A may also be limited in time and frequency (eg, once a day).

[0037] exist Figure 4 In B, through Figure 4 If you take and send the image of A's beverage can a certain number of times, you will automatically be eligible for an original product (gift). Figure 4 In the example of B, Figure 4 The capture and sending of the beverage can image of A is converted into 1 point, and for every 5 points accumulated, the original product (gift) will be automatically applied for. Here, the automatic application of every 5 points can also be limited in time and number of times (for example, a maximum of 10 times during the promotion period).

[0038] exist Figure 4 In C, if the user wins the automatic application for every 5 points, the user wins (is provided) the original product. Figure 4 In C, a case of a portable terminal (original smartphone case) on which the manufacturer (XYZ) and product name (ABCDE) of a beverage can are drawn is exemplified as an original product.

[0039] The beverage can image analysis application service is intended to realize a service that promotes the sale of beverage cans, and therefore, in its nature, it is assumed that the beverage cans involved in the beverage can images sent to the image processing device 20 are not the same (as a premise). That is, each of the prescribed points (e.g., 5 points) required for the automatic application of original products (1 point) should not be obtained by photographing multiple identical beverage cans or from the Internet, but rather it is assumed that the number of beverage cans whose contents the user has drunk is taken each time the user drinks (as a premise). Further, it is assumed that the beverage can whose contents the user has drunk is purchased by, for example, the user himself, his family or roommate, or a friend or colleague who drinks the contents of the beverage can with the user (as a premise).

[0040] From the perspective of taking the above assumptions and premises as the cornerstone, the processing device, processing method and processing program of the image containing beverage cans disclosed in the present invention have excellent analysis accuracy for the beverage cans contained in the image, and have structural elements that can further link whether the beverage cans contained in the image are the same with the "proof of purchase" of the beverage can. For example, if smooth and reliable proof of purchase can be performed, it is easier to establish a loyalty program for the merchandise materials purchased in the store, and digital promotions can be sublimated into marketing CRP (Customer Relationship Process) for increasing brand fans.

[0041] Here, the following are the main reasons for the difficulty in providing smooth and reliable proof of purchase.

[0042] (1) Considering the handling of complaints and unfair behavior, the purchase certificate cannot be wrong.

[0043] (2) Postcards are difficult to circulate and promote, and they are easily thrown away and difficult to preserve.

[0044] (3) Serial numbers are processed on the factory production line, and a huge number of them are generated due to the issuance of barcodes and the printing of labels.

[0045] (4) Receipts are complex and time-consuming, and the cost of determining their correctness is high, and there are loopholes for unfairness. In the past, there have been cases of organized receipt purchase fraud (falsification of dates, folding for different settlements, background color processing, overlapping multiple receipts) during promotional activities.

[0046] (5) Electronic settlements such as "○○Pay" that are less prone to errors have become a problem due to settlement constraints, retail restrictions, and lack of flexibility due to platform dominance.

[0047] In this way, under the guidance of the manufacturer of the beverage can (in-house manufacturing), the analysis accuracy of the beverage can contained in the waiting image is excellent, and whether the beverage can contained in the image is the same can be further linked to the purchase proof of the beverage can. Furthermore, based on such a focus, the inventors have realized a processing device, a processing method and a processing program for an image of a beverage can having such a structure. The structure is based on the possibility of a so-called "pseudo-purchase proof", that is, converting the purchase proof of a promotional activity from a sexually evil theory to a sexually good theory, and unless obvious impropriety or fraud can be detected, it can also include the flexibility of not disliking to give too many points and dare to make a purchase judgment without strictness.

[0048] Figure 5 2 is a diagram showing an example of the structure of the image processing device 20. The image processing device 20 includes an image input unit (image acquisition unit) 21, a first determination unit 22, a second determination unit 23, a third determination unit 24, an angle calculation unit 25, an angle output unit 26, a comparison unit 27, a notification unit 28, and a benefit granting unit 29.

[0049] The image input unit (image acquisition unit) 21 inputs (acquires) an image including a beverage can captured by the image capture unit 11 of the user terminal 10 and transmitted from the image transmission unit 12. The image input unit (image acquisition unit) 21 inputs (acquires) a plurality of images from the same user terminal 10.

[0050] The first determination unit 22 determines whether the beverage can contained in the image is of a specified brand by analyzing the image input to the image input unit 21. This determination may be the same as the process of determining whether the beverage can is photographed by the photographing unit 11 of the user terminal 10. The first determination unit 22 may also calculate the probability (reliability score) that the beverage can contained in the image input to the image input unit 21 is of a specified brand.

[0051] The second determination unit 23 determines whether the beverage can contained in the image is of a specified capacity by analyzing the image input to the image input unit 21. The second determination unit 23 may also determine whether the beverage can contained in the image input to the image input unit 21 is a 500ml can, a 350ml can, or other capacity. The second determination unit 23 may also calculate the probability (reliability score) that the beverage can contained in the image input to the image input unit 21 is a 500ml can, a 350ml can, or other capacity.

[0052] The third determination unit 24 determines whether the image input to the image input unit 21 is an existing image lacking originality by analyzing the image. The third determination unit 24 detects whether the image input to the image input unit 21 is an image obtained from the Internet (i.e., it is highly likely that it is not an image that the user has taken by himself through the user terminal 10). The third determination unit 24 uses template matching to compare with the Internet image sent to the back end to measure the similarity between the two. The third determination unit 24 can also calculate the probability (reliability score) that the image input to the image input unit 21 is an existing image lacking originality.

[0053] The angle calculation unit 25 calculates the angle formed by the first straight line and the second straight line set based on the outer contour feature of the beverage can by analyzing the image input to the image input unit 21. There is freedom in how to focus on the outer contour feature of the beverage can and where to focus, and various design changes can be made, but in this disclosure, the drinking mouth on the upper surface of the beverage can, the center of the upper surface of the beverage can, and the display part on the side of the beverage can are used.

[0054] Figure 6 FIG. 1 is a diagram showing an example of first and second straight lines and their angles set based on the outer contour feature of a beverage can. Figure 6In the figure, a point on the display part of the side of the beverage can is drawn as point (1), which is the center of C in the middle of the product name ABCDE. In addition, a point where a straight line including point (1) and extending in the height direction of the beverage can intersects with the upper surface of the beverage can is drawn as (2). In addition, the center of the upper surface of the beverage can is drawn as point (3). And, the front end of the drinking spout on the upper surface of the beverage can is drawn as point (4). And, the angle θ formed by a first straight line connecting the front end of the drinking spout on the upper surface of the beverage can and the center of the upper surface of the beverage can (a straight line connecting point (3) and point (4)) and a second straight line connecting a point on the display part of the side of the beverage can and extending in the height direction of the beverage can, the point where the straight line intersects with the upper surface of the beverage can and the center of the upper surface of the beverage can (a straight line connecting point (2) and point (3)) is calculated. In the case where the upper surface of the beverage can is an ellipse, the calculated angle can also be appropriately corrected.

[0055] The angle calculation unit 25 performs angle calculation through three processes: segmentation, key point extraction, and angle calculation based on geometric processing.

[0056] Segmentation is a model that estimates what is captured for each pixel in an image. You can use the model architecture used in normal object detection to create your own teacher data for additional learning. In segmentation, you determine where the area on the top surface of the beverage can in the object image is in units of pixels.

[0057] Key point extraction is a model that detects the coordinates of points that are the features of an object in an image. It is possible to set new key points for beverage cans in an image and learn based on the model. In key point extraction, the coordinates of points (1) to (4) that define (determine) the first and second straight lines in the object image are detected.

[0058] In the angle calculation based on the geometric processing, the angle θ (see θ) formed by the first straight line (the straight line connecting point (3) and point (4)) and the second straight line (the straight line connecting point (2) and point (3)) is calculated based on the data detected by segmentation and key point extraction. Figure 6 ).

[0059] When multiple images from the same user terminal 10 are input to the image input unit 21, the angle calculation unit 25 calculates the angle θ formed by the first straight line (the straight line connecting point (3) and point (4)) and the second straight line (the straight line connecting point (2) and point (3)) for the multiple images.

[0060] As described above, there is freedom in how and where to focus on and set the contour feature of the beverage can. For example, the contour feature can also be set to include at least one of the drinking mouth on the upper surface of the beverage can, the central part of the upper surface of the beverage can, and the display part (manufacturer and product name) on the side of the beverage can. Alternatively or additionally, the base end of the drinking mouth on the upper surface of the beverage can, the pull ring on the upper surface of the beverage can, or the depression of its peripheral part can be used as the contour feature, and when a new and characteristic beverage can is launched in the future, a part of the beverage can can also be used as the contour feature.

[0061] The angle output unit 26 outputs the angle θ formed by the first straight line (the straight line connecting point (3) and point (4)) and the second straight line (the straight line connecting point (2) and point (3)) of the beverage can calculated by the angle calculation unit 25. When the angle output unit 26 inputs a plurality of images from the same user terminal 10 to the image input unit 21 and the angle calculation unit 25 calculates the angle θ formed by the first and second straight lines of the plurality of images, the angle output unit 26 outputs the angle θ formed by the first and second straight lines of the plurality of images.

[0062] The comparison unit 27 compares whether the angle θ formed by the first and second straight lines of the plurality of images from the same user terminal 10 is within a predetermined range.

[0063] When manufacturing beverage cans, the positional relationship between the drinking opening on the upper surface of the beverage can and the display portion (manufacturer or trade name) on the side of the beverage can is not uniformly made the same, and the positional relationship between the two cans can be considered as the degree of originality of each beverage can. That is, strictly speaking, the angle θ formed by the first straight line and the second straight line of each beverage can is almost different, and the possibility of containing the same beverage can in multiple images can be determined based on the angle θ. For example, for beverage cans contained in multiple images, if the angle θ formed by the first and second straight lines is greatly different, the possibility of different beverage cans contained in multiple images becomes higher, and if the angle θ formed by the first and second straight lines is the same or almost the same, the possibility of the same beverage cans contained in multiple images becomes higher.

[0064] For example, the comparison unit 27 sets the angle θ formed by the first and second straight lines in any one of the reference images of the plurality of images as the reference angle θ. standard , and in other reference images of the plurality of images, the angle θ formed by the first and second straight lines is set as the reference angle θ reference Then, compare the reference angle θ standard and reference angle θ reference Is it within the specified range? For example, it can be reference ≤ Reference angle θ standard ≤1.05×reference angleθ referenceWhen the conditional expression is satisfied, the beverage cans contained in the base image and the reference image are determined to be the same, and when the conditional expression is not satisfied, the beverage cans contained in the base image and the reference image are determined to be different. The comparison unit 27 may also calculate a probability (reliability score) indicating whether the beverage cans contained in the plurality of images (base image and reference image) are the same.

[0065] For multiple images from the same user terminal 10, when the angle θ formed by the first and second straight lines is within a specified range, that is, when the beverage cans contained in the multiple images are likely to be the same, the notification unit 28 notifies the user terminal 10 of the content. The method of notifying the user terminal 10 may be, for example, a display on a display and / or a sound from a speaker. At this time, the notification unit 28 may also notify that the multiple images are not objects of the preferential granting of the preferential granting unit 29 described later.

[0066] When the angle θ formed by the first straight line and the second straight line of multiple images from the same user terminal 10 is not within the specified range, the discount granting unit 29 determines that the beverage cans contained in the multiple images are different, and grants a discount corresponding to the number of multiple images to the user terminal 10. For example, one image of a beverage can taken can be converted into one point, and when 5 points corresponding to 5 images are reached, an automatic application is made, and in the case of winning the lottery, an original product can be drawn (refer to Figure 4 B. Figure 4 C).

[0067] Figure 7 1 is a diagram showing an example of the concept of a beverage can image analysis application service based on an image containing a beverage can. Figure 7 As shown, an image containing a beverage can is sent from an application of the user terminal 10 to the AI ​​(Artificial Intelligence) of the image processing device 20. The AI ​​of the image processing device 20 adds the information of the beverage can to the uploaded image. More specifically, information such as the angle of the beverage can's mouth (e.g., the angle θ formed by the first and second straight lines), the similarity with images on the Internet, the angle of the beverage can's mouth recently uploaded by the same user (e.g., the angle θ formed by the first and second straight lines), and product information (e.g., whether the beverage can is 350ml or 500ml) can be obtained. The result of the judgment by the AI ​​of the image processing device 20 is transmitted to the activity system in the form of a numerical value, and the adjustment of points and discounts can be performed on the activity system side.

[0068] Figure 8 This is a diagram showing an example of the flow of a method for processing an image including a beverage can.

[0069] In step ST1, a camera as the photographing unit 11 of the user terminal 10 is started. In step ST2, an image including a beverage can is photographed (acquired) by the photographing unit 11 of the user terminal 10. When the logo or a specific part of the beverage can is recognized in the camera startup state (if the probability of being the target beverage can exceeds a predetermined value), the image including the beverage can is photographed by automatically pressing the shutter.

[0070] In step ST3, the second determination unit 23 of the image processing device 20 determines that the beverage can has a specified capacity. This determination can be made, for example, by distinguishing between 500 ml and 350 ml based on the overall shape of the beverage can, or by using the product ID (JAN code) attached to the beverage can. In step ST4, the third determination unit 24 of the image processing device 20 confirms that the image containing the beverage can is not an existing image lacking originality (an image obtained from the Internet).

[0071] In step ST5, the angle calculation unit 25 of the image processing device 20 calculates the angle formed by the first and second straight lines of the beverage can contained in the captured image. In step ST6, the comparison unit 27 of the image processing device 20 compares the angle formed by the first and second straight lines of the beverage can contained in the image recently logged in by the user with the same ID (the same user) with the angle formed by the first and second straight lines calculated in step ST5 to determine their consistency. In step ST7, a final determination is made as to whether the beverage cans contained in the multiple images whose angles have been compared and determined in step ST6 are the same beverage cans or different beverage cans.

[0072] As described above, in the processing device 20 for the image of the beverage can of the present disclosure, the image input unit 21 obtains the image containing the beverage can, the angle calculation unit 25 calculates the angle formed by the first and second straight lines set based on the outer contour feature of the beverage can by analyzing the image containing the beverage can, and the angle output unit 26 outputs the angle formed by the first straight line and the second straight line. As a result, the analysis accuracy of the beverage can contained in the image is excellent, and it is not only possible to determine whether the beverage can contained in the image is the same, but also to further connect with the purchase certificate of the beverage can.

[0073] In addition, in a processing device for an image of a beverage can including the present disclosure, the flexibility of correct or incorrect judgment is ensured by saving whether the beverage can contained in the image is a specific beverage can or whether it is the same beverage can as a probability. In addition, by determining the metadata around the detailed feedback, flexible changes can be made on the design side of the promotional activity. In addition, since the analysis process is performed on the application server side (image processing device 20) and the beverage can is identified on the application side (user terminal 10), UX (User Experience) such as real-time feeling can be achieved. In addition, for example, since it can be implemented with javascript running in HTML language, it is easy to install.

[0074] In the above-mentioned embodiment, the processing device for processing an image including a beverage can is described in which the object is a beverage can, but the present invention can be applied to a processing device for processing an image including any object other than a beverage can. That is, the processing device for processing an image including an object may also include: an image acquisition unit that acquires an image including the object; an angle calculation unit that calculates the angle formed by the first and second straight lines set based on the outer contour feature portion of the object by analyzing the image; and an angle output unit that outputs the angle formed by the first straight line and the second straight line.

[0075] For example, the object may be a plastic bottle, and the image of the plastic bottle may be processed (determination of whether it is the same plastic bottle or even a false proof of purchase) based on the angle formed by the first and second straight lines focusing on the positional relationship between the degree of closure of the plastic bottle cap and the mark on the side label. In addition, all commodities with random numbers printed during manufacturing may be used as objects. Furthermore, even for commodities that do not have characteristic differences during the manufacturing process, snacks such as chewing gum or packaged commodities such as frozen foods may be used as objects, and the image of the object may be processed (determination of whether it is the same object or even a false proof of purchase) based on the angle formed by the first and second straight lines focusing on the degree of curvature of the opening. In addition, cup noodles may be used as objects, and the details of each single product may be distinguished based on the angle formed by the first and second straight lines focusing on the degree of opening and closing of the cup noodle lid.

[0076] Fig. 9 FIG. 1 is a diagram showing an example of a functional configuration of a user terminal 10 and an image processing device 20 according to an embodiment. Fig. 9 As shown, the user terminal 10 and the image processing device 20 include a control unit 110, a storage unit 120, a communication unit 130, an input unit 140, and an output unit 150. Fig. 9 An example of a functional block of the user terminal 10 and the image processing device 20 may include Fig. 9 Other functional blocks not shown in the figure. In addition, it is also possible to configure so as not to include some functional blocks.

[0077] The control unit 110 controls the user terminal 10 and the image processing device 20. The control unit 110 may be composed of a controller, a control circuit, or a control device that will be described based on the common knowledge in the technical field of the present invention.

[0078] The storage unit 120 stores information used in the user terminal 10 and the image processing device 20. The storage unit 120 may be composed of, for example, a memory, a storage device, or the like described based on common knowledge in the technical field of the present invention.

[0079] The communication unit 130 performs communication between the user terminal 10 and the image processing device 20 (e.g., mutual communication between the two). The communication unit 130 may be composed of a transmitter / receiver, a transceiver circuit, or a transceiver device described based on the common understanding in the technical field of the present invention. In addition, the communication unit 130 may also be composed of a transmitter and a receiver.

[0080] The input unit 140 receives input from the user terminal 10 and the image processing device 20. In addition, the input unit 140 may be connected to a predetermined device, storage medium, etc., and receive input of data. The input unit 140 may, for example, output the input result to the control unit 110. The input unit 140 may be composed of input devices such as a keyboard, a mouse, and a button, input / output terminals, and input / output circuits, etc., which are described based on the common understanding in the technical field of the present invention. In addition, the input unit 140 may also be a structure that is integrated with the display unit (for example, a touch panel).

[0081] The output unit 150 performs output in the user terminal 10 and the image processing device 20. For example, the output unit 150 may also include a display unit for displaying images, a sound output unit for outputting sounds, and the like. The display unit may be composed of a display device such as a display or a monitor described based on the common understanding in the technical field of the present invention. In addition, the sound output unit may be composed of an output device such as a speaker described based on the common understanding in the technical field of the present invention.

[0082] In addition, the block diagram used in the description of the above-mentioned embodiment represents a block of a functional unit. These functional blocks (constituents) are implemented by any combination of hardware and / or software. In addition, the implementation means of each functional block is not particularly limited. That is, each functional block can be implemented by a physically combined device, or by connecting two or more physically separated devices by wire or wireless, and implemented by these multiple devices.

[0083] For example, the user terminal 10 and the image processing device 20 according to one embodiment of the present disclosure may be used as a computer that performs processing of the method and processing program for an image of a beverage can including the present disclosure. Fig.101 is a diagram showing an example of a hardware configuration of a user terminal 10 and an image processing device 20 according to an embodiment. The user terminal 10 and the image processing device 20 may be physically configured as a computer device including a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an input device 1005, an output device 1006, a bus 1007, and the like.

[0084] In addition, in the present disclosure, devices, circuits, equipment, units, servers, etc. may be interchangeable. The hardware structure of the user terminal 10 and the image processing device 20 may include one or more of the devices shown in the figures, or may exclude some of the devices.

[0085] For example, although only one processor 1001 is shown, there may be multiple processors. In addition, the processing may be performed by one processor, or the processing may be performed by two or more processors simultaneously, sequentially, or using other methods. In addition, the processor 1001 may also be implemented by one or more chips.

[0086] Each function in the user terminal 10 and the image processing device 20 is realized by controlling the reading of specified software (program) on hardware such as the processor 1001 and the memory 1002, and the processor 1001 performs calculations based on communication with the communication device 1004, reading and / or writing of data in the memory 1002 and the storage 1003, etc.

[0087] The processor 1001 controls the entire computer by, for example, running an operating system. The processor 1001 may be composed of a central processing unit (CPU) including an interface with peripheral devices, a control device, a computing device, registers, etc. In addition, the above-mentioned control unit 110 and other units may also be implemented by the processor 1001.

[0088] In addition, the processor 1001 reads a program (program code), a software module, data, etc. from at least one of the storage 1003 and the communication device 1004 to the memory 1002, and performs various processes based on them. As a program, a program that causes a computer to perform at least a part of the actions described in the above embodiments is used. For example, the control unit 110 can be implemented by a control program stored in the memory 1002 and running in the processor 1001, and other functional blocks can be implemented in a similar manner.

[0089] The memory 1002 is a computer-readable storage medium and may be composed of at least one of, for example, a ROM (Read Only Memory), an EPROM (Erasable Programmable ROM), an EEPROM (Electrically EPROM), a RAM (Random Access Memory), and other suitable storage media. The memory 1002 may be referred to as a register, a cache, a main memory (main storage device), etc. The memory 1002 can store a program (program code), a software module, etc. that can be executed to implement a method of an embodiment.

[0090] The memory 1003 is a computer-readable storage medium and may be composed of, for example, at least one of a floppy disk, a floppy (registered trademark) disk, a magneto-optical disk (e.g., a compact disc (CD-ROM (Compact Disc ROM)), a digital versatile disc, a Blu-ray (registered trademark) disc), a removable disk, a hard disk drive, a smart card, a flash memory device (e.g., a card, a stick, a key drive), a magnetic stripe, a database, a server, and other suitable storage media. The memory 1003 may be referred to as an auxiliary storage device. In addition, the above-mentioned storage unit 120 may also be implemented by the memory 1002 and / or the memory 1003.

[0091] The communication device 1004 is hardware (transceiver) for communicating between computers via at least one of a wired network and a wireless network, and is also called a network device, a network controller, a network card, a communication module, etc. The communication device 1004 may include a SIM card. In addition, the communication unit 130 may also be implemented by the communication device 1004.

[0092] The input device 1005 is an input device (e.g., a keyboard, a mouse, etc.) for receiving input from the outside. The output device 1006 is an output device (e.g., a display, a speaker, etc.) for implementing output to the outside. In addition, the input device 1005 and the output device 1006 may also be an integrated structure (e.g., a touch panel). In addition, the above-mentioned input unit 140 and the output unit 150 may also be implemented by the input device 1005 and the output device 1006, respectively.

[0093] In addition, the processor 1001, the memory 1002 and other devices are connected via a bus 1007 for communicating information. The bus 1007 may be composed of a single bus or different buses between devices.

[0094] In addition, the user terminal 10 and the image processing device 20 may include hardware such as a microprocessor, a digital signal processor (DSP), an ASIC, a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array), and may also implement a part or all of each functional block by the hardware. For example, the processor 1001 may be implemented by at least one of these hardware.

[0095] (Variation Example)

[0096] Furthermore, terms explained in the present disclosure and / or terms required for understanding the present disclosure may be replaced with terms having the same or similar meanings.

[0097] Information, parameters, etc. described in this disclosure may be expressed using absolute values, relative values ​​from a specified value, or other corresponding information. In addition, the names used for parameters, etc. in this disclosure are not limited in any way.

[0098] Any of a variety of different technologies may be used to represent the information, signals, etc. described in the present disclosure. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. mentioned throughout the above description may be represented by voltage, current, electromagnetic waves, magnetic fields or magnetic particles, light fields or photons, or any combination thereof.

[0099] Information, signals, etc. can also be input and output via multiple network nodes. The input and output information, signals, etc. can be stored in a specific place (such as memory) or managed using a table. The input / output information, signals, etc. can be overwritten, updated, or appended. The output information, signals, etc. can also be deleted. The input information, signals, etc. can also be sent to other devices.

[0100] Furthermore, notification of the prescribed information (for example, notification of "it is X") is not limited to explicit notification, but may be performed implicitly (for example, by not notifying the prescribed information or by notifying other information).

[0101] Software shall be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subroutines, software modules, applications, software applications, software packages, routines, subprograms, objects, executables, threads of execution, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.

[0102] In addition, software, instructions, information, etc. may also be sent and received via at least one of a transmission medium and a signal waveform. For example, if the software is sent from a website, server, or other remote source using at least one of wired technology (coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), etc.) and wireless technology (infrared, microwave, etc.), at least one of these wired technology and wireless technology is included in the definition of transmission medium.

[0103] The terms "system" and "network" used in the present invention may be used interchangeably.

[0104] The various methods and implementations described in this disclosure may be used alone, in combination, or switched as they are executed. In addition, the processing order, sequence, flow chart, etc. of the various methods and implementations described in this disclosure may be changed in order as long as there is no contradiction. For example, for the methods described in this disclosure, the elements of various steps are presented in an exemplary order and are not limited to the specific order presented.

[0105] The description of “based on” used in the present disclosure does not mean “only based on” unless otherwise specified. In other words, “based on” means both “only based on” and “at least based on”.

[0106] Any reference to an element using the designations "first," "second," etc., used in this disclosure does not limit the amount or order of these elements as a whole. These designations may be used in this disclosure as a convenient method of distinguishing between two or more elements. Therefore, reference to a first and a second element does not mean that only two elements may be used, or that the first element must precede the second element in some form.

[0107] In this disclosure, where “include,” “including,” and variations thereof are used, these terms are intended to be inclusive similar to the term “comprising.” Additionally, the term “or” as used herein is not intended to be a logical exclusive or.

[0108] In the present disclosure, for example, like a, an, and the in English, when articles are added by translation, the present disclosure may include the case where the noun after these articles is in plural form.

[0109] The invention involved in the present disclosure is described in detail above, but it is obvious to those skilled in the art that the invention involved in the present disclosure is not limited to the embodiments described in the present disclosure. The invention disclosed in the present disclosure can be implemented as a modified and altered mode without departing from the subject matter and scope of the invention determined according to the records of the claims. Therefore, the description of the present disclosure is intended for the purpose of illustration and does not provide any restrictive meaning for the invention according to the present disclosure.

[0110] This application is based on Japanese Patent Application No. 2022-035954 filed on March 9, 2022, the entire contents of which are expressly incorporated herein by reference.

Claims

1. A device for processing an image containing a beverage can, characterized in that have: an image acquisition unit that acquires an image including a beverage can; an angle calculation unit that calculates an angle formed by a first straight line and a second straight line that are set based on an outer contour feature of the beverage can by analyzing the image; and An angle output unit outputs the angle formed by the first straight line and the second straight line.

2. The apparatus for processing an image containing a beverage can according to claim 1, characterized in that The contour feature portion includes at least one of a drinking mouth on the upper surface of the beverage can, a central portion of the upper surface of the beverage can, and a display portion on the side of the beverage can.

3. The apparatus for processing an image containing a beverage can according to claim 2, characterized in that The first straight line is a straight line connecting the front end of the drinking opening on the upper surface of the beverage can and the center of the upper surface of the beverage can. The second straight line is a straight line connecting a point where a straight line including a point on the display part of the side surface of the beverage can and extending in the height direction of the beverage can intersects with the upper surface of the beverage can and the center of the upper surface of the beverage can.

4. The processing device for an image containing a beverage can according to any one of claims 1 to 3, characterized in that The device further includes a determination unit that determines whether the beverage can is of a specified brand, whether the beverage can has a specified capacity, and whether the image is an existing image lacking originality by analyzing the image.

5. The processing device for an image containing a beverage can according to any one of claims 1 to 3, characterized in that The image acquisition unit acquires a plurality of images from the same user terminal. The angle calculation unit calculates the angle formed by the first straight line and the second straight line for the plurality of images. The angle output unit outputs the angle formed by the first straight line and the second straight line for the plurality of images, The device further includes a comparison unit that compares the plurality of images to determine whether the angle formed by the first straight line and the second straight line is within a predetermined range.

6. The apparatus for processing an image containing a beverage can according to claim 5, characterized in that The device further includes a notification unit configured to notify the user terminal of the angle when the angle formed by the first straight line and the second straight line is within a predetermined range with respect to the plurality of images.

7. The apparatus for processing an image containing a beverage can according to claim 5, characterized in that The invention further includes a benefit granting unit that grants a benefit corresponding to the number of the plurality of images to the user terminal when the angle formed by the first straight line and the second straight line is not within a predetermined range with respect to the plurality of images.

8. A method for processing an image containing a beverage can, characterized in that: have: The step of obtaining an image containing a beverage can; A step of calculating an angle formed by a first straight line and a second straight line set based on an outer contour feature of the beverage can by analyzing the image; as well as The step of outputting the angle formed by the first straight line and the second straight line.

9. A program for processing an image containing a beverage can, characterized in that Causes the computer to execute: The step of obtaining an image containing a beverage can; A step of calculating an angle formed by a first straight line and a second straight line set based on an outer contour feature of the beverage can by analyzing the image; as well as The step of outputting the angle formed by the first straight line and the second straight line.

10. A device for processing an image containing an object, characterized in that: have: an image acquisition unit that acquires an image including an object; an angle calculation unit that calculates an angle formed by a first straight line and a second straight line set based on an outer contour feature portion of the object by analyzing the image; and An angle output unit outputs the angle formed by the first straight line and the second straight line.

Images