Processing device, processing method, and processing program of image including container

Abstract

To provide a processing device, a processing method, and a processing program of an image including a suitable (improved) container.SOLUTION: A processing device of an image including a container comprises an upper surface open part, a lower surface bottom part, a side surface connection part connecting the upper surface open part and the lower surface bottom part, an upper surface sealing part sealing the upper surface open part, an upper surface side display part provided in the upper surface sealing part, and a side surface side display part provided in the side surface connection part. The processing device of the image including the container comprises: an image acquisition unit which acquires the image including the container, captured by a capturing unit of a user terminal and transmitted by an image transmission unit of the user terminal; a first straight line acquisition unit which acquires a first straight line based on the upper surface side display part, from the image; a second straight line acquisition unit which acquires a second straight line based on the side surface side display part, from the image; and an angle acquisition unit which acquires an angle defined by the first straight line and the second straight line.SELECTED DRAWING: Figure 6

Description

[Technical field]

[0001] The present disclosure relates to a processing device, a processing method, and a processing program for an image including a container. [Background technology]

[0002] Patent Document 1 describes a drunk driving prevention device that includes an individual identification information reading means, a position estimation means, and a drunk driving suppression control means. The individual identification information reading means is capable of reading individual identification information from an alcoholic beverage container present in the vehicle cabin. The position estimation means estimates the position of the alcoholic beverage in the vehicle cabin based on the output of the individual identification information reading means. The drunk driving suppression control means performs a predetermined control to suppress drunk driving based on the position of the alcoholic beverage estimated by the position estimation means. Patent Document 1 also describes an RFID reader as a specific example of a device that reads the individual identification information of an alcoholic beverage. Patent Document 1 further describes that the device that reads the individual identification information of an alcoholic beverage is not limited to one that uses wireless communication, and may, for example, be one that captures an image of a barcode or the like and reads the individual identification information of the alcoholic beverage by image recognition.

[0003] Patent Document 2 describes a notification control system including a user information receiving means, a store information receiving means, a matching means, and a purchase information notifying means. The user information receiving means receives user information posted by a user about beverages. The store information receiving means receives store information about beverage purchases at a real store or a virtual store. The matching means matches the user information with store information about the beverage attributes. The purchase information notifying means notifies the user of the purchase information based on the user information and store information matched by the matching means. Patent Document 1 also describes that the matching means performs image recognition on the image data of the user information to identify the beverage attributes, and that at that time, the matching means may perform image recognition on the image data of the user information using a publicly known image recognition technology (OCR technology, shape determination technology, etc.) to identify the beverage attributes. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2009-258855 A [Patent Document 2] JP 2017-091343 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, the prior art including Patent Documents 1 and 2 leaves room for improvement in terms of processing images including suitable (improved) containers.

[0006] Therefore, an object of the present disclosure is to provide a processing device, a processing method, and a processing program for an image including a suitable (improved) container. [Means for solving the problem]

[0007] An image processing device including a container according to one embodiment of the present disclosure is an image processing device including a container having a top opening portion, a bottom portion, a side connection portion connecting the top opening portion and the bottom portion, a top sealing portion sealing the top opening portion, a top display portion provided on the top sealing portion, and a side display portion provided on the side connection portion, and is characterized in having an image acquisition unit that acquires an image including the container captured by an imaging unit of a user terminal and transmitted by an image transmission unit of the user terminal, a first line acquisition unit that acquires a first straight line from the image based on the top display portion, a second line acquisition unit that acquires a second straight line from the image based on the side display portion, and an angle acquisition unit that acquires the angle between the first line and the second line. Effect of the Invention

[0008] According to one aspect of the present disclosure, a processing device, a processing method, and a processing program for an image including a suitable (improved) container can be obtained. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of a system including a processing device for an image including a container. [Diagram 2] FIG. 2 is a diagram illustrating an example of the configuration of a user terminal. [Diagram 3] FIG. 13 is a diagram showing an example of an image including a container. [Figure 4] FIG. 13 illustrates an example of the concept of a container image analysis application service based on an image including a container. [Diagram 5] FIG. 1 illustrates an example of a configuration of an image processing device. [Figure 6] FIG. 4 illustrates an example of the configuration of an angle calculation unit. [Figure 7] 11 is a diagram showing an example of a first line acquisition process performed by a first line acquisition unit; FIG. [Figure 8] 11 is a diagram showing an example of a process of acquiring a second line by a second line acquiring unit; FIG. [Figure 9] 4 is a diagram showing an angle formed between a first line and a second line acquired by an angle acquisition unit. FIG. [Figure 10] FIG. 13 is a diagram illustrating an example of the concept of a container image analysis application service based on an image including a container. [Figure 11] FIG. 11 is a diagram showing a first example of the flow of a method for processing an image including a container. [Figure 12] FIG. 11 is a diagram showing a second example of the flow of a method for processing an image including a container. [Figure 13] FIG. 2 is a diagram illustrating an example of a functional configuration of a user terminal and a processing device for an image including a container. [Figure 14] FIG. 2 is a diagram illustrating an example of a hardware configuration of a user terminal and a processing device for an image including a container. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings.

[0011] 1 is a diagram showing an example of the configuration of a system 1 including a processing device 20 for an image including a container. The "processing device for an image including a container" may be read as a "processing system for an image including a container" (the two may be synonymous). Furthermore, the processing method and processing program for an image including a container are realized by causing a computer (CPU: Central Processing Unit) included in the system 1 (user terminal 10, processing device 20 for an image including a container) to execute various processing steps.

[0012] As shown in FIG. 1, the system 1 includes a user terminal 10, a processing device for an image including a container (hereinafter referred to as an "image processing device") 20, and a network 30 connecting the user terminal 10 and the image processing device 20. In FIG. 1, the user terminal 10 and the image processing device 20 are depicted in a simplified manner as a single configuration, but this is for the sake of convenience in drawing. In reality, the user terminal 10 and the image processing device 20 have more complicated configurations than those depicted in FIG. 1, both in terms of hardware configuration and software configuration. For example, the image processing device 20 may be configured to include multiple servers, databases, etc.

[0013] The system 1 may be regarded as a configuration including a user terminal 10 and an image processing device 20, or may be regarded as a configuration including only the image processing device 20 without including the user terminal 10. In other words, in the system 1, the user terminal 10 is not an essential component (it is sufficient that an image including a container, which will be described later, is input to the image processing device 20).

[0014] The user terminal 10 is, for example, a mobile terminal (mobile communication terminal) such as a mobile phone, a smartphone, or a tablet terminal. In other words, the user terminal 10 in this specification is a communication device capable of performing various types of communication with the image processing device 20. The user terminal 10 may be, for example, a wired and / or wireless (e.g., Long Term Evolution (LTE), 5 thThe user terminal 10 may communicate with a network (such as the Internet) via a wireless communication system (such as 5G Generation New Radio (5G NR), Wi-Fi (registered trademark), etc.) via a wireless communication system (such as 5G Wireless Communication System). The user terminal 10 executes a browser and various other applications (particularly a container image analysis application service described later) by user operation.

[0015] The image processing device 20 may be any communication device capable of performing various types of communication with the user terminal 10, and may be interpreted as a device, a circuit, etc. In particular, the image processing device 20 performs various types of communication with the user terminal 10 in order to analyze an image including a container acquired (captured) by the user terminal 10 and provide various application services (container image analysis application services) based on the analysis results.

[0016] Fig. 2 is a diagram showing an example of the configuration of the user terminal 10. The user terminal 10 has an imaging unit (image acquisition unit) 11, an image transmission unit 12, and a container image analysis application unit 13. In addition to the components depicted in Fig. 2, the user terminal 10 has components that are installed in a general user terminal, such as a display, a speaker, and a microphone.

[0017] The imaging unit 11 is a camera system mounted on the user terminal 10, and captures (obtains) an image including a container (unopened container). The image transmission unit 12 transmits the image including the container captured by the imaging unit 11 to the image processing device 20. The container image analysis application unit 13 executes various processes for utilizing a container image analysis application service based on the image including the container transmitted from the image transmission unit 12 to the image processing device 20.

[0018] For example, when the camera of the imaging unit 11 is started, a photo may be taken by determining whether or not the container in the image received by the imaging element (CCD: Charge Coupled Device) is a specified brand. In order to realize a more comfortable user experience (UX: User Experience) than taking an image separately, the container determination process may be divided. In the determination process, for example, the outer shape and design of the container may be analyzed to determine whether or not the image received by the imaging element includes the logo of the specified brand of the container or the top surface of the container. In this case, the probability (reliability score) that the container received by the imaging element is the specified brand may be calculated, and imaging may be performed if the probability is equal to or greater than a specified value (for example, 50% or greater). Here, the above-mentioned specified value that determines whether or not imaging is performed has a degree of freedom, and various design changes are possible. Of course, whether or not the container received by the imaging element is a specified brand may be detected by a 1 / 0 flag.

[0019] 3A, 3B, and 3C are diagrams showing an example of an image including a container. As shown in FIG. 3A to FIG. 3C, the container 40 has an upper surface opening portion 41, a lower surface bottom portion 42, a side connection portion 43 connecting the upper surface opening portion 41 and the lower surface bottom portion 42, and an upper surface sealing portion 44 sealing the upper surface opening portion 41. FIG. 3A to FIG. 3C show a state before opening of the container 40 in which the upper surface opening portion 41 is sealed by the upper surface sealing portion 44, and the upper surface opening portion 41 is hidden by the upper surface sealing portion 44 (the leader line of the upper surface opening portion 41 is drawn by a dashed line). The image processing of this embodiment targets an image including the container 40 before opening. In addition, in this specification, the "shape of the upper surface sealing portion 44 (a perfect circle or an ellipse to be described later)" means the upper surface of the upper surface sealing portion 44 (a surface parallel or approximately parallel to a surface including the upper surface opening portion 41).

[0020] An upper surface display section 45 is provided on the upper surface sealing section 44, and in the example of Fig. 3A to Fig. 3C, the upper surface display section 45 is simply drawn with "ABC". A side surface display section 46 is provided on the side surface connecting section 43, and in the example of Fig. 3A to Fig. 3C, the side surface display section 46 is simply drawn with "XYZ". In Fig. 3A to Fig. 3C, for convenience of drawing, the upper surface display section 45 and the side surface display section 46 are drawn in a normal font, but in reality, the upper surface display section 45 and the side surface display section 46 are distorted in the image depending on the shape, roundness, etc. of the upper surface sealing section 44 and the side surface connecting section 43 of the container 40.

[0021] 3A shows, for example, a small lactobacillus beverage container 40, with a top open part 41 in the shape of a small circle, a bottom bottom part 42 in the shape of a large circle, and a side connection part 43 in the shape of a cylinder that expands in diameter from the top open part 41 towards the bottom bottom part 42, then becomes a fixed diameter, becomes depressed once, and then becomes a fixed diameter again. The top sealing part 44 is made of a film member (foil) that is placed over and adhered to the top open part 41, and by pinching and peeling off the peripheral part of the film member (the part that hangs down outside the top open part 41), the top sealing part 44 is removed and the top open part 41 is exposed.

[0022] 3B shows, for example, a container 40 for cup noodles (cup ramen, cup soba, cup udon, etc.), in which an upper open portion 41 is a large-diameter circle, a lower bottom portion 42 is a small-diameter circle, and a side connection portion 43 is a cylinder whose diameter decreases from the upper open portion 41 toward the lower bottom portion 42. An upper sealing portion 44 is made of a lid member (a flap) that is placed over and adhered to the upper open portion 41, and by pinching and peeling off the peripheral portion of the lid member (the portion that hangs down outside the upper open portion 41), the upper sealing portion 44 is removed and the upper open portion 41 is exposed.

[0023] 3C shows, for example, a PET bottle-type container 40 for beverages (mineral water, tea, soft drinks, etc.), in which the top open portion 41 is a small-diameter circle, the bottom bottom portion 42 is a large-diameter circle, and the side connection portion 43 is a cylinder whose diameter increases from the top open portion 41 toward the bottom bottom portion 42 and then becomes a fixed diameter. The top sealing portion 44 is made of a cap portion having a screw portion that screws into a screw portion formed on the periphery of the top open portion 41, and by pinching and turning the cap portion, the top sealing portion 44 is removed and the top open portion 41 is exposed.

[0024] The shape of the container 40 depicted in FIG. 3A to FIG. 3C is merely an example, and various other shapes of containers 40 can be used. There is a degree of freedom in the shapes and modes of the top open portion 41, the bottom bottom portion 42, the side connection portion 43, and the top sealing portion 44, and various design modifications are possible. For example, the top open portion 41, the bottom bottom portion 42, and the top sealing portion 44 may be circular with the same or different diameters, or may be a shape other than a circle (however, it is preferable that the shape is symmetrical so that the center point can be determined). In addition, the side connection portion 43 may be a shape in which the center in the height direction is bulged more than the top and bottom surfaces, like a beer barrel (a Western-style barrel filled with beer, with a bulging center). In addition, there is a degree of freedom in the contents of the container 40, and various design modifications are possible (any other contents such as food and beverages can be contained).

[0025] 4A to 4C are diagrams showing an example of the concept of a container image analysis application service based on an image including a container. The container image analysis application service provides benefits (experiences of value) while creating fans of the brand based on the experience of capturing a container with a camera. In order to receive the container image analysis application service, the user needs to confirm and agree to the terms of use and privacy policy via the user terminal 10 and then indicate his / her intention to participate. In addition, the container image analysis application service is set with the campaign name, application period, target products (type and size of container, etc.), prizes, number of winners, required points, etc.

[0026] In Fig. 4A, the image capturing unit 11 of the user terminal 10 captures (scans) an image of the container before the user eats or drinks from it, and transmits the captured image to the image processing device 20. Here, the image capturing and transmission of the container image in Fig. 4A may be limited in terms of time and number of times (for example, once a day).

[0027] In Fig. 4B, when the image of the container in Fig. 4A is captured and transmitted a predetermined number of times, an application for original goods (prize) is automatically made. In the example of Fig. 4B, capturing and transmitting the image of the container in Fig. 4A is converted into 1 point, and an application for original goods (prize) is automatically made every time 5 points are accumulated. Here, the automatic application for every 5 points may be limited in terms of time and number of times (for example, a maximum of 10 times during the campaign period).

[0028] In Fig. 4C, if a user wins an automatic entry for every 5 points, the user will win (be provided with) original goods. In Fig. 4C, an example of the original goods is a mobile phone case (original smartphone case) with the container manufacturer XYZ and the product name ABC printed on it.

[0029] The above-mentioned container image analysis application service is intended to promote sales of containers (related products), and therefore, by its nature, it is assumed (presumed) that the containers related to the container images sent to the image processing device 20 are not the same. In other words, each of the predetermined points (e.g., 5 points) required for automatic application for original goods (1 point) must not be multiple images of the same container or images picked up from the Internet, but is assumed (presumed) to be images taken each time the user eats or drinks (before eating or drinking) according to the number of containers from which the user eats or drinks. Furthermore, it is assumed (presumed) that the containers from which the user eats or drinks are purchased by the user himself / herself, the user's family or cohabitant, or friends or colleagues who eat or drink the contents of the container together with the user.

[0030] From the viewpoint of making the above assumptions and presuppositions firm, the processing device, processing method, and processing program for an image including a container disclosed herein have the constituent elements to process (analyze) the containers included in the image to determine whether the containers included in the image are the same or not, and to connect them to a "proof of purchase" for the container. For example, if smooth and reliable proof of purchase can be obtained, it will be easier to set up a loyalty program (a marketing measure in which a company gives benefits to "good customers" who use a service multiple times or frequently purchase products) even for in-store purchased products, and it will be possible to elevate digital sales promotion to a marketing customer relationship process (CRP) for increasing the number of brand fans.

[0031] Here are some of the factors that make it difficult to obtain smooth and reliable proof of purchase: (1) Proof of purchase cannot be misconstrued, especially when it comes to handling complaints and fraud. (2) Postcards are a pain because they don’t go far in distribution and have to be thrown away each time. (3) Serial identification would require a huge number of items to be produced on a factory production line, and would also require the issuance of barcodes and printing of stickers. (4) Receipts are cumbersome and time-consuming, and there is a cost to determining whether they are correct, and there are loopholes for fraud. In the past, there have been cases of organized receipt proof of purchase fraud (falsifying the date, folding the receipt to make a different payment, modifying the background color, stacking multiple receipts) occurring during promotional campaigns. (5) Electronic payments such as “XX Pay,” which are less prone to errors, have problems with payment restrictions, limited retail availability, and a lack of flexibility due to being driven by platform providers (businesses that provide the infrastructure).

[0032] Thus, a mechanism is awaited that can determine whether the containers in an image are the same or not by processing (analyzing) the containers in the image under the initiative of the container manufacturer (in-house production), and can further lead to purchase proof of the container. Based on this idea, the present inventor has realized a processing device, processing method, and processing program for images including containers that have such a mechanism. This mechanism changes the concept of purchase proof for campaigns from a theory of bad people to a theory of good people, and includes flexibility that does not hesitate to give points slightly in excess as long as obvious fraud or dishonesty is detected, and is based on the possibility of so-called "pseudo purchase proof," which does not require strict purchase judgment.

[0033] 5 is a diagram showing an example of the configuration of the image processing device 20. The image processing device 20 has an image input unit (image acquisition unit) 21, a first determination unit 22, a second determination unit 23, a third determination unit 24, an angle calculation unit 25, an angle output unit 26, a comparison unit 27, a notification unit 28, and a privilege granting unit 29.

[0034] The image input unit (image acquisition unit) 21 inputs (acquires) an image including a container that has been captured by the imaging unit 11 of the user terminal 10 and transmitted from the image transmission unit 12. The image input unit (image acquisition unit) 21 inputs (acquires) a plurality of images from the same user terminal 10.

[0035] The first determination unit 22 analyzes the image input to the image input unit 21 and determines whether or not the container included in the image is a predetermined brand. This determination may be the same as the process when determining whether or not to image the container with the imaging unit 11 of the user terminal 10. The first determination unit 22 may calculate the probability (reliability score) that the container included in the image input to the image input unit 21 is a predetermined brand.

[0036] The second determination unit 23 analyzes the image input to the image input unit 21 and determines whether the container included in the image has a predetermined capacity. For example, the second determination unit 23 may determine whether the container included in the image input to the image input unit 21 has a first capacity, a second capacity, or another capacity. The second determination unit 23 may calculate the probability (reliability score) of whether the container included in the image input to the image input unit 21 has the first capacity, the second capacity, or another capacity.

[0037] The third determination unit 24 analyzes the image input to the image input unit 21 and determines whether the image is an existing image lacking originality. The third determination unit 24 detects images input to the image input unit 21 that have been picked up from the Internet (i.e., images that are highly likely not taken by the user himself / herself via the user terminal 10). The third determination unit 24 uses template matching to compare the image with an Internet image sent to a backend (a part invisible to the user, such as a server side or database system) and measures the similarity between the two. The third determination unit 24 may calculate the probability (reliability score) that the image input to the image input unit 21 is an existing image lacking originality.

[0038] Angle calculation unit 25 analyzes the image input to image input unit 21 to determine a first straight line and a second straight line set based on the contour characteristic part of the container, and calculates the angle between the first straight line and the second straight line. In the present disclosure, the first straight line and the second straight line are defined by using top surface side display part 45 provided on top surface sealing part 44 and side surface side display part 46 provided on side surface connection part 43 as the contour characteristic parts of container 40. A specific description will be given below.

[0039] 6 is a diagram showing an example of the configuration of the angle calculation section 25. The angle calculation section has a first line acquisition section 25X, a second line acquisition section 25Y, and an angle acquisition section 25Z.

[0040] The first line acquisition unit 25X acquires a first line based on the upper surface side display unit 45 provided on the upper surface sealing portion 44 from the image input to the image input unit 21.

[0041] 7A, 7B, and 7C are diagrams showing an example of the first line acquisition process by the first line acquisition unit 25X.

[0042] As shown in FIG. 7A, the first straight line acquisition unit 25X corrects the top sealing portion 44 captured in the image input to the image input unit 21 from a non-circular shape (e.g., an ellipse) to a perfect circle. At that time, the first straight line acquisition unit 25X corrects the distortion of the top display unit 45 provided on the top sealing portion 44. When the container 40 is imaged from directly above and the top sealing portion 44 in the image is a perfect circle, the correction process of FIG. 7A is not necessary. The correction process of FIG. 7A can also be performed after the acquisition and update process of the first straight line in FIG. 7B and FIG. 7C. For example, when the top sealing portion 44 is captured in an elliptical or approximately elliptical shape, the center point of the ellipse or approximately ellipse, which is the intersection of the major axis and the minor axis, corresponds to the "center point of the top sealing portion 44."

[0043] As shown in Fig. 7A, the top display unit 45 provided on the top sealing unit 44 is configured to include a character string of "ABC" repeatedly arranged in a predetermined column direction and row direction. In the example of Fig. 7B, the character string of "ABC" is drawn in the left-right direction (column direction) in the figure, and the character string of "ABC" is repeatedly drawn in the up-down direction (row direction) in the figure. A predetermined space is provided between the character strings of "ABC" in the up-down direction (row direction).

[0044] 7B, the first line acquisition unit 25X acquires, as the first line, a line along the character string "ABC" of the top display unit 45 provided on the top sealing unit 44, more specifically, a line drawn by a dashed dotted line along the topmost character string "ABC". And / or, the first line acquisition unit 25X acquires, as the first line, a line along the boundary between adjacent character strings "ABC" of the top display unit 45 provided on the top sealing unit 44, more specifically, a line drawn by a dashed dotted line along the boundary between the bottommost character string "ABC" and the character string "ABC" above it.

[0045] As shown in Fig. 7C, the first straight line acquisition unit 25X may acquire an updated version of the first straight line by translating the straight line (dash line) along the character string "ABC" acquired in Fig. 7B or the straight line (dash line) along the boundary between adjacent character strings "ABC" so that it passes through the center point (center point of the perfect circle) of the top sealing portion 44. The updated first straight line is depicted by a dashed line. The update process in Fig. 7C may be omitted.

[0046] The first straight line acquisition unit 25X may perform different acquisition and update processes of the first straight line depending on the shape of the top sealing part 44 captured in the image input to the image input unit 21. For example, when the top sealing part 44 captured in the image is a perfect circle, a straight line (dash line) along the character string "ABC" or a straight line (dash line) along the boundary between adjacent character strings "ABC" may be translated to pass through the center point (center point of the perfect circle) of the top sealing part 44, and may be acquired as an updated version of the first straight line. On the other hand, when the top sealing part 44 captured in the image is an ellipse, a straight line (dash line) along the character string "ABC" or a straight line (dash line) along the boundary between adjacent character strings "ABC" may be translated to pass through the center point of the major axis or minor axis of the ellipse of the top sealing part 44, and may be acquired as an updated version of the first straight line.

[0047] There is a degree of freedom in the specific mode of the process in which the first line acquisition unit 25X acquires and updates the first line based on the top display unit 45, and various design modifications are possible. For example, a line along a character string included in the top display unit 45, or a line along a boundary between adjacent character strings, rotated in the same direction (e.g., clockwise or counterclockwise) by a predetermined angle (e.g., 90° or 45°, etc.) may be acquired as the first line. The first line may be acquired and updated according to a common (same) rule based on the top display unit 45.

[0048] The second line acquisition unit 25Y acquires a second line based on the side display unit 46 provided on the side connection unit 43 from the image input to the image input unit 21.

[0049] The side display unit 46 is configured to include a reference point provided on the side connection unit 43. For example, a part of the character string "XYZ" provided on the side connection unit 43 (side display unit 46) is set as this "reference point." Here, the center (center point) of the character "Y" is set as the "reference point provided on the side connection unit 43 (side display unit 46)." As will be described in detail later, the "reference point provided on the side connection unit 43 (side display unit 46)" is extracted and determined by using segmentation and key point extraction (particularly key point extraction) to target a point (for example, the center of a part of the character string) of the logo part on the side of the container. This also applies to the extraction and determination of the character string "ABC" provided on the top display unit 45 and the straight line along the character string.

[0050] FIG. 8 is a diagram showing an example of the second line acquisition process by the second line acquisition unit 25Y. As shown in FIG. 8, the center point A of the top surface sealing unit 44 is acquired (set, extract). Also, a reference point provided on the side surface connection unit 43 (side surface display unit 46), that is, a point B at which a straight line extending perpendicularly from the center (center point) of the letter "Y" toward a plane including the top surface sealing unit 44 intersects with the plane including the top surface sealing unit 44 is acquired (set, extract). Then, a straight line connecting point A and point B is acquired as the second line. In this way, the second line acquisition unit 25Y acquires, from the image input to the image input unit 21, a straight line connecting the center point A of the top surface sealing unit 44 and point B at which a straight line extending perpendicularly from the reference point of the side surface display unit 46 toward a plane including the top surface sealing unit 44 intersects with the plane including the top surface sealing unit 44 as the second line.

[0051] In the examples of Figs. 7A to 7C and 8, the top surface (top sealing portion 44) of the container is circular (approximately circular) when viewed in plan. For this reason, when capturing an image of the container, if the image is captured from directly above the container, the top surface (top sealing portion 44) of the container will appear circular (approximately circular), but if the image is captured from even a slight angle, the top surface (top sealing portion 44) of the container will appear non-circular, and it is highly likely that the latter case will be the majority. Therefore, the first line acquisition unit 25X may correct the top surface (top sealing portion 44) of the container captured in the image from a non-circular shape to a perfect circle before acquiring the first line, and the second line acquisition unit 25Y may correct the top surface (top sealing portion 44) of the container captured in the image from a non-circular shape to a perfect circle before acquiring the second line.

[0052] Angle acquisition unit 25Z acquires the angle between the first line acquired by first line acquisition unit 25X and the second line acquired by second line acquisition unit 25Y. The first line acquired in Fig. 7A to Fig. 7C and the second line acquired in Fig. 8 are located on the same plane along the upper surface of top sealing portion 44, so it is possible to acquire the angle between the first line and the second line. Fig. 9 is a diagram showing the angle θ between the first line and the second line acquired by angle acquisition unit 25Z.

[0053] The angle calculation by the angle calculation unit 25 (first line acquisition unit 25X, second line acquisition unit 25Y, angle acquisition unit 25Z) is performed by three processes: segmentation, key point extraction, and angle calculation by geometric processing. That is, when an image including a container is sent to the back end (a part invisible to the user such as a server side or database system), the three processes of segmentation, key point extraction, and angle calculation by geometric processing are performed, and as a result, the first line and the second line are obtained, and the angle formed by the first line and the second line is obtained. In this way, the first line acquisition unit 25X and the second line acquisition unit 25Y acquire the first line and the second line based on the segmentation and key point extraction.

[0054] Segmentation is a model that estimates what is in an image for each pixel, and additional learning can be performed by creating training data independently using a model architecture used in general object detection. In segmentation, the area of ​​the top surface of the container is determined on a pixel-by-pixel basis in the target image.

[0055] Keypoint extraction is a model that detects the coordinates of points that are characteristic of an object in an image, and learning based on the model is possible by setting new keypoints for containers in the image. In keypoint extraction, the coordinates of points in the target image for defining (identifying) the first and second straight lines are detected. For example, the coordinates of the center point of the top sealing part 44 and the plane including the top surface of the top sealing part 44 for defining (identifying) the first and second straight lines are detected. In addition, the coordinates of the character string "ABC" for defining (identifying) the first straight line are detected. In addition, the coordinates of the character string "XYZ" and the reference point in the character string (for example, the center point of the letter "Y") for defining (identifying) the second straight line are detected.

[0056] In angle calculation using geometric processing, the angle θ between the first line and the second line is calculated based on the data detected by segmentation and keypoint extraction (see Figure 9).

[0057] As an example, segmentation takes an image that includes a container as input and determines where the top area of ​​the container is on a pixel-by-pixel basis. Keypoint extraction takes an image that includes a container as input and identifies points to define (identify) the first and second lines. Angle calculation through geometric processing takes the results of segmentation and keypoint extraction as input to find the first and second lines and obtain the angle θ between the first and second lines.

[0058] When multiple images are input to the image input unit 21 from the same user terminal 10, the angle calculation unit 25 (first line acquisition unit 25X, second line acquisition unit 25Y, angle acquisition unit 25Z) calculates the angle θ between the first line and the second line for each of the multiple images.

[0059] Angle output unit 26 outputs the angle θ between the first line and the second line calculated by angle calculation unit 25 (first line acquisition unit 25X, second line acquisition unit 25Y, angle acquisition unit 25Z). When multiple images from the same user terminal 10 are input to image input unit 21 and angle calculation unit 25 calculates the angle θ between the first line and the second line for the multiple images, angle output unit 26 outputs the angle θ between the first line and the second line for the multiple images.

[0060] The comparison unit 27 compares a plurality of images from the same user terminal 10 to determine whether the angle θ between the first line and the second line is within a predetermined range.

[0061] When manufacturing a container, the positional relationship between the top sealing part (top display part drawn thereon, for example, the character string "ABC") that seals the top open part of the container and the side connection part of the container (side display part drawn thereon, for example, the character string "XYZ") is not uniformly created in the same way, and the positional relationship between the two can be considered, so to speak, as the degree of originality of each container. In other words, strictly speaking, the angle θ between the first line and the second line is almost always different for each container, and the possibility that the same container is included in multiple images can be determined based on the angle θ. For example, if the angle θ between the first line and the second line is significantly different for containers included in multiple images, the containers included in the multiple images are likely to be different, and if the angle θ between the first line and the second line is the same or almost the same, the containers included in the multiple images are likely to be the same.

[0062] For example, the comparison unit 27 determines the angle θ between the first line and the second line in an arbitrary one of the reference images as a reference angle θ standard , and the angle θ between the first line and the second line in the other reference images of the multiple images is set as the reference angle θ reference Then, the reference angle θ standard and the reference angle θ reference is compared to see if it is within a predetermined range. For example, 0.95 × reference angle θ reference ≦Reference angle θ standard≦1.05×reference angle θ reference If the conditional expression is not satisfied, it can be determined that the containers included in the reference image and the standard image are different. The comparison unit 27 may calculate a probability (reliability score) indicating whether the containers included in the multiple images (standard image and reference image) are the same or not.

[0063] When the angle θ between the first line and the second line for multiple images from the same user terminal 10 is within a predetermined range, that is, when there is a high possibility that the containers included in the multiple images are the same, the notification unit 28 notifies the user terminal 10 to that effect. The method of notifying the user terminal 10 can be, for example, a display on a display and / or a voice from a speaker. At that time, the notification unit 28 may notify that the multiple images are not eligible for a bonus by the bonus granting unit 29 described later.

[0064] In addition, if the area of ​​the container in the image including the container input to the image input unit 21 is below a predetermined range, the notification unit 28 may issue an error notification, indicating that it is not possible to calculate (obtain) the angle θ between the first line and the second line.

[0065] When the angle θ between the first line and the second line is not within a predetermined range for multiple images from the same user terminal 10, the bonus awarding unit 29 determines that the containers included in the multiple images are different, and awards a bonus to the user terminal 10 according to the number of multiple images. For example, each image that includes a container may be converted into 1 point, and when the number of points reaches 5, which corresponds to 5 images, an automatic application may be made, and original goods may be won if the user wins a lottery (see Figs. 4B and 4C).

[0066] FIG. 10 is a diagram showing an example of the concept of a container image analysis application service based on an image including a container. As shown in FIG. 10, an image including a container is transmitted from an application of a user terminal 10 to an AI (Artificial Intelligence) of an image processing device 20. The AI ​​of the image processing device 20 assigns container information to the uploaded image. More specifically, information such as the angle θ between the first and second straight lines for each container, the similarity with an image on the Internet, the angle θ between the first and second straight lines of a container recently uploaded by the same user, and product information (e.g., the capacity of the container) can be obtained. The result of the determination by the AI ​​of the image processing device 20 is passed to a campaign system as a numerical value, and the campaign system is configured to be able to regulate the awarding of points and benefits.

[0067] FIG. 11 is a diagram showing a first example of the flow of a method for processing an image including a container.

[0068] In step ST1, a camera serving as the imaging unit 11 of the user terminal 10 is started. In step ST2, an image including a container is captured (obtained) by the imaging unit 11 of the user terminal 10. When the camera is started and recognizes a logo or a specific part (e.g., characters or a pattern indicating a product name) of a container (when the probability that the container is the target container exceeds a predetermined value), the shutter is automatically released to capture an image including the container.

[0069] In step ST3, the second determination unit 23 of the image processing device 20 determines whether the container has a predetermined capacity. For this determination, for example, the capacity may be determined based on the overall shape of the container, or the product ID (JAN code) attached to the container may be used. In step ST4, the third determination unit 24 of the image processing device 20 confirms that the image including the container is not an existing image (an image picked up from the Internet) that lacks originality.

[0070] In step ST5, the angle calculation unit 25 (first line acquisition unit 25X, second line acquisition unit 25Y, angle acquisition unit 25Z) of the image processing device 20 calculates the angle between the first line and the second line for a container included in the captured image. In step ST6, the comparison unit 27 of the image processing device 20 compares the angle between the first line and the second line of a container included in an image most recently registered by a user with the same ID (same user) with the angle calculated in step ST5 by checking against a database, and determines the degree of agreement. In step ST7, a final determination is made as to whether the containers included in the multiple images whose angles have been compared and determined in step ST6 are the same container or different containers.

[0071] Figures 12A, 12B, 12C and 12D are diagrams showing a second example of the flow of a method for processing an image including a container, in which a container of the type exemplified in Figure 3A is depicted.

[0072] In FIG. 12A, based on filter 1 using a camera AI model, it is determined whether the container is a specified brand. In FIG. 12B, based on filter 2 using a back-end AI model (object detection), it is determined whether the container is captured at a relatively large size and the character string "XYZ" on the side display part. In FIG. 12C, based on filter 3 using a back-end AI model (keypoint detection), it determines the character string "ABC" on the top display part and also determines the reference point (for example, the center of the central "Y") of the character string "XYZ" on the side display part. In FIG. 12D, based on filter 4 using a back-end AI model (segmentation), it performs ellipse detection for angle calculation from the top sealing part of the container and obtains the angle between the first straight line obtained based on the character string "ABC" on the top display part and the second straight line obtained based on the character string "XYZ" on the side display part.

[0073] Thus, in the processing device for an image including a container according to the present disclosure, the first straight line acquisition unit acquires a first straight line based on the top display unit from an image including a container, the second straight line acquisition unit acquires a second straight line based on the side display unit from an image including a container, and the angle acquisition unit acquires the angle between the first straight line and the second straight line. This enables processing of an image including a suitable (improved) container. For example, an analysis of the container included in the image can be performed to determine whether the containers included in the image are the same, and can even lead to purchase proof of the container. In addition, it is flexible and convenient, and can achieve a certain level of accuracy.

[0074] In addition, in the processing device for an image including a container according to the present disclosure, by storing the probability of whether an image contains a specific container or not, and whether it is the same container or not, flexibility in determining whether it is true or false is ensured. In addition, detailed feedback of metadata surrounding the determination allows flexible changes on the campaign design side. In addition, since the analysis process is performed on the application server side (image processing device 20) and the container recognition is performed on the application side (user terminal 10), a user experience (UX: User Experience) such as a real-time feeling can be realized. In addition, since it can be realized by, for example, javascript (registered trademark) running on HTML language, implementation is easy.

[0075] Fig. 13 is a diagram showing an example of a functional configuration of a user terminal 10 and an image processing device 20 according to an embodiment. As shown in Fig. 13, the user terminal 10 and the image processing device 20 have a control unit 110, a storage unit 120, a communication unit 130, an input unit 140, and an output unit 150. Note that Fig. 13 shows an example of functional blocks of the user terminal 10 and the image processing device 20, and the user terminal 10 and the image processing device 20 may have other functional blocks not shown in Fig. 13. Also, the configuration may not include some functional blocks.

[0076] The control unit 110 controls the user terminal 10 and the image processing device 20. The control unit 110 can be configured by a controller, a control circuit, or a control device that is described based on common understanding in the technical field related to the present invention.

[0077] The storage unit 120 stores information used by the user terminal 10 and the image processing device 20. The storage unit 120 can be configured, for example, by a memory, a storage, a storage device, or the like that is described based on a common understanding in the technical field related to the present invention.

[0078] The communication unit 130 performs communication (e.g., mutual communication) between the user terminal 10 and the image processing device 20. The communication unit 130 can be configured with a transmitter / receiver, a transmission / reception circuit, or a transmission / reception device that are explained based on a common understanding in the technical field related to the present invention. Note that the communication unit 130 may be configured with a transmission unit and a reception unit.

[0079] The input unit 140 accepts inputs in the user terminal 10 and the image processing device 20. The input unit 140 may be connected to a predetermined device, a storage medium, etc., and may accept data input. The input unit 140 may output the input result to, for example, the control unit 110. The input unit 140 may be configured with input devices such as a keyboard, a mouse, and a button, an input / output terminal, an input / output circuit, etc., which are explained based on a common understanding in the technical field related to the present invention. The input unit 140 may also be configured to be integrated with a display unit (for example, a touch panel).

[0080] The output unit 150 performs output in the user terminal 10 and the image processing device 20. For example, the output unit 150 may be configured to include a display unit that displays images, an audio output unit that outputs audio, and the like. The display unit may be configured, for example, by a display device such as a display or monitor that is described based on a common understanding in the technical field related to the present invention. Furthermore, the audio output unit may be configured by an output device such as a speaker that is described based on a common understanding in the technical field related to the present invention.

[0081] The block diagrams used to explain the above embodiments show functional blocks. These functional blocks (components) are realized by any combination of hardware and / or software. The means for realizing each functional block is not particularly limited. That is, each functional block may be realized by one physically combined device, or may be realized by two or more physically separated devices connected by wire or wirelessly.

[0082] For example, the user terminal 10 and the image processing device 20 in an embodiment of the present disclosure may function as a computer that processes the processing method and processing program for an image including a container of the present disclosure. Fig. 15 is a diagram showing an example of a hardware configuration of the user terminal 10 and the image processing device 20 according to an embodiment. The above-mentioned user terminal 10 and the image processing device 20 may be physically configured as a computer device including a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an input device 1005, an output device 1006, a bus 1007, etc.

[0083] In this disclosure, the terms apparatus, circuit, device, unit, server, etc. may be interchangeable. The hardware configuration of the user terminal 10 and the image processing device 20 may be configured to include one or more of the devices shown in the drawings, or may be configured to exclude some of the devices.

[0084] For example, although only one processor 1001 is shown, there may be multiple processors. Also, the processes may be performed by one processor, or the processes may be performed by two or more processors simultaneously, sequentially, or in other manners. Also, the processor 1001 may be implemented by one or more chips.

[0085] Each function of the user terminal 10 and the image processing device 20 is realized by loading a specific software (program) onto hardware such as a processor 1001 and a memory 1002, so that the processor 1001 performs calculations and controls communication via a communication device 1004, reading and / or writing of data in the memory 1002 and storage 1003, etc.

[0086] The processor 1001 controls the entire computer by running an operating system, for example. The processor 1001 may be configured with a central processing unit (CPU) including an interface with peripheral devices, a control device, an arithmetic unit, a register, etc. Each unit such as the control unit 110 described above may be realized by the processor 1001.

[0087] Moreover, the processor 1001 reads out programs (program codes), software modules, data, etc. from at least one of the storage 1003 and the communication device 1004 into the memory 1002, and executes various processes according to the programs. As the programs, programs that cause a computer to execute at least a part of the operations described in the above-mentioned embodiments are used. For example, the control unit 110 may be realized by a control program stored in the memory 1002 and operated by the processor 1001, and the other functional blocks may be realized in a similar manner.

[0088] The memory 1002 is a computer-readable recording medium, and may be configured by at least one of, for example, a Read Only Memory (ROM), an Erasable Programmable ROM (EPROM), an Electrically EPROM (EEPROM) (registered trademark), a Random Access Memory (RAM), and other suitable storage media. The memory 1002 may also be called a register, a cache, a main memory, etc. The memory 1002 may store executable programs (program codes), software modules, etc. for implementing a method according to an embodiment.

[0089] Storage 1003 is a computer-readable recording medium, and may be composed of at least one of a flexible disk, a floppy disk, a magneto-optical disk (e.g., a compact disk (CD-ROM (Compact Disc ROM)), a digital versatile disk, a Blu-ray (registered trademark) disk), a removable disk, a hard disk drive, a smart card, a flash memory device (e.g., a card, a stick, a key drive), a magnetic stripe, a database, a server, and other suitable storage media. Storage 1003 may be called an auxiliary storage device. Note that the above-mentioned storage unit 120 may be realized by memory 1002 and / or storage 1003.

[0090] The communication device 1004 is hardware (transmission / reception device) for performing communication between computers via at least one of a wired network and a wireless network, and is also called, for example, a network device, a network controller, a network card, a communication module, etc. The communication device 1004 may include a SIM card. Note that the above-mentioned communication unit 130 may be realized by the communication device 1004.

[0091] The input device 1005 is an input device (e.g., a keyboard, a mouse, etc.) that accepts input from the outside. The output device 1006 is an output device (e.g., a display, a speaker, etc.) that performs output to the outside. The input device 1005 and the output device 1006 may be integrated into one (e.g., a touch panel). The above-mentioned input unit 140 and output unit 150 may be realized by the input device 1005 and the output device 1006, respectively.

[0092] Furthermore, each device such as the processor 1001 and the memory 1002 is connected by a bus 1008 for communicating information. The bus 1007 may be configured by a single bus, or may be configured by different buses between the devices.

[0093] Furthermore, the user terminal 10 and the image processing device 20 may be configured to include hardware such as a microprocessor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a programmable logic device (PLD), a field programmable gate array (FPGA), etc., and some or all of the functional blocks may be realized by the hardware. For example, the processor 1001 may be implemented by at least one of these pieces of hardware.

[0094] (Modification) In addition, terms explained in this disclosure and / or terms necessary for understanding this disclosure may be replaced with terms having the same or similar meanings.

[0095] The information, parameters, etc. described in this disclosure may be expressed using absolute values, may be expressed using relative values ​​from a predetermined value, or may be expressed using other corresponding information. Furthermore, the names used for parameters, etc. in this disclosure are not limiting in any respect.

[0096] The information, signals, etc. described in this disclosure may be represented using any of a variety of different technologies. For example, the data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.

[0097] Information, signals, etc. may be input and output via multiple network nodes. Input and output information, signals, etc. may be stored in a specific location (e.g., memory) or may be managed using a table. Input and output information, signals, etc. may be overwritten, updated, or added. Output information, signals, etc. may be deleted. Input information, signals, etc. may be transmitted to another device.

[0098] Furthermore, notification of specified information (e.g., notification that "it is X") is not limited to explicit notification, but may be made implicitly (e.g., by not notifying the specified information or by notifying other information).

[0099] Software shall be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.

[0100] Software, instructions, information, etc. may also be transmitted and received via a transmission medium and / or signal waveform. For example, if the software is transmitted from a website, server, or other remote source using wired technologies (such as coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL)), and / or wireless technologies (such as infrared, microwave), then these wired and / or wireless technologies are included within the definition of a transmission medium.

[0101] As used in this disclosure, the terms "system" and "network" may be used interchangeably.

[0102] Each aspect / embodiment described in this disclosure may be used alone, in combination, or switched according to implementation. In addition, the processing procedures, sequences, flow charts, etc. of each aspect / embodiment described in this disclosure may be reordered unless inconsistent. For example, the methods described in this disclosure present elements of various steps using an example order, and are not limited to the particular order presented.

[0103] As used in this disclosure, the phrase "based on" does not mean "based only on," unless expressly stated otherwise. In other words, the phrase "based on" means both "based only on" and "based at least on."

[0104] Any reference to an element using a designation such as "first," "second," etc., used in this disclosure does not generally limit the quantity or order of those elements. These designations may be used in this disclosure as a convenient method of distinguishing between two or more elements. Thus, a reference to a first and a second element does not imply that only two elements may be employed or that the first element must precede the second element in some way.

[0105] When the terms "include," "including," and variations thereof are used in this disclosure, these terms are intended to be inclusive, similar to the term "comprising." Further, when used in this disclosure, the term "or" is not intended to be an exclusive or.

[0106] In this disclosure, where articles have been added by translation, such as a, an, and the in English, the disclosure may include that the nouns following these articles are in the plural form.

[0107] Although the invention according to the present disclosure has been described in detail above, it is clear to those skilled in the art that the invention according to the present disclosure is not limited to the embodiments described in the present disclosure. The invention according to the present disclosure can be implemented as modified and altered forms without departing from the spirit and scope of the invention defined based on the description of the claims. Therefore, the description of the present disclosure is intended to be illustrative and does not have any limiting meaning on the invention according to the present disclosure. [Explanation of symbols]

[0108] 1 System 10 User terminal 11 Imaging unit (image acquisition unit) 12 Image transmission unit 13 Container Image Analysis Application Department 20 Image processing device including container (image processing device) 21 Image input unit (image acquisition unit) 22 First Judgment Section 23 Second Judgment Section 24 Third Judgment Section 25 Angle calculation section 25X 1st straight line acquisition part 25Y 2nd straight line acquisition part 25Z angle acquisition part 26 Angle output section 27 Comparison section 28 Notification Department 29 Benefits Granting Department 30 Network 40 containers 41 Open top part 42 Bottom bottom 43 Side connection 44 Top sealing part 45 Top side display 46 Side display section

Claims

1. An upper opening; The bottom surface and A side connection portion that connects the upper surface opening portion and the lower surface bottom portion; An upper surface sealing portion that seals the upper surface opening portion; an upper display unit provided in the upper sealing portion; A side display unit provided on the side connection unit; An image processing device including a container having an image acquisition unit that acquires an image including the container, the image being captured by an imaging unit of the user terminal and transmitted by an image transmission unit of the user terminal; a first line acquisition unit that acquires a first line based on the upper surface side display unit from the image; a second line acquisition unit that acquires a second line based on the side display unit from the image; an angle acquisition unit that acquires an angle between the first straight line and the second straight line; An image processing device including a container, comprising:

2. the upper surface display unit is configured to include a character string provided on the upper surface sealing unit, the side display portion is configured to include a reference point provided on the side connection portion, the first line acquisition unit acquires, as the first line, a line along the character string or a line along a boundary between adjacent character strings; the second straight line acquisition unit acquires, as the second straight line, a straight line connecting a center point of the top surface sealing portion and a point at which a straight line extending perpendicularly from the reference point of the side display unit toward a plane including the top surface sealing portion intersects with the plane including the top surface sealing portion. An image processing device including the container according to claim 1 .

3. The first straight line acquisition unit acquires, as an updated version of the first straight line, a straight line along the character string or a straight line along a boundary between the adjacent character strings, which is translated so as to pass through a center point of the top sealing portion. An image processing device including the container according to claim 2 .

4. The first straight line acquisition unit is When the top surface sealing portion captured in the image has a perfect circular shape, a straight line along the character string or a straight line along a boundary between adjacent character strings is translated so as to pass through a center point of the perfect circular shape, and the translated line is acquired as an updated version of the first straight line; When the top sealing portion captured in the image is elliptical, a straight line along the character string or a straight line along a boundary between adjacent character strings is translated so as to pass through a center point of a major axis or a minor axis of the ellipse, and the translated line is obtained as an updated version of the first straight line. An image processing device including the container according to claim 2 .

5. The first straight line acquisition unit and the second straight line acquisition unit acquire the first straight line and the second straight line after correcting the top sealing portion captured in the image from a non-circular shape to a perfect circle. An image processing device comprising the container according to claim 1 or 2.

6. The first line acquisition unit and the second line acquisition unit acquire the first line and the second line based on segmentation and key point extraction. An image processing device comprising the container according to claim 1 or 2.

7. An upper opening; The bottom surface and A side connection portion that connects the upper surface opening portion and the lower surface bottom portion; An upper surface sealing portion that seals the upper surface opening portion; an upper display unit provided in the upper sealing portion; A side display unit provided on the side connection unit; A method for processing an image including a container having acquiring an image including the container, the image being captured by an imaging unit of a user terminal and transmitted by an image transmission unit of the user terminal; obtaining a first straight line based on the top display unit from the image; obtaining a second straight line based on the side display unit from the image; obtaining an angle between the first line and the second line; A method for processing an image including a container, the method being executed by a computer.

8. An upper opening; The bottom surface and A side connection portion that connects the upper surface opening portion and the lower surface bottom portion; An upper surface sealing portion that seals the upper surface opening portion; an upper display unit provided in the upper sealing portion; A side display unit provided on the side connection unit; A processing program for an image including a container having acquiring an image including the container, the image being captured by an imaging unit of a user terminal and transmitted by an image transmission unit of the user terminal; obtaining a first straight line based on the top display unit from the image; obtaining a second straight line based on the side display unit from the image; obtaining an angle between the first line and the second line; A processing program for an image including a container, which causes a computer to execute the above.

Images