Inspection of straws

Abstract

The present disclosure relates at least to the inspection of straws. A method and an arrangement for inspecting a straw are disclosed, involving the use of the straw as a light guide for inspecting the side wall of the straw based on light leakage of guided light emitted from the straw via the side wall, such as by way of damage in the side wall. It illuminates a first portion of the straw by means of one or more light sources, such that at least some of the light on the first portion is transmitted through the side wall of the straw into the straw and guided therein. One or more digital images are provided of another, second portion of the straw during said illumination. A light pattern captured by the one or more digital images is analysed, which corresponds to light escape of internally reflected light emitted from the second portion of the straw via the side wall of the straw. Damage can be detected as local spots of image data differences.

Description

Technical Field

[0001] The embodiments described herein relate to methods and arrangements for inspecting a straw using one or more images of the straw. Background Technology

[0002] Straws need to be inspected before use (usually during manufacturing) to ensure functionality for consumers, such as ensuring sufficient and / or required quality, and that there is no damage to the sidewalls of the straw, such as holes.

[0003] Some straws are included in the packaging for attaching to the dispenser and dispensing with it; the straws are intended for use with the dispenser.

[0004] To date, plastic straws and plastic packaging materials such as transparent plastic foil have been dominant.

[0005] One way to inspect straws from the outside of their packaging is to image them and use imaging analysis to check for damage, particularly in more vulnerable areas. For example, some straws have a curved drinking end that bends when inserted into the packaging; for these straws, the curved portion is more prone to damage than the rest. When the packaging is transparent, the straw is visible from the inside and can be inspected while it is inside the packaging. Summary of the Invention

[0006] In view of the above, the aim is to provide one or more improvements or alternatives to the existing technology.

[0007] According to a first aspect of the embodiments herein, the objective is achieved by a method for inspecting a straw. It illuminates a first portion of the straw by means of one or more light sources, such that at least some of the light on the first portion is transmitted through the sidewalls of the straw into the straw and guided therein by internal reflection. One or more digital images of a second portion of the straw are provided during the illumination by means of a camera having an image sensor configured to sense the light provided by the light sources. The light patterns captured by the one or more digital images are then analyzed, the light patterns corresponding to the light escape from the second portion of the straw via the sidewalls of the straw and the internal reflections.

[0008] According to a second aspect of the embodiments herein, the object is achieved by a computer program including instructions that, when executed by one or more processors, cause one or more devices to perform the method according to the first aspect.

[0009] According to a third aspect of the embodiments herein, the objective is achieved by a carrier including a computer program according to the second aspect.

[0010] According to a fourth aspect of the embodiments herein, the objective is to use a straw as a light guide to inspect the sidewall of the straw based on light leakage of guided light emitted from the straw via the sidewall.

[0011] According to a fifth aspect of the embodiments herein, the objective is achieved by means of one or more devices for inspecting a straw. The one or more devices are configured to illuminate a first portion of the straw by means of one or more light sources, such that at least some of the light on the first portion is transmitted through the sidewalls of the straw into the straw and guided therein by internal reflection. The one or more devices are also configured to provide one or more digital images of a second portion of the straw during the illumination by means of a camera having an image sensor configured to sense the light provided by the light sources. Furthermore, the one or more devices are configured to analyze light patterns captured by the one or more digital images, the light patterns corresponding to light escape from the second portion of the straw via the sidewalls of the straw and caused by internal reflection.

[0012] Due to the embodiments described herein, even when the straws and / or packaging are opaque, but rather translucent or opaque, under normal lighting conditions and / or general illumination, image analysis-based inspection of straws and their packaging is facilitated or even enabled. This is typically the case if the straws and / or packaging are made of paper, or based on paper or similar paper materials, such as when packaged straws are inside foil packaging. The embodiments described herein therefore facilitate the inspection of straws and / or packaging based on paper or similar paper materials. Attached Figure Description

[0013] This document describes examples of embodiments in more detail with reference to the accompanying schematic diagrams, which are briefly described below.

[0014] Figure 1A -D schematically illustrates examples of straws and packaged straws that can be used with the embodiments described herein.

[0015] Figure 2A -B schematically illustrates an example of a lighting unit used to illuminate the first part of a straw and to allow light to enter the first part of the straw.

[0016] Figure 3A -C schematically illustrates how the lighting unit can be moved into place and, when in that position, provides illumination to the first part of the straw.

[0017] Figure 4 An imaging system for inspecting straws and packaging is schematically illustrated according to some embodiments thereof.

[0018] Figure 5A-B is a normal image of the second part of the straw and an image of the same second part provided based on the embodiments herein when the straw is in its packaging.

[0019] Figure 6 This is a flowchart used to schematically illustrate an embodiment of a method according to the embodiments herein.

[0020] Figure 7 This is used to illustrate how one or more devices can be configured to perform actions related to... Figure 6 A schematic block diagram illustrating embodiments of the methods and actions discussed.

[0021] Figure 8 These are schematic diagrams illustrating some embodiments related to computer programs and their carriers, enabling one or more devices to perform actions related to... Figure 6 The methods and actions discussed. Detailed Implementation

[0022] The embodiments described herein are exemplary embodiments. It should be noted that these embodiments are not necessarily mutually exclusive. It may be assumed by default that components from one embodiment exist in another embodiment, and how those components can be used in other exemplary embodiments will be apparent to those skilled in the art.

[0023] Plastic straws and plastic packaging (e.g., plastic foil as mentioned in the background art) will be banned or are expected to be banned soon. Packaging materials are expected to be replaced by paper-based or paper-like materials, such as paper foil or similar materials, which are not typically transparent as in the case of plastic foil, and are not even usually translucent under normal lighting conditions and general illumination, but rather opaque. This means that, as mentioned in the background art, conventional imaging of straws when they are inside packaging can no longer be used to inspect them, as the image will at best provide only a blurry picture of the straw. Therefore, a new method for inspecting packaged straws has been identified, and this method will also work when straws are inside opaque packaging (e.g., translucent or opaque packaging). Inspection may even be more important than in the past, as straws made of non-plastic materials may be more difficult to produce of good quality than plastic straws, and therefore there may be a greater risk of damaged straws needing to be identified.

[0024] Figure 1A -D schematically illustrates an example of a straw 101 and a packaged straw 109 that can be used with the embodiments herein.

[0025] Figure 1A A straw 101 is shown, having an insertion end portion 103 and a curved drinking end portion 105. The insertion end portion 103 has one end for insertion into a dispenser (not shown), while the curved drinking end portion 105 has one end for drinking.

[0026] Figure 1B The straw 109 of the package is shown, corresponding to the straw 101 in the package 107. For example, the package 107 is made of paper as mentioned above. The insertion end portion 111 of the straw 109 of the package includes the insertion end portion 103 of the straw 101. The drinking end portion 113 of the straw 109 of the package includes the curved drinking end portion 105 of the straw 101.

[0027] Figure 1C A first cross-section of the straw 109 in the package is shown. This cross-section is located at... Figure 1B At position AA marked in the figure, straw 101 can be seen located within package 107. Straw 101 has sidewalls 102 as indicated in the figure. In the unusual case of non-circular or non-elliptical straws, one or more sidewalls are typically thin, as can also be seen in the figure. In practice, it is generally a concern to manufacture straws with sidewalls that are as thin as possible and moderately thin as possible for cost and environmental reasons. However, this increases the risk of problematic sidewall damage (such as holes), which is why it is important to inspect the sidewalls of straws, especially those parts or areas that may be more susceptible to damage during production, or the risk of undesirable variations.

[0028] Figure 1D A second cross-section of the straw 109 in the package is shown. This cross-section is located at... Figure 1B The location marked BB in the middle.

[0029] The curved portion of the drinking end 105 can be formed by bending a straight straw, which has corrugations at its curved portion to enable and / or facilitate bending, or by any other conventional method. The bending can be performed before or in conjunction with insertion into the packaging 107; that is, such a corrugated straw can be inserted such that it bends upon insertion and / or remains in a curved position by the packaging 107 while inside the packaging. In this case, it may be of particular concern to be able to inspect the curved portion of the straw 101 while it is inside the packaging 107 to identify whether such bending has caused damage.

[0030] Note that straw 101 and packaged straw 109 are merely examples. Other formed and / or shaped straws may also be used with the embodiments described herein, such as those with different dimensions, relationships, and / or proportions. Figure 1A -D shows different straight straws, curved or bent straws.

[0031] The embodiments described herein are at least in part based on the concept of using the straw to be inspected (e.g., straw 101) itself as a light guide, and inspecting the sidewall (e.g., sidewall 102) of straw 101 based on light leakage from straw 101 via sidewall 102. It has been found that by aiming and / or directing external illumination (such as specifically) at a first portion of the sidewall, a sufficient amount of diffuse light can enter the straw and be guided therein by internal reflections within the sidewall, such that if a hole or other damage or structure is present at another portion, this will cause light to escape or alter its escape through the sidewall at a second portion via the hole, damage, or structure, and sufficient light will leak out such that it can be sensed by a camera and image sensor. This can thus provide one or more digital images capturing the light pattern of the escaped light. The presence of such a light pattern and / or a change in the light pattern compared to a reference, and / or even the location of the light escape, can be identified through analysis of the digital images(s).

[0032] This principle also applies to packaged straws (such as packaged straw 109). That is, illumination can be provided so that light is transmitted through the sidewall 102 of the package 107 and the straw 101 into the straw 101, where it is guided therein by internal reflection.

[0033] Technicians recognized practical limitations in the application, but even in the case of opaque straws and / or packaging (e.g., paper-like or paper-based materials), sufficient light could be allowed to enter the straw by means of, for example, one or more light-emitting diodes (LEDs) as a light source(s) providing illumination (preferably closely connected to the straw or packaging). Alternatively, sufficiently strong light could be directed and / or directed to a first part, i.e., the part to be illuminated, to achieve sufficiently strong light to penetrate the interior of the straw through the sidewalls of the packaging (when present) and the straw.

[0034] When the general principles behind the embodiments described herein are understood, those skilled in the art will have no problem implementing feasible solutions based on the embodiments and information provided herein, through general knowledge, routine experiments and tests, in specific cases of particular straws and / or packaging, or concluding that particular straws and / or packaging are not suitable for use with the embodiments described herein.

[0035] As long as some light is allowed to enter through the sidewall portion of the straw and any packaging along the way and covering that portion—that is, light transmission exists—the entering light will enter more or less as diffuse light, especially when the straw and / or packaging is opaque or translucent. The light entering the interior is generally more diffuse than light directly from one or more light sources. Light sources that themselves provide diffuse light, such as conventional LEDs, can be advantageously used and are preferred when applied to transparent straws and packaging (if present) to allow more light to enter via the sidewalls at an angle that results in internal reflection. In any case, if the straw material and interior allow for this, some of the diffuse light entering through the sidewalls will be reflected and directed by internal reflection within the straw. Internal light reflection within the straw is generally the case for all practical straws. If not, for example, if the straw is made of a material that prevents sufficient internal reflection of light and / or has an inner surface that prevents sufficient internal reflection of light, then a person skilled in the art will undoubtedly recognize this and therefore will not expect the embodiments described herein to be compatible with such straws.

[0036] Examples of straws and packaging that are not expected by those skilled in the art to be compatible with the embodiments herein are those with a continuous metal surface or layer in the straws and / or packaging, or those that are very thick and opaque. However, as indicated above, such straws and packaging typically receive little or no commercial attention.

[0037] Figure 2A -B schematically illustrates an example of an illumination unit 121 for illuminating a first portion of a straw (e.g., straw 101) and allowing illumination to enter the first portion of the straw (e.g., straw 101) according to some embodiments of this document. While illumination units of the type shown may be preferred in some cases, it will be appreciated from the examples and comments below that the figures shown are specific examples and the embodiments herein are not limited to the examples shown.

[0038] Figure 2A A top view of the lighting unit 121 is shown and Figure 2B It is the lighting unit 121 in Figure 2A The cross-section at the marked position CC.

[0039] The lighting unit 121 has a body that acts as a light shield 125, and light sources 123a, 123b (e.g., LEDs) for illuminating a first portion of the straw 101 or the packaged straw 109 are attached to the body. In this example, the light sources 123a-b are integrated with the light shield 125. Alternatively, the corresponding functions described herein with respect to the lighting unit 121 can be achieved by means of separate light shields(one or more) and light sources(one or more).

[0040] As can be seen from the figure, light sources 123a-b are arranged in recesses 124 formed by a light shield 125. Recesses 124 are used to at least partially receive a first portion of the straw 101, such that the periphery of the straw is at least partially surrounded by the recesses 124 and the light-emitting surfaces of the light sources 123a-b are positioned close to the sidewalls 102 and outer surfaces of the straw 101, and in some embodiments even in direct contact with the straw 101 or the packaged straw 109, but in some cases a certain distance may be preferred to reduce heat transfer.

[0041] In this example, the light shield 125 is configured to block light along the straw and in the lateral (i.e., sideways) direction. The former is achieved in this example by light sources 123a-b that do not extend fully from one end of the light shield 125 to the other and by recesses 124. The light shield 125 can provide a light seal to the packaged straw 109 when the recesses 124 stop in the direction along the straw, and in the lateral direction it can provide a light seal to the packaged straw 109 and / or the package 107.

[0042] The lighting unit 121 and how it is used and operated in conjunction with some embodiments herein and according to some embodiments herein will be described next.

[0043] Figure 3A -C schematically illustrates how the lighting unit 121 can be moved to a position and, when in that position, illuminates the first portion 131 of the straw 109 of the package.

[0044] Figure 3A-B schematically illustrates how the lighting unit 121 can be moved and positioned to receive the packaged straw 109, and the scenario when it has received the straw 109. Assuming the packaged straw 109 is placed on a horizontal surface, the lighting unit 121 can be moved from above towards the horizontal surface until the first portion of the straw 101 is received in the recess 124. The recess 124 can be formed, and the lighting unit 121 is moved such that when the light shield 125 contacts the package 107 on the side of the straw 101, towards the horizontal surface, the straw portion of the packaged straw 109 has been received and suitably positioned in the recess 124. As a result, the light source 123 can then be positioned at a predetermined and suitable distance from the sidewall 102 of the straw 125 to efficiently illuminate the first portion 131 of the straw 121 with light 127. Illumination is advantageously provided only when the straw 101 is positioned in the recess and the light sources 123a-b and the light shield 125 are in the desired positions. The illumination can also be synchronized with the imaging of the second part 133 of the straw 101, so that illumination is provided only during imaging. This means that the illumination can be provided for a very short time and can be turned off for a longer time, for example, when the illumination unit 121 moves from one straw to another. In this way, heat generation can be easily kept low and kept at a level that does not cause problems with the handling of the straws and packaging.

[0045] During illumination, the distance between the light source 123a-b, particularly its light-emitting surface, and the sidewall 102 can be on the order of (a) millimeters or less. Since it is advantageous to place the light source(s) close to the sidewall 102 to increase illumination on and within the straw 101, the light source(s) should preferably not be placed further than a distance corresponding to the diameter or radius of the straw, but being as close as possible is preferred. The light-emitting surface may be in physical contact with the outer surface of the sidewall 102 or the packaging 107 (if present) to increase light transmitted into the straw, but avoiding this to reduce the risk of damage to the straw or packaging may still be preferred.

[0046] As shown in the figure, light sources 123a-b are arranged in the recess 124, and the light-emitting surfaces of the light sources face the sidewalls 102 of the straw 101 at two or more different angles, thereby increasing surface illumination on and within the straw 101. In this example, the light-emitting surfaces are located on two opposite sides of the straw 101.

[0047] In some embodiments, instead there is a single light-emitting surface, for example, formed by one or more LEDs, and may be flat and arranged directly above and / or parallel to a horizontal surface on which the straw 109 of the package may rest.

[0048] In some embodiments having two light-emitting surfaces at two different angles and located on opposite sides of the straw, there is also a third light-emitting surface arranged at another angle between the two surfaces, such as a horizontal surface directly above the straw 109 of the package and / or parallel to the straw 109 of the package on which it can rest.

[0049] An alternative to multiple flat light-emitting surfaces could be one or more curved light-emitting surfaces formed to cover and conform to the outer contour of the straw sidewall 102. Such LEDs could be provided, but using standard LEDs with flat light-emitting surfaces as shown in the example may be more cost-effective. Each light source (e.g., each of light sources 123a-b) could be a single LED with a very large light-emitting surface and / or an unconventional form factor, but this would likely require special manufacturing. Alternatively, using multiple conventional LEDs arranged side-by-side with parallel light-emitting surfaces forming a common light-emitting surface could be advantageous.

[0050] The type of light used for illumination can be visible or near-visible. Generally, any such light will work, but depending on the material and surface characteristics of the specific straw and / or packaging, some types of light may be more effective than others. Of course, the sensitivity of the image sensor used should also be considered to ensure it is sufficiently sensitive to the light applied. Technicians can determine, through routine experimentation and testing, which type of light and image sensor is best suited for a particular straw and packaging.

[0051] A portion of the lighting unit 121 can be configured to contact the straw 101 or its packaging 107 during illumination. In the illustrated example, and advantageously, this portion is a light shield 125. This portion (e.g., light shield 125) can advantageously be a soft material that is easily compressed under pressure and then returns to its original form, such as a sponge or foam material, and / or should not have any hard and / or sharp edges that would pose a risk of damaging contact with the straw 101 or packaging 107 (if present). This is solely to avoid the risk of physical contact that could potentially damage the straw 101 and packaging 107 (if present). Such a material can also make the light shield 125 more efficient by improving the light-sealing effect on the straw 101 and / or packaging 107. The reasons for physical contact with the packaging 107 and / or straw 101 during illumination may be one or more of the following: to improve the light-blocking effect, to facilitate more light entering the straw 101, to ensure the desired (e.g., predetermined) position of (one or more) light sources 123a-b and / or light shield 125 relative to the straw 101 and / or packaging 107, to move toward and / or press the packaging toward and / or against the straw 101 to facilitate the transmission of light through the packaging 107 into the straw 101.

[0052] Figure 3CA top view of the straw 109 in the package is shown when the lighting unit 121 is in the position of illuminating the first position 131 of the straw 101 in the package 107 (i.e., the straw 109 of the package). The light entering the straw 101 at the position where the light source 123a-b of the lighting unit 121 covers the first portion 131 (i.e., the portion of light transmitted through the package 107 and the side wall 102 of the straw 101) is then guided inside the straw 101 and along the straw.

[0053] When illumination is provided and light is guided inside straw 101, an image is captured of another second portion 133 of straw 101, which is the part of straw 101 to be inspected. The image can be provided by means of a camera having an image sensor with a field of view that at least covers the second portion 133, for example, such that an image corresponding to the imaged area 135 indicated as shown is provided, here covering the curved portion of straw 101. The provided imaged area 135 and image should therefore image at least the second portion 133.

[0054] Note that the first part can of course be located in the same position as... Figure 3C The first position 131 shown is a different location and / or a larger portion of the total length of the straw, or it could be a smaller portion. A larger portion means that more light can be transmitted into the straw, but it also means that while providing illumination, this larger portion is excluded from the second part and inspection. The second part can, of course, be another portion of the straw 101 different from the second part 133 shown in the figure. To inspect the entire straw, the embodiments described herein can be applied continuously to the same straw but with different first and second positions, i.e., changing between applications.

[0055] Figure 4 An imaging system 101 for inspecting straws and packaged straws (such as straw 101 and packaged straw 109) is schematically illustrated based on the foregoing and some embodiments thereof. A camera 141 having an image sensor 143 is arranged to have a field of view 145, so that it can provide a digital image of a second portion (such as second portion 133) of the straw or packaged straw, while its first portion (such as first portion 131) is illuminated as described above, i.e., such that some light enters the straw through the sidewall and is reflected inside the straw and along the straw. More specifically, the digital image may correspond to the imaged area 135 and may be generated by exposure of the image sensor 143 when the illumination unit 121, as shown, illuminates the first portion of the straw 109b through the package and sidewall so that light enters the interior of the straw 109b.

[0056] Imaging system 161 can be configured to work on a horizontal surface 162 with straws and / or packaged straws, for example, a conveyor belt or similar that can transport straws and / or packaged straws 109a-c, for example, in connection with their manufacture. Straws can pass through illumination unit 121 and camera 141 one at a time, whereby illumination unit 121 can, for example, illuminate a first portion of straw 109b by moving to an illuminated position relative to straw 109b. Camera 141 can image a second portion of straw 109b as described above during illumination. Illumination and imaging can be provided very quickly. Illumination unit 121, and possibly camera 141, can move with each straw for a short period of time, while, for example, without stopping if there is a continuous flow of straws passing by. Another possibility is to temporarily and briefly stop the flow of straws when the illumination unit moves into position and / or when the illumination unit provides illumination and performs imaging, and for example until the illumination unit 121 has moved away to wait for the next straw to be illuminated, etc.

[0057] One or more images captured on each of the second portions of straws 109a-c may be expected to be transmitted outside of camera 141, for example, for further processing, including, for example, image analysis, such as transmission to computing device 147, which may be a computer or the like. Such further processing may be performed additionally or alternatively by a computing unit or device (not shown) that is separate from (i.e., separate from image processor 131, but included in or integrated with camera 141) or a unit that includes camera 141.

[0058] The appropriate driving and / or control circuitry system and its power supply for light source 123 are not included. Figure 2A As shown in -B. This can be a conventional type of light source(s) used and fully or partially integrated with the lighting unit 121, such as with light sources 123a-b and / or light shield 125, or it can be provided at least partially by a separate unit connected to the lighting unit 121 via one or more cables. For example, as Figure 4 The external unit 151 is shown. The external unit 151 may be connected to the computing device 147, or in some embodiments, it may be a single unit or device. The computing device 147 may, for example, control both the camera and the lighting unit 121 via the external unit 151, or the external unit 151 may control both the lighting unit 121 and the computing device 147, or a third unit or device (not shown) may be present, for example, to provide control over both the camera 141 and the lighting unit 121.

[0059] The light source (e.g., light source 123a-b) can be configured and controlled to be either "on" or "off", wherein "on" is used to provide said illumination on the sidewall (i.e., outer surface) of the straw.

[0060] Figure 5A -B is a normal image of the second portion 233 of straw 201 and an image of the same second portion provided based on the embodiments herein when straw 201 is inside the packaging. Figure 5A A second portion of the straw 201 with a sidewall 202 is shown more specifically, the sidewall 202 having a defect, here a hole 204 in the sidewall. The second portion 233 covers the curved or bent portion of the straw 201, and the hole 204 is located therein.

[0061] Figure 5B A digital image 241 of the same second portion 233 is shown when straw 201 is inside the packaging; that is, the image is of the packaged straw 209, and this image is provided based on the embodiments herein. Specifically, illumination has been provided through the packaging and the sidewalls of the first portion (not shown) of straw 201, such that some light has entered the interior of the straw and is guided therein to the second portion 233 by internal reflection within straw 210, as described above. In the example shown, some of the guided light leaks fairly uniformly through the sidewalls of straw 209 and packaging, as seen in image 241, and this is why both the packaging and straw are visible in the image. At the location of hole 204, localized spots 243 can be seen, resulting in increased light intensity due to inconsistent light escaping from straw 201 through hole 204. Therefore, localized spots 242 indicate the presence of hole 204, and thus indicate damage to straw 201. More generally, the light pattern captured by such a digital image can be analyzed to examine the second portion of straw 209. The light pattern corresponds to the light escaping from the internally reflected light emitted from the straw via the sidewall of the straw 201 at the second part 233 (i.e., the part corresponding to the second part 133 used in the example above).

[0062] When analyzing the light pattern in an image (such as digital image 241) to detect damage (if any) in the straw, this analysis can be about detecting local spots (e.g., local spot 243) of image data differences in the digital image. Thus, the image data differences correspond to the capture of differential light escaping from the straw via the damage, thereby allowing the damage to be detected.

[0063] Therefore, the differential light emission is caused by damage (e.g., an aperture, such as aperture 204). The difference should therefore be understood as relative to the expected and normally normal condition without any damage. For example, damage could be a break or near-break on the surface of the straw, which could correspond to or be close to creating an aperture in the straw, causing more light to escape from it than in the normal condition without damage, which can be detected by changes in intensity (e.g., an increase in local intensity, such as in the case of local spot 243).

[0064] In some embodiments not shown in the figures, the light pattern to be analyzed is generated by light escaping via a structure normally present in the straw (e.g., a joint or seam formed by the straw). In these embodiments, the analysis can be an evaluation of the structure and the straw (e.g., a part of quality control), such as determining the strength or quality of the joint. The amount of light escaping (e.g., corresponding to an increase in normal light intensity and / or anomalous light changes in the digital image at one or more locations of the structure) can serve as an indicator of the strength and / or quality of the structure (e.g., the joint), and therefore the straw. Alternatively or additionally, this analysis can be used to ensure that packaged straws have a light pattern sufficiently similar to a preferred light pattern, which corresponds to straws and / or packaged straws of sufficient quality, thereby preventing the use of any packaged straws that do not meet this requirement (e.g., during manufacturing).

[0065] Figure 6 This is a flowchart used to schematically illustrate an embodiment of the method based on the above and according to the embodiments herein. The following describes the action of this method as an inspection of a straw (e.g., straw 101 or 201). Straw 101 is used as an example below.

[0066] Below and Figure 6 The methods and / or actions indicated herein may be performed by one or more devices (i.e., one or more devices, for example, those wholly or partially correspond to the imaging system 161, such as computing device 147 and / or camera 141 and / or illumination unit 121 and / or external unit 151, and / or one or more other suitable devices). The devices (one or more) used to perform the methods and actions thereof are further described below.

[0067] Note that the following actions may be performed in any suitable order and / or, where possible and appropriate, may be performed in a manner that fully or partially overlaps in time.

[0068] Action 601

[0069] A first portion (e.g., first portion 131) of straw 101 is illuminated by one or more light sources (e.g., light sources 123a-b). This causes at least some of the light (e.g., light 127) illuminating the first portion 131 to be transmitted through the sidewalls of the straw (e.g., sidewalls 102 or 202) and guided therein by internal reflection. That is, guided inside the straw and along the straw.

[0070] In some embodiments, the one or more light sources have one or more light-emitting surfaces at least during the illumination of the first portion, the light-emitting surfaces being positioned at a predetermined distance from the straw to specifically achieve the illumination of the first portion. In embodiments where the straw is a packaged straw (e.g., packaged straw 109 or 209), the illumination is on and through the package, with the first portion located below the package.

[0071] In some embodiments, the one or more light sources have light-emitting surfaces for physically covering the sidewall of the straw where the first portion of the straw is located, at least during the illumination, i.e., covering the outer surface of the sidewall of the straw where light enters.

[0072] Action 602

[0073] By means of a camera (e.g., camera 141) having an image sensor (e.g., image sensor 143) configured to sense light provided by the light source, one or more digital images (such as digital image 241) are provided that image another second part (e.g., second part 133 or 233) of the straw during the illumination (i.e., the illumination in action 601).

[0074] Therefore, the second part should correspond to or include the part or portion of the straw to be inspected (i.e., the place where inspection is expected and / or should be performed). As already indicated, the second part, or at least the part or portion used for inspection, should be outside the first part (e.g., 131, where illumination into the straw is provided in action 601), i.e., not overlapping with it. Typically, they should be located in different and non-overlapping longitudinal positions, i.e., at different points along the straw. In principle, the second part can be the rest of the straw other than the first part, and vice versa.

[0075] In the case of oval or circular straws, as in the example shown herein, there is only one circumferential sidewall, and the first and second parts are on the same sidewall, i.e., different portions of the same sidewall. However, in the unusual but possible case of straws with more than one sidewall, the first and second parts can be on different sidewalls of the straw. In any case, the first and second parts can be located on different lateral sides of the straw, and of course, they can alternatively or additionally be located on the same lateral side. One or both of the first and second parts can cover all lateral sides, i.e., can be circumferential, but this is generally not necessary and / or may not always be practically possible or desirable.

[0076] Within the limits of practical possibility and need, the first section providing illumination should cover as much of the straw as possible, excluding the second section. In principle, the more sidewalls the first section covers, the more illumination enters the straw.

[0077] In cases where the light transmitted into the straw and directed to the second part is insufficient, the first part can be extended and / or moved to other locations along the straw to improve the situation. Alternatively or additionally, to attempt to improve the situation, the light intensity can be increased and / or the type of light used for illumination can be changed.

[0078] In some embodiments, one or more additional portions (e.g., a third portion) are introduced that have the same function as the first portion in illuminating the straw. Such one or more separate portions may be for practical reasons and / or because the second portion “hinders” the extension of the first portion.

[0079] For example, refer to Figure 3C For example, the lighting unit 121 can be moved, for example, closer to the second portion 133, and / or extended longitudinally, thereby also extending the first portion 131 along the straw 101, for example, until the second portion 133. Additionally and / or alternatively, another lighting unit and a third portion having the same function as the lighting unit 121 and the first portion 131 can be introduced, but instead located along the drinking end of the straw 101, i.e., after the curved portion of the straw 101, such that the second portion 133 is located between the first portion 131 and the third portion.

[0080] Action 603

[0081] Analyze the light patterns captured by the one or more digital images, which correspond to the light escape of internally reflected light emitted from the second portion of the straw 101 via the sidewall (e.g., sidewall 101) of the straw 101.

[0082] In some embodiments, the inspection is a damage inspection and the light escaping is via damage in the sidewall of the straw (e.g., hole 204). In some of these embodiments, the analysis includes detecting the damage in the straw as local spots (e.g., local spot 243) of image data differences in at least one of the digital images. Local spots can therefore correspond to and / or be caused by damage. Image data differences correspond to capturing differential light escaping from the straw via the damage, as discussed above.

[0083] In embodiments where the straw is a packaged straw (e.g., packaged straw 109 or 209), the light of interest should therefore be emitted at a location in the image corresponding to the position of the straw.

[0084] In some embodiments, a light shield (e.g., light shield 125) is applied to prevent light from the light source from directly illuminating the second portion at least during the imaging of the second portion. This light shield or another light shield may additionally prevent or reduce illumination from the light source from directly illuminating the image sensor (e.g., image sensor 143).

[0085] In some embodiments, a light shield (e.g., light shield 125) is applied to reduce reflected light from the first portion illuminating the second portion at least during the imaging process of the second portion.

[0086] It should be noted that the light shields in these embodiments may be the same as those in the above embodiments to prevent direct illumination of the second part, but may additionally or alternatively be completely or partially separate and / or different light shields.

[0087] In some embodiments, the light source and the light shield are positioned between the camera and the straw, but the camera can still image at least the second part while the first part can be blocked by the light shield.

[0088] In some embodiments, the straw is inside the packaging (e.g., packaging 107), and is therefore a packaged straw (such as packaged straw 109 or 209). In these embodiments, at least some of the light (e.g., light 127) is transmitted through both the packaging and the sidewalls of the straw into the straw. Additionally, in these embodiments, the imaging is an image of the packaged straw and the light pattern corresponds to the light emission visible through the packaging. The light emission visible through the packaging should originate from a location where the straw is located below the packaging. The straw may be visible in the image, but the packaging or its position relative to some reference in the image is known or predetermined.

[0089] As used herein, the packaging is intended to contain and / or protect the straw before it is used for drinking, such as during transport, and / or to attach the straw to a dispenser used with it. The straw should be completely or partially removed from the packaging before use.

[0090] In some embodiments, the one or more light sources are integrated with a light-emitting unit (e.g., light-emitting unit 121) in a light-emitting unit. In some of these embodiments, the light-emitting unit is positioned in physical contact with the packaging at least during the first phase of illumination, such that the packaging is pressed against the sidewall of the straw and the one or more light sources are positioned at a predetermined distance from the straw below the packaging. This allows more light to be transmitted into the straw.

[0091] In some of these embodiments, the one or more light sources are arranged in a recess (e.g., recess 124) formed by a light shield for at least partially receiving a straw that is covered by and located below the packaging. The one or more light sources may be arranged in the recess with their light-emitting surfaces facing the sidewalls of the straw. The light-emitting surfaces of the light sources may advantageously face the sidewalls of the straw at two or more different angles, thereby increasing surface illumination on and within the straw. The light-emitting surfaces at different angles may be located on opposite sides of the straw.

[0092] The first part may be a portion of the insertion end portion of the straw used to insert into the dispenser (e.g., insertion end portion 103). The second part may be a portion of or corresponding to the curved and / or bent drinking end portion of the straw (e.g., curved drinking end portion 105).

[0093] Figure 7 This is a schematic block diagram illustrating an embodiment of one or more devices 700 (i.e., (one or more) devices 700), which can be compared with the embodiments already mentioned above for performing this document (such as those for performing the above-mentioned embodiments). Figure 6 The described method and / or action corresponds to one or more devices. One or more devices may, for example, correspond wholly or partially to the imaging system 161 (such as computing device 147 and / or camera 141 and / or illumination unit 121 and / or external unit 151, and / or one or more other suitable devices).

[0094] The schematic block diagram is used to illustrate how device 700 can be configured to perform the above-mentioned tasks. Figure 6 Examples of methods and actions discussed. Thus, one or more devices 700 are used to inspect straws (e.g., straw 101 or 201).

[0095] One or more devices 700 may include corresponding processing modules 701, such as processing components, one or more hardware modules, including, for example, one or more processing circuits, circuit systems (such as processors), and / or one or more software modules for performing the methods and / or actions.

[0096] One or more devices 700 may also include a corresponding memory 702, which may include, for example, a corresponding computer program 703. The computer program 703 includes “instructions” or “code” that are executed directly or indirectly by one or more devices 700 to perform the methods and / or actions. The memory 702 may include one or more memory cells and may also be arranged to store data (such as configurations, data, and / or values) relating to or used to perform the functions and actions of the embodiments herein.

[0097] Furthermore, device(s) 700 may include a corresponding processing circuitry system 704 involved in processing and, for example, encoding data, as one or more exemplary hardware modules, and may include or correspond to one or more processors or processing circuits. Processing module(s) 701 may include, for example, "implemented in the form of processing circuitry system 704" or "implemented by processing circuitry system 704". In these embodiments, memory 702 may include a computer program 703 executable by processing circuitry system 704, thereby enabling device(s) 700 to operate or be configured to perform the methods and / or their actions.

[0098] Typically, one or more devices 700 (e.g., one or more processing modules 701) include corresponding one or more input / output (I / O) modules 705, configured to participate, for example, by performing any communication with other units and / or devices (such as sending and / or receiving information from other devices). One or more I / O modules 705 can be exemplified by acquiring (e.g., receiving) one or more modules and / or providing (e.g., sending) one or more modules as applicable.

[0099] Additionally, in some embodiments, device 700 (e.g., one or more processing modules 701) includes one or more of illumination modules, one or more providing and / or imaging modules, and one or more analysis modules, as example hardware and / or one or more software modules for performing the actions of the embodiments herein. These modules may be implemented wholly or partially by processing circuitry system 704.

[0100] therefore:

[0101] One or more devices 700, and / or one or more processing modules 701, and / or processing circuitry 704, and / or one or more I / O modules 705, and / or one or more lighting modules may be operable or configured to illuminate the first portion of the straw by means of the one or more light sources, such that at least some of the light illuminating the first portion is transmitted through the sidewall of the straw into the straw and guided therein by internal reflection.

[0102] One or more devices 700, and / or one or more processing modules 701, and / or processing circuitry 704, and / or one or more providing and / or imaging modules operable or configured to provide one or more digital images of the other second portion of the straw during the illumination by means of the camera having an image sensor configured to sense light provided by the light source.

[0103] Additionally, one or more devices 700, and / or one or more processing modules 701, and / or processing circuitry 704, and / or one or more analysis modules are operable or configured to analyze the light patterns captured by the one or more digital images.

[0104] Figure 8 The diagram illustrates some embodiments related to a computer program and its carrier, enabling one or more of the devices 700 discussed above to perform the methods and actions.

[0105] The corresponding computer program may be corresponding computer program 703 and includes instructions that, when executed by processing circuitry system 704 and / or processing module 701, cause device 700 to execute as described above. In some embodiments, a carrier, or more specifically, a data carrier, such as a computer program product including the computer program, is provided. The carrier may be one of electronic signals, optical signals, radio signals, and computer-readable storage media, such as computer-readable storage media 801 schematically shown in the figures. Computer program 703 may therefore be stored on computer-readable storage media 801. The carrier may not include transient, propagating signals, and the data carrier may be correspondingly named a non-transient data carrier. Non-limiting examples of data carriers as computer-readable storage media are memory cards or memory sticks, disk storage media, or mass storage devices that may be based on hard disk drives (one or more) or solid-state drives (SSDs). Computer-readable storage media 801 may be used to store data accessible via computer network 802 (e.g., the Internet or a local area network (LAN)). Computer program 703 may also be provided as one or more pure computer programs or included in one or more files. One or more files may be stored on computer-readable storage medium 801 and may be obtained, for example, by downloading via a server, such as through a computer network 802 as shown. The server may be, for example, a web or file transfer protocol (FTP) server. For example, the one or more files may be executable files for direct or indirect download to and execution on the device(s) to perform as described above, for example, by the processed circuitry system 704. The one or more files may also be used, or alternatively, for intermediate download and compilation involving the same or another processor(s) to make them executable prior to further download and execution, thereby enabling the device(s) 700 to perform as described above.

[0106] It should be noted that any of the aforementioned processing modules(s) and circuits(s) can be implemented as software and / or hardware modules, for example, in existing hardware and / or as application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), etc. It should also be noted that any of the aforementioned hardware modules(s) and / or circuits(s) can be included, for example, in a single ASIC or FPGA, or distributed across several separate hardware components, whether individually packaged or assembled into a system-on-a-chip (SoC).

[0107] Those skilled in the art will also recognize that the modules and circuit systems discussed herein may refer to hardware modules, software modules, combinations of analog and digital circuits, and / or one or more processors configured with software and / or firmware (e.g., stored in memory), which, when executed by one or more processors, can configure (one or more) devices, (one or more) sensors, etc., to and / or perform the methods and actions described above.

[0108] The identification used in this document through any identifier can be implicit or explicit. Identifiers can be unique in a particular context, such as for a particular computer program or program provider.

[0109] As used herein, the term "memory" can refer to data storage devices used to store digital information, typically hard disks, magnetic storage devices, media, portable computer floppy disks or hard drives, flash memory, random access memory (RAM), etc. Additionally, memory can be the processor's internal register memory.

[0110] It should also be noted that any enumerated terms (such as first device, second device, first surface, second surface, etc.) should be considered non-restrictive in themselves, and such terms do not imply any hierarchical relationship. Rather, in the absence of any explicit information, enumerated naming should be considered merely a way of implementing different names.

[0111] As used herein, the expression “configured to” can mean that the processing circuitry is configured or adapted to perform one or more of the actions described herein by means of software or hardware configuration.

[0112] As used herein, the term "numerical value" or "value" can refer to any kind of number, such as binary, real, imaginary, or rational numbers. Furthermore, a "numerical value" or "value" can be one or more characters, such as letters or a string of letters. Additionally, a "numerical value" or "value" can be represented by a bit string.

[0113] As used herein, the expressions “may” and “in some embodiments” are generally used to indicate that the described features can be combined with any other embodiments disclosed herein.

[0114] In the accompanying drawings, features that may only exist in some embodiments are typically, but not necessarily, drawn using dotted or dashed lines.

[0115] When using the words “include” or “contain”, they should be interpreted as non-restrictive, meaning “consisting of at least…”.

[0116] The embodiments described herein are not limited to those described above. Various alternatives, modifications, and equivalents may be used. Therefore, the above embodiments should not be considered as limiting the scope of this disclosure as defined by the appended claims.

Claims

1. A method for inspecting a straw (101), wherein the straw (101) is within a package (107), and is therefore a packaged straw, and wherein the method comprises: - The first part (131) of the straw (101) is illuminated by one or more light sources (123), such that at least some of the light (127) on the first part (131) is transmitted through both the packaging (107) and the sidewall (102) of the straw (101) into the straw (101) and is guided therein by internal reflection; -One or more digital images (241) of another second portion (133) of the packaged straw are provided (602) by means of a camera (141) having an image sensor (143) configured to sense light provided by the light source (123); and -Analyze (603) the light pattern captured by the one or more digital images (241), the light pattern corresponding to the light escape of internally reflected light emitted from the second part (133) of the straw (101) via the sidewall (102) of the straw (101) as visible through the packaging (107). A light shield (125) is applied to prevent light from the light source (123) from directly illuminating the second part (133) at least during the imaging process of the second part (133); and The one or more light sources (123) are integrated with a light shield (125) in a light emitting unit (121), and the light emitting unit (121) is positioned to physically contact the packaging (107) at least during the illumination of the first part (131), such that the packaging is pressed against the sidewall (102) of the straw (101), and the one or more light sources (123) are positioned at a predetermined close distance from the straw (101) below.

2. The method of claim 1, wherein the inspection is a damage inspection and the light emission is performed via damage (204) in the sidewall (102) of the straw (101).

3. The method of claim 2, wherein the analysis comprises detecting the damage (204) in the straw (101) as a local blot (243) of image data difference in at least one digital image of the digital image (241), the image data difference corresponding to capturing differential light escaping from the straw (101) via the damage (204).

4. The method according to any one of claims 1-3, wherein the one or more light sources (123) have one or more light-emitting surfaces at a predetermined distance from the straw (101) at least during the illumination of the first part (131) for specifically completing the illumination of the first part (131).

5. The method of any one of claims 1-3, wherein the one or more light sources (123) have a light-emitting surface for physically covering the sidewall (102) of the straw (101) where the first portion (131) of the straw (101) is located, at least during the illumination.

6. The method of claim 1, wherein the one or more light sources (123) are arranged in a recess (124) formed by a light shield (125) for at least partially receiving a straw (101) covered by and located below the package (107), and wherein the one or more light sources (123) are arranged in the recess (124) and the light emitting surface of the light source (123) faces the sidewall (102) of the straw (101).

7. The method of claim 6, wherein the light-emitting surface of the light source (123) faces the sidewall (102) of the straw (101) at two or more different angles, thereby increasing surface illumination on and inside the straw (101).

8. A computer program comprising instructions that, when executed by one or more processors (704), cause one or more devices (700) to perform the method according to any one of claims 1-7.

9. A carrier comprising a computer program (703) according to claim 8, wherein the carrier is one of an electrical signal, an optical signal, a radio signal, or a computer-readable storage medium (801).

10. A straw (101) is used as a light guide for inspecting the sidewall (102) of the straw (101) based on light leakage of guided light emitted from the straw (101) via the sidewall (102), wherein the inspection is performed according to the method of claim 1.

11. One or more devices (700) for inspecting a straw (101), wherein the straw (101) is within a package (107), and is therefore a packaged straw, and wherein said one or more devices are configured to: The first part (131) of the straw (101) is illuminated by one or more light sources (123), such that at least some of the light (127) on the first part (131) is transmitted through both the packaging (107) and the sidewall (102) of the straw (101) into the straw (101) and is guided therein by internal reflection; One or more digital images (241) of another second portion (133) of the packaged straw are provided (602) by means of a camera (141) having an image sensor (143) configured to sense light from the light source (123); and Analysis (603) of the light pattern captured by the one or more digital images (241) corresponds to the light emission of internally reflected light emitted from the second portion (133) of the straw (101) via the sidewall (102) of the straw (101), which is visible through the packaging (107). in, A light shield (125) is applied to prevent light from the light source (123) from directly illuminating the second part (133) at least during the imaging process of the second part (133); and The one or more light sources (123) are integrated with a light shield (125) in a light emitting unit (121), and the light emitting unit (121) is positioned to physically contact the packaging (107) at least during the illumination of the first part (131), such that the packaging is pressed against the sidewall (102) of the straw (101), and the one or more light sources (123) are positioned at a predetermined close distance from the straw (101) below.

Images