Product containers including digital marking for recyclable items

Abstract

A plastic article, such as a beverage bottle, can carry two separate digital watermarks encoded using two separate signal protocols. A first, printed label watermark, carries a retail payload containing a Global Trade Item Number (GTIN) used by a point-of-sale system at a retail store to identify and price the item when presented for checkout. A second, plastic texture watermark may carry a recycling payload containing data identifying the plastic's composition. The use of two different signal protocols ensures that a point-of-sale system does not expend its limited time and available computing resources decoding a recycling watermark that may lack the data necessary for retail checkout. In some embodiments, a recycling device utilizes both types of watermarks to identify the item's plastic composition (e.g., using a relational database to associate the GTIN with the plastic type), thereby increasing the percentage of items that are accurately identified for sorting and recycling. In other embodiments, a plastic article (or a label affixed to a plastic article) carries only a single watermark. Numerous other features and configurations are further detailed.

Description

Related Application Data

[0001]

[0001] In the United States, this application is a partial continuation application of Patent Application No. 16 / 435,292 filed on June 7, 2019 (published as US Patent Application Publication No. 20190306385), and further claims priority to US Provisional Patent Application No. 62 / 818,051 filed on March 13, 2019, US Provisional Patent Application No. 62 / 830,318 filed on April 5, 2019, US Provisional Patent Application No. 62 / 836,326 filed on April 19, 2019, US Provisional Patent Application No. 62 / 845,230 filed on May 8, 2019, US Provisional Patent Application No. 62 / 854,754 filed on May 30, 2019, No. 62 / 923,274 filed on October 18, 2019, US Provisional Patent Application No. 62 / 956,493 filed on January 2, 2020, US Provisional Patent Application No. 62 / 967,557 filed on January 29, 2020, and US Provisional Patent Application No. 62 / 968,106 filed on January 30, 2020. Background

[0002]

[0002] There is an urgent need to increase the proportion of plastic articles that are reused or recycled.

[0003]

[0003] U.S. Patent Application Publication No. 20040156529, which is a document of the applicant, teaches that the plastic surface of a 3D (three-dimensional) object can be textured by thermoplastic molding to form a machine-readable electronic watermark that holds a multi-bit payload.

[0004]

[0004] U.S. Patent Application Publication No. 20040086151, which is a document of the applicant, teaches how a 3D object with an electronic watermark can be made using injection molding (e.g., using vacuum molding or pressure molding).

[0005]

[0005] U.S. Patent Application Publication No. 20020099943, which is a document of the applicant, teaches that an object can hold two watermarks, one formed in the topology of the object surface and the other formed by printing.

[0006]

[0006] The applicant’s document, U.S. Patent Application Publication No. 20150016712, teaches that a 3D object can be identified using watermark or image fingerprint data, and that this identification data can be linked to the object’s recycling information. For example, the identification data can be linked to a recycling code indicating whether the object is made of polyethylene terephthalate, high-density polyethylene, polyvinyl chloride, etc.

[0007]

[0007] The applicant's U.S. Patent Application Publication No. 20150302543 similarly teaches that a watermark payload formed on a plastic object can hold or link to the object's recycling code. Furthermore, U.S. Patent Application Publication No. 20150302543 teaches that a camera-equipped waste sorting device can sort incoming material streams based on decoded watermark data. U.S. Patent Application Publication No. 20180345323 by FiliGrade BV also discloses sensing recycling information from watermarked plastic bottles and separating waste streams based on the decoded information.

[0008]

[0008] This research by the applicant improves upon the above-described technology and provides many further features and advantages. Introduction

[0009]

[0009] In one embodiment, the technology involves defining a data pattern comprising binary elements spaced apart at positions in a regular 2D (two-dimensional) position grid. The pattern defines a first fixed reference signal and a first variable data signal. The first reference signal facilitates the geometric alignment and extraction of the first variable data signal by a decoder presented with a camera-captured image showing a physical counterpart of the data pattern. The configuration further includes forming a three-dimensional surface topology pattern of a mold according to a smoothed counterpart of the data pattern. The topology pattern includes peaks or depressions having a smooth cross-section to facilitate the release of a molded part from the mold.

[0010]

[0010] In a particular embodiment, the 2D position grid defines M candidate positions where the binary elements can be located. The binary elements are arranged at 25%, 20%, 10% or less of those M candidate positions.

[0011]

[0011] In a further particular embodiment, the 2D position grid consists of an N×N grid of positions, each position having the grayscale or floating-point value of the first reference signal corresponding to that position. The first variable data signal includes an M×M array of positions, where M < N, and each position in the M×M array of positions has the two-tone value of the variable data signal corresponding to that position. The M×M first variable data signal values are interpolated to generate an N×N array of interpolated values. By doing so, the first variable data signal is converted from a two-tone form to a grayscale or floating-point form. At each of the N×N positions, the corresponding values of the first reference signal and the interpolated first variable data signal are summed at a weighted ratio to generate an N×N sum array of values. A thresholding operation is applied to the N×N sum array of values to identify the values, and then the positions are marked by binary elements in the N×N grid corresponding to those extreme values.

[0012]

[0012] In another particular embodiment, the 2D position grid defines M positions, each of the M positions having a corresponding value of the first reference signal. Each value represents the relative darkness of the reference signal at that position. The first variable data signal includes binary symbols, each of which is associated with a corresponding position in the regular 2D position grid. To generate a data pattern, the values ​​of the first data signal are sorted to generate a ranking of the N darkest positions. Within this ranking of the N darkest positions, P darkest positions are identified (the Q other positions remain unchanged). Each of the P positions is marked by a binary element. Depending on whether the corresponding binary symbol of the variable data signal has a first or second value, each of the remaining Q positions is marked or not (by a binary element).

[0013]

[0013] A mold can be made using the above-described configuration and can be used to mold a plastic container. In such a container, the molded plastic holds a first variable data signal which may be read by a suitable decoder, such as in a waste recycling facility.

[0014]

[0014] In some configurations, such a plastic container further has a label. The label may include a printed pattern that defines a second fixed reference signal and a second variable data signal. The second reference signal facilitates the geometric alignment and extraction of the second variable data signal by a decoder presented with a camera capture image showing the printed pattern. Typically, the second fixed reference signal is different from the first fixed reference signal, and / or the second variable data signal is different from the first variable data signal.

[0015]

[0015] A recycling system for processing two different such plastic containers can process one based on a plastic texture pattern and the other based on a printed label pattern. That is, a computer which is the processor of such a recycling system can use a first alignment signal (of the textured plastic pattern) to geometrically align the first container with the first variable data signal, extract the first variable data signal, and sort the first container for recycling based on the extracted first variable data signal. Furthermore, a second alignment signal (of the printed label pattern) can be used to geometrically align the second container with the second variable data signal, extract the second variable data signal, and sort the second container for recycling based on the extracted second variable data signal.

[0016]

[0016] In a further embodiment, the plastic container is molded to hold information. More specifically, the container is molded to hold a texture pattern of elements spaced apart at positions in a regular 2D position grid. The pattern defines a first fixed reference signal and a first variable data signal. The first reference signal facilitates the geometric alignment and extraction of the first variable data signal by a camera-captured image of the container by a presented decoder. In such a container, the 2D position grid defines M candidate positions where the elements may be located. The elements are positioned at 25%, 20%, 10%, or less of those M candidate positions.

[0017]

[0017] Typically, the remaining 75%, 80%, 90%, or more of the M candidate positions follow the nominal contour of the plastic container, for example, remaining smooth and simply following the cylindrical shape of the bottle. That is, at the boundaries of the texture pattern, the majority of the surface area of ​​the container remains unchanged.

[0018]

[0018] In another embodiment, the plastic container holds both a plastic texture pattern and a printed label pattern. The plastic texture pattern includes elements spaced apart at positions in a regular 2D position grid. This plastic pattern defines a first fixed reference signal and a first variable data signal. The first reference signal facilitates the geometric alignment and extraction of the first variable data signal by a decoder presented with a camera-captured image of the container. Similarly, the printed label pattern includes elements spaced apart at positions in a regular 2D position grid. In this case as well, the printed label pattern defines a second fixed reference signal and a second variable data signal. The second reference signal facilitates the geometric alignment and extraction of the second variable data signal by a decoder presented with a camera-captured image of the container. In such a configuration, the second fixed reference signal is different from the first fixed reference signal, and / or the second variable data signal is different from the first variable data signal.

[0019]

[0019] In one particular configuration, the second fixed reference signal is different from the first fixed reference signal. In another particular configuration, the second variable data signal is different from the first variable data signal.

[0020]

[0020] In yet another embodiment, the plastic container holds a texture pattern comprising elements spaced apart at positions within a regular 2D position grid. The pattern defines a first fixed reference signal and a first variable data signal. The first reference signal facilitates the geometric alignment and extraction of the first variable data signal by a decoder presented with a camera-captured image of the container. In this configuration, the 2D position grid defines M candidate positions where the elements may be located. The elements are actually placed in 20%, 20%, 10%, or less of those M candidate positions. In this case as well, for the majority of the M candidate positions, the container follows a nominal contour, as described above.

[0021]

[0021] Further embodiments relate to a method for marking a container to hold a plurality of symbol payloads. The method includes the step of generating a data pattern that encodes the payloads. The pattern includes elements spaced apart at positions in a regular 2D position grid. The pattern defines a fixed reference signal and a variable data signal. The reference signal facilitates the geometric alignment and extraction of the variable data signal by a decoder presented with a camera-captured image showing a physical counterpart to the data pattern.

[0022]

[0022] The method further includes the step of forming a physical counterpart of the pattern on the container by printing or texturing. In such a configuration, the 2D position grid defines M positions, each of which is associated with a corresponding value of the reference signal. Each value represents the relative darkness of the reference signal at that position. The variable data signal includes binary symbols, each of which is associated with a corresponding position in the regular 2D position grid.

[0023]

[0023] More specifically, the step of generating the data pattern begins by sorting the values ​​of the reference signal to generate a ranking of the N darkest positions. Within this ranking of the N darkest positions, P darkest positions are then identified (the Q other positions remain unchanged). Each of these P positions is marked by a binary element. Depending on whether the corresponding binary symbol of the variable data signal has a first value or a second value, the remaining Q positions are marked or left unmarked by a binary element.

[0024]

[0024] A further embodiment of the present technology includes a recycling system comprising an optical reader and plastic bottles. The plastic bottles have labels. The labels are imprinted with a first digital pattern encoding a first identifier in ink. The plastic is textured with a second digital pattern encoding a second different identifier. In this case, the recycling system can separate the bottles by plastic type by decoding any of the identifiers by the optical reader.

[0025]

[0025] Yet another aspect of the present technology relates to a recycling system, in this case also comprising an optical reader and a plastic bottle. The bottle is at least partially packaged in a sleeve. The sleeve is pre-printed with ink-based markings, i.e., while in a planar form. The printed sleeve is then wrapped around the bottle and heat-shrinked to make it tightly adhere to the bottle. The ink-based markings on the packaging sleeve are still readable by the optical reader, even if they include machine-readable codes that are geometrically distorted by the heat-shrinkage, and control the sorting of the plastic bottles for recycling.

[0026]

[0026] Yet another aspect of this technology is point-of-sale information management, which may be used for checkout at retail stores. (POS, Point of Sale) Regarding the system. POS The system comprises an optical reader and a plastic bottle. The plastic bottle has a printed label on which a first digital pattern encoding a first identifier is applied with ink, and the plastic is textured with a second digital pattern encoding a second identifier. The optical reader is configured to decode the first identifier but not the second identifier.

[0027]

[0027] A further aspect of the present technology relates to a bottle made of a plastic container that serves as the base for an ink-printed label. The ink-printed label includes a machine-readable code that allows for sorting by the type of plastic of the base plastic container.

[0028]

[0028] The above configuration and other configurations will be described in detail in the following detailed description proceeding with reference to the accompanying drawings.

Brief Description of the Drawings

[0029] [Figure 1A-G] FIGS. 1A to 1Q are diagrams showing several different shapes in which a plastic surface can be shaped to hold digital watermark data. [Figure 1H-L] FIGS. 1A to 1Q are diagrams showing several different shapes in which a plastic surface can be shaped to hold digital watermark data. [Figure 1M-Q] FIGS. 1A to 1Q are diagrams showing several different shapes in which a plastic surface can be shaped to hold digital watermark data. [Figure 2A] FIG. 2A is a diagram showing a shape in which a plastic surface can be shaped to hold ternary digital watermark data. [Figure 2B] FIG. 2B is a diagram showing another shape in which a plastic surface can be shaped to hold multi-value or continuous tone digital watermark data. [Figure 3A] FIGS. 3A, 3B, 3C and 3D are diagrams showing Voronoi, Delaunay, traveling salesman, brick patterns. [Figure 3B] FIGS. 3A, 3B, 3C and 3D are diagrams showing Voronoi, Delaunay, traveling salesman, brick patterns. [Figure 3C] FIGS. 3A, 3B, 3C and 3D are diagrams showing Voronoi, Delaunay, traveling salesman, brick patterns. [Figure 3D] FIGS. 3A, 3B, 3C and 3D are diagrams showing Voronoi, Delaunay, traveling salesman, brick patterns. [Figure 4] FIG. 4 is a diagram showing peaks that define a reference signal for printed digital watermarking in the spatial frequency (Fourier amplitude) domain. [Figure 4A] Note: In the original text, there is a repeated sentence in IDs 11, 14, and 17. In the translation, the repeated sentence is translated only once for each ID for simplicity. Also, for the term "電子透かし", it is translated as "digital watermark" which is a common translation in the context of patent texts related to this technology.Figure 4A is an enlarged view of Figure 4, showing radial lines passing through different peaks. [Figure 5A] Figures 5A to 5C show various reference signals that can be used with plastic texture watermarks, which have been adjusted to avoid interference with the watermark reference signal in Figure 4. [Figure 5B] Figures 5A to 5C show various reference signals that can be used with plastic texture watermarks, which have been adjusted to avoid interference with the watermark reference signal in Figure 4. [Figure 5C] Figures 5A to 5C show various reference signals that can be used with plastic texture watermarks, which have been adjusted to avoid interference with the watermark reference signal in Figure 4. [Figure 6A] Figures 6A to 6C show the corresponding signals in the spatial domain (pixel domain) of each of the reference signals in Figures 5A to 5C. [Figure 6B] Figures 6A to 6C show the corresponding signals in the spatial domain (pixel domain) of each of the reference signals in Figures 5A to 5C. [Figure 6C] Figures 6A to 6C show the corresponding signals in the spatial domain (pixel domain) of each of the reference signals in Figures 5A to 5C. [Figure 7] Figure 7 shows a block of a snake-shaped watermark pattern that can be molded into a mold for a plastic bottle. [Figure 8] Figures 8, 9, 10, and 11 illustrate different systems for capturing images of items on a conveyor belt in a recycling device. [Figure 9] Figures 8, 9, 10, and 11 illustrate different systems for capturing images of items on a conveyor belt in a recycling device. [Figure 10] Figures 8, 9, 10, and 11 illustrate different systems for capturing images of items on a conveyor belt in a recycling device. [Figure 11] Figures 8, 9, 10, and 11 illustrate different systems for capturing images of items on a conveyor belt in a recycling device. [Figure 12] Figure 12 shows a configuration that generates various types of lighting to achieve contrast enhancement. [Figure 13] Figure 13 is a diagram illustrating in detail a specific part of the process performed by the example recycling device. [Figure 14] Figure 14 is a diagram that provides further details about the recycling apparatus illustrated in Figure 13. [Figure 15] Figure 15 shows blocks arranged to overlap across an image frame used in a particular embodiment of this technology. [Figure 16] Figure 16 shows a high-density cluster of neighboring blocks that are analyzed in each block when a watermark signal is detected in a block, in a specific embodiment of this technology. [Figure 17] Figure 17 shows the high-density cluster of Figure 16 in the context of the image frame of Figure 15, located where one of the blocks was found to contain the reference signal. [Figure 18] Figure 18 shows high-density clusters of neighboring blocks that are analyzed when a glare region is detected in an image frame, in a specific embodiment of this technology. [Figure 19] Figure 19 shows a subblock histogram used in one method of triggering block analysis. [Figure 20] Figure 20 is a diagram that helps illustrate another way to trigger block analysis. [Figure 21A] Figure 21A shows a block arrangement along the entry side of an image frame and a high-density cluster of neighboring blocks located where one of the entry blocks detects a watermark reference signal, which may occur in a particular embodiment of the present technology. [Figure 21B] Figure 21B shows a frame captured shortly after the frame in Figure 21A, where the cluster of analysis blocks is moving downwards in accordance with the movement of the conveyor. [Figure 21C]Figure 21C shows a frame captured shortly after the frame in Figure 21B, illustrating the detection of a watermark reference signal that generates a second cluster of blocks. [Figure 21D] Figure 21D shows a frame captured shortly after the frame in Figure 21C, and shows two clusters of analysis blocks moving further down the frame in accordance with the movement of the conveyor. [Figure 22] Figure 22 shows the combinations of waxel data within a frame. [Figure 23] Figure 23 shows another example of a combination of waxel data within a frame. [Figure 24] Figure 24 shows a camera / lighting configuration that uses light transmission to the camera via a plastic object. [Figure 25] Figure 25 shows a partially assembled lighting module. [Figure 26A] Figures 26A and 26B show alternative configurations that can be implemented using diffuse light illumination. [Figure 26B] Figures 26A and 26B show alternative configurations that can be implemented using diffuse light illumination. [Figure 27] Figure 27 is a schematic diagram showing a configuration using multiple cameras. [Figure 28] Figure 28 schematically shows a configuration in which the camera has a divided field of view, which is partially occupied by specular reflection of the subject. [Figure 29] Figure 29 schematically shows a configuration in which the first and second light sources are arranged and operate alternately to optimize the specular and diffuse light reflected from the object. [Figure 30] Figure 30 shows three overlapping 32x32 waxel patches in the image, all representing a single waxel. [Figure 31] Figure 31 shows how the center of gravity of an object (in this case, a transparent beverage bottle) is determined by the position of the block where the watermark reference signal is detected. [Figure 32A]Figures 32A and 32B show a recycling system that includes a sorting diverter in which sorting bins are designated. [Figure 32B] Figures 32A and 32B show a recycling system that includes a sorting diverter in which sorting bins are designated. [Figure 33A] Figures 33A to 33D show various camera and light source configurations. [Figure 33B] Figures 33A to 33D show various camera and light source configurations. [Figure 33C] Figures 33A to 33D show various camera and light source configurations. [Figure 33D] Figures 33A to 33D show various camera and light source configurations. [Figure 34] Figure 34 shows watermark detection corresponding to different LED channels. [Figure 35] Figure 35 shows watermark detection corresponding to different LED channels. [Figure 36A] Figures 36A and 36B show the determination of sorting box values. [Figure 36B] Figures 36A and 36B show the determination of sorting box values. [Figure 37] Figure 37 shows an example of an ecosystem in which the recycling system shown in Figures 32A and 32B exists. Detailed explanation

[0030]

[0030] For example, there is a growing need for highly reliable identification of plastic items in order to sort waste streams.

[0031]

[0031] Since digital watermarks can be applied to materials of various types and shapes, they are beneficial for the above-mentioned purposes. Furthermore, the watermark can be spread over the container and / or its label to improve readability even if the object is damaged, soiled, or partially blocked.

[0032]

[0032] In order to identify the type of material in each object and separate the waste stream accordingly, the watermark provides a 2D optical code signal that enables machine vision in the waste sorting system. As described later, the coded signals applied to the containers by 3D printed molds, laser processed molds, and etched molds can be used to sort the containers in various recycling environments.

[0033]

[0033] According to one aspect of the present technology, a plastic article is encoded using two different watermarks. One watermark is printed on a label attached to the article, usually with ink (or printed on the article itself), and the other watermark is formed by 3D texture processing of the plastic surface.

[0034]

[0034] Printed watermarks are generally, originally, POS scanner Designed for use by retailers, for example, at checkout in a retail store, watermarks hold a retail payload containing or indicating product name, price, weight, expiration date, packaging date, etc., to identify an item and verify its price. Texture watermarks are generally effective for recycling and contain or indicate a payload containing data related to plastics, for example. Each watermark typically lacks some or all of the information held by the other watermark.

[0035]

[0035] In most embodiments, it is important that the two watermarks described above (retail watermark and recycling watermark) use different signaling protocols. The applicant states that a typical retail store POS scanner However, it was found that the time interval for reading the retail watermark before the next frame of the image arrived for analysis was very short. If the retail watermark and the recycle watermark are shown in the same image frame, they must be distinguishable quickly, otherwise POS scanner However, it may not be possible to successfully decrypt the retail watermark before the next image frame arrives. Part of this specification describes how the two watermarks described above can be quickly distinguished. POS scannerThis teaches how to avoid wasting precious milliseconds attempting to decrypt the recycling watermark, thereby helping to ensure reliable retail checkout operations.

[0036]

[0036] A basic method for quickly distinguishing between retail watermarks and recycling watermarks is the use of different signaling protocols (including, for example, different reference signals, different encoding protocols, and / or different output formats). Such differences POS scanner While retail watermarks can be recognized with high reliability, recycling systems can recognize recycling watermarks with high reliability. POS scanner There is no risk of confusion arising from an attempt to mistakenly decrypt the payload from the recycled watermark.

[0037]

[0037] Despite differences in watermarking signal protocols, it is also desirable that the recycling system be configured to have a watermarking processing module configured to read retail watermarks (and recycling watermarks) and to recognize information from the retail watermark that can be used for plastic recycling purposes (generally by referring to a database that associates retail watermark payload data with plastic information). This way, regardless of which watermark is read from the item by the recycling system, the system obtains information to control the proper sorting of items by plastic type.

[0038]

[0038] As described above, the signal protocols of the two watermarks may differ in several ways, for example, including the reference signal and / or the encoding algorithm used. The reference signal of each watermark (which may be called a calibration signal, synchronization signal, grid signal, or alignment signal) serves as a synchronization component that enables accurate extraction of the payload by making the geometric orientation of the watermark, as shown in the captured image, recognizable. An exemplary reference signal is a set of multiple peaks in the spatial frequency domain. The first of the two watermarks may include a first reference signal that the second watermark lacks. (The latter watermark may include a different reference signal that includes, for example, peaks of different frequencies, peaks of different phases, and / or a different number of peaks).

[0039]

[0039] The encoding algorithm may differ in the process by which the data is encoded and / or in the format in which the encoded data is represented. For example, the encoding algorithm for printed watermarks may use a signal protocol in which the resulting watermark format is a rectangular block holding data structured as a 128 × 128 array of element arrangements, with sides of 0.85 inches and a waxel resolution of 150 per inch. In contrast, the signal protocol used by the texture watermark encoding algorithm may produce a rectangular block holding data of a different size (typically less than 0.85 inches on each side), with a different waxel resolution than 150 per inch, and / or configured in a way other than a 128 × 128 array. The two different signal protocols used in the two watermarks may have different payload capacities, for example, one having a variable message portion capable of holding 48 bits and the other having a variable message portion capable of holding exactly half or one-third of its payload capacity.

[0040]

[0040] The two encoding algorithms described above may differ, additionally or alternatively, from the error correction encoding method used (if used), the redundancy rate employed, the number of bits in the signature sequence output by the error correction encoder, the CRC method used (if used), the scrambling key used to scramble the signature sequence output from the error correction encoder to generate the scrambled signature sequence, the spreading key used to generate a number of randomized “chips” from each bit of the scrambled signature sequence, and the scattering table data that defines the spatial arrangement of each of those “chips” in the output watermark pattern. The decoding algorithm may differ accordingly.

[0041]

[0041] One watermark reader (for example, retail POS The inability of a watermark reader to read other types of watermarks (e.g., recycled watermarks) may be due to any of the aforementioned differences between watermarks, such as their geometric reference signals, output formats, signal protocols, encoding / decoding algorithms, etc.

[0042]

[0042] Each watermark payload typically includes fixed and variable message portions. The fixed portion typically includes data that identifies the signaling protocol used. The variable message portion typically includes multiple fields. For printed retail watermarks, one field typically holds a Global Trade Item Number (GTIN), and another field may hold an Applicable Business Identifier Code (e.g., indicating weight, expiration date, etc.) as defined by GS1. Although such Applicable Business Identifier Codes are not currently part of the GS1 standard, plastic identification information may be held in printed retail watermarks in the form of such Applicable Business Identifier Codes.

[0043]

[0043] Some recycling systems use two watermark readers, where the first reader is configured to apply a first watermark reading algorithm (for example, to read retail watermarks using a first signaling protocol), and the second reader is configured to apply a different second reading algorithm (for reading recycling watermarks using a second signaling protocol). Each of these readers cannot read the other type of watermark. Other recycling systems use a single reader configured to read both types of watermarks. Yet another system uses a hybrid configuration where certain components are shared (for example, to perform a general FFT operation), and other components are dedicated to either one type of watermark or the other.

[0044]

[0044] In order to ensure highly reliable reading of the watermark regardless of the position of the article in the waste stream, it is preferable that the watermark be visible from the perspective of multiple articles. For example, a recycled texture watermark is preferably formed on several surfaces, including the front and back of each article. Similarly, a retail printed watermark is preferably on the label of each article, for example, both the front and back. , opposite each other Opposite ki It is desirable that it be formed on the side that does not produce the desired result.

[0045]

[0045] In order to apply the watermark reading operation most effectively, certain embodiments of the Art inspect image pixel blocks for cues that suggest the presence of watermark data. Further watermark analysis is performed only on image blocks in which such cues are found. Many of these cues are detailed and include detecting glare spots (areas of pixels, each with a value above a threshold), detecting a set of spatial image frequencies corresponding to a watermark reference signal, a classifier output indicating that a pixel block may represent a plastic article, a classifier output indicating that a pixel block may not represent a conveyor belt, determining that pixels from most of the subblocks of the block have an average value within 1, 2, 3, or 4 digital histogram peaks based on the previous image, detecting signals associated with conveyor belt markings, detecting salt and pepper markings, and various other techniques for distinguishing promising image blocks from others. Once promising image patches are identified, they are typically analyzed to confirm the presence of both retail and recycling watermarks.

[0046]

[0046] In some embodiments, if one image block is found to be promising, that decision also triggers the inspection of several neighboring image blocks. The incoming image frame may first be divided into blocks at a first density (e.g., with a first pixel spacing or overlap). If a promising block is found, other blocks located further away from the promising block, for example with smaller pixel spacing, or that overlap more significantly, are inspected at a higher density. In connection therewith, if a promising block is found in one frame, watermark data in subsequent frames corresponding to the predicted movement of the article shown in the promising block can be obtained and analyzed based on the conveyor speed and frame capture speed.

[0047]

[0047] Due to image analysis to identify both types of watermarks, two instances of the same object (e.g., two identical 12-ounce Pepsi bottles) may be separated based on two different watermark readings. That is, the plastic type of the first bottle may be identified by its printed watermark, and the plastic type of the second bottle may be identified by its textured watermark. Regardless of the different watermark readings, both may be sent to the same recycling destination. Specific configuration

[0048]

[0048] The digital watermark information is read from image data indicating plastic objects in the waste stream. This information can indicate the type of plastic (e.g., polyethylene terephthalate, high-density polyethylene, low-density polyethylene, polypropylene, polycarbonate, etc.) or hold other information useful for recycling. Diverters and other mechanisms of the automated sorting system are controlled according to such watermark information to send the plastic objects to the appropriate sorting destination for recycling or reuse.

[0049]

[0049] Digital watermarks (hereinafter referred to as watermarks) are printed on the packaging of many products and generally serve to encode the Global Trade Item Number or GTIN (which closely resembles the widely used 1D (one-dimensional) UPC barcode) in a visually inconspicuous manner. POS scanner This allows for the detection and decryption of watermark data, which can then be used to identify and price products, and add them to the shopper's receipt. Watermark data is typically organized as rectangular blocks redundantly tiled with their edges touching across some or all of the printing on the product. Because watermark data is spatially distributed, POS scanner It can read data from different views of the product (for example, from front and back views of a beverage bottle).

[0050]

[0050] Most commonly, watermark data is hidden as a slight change in the brightness and / or chrominance of pixels that include the artwork on the package. In some cases, the watermark may take the form of an inconspicuous pattern of dots, which may spread across adhesive labels attached to, for example, plastic fresh food containers.

[0051]

[0051] In order to reduce costs, POS scanner It typically uses a simple processor. POS scanner Generally, the majority of its operation is primarily focused on 1D barcode detection and decoding, with watermark reading being a supplementary function. It captures 30 frames per second. POS scanner It has only 33 milliseconds to process each frame, and uses most of that time for barcode reading. Only a few milliseconds are available for watermark reading.

[0052]

[0052] Watermark reading has two parts: watermark detection and decoding of the watermark.

[0053]

[0053] In the exemplary embodiment, watermark detection (sometimes referred to as watermark detection) involves analyzing frames of the captured image to locate a known reference signal. This reference signal may be a set of peak characteristics in the 2D Fourier amplitude domain (known as the spatial frequency domain). In the spatial (pixel) domain, such a reference signal takes the form of a collection of 2D sine waves summed up at different spatial frequencies across the watermark block. Figure 5A is a diagram showing an exemplary reference signal in the Fourier amplitude domain, and Figure 6A is a diagram showing such the same reference signal in the spatial domain. To ensure continuity along the edges of the watermark block, the frequencies are preferably integer values. When an object with such a known reference signal is shown in the captured image, its particular representation clearly indicates the scaling, rotation, and translation of the watermark payload data similarly present in the image.

[0054]

[0054] This watermark payload data is encoded by watermark elements ("waxels") that occupy a position in a 2D array, typically consisting of 128 × 128 elements. Depending on whether the watermark is formed with a resolution of 150 or 75 waxels per inch (WPI), this array may extend to an area of, for example, 0.85 or 1.7 inches on each side. Such blocks, along with a reference signal, are tiled in a repeating array across the packaging.

[0055]

[0055] Once the scaling, rotation, and translation of the watermark are known from the analysis of the reference signal as shown in the captured image, the watermark payload can be decoded. The decoder samples the captured image at positions corresponding to the initially encoded 128×128 array of data and uses those sample values ​​when decoding the original watermark payload. (For example, convolution coding is commonly used because a 48-bit payload is converted into a string of 1024 data, which is then redundantly distributed to 16,384 positions in a 128×128 element watermark block).

[0056]

[0056] The above and other details of the watermarking technique, including details from the patent documents described herein, are well known to those skilled in the art.

[0057]

[0057] In a particular embodiment of the present technology, the plastic container has two watermarks, one of which is formed by label printing, and the second watermark is formed by texture treatment of the plastic surface, such as by molding. (This label may include a base layer that is printed and affixed to the container, or it may include printing applied directly to the container.)

[0058]

[0058] Plastics can be molded by a variety of methods, including blow molding, injection molding, rotational molding, compression molding, and thermoforming. In each of these processes, heated plastic resin is molded according to a mold. By molding the surface of the mold with a pattern, an interlocking pattern is formed on the surface of the resulting plastic product. When the pattern of the mold is adjusted to have the shape of a watermark pattern (having a change in brightness / chrominance which is translated into a change in the height, depth, angle, reflectance, or local curvature of the mold), the resulting plastic product may have a surface texture corresponding to its watermark. Such patterns on the plastic surface can be perceived by optical methods, which are detailed below.

[0059]

[0059] Figures 1A to 1Q are diagrams of typical surface textures.

[0060]

[0060] Most of the textures shown are illustrated as 2D cross-sectional views of 3D surfaces, showing modulation in only one dimension. For clarity, the textures are shown on flat surfaces. Naturally, most plastic containers are curved in at least one dimension.

[0061]

[0061] For clarity, most of the figures in Figures 1A to 1Q show marks having only binary values. Specific examples include the “sparse” dot mark, detailed in the patent applications U.S. Patent Publication Nos. 20170024840, 20190139176, and International Publication No. 2019 / 165364. Other binary marks include line drawing patterns such as Voronoi, Delaunay, Traveling Salesman, and Brick, detailed in the published applications International Publication No. 2019 / 113471 and U.S. Patent Publication No. 20190378235, and shown in Figures 3A, 3B, 3C, and 3D, respectively. (The Voronoi pattern is realized by forming a mesh of glints (triangles in this case) with vertices at positions corresponding to a sparse array of dots. The Delaunay pattern is the dual of the Voronoi pattern, where the glints have the shape of polygons with a different number of sides. The traveling salesman pattern is realized by defining a traveling salesman's route that visits each dot in a sparse array of dots. The brick pattern is realized by placing vertical line segments at the dot positions in an array of sparse dots to form horizontal lines at intermediate positions, thereby defining rectangular glints.)

[0062]

[0062] Figure 1A is shown to represent the binary states of each waxel. "1" is represented here by a relatively protruding portion, and "0" is represented by the nominal reference height of the plastic surface (which may appear relatively recessed compared to the illustrated "1" state). The nominal height of the plastic surface is indicated by a dashed line.

[0063]

[0063] Figure 1B is similar to Figure 1A, but the sharp corners have been rounded (for example by low-pass filtering) to help release the molded plastic from the mold. Such rounding can be used in any embodiment to flatten the sharp angles.

[0064]

[0064] Figure 1C shows an embodiment in which the transition between states has a slope, in which consecutive "1" values ​​include a slight return to the nominal surface level on the opposite side. Figure 1D is a variation of Figure 1C. Making the transition sloped can further aid in demolding and in assist with optical detection depending on the illumination.

[0065]

[0065] In some embodiments, the raised protrusions in Figures 1B, 1C, and 1D can each have only a small flat portion at the peak, or be rounded protrusions with no flat portion at all.

[0066]

[0066] Figure 1E shows that the "1" state can be characterized by a plane that is not parallel to the nominal plane that characterizes the "0" state. Figure 1F is a variation of Figure 1E showing that the "1" state does not need to be high and can simply be inclined.

[0067]

[0067] Figure 1G shows a configuration in which the "1" state and the "0" state are each tilted in different directions relative to the nominal surface of the plastic. (The tilt directions may be 180 degrees apart as shown, or may differ by only 90 degrees). Such tilts cause light to be reflected preferentially in different directions, making the marks more visible to the watermark reader.

[0068]

[0068] Although Figures 1A to 1G have been described and illustrated as including portions that are nominally raised above the surface, it will be recognized that such encoding can also (perhaps more generally) include portions that are nominally recessed below the surface. (Watermark encoding / reading is usually independent of the polarity of up or down). One example is in the formation of lines used in the patterns in Figures 3A to 3D and Figure 7. Combinations of raised and recessed portions are also, of course, usable.

[0069]

[0069] Figure 1H shows a beneficial dispersion phenomenon associated with curved surfaces. In most camera and light source configurations relative to a curved surface, incident light (indicated by large arrows) is reflected from the surface at various angles (indicated by small arrows), some of which is reflected back towards the camera, creating a bright glint. In contrast, for a flat surface, almost all of the incident illumination is reflected in a single direction, often away from the camera. As a result, flat surfaces typically appear dark to the camera, while curved surfaces are typically characterized by a bright glint. (If, by chance, the flat surface reflects back towards the camera, an "inversion" occurs, making the flat surface brighter than the curved surface).

[0070]

[0070] Figure 1I shows the dispersion and focusing phenomena associated with a surface having both convex and concave portions. The convex portions act as described above, dispersing incident light over a wide angular range. In contrast, the curved concave portions act as focusing elements. Compared to the dispersion caused by the convex portions, the focusing caused by the concave portions reflects a large amount of light in the overall direction of the light source. Assuming the camera is relatively close to the light source (e.g., within 10 degrees from the illuminated surface), the concave portions appear brighter than the convex portions in the image captured by the camera. (The dashed lines indicate nominal plastic surfaces).

[0071]

[0071] (It will be understood in this specification and other parts thereof that the light source and camera can be positioned in ways other than those shown in the figures. The light source and camera can be positioned in close proximity, for example, within one-digit angles), or further apart. The light can illuminate the surface directly downwards (90° incidence), or at an angle of incidence of 80°, 60°, 30°, or less.)

[0072]

[0072] The configuration in Figure 1I can be extended to three surface features: convex, concave, and flat, as shown in Figure 1J. The flat surface reflects light as described in relation to Figure 1H. Thus, the configuration in Figure 1J is an example of a surface that can be used for tri-level signal coding, reflecting various amounts of light: intermediate amounts (i.e., glint caused by the convex parts), large amounts of light (i.e., focused reflection caused by the concave parts), and extreme values ​​(usually dark but can also be bright, caused by the flat parts).

[0073]

[0073] Figure 1J further illustrates another aspect of surface molding that can be used in any embodiment, where the protrusions do not need to be dimensionally similar to the depressions. In this example, the raised protrusions are greater than the depth of the depressions. In connection with this, the raised protrusions have a smaller radius of curvature than the recessed depressions. The reverse is also possible.

[0074]

[0074] Figure 1K shows that modulating the surface height can have little to no effect on the reflected light pattern, even if it does have some effect. Often, what is important is the surface height transition That is, the function that defines the surface height Differential coefficient That is the case.

[0075]

[0075] In Figure 1K, light incident at point B on the plastic surface is reflected with the same direction and brightness as light incident at point D. The two surfaces are parallel but at different heights. In contrast, light incident at point A is reflected with a different brightness and direction than light incident at point C. At point A, the derivative of the surface is negative (the height decreases as you move to the right). At point C, the derivative of the surface is positive. Assuming the camera is positioned close to the light source, almost no incident light is reflected back towards the camera from point A, while almost all of the incident light is reflected back towards the camera from point C. The recess with a flat bottom shown in the cross-sectional view of Figure 1K therefore has three reflection zones: one zone along the flat bottom, one zone with a negative derivative, and one zone with a positive derivative. When the light source is positioned as shown (with the camera also positioned nearby), the glint of reflection is detected by the camera from the latter zone, and there is no reflection from the first two zones.

[0076]

[0076] As shown in Figure 1L, a similar phenomenon occurs from a raised convex portion with a flat top. The leftmost part of the convex portion has a positive derivative and reflects glints of light back to the camera. The flat top does not reflect light back to the camera, nor does the rightmost part of the convex portion reflect light (due to its negative reflectivity).

[0077]

[0077] (It will be understood that the results described above depend on the light source being located on the left side of the molded surface. If the light source is located on the right side, some of the results will be reversed.)

[0078]

[0078] Naturally, the curved shape can be adjusted to optimize performance, for example, to allow reflection in a specific direction relative to the incident light source.

[0079]

[0079] Generally speaking, in contrast to basic shapes with straight edges, convex parts and dots with a circular planar appearance are preferable because they tend to reflect light more in all directions.

[0080]

[0080] Notwithstanding the foregoing, another beneficial approach to surface texture treatment is to use back-reflecting features, such as recesses in the shape of a 3D corner reflector, on plastics. A 3D corner reflector has the property that light is reflected back to its light source over a wide range of incident angles. Figure 1M shows this property in two dimensions, and the property is further extended to three dimensions.

[0081]

[0081] Corner-shaped recesses can be formed on plastic surfaces where the watermark should appear bright (e.g., state "1"), and not formed in locations where the watermark should appear dark (e.g., state "0"). The deepest "points" of the recesses can be rounded, and importantly, most of the surface area is perpendicular to each other.

[0082]

[0082] Figure 1N shows a portion of a rectangular 128 x 128 waxel perforated block, showing 16 waxels. Some are recessed by the back-reflecting 3D corner reflectors according to the encoded data (e.g., representing the "1" signal), while others remain flat (e.g., representing the "0" signal). Figure 10 shows a portion using triangular waxels, which are organized into a hexagonal array. In this case as well, some are recessed by the back-reflecting 3D corner reflectors according to the encoded data, while others are not recessed.

[0083]

[0083] In a modified embodiment, the two states of the signal tile are not represented by corner reflectors or planes. Instead, corner reflectors are formed at the location of each waxel. The two states are distinguished by the processing of three orthogonal surfaces (fine faces) that provide recessed reflectors. State "1" is characterized by a smooth surface that reflects light with relatively little scattering. State "0" is characterized by a textured surface (e.g., rough or matte) that reflects light with relatively much scattering. The first type of reflector is manufactured to be efficient, and the second type of reflector is manufactured to be inefficient. Furthermore, to a human observer, the two features are substantially indistinguishable and give the surface a uniformly textured appearance. Figure 1P shows such a configuration (having rough corner reflectors indicated by gray waxels).

[0084]

[0084] If rectangular waxels are formed in plastic at a density of 75 per inch, each waxel will extend to an area with sides of 0.0133 inches. Therefore, the recess of each corner reflector will have a width of less than or equal to this value. As the density of the waxels increases, the dimensions will decrease.

[0085]

[0085] Naturally, in a back reflection configuration, the camera should be positioned as close as possible to the light source, so that the angular distance between the two (as seen from the conveyor) is preferably less than 10 degrees.

[0086]

[0086] Some of the surface texture treatments in the configuration of Figure 1P can be used in other configurations, including other configurations shown. That is, some areas of the plastic surface may be roughened or given a matte finish to increase scattering, while other areas may be left smooth to increase specular reflection. In some embodiments, the plastic surface does not have indentations or protrusions for encoding watermark data. Rather, encoding can be achieved by performing scattering texture treatment on various areas as a whole without interfering with the nominal shape of the article.

[0087]

[0087] Figure 1Q is a 3D view showing a portion of a plane marked with three sparse dots that have the form of depressions on the surface.

[0088]

[0088] Many of the illustrated surfaces can encode two signal states, and some can encode three states, but more generally, M-value encoding is available.

[0089]

[0089] Figure 2A shows another form of ternary coding in which the signal consists of elements -1, 0, and 1. "-1" is represented by a slope in one direction, "1" by a slope in another direction, and "0" by the other two intermediate slopes. Many other such forms can naturally be conceived by including indentations from a nominal plastic surface that reflect the protrusions in Figures 1A to 1F, for example. Quadrary coding can be realized using four different surface slopes at consecutive 90-degree angles. Quadrary coding can be realized by using the four slopes of orthogonal coding, plus a fifth state which is a nominal surface of plastic. Higher-order M-level coding can be realized by expanding the set of slopes.

[0090]

[0090] (As shown in other figures, the surface of Figure 2A can be roughened, for example, by a matte finish or a translucent finish, in order to scatter some of the light in a direction that is not at all reflective.)

[0091]

[0091] In addition to M-value coding, this technique is also suitable for use with so-called "continuous gradation" watermarks, which have various intermediate states between two extreme values. Often, the reference signal has continuous values ​​(or values ​​with a number of quantized steps), and by matching such a reference signal with the M-value payload pattern representation, a continuous gradation watermark is generated. The continuous values ​​of the waxels of such a mark can be represented by the local surface height or degree of slope. Such a mark is conceptually illustrated by Figure 2B.

[0092]

[0092] The patterns described above suggest that the molding extends to both sides of the plastic medium, for example, top and bottom (or inside and outside the bottle). In some cases, the molding is performed on only one side (e.g., the outside), and the other side is smooth.

[0093]

[0093] Plastic texture processing using molded templates is the most common, but other forming approaches are also available. Laser or chemical etching is one example, resulting in a surface marked with indentations corresponding to the amplitude or slope of spatial variations in the watermark signal. (Laser etching is very suitable for serialization where each instance of the article is encoded differently).

[0094]

[0094] In some embodiments, the plastic surface is locally treated to achieve a matte or translucent finish rather than a glossy finish. In such cases, the translucency itself can be formed as a pattern consisting of matte and glossy waxes. The matte texture is achieved by molding or surface treatment to achieve a certain surface roughness, such as vertical variation of 1 / 10 or 1 / 2 micrometer or more.

[0095]

[0095] In the exemplary embodiment, the plastic watermark is POS scanner It will be adjusted to avoid confusion caused by such. scanner It has limited processing capabilities and time for extracting watermark identifiers. POS scanner Several measures can be taken to help prevent the system from attempting to read the plastic watermark, i.e., from wasting valuable processing time, and may also be to prevent the system from decrypting the product GTIN from the product label shown in the same frame.

[0096]

[0096] POS scanner One measure to help avoid confusion is to use a reference signal for plastic watermarks that is unlikely to be mistaken for the reference signal used for printed label watermarks. Such a reference signal is generated by randomly generating multiple candidate signals (for example, by selecting a random set of peak positions in the spatial frequency domain and assigning a random phase to each), POS It is possible to generate such signals experimentally by testing each candidate to evaluate the likelihood that a watermark reader would mistake it for a printed label watermark reference signal. The candidate reference signal with the lowest probability of confusion is then used.

[0097]

[0097] Another approach involves mathematically calculating a theoretical confusion (correlation) amount that shows the similarity between random reference signals of different candidates and the printed label reference signal, and then selecting the candidate with the lowest correlation.

[0098]

[0098] The applicant argues that, as the wise man states, theoretically there is no difference between theory and practice, but in practice there is a difference, and therefore the first approach is preferable.

[0099]

[0099] The process for discovering candidate reference signals for plastic watermarks can be facilitated by imposing different constraints in the signal generation or selection process. One is that it is desirable that the peaks in the plastic reference signal should not be identical to any peaks in the printed label reference signal. Any randomly generated candidate plastic reference signals having such attributes may be discarded.

[0100]

[0100] Figure 4 shows the peak of the printed label watermark reference signal in the 2D Fourier amplitude domain. It is desirable that the plastic watermark reference signal does not have a common peak position.

[0101]

[0101] In relation to this, in the printed label reference signal, each frequency peak lies on a different radial line from the origin. A small number of peaks are shown in an enlarged view of Figure 4A. It is desirable that none of the peaks in the plastic reference signal are located on any of those radial lines. (Depending on the scale on which the watermarked object is viewed, the peaks of the reference signal move concentrically toward the origin, away from the origin, and along those radial lines, and confusion may arise if both reference signals have peaks on the same radial line).

[0102]

[0102] In such a configuration, it is desirable that none of the peaks in the plastic reference signal lie on the vertical axis 31 or the horizontal axis 32 of the spatial frequency plane. Many other features of the captured image may have signal energy focused along their axes, thereby best avoiding peaks along such axes.

[0103]

[0103] The reference signal for printed labels is four-quadrant symmetric and mirrored around the vertical and horizontal frequency axes, and such a configuration may be used for plastic reference signals for reasons of detector efficiency. However, this is not mandatory, and reference signals for plastic watermarks that do not exhibit this attribute may not cause much confusion.

[0104]

[0104] Peaks along the vertical and horizontal axes are best avoided, but it is generally desirable for peaks for a plastic reference signal to be located on radial lines at various angles. In each quadrant of a four-quadrant symmetric reference signal, 1 / 4 to 1 / 3 of the peaks may be located on different radial lines within 30 degrees of the horizontal axis, 1 / 4 to 1 / 3 may be located on different radial lines within 30 degrees of the vertical axis, and 1 / 3 to 1 / 2 may be located on different radial lines between those two ranges.

[0105]

[0105] It is equally desirable that the peaks for the plastic reference signal differ in distance from the origin. Low-frequency points (e.g., less than 20 or 25 periods per block) are undesirable and should be replaced with high frequencies (e.g., more than 50 or 60 periods per block), as zooming in / out may move low-frequency points to positions where the watermark reading software does not look for peaks (resulting in a blank area in the center of Figure 4). However, to ensure a nearly uniform distribution, a spatial budget can be used to allocate peaks in the intermediate donut band (shown as a dashed line in Figure 4), as described in the paragraph above.

[0106]

[0106] POS scanner Another measure to help avoid confusion is to use a reference signal in plastic watermarks that has fewer peaks than the reference signal in printed label watermarks. The fewer the number of peaks, the less likely it is to be mistaken for a peak in a printed label watermark.

[0107]

[0107] The resulting advantage is that, because the available signal energy budget is distributed among features with fewer peaks, each peak in a plastic watermark reference signal can be encoded using more energy. A plastic reference signal consisting of a few strong peaks is less likely to result in confusion than a reference signal consisting of many weak peaks.

[0108]

[0108] A further defense against confusion between printed watermarks and plastic watermarks is to form the marks at different scales. As mentioned above, printed watermarks are generally formed at 75 or 150 waxels per inch (i.e., 1.7 or 0.85 square inch watermark blocks). Plastic watermarks may be formed at different resolutions, such as 200, 250, or 300 waxels per inch (i.e., 0.64, 0.51, and 0.43 square inches). Thus, the obvious edge distortion of the watermark pattern due to curvature decreases as the watermark block size decreases, which helps in detection from curved container surfaces.

[0109]

[0109] One algorithm for generating candidate plastic reference signals is to take a Fourier amplitude plot of the label reference signal, which must be kept clear, and add two circumscribed circles (as shown in Figure 4) that create a ring space in which all points should reside. Then, as in Figure 4A, radial lines extending from the center of the plot through each label reference signal peak are added to the outer circle. Finally, the ring space is divided into triangles using the label reference signal peaks as vertices to create the largest triangle that does not contain any other peaks. Then, the point in the ring that is furthest from the nearest straight line (i.e., radial lines, triangulation lines, and horizontal and vertical axes) is identified and added to a set of candidate points. This is repeated until the desired number of points are identified.

[0110]

[0110] Different random distortions such as tilt, rotation and scaling, as well as additive Gaussian noise, are applied to each candidate plastic reference signal to determine how frequently POSThe watermark reader's reference signal detection stage determines whether it mistakes a strain signal for the label watermark reference signal, allowing different candidate plastic reference signals to be examined for potential confusion with the label reference signal. After each candidate reference signal is tested with hundreds of different strains, typically one candidate signal emerges as superior to the others. (This signal may be examined in the spatial domain by a human reviewer to ensure it does not possess subjectively undesirable attributes, although such review is also optional.)

[0111]

[0111] Several candidate plastic watermark reference signals are shown in Fourier amplitude plots in Figures 5A, 5B, and 5C. Figures 6A, 6B, and 6C show their corresponding spatial domain representations.

[0112]

[0112] Confusion with the printed label watermark reference signal tends to decrease with respect to the "flatness" of the spatial domain representation of the plastic reference signal. Therefore, according to another aspect of the art, each candidate reference signal for plastic watermarking is modified by trying different phase assignments for different peaks in the Fourier amplitude plot in order to identify a set of phase assignments that minimizes the standard deviation of pixels in the spatial domain representation. This is a task well suited to computer automation, where hundreds of thousands or millions of different sets of phase assignments are tried to find a set that produces a spatial domain pattern with the minimum standard deviation.

[0113]

[0113] For example, using the method detailed above, the reference signal patterns in Figures 5A to 5C (and Figures 6A to 6C) were experimentally generated, but when a confusion test with the printed label watermark reference pattern was performed by checking the correlation with the printed label watermark reference pattern, the result was 0.2> r >-0.2(0.1> rA very small correlation with a maximum value of >-0.1 (sometimes >-0.1) r It was discovered.

[0114]

[0114] Two images, both with a size of P×P pixels f 1 and f The correlation of 2 can be expressed as follows:

number

[0115]

[0115] It will be understood that the detailed reference signal consists of sinusoidal curves of equal amplitude. In other embodiments, the sinusoidal curves can have different amplitudes, generating a more prominent "weave" pattern for their spatial domain representation.

[0116]

[0116] As described above, the reference signal is one of the two elements of the watermark signal, the other being the encoded representation of the payload message. This representation can be generated by convolutional encoding of the symbols of the payload message to produce a very long string of symbols (e.g., 1024 bits), which may be called the signature. The signature may be randomized by performing an exclusive OR operation using scramble keys of the same length. Chips redundantly representing each of the scrambled signature bits are randomly distributed spatially at the positions of a rectangular array of, for example, 128 × 128 (16,384) elements to form a signature array.

[0117]

[0117] By scaling the spatial domain reference signal to an average pixel value of 128, a continuous grayscale watermark can be generated by adding or subtracting an offset value to each component pixel value, which depends on whether the chip assigned to that position is 1 or 0.

[0118]

[0118] Sparse watermarks can be generated by various methods that generally involve generating output patterns of spaced-out dots. Several methods are described in detail in the literature mentioned above and will be explained in the following section titled "Examination of Exemplary Watermark Creation Methods".

[0119]

[0119] As described above and illustrated in Figures 3A to 3D, sparse patterns can be converted into various two-tone line-based representations. Another such pattern called a "snake" is shown in Figure 7. A snake is generated from a continuous-tone watermark using the following algorithm, which is performed using Adobe Photoshop® and Illustrator.

[0120]

[0120] In other words, a 300 DPI monochrome (grayscale) block with a white background is filled with 50% gray and encoded with a continuous grayscale watermark (reference signal and payload signal). This image is then adjusted in Photoshop using the Adjustment → Exposure: Default / Exposure: 1.05 / Offset: -0.075 / Gamma Correction: 0.3 control. Next, filtering is applied using the Photoshop control Filter → Blur → Gaussian Blur: Radius: 3 pixels, followed by the Photoshop control Filter → Stylize → Wind: Method = Wind / Direction: Right or Left (either is fine). After that, the image is binarized at a threshold using the Photoshop control Image → Adjustment → Threshold: Threshold Level: 140 (+ / -5). The resulting file is saved and then opened in Adobe Illustrator. The image immediately after editing is selected from within the layer. The "Image Trace" button in the main top frame of the Illustrator user interface is clicked, and after a preview is displayed, the Image Trace Panel next to the Drop Down frame indicating "Default" is clicked. From the top line of icons, the Outline button is clicked. After a preview is displayed, the "Expand" button next to the Drop Down frame indicating "Tracing Result" is clicked. This provides a UI that allows the pattern stroke size to be made thicker or thinner. Some kind of bolding is applied to generate a pattern like the one in Figure 7.

[0121]

[0121] It can be seen that such patterns are distributed throughout the region and consist of multiple curved segments (many of which are complexly curved, i.e., have multiple changes of orientation along their length) in which some segments cross others and others remain independent without crossing others.

[0122]

[0122] To describe a larger system, a recycling apparatus according to one embodiment of the Technology uses one or more cameras and light sources to capture images showing watermarked plastic containers moving along a conveyor in a waste stream. Depending on the embodiment, the conveyor area imaged by the camera system (i.e., its field of view) may be as small as approximately 2 inches x 3 inches, or as large as approximately 20 inches x 30 inches, or even larger, and is basically dependent on the sensor resolution of the camera and the focal length of the lens. In some embodiments, multiple imaging systems are used to capture images collectively arranged in the width direction of the conveyor. (The conveyor may be up to 5 feet or 2 meters wide in a mass feed system. Single feed systems, where items are fed onto the conveyor one at a time, are narrower, for example, 12 inches or 50 cm wide. Conveyor speeds of 1 to 5 meters / second are common.)

[0123]

[0123] Figure 8 shows a simple configuration in which the camera and light source are placed in almost the same location, that is, the illumination is directed from a position less than 10 degrees away from the projection of the camera's visual axis onto the waste stream conveyor (i.e., the camera object). In another configuration, the light source is positioned to illuminate the camera object at an angle, that is, the light source is directed at an angle greater than 50 degrees away from the direction of the camera's lens axis, as shown in Figure 9. In yet another configuration (Figure 10), opposing illumination is used, that is, the axis of the light source is directed at an angle greater than 140 degrees away from the direction of the camera lens. In the latter configuration, surface texture processing can generate local shading on the plastic surface, for example, each plastic protrusion blocks the light, and adjacent areas are imaged with relatively lower brightness than the area where light is incident.

[0124]

[0124] The positions of the cameras and light sources in Figures 8 to 10 may be interchanged. In other embodiments, multiple light sources can be used. Naturally, the exposure interval should be short enough to avoid motion blur. A strobe-emitting light source helps to avoid blur. The light source can be placed close to the conveyor, as close as the size of the article, so that the article can pass underneath it, or it can be placed at a greater distance, for example, two or four feet away.

[0125]

[0125] Figure 11 shows a configuration in which two different colored light sources, namely red and blue, illuminate the camera object from the opposite side of the camera, at an oblique angle (>50 degrees) in this example. The green light source is placed in the same location as the camera. The camera in Figure 11 is an RGB camera and includes a 2DCMOS sensor covered with a Bayer pattern color filter. Its raw output includes red-filtered pixels, green-filtered pixels, and blue-filtered pixels. Three different monochrome (grayscale) images are thus formed by the corresponding pixels from the sensor array, one showing a waste stream of the red portion of the visible light spectrum, one showing a waste stream of the blue portion of the spectrum, and one showing a waste stream of the green portion of the spectrum.

[0126]

[0126] The configuration in Figure 11 shows light sources arranged along the direction of movement of the conveyor (waste stream). In an alternative embodiment, the light sources are positioned across the direction of movement of the conveyor, rather than coinciding with it. In yet another embodiment, a first pair of red / blue light sources are positioned along the direction of movement of the conveyor (as shown), and a second pair is positioned across the direction of movement. These pairs of light sources are activated for alternating frames of image capture by the camera (therefore, for example, frames may be captured at 60 or 150 frames per second). One frame is illuminated by the red / blue light sources aligned along the direction of movement, the next frame is illuminated by the red / blue light sources positioned across, and so on. Each frame is illuminated by a green light source.

[0127]

[0127] Each of the resulting image frames is analyzed to obtain watermark data and examine both printed label watermarks and plastic watermarks. In some embodiments, a fourth image frame is generated by calculating the difference between the red pixel value and the blue pixel value of each Bayer cell. The resulting difference values ​​are divided in half and added to an offset value of 128 to ensure that the elements of the difference image are in the range of 0 to 255. This difference image is also processed to decode any existing printed label watermark or plastic watermark. Such a configuration is shown in Figure 13.

[0128]

[0128] Eight separate watermark reading systems are shown in Figure 13, but some of the image processing may be integrated, and the results may be shared between the label reading watermark system and the plastic reading watermark system. For example, each red frame of the data may undergo a Fast Fourier Transform by a common FFT stage, and the results may be used for both label reading and plastic reading (synchronization). However, if the resolutions of the two watermarks are different (e.g., 150 WPI and 250 WPI), a completely separate processing path may be preferable.

[0129]

[0129] In one particular embodiment, an image is captured using an f / 8 lens with an exposure interval of 20 microseconds. The imaging distance is set so that each captured pixel corresponds to an area of ​​approximately 1 / 150th of an inch in the focusing zone located 3 inches above the conveyor. Thereafter, each pixel corresponds to a single waxel of 150 WPI. The camera gain (or distance from the light source to the conveyor) is adjusted so that a pure white object on the conveyor is depicted with an 8-bit pixel value of 250 when captured.

[0130]

[0130] The effective dynamic range of the imaging system can be expanded by using different illuminance bands. The normal illuminance band can be illuminated as described above, so that white objects achieve a camera pixel value of 250. Adjacent high-illuminance bands can be illuminated at more than twice the illuminance. Doing so will cause bright areas to be overexposed, but dark objects can therefore be resolved with better luminance gradation (i.e., enhanced contrast). For example, the formation of a watermark pattern on a dark printed label, which may appear as a pixel value in the range of 5 to 10 under the former luminance conditions, can appear with an expanded range of 10 to 20 (or 50 to 100) under the latter illumination.

[0131]

[0131] In a particular embodiment, such illumination variation is a design parameter of the lens in a single light source. For example, a linear array of LEDs may have a linear lens that projects a variable brightness pattern with a high-brightness band in the center and normal brightness bands adjacent on either side. As the conveyor moves the articles through the projected light, each point of the article first passes through a normal brightness band, then a high-brightness band, and then another normal brightness band. Depending on the conveyor speed, frame rate, and illumination area, each point of the article may be imaged once, twice, or more times as it passes through each of the above brightness bands.

[0132]

[0132] In another configuration, two or more different light sources can be used to provide similar effects to the high-luminosity light band and the low-luminosity light band.

[0133]

[0133] In yet another configuration shown in Figure 12, a linear light source 120 (shown in the side view) designed to output a nearly uniform brightness across its entire illumination area is tilted relative to the conveyor 122, thereby resulting in different path lengths from the light to different areas of the belt. In such cases, a gradient effect is created due to the attenuation of illumination with distance, with the area of ​​the conveyor closest to the light 124 being illuminated with high brightness, and the area further away 126 being illuminated with gradually decreasing brightness.

[0134]

[0134] In a particular embodiment, the captured image frame covers both brighter and darker illuminated areas of the belt. In a first single frame, the bright areas of the article are overexposed, while the dark areas are given enhanced contrast. In another single frame, the bright areas are properly exposed, while the dark areas are relatively underexposed. Overexposed areas do not have changes in pixel values ​​that can serve as clues for selecting patches for analysis, so the decoder tends to ignore overexposed areas, and therefore such patches are not analyzed. Similarly, the decoder also tends to ignore areas that are too dark, due to the lack of pixel changes. Thus, in a series of frames showing a single article passing through variable illumination, there is a tendency for darker areas from one frame to be analyzed (when brighter illumination is applied), and darker areas from another frame to not be analyzed (when darker illumination is applied). Similarly, there is a tendency for lighter areas from one frame to be analyzed (when darker illumination is applied), and lighter areas from another frame to not be analyzed (when brighter illumination is applied).

[0135]

[0135] In another configuration, a red light source and a white light source are used. The red light source(s) and the white light source(s) can illuminate a common area, or overlapping or adjacent areas. All such illuminated areas may be within the field of view of a common imaging camera.

[0136]

[0136] In other configurations, polarization is used for illumination. Additionally or alternatively, one or more polarizing filters can be used in the image sensor to attenuate orthogonally polarized light.

[0137]

[0137] In many applications, glare, i.e., specular reflection of light from a surface, is an obstacle. In certain embodiments of this technology, in contrast, such specular reflection can be important when transmitting watermark information as a signal. Polarizing filters can be used to enhance signal-holding glare rather than to remove glare with a filter.

[0138]

[0138] Some embodiments of this technology use a novel image sensor having a polarizing filter array. One example is Sony's Polarsens image sensor. The pixel array is covered by a spatially corresponding polarizer array consisting of four polarizers at different angles (90°, 45°, 135°, and 0°). An image frame consisting only of data from the 90° polarizing sensor can be analyzed for watermark data. The same applies to each of the other three polarization states. Furthermore, the difference between, for example, a 90° "image" and a 45° "image" can be calculated, and such a difference image can similarly be analyzed to obtain watermark data.

[0139]

[0139] This Sony sensor is available in various configurations. The IMX250MZR is an example. The IMX250MZR is a monochrome CMOS sensor with 2464 x 2056 pixels. The color CMOS sensor is Sony's IMX250MYR.

[0140]

[0140] Because human vision is particularly sensitive to the green spectrum, digital data is unlikely to be encoded in the green channel if the goal is to make it undetectable. A better option is a camera optimized to detect when digital data uses wavelengths away from green, such as blue and red (and possibly ultraviolet and infrared).

[0141]

[0141] One sensor optimized for watermark detection in visible wavelengths other than green is detailed in the applicant's U.S. Patent No. 10,455,112. One particular embodiment detailed in that patent uses a color filter array in which, rather than a monochrome sensor, there are three magenta-filtered photocells for each green-filtered photocell.

[0142]

[0142] Once plastic articles are identified, they can be moved from the conveyor to a suitable collection point or to a further conveyor by known means such as electromagnetic plungers, stepper motor control arms, and forced air jets. Exemplary separation and sorting mechanisms are known to those skilled in the art from, for example, U.S. Patent Publications No. 5,209,355, 5,485,964, 5,615,778, U.S. Patent Application Publication No. 20040044436, U.S. Patent Application Publication No. 20070158245, U.S. Patent Application Publication No. 20080257793, U.S. Patent Application Publication No. 20090152173, U.S. Patent Application Publication No. 20100282646, U.S. Patent Application Publication No. 20120168354, and U.S. Patent Application Publication No. 20170225199. These mechanisms are referred to here as “sorting diverters,” or simply “diverters,” and their operation is controlled according to the type of plastic identified.

[0143]

[0143] Figure 14 is a diagram that shows some of the relevant data in particular detail.

[0144]

[0144] In the illustrated embodiment, each plastic watermark holds a 32-bit payload. This payload can be divided into various fields. One field identifies the type of plastic by class (e.g., ABS, EPS, HDLPE, HDPE, HIPS, LDPE, PA, PC, PC / ABS, PE, PET, PETG, PLA, PMMA, POM, PP, PPO, PS, PVC, etc.). Another field identifies the subtype of the plastic by its average molecular weight, solution viscosity value, or recommended solvent, or by whether the plastic was used as a food container or a non-food container. A third field identifies the color of the plastic (the color may be optically perceptible; however, plastic consumer packaging increasingly includes a printed shrink sleeve on the container to conceal its color). A fourth field identifies the date the plastic was manufactured, for example, by year and month. A fifth field identifies the country of manufacture. A sixth field identifies the manufacturer. Naturally, more or fewer fields are available. Additional fields include whether the product is packaged food (or non-food), multi-layered (or single-layered), and compostable (or recyclable only). Some fields hold index values ​​or flag (yes / no) values. Where necessary, each index value can be broken down into values ​​(or ranges of values) by referencing a data structure such as character text, a date column, or a table or database.

[0145]

[0145] In the exemplary embodiment, the sorting diverter reacts to the first three fields of data and operates to separate plastics by type, subtype, and color. All of the decoded watermark data is logged to provide statistics about the waste stream being processed.

[0146]

[0146] The printed label payload typically holds a long payload, such as 48 or 96 bits. Its contents may vary depending on the item, but each typically begins with the GTIN, followed by one or more application business identifier key-value pairs (e.g., indicating expiration date, lot code, item weight, etc.). In some configurations, none of the payloads represent the type of plastic used in the item container.

[0147]

[0147] A data structure 121, such as a table or database, can be used to determine the plastic type. The data structure 121 plays the role of associating the GTIN of an article with corresponding information about the plastic used for the article container. That is, this data structure is queried using the GTIN identifier decoded from the printed label watermark payload, so that the system can access pre-stored data that identifies the plastic type, subtype, and color (if available) of the product having that GTIN. This plastic material information is supplied to the logic circuit that controls the sorting diverter, as is done using the data from the plastic watermark.

[0148]

[0148] As described above, the technical problems of the prior art are that within the limited time and processing constraints of the environment described above, POS scanner It will be recognized that the objective was to ensure highly reliable reading of the GTIN label watermark on the product packaging presented. The technical effect of the detailed configuration described above is that such packaging can retain a second watermark, due to differences in the signal protocols used for the two watermarks. POS scanner The objective is to promote recycling without compromising the highly reliable reading of GTIN label watermarks.

[0149]

[0149] A further technical challenge was ensuring highly reliable optical reading of watermark data from articles in a fast-moving waste stream. In some embodiments, reliability is improved by imaging devices used to capture representations of articles in the waste stream. In some embodiments, reliability is improved by the shape of texture marks applied to the surface of plastic containers in the waste stream.

[0150]

[0150] It will be recognized that this technology is available for use in waste sorting systems of the types sold by Pellenc ST, MSS Inc., Bulk Handling Systems, National Recovery Technologies LLC, Rofin Australia PTY, Ltd., Green Machine Sales LLC, EagleVizion, BT-Wolfgang Binder GmbH, RTT Steinert GmbH, S+S Separation and Sorting Technology GmbH, and Tomra Systems ASA. Optical sorting used in such machines (e.g., based on near-infrared spectroscopy or visible spectroscopy, based on different absorption spectra of different plastics) can be replaced by this technology, or this technology can be used in combination with those other methods. Block analysis

[0151]

[0151] In one exemplary embodiment, the conveyor belt is covered by an array of cameras, each camera providing image frames at a rate of 150 per second. Each frame is 1280 × 1024 pixels in size and covers a field of view of approximately 8 inches × 6 inches on the conveyor belt. Analysis blocks are arranged across each captured image, and each block is analyzed for watermark cues, such as a watermark reference signal. If a watermark reference signal is found, it is used to identify the orientation of the watermarked object on the conveyor belt (using, for example, the techniques detailed in U.S. Patents 9,959,587 and 10,242,434). Using the orientation information, the image is sampled again in the region where the reference signal was detected, waxel data is extracted, and then given to a decoder attempting to extract the watermark payload.

[0152]

[0152] While this specification commonly refers to processing blocks or patches of images with a size of 128 × 128 pixels (or waxels), the applicant has found that the above detailed configurations are often better achieved by processing smaller sets of data such as 96 × 96, 88 × 88, 80 × 80, and 64 × 64. (Due to the curvature and fragmentation of articles found in waste streams, there are not many planar surfaces. However, geometric synchronization usually proceeds on the assumption of planarity. This is considered to be why processing smaller patches of images can yield better results, i.e., the effects of non-planar physical distortion are thereby minimized). Thus, the reader should understand that the reference to 128 × 128 in relation to watermark reading operations is merely illustrative, and smaller datasets are often intended and preferred. (In contrast, watermark coding may still be performed based on a 128x128 block size, but decoding can extract the watermark payload from the analysis of smaller image blocks. Alternatively, coding can also proceed based on smaller blocks.)

[0153]

[0153] The analysis blocks arranged across each image frame for watermark reading may be uniformly or randomly spaced apart, tiled with their edges touching, or overlap (for example, each block may overlap the immediately adjacent block by 20% to 80%). Figure 15 shows an example block pattern in which a 1280×1024 image frame is analyzed using 96×96 pixel blocks, and each block overlaps the adjacent block by 25%. The tiling pattern shows some blocks darker to blur the boundaries of individual blocks.

[0154]

[0154] In some embodiments, if a watermark reference signal or other clue (such as those detailed below) is found in one of the analysis blocks, a higher density cluster of analysis blocks in its vicinity is examined to find the reference signal, and if successful, the payload data is obtained and analyzed. Figure 16 shows an example. The original block is shown in the center with a thick line. The other blocks are arranged around it with 75% overlap (the analyzed block locations in the original block location array are omitted). Again, for clarity, some of the blocks are shown with thick dashed lines. Figure 17 shows a region of blocks that are more densely arranged in the context of the frame in Figure 15, located at the location where the watermark reference signal or other clue was found in the first examined block.

[0155]

[0155] In some recycling systems, the conveyor belt is empty in places, and no items are present in parts of the camera view. Clues to the presence or absence of such empty areas are detectable, allowing processing resources to be applied to more promising images. Similarly, watermarking of captured images may be triggered only if a fast evaluation of the image finds clues indicating the possible presence of plastic (or indicating something other than the conveyor belt).

[0156]

[0156] Plastics are often characterized by areas of specular reflection or glare when the plastic surface specularly reflects incident illumination toward the camera. This glare is perceptible and can serve as a cue to activate (trigger) watermarking. For example, multiple blocks of an input sequence of image frames (e.g., 150 frames per second) can each be analyzed to find a 2x2 pixel area where the pixel intensity is in the top 5%, 10%, or 20% of the sensor's output range (or within a similar percentile of previously sensed pixels from the previous block representing the conveyor belt area). Frames that meet this criterion are analyzed to find watermarking data. (It is desirable to analyze areas of the image other than those near the glare, as plastics may extend far beyond such points.)

[0157]

[0157] In one particular embodiment, no part of the frame is processed until a glare pixel is detected. When this occurs, the analysis of the entire frame is not triggered. Rather, a 7x7 array of overlapping pixel blocks is placed based on the glare area, and each of those blocks is analyzed to confirm the presence of a watermark reference signal. These blocks may overlap by more than 50% of their width, i.e., more than normal block overlap. Figure 18 shows an example where blocks overlap by 75% of their width. The glare area is identified by a "+" mark in the middle of the densely overlapping blocks. In this case as well, some blocks are identified by particularly thick dashed lines because the boundaries of the constituent blocks are not clear.

[0158]

[0158] In addition, a metric other than glare is used to determine whether or not the image is subject to watermarking.

[0159]

[0159] One method called the block trigger method provides clues that help distinguish between empty and non-empty sections of a conveyor belt based on a comparison of input pixel values ​​with a previous reference.

[0160]

[0160] A specific single-block trigger algorithm compiles a histogram of selected pixel values ​​from subblocks of an analysis block (such as one of the blocks shown in bold in Figure 15) for many captured image frames. Each block may be 96x96 waxels (pixels, scale=1). The block is a 4x4 array of subblocks, each with sides of 24 waxels (i.e., 16 subblocks per block, each with 24 2 It is logically divided into subblocks (or containing 576 pixels). Values ​​from 25 randomly selected but static pixels from each subblock are averaged together to calculate one average pixel value per subblock (i.e., a value between 0 and 255 in 8-bit grayscale). Such a new subblock average pixel value is generated per frame.

[0161]

[0161] The 256 average pixel values ​​for a particular subblock are ultimately compiled into a histogram (i.e., over 256 frames). These values ​​show a steep peak corresponding to the average pixel values ​​of an empty conveyor belt at the belt position corresponding to that particular subblock (and having that particular lighting).

[0162]

[0162] When a new frame is captured, values ​​are recalculated for the 16 subblocks within the block. Each value is judged against the histogram of that block. If the new value is among several digital numbers of pixel values ​​(e.g., 1, 2, 3, or 4) that cause the histogram to show a sharp peak, it counts as one vote for the conclusion that the subblock image shows an empty belt. The 16 votes obtained for the 16 subblocks of that block are recorded. If the threshold of votes (e.g., 11 out of 16 votes) leads to the conclusion that the subblock image shows an empty belt, then the block is concluded to show an empty belt. In such cases, the analysis of that block is skipped. Otherwise, the block is analyzed to obtain watermark data.

[0163]

[0163] This process is performed for every frame, for all blocks in the camera view (for example, all blocks shown in Figure 15).

[0164]

[0164] (If the image is captured at high resolution, i.e., resolution greater than 1 pixel per waxel, the 25 values ​​from each subblock can be determined by subsampling, for example, by averaging the values ​​of 4 or 9 of the smaller pixels in the vicinity of the 25 static positions. Alternatively, the value of a single small pixel closest to each of the 25 static positions can be used.)

[0165]

[0165] Figure 19 shows an example histogram for one example subblock after 219 frames have been processed. The x-axis shows the average pixel value for different frames calculated for that subblock. The y-axis shows the number of frames ("bin count") with different average pixel values ​​for that subblock. The histogram peaks at 20. In the relevant section, the relevant bin counts for different average pixel values ​​are as follows: [Table 1]

[0166]

[0166] When the next frame of the image is captured, if the average value calculated from the 25 static pixel positions of this subblock is equal to 18, 19, 20, 21, or 22 (i.e., a peak value of 20+ / -2), then the subblock is determined to represent an empty conveyor belt. If 10 of the other 16 subblocks of that block match, this is used as a clue that the block represents an empty conveyor belt. As a result, no watermarking is performed on that block. Alternatively, if no such match is found, this serves as a clue that a plastic item may be represented by that block, and further processing is triggered.

[0167]

[0167] To make space for more data, each histogram is kept fresh by periodically discarding data. For example, when the frame counter associated with the histogram indicates that 256 frames have been processed, the average of 256 for that subblock is loaded into the histogram, and the contents of the histogram are halved to 128 values. This can be done by using a bin count per average pixel value in the histogram and dividing by 2 (rounding down). This resets the frame counter to 128 frames. Subsequently, the count of average pixel values ​​from the next 128 frames is recorded in the histogram, and the decimation is repeated simultaneously. This configuration causes past pixel values ​​to rapidly lose importance, and the histogram can reflect the most recent data.

[0168]

[0168] By using the newly captured frame, this block triggering method provides a clue as to whether to trigger a watermark reading operation for each block position in that frame. The average pixel values ​​derived from the newly captured frame serve to update the corresponding histogram so that it can be used when evaluating blocks in subsequent image frames.

[0169]

[0169] (It will be recognized that watermark reading can be triggered when a sufficient number of subblocks have average pixel values ​​above (brighter) and / or below (darker) the histogram peak (i.e., the most recent belt brightness). That is, plastic objects may contain areas of dark pixels along with lighter pixels, both of which help signal the decision to perform a trigger.)

[0170]

[0170] Related technologies are also progressing in a similar manner, but they are based on statistics of color distribution rather than luminance distribution.

[0171]

[0171] In a particular embodiment of the block trigger algorithm, if further analysis of a block is triggered, the analysis detects a watermark reference signal from that block (or decodes the watermark payload), and then the average subblock pixel value data of that block is converted into its respective histogram. Cannot be added (Or, if added early, such counts are removed.) Thus, the histogram shows empty conveyor belts. not present It is known that the data from the image is not corrupted.

[0172]

[0172] Many recycling systems set a limit, or processing budget, on the number of image blocks that can be analyzed during the processing of each frame. For example, the limit is 200 blocks. A fraction of this total, such as 50 to 75 blocks, may be reserved for the analysis of blocks densely arranged around a block in which a watermark reference signal or other cues have been detected (as described above in relation to Figures 15 to 17, for example). If the dense arrangement of further analysis blocks exceeds the 200-block limit due to cues being detected from several blocks, additional blocks may be allocated according to the value of the cues (e.g., the intensity of the detected watermark reference signal), with the block deemed most promising receiving the largest allocation of neighboring analysis blocks.

[0173]

[0173] If all 200 blocks are not analyzed for each frame, power consumption decreases, and the heat output from the computer processor(s) (which often needs to be offset by air conditioning) is also reduced.

[0174]

[0174] In the modified block triggering method, the entire processing budget (e.g., 150 block analyses) is used per frame. That is, since 11 of the 16 subblocks (or more generally, K subblocks out of L subblocks) have an average pixel value (25, or more generally, more than N selected pixels) within a small number of digital peaks in their respective histograms, some block analyses are triggered as described above. Then, any remaining analysis blocks are assigned according to the difference between the average subblock pixel value and the peaks in their respective histograms, which are aggregated for all 16 subblocks of the block. Blocks with the smallest aggregated difference are triggered for watermark analysis until the entire budget of 150 analysis blocks is reached.

[0175]

[0175] When the load on the conveyor belt exceeds any threshold, some systems enable the above deformation method automatically or manually. In extreme cases, the conveyor belt may be almost entirely hidden for a period of several hundred consecutive frames by covering the object. In this case, no prominent peaks associated with the belt brightness in the background appear in the histogram. However, each histogram still has a peak at some point. The deformation block trigger method uses the procedure described above to allocate the entire budget of the analysis blocks to image frames. In effect, this results in a large portion of the blocks for analysis being randomly selected. However, this is not an irrational block selection strategy, as the belt is clearly crowded with objects.

[0176]

[0176] Other clues for recognizing images that may be subject to watermarking include using image statistics such as mean, standard deviation, and / or variance.

[0177]

[0177] Figure 20 shows the image frame field of view extending across the entire conveyor, indicated by a large rectangle. The dashed rectangle similarly indicates the arrangement of linear LED light sources extending across the entire conveyor. Due to the orientation of the light source or its lens (or reflector), the illumination has spatial luminance characteristics as shown in the chart immediately to the left, exhibiting maximum luminance in the lamp's region, rapidly attenuating in one direction, and gradually attenuating in the other (shown on a scale of 0 to 100).

[0178]

[0178] Arranged across the direction of the belt are multiple strips of image blocks, each measuring 128 x 128 pixels. Although only two rows are shown in the figure, similar strips extend across the entire image frame. Due to the illumination characteristics of the lamp, adjacent strips may be illuminated differently.

[0179]

[0179] (In Figure 20, the blocks are not adjacent or overlapping, but this is for clarity in the illustration. In reality, blocks are generally adjacent or overlapping.)

[0180]

[0180] A metric is derived from each of the above blocks in each strip and used as a clue to determine the similarity of the image block to the image showing an empty belt.

[0181]

[0181] In the exemplary embodiment, a feature f is calculated for each block and used to identify areas that may be subject to further watermark analysis. Generally, f(·) is a function of each pixel in the block. An initialization phase is performed while the belt is moving but empty, for example, when the sorting system is first powered on. The feature f is calculated for each block over multiple frames, and the amount is grouped by strip. For example, for each strip, the population mean and standard deviation are estimated from the corresponding group of sample features obtained over multiple frames.

[0182]

[0182] Subsequently, when a new image frame is captured, a feature is calculated for each block of that new frame. For each feature, a normalized feature is calculated using the prior estimated mean and standard deviation for the strip containing the block in which the feature was calculated. The normalized feature is calculated as follows:

number

[0183]

[0183] To identify the block most likely to represent an object with a watermark, the normalized feature metric values ​​are sorted from highest to lowest. This establishes the priority for watermark reading. If the system processing budget allows for the analysis of 150 blocks per frame, data from the 150 blocks with the highest first metric is sent for watermarking.

[0184]

[0184] As a result, various basic features f with different effectiveness can be used in the watermarking process. The exemplary embodiment includes block mean and block standard deviation.

[0185]

[0185] The effectiveness of a particular feature in distinguishing an image block containing only belt pixels from other image blocks depends on the conditional distribution of the feature for those two types of blocks. For some non-belt image blocks, feature f AWhile this may not be helpful in distinguishing a block from another belt block, feature f B This can be useful when distinguishing that block. For other non-belt blocks, the situation may be reversed, f A This may be a desirable feature. This leads to further types of embodiments that utilize multiple features.

[0186]

[0186] In the multiple feature embodiment, separate sets of mean and standard deviation estimates are calculated for each feature during the initialization phase, and normalized feature quantities corresponding to the features of each block in the new image frame are calculated. The normalized feature quantities are combined with a single metric value using a join function. The resulting combined metric value is sorted, and the sorted list of metric values ​​forms a priority list for watermarking.

[0187]

[0187] One example of a joining function is the sum of normalized features. Other embodiments include more complex functions derived from, for example, statistical analysis of normalized feature distributions for two types of images: belt blocks and non-belt blocks. Polynomials for joining features are used in some embodiments. To take advantage of the fact that different image strips may consequently produce different normalized feature distributions, further embodiments may have different joining functions for each image strip.

[0188]

[0188] The above configuration will always be recognized as making full use of the entire system processing budget. If the system budget allows for the analysis of 150 blocks per frame, then 150 blocks will be analyzed per frame. (As before, there may be a reserve budget for additional blocks that can be allocated based on the processing results from the first 150 blocks).

[0189]

[0189] The above configuration may be determined as a type of classifier that classifies whether or not the image may show a belt (or glare from plastic). Many other types of classifiers can be used to provide a controllable clue for watermarking.

[0190]

[0190] One such alternative involves using a neural network trained to classify image frames as representing either one type or the other, by training the network with a large corpus of labeled images that show various images of (a) belts only, or (b) something other than belts only. Suitable networks and training methods are described in detail in U.S. Patent Applications Publications 20160063359, 20170243085, and 20190019050, and further in Krizhevsky et al., "Imagenet classification with deep convolutional neural networks, Advances in Neural Information Processing Systems 2012," pp. 1097-1105. Further information is described in concurrent application 15 / 726,290, filed 5 October 2017.

[0191]

[0191] If it is determined that an image or image patch may only represent a conveyor belt, no further analysis of such image is performed. (Instead, the freed processor cycles can be used to further process other images, for example, by analyzing further blocks, such as by attempting to encode them using different candidate affine transforms.)

[0192]

[0192] Another configuration classifies images showing empty conveyor belts and provides clues to distinguish such images from others by sensing characteristic belt marks. For example, conveyor belts generally have scratches, dirt, and other streaky patterns stretched along the belt's axis of travel (belt direction). Such marks detected in the image mostly have low frequencies. The captured images can be subjected to low-pass filtering to reduce high-frequency noise, and the resulting images can then be analyzed (e.g., by the Canny algorithm or the Sobel algorithm) to evaluate the intensity of edges in various directions.

[0193]

[0193] In a particular embodiment, a 128 × 128 block of the image is subjected to low-pass filtering and then inspected using a Canny edge detector to evaluate the intensity of the gradient along the belt direction and the intensity of the gradient across the belt direction (for example, by summing the gradient values ​​in the vertical and horizontal image directions). If a patch indicates a belt, the sum of the former gradients will be considerably larger than the sum of the latter gradients. The logistic regressor is trained to respond to the above two intensity values ​​by classifying image patches as either indicating a belt or not. If a belt is indicated, no further analysis is performed on such a block; if a belt is not indicated, further watermark analysis of the block can be initiated.

[0194]

[0194] In another embodiment, a unit ratio between the two combined gradient amounts is calculated and this value is compared to a threshold to determine whether the image block represents a conveyor belt.

[0195]

[0195] The sorter may be equipped with a laser system for detecting the presence of objects. For example, the laser beam may be swept across the entire range of the belt using a rotating mirror device and may serve to trigger detection along the elements of a linear photodetector array on the other side. As long as each of the photodetectors detects the laser beam, it can be determined that the conveyor belt in the swept area is empty. Such a check can be used to reduce the analysis of the captured image block.

[0196]

[0196] Another type of clue that can trigger further watermark analysis is based on the sesame-salt (or salt-and-sesame) pattern metric, which indicates the possibility that a block exhibits a sparse-dot watermark. An example algorithm for calculating such a metric is described below.

[0197]

[0197] The scale is 1 because the input image block is downsampled as needed. That is, each waxel is represented by the size of 1 pixel. We are looking for dark pixels in lighter color ranges, i.e., pixel outliers. However, image contrast can be high or low, and illuminance can vary within a block. It is desirable that the calculated metric be robust to such variations. To that end, we calculate a measure that examines the pixel neighborhood and also takes into account sensor acquisition noise.

[0198]

[0198] The acquired noise present in the captured image is a function of the pixel value, with higher pixel values ​​resulting in higher noise values. A polynomial function or reference table can provide the noise standard deviation for each pixel value between 0 and 255. To identify outlier pixels (e.g., the relatively darkest pixel in a range of relatively light-colored pixels), the measure, i.e., sigma, is calculated for the pixel neighborhood region around the target pixel with value x at coordinate (i,j) using the following formula.

number

[0199]

[0199] For pixels that are darker than the average of the neighboring region, the above sigma value is negative. In order to be judged as a sparse mark dot, the sigma value is, for example, σ ij Set a density threshold that must satisfy <-3. Generate a filtered image block containing only pixels whose corresponding sigma values ​​satisfy the above check. All other pixels are removed (for example, set to white with a pixel value of 255).

[0200]

[0200] The steps up to this point identify the darkest dots, including pixels that form the darkest edges (e.g., dark text). In order to focus the watermark extraction process only on sparse mark dots, it is necessary to filter and remove pixels that are not separated from other pixels (a form of morphological filtering). Various techniques can be used for this task. A simple technique is to visit each dark pixel, examine a 5x5 pixel area at the center of its image position, and count the number of dark pixels in that area. If there are three or more dark pixels in that 5x5 area, the central pixel is removed (e.g., changed to white). The resulting processed block is then composed entirely of the separated dark dots.

[0201]

[0201] Finally, this processed block is inspected to count the number of dark dots remaining within the block boundary. This number serves as a metric indicating whether the block contains sparse watermarks.

[0202]

[0202] This metric may be compared to determine whether it exceeds a threshold K (e.g., K=500) experimentally determined to identify frames that may exhibit sparse watermark data. Alternatively, blocks of that frame can be ranked based on their associated sparse metric, and blocks with the highest sparse metric can then be further analyzed to extract watermark data up to the limits of the block processing budget.

[0203]

[0203] Various simplifications and modifications can be made to this particular algorithm. For example, a simpler procedure is to identify only one set of the darkest pixels in a block. (For example, the darkest 10% or 30% of pixels in a block can be identified). This procedure then applies the morphological filtering and counting operations described above to obtain a sparse metric.

[0204]

[0204] Another modification configuration distinguishes possible sparse dots from others based on learning from previous image frames.

[0205]

[0205] The example learning process analyzes pixel values ​​from a series of past frames, for example, by sampling 10 blocks in each frame. Each block is divided into subblocks, for example, 5x8 pixels. For each analyzed subblock, both the intermediate pixel value and the minimum pixel value are determined.

[0206]

[0206] In some subblocks, the minimum pixel value is that of a dense sparse dot. In other subblocks, which do not contain sparse dots, the minimum pixel value is simply the minimum pixel of the non-sparse dot image content (e.g., background image, items marked with a continuous grayscale watermark rather than a sparse watermark).

[0207]

[0207] From this collected statistical data, we identify the maximum value of the minimum pixel value ("maxminimum") for each associated subblock mean. For example, considering all subblocks with an intermediate pixel value of 151, the maximum value of the minimum pixel value occurring in the analyzed series of frames is 145. Pixel values ​​greater than 145 are very certain not to be sparse mark dots in a subblock with an mean of 151. This value, and other similarly confirmed values, can therefore help set a threshold for distinguishing possible sparse mark dots (outliers) from impossible sparse dots.

[0208]

[0208] In a particular embodiment, all such sets of points are described by a best-fit line characterized by, for example, the following slope and offset amount. τ 外れ値 = 0.96 * μ - 1.6 However, μ is the intermediate pixel value of the subblock.

[0209]

[0209] When a new frame of the image is received, the average value of each 5x8 pixel subblock is calculated, and the corresponding outlier threshold is determined by the best-fit line formula. Pixels in subblocks with values ​​smaller than this threshold are identified as candidate sparse dots. (For example, if a subblock has an intermediate pixel value of 82, all pixels in the subblock with a pixel value of 77 or less are treated as candidate sparse dots.) Then, as described above, a morphological filter is applied to the entire block to discard connected dots, and then the number of dots remaining in that block is counted to generate a sparse metric. As previously mentioned, this metric can be tested against a threshold to identify blocks that may be subject to watermarking. Alternatively, all blocks in the frame can be ranked according to this metric and selected for processing based on this until the block processing budget is reached.

[0210]

[0210] In an alternative embodiment, the process detailed above can be modified to generate a metric based on bright pixels in dark areas (i.e., salt and pepper). One such modification simply inverts the grayscale of the image block before executing one of the algorithms described above.

[0211]

[0211] Some recycling systems may look for multiple cues when determining which blocks to perform watermark analysis on. For example, to identify blocks that only show conveyors, a block trigger cue may be obtained first for all blocks in the image frame. The remaining blocks can then be evaluated one by one to determine the sparse metric as described above in order to assess which of the blocks that do not show conveyors is most promising for watermark analysis.

[0212]

[0212] When items are moved by the conveyor of the recycling system, they pass through the camera linearly by entering the field of view from one side of the camera sensor and exiting from the other. For example, as described in detail above, if a cue indicating an image block showing a non-empty conveyor belt is detected in one frame, not only is the image of the current frame analyzable, but images showing continuously shifted regions of the camera's field of view are also analyzable in subsequent N frames. N is a function of the camera's frame rate, belt speed, and camera's field of view. For example, if the camera's field of view is 15 inches and the conveyor is moving 10 feet per second, items on the conveyor need to enter the field of view in 1 / 8 of a second as they move through the camera's field of view. If the camera captures 60 frames per second, N can be set to 6 (i.e., the corresponding block will be analyzed in a total of 7 frames).

[0213]

[0213] In a particular embodiment, an array of overlapping analysis blocks is arranged along the side of the camera field of view into which the object first enters, and each of those blocks is analyzed frame by frame to find a watermark reference signal. When a reference signal or other clue is found in any of those blocks, such detection triggers further analysis of an overlapping cluster of blocks located at the center of the detected block, as described above. This cluster is gradually moved across the field of view between frames, according to the speed of the conveyor belt.

[0214]

[0214] Figures 21A to 21D show such a configuration. A series of blocks are analyzed on the side of each image frame where the object is located. (Blocks inside the frame do not usually need to be analyzed). A watermark reference signal or other clue is recognized in one of those edge blocks (shown in thick lines), in which case clusters of nearby overlapping blocks can be analyzed to find the watermark reference signal. Once a watermark reference signal is detected, the analysis continues to attempt to recover the watermark payload from waxel data obtained using affine parameters found from the reference signal. The corresponding clusters of blocks are analyzed in consecutive frames at consecutive positions until the detected object is no longer in the camera's field of view.

[0215]

[0215] If one of the advancing cluster blocks detects a watermark reference signal or other cues (e.g., the thick-lined block in Figure 21C), a supplemental cluster of the analysis block (shown by a dotted line) can be generated and placed in the center of the detected block. This supplemental cluster of the block can also advance across the field of view together with the original cluster, synchronized with the movement of the conveyor. Meanwhile, the original block bands arranged across the entry side of the camera field of view continue to inspect each new image frame in search of a watermark reference signal or other cues. optimization

[0216]

[0216] As mentioned above, the conveyor belt on which plastic items are transported for identification / sorting moves at a relatively high speed. A smaller aperture and longer exposure are desirable to ensure sufficient lighting and depth of field. This can lead to motion blur.

[0217]

[0217] Some embodiments of this technology apply blur correction to the captured image before attempting to read the watermark. Various techniques can be used, including inverse filters, Wiener filters, or deconvolution using the Richardson-Lucy algorithm. The optimal point spread function (PSF) for 1D motion can be estimated using conventional methods. (The PSF substantially characterizes the amount of energy that light from a single point in the scene exposes each pixel of the camera during static exposure.)

[0218]

[0218] More sophisticated techniques can be used, such as a flutter shutter technique that samples the scene at different times at different intervals and uses the resulting images to derive a more refined estimate of the blur-corrected scene. (See, for example, U.S. Patent Application Publication No. 20090277962).

[0219]

[0219] In the exemplary embodiment, blur correction is performed in the Fourier domain, and the Fourier transform of the image is divided by the Fourier transform of the blur kernel. In other embodiments, such operation can be performed in the spatial (pixel) domain.

[0220]

[0220] In convolutional decoding of watermarked payloads, list decoding can be used. Instead of outputting a single decoded payload, list decoding outputs a list of possible values, one of which is correct. This allows for handling a larger number of errors than would be possible with unique decoding. The enumerated payloads can then be evaluated using CRC data or constraints within the payload itself (for example, it is known that the values ​​in a particular area of ​​the data are derived from only a subset of possible values) to identify the one payload that has been decoded correctly.

[0221]

[0221] Instead of attempting to characterize the orientation of a 128×128 waxel image patch, it is preferable to analyze a smaller patch, such as a 96×96 waxel patch, as described above. (In a preferred embodiment, a 96×96 waxel patch corresponds to a 96×96 pixel patch, where the camera sensor, lens, and imaging distance are selected such that each pixel represents a watermarked object on a scale approximately corresponding to the area of ​​a single waxel). A 128×128 FFT is performed on this patch by zero-padding or by processing adjacent pixel images with a rectangular or Gaussian window to converge to the central region. As shown above, the methods detailed in U.S. Patents 9,959,587 and 10,242,434 are used to characterize rotation and scaling. Translation can then be determined using the phase shift method of U.S. Patent 9,959,587. In summary, rotation, scaling, and translation (affine parameters) explain how the original watermark is present within the captured image.

[0222]

[0222] The phase shift method provides a metric indicating the intensity of the detected reference signal within the analyzed patch of the image, i.e., the sum of the phase shifts between the measured phase and estimated phase of each reference signal. If this phase shift metric is below a threshold (a lower metric is better), the image patch is determined to contain a readable watermark. Subsequently, an interpolation operation is performed to sample images of points corresponding to waxel positions derived by the recognized affine parameters in order to generate data for payload decoding.

[0223]

[0223] As described above, if one patch of the image is determined to contain a readable watermark, adjacent patches are checked, for example using the procedure described above, to determine if adjacent patches also contain a readable watermark. For each such patch, a corresponding pair of affine parameters is determined. (Typically, each patch is characterized by a different pair of affine parameters). In this case as well, an interpolation operation is then performed to generate more waxel data to be used in payload decoding.

[0224]

[0224] As mentioned above, adjacent patches may be adjacent with their edges touching, or they may be overlapped by any number of waxels.

[0225]

[0225] When image patches smaller than 128×128 (e.g., 96×96 waxels or 64×64 waxels) are analyzed, not all 128×128 waxel encoded locations may be shown in each patch (depending on the scale). Nevertheless, corresponding locations are identified between the analyzed patches (using affine parameters), and their sampled waxel data are combined (e.g., averaged or summed). A combined record of waxel data for some or all of the 128×128 encoded locations is generated and given to the Viterbi decoder for extraction of the encoded watermark payload.

[0226]

[0226] This is schematically shown in Figure 22. The reference signal is detected in small image patch 141 (shown here only as an 8x8 waxel), leading to the search and discovery of the reference signal in the adjacent small image patches 142 and 143, each having a different affine orientation. Watermark signal blocks (not shown in particular) extend over an area larger than any of the patches.

[0227]

[0227] For some waxes in the watermark signal block, such as waxel 144, interpolation data from a single image patch is provided to the decoder. For other waxes, such as waxel 145, interpolation data is available from each of two overlapping patches. These two interpolation values ​​are averaged (or summed) and provided to the decoder. For yet another waxe, such as waxel 146, data from three patches is averaged (or summed) and provided to the decoder. For yet another waxe, such as waxel 147, there is no data available to the decoder.

[0228]

[0228] In some cases, data for a particular waxel is available from two different (but usually adjacent) 128x128 waxel watermark blocks. Figure 23 shows two such blocks as solid lines. Also shown as dashed lines are two 96x96 waxel patches that are processed as described above. From the affine orientation parameters determined for such patches, it can be seen that the waxel indicated by the circle in the left patch spatially corresponds to the waxel indicated by the circle in the right patch. Both hold the same chip of signature information. In this case, the two waxel values ​​are added together and sent to the decoder.

[0229]

[0229] The decoder processes all available data and generates an extracted payload (or a list of candidate payloads).

[0230]

[0230] In some embodiments, the waxel data contributed by each image patch is weighted according to an intensity metric for the associated reference signal. In other embodiments, different metrics may be used, such as those detailed in U.S. Patent No. 10,506,128 (referred to as Reference Pattern Strength and Linear Reference Pattern Strength in the literature). Alternatively, each waxel data may be weighted according to a corresponding message intensity coefficient, such as those detailed in U.S. Patent No. 7,286,685.

[0231]

[0231] The aforementioned accumulation of waxel data from the entirety of multiple patches in an image frame is sometimes called intra-frame signature joinery. Additionally or alternatively, accumulation of waxel data from the same or corresponding waxel locations in the entirety of patches shown in different image frames is available and is sometimes called inter-frame signature joinery.

[0232]

[0232] When the affine parameters of a patch (which describe the appearance of the patch's watermark) are known, payload reading can be performed using payload correlation techniques instead of Viterbi decoding. This is particularly effective when the number of different payloads is small, for example, on the order of tens or hundreds. This may be the case when only the payload of interest is plastic type data, and there are only a limited number of plastic types that can be encountered.

[0233]

[0233] In a particular configuration, a set of templates is generated, each representing a waxel encoding associated with a specific type of plastic. Waxel elements common across all plastic types (or a significant percentage, such as 30%) can be removed from those templates to reduce the possibility of confusion. To identify the one pattern that the image data most strongly corresponds to, the image data is correlated with various templates. Since it has already been determined that the image contains a reference signal (e.g., a reference signal for plastic texture watermarks), there should be one of a limited number of waxel patterns, which provides a highly reliable correlation method for recognizing its payload.

[0234]

[0234] Plastic bottles are increasingly not printed directly on them, but instead are packaged in plastic sleeves that are printed on and then heat-shrink to fit tightly to the bottle. This causes problems because heat-shrinkable materials generally shrink basically in one direction (circumferentially). Watermark patterns printed on such sleeves are then reduced in size differently by the heat shrinkage, which can hinder watermark reading.

[0235]

[0235] To solve this problem, one or more of the "seed" linear transforms (detailed in U.S. Patent Nos. 9,959,587 and 10,242,434) that serve as starting points for iterative search to determine the affine transform of the watermark are initialized to include differential expansion / shrinkage components. This enables the iterative process to reach a better estimate of the affine distortion more quickly when detecting the watermark from the heat-shrinkable plastic sleeve.

[0236]

[0236] In some cases, the watermark is not read from the marked article, and the conveyor proceeds without performing type identification. On the other hand, other articles are discharged from the conveyor towards sorting bins such as ABS, HDPE, PET, PETg, etc., leaving the un-identified articles behind.

[0237]

[0237] These un-identified articles are collected in their own sorting bins and may be reprocessed later. Reading failures are abnormal and are generally addressed by changing the orientation of the article and the camera with respect to the lighting. By collecting and reprocessing such articles, a second presentation in a different orientation may result in identification.

[0238]

[0238] Alternatively, instead of collection and reprocessing, the article may be rolled (e.g., dropped from one conveyor to another) or pushed / mixed (e.g., the conveyor may pass through a curtain of suspended obstacles) to change the orientation of the article, and a second camera / lighting system may then be able to collect additional images for analysis.

[0239]

[0239] In some embodiments, the captured image correlates with light transmission through the article rather than simple light reflection from the article. Figure 24 shows an article moving "out a bit" from a conveyor to another conveyor, and the article viaFIG. schematically shows a configuration for presenting a camera view to one or more light sources of the other party. Such an approach can be used with any of the camera / lighting systems described above. The "clue" based on the detection of the conveyor belt can also be similarly based on the detection of such splashes without background.

[0240]

[0240] The direct least squares method for determining the zoom and rotation transformation to characterize the appearance of the watermark in the image operates by successively screening and refining a large number of candidate transformations until only one remains. Then, the above-mentioned phase shift processing is performed to realize the x and y translations of the watermark pattern in the image. In a particular embodiment of the present technology, the direct least squares method does not screen the candidate transformations until there is only one, but rather outputs two or more top candidates. The phase shift processing is applied to each of them to generate a plurality of candidate affine poses. The best pose that generates the minimum sum of the phase shifts between the measured phase and the estimated phase of each reference signal is selected. With such a configuration, the number of articles that remain unread when passing through the device for the first time is small, minimizing the need for reprocessing.

[0241]

[0241] In some cases, the pattern of reflected light from a textured surface patch, especially from a transparent plastic bottle, can appear inverted, with lighter areas appearing darker and darker areas appearing lighter. Furthermore, the pattern may appear reversed (flipped horizontally / vertically), as is the case when a transparent textured surface is read from below. Therefore, after scaling and rotation are performed (by direct least squares, correlation, or another approach), multiple versions of the image are presented for analysis by a process that determines the x and y translations (by phase shift or correlation). One version is inverted in black and white (lighter areas appearing darker). Another version is (horizontally) flipped. Another version is the original image. Only one of these properly synchronizes with the known phase characteristics of the reference signal peak from which the translation was determined, and does not match the others. In this case as well, such measures help maximize the number of plastic articles read when they first pass through the apparatus and minimize the need for reprocessing.

[0242]

[0242] (In some embodiments, the decoder is configured to examine the polarity of the message chip encoded in each subtile block (e.g., a 32x32 waxel with 16 subtiles per tile) in order to evaluate whether the message chip is inverted. Such a decoder performs the above examination by correlating the watermark signals of the subtiles to check whether the watermark signals of the subtiles have positive or negative correlation peaks. A negative peak indicates that the signal is inverted, and the decoder inverts the chip from such inverted subtiles before aggregating it with the chips of other subtiles. Correlation can be performed using known or fixed portions of the watermark signals.)

[0243]

[0243] The applicant has found that it may be beneficial to capture frames, each having different imaging parameters that represent a common area of ​​the belt. For example, a single camera may alternate between short exposure intervals, such as 20 microseconds and 100 microseconds, and long exposure intervals in a series of frames. Alternatively, two cameras may capture images of a common area of ​​the belt, one having a relatively large aperture (e.g., f / 4) and the other having a relatively small aperture (e.g., f / 8). Alternatively, they may have different exposure intervals. The resulting changes in the captured images help ensure that small changes associated with watermark coding are easily detectable, regardless of the wide range of brightness reflected from the imaged article.

[0244]

[0244] When a plastic material is molded, the first surface of the material is generally adjacent to the molded surface, while the second, opposite surface is not adjacent. This opposite surface can still be molded because the vacuum pulls the first surface of the material into the mold, with the second surface following. However, the physical resolution of the second surface is not good and lacks high-frequency detail. However, this second surface may be imaged by a camera (for example, if a carbon black plastic tray in which meat is packaged is used, the tray may be presented to the camera either top-up or bottom-up). To solve this problem, some or all of the captured frames (or portions) can be processed to enhance high-frequency detail.

[0245]

[0245] In one exemplary embodiment, if no reference signal is found in the block to be analyzed, the block is processed by an unsharp mask filter and the analysis is repeated in the hope that such processing will help detect a watermark reference signal indicated from the back of the molded plastic. In another exemplary embodiment, if a reference signal is found in the block but payload extraction fails, the block is processed by an unsharp mask filter and the payload extraction operation is attempted again.

[0246]

[0246] The illustrative lighting system is constructed from one of the circuit board modules 250 shown in Figure 25. Each module has a width of 10 cm and is configured to house 75 LEDs of the Cree XP-E2 series. Since the white light LEDs of this series are judged to provide a drive current of 1 A for a light output between 220 lumens and 280 lumens, a module of 75 LEDs can produce a luminous flux of 16,000 to 21,000 lumens. The modules are designed for parallel use. For example, to cover a belt with a width of 1 meter, more than 10 such modules can be used, resulting in a total light output of 160,000 to 200,000 lumens or more.

[0247]

[0247] This circuit board module is configured to mount three LEDs as a set, for example by three sets of proximity solder pads 252a, 252b, 252c. Each of these three LEDs is configured to house a lens assembly 254 to focus the light output into the imaging range of the belt. The lens has an elliptical output, and it is desirable that the light spreads more in one dimension than in the vertical dimension. A suitable lens assembly is Carclo Technical Plastics (UK) part number 10510, which focuses the output from the Cree LEDs into a ray with a full width at half maximum of 45 degrees × 16 degrees. The wider dimension is oriented along the width of the belt, while the narrower dimension is oriented along the length of the belt (direction of travel). The latter measurement is usually selected based on the distance between the LED module and the belt and the range of the imaging field along the belt length.

[0248]

[0248] The greater the brightness of the illumination, the shorter the exposure interval can be (increasing the depth of field). If the exposure interval is 100 microseconds, and the frames are captured at a rate of 150 frames per second, the camera sensor is collecting light for a total of only 0.015 seconds per second. If the illumination system is operated (emitting light) only while the camera is capturing exposure, the illumination system operates at a 1.5% operating cycle. In such cases, it is possible to operate the LEDs with a drive current well above the nominal specified value of 1A. For example, a drive current of 3A may be used. By doing so, the light output can be further increased to the order of 300,000 lumens per meter of belt width, for example. (It should be recognized that lumens are a scale based on the sensitivity of the human visual system. Illumination specified in watts is usually more effective in machine vision. Lumens are used as a scale simply because they are well known to some people.)

[0249]

[0249] The light output of these LEDs decreases with temperature. Therefore, it is desirable to keep the LEDs at a relatively low temperature. To assist in this operation, the circuit board module may have an aluminum or copper substrate, and the module may be thermally coupled to an aluminum or copper heat sink using appropriate thermal grease. This heat sink may have fins to increase its surface area and improve its passive heat transfer characteristics to the ambient air. Alternatively, this heat sink may be cooled by forced airflow or forced water flow.

[0250]

[0250] In some embodiments, all of the above LEDs are white. In other embodiments, all LEDs are red (for example, Cree part number XPEBPR-L1-0000-00D01, having peak emission between 650nm and 670nm). In yet another embodiment, module 250 comprises LEDs having various spectra. Thus, a control circuit is provided to drive LEDs of different colors (and possibly LEDs of even different ranks) independently or in various combinations.

[0251]

[0251] In one such embodiment, each of the "triplets" shown in Figure 25 includes a red LED, a green LED, and a blue LED. These are organized into three "ranks," A, B, and C, as shown in the figure. The red LEDs of rank A are switched in sequence, the green LEDs of rank A are switched in sequence, and the blue LEDs of rank A are switched in sequence. The same applies to ranks B and C. The sets of LED colors and ranks can be operated individually or in combination with other sets of LED colors and ranks during the exposure period. This configuration makes it possible to capture various image frames under various spectra of light. For example, one frame can be captured using all red illumination, while the next frame can be captured using green or red + green + blue (~white) illumination.

[0252]

[0252] In another such embodiment, not all ranks have the same type of LEDs. For example, ranks A and C may have red / green / blue LEDs as described above, while rank B may have only white LEDs or only red LEDs.

[0253]

[0253] In another configuration, module 250 comprises LEDs with up to nine different spectra. Rank A is available with LEDs having spectra 1, 2, and 3. Rank B is available with LEDs having spectra 4, 5, and 6. Rank C is available with LEDs having spectra 7, 8, and 9. Some of these spectra are outside the visible light range and may extend to ultraviolet or infrared wavelengths. This makes it possible to obtain data that makes an object identifiable by its spectral signature, as detailed, for example, in the applicant's "Spectra ID" U.S. Patent Application Publication No. 20140293091 and pending patent application No. 62 / 956,845 filed on January 2, 2020.

[0254]

[0254] If the camera sensor is a color sensor, for example, one having a color filter array superimposed on a monochrome sensor, then different colored photodetectors can capture images at different wavelengths. When both red and blue LEDs are energized during frame exposure, the red-filtered photodetector will sense an image at approximately 660 nm, and the blue-filtered photodetector will sense an image at approximately 465 nm. Subtracting the blue image from the red image produces an image in which certain encoded markings may be particularly easy to detect (for example, due to modulated color channels in the printed label artwork to achieve encoding). The same applies to other color combinations.

[0255]

[0255] Since plastic surfaces can be glossy, specular reflection is not unusual. That is, light from a given position may reflect from the surface patch to mainly a single position. Unless the camera is in that position, the surface patch may be imaged densely, making it difficult to analyze and obtain encoded information. Therefore, it is desirable that the surface be illuminated from various directions. An elongated light bar consisting of multiple modules 250 mounted side by side extends across the belt and has a wide light scattering across the belt (45 degrees when using the lens mentioned in the example above), which helps to achieve the spatial diversity described above. Diversity is further enhanced by having two or more such light bars and illuminating the belt from various positions along its length.

[0256]

[0256] Other embodiments utilize an optical diffuser device, as shown in Figures 26A and 26B. Figure 26A shows a cross-section of a generally cylindrical reflector 261, with the axis of the reflector 261 extending across the width of the conveyor belt. A linear array 262a of lighting modules, such as module 250 described above, extends along one edge of the reflector and is oriented upward to illuminate the reflector surface. A similar lighting array 262b extends from the other edge of the reflector in the same manner. Illumination exceeding 500,000 lumens is achievable for a 1-meter wide belt.

[0257]

[0257] A mirrored or colored surface can be used, but the surface of the reflector 261 is usually white. Diffusers may be used in each illumination array 262a, 262b to distribute the illumination from the LEDs to the reflector. Alternatively, lens devices with a spread greater than the 16 degrees mentioned above can be used. For example, a spread of 90 to 120 degrees can be used to achieve broad illumination of the reflector. The reflector 261 is shown as part of a circle in cross-section, but different shapes can be used to increase the illumination in the section being imaged by the camera 264, and are adjusted to focus the light from the two linear illumination arrays onto a band 263 extending across the belt.

[0258]

[0258] Figure 26B is a cross-sectional view of an alternative configuration in which a plurality of linear arrays of LED modules 262c extend across a belt. Module 262c is different from module 250 in that it does not include a lens. Instead, the LEDs illuminate a plastic diffuser 266. Suitable diffusers are available under the brand name Optix from Curbell Plastics, Inc. Using four or more arrays 262c of modules extending across the belt, lighting in excess of 1 million lumens can be achieved for a 1-meter belt width.

[0259]

[0259] Additionally or alternatively, the problem of specular reflection can be reduced by using a plurality of cameras arranged at various positions not only across the width of the belt but also along its length. Two or more such cameras may be oriented to capture images from a common focus region of the belt. Due to different viewpoints, one camera system may succeed in decoding an identifier from an object on the belt while another camera taking the image may fail.

[0260]

[0260] In addition to capturing diverse views of an object to improve the reliability of decoding, the use of a plurality of cameras capturing a common area enables the extraction of 3D information about an object on the conveyor belt using well-known stereoscopic principles. This provides additional information by which the object can be recognized.

[0261]

[0261] Figure 27 is a diagram showing a configuration using both a plurality of light sources and a plurality of cameras along the length of a conveyor belt. Figure 27 is a schematic diagram. As described above and illustrated in connection with Figure 26B, it is desirable to use light sources with large apertures and diffusers.

[0262]

[0262] Figure 28 shows a modified configuration in which a single camera is used, but a portion of the camera's field of view (e.g., half) is occupied by different views of a belt relayed by a mirror system (shown in thick lines). The path length through the mirrors is twice the path length without the mirrors. Therefore, the resolution of the mirrored half of the field of view is half the resolution of the direct view, and typically requires a high-resolution sensor. If the entire image is input to a general detection module, the direct view portion of the captured image can be downsampled to match the resolution of the mirrored view. Alternatively, the bifurcated image can be fed to two different detector modules, each optimized to a specific resolution of half of the captured image. In either case, it is desirable to note that the specular reflection of the image should be reversed when an odd number of mirrors are present in the path, or that such reflections should be predicted and the reflected portion of the image analyzed. (In this case as well, the light sources described above, including dome-shaped reflectors and diffusers, can be used).

[0263]

[0263] The lighting source should ideally be as close to the belt as possible to enable the shortest possible camera capture interval. However, sufficient clearance must be provided so that items can pass underneath while on the belt. A suitable compromise is a distance between 15 and 20 cm. Depending on the type of items on the belt, a higher clearance of up to 25 cm may sometimes be necessary.

[0264]

[0264] As mentioned above, specular reflection can be helpful at times (for example, in sensing texture coding from black plastic) and at other times it can be a hindrance. One useful configuration involves using multiple independently operable light sources positioned relative to the camera, such that one or more independently operable light sources are positioned to promote specular reflection, while one or more light sources are positioned to avoid specular reflection.

[0265]

[0265] Figure 29 schematically shows an exemplary embodiment. Light source A is positioned and oriented so that specular reflection (arrow AA) from a horizontal plane located 7 cm above the belt (nominal position of the top surface of the plastic article) is reflected to the camera lens (incident angle = reflection angle). In contrast, light source B is positioned and oriented so that specular reflection (arrow BB) from such a surface does not hit the camera lens. Rather, the light from light source B perceived by the camera is due to diffuse reflection. Light sources A and B are operated to irradiate various frame captures and generate image frames optimized to show specular and diffuse reflection, respectively.

[0266]

[0266] It is desirable that the light source B is positioned such that its specularly reflected light rays BB pass through a distance D at least 10 cm, preferably 15 or 20 cm, away from the camera lens.

[0267]

[0267] (Figure 29 shows a specular reflection from light source A that appears in the center of the captured image frame by entering the camera lens along the central axis of the camera lens, but this is not essential. All that is required is that the specular reflection from light source A is somewhere within the camera's field of view.)

[0268]

[0268] In another specific configuration, light source A is angled at 45 degrees (as shown in Figure 29), while light source B is angled directly downwards.

[0269]

[0269] In some embodiments, light sources A and B are colored with different colors. For example, light source A may have any of the following colors: white, red, blue, ultraviolet and / or infrared, while light source B may have a different color.

[0270]

[0270] Accurate extraction of payload signature data from image patches relies heavily on the precise spatial alignment of the patches, i.e., on accurately assessing the affine pose of the patches, so that waxel values ​​can be sampled from the exact original encoded locations in the image. As described in other parts, the alignment in the exemplary embodiment is performed using a reference (grid) signal consisting of a set of peaks in the spatial frequency (Fourier) domain.

[0271]

[0271] As mentioned above, the accuracy of the alignment can be evaluated by a metric ("grid strength metric" or "Linear Reference Pattern Strength") that compares the Fourier amplitude at each estimated grid signal frequency with the amplitudes of four or eight neighboring estimated grid signal frequencies, for example, by the ratio of the former amplitude to the mean of the latter. The values ​​for all grid points can then be summed up to generate the final grid strength metric.

[0272]

[0272] To ensure the accuracy of the extracted signature data, the applicant uses the procedure otherwise specified to characterize the affine pose of the image patch, and then iterates over one or more of the pose parameters while monitoring changes to the grid intensity metric to optimize the grid intensity metric. For example, the x-translation parameter of the determined affine pose may be fine-tuned by 1 / 10 or 1 / 4 waxels to determine whether the grid intensity metric increases. If the grid intensity metric increases, further such fine-tuning is performed. If the grid intensity metric decreases, fine-tuning is performed in the opposite direction, and so on. A similar procedure is then performed with the y-translation parameter until a local maxima is found in the grid intensity parameter function.

[0273]

[0273] This procedure can be based on image patches of size 32×32 wax cells, and the orientation of each such patch is optimized to maximize the value of the associated grid intensity metric. In a particular preferred embodiment, such analysis is performed on different 32×32 wax cell patches of an image with 16 wax cells overlapping. Three such 32×32 overlapping patches, 281 (shown in bold), 282 and 283 are shown in Figure 30. In such overlapping configurations, each wax cell is contained within four overlapping patches. Wax cell 285 in Figure 30 is an example and is contained within patches 281, 282 and 283, with the fourth patch not shown (to avoid illustration confusion).

[0274]

[0274] By overlapping as described above, it becomes possible to obtain four estimates of the value of waxel 284 (and other such waxels). The value of waxel 284 is first sampled according to the affine attitude parameters of patch 281, a second time according to the affine attitude parameters of patch 282, again according to the affine attitude parameters of patch 283, and a fourth time according to the affine attitude parameters of the fourth patch.

[0275]

[0275] As described above, it is desirable that each value of such waxel data be weighted according to the grid intensity of the image patch in which the waxel is located in order to accumulate the value to be input to the Viterbi decoder. Since each waxel is found in four overlapping patches, the sum of the four weighted data is accumulated and given to the decoder as a confidence-weighted estimate of the value of that waxel.

[0276]

[0276] The above configuration has been shown to significantly improve the percentage of images from which payload data was successfully extracted.

[0277]

[0277] Further improvement in the percentage of images from which payload data has been successfully extracted can be achieved by dark frame subtraction technique. Determining fixed pattern sensor noise by capturing long-exposure images while a lens cap is blocking sensor illumination, and then subtracting the corresponding pattern residue from the subsequently captured images, is well known in nighttime astronomy and other long-exposure or high-ISO photography. However, the applicant is not aware of any technique used in high illumination contexts with extremely short exposure times, as in the present technique. However, it is known that such a method can achieve a significant improvement in decoding performance.

[0278]

[0278] In a particular method, the applicant places a cap on a camera lens and captures 100 images using a “darkfield” sensor having exposure intervals and analog gain set to values ​​expected to be used during normal operation. The frames are averaged to reduce thermal (shot) noise. A matrix of residual noise values ​​is generated (a combination of readout noise and dark noise), which can be subtracted from image frames captured later in operation to reduce such fixed sensor noise. (Dark pixel values ​​in the range of 1 to 12 digital numbers, i.e., noise patterns that interfere with decoding in many boundary cases, have been discovered by this method).

[0279]

[0279] Further information relating to characterizing and removing fixed pattern noise before watermark decoding is detailed in the applicant's U.S. Patent No. 9,544,516.

[0280]

[0280] Naturally, the larger the sensor, the higher the sensitivity and the shorter the exposure time. It is desirable that the sensor has pixels with sides larger than 3.5 micrometers, preferably pixels with sides larger than 5 micrometers. Ideally, although cost is an issue, sensors with pixels of size 10 or 15 micrometers can be used. (For example, a 2K×2K sensor with a pixel size of 15 micrometers, such as the SOPHIA2048B-152 from Princeton Instruments). An alternative is to use "binning" with a high-resolution sensor, such as a 2.5K×2.5K sensor with 5-micrometer pixels, where adjacent 2×2 sets of pixels are binned to achieve performance close to that of a 1.25K×1.25K sensor with 10-micrometer pixels. However, since binning reduces the sensor resolution, it is preferable to use a sensor with appropriate sensitivity at its original resolution.

[0281]

[0281] As described above, either a monochrome or color sensor can be used. Some printed labels are encoded using “chroma” watermarking, for example, using a combination of cyan and magenta inks. These two inks have different specular reflection curves, which, when illuminated by white (red-green-blue) lighting, allow the difference between the red and blue (and / or green) channel camera responses to be subtracted to produce an image in which the watermark signal is enhanced. (See U.S. Patent No. 9,245,308). Furthermore, despite the signal enhancement achieved by such techniques, the applicant found that illuminating the above-mentioned labels with red light only and sensing them with a monochrome sensor produces a stronger, less noisy recovered watermark signal. (Furthermore, red LEDs are more efficient than, for example, green and blue LEDs, and in some cases more than twice as efficient. This leads to less heat generation and, as described above, produces a greater luminous flux output).

[0282]

[0282] In yet another embodiment, the printed label can be encoded with machine-readable data (e.g., a sparse watermark pattern) formed using yellow ink for encoding recycling-related data. Further explanation regarding plastic molding, etc.

[0283]

[0283] The following description further details techniques for encoding plastic containers and labels to retain machine-readable markings. This includes details for overcoming specific signal distortions incorporated into the design and manufacture of plastic containers.

[0284]

[0284] For brevity, a watermark is an optical code that typically includes a 2D pattern of coded signal elements in generally rectangular blocks, which can be tiled with other blocks by butting their edges together so as to cover the entire surface. Each rectangular array can be thought of as a "grid" of coded positions. In some embodiments, each position is marked to represent one of two data, such as "-1" or "1". (In other embodiments, the two data could be "0" and "1").

[0285]

[0285] The applicant's U.S. Patent Application Publication No. 20040156529, cited above, describes how coded signals are applied by etching a mold with a data-holding pattern. After the desired data-holding pattern is determined, the pattern is used to texture the surface of plastic by forming plastic in the mold. For injection molding, the mold is etched by a computer-driven etching apparatus. Each cell in the output grid (array) pattern corresponds to, for example, a 250 × 250 micron patch on the mold. If the output grid pattern for a particular cell has a value of "1", a depression is formed in the corresponding patch on the mold surface. If the output grid pattern for a cell has a value of "-1" (or "0"), no depression is formed. The depth of the depression is determined considering aesthetic considerations. A typical depression has a depth of less than 1 / 2 millimeter and may be on the order of the patch size (250 microns) or less. The resulting pattern from mold pitting is a physical manifestation of the output grid pattern. If the mold is used to form the surface of the product container, a negative of this pattern is created, and each recess becomes a raised point on the container.

[0286]

[0286] The size of the textured area depends on the patch size and the number of rows / columns in the output grid pattern. A larger textured area provides more "signals" available for decoding, which can reduce the precision of the reader's specifications. A textured area with sides of approximately 1 centimeter has been shown to provide more than enough signal. Smaller textured areas (or larger textured areas) are available depending on the application requirements.

[0287]

[0287] To form the mold according to the output grid signal, technologies other than computer-controlled etching equipment can be used. A small computer-controlled milling machine can be used. A laser cutting machine can also be used.

[0288]

[0288] In other embodiments, the above approach assumes that the container already has a texture, but the container can be formed with a flat surface and then textured, for example, by using a heated press mold, assuming that the packaging material is thermoplastic.

[0289]

[0289] In order to emphasize the "signal" preserved by the texture processing, surface changes are applied that correspond to both the values ​​of "1" and "-1" in the output pattern grid (rather than simply corresponding to the value of "1" as described above). As a result, raised areas are formed with patches corresponding to the output pattern cells given the value of "1", and recessed areas are formed corresponding to the output pattern cells given the value of "-1".

[0290]

[0290] In other embodiments, texture can also be applied by an additional material layer applied to a container after it has been formed to have a desired output pattern. For example, viscous ink can be applied in screen printing. The screen has openings where the corresponding cells of the output grid pattern have a value of "1", and no openings elsewhere. When viscous ink is applied through the screen, small patches of ink are deposited where the screen has openings, and no deposits elsewhere.

[0291]

[0291] In such embodiments, depending on the resolution limitations of the screen printing process, patches larger than 250 microns may be used. As a result, even in this case, a textured surface is obtained having a pattern of raised regions that hold the binary data payload.

[0292]

[0292] Various materials other than ink can be applied to form a textured layer on the container. Thermoplastics and epoxy resins are two such alternative materials.

[0293]

[0293] In some such embodiments, techniques other than printing are used to impart a textured layer to the container. For example, various photolithography techniques can be used. One technique uses a photoreactive polymer, which is applied to the surface and then exposed through a mask corresponding to an output grid pattern. The exposed polymer is developed to remove patches of material.

[0294]

[0294] In yet another embodiment, the output grid pattern is printed on the container surface in two contrasting colors (e.g., black and white). Cells with a value of "1" are printable in one color, and cells with a value of "-1" are printable in the other color. In such an embodiment, the binary payload is not recognized from the texture pattern, but rather from the contrasting color pattern.

[0295]

[0295] Other patent documents of the applicant recognized herein detail other procedures for physically realizing 2D optical codes on an article, as further described in U.S. Priority Application No. 62 / 814,567.

[0296]

[0296] Various methods can be used to prevent signal distortion in the design and / or manufacture of plastic containers.

[0297]

[0297] In a first embodiment, signal coding is incorporated into the container mold during 3D printing of the mold. The inner surface of the mold that contacts the outer surface of the container is printed to include a complex texture, pattern, image, or design. This texture, pattern, image, or design holds the coded signal. For example, a raw sparse watermark signal is generated, as detailed in the published documents U.S. Patent Applications Publications 20170024840, 20190139176, and 20190332840. Here, the term "raw" is used to mean that the sparse watermark signal is combined with a host image or surface. The raw sparse watermark is used as a template to guide the 3D printing of the inner surface of the mold. The surface of the mold includes deformable protrusions and recesses that collectively (and often redundantly) hold the raw sparse watermark.

[0298]

[0298] The workflow is described below. A three-dimensional (3D) mold is designed using CAD software such as AutoCAD, Photoshop, Solidworks, Materialise, or many other CAD software programs. The CAD software defines the shape of the mold. For example, the mold may be shaped to produce a water bottle, a yogurt cup, or other container. A 2D encoded signal (e.g., a sparse watermark) is generated. At this point, the 2D watermark signal needs to be mapped onto the 3D inner surface of the mold, preferably in a way that minimizes distortion of the encoded signal.

[0299]

[0299] One approach to minimizing distortion is to utilize unidirectional pre-deformation based on the expected relative size of the container. Consider a drum-shaped container as an example. The radius of the middle section of such a container is smaller than the radii of the top and bottom. When a 2D rectangular watermark tile is mapped onto this container, different scaling may occur in the middle section compared to the top and bottom of the container. Therefore, the watermark tile may be stretched more in one spatial dimension (x-axis) compared to another spatial dimension (y-axis). This type of distortion is sometimes called differential scaling or differential deformation. Consider an example where the original watermark tile is rectangular. As a result of differential scaling, the rectangle may be distorted into a parallelogram with unequal sides. The differential scaling parameter defines the characteristics and range of this stretching. Differential scaling can cause certain problems for watermark detectors. Considering an embedded tile with x and y coordinates and a rectangle having equal x and y sides, when applied, the x dimension decreases in the middle of the container while the y dimension remains the same length overall. If the radius of the middle is approximately 0.75 relative to the radii of the top and bottom, when mapped onto the surface, the x coordinate shrinks by approximately 0.75*x while the y axis remains the same overall (1*y). As a result, differential scaling occurs on the x and y coordinates, similar to forming an image capture angle of approximately 41 degrees, making sparse watermark detection difficult.

[0300]

[0300] On the encoding side, one objective of the solution is to generate an encoded signal that, when drawn onto the surface of the mold, is within an orientation range detectable by the decoder. For example, it is preferable that the signal is within a range of scaling, rotation, and translation that the decoder can detect. Differential scaling is particularly difficult to realign for data extraction. To solve this differential scaling problem, efforts were made to ensure that the x and y coordinates of the tiles maintain similar dimensions relative to each other after mapping to the 3D surface. Therefore, the tiles are pre-strained in one direction before embedding. In particular, the tiles are pre-strained in the y direction by an amount similar to what would be predicted by some x-direction distortion. After pre-straining and mapping, the resulting embedded tiles are smaller, but consequently have similar dimensions with respect to the x and y edges. The y direction of various tiles placed on the surface can be individually determined by the relative size of the radius at each embedding position. The pre-strain changes across the mold based on the position where the tiles are placed on the 3D surface. (This identical distortion correction process can be used when labeling containers, for example, when applying heat-shrinkable labels to curved containers. The y-direction of the embedded tile can be modified to include the same expected expansion / contraction as the x-direction after heat shrinkage.)

[0301]

[0301] Another approach to minimize distortion is to utilize so-called UV texture processing (or mapping). UV texture processing utilizes polygons that make up a 3D object that is textured by surface attributes from a 2D image (e.g., a "UV texture map"). This texture map has coordinates U, V, while the 3D object has coordinates X, Y, Z. UV mapping places the pixels in the UV texture map onto the polygons. surfaceAssign to mapping. This can be achieved by copying triangular pieces of the UV texture map and pasting them onto triangles on the 3D object. UV texturing is an alternative mapping system that only maps objects into texture space, not geometric space. Rendering operations use UV texture coordinates to determine how to position the 3D surface. UV texturing can be used to preserve a 2D sparse watermark (or other 2D encoded signal) on the surface of a mold. Here, the sparse watermark is used as a UV texture map to texture the surface of the mold. Varying the grayscale levels within the UV texture map can be used to indicate the texture depth or height of the mold surface. The resulting textured surface of the mold preserves its watermark signal.

[0302]

[0302] When used in combination with advanced decoding techniques within a detector, such as those described in the assignee's patent documents, U.S. Patent No. 9,182,778 (e.g., including direct least squares for recovering geometric transformations within a detector), U.S. Patent No. 9,959,587 (e.g., using direct least squares for projection approximation and phase estimation in coordinate value correction and correlation metrics), U.S. Patent No. 10,373,299 (e.g., using direct least squares to improve projection distortion (slope) performance), and U.S. Patent No. 10,242,434 (e.g., a detector using a hybrid of supplementary methods for geometric alignment such as Log polar for low slope angles / weak signals and direct least squares for high slope angles), further detection improvements can be achieved when the above-mentioned one-dimensional scaling or UV texture mapping is used before 3D printing or laser texture processing. Such detection techniques help recover signals that were distorted during mold making and / or distorted during image capture of containers manufactured using such molds. For example, mold creation may introduce initial distortions associated with 2D mapping onto the surface of a 3D object, and image capture may introduce tilt, scaling, and / or rotation from the camera angle relative to the container.

[0303]

[0303] In further embodiments, distortion relief techniques described in the applicant's patent documents are used to compensate for the mapping of 2D signals to 3D molds. See, for example, U.S. Patents 6,122,403, 6,614,914, 6,947,571, 7,065,228, 8,412,577, 8,477,990, 9,033,238, 9,182,778, 9,349,153, 9,367,770, 9,864,919, 9,959,587, 10,242,434, and 10,373,299.

[0304]

[0304] The surface texture of the inner surface of the mold is used to generate an encoded signal in the plastic container. This texture is created by creating convex and / or concave areas on the mold surface, resulting in the formation of concave or convex areas in the container. For example, for sparse perforated tiles, each embedded position corresponds to, for example, an n × m inch patch of the mold. If an embedded position has a value of "1", a depression is formed in the corresponding patch on the mold surface. If an embedded position has a value of "-1", no depression (or concave area) is formed. Thus, raised areas are formed in the container corresponding to embedded positions with a value of "1", and unchanging areas (or concave areas) are formed in the container corresponding to embedded positions with a value of "-1". When an image of the marked container is analyzed, the convex and concave areas have different reflective properties. These differences can be analyzed to decode the encoded signal.

[0305]

[0305] Returning to the workflow, define the shape of the mold, generate a 2D encoded signal (e.g., sparse watermark), map the watermark signal to the 3D interior of the mold, and then create the corresponding 3D printer file format (e.g., STL, OBJ, AMF, or 3MF) to control the 3D printer. The 3D printer prints the mold, including the surface texture, according to its encoded signal pattern. Naturally, the 3D printer must be able to print at a resolution corresponding to that encoded signal pattern. For example, if the encoded signal pattern corresponds to 50 or 100 dots per inch, the printer must be able to replicate it.

[0306]

[0306] In other embodiments, instead of using sparse watermarks to guide the surface texture processing, signals generated by a neural network, or signals based on Voronoi, Delaunay, or pointillist halftoning, may be used. Such signals are described in the patent publications International Publication No. 2019 / 113471 and U.S. Patent Application Publication No. 20190378235.

[0307]

[0307] In other embodiments, encoding is performed on the mold surface by laser engraving, etching, embossing, or ablation. Machine-readable marks (held by surface topology changes within the mold) are applied to the plastic when the container is formed. Very fine texture patterns can be realized by laser engraving and tool etching. Recently, laser texturing for molds has advanced to the point of creating different depth levels. Multiple different depth levels can be used to hold different signal information. For example, in terms of signal values, the first depth may represent "1", the second depth may represent "0", and the third depth may represent "-1". As above, UV texture mapping and / or unidirectional pre-distortion can be used to suppress 2D to 3D conversion.

[0308]

[0308] Another issue with 3D printed molds, laser engraved molds, or etched molds is that the surface signal of the container must withstand the formation without degrading the final container (e.g., without creating areas that are too thin) and facilitate the release of the container from the mold (e.g., without it sticking to the mold). For example, if the mold creates a convex or raised area on the container, the corresponding depressions in the mold should be shaped to facilitate the release of the container from the mold. For example, if the mold includes a sharp, deep depression (corresponding to a sharp, high convex area on the container), the container may not release from the mold. The irregularities in the mold can be shaped in one direction, for example, in a teardrop shape (or dorsirock shape) in the mold release direction. Alternatively, the depressions can be shaped to match the draft angle for tool removal for the tool, material type and / or section shape.

[0309]

[0309] Similar considerations are required for sintered metal or ceramic parts in which the watermark is held by the surface texture. The watermarked part must be demolded from the mold without deformation before heating, and the watermark will deform along with the part during sintering. The expected deformation can be corrected by pre-straining the watermark signal.

[0310]

[0310] In yet another embodiment, the watermark texture may be formed by linear peeling ridges by modulation of the strip position. A mold having such linear ridges can be moved spatially and / or its size can be increased or decreased to represent the watermark signal. Details of mold making

[0311]

[0311] A specific example uses a sparse watermark signal to place shapes or structures at dot locations. Instead of marking with rectangular dots, the 3D surface topology is preferably formed with smoothed depressions, recesses or peaks shaped using curves such as Gaussian or sine curves. Another example forms line drawings or elemental features (circles, lines, ellipses, etc.) that coincide with the peaks and / or valleys of a continuous watermark signal. Another example forms 3D surface patterns of signal-rich art designs described in International Publication 2019 / 113471 and U.S. Patent Application Publication 20190378235, to name a few examples, including but not limited to Voronoi, stippling, Delaunay, and Traveling Salesman patterns. In such examples, the topology is formed such that the cross-section of the surface peak or depression pattern is smoothed (for example, in the form of a sinusoidal or Gaussian curve cross-section). The feasible cross-section depends on the type of marking (CNC milling, laser marking, 3D printing) and should be designed to ensure proper part release from the mold. Contour smoothing will solve this problem.

[0312]

[0312] The following example illustrates the design challenges involved in converting two-dimensional data containing signals into a template.

[0313]

[0313] When selecting a signal type (e.g., continuous, binary, or sparse), various factors are involved, including the type of plastic being molded (PET, PP, PE, HDPE, LDPE, etc.), the type of manufacturing process (e.g., blow molding, injection molding, thermoforming, etc.), the type of mold (metal, ceramic, etc.), the mold making process (etching, engraving, etc.), aesthetic characteristics, and the attributes of the camera / lighting used for detection. In particular, continuous signals typically require high resolution in both space and depth (embossing, debossing, etching, etc.). Binary signals typically have high spatial resolution but low depth resolution. Sparse binary signals can be implemented when both the available spatial and depth resolutions are low, such as when thermoforming is performed. (Blow molding and injection molding achieve better accuracy compared to thermoforming).

[0314]

[0314] Another factor to consider is the ratio of the reference (synchronization) signal strength to the message signature strength. Ensuring a sufficiently strong message signal strength relative to the synchronization signal component improves the reliability of digital payload recovery. For sparse and binary marks, the synchronization signal to message signal ratio can be heuristically determined based on the specified watermark resolution, image resolution, dot size, number of dots per tile, and payload size. Different sets of heuristic methods can be created for different plastic types, mold types, etc. For example, the properties of the plastic (e.g., the intrinsic viscosity of sheet-grade, bottle-grade, and film-grade PET) may determine how effective the molded plastic is in preserving the spectral features of the watermark signal (e.g., low-frequency vs. high-frequency). Similar considerations apply to continuous and binary signals.

[0315]

[0315] Another factor to consider is the watermark signal resolution. The resolution of the watermark signal in each signal block (tile) should be sufficiently high to achieve the desired aesthetic characteristics while minimizing the geometric deformation caused by the curvature of the object across each tile by making the watermark payload readable from smaller tiles. In one example, a recommended resolution is 200 watermark cells (waxels) (WPI) or higher per inch. For a tile size of 128 × 128 waxels, the tile dimensions for a 200 WPI tile are therefore 0.64 inches × 0.64 inches.

[0316]

[0316] In addition to improving detection of objects with shapes other than rectangles, high-resolution watermarks enable improved detection of flattened, crushed, deformed, or shredded objects, such as those found in recycling streams.

[0317]

[0317] Reducing the dot density of each perforated tile offers several advantages. For example, the visibility of the signal pattern of the molded object is reduced, which means less interference with the visual quality and aesthetic characteristics of the object. In transparent containers, this signal pattern has less visual impact on the contents of the container (e.g., water in a transparent plastic water bottle). Furthermore, since dots are converted into protrusions or recesses / indentations / grooves on the surface of the object, fewer dots mean smaller dot spacing, making it easier to form the corresponding shape in the mold. Techniques for creating the topology of the mold surface (e.g., protrusions or recesses / indentations / grooves) include, for example, laser engraving, etching, electrical discharge machining (e.g., so-called spark erosion), computer numerical control (CNC) milling, or 3D printing. When using CNC milling bits, care can be taken to ensure sufficient resolution. Marking devices with a larger marking width can be used to remove surface material and leave curved protrusions with a diameter smaller than the bit width. The bit shape can be varied to achieve the desired dot representation, including, for example, conical bits, triangular bits, circular cross-sections, and ball mills. Furthermore, the depressions do not need to be deep, but variations in brightness can be used. The fewer convex / concave parts that are spaced further apart, the smoother the contours of the convex and concave parts of the mold become.

[0318]

[0318] Dot density can be expressed as the ratio of dots to the tile having the maximum ratio of dot range. The maximum ratio of dot range in a watermark signal tile that contains or does not contain any dots per cell is 50%. This means that half of the cells (waxels) in that tile are marked with dots (e.g., dark values). The dot density should decrease as visibility decreases, preferably between 10 and 35 (meaning 5 to 17.5% of the tiles marked with dots).

[0319]

[0319] The dot size is described above. The dot size is a parameter that controls the size of the elemental dot structure in a sparse signal. The dot size for a particular image resolution is expressed in dots per inch (DPI), for example, 600 DPI means 600 pixels per inch. The dot size is an integer value that indicates the dimensions of a dot along one axis of a pixel at a given image resolution. A dot size of 1 means that the dot is 1 pixel. A dot size of 2 means that the dot is 2 pixels (for example, consisting of a row and a column in a two-dimensional array of pixel coordinates, or consisting along a diagonal). For example, at 600 DPI, a dot size of 1 or 2 would be a dot width of 42 or 84 microns. Since the bits only need to be partially pressed into the surface of the aluminum mold, indentations with this dot width can be formed with larger bit sizes (e.g., 257 microns).

[0320]

[0320] Dots can have a variety of shapes. While rectangular dots can be easily represented in the form of pixels in images, there may be shapes and structures that are more suitable for encoding signals in physical materials such as plastic or metal. Examples include circles, ellipses, and lines. Smooth shapes may be easier to form than shapes with sharp edges or corners (for example, due to the ease of manufacturing the mold).

[0321]

[0321] Various types of plastics, molds, and mold making enable marking at various depths on the surface of plastics, such as deeper or shallower markings. Generally, the deeper the usable marking, the lower the usable dot density, while shallower marks typically use high-density dots. Deeper marks are more likely to withstand workflow changes such as surface abrasion, planarization, and grinding.

[0322]

[0322] The image signal representation of the watermark tile provided for conversion to a 3D surface topology for the mold may be a vector or raster image file such as an SVG image format. For example, to create the file in combination with the applicant Digimarc Corp's watermark tool plugin, an image editing tool such as Adobe Photoshop, a design tool such as Adobe Illustrator, or signal processing software such as MathWorks MATLAB can be used.

[0323]

[0323] In electronic image files, dots can have various shapes. Rectangular dots can be easily represented in the form of pixels in an image, but various shapes and structures are generally more suitable for encoding signals in physical materials such as plastic or metal. Examples include circles, ellipses, and lines. For example, smoother shapes are easier to reproduce than shapes with sharp edges or corners, due to the ease of manufacturing the mold. Vector representation allows dots to be defined in terms of dot shapes that are beneficial for the aesthetic properties of the finished molded product and also for the performance of the mold. Factors to consider regarding mold performance include tapering, smoothing, or contouring of recesses or protrusions for demolding the molded part from the mold. In a simple example, dots have a circular shape, for example, to facilitate molding onto the surface of an aluminum mold using a CNC machine. The 3D structure of its shape, along with manufacturing (e.g. demolding), relates to the ease of induced brightness changes that maintain the modulation necessary when encoding the watermark signal. Forms of signal-rich art (such as those described in U.S. Patent Application Publication No. 20190378235 and International Publication No. 2019 / 113471) can be created by selectively placing objects of a desired shape at dot locations and / or drawing vector art through the dot locations so that the vector art at the dot locations is highly correlated with the watermark signal.

[0324]

[0324] The resolution of the tile image (e.g., in DPI units) determines the granularity of the modulation performed on the material. The use of high resolution (e.g., 600 DPI) provides greater flexibility when designing features (e.g., dots or other structures) that can be subjected to embossing, debossing, etching, milling, electrical discharge machining, etc. The use of high resolution further provides greater flexibility during signal formation, for example when creating sparse binary marks, by giving a greater margin in the selection of prohibited areas, dot shapes, sizes, etc. Examination of example watermarking methods

[0325]

[0325] In the exemplary watermarking method, a multi-symbol message payload (e.g., 48 binary bits that may represent a global trade identification number (GTIN) or plastic recycling information for a product, along with 24 associated CRC bits) is applied to an error-correcting encoder. This encoder uses an error-correcting method to convert the symbols in the message payload into a very long array of encoded message elements (e.g., binary or M-value elements). (Suitable encoding methods include block codes, BCH, Reed-Solomon, convolutional codes, turbo codes, etc.). The output of the encoder may include hundreds or thousands of binary bits, such as 1024, which may be called raw signature bits. These bits may be scrambled by performing an exclusive OR operation using a scramble key of the same length, thereby generating a scrambled signature.

[0326]

[0326] Each of the scrambled signature bits modulates a 16-length pseudo-random noise modulation sequence (spreading carrier wave) by, for example, performing an exclusive OR operation. Each of the scrambled signature bits thus generates a modulated carrier wave sequence of 16 "chips," generating a scrambled expanded payload sequence consisting of 16,384 elements. This sequence is mapped to elements of a rectangular block having 128×128 embedding positions according to the data in the scattering table, generating a 2D payload signature pattern. (For each of the four 64×64 quadrants of the 128×128 block, the scattering table assigns 4 chips for each scrambled signature bit). Each position in the 128×128 block is associated with either a value of 0 or 1, or black or white, and approximately half of the positions have each state. These two-mode signals are often mapped to larger two-mode signals centered on 128 8-bit grayscale values, for example, with values ​​of 95 and 161. Each of these embedding locations may correspond to a small area of ​​pixels, such as a 2x2 patch, called a "bump," generating a watermark message block with dimensions of 256x256 pixels.

[0327]

[0327] As described above, a synchronization component is generally included in the digital watermark to help recognize the parameters of any affine transform to which the watermark has been applied before decoding, thereby enabling the payload to be accurately decoded. A particular synchronization component takes the form of a reference signal consisting of several tens of magnitude peaks of a sine curve with pseudorandom phase in the Fourier domain. This signal is transformed (e.g., by an inverse fast Fourier transform) into a spatial domain of 256 × 256 block size, corresponding to the 256 × 256 blocks to which the scrambled augmented payload sequence is mapped. The spatial domain reference signal, which may contain floating-point values ​​between -1 and 1, can be scaled to a range of -40 to 40 and combined with the 256 × 256 pixel payload blocks to generate a final watermark signal block with values ​​in the range of, for example, 55 (i.e., 95-40) to 201 (i.e., 161+40). This signal can then be aggregated with the host image after a first reduction, which is shown inconspicuously.

[0328]

[0328] When such a watermark signal block is printed at a spatial resolution of 300 dots per inch (DPI), the resulting print block is approximately 0.85 square inches. (A side dimension of 0.85 inches corresponds to 128 waxels, resulting in 150 waxels per inch). Such blocks can be tiled together by butting the edges to mark a larger surface.

[0329]

[0329] The watermark signals described above are sometimes called "continuous" watermark signals. Continuous watermark signals are typically characterized by multi-level data, i.e., not simply on / off (or 1 / 0 or white / black), and are therefore called "continuous." Each pixel in the host image (or region within the host image) is associated with one corresponding element of the watermark signal. Most pixels in this image (or region of the image) change their value in combination with their corresponding watermark element. These changes are usually both positive and negative, for example, changing to increase the local brightness of the image at one location and decreasing it at another. Furthermore, the degree of change may vary, with some pixels changing relatively little and others changing relatively much. Typically, the amplitude of the watermark signal is small enough that its presence in the image is not noticed unless carefully examined (i.e., it is steganographic).

[0330]

[0330] (Due to the high redundancy of the encoding, some embodiments can ignore pixel changes between directions. For example, in one such embodiment, only the pixel value changes in the positive direction. Pixels that normally change in the negative direction remain unchanged.)

[0331]

[0331] In a deformed continuous gradation watermark, the signal acts to not change the local luminance of the artwork pixels, but it does change their color. Such a watermark is called a "chrominance" watermark (rather than a "luminance" watermark). For example, an example is detailed in U.S. Patent No. 9,245,308.

[0332]

[0332] Sparse or binary watermarks differ from continuous-tone watermarks. Sparse or binary watermarks do not alter most of the pixel values ​​of the host image (or image area). Rather, the resulting print density is between approximately 5% and 45% of the pixel positions in the image (which may be user-defined). Adjustments are usually all made in the same direction, such as reducing brightness. Sparse elements are usually binary, for example, either white or black. Sparse watermarks may be formed on other images, but are usually presented on areas of blank or uniformly colored artwork. In such cases, the sparse mark contrasts with its background, making it visible without careful observation. Sparse marks may take the form of areas of seemingly random dots, but can also take the form of linear structures, as detailed elsewhere. When continuous grayscale watermarks are present, sparse watermarks typically take the form of signal blocks tiled across a region of the image.

[0333]

[0333] Sparse watermarks can be created from continuous grayscale watermarks by thresholding. That is, the darkest elements of the combined reference signal / payload signal blocks are copied to the output signal blocks until the desired dot density is obtained.

[0334]

[0334] U.S. Patent Application Publication No. 20170024840 details various other forms of sparse watermarking. In one embodiment, a signal generator starts with a 128 × 128 input. One is a payload signal block, where, as described above, its positions are amplified and scrambled payload sequence of binary values ​​(0 / 1 or black / white). The other is a spatial domain reference signal block, where each position is assigned a floating-point number between -1 and 1. The darkest (most negative) "x"% of those reference signal positions are recognized and set to black, and the rest to white. The spatially corresponding elements of these two blocks are logically ANDed together to find a match of black elements between the two blocks. These elements are set to black in the output block, while the other elements remain white. By setting "x" higher or lower, the output signal block can be made darker or lighter.

[0335]

[0335] U.S. Patent Application Publication No. 20190332840 details further embodiments of sparse coding. One embodiment uses a reference signal generated at a relatively high resolution (e.g., 384 × 384 pixels) and a payload signature spanning a relatively low resolution (e.g., 128 × 128) array. The latter signal has only two values ​​(i.e., two-tone), while the former signal has more values ​​(i.e., multi-level, such as binary grayscale, or multi-level, consisting of floating-point values). The payload signal is interpolated to a higher resolution than the reference signal, and in its processing, is converted from two-tone form to multi-level. These two signals are joined at high resolution (e.g., by summing them in a weighted ratio), and a thresholding operation is applied to the result to identify the locations of polar (e.g., dark) values. These locations are marked to generate sparse blocks (e.g., 384 × 384 sparse blocks). This threshold level determines the dot density of the resulting sparse marks.

[0336]

[0336] Another embodiment classifies samples in a block of the reference signal by value (darkness) to create a ranked list of the darkest N positions (e.g., position 1600), each having a position (e.g., within a 128 × 128 element array). The darkest positions of those N positions are always marked in the output block (e.g., position 400 or position P) so that the reference signal is strongly represented. The rest of the N positions (i.e., positions NP or Q) are marked or not marked depending on the value of the message signal data mapped to such positions (e.g., by the encoder's scattering table). Sparse block positions that are not among the darkest N positions (i.e., not among the P or Q positions) are never marked and are consequently reliably ignored by the decoder. By setting the number N to be larger or smaller, sparse marks with more or fewer dots are generated. (This embodiment is referred to as “Fourth Embodiment” in U.S. Patent Application Publication No. 20190332840 referenced above).

[0337]

[0337] When generating sparse marks, spacing constraints can be applied to candidate mark positions to prevent concentration. These spacing constraints may take the form of a circular, elliptical, or other (e.g., irregular) forbidden area. The forbidden area may have (or may not have) two or more or fewer axes of symmetry. Enforcing the spacing constraint can be done using an associated data structure having one element for each position in the tile. When a dark mark is added to the output block, corresponding data is stored in a data structure that identifies the positions that have become unavailable for potential markings due to the spacing constraint.

[0338]

[0338] In some embodiments, the reference signal can be adjusted to appear non-randomly by changing the relative amplitude of the spatial frequency peaks, so that not all spatial frequency peaks have equal amplitudes. Such changes in the reference signal consequently affect the appearance of sparse signals.

[0339]

[0339] Sparse patterns can be represented in various forms. The simplest form is a seemingly random pattern of dots. However, more artistic depictions are also possible, including those described and illustrated above.

[0340]

[0340] Other obvious artistic patterns that retain watermark data are described in detail in the patent document, U.S. Patent Application Publication No. 20190139176. In one approach described, the designer creates candidate artwork designs or selects one from a library of designs. Vector art in the form of lines or small discontinuous printed structures of the desired shape works well in this approach. The payload is input to a signal generator, which generates raw data signals in the form of two-dimensional tiles of data signal elements. This method then edits the artwork at its spatial location according to the data signal elements at that spatial location. Once artwork with the desired aesthetic quality and robustness is generated, it is applied to the object, for example, by laser marking.

[0341]

[0341] Other techniques for generating visible artwork with robust data signals are detailed in the assignee's patent applications, U.S. Patent Application Publication No. 20190213705 and Pending Application No. 62 / 841,084 filed April 30, 2019. In some embodiments, a neural network is applied to an image containing machine-readable code to transform its appearance while maintaining machine readability. One particular method involves training a neural network with style images having various features. The trained network is then applied to an input pattern that encodes a multi-symbol payload. The network adapts features from the style images to represent details of the input pattern, thereby generating an output image in which features from the style images contribute to encoding the multi-symbol payload. This output image can then be used as a graphical component of product packaging, such as a background, border, or pattern fill. In some embodiments, the input pattern is a watermark pattern, while in other embodiments, the input image is a pre-watermarked host image.

[0342]

[0342] Other such techniques do not require a neural network. Instead, the watermark signal block (i.e., the reference and message signals) is broken down into subblocks. The style image is then analyzed to find the subblock with the highest correlation to each of the watermark signal subblocks. The subblocks from that style image are then mosaicked together to produce an output image that visually resembles the style image but has signal characteristics that approximate the watermark signal block.

[0343]

[0343] In addition to the references cited elsewhere, further details regarding watermark coding and reading that may be included in embodiments of this technology can be found in U.S. Patents Nos. 5,850,481, 6,122,403, 6,590,996, 6,614,914, 6,782,115, 6,947,571, and 6,97 No. 5,744, No. 6,985,600, No. 7,044,395, No. 7,065,228, No. 7,123,740, No. 7,130,087, No. 7,40 No. 3,633, No. 7,763,179, No. 8,224,018, No. 8,300,274, No. 8,412,577, No. 8,477,990, No. 8,54 U.S. Patent Publication Nos. 3,823, 9,033,238, 9,349,153, 9,367,770, 9,521,291, 9,600,754, 9,749,607, 9,754,341, 9,864,919, 10,113,910, 10,217,182, and U.S. Patent Application Publication No. 201 This is disclosed in the applicant's previous patent applications, including U.S. application No. 60364623, and pending U.S. applications No. 16 / 270,500 filed on 7 February 2019, No. 62 / 814,567 filed on 6 March 2019, No. 62 / 820,755 filed on 19 March 2019, and No. 62 / 946,732 filed on 11 December 2019.

[0344]

[0344] Although the above techniques are often described in the context of watermarking prints, similar techniques can be used for watermarking based on 3D textures / shapes. Sparse dots and line elements of binary marks can be represented by protrusions (or depressions) on a 3D surface.

[0345]

[0345] Similarly, the positive and negative changes in pixel values ​​associated with continuous grayscale can be represented by spatial changes in the 3D surface height. In some configurations, the surface is modified in only one direction, for example by protrusions raised from the surface. In other configurations, the surface may be modified in the opposite direction by both protrusions raised from the 3D surface and recesses (concave) recessed below the 3D surface.

[0346]

[0346] When the surface is changed in only one direction, one embodiment ignores negative changes in the watermark value and the surface is changed only by positive changes. Another embodiment ignores positive changes in the watermark signal and the surface is changed only by negative changes. In both such embodiments, the surface change may be in either a positive protrusion direction or a negative recess direction.

[0347]

[0347] In yet another embodiment, the most negative change (extreme value) of the continuous watermark signal does not correspond to a change on the surface, while a change gradually moving positive from this extreme value corresponds to a gradually increasing surface change (either a protrusion or a depression). In yet another embodiment, the most positive change of the continuous watermark signal does not correspond to a change on the surface, while a change gradually moving negative from this value corresponds to a gradually increasing surface change (again, either a protrusion or a depression).

[0348]

[0348] When the surface is varied in two directions, negative values ​​of the continuous grayscale watermark signal can correspond to depressions in the surface (depth depends on the negative signal value), while positive values ​​of the watermark signal correspond to protrusions from the surface (height depends on the positive signal value). In other embodiments, the polarity is switchable, and positive values ​​of the watermark signal correspond to depressions in the surface, and vice versa. The depth of the deepest depression and the height of the highest protrusion may be equal, but are not required. The same applies to the average depth of the depression and the average height of the protrusion. The depth / height may be asymmetrical, as a DC offset is applied to the continuous grayscale watermark signal.

[0349]

[0349] When the surface can be altered in two directions, it is desirable that both the recess and the protrusion hold the watermark payload information (unlike the configuration of U.S. Patent Application Publication No. 20180345323, which teaches that only one or the other holds the payload information).

[0350]

[0350] A recycling system including individually configurable sorting boxes (or compartments) will be described with reference to Figures 32A and 32B. The recycling system includes two stages, although its functions can be combined into one or more stages. One or more sorting units have a light source, an image capture unit, a watermark reader, and a control logic circuit. The sorting unit reads watermark information from image data indicating plastic objects in the waste stream. This information can indicate the type of plastic (e.g., polyethylene terephthalate, high-density polyethylene, low-density polyethylene, polypropylene, polycarbonate, etc.) or can hold other information useful in recycling. Diverters and / or other mechanisms are controlled according to such watermark information to send the plastic objects to the appropriate sorting destination for recycling or reuse. In the first stage shown on the left side of Figure 32A, the plastic objects (or other container materials) are initially sorted in a binary manner, such as being sorted into coded compartments and uncoded compartments. The unencoded category includes plastics that do not have detectable watermarks. The unencoded category includes plastics that originally did not have watermarks and plastics that have deteriorated to the point where any original watermark is undetectable. The encoded category includes plastics that have detectable watermarks.

[0351]

[0351] The coded plastic is further processed according to the second step shown on the right side of Figure 32A. Although Figure 32A shows two separate processing steps, the first step (left side of the figure) and the second step (right side of the figure) can be combined into one or more steps.

[0352]

[0352] Referring to Figures 32A and 32B, the coded plastic is passed under or through the sorting unit at a speed of, for example, 1 to 3 m / s, more preferably 5 to 9 m / s, for example 5 m / s. In one embodiment, the coded plastic is passed one at a time, and in other embodiments, the coded plastic is passed in groups.

[0353]

[0353] The sorting unit comprises a light source(s), an image capture unit(s), a watermark reader(s), and a control logic circuit. For example, the light source(s) may have LEDs(s), and the image capture unit may have one or more cameras or image sensor arrays. The watermark reader operates to decode the watermark from an image frame representing an encoded plastic. The watermark reader provides the control logic circuit with the decoded watermark data to control the control logic circuit in order to control sorting diverters that can be individually sorted along the stream sorting path.

[0354]

[0354] The configuration in Figure 33A shows an embodiment of a sorting unit having multiple light sources arranged along the direction of movement of a conveyor (waste stream). In an alternative embodiment, the light sources are arranged transverse to the direction of movement of the conveyor, rather than coinciding with the direction of movement of the conveyor. In yet another embodiment, one or more light sources are arranged along the direction of movement of the conveyor (as shown), and one or more light sources are arranged transverse to the direction of movement. Different light sources can be activated for alternating frames of image capture by a camera (which may capture frames at a rate of, for example, 150, 300, or 500 frames per second). For example, one frame may be illuminated by one light source, and the next frame by another light source. Alternatively, if multiple image sensors are used, or if image sensors with two or more color filters are used, multiple light sources may be activated simultaneously, with the first sensor capturing an image corresponding to the first light source, the second sensor capturing an image corresponding to the second light source, and so on.

[0355]

[0355] In a specific example, the three light sources in Figure 33A include a red LED (for example, between 620nm and 700nm, with a peak irradiation referred to as "660nm or around 660nm"), a blue LED (for example, between 440nm and 495nm, with a peak irradiation referred to as "450nm or around 450nm"), and an infrared (or near-infrared) LED (for example, between 700nm and 790nm, with a peak irradiation referred to as "730nm or around 730nm"). Furthermore, in specific examples, a red LED has a narrowband center wavelength between 650nm and 670nm, for example, 660nm, and a half-wave height total width ("FWHM") of emission of 30nm or less; a blue LED has a narrowband center wavelength between 440nm and 460nm, for example, 450nm, and an FWHM of emission of 30nm or less; and an infrared (or near-infrared) LED has a narrowband center wavelength between 720nm and 740nm, for example, 730nm, and an FWHM of emission of 40nm or less.

[0356]

[0356] In another specific example of the sorting unit shown in Figure 33B, the two light sources include a blue LED (for example, between 440nm and 495nm, with a peak irradiation referred to as "450nm or around 450nm") and an infrared LED (for example, between 700nm and 790nm, with a peak irradiation referred to as "730nm or around 730nm"). In an even more specific example, the blue LED has a peak irradiation between 440nm and 465nm, for example at 450nm, and the infrared LED has a peak irradiation between 710nm and 740nm, for example at 730nm.

[0357]

[0357] In another specific example of the sorting unit, ambient light is used to illuminate the object to be encoded.

[0358]

[0358] The image capture unit(s) of the sorting unit have one or more cameras or image sensor arrays for capturing images or image frames corresponding to various LED illuminations. These cameras or image sensor arrays can be positioned around the LEDs at various locations (or vice versa), as described in this patent document, for example.

[0359]

[0359] In an alternative embodiment, referring to Figures 33C and 33D, it is preferable that each point on the belt in the field of view is illuminated by a diffuse light source from multiple directions with each light color. The LED light is preferably focused by a lens with at least 40 degrees FWHM perpendicular to the belt operating range. Along the belt operating range, it is preferable that the light comes from at least two directions (e.g., two light bars) about 10 to 25 degrees from the camera axis. The light can be positioned at least 50 cm away from the belt to minimize the difference between the near and far fields of view. Each light source can be focused to illuminate the field of view (FoV). Furthermore, light diffusion above the LED lens is recommended, and a suitable depth of field (DoF) is at least about 10 cm. The use of camera gain (digital or analog) is not recommended to maximize the SNR. The captured image is monochrome and has, for example, an 8-bit dynamic range without compression.

[0360]

[0360] The image capture unit may have one or more monochrome cameras, for example, with 8 bits or more and a capture speed of up to 300 to 700 frames per second (FPS). The number of frames per second depends to some extent on the conveyor belt speed. For example, at least 300 FPS is preferred for a belt speed of 3 m / s (e.g., enabling 150 FPS for frames illuminated with red LEDs + 150 FPS for frames illuminated with blue LEDs). However, at least 500 FPS is preferred for a belt speed of 5 m / s (e.g., enabling 250 FPS for frames illuminated with red LEDs + 250 FPS for frames illuminated with blue LEDs). The recommended maximum camera exposure time is about 60 μs for a 3 m / s belt, or about 40 μs for a 5 m / s belt. A monochrome surface scan camera with a global shutter can be used to minimize motion artifacts. In this alternative embodiment, as shown in Figure 33C, the optical axis of the camera is perpendicular to the conveyor belt. The sampling resolution of a camera at a distance of 50 cm from the belt can be measured in pixels, for example, 150-600 pixels per inch, or 170-180 PPI in one example. The camera(s) are preferably positioned so that the FoV captures the entire width of the belt, and if multiple cameras are used, at least 2 cm of FoV overlap is preferred. Regarding the belt length FoV, it is preferable that at least 14 cm of the belt is captured along the direction of belt movement. A lens aperture of f / 5.6 or less, such as f / 8, is recommended.

[0361]

[0361] The light source can operate in pulse mode and synchronize with the camera, and can operate periodically by combining different color LEDs. For example, two frames can be generated by illuminating the first frame with a 730nm LED and the second frame with a 450nm LED, or by illuminating the first frame with a mixture of a 730nm LED and a 450nm LED and the second frame with a 660nm LED.

[0362]

[0362] In the exemplary embodiment, the sorting unit has a watermark reader or decoder that analyzes the resulting image frame to find watermark data and searches for both printed label watermarks and plastic watermarks as shown in Figure 34, or more generally, one or more watermarks held by plastic as shown in Figure 35. The watermark payload data can be used as input(s) to the sorting unit's control logic circuit(s) (e.g., diverter control logic circuit). In one embodiment, the watermark payload data is provided to a database that indexes relevant information, which is then provided to the control logic circuit. The diverter control logic circuit controls various sorting diverters arranged along the path in Figure 32B, such as one or more conveyors, rollers, or a path including a free-fall path.

[0363]

[0363] Referring to Figure 36A, a watermark reader (housed within or communicating with the sorting unit shown in Figures 32A and 32B) decodes the watermark from the captured image frame. In one example, the decoded watermark includes a GTIN (and possibly other data). A data structure 122, such as a table or database, can be used to determine the sorting box value. The data structure 122 associates the item GTIN with corresponding information about the encoded plastic container. That is, this data structure is queried with the GTIN identifier decoded from the watermark, so that the system can access pre-stored data that identifies, for example, the sorting box value (and other information such as plastic type, subtype, and / or color) for a product having that GTIN. The sorting box value information can be provided to a logic circuit that controls the sorting diverter. This allows sorting boxes to be individually designated along the recycling route.

[0364]

[0364] Referring back to Figure 32B, the control logic circuit uses the sorting box value information to activate one or more sorting diverters along the waste recycling route to sort the encoded plastic articles into specific sorting boxes. Consider an example where brand X manufactures three different types of plastic containers, including container A (encoded with GTIN A), container B (encoded with GTIN B), and container C (encoded with GTIN C). Brand X is very interested in recycling its containers to help minimize their material costs. Data structure 122 is updated to include the sorting box locations associated with the GTINs of containers A, B, and C (Figure 36B). The sorting unit decodes the watermark containing GTIN B from the plastic articles on the conveyor. The sorting unit queries data structure 122 using GTIN B to find the associated sorting box value, in this case "brand X, sorting box B". The control logic circuit uses its sorting box value to activate the "sorting diverter - brand X, sorting box B" to place the corresponding plastic items into sorting box B for brand X. The control logic circuit may also activate the "sorting diverter - brand X, sorting box B" using other data related to the recycling system, such as the conveyor speed and the physical location of sorting box B for brand X along the path. If no sorting box value is associated with a particular GTIN, the corresponding plastic container can be sorted based on the material type, subtype, or other information contained within the data structure 122. The decoded watermark data and associated sorting events can be logged to provide statistics on the waste stream being processed.

[0365]

[0365] From the above, it will be recognized that the technical problem was binary level sorting (e.g., coded or uncoded). However, by using the technology of this disclosure, N-value sorting (or sorting where the sorting destination can be specified individually) can be achieved. This level of sorting enables container-by-container recycling, ensures material purity, and helps reduce the use of non-recycled raw materials.

[0366]

[0366] Figure 37 illustrates an overview of the ecosystem, including the recycling system shown in Figures 32A and 32B. This ecosystem clearly outlines the elements of the container lifecycle, including supplying finely separated bales to dedicated composite material reprocessing and ultimately producing recycled materials that are comparable to, or can replace, non-recycled material supplies.

[0367]

[0367] The illustrated recycling system will increase knowledge about how to design the reuse and recycling of products made of composite or multilayer materials ("circular design"). Another benefit is that it will increase knowledge about the overall environmental footprint of containers, including the net effect on greenhouse gas emissions of improved sorting, separation, and recycling of composite and multilayer materials. conclusion

[0368]

[0368] The principles of the present invention have been described and illustrated with reference to explanatory examples, but it should be understood that the art is not limited thereto.

[0369]

[0369] For example, the embodiments described involve images captured using visible light, but this is not essential. Other forms of lighting, such as ultraviolet or infrared light, can be used as alternatives.

[0370]

[0370] Although plastic bottles have been described as including both printed watermarks and textured watermarks, it will be understood that certain techniques of this technology make improvements to textured watermarks regardless of the presence or absence of printed watermarks. For example, a plastic bottle on which recycling information is encoded using a pattern as shown in the figure is an improvement over conventional marking of plastic containers with recycling data (markings tend to be conspicuous and detract from the aesthetic characteristics of the packaging). Similarly, other improvements, such as detailed cues to distinguish empty conveyors from non-empty conveyors, are applicable to watermarking in general.

[0371]

[0371] In various detailed embodiments, print watermarks and texture watermarks use a reference signal that includes peaks at different spatial frequencies, but this is not essential to avoid confusion. In other embodiments, both watermarks use a reference signal that includes peaks at the same spatial frequencies, in which case the watermarks can be distinguished (e.g., by a dedicated sales terminal) using other attributes of their protocols. For example, a version of the bit string encoded in variable data can be used to distinguish a print label watermark from a textured plastic watermark. (In the exemplary signal protocol, a 1024-bit message string is formed as a concatenation of (a) a 100-bit string indicating the protocol version, followed by (b) a 924-bit string based on 47 bits of payload data. The latter bits are formed by concatenating the 47 bits of payload data with 24 corresponding CRC bits. The 71 bits are then convoluted at a rate of 1 / 13 to produce 924 bits. Thus, the bit string indicating the protocol version represents approximately 10% of the signal energy.) Alternatively, the reference signal for one watermark can use spatial frequency peaks that are a subset of the peaks used in the reference signal for the other watermark.

[0372]

[0372] If the two watermark reference signals share some or all of the same spatial frequency peaks, to avoid confusion, the peaks of one reference signal may be assigned to a different phase than the peaks of the other reference signal. If sufficient false detection behavior cannot be obtained by differentiating the two watermarks by peak phase, additional checks can be performed. For example, the phase may be checked twice with respect to two different corresponding parts of the captured image. These corresponding parts may be consecutive image frames or a single image frame processed to generate two images. For example, Gaussian noise may be added to generate the second image. Alternatively, the second image may be generated by discarding even the rows and columns of pixel data from the first image. There are many such possibilities. The result is reliable only if the two phase-based identifications of the watermark signals from the two corresponding images match.

[0373]

[0373] In yet another embodiment, to avoid confusion, the two watermarks use different scramble keys, or different diffusion keys, or different diffusion tables.

[0374]

[0374] In embodiments in which the reference signals of two watermarks commonly use spatial frequency peaks, the processing configuration can be simplified. For example, since a common set of reference signal peaks is generated by synchronizing the scaling and rotation of both watermarks, such synchronization can be performed by a common processing stage. Such methods are described in detail, for example, in the patent application documents U.S. Provisional Patent Application No. 62 / 834,260 filed April 15, 2019 and U.S. Provisional Patent Application No. 62 / 834,657 filed April 16, 2019.

[0375]

[0375] In a particular detector, a "supergrid" reference signal structure is used that includes all peaks from both reference signals. The scaling and rotation of the input image are determined by synchronization with a composite reference signal, etc. Once such synchronization is achieved, it is easy to determine whether the input image contains one reference signal or the other by, for example, looking for and inspecting a unique peak or phase in one of the two reference signals.

[0376]

[0376] The above-described embodiment uses a reference signal consisting of peaks in the Fourier amplitude domain, but it should be understood that the reference signal can exhibit peaks in different conversion domains.

[0377]

[0377] In relation to this, the watermark signal does not need to include a separate reference signal for the purpose of geometric synchronization. In some cases, the payload portion of the watermark signal itself has known embodiments or structures that enable geometric synchronization that does not depend on a separate reference signal.

[0378]

[0378] The term "watermark" generally refers to a mark that is not noticeable to humans, i.e., steganographic. Steganographic watermarks can be beneficial, but are not essential. Watermarks that form obvious, conspicuous patterns to humans can be used in embodiments of this technology.

[0379]

[0379] In the embodiment of Figure 13, the GTIN payload data field from the label watermark is used to access information such as the corresponding plastic type from the database, but this is not mandatory. For this purpose, other fields of the label watermark can be used, for example, to detail the various data types mentioned here. In fact, the use of a database in combination with the label watermark is not mandatory, and the payload can directly hold the plastic data, for example, in one of the application business identifier key-value pairs.

[0380]

[0380] Similarly, although GTIN information is generally encoded only in label watermarks, in some embodiments plastic texture watermarks can also encode that information. In such cases, information about the constituent plastic or the sorting bin to which it is sorted can be obtained by using a data structure (such as Table 121) that associates the GTIN with such other information.

[0381]

[0381] Although this specification has described 2D image sensors in particular, 2D sensors are not required. Image sensing can instead be performed by a linear array sensor that captures line scan images at a suitable high rate.

[0382]

[0382] Some of the surface shaping shown in the figures primarily uses straight lines for the sake of ease of drafting. Generally, surface texture treatment achieves a curved, tapered shape.

[0383]

[0383] A processing patch for captured images having a specific size in waxel units has been described. The exact waxel size of the patch cannot be determined until its scale is evaluated (for example, using the direct least squares method mentioned above), but the encoding scale of each watermark encountered by the system is known in advance, and the imaging distance is fixed, so the scale correspondence between captured pixels and encoded waxels is roughly known, which is sufficient for the purposes of this technique.

[0384]

[0384] The image processing described herein is typically performed on data that has been pre-filtered using an "8-axis" (or "cross") filter, as described in the references cited above. In the exemplary embodiment, the 8-axis filtered data can have integer values ​​in the range of -8 to 8.

[0385]

[0385] In some embodiments, after the affine parameters characterizing the article orientation are recognized, the estimated value of the reference signal is subtracted from the captured image, as the reference signal later becomes mere noise. Eight-axis processing can then be applied to the remaining signal.

[0386]

[0386] Although this specification has repeatedly referred to plastic bottles, it will be recognized that this technology can be used in combination with any other article, such as trays, bags, cups, and transport containers.

[0387]

[0387] Furthermore, although recycling is emphasized in this specification, it should be understood that the technology can also be used for sorting plastics and other containers for reuse. For example, a beverage manufacturer may serialize bottles by texture processing with a unique identifier for each. When a consumer returns a bottle for reuse, the serialization identifier can be sensed in the process of washing and refilling the bottle, and a counter tracking the number of times the bottle has been processed for reuse can be incremented using this technology. When a bottle has reached an empirically determined lifespan (e.g., after 30 uses), it can be repurposed for recycling.

[0388]

[0388] For optimal divertor performance, the center of gravity of the detected plastic article is estimated, and the center of gravity position is used to control the operation of the divertor mechanism (for example, the center of gravity position is the target of the compressed air injection). Each detection of a watermark block serves as a data point in estimating the center of gravity. In one example, the coordinates of the center of each watermark block are determined in the coordinate system of the image in which the block was detected. Their x and y coordinates are averaged, respectively, to determine the center of gravity of the object within that image frame. For example, in Figure 31, their coordinates are averaged to show the position indicated by the target. The spatial relationship between the camera field of view and the divertor assembly is known, such as the belt velocity, and the divertor can be activated and directed to a position calculated to optimally transfer the article from the belt.

[0389]

[0389] (If the belt is congested with objects, the watermark blocks may be checked to verify payload integrity before the positions of the watermark blocks are averaged. If one watermark indicates one type of plastic and nearby blocks indicate a different type of plastic, it is understood that the watermark and nearby blocks are marking different items, and their coordinates should not be used together in the common mean.)

[0390]

[0390] The object image can also be passed to a convolutional neural network trained to classify the input image as an object belonging to one of a limited number of classifications, such as a bottle or a flat object (e.g., a padded plastic shipping envelope). The pressure or direction of the air emitted from the air jet diverter is preferably controlled according to the above classification to help ensure that the object is transported correctly. For example, a flat object can act as a sail, and by capturing the air, less air is applied to transport the flat object than is applied when transporting a bottle (the curved surface of a bottle generally deflects the air around it).

[0391]

[0391] A short time interval exists between when an item is imaged by a camera(s) and when the item is positioned for transfer from the conveyor. This interval is generally sufficient to enable cloud processing. For example, the captured image (or a derivative of such image) can be transmitted to a remote cloud computing service such as Microsoft Azure, Google Cloud, or Amazon AWS. The cloud processor(s) perform some or all of the processing detailed here, return the resulting data to the waste disposal system, and the divertor is controlled according to that resulting data.

[0392]

[0392] Similarly, in a waste stream where some items effectively contain plastic recycling codes in their payload, the recycling codes for other items must be retrieved from a database (e.g., based on a lookup from a decrypted GTIN identifier), but a short interval before transfer allows time to look up the cloud database for the necessary recycling codes for the latter items.

[0393]

[0393] It will be recognized that a recycling system using an embodiment of this technology does not inherently require a conveyor belt. For example, items can be transported to the diverter system through the camera system by other means, such as by rollers or free fall. All such alternatives are intended to be included in the term "conveyor belt".

[0394]

[0394] While we have mentioned processing captured images using an unsharp mask filter, other filters (linear or nonlinear) can also be used to enhance the high-frequency components of an image (or, similarly, to stop enhancing the low-frequency components).

[0395]

[0395] Most of the detailed configurations operate using grayscale images, but certain improvements in performance (e.g., more reliable recognition of empty belts and watermark decoding in certain modes) may be achievable with higher-dimensional multi-channel images. As mentioned above, RGB sensors can be used. However, half of the pixels of an RGB sensor are typically filtered for green (due to the widespread use of Bayer color filters). Better results can be obtained using sensors that output four (or more) different channels of data, such as R / G / B / ultraviolet, R / G / B / infrared, R / G / B / polarized, or R / G / B / white.

[0396]

[0396] Although described in the context of plastic articles, it will be recognized that many aspects of this technology are applicable to other articles, such as articles made of glass or metal.

[0397]

[0397] Similarly, although this technology has been described in the context of digital watermarking, it should be recognized that any other machine-readable marking, such as DotCode and dot-pin marking, can be used (although certain advantages, such as readability from different viewpoints, may be compromised). U.S. Patent No. 8,727,220 teaches 20 different 2D codes that can be embossed or molded onto the outer surface of plastic containers.

[0398]

[0398] As described above, in some embodiments, an image block is analyzed to find clues indicating whether or not the block represents a conveyor belt. If the block does not represent a conveyor belt, further analysis is performed, such as block analysis to find a watermark reference signal. In other embodiments, the block is first analyzed to confirm the presence of a watermark reference signal, and such reference signal detection serves as a clue. Such reference signal detection triggers further analysis, such as block analysis to find payload data, and / or analysis of nearby blocks or spatially displaced blocks in subsequent image frames to find the reference signal. (Typically, the type of reference signal detected indicates whether the associated watermark may be of the printed or textured type, so a corresponding decoding algorithm can be applied).

[0399]

[0399] As described above, the two watermarks intended by specific embodiments of this technology differ in three respects: shape, payload, and signal protocol. To avoid uncertainty, it should be understood that each of these attributes is distinct. The two watermarks may differ in shape (printing or texture processing) but may be identical in signal protocol and payload. Similarly, the two watermarks may differ in payload but be identical in shape and signal protocol. Similarly, the two watermarks may differ in signal protocol but be identical in shape and payload. (The signal protocol encompasses all aspects of the watermark except its shape and payload, such as the reference signal, encoding algorithm, output data format, payload length, syntax, etc.).

[0400]

[0400] While much has been said about rectangular perforated blocks, it will be noted that the printed or textured surfaces can be tiled in the same way as perforated blocks of other shapes. For example, a hexagonal honeycomb shape may be composed of waxes formed into triangles.

[0401]

[0401] Although this technique has been described with reference to the detection of a watermark synchronization (reference) signal using a direct least-squares and phase-shift approach, other techniques may also be used. One example is a coiled, all-position configuration, as detailed in U.S. Patent Application Publication No. 20190266749. Another option is to use an impulse-matched filter approach (e.g., correlated with a template consisting of peaks), as detailed in U.S. Patents No. 10,242,434 and 6,590,996.

[0402]

[0402] Surface processing to achieve a matte or translucent finish, even to a slight degree, can be recognized as a form of 3D surface molding / texturing. Generally, non-inking processes that change the bidirectional reflectance distribution function (BDRF) of a surface are considered 3D molding / texturing operations in this context.

[0403]

[0403] For example, the curved surfaces shown in Figures 1H to 1L are symmetrical in part and / or in cross-section of a sphere, but this is not mandatory. In part of an ellipse, more complex (higher-order) surfaces can be used more generally. Some surfaces cut by a plane perpendicular to the nominal surface of a plastic article may have an asymmetrical shape. In fact, some such surfaces are characterized by not having a symmetrical cross-section perpendicular to the nominal plastic surface.

[0404]

[0404] Pay particular attention to U.S. Provisional Patent Application No. 62 / 956,845, referenced in the opening section of this specification. This application details research by another team of the assignee, but deals with similar subject matter, including recycling. That application details features, methods, and configurations that the applicant intends to be incorporated into embodiments of the present technology. (Similarly, the applicant intends that the features, methods, and configurations of the present technology be incorporated into embodiments of the technology of U.S. Provisional Patent Application No. 62 / 956,845). Thus, for example, the identification of objects using both deterministic and probabilistic methods to trigger object-specific analysis routines (e.g., contamination analysis) is detailed in the above-referenced application and similarly applied to embodiments of the present technology. That application and the present technology should be read together to achieve a more complete understanding of the present technology. (That application is not described again here in order to comply with the patent law requirement that the specification must be "concise").

[0405]

[0405] It will be understood that the methods and algorithms detailed above can be performed using a computer device having one or more processors, one or more memories (e.g., RAM), storage (e.g., disk or flash memory), a user interface (e.g., including a keypad, a TFT LCD or OLED display screen, a touch or other gesture sensor, along with software instructions for providing a graphical user interface), interconnections of these elements (e.g., a bus), and wired or wireless interfaces for communicating with other devices.

[0406]

[0406] The methods and algorithms detailed above can be implemented in a variety of different hardware processors, including microprocessors, application-specific integrated circuits (ASICs), and field-programmable gate arrays (FPGAs). Hybrids of such configurations can also be used.

[0407]

[0407] As a microprocessor, the applicant means a multipurpose clock-driven integrated circuit comprising a specific structure, namely, integer and floating-point arithmetic logic units (ALUs), control logic circuits, a set of registers, and scratchpad memory (known as cache memory), all linked by a fixed bus interconnect. The control logic circuits retrieve instruction codes from external memory, and the ALU initiates a sample operation necessary to execute those instruction codes. The instruction codes are derived from a limited instruction vocabulary, which may be considered the native instruction set of the microprocessor.

[0408]

[0408] One particular embodiment of the processes detailed above in a microprocessor, such as recognizing affine pose parameters from a watermark reference signal of a captured image or decoding watermark payload data, involves first defining a sequence of algorithmic actions in a high-level computer language such as MatLab or C++ (sometimes called source code), and then using a commercial compiler (such as the Intel C++ compiler) to generate machine code (i.e., instructions from the native instruction set, sometimes called object code) from the source code. (Both source code and machine code are considered software instructions here). The process is then executed by instructing the microprocessor to execute the compiled code.

[0409]

[0409] Currently, many microprocessors are a fusion of several simpler microprocessors (called "cores"). Such a configuration allows multiple operations to be executed in parallel (some elements, such as the bus structure and cache memory, may be shared between cores).

[0410]

[0410] Examples of microprocessor structures include Intel Xeon, Atom, and Core-I series devices, as well as various models from ARM and AMD. Because these microprocessor structures are general-purpose components, they are attractive options in many applications. Implementation does not require customized design / assembly.

[0411]

[0411] A graphics processing unit (GPU) is closely related to a microprocessor. A GPU is similar to a microprocessor in that it includes an ALU, control logic circuits, registers, cache, and fixed bus interconnects. However, the native instruction set of a GPU is commonly optimized for image / video processing tasks such as moving large blocks of data into and out of memory, and performing the same operation on multiple data sets simultaneously. Other specialized tasks such as rotating and translating arrays of vertex data to different coordinate systems, and interpolation are also generally supported. Representative vendors of GPU hardware include Nvidia, ATI / AMD, and Intel. As used herein, the applicant intends to refer to microprocessors, which also include GPUs.

[0412]

[0412] Due to the characteristics of the data being processed and the potential for parallelization, GPUs are an attractive structural choice for executing certain algorithms among those detailed.

[0413]

[0413] While microprocessors can be reprogrammed with appropriate software to execute various different algorithms, ASICs are not reprogrammable. A particular Intel microprocessor may be programmed today to recognize affine attitude parameters from a watermark reference signal and tomorrow to prepare a user's tax return, but an ASIC structure does not have this flexibility. Rather, ASICs are designed and assembled to perform a dedicated task. ASICs are made for a specific application.

[0414]

[0414] An ASIC structure has an array of circuits specifically designed to perform a particular function. There are two common classes: gate arrays (sometimes called semi-custom) and fully custom. In the former, the hardware has a regular array structure of (usually) millions of digital logic gates (e.g., XOR and / or AND gates) assembled in a diffusion layer and distributed on a silicon substrate. Then, a metallization layer with specially designed interconnects is applied to permanently link specific gates among the gates in a fixed topology. (As a result of this hardware structure, a large number of the assembled gates, generally the majority, remain unused).

[0415]

[0415] However, in a fully custom ASIC, the gate configuration is specially designed to serve its intended purpose (for example, to execute a specified algorithm). This special design enables more efficient use of available board space, resulting in shorter signal paths and faster performance. A fully custom ASIC can also be assembled to include analog components and other circuits.

[0416]

[0416] Generally speaking, ASIC-based embodiments of watermark detectors and decoders achieve higher performance and consume less power compared to embodiments using microprocessors. However, a drawback is that designing and assembling circuits tailored to one specific application requires significant time and expense.

[0417]

[0417] For example, any specific implementation of the above processes using an ASIC, such as recognizing affine pose parameters from a watermark reference signal in a captured image, or decoding watermark payload data, is initiated by defining a sequence of operations in source code such as MatLab or C++. However, instead of compiling to the native instruction set of the multipurpose microprocessor, the source code is compiled into a "hardware description language" such as VHDL (IEEE standard) using a compiler such as HDLCoder (available from MathWorks). The VHDL output is then applied to a hardware integration program such as Design Compiler by Synopsis, HDL Designer by Mentor Graphics, or Encounter RTL Compiler by Cadence Design Systems. This hardware integration program generates output data that specifies a particular array of electronic logic gates that implement the technology in hardware form, acting as a specialized machine dedicated to the purpose of implementing the technology in hardware form. This output data is then passed to a semiconductor manufacturer, who uses the output data to fabricate a specially designed silicon component. (Suitable vendors include TSMC, Global Foundries, and ON Semiconductors.)

[0418]

[0418] A third hardware structure that can be used to execute the algorithms detailed above is an FPGA. An FPGA is similar to the semi-custom gate array described above. However, instead of using a metallization layer to provide fixed interconnections between general-purpose arrays of gates, the interconnections are configured by a network of switches that can be electrically configured (and reconfigured) to be either ON or OFF. The configuration data is stored in and read from external memory. Because of such a configuration, the link of the logic gates, and therefore the function of the circuit, can be freely changed by loading various configuration instructions from memory to reconfigure how those interconnection switches are configured.

[0419]

[0419] Furthermore, FPGAs differ from quasi-custom gate arrays in that they are not generally composed of simple gates as a whole. Rather, FPGAs can include several logic elements configured to perform complex combinational functions. They can also include memory elements (e.g., flip-flops, but more commonly, entire blocks of RAM memory). The same applies to A / D and D / A converters. In this case as well, the reconfigurable interconnects that characterize FPGAs allow such additional elements to be incorporated into desired positions in larger circuits.

[0420]

[0420] Examples of FPGA structures include Stratix FPGAs from Intel and Spartan FPGAs from Xilinx.

[0421]

[0421] As with other hardware structures, the execution of the FPGA processing detailed above begins by describing the processing in a high-level language. Furthermore, as in the ASIC embodiment, the high-level language is then compiled into VHDL. However, the instructions for the interconnect configuration are then generated from VHDL by a software tool (e.g., Stratix / Spartan) specific to the series of FPGAs being used.

[0422]

[0422] Hybridization of the structures described above can be further used to execute the detailed algorithms. A microprocessor integrated on a substrate is used as a component of the ASIC. Such a configuration is called a system on a chip (SOC). Similarly, a microprocessor can be used, in particular, for reconfigurable interconnection with other elements of an FPGA. Such a configuration is sometimes called a system on a programmable chip (SORC).

[0423]

[0423] Another type of processor hardware is neural network chips such as Intel Nervana NNP-T, NNP-I and Loihi chips, Google Edge TPU chips, and Brainchip Akida neuromorphic SOC.

[0424]

[0424] Software instructions for performing the functions detailed above on the selected hardware can be written by those skilled in the art from the description given herein without any further experimentation, and can be written, for example, in combination with the relevant data, in C, C++, Visual Basic, Java®, Python, Tcl, Perl, Scheme, Ruby, Caffe, TensorFlow, etc.

[0425]

[0425] Software and hardware configuration data / instructions are generally stored as instructions in one or more data structures held on tangible media such as magnetic or optical disks, memory cards, ROMs, etc., which may be accessed over a network. Some embodiments may be implemented as embedded systems, i.e., specialized computer systems in which the user cannot distinguish between operating system software and application software (as is common in, for example, a basic mobile phone). The functions detailed herein can be implemented in operating system software, application software, and / or embedded system software.

[0426]

[0426] Different functions can be performed on different devices. Different tasks can be performed exclusively by different devices, or their execution can be distributed across devices. Similarly, the description of data stored on a particular device is illustrative, and data can be stored anywhere, including on local devices, remote devices, in the cloud, or in a distributed manner.

[0427]

[0427] Other recycling configurations are taught in the patent documents U.S. Patent Nos. 4,644,151, 5,965,858, 6,390,368, U.S. Patent Publication Nos. 2006,007,0928, 2014,030,5851, 2014,036,5381, 2017,022,5199, 2018,005,6336, 2018,006,5155, 2018,034,9864, and 2019,003,0571. Alternative embodiments of the present technology utilize features and configurations from these references.

[0428]

[0428] This specification describes various embodiments. It should be understood that methods, elements and concepts detailed in relation to one embodiment can be combined with methods, elements and concepts detailed in relation to other embodiments. While several such configurations have been specifically described, many configurations have not been described due to the number of substitutions and combinations. The applicant also recognizes and intends that the methods, elements and concepts herein can be combined, substituted or exchanged not only among themselves but also with those known from the referenced prior art. Furthermore, it will be recognized that the detailed technologies may be included with other current and future technologies to obtain beneficial effects. The implementation of such combinations is quite straightforward for those skilled in the art from the teachings given in this disclosure.

[0429]

[0429] While this disclosure details a particular order of operations and a particular combination of elements, it will be recognized that other intended methods may re-sort the operations (in some cases, by removing some operations and adding others), and other intended combinations may remove some elements and add others, etc.

[0430]

[0430] The system as a whole has been disclosed, but smaller combinations of the detailed configurations are also intended separately (for example, by removing various features from the features of the whole system).

[0431]

[0431] Although certain aspects of the present invention have been described by reference to exemplary methods, it will be recognized that apparatus configured to perform the operations of such methods are also contemplated as part of the applicant's invention. Similarly, other aspects have been described by reference to exemplary apparatus, and methodologies performed by such apparatus are also within the scope of the present invention. Furthermore, tangible computer-readable media containing instructions for configuring a processor or other programmable system to perform such methods are also obviously contemplated.

[0432]

[0432] In order to achieve comprehensive disclosure, the applicant invokes each of the documents referenced herein by reference in accordance with the requirements of brevity in patent law. (Even if the documents referenced above are referred to in relation to a specific teaching among the teachings of the documents listed above, those documents are invoked as a whole.) These references disclose the technology and teachings that the applicant intends to be incorporated into the configuration detailed herein and into the technology and teachings detailed herein.

[0433]

[0433] Considering the wide variety of embodiments to which the above-described principles and features can be applied, it will be clear that the detailed embodiments are merely illustrative and should not be considered as limiting the scope of the present invention. [Item of the invention] [Item 1] It is a method, A step of defining a data pattern in an electronic file, comprising binary elements spaced apart at regular positions within a two-dimensional positional grid, wherein the pattern defines a first fixed reference signal and a first variable data signal, and the first reference signal facilitates the geometric alignment and extraction of the first variable data signal by a decoder presented with a camera-captured image showing a physical counterpart to the data pattern. A method comprising the steps of forming a three-dimensional surface topology pattern of a mold according to a smoothed counterpart of the data pattern, wherein the topology pattern includes peaks or depressions having a smooth cross-section to facilitate the release of a molded part from the mold. [Item 2] The method according to item 1, wherein the two-dimensional position grid defines M candidate positions where the binary element may be located, and the binary element is located in 25% or less of the M candidate positions in the two-dimensional position grid. [Item 3] The two-dimensional position grid consists of an N×N grid of positions, where each position has the grayscale or floating-point value of the first reference signal corresponding to the position. The first variable data signal consists of an M×M array of positions, where M < N, and each position in the M×M array of positions has a two-tone value of the variable data signal corresponding to the position. Interpolate the M×M first variable data signal values to generate an N×N array of interpolated values, thereby converting the first variable data signal from a two-tone form to a grayscale or floating-point form. At each of the N×N positions, sum the corresponding values of the first reference signal and the interpolated first variable data signal at a weighted ratio to generate an N×N sum array of values. Apply a thresholding operation to the N×N sum array of values to generate extreme values. Mark the positions in the N×N grid corresponding to the extreme values. The method according to item 1. [Item 4] The two-dimensional position grid defines M positions, and each of the M positions has the value of the first reference signal corresponding to the M positions, and each value represents the relative darkness of the reference signal at that position. The first variable data signal includes binary symbols, and each of the binary symbols is associated with a corresponding position within the regular two-dimensional position grid. The method includes Generating a ranking of the N darkest positions by sorting the values of the first reference signal. Identifying P of the darkest positions in the ranking of the N darkest positions, leaving Q other positions unchanged, and marking each of those P positions with a binary element. Marking or not marking each of the Q other positions with a binary element according to whether the corresponding binary symbol of the variable data signal has a first value or a second value. The method according to item 1, including the step of generating the data pattern by an operation including the above. [Item 5] A mold generated by the process according to item 1. [Item 6] A method further including the step of molding a plastic container using the molded mold, wherein the molded plastic of the container holds the first variable data, according to item 1. [Item 7] A plastic container molded using the method according to item 6. [Item 8] The plastic container according to item 7, wherein the plastic container further has a label, the label including a printed pattern defining a second fixed reference signal and a second variable data signal, the second reference signal facilitating the geometric alignment and extraction of the second variable data signal by a decoder presented with a camera capture image showing the printed pattern, the second fixed reference signal being different from the first fixed reference signal, and / or the second variable data signal being different from the first variable data signal. [Item 9] A recycling system comprising a camera, a processor, and molded first and second plastic containers as described in item 8, wherein the processor is configured to process camera-captured images of the molded plastic containers such that (a) a first alignment signal is used to geometrically align the first container with respect to a first variable data signal, extract the first variable data signal, separate the first container for recycling based on the extracted first variable data signal, and (b) a second alignment signal is used to geometrically align the second container with respect to a second variable data signal, extract the second variable data signal, and separate the second container for recycling based on the extracted second variable data signal. [Item 10] A method comprising the step of molding a plastic container to hold a texture pattern of elements spaced apart at positions in a regular two-dimensional position grid, wherein the pattern defines a first fixed reference signal and a first variable data signal, the first reference signal facilitates the geometric alignment and extraction of the first variable data signal by a decoder presented with a camera-captured image of the container, the two-dimensional position grid defines M candidate positions where the elements may be located, and the elements are located in the two-dimensional position grid at least 25% of the M candidate positions. [Item 11] The method according to item 10, wherein more than 75% of the remaining M candidate positions follow the nominal contour of the plastic container. [Item 12] A plastic container molded according to the method described in item 10. [Item 13] The plastic container according to item 10, wherein, at the boundary of the pattern, most of the surface area of ​​the container follows the nominal contour of the container. [Item 14] A plastic container for holding a plastic texture pattern and a printed label pattern, wherein the plastic texture pattern includes elements spaced apart at positions in a regular two-dimensional position grid, the plastic pattern defines a first fixed reference signal and a first variable data signal, the first reference signal facilitates the geometric alignment and extraction of the first variable data signal by a decoder presented with a camera-captured image of the container, and the printed label pattern includes elements spaced apart at positions in a regular two-dimensional position grid, the printed label pattern defines a second fixed reference signal and a second variable data signal, the second reference signal facilitates the geometric alignment and extraction of the second variable data signal by a decoder presented with a camera-captured image of the container, the second fixed reference signal is different from the first fixed reference signal, and / or the second variable data signal is different from the first variable data signal. [Item 15] A plastic container as described in item 14, wherein the second fixed reference signal is different from the first fixed reference signal. [Item 16] The plastic container described in item 14, wherein the second variable data signal is different from the first variable data signal. [Item 17] A plastic container holding a texture pattern comprising elements spaced apart at positions within a regular two-dimensional position grid, wherein the pattern defines a first fixed reference signal and a first variable data signal, the first reference signal facilitates the geometric alignment and extraction of the first variable data signal by a decoder presented with a camera-captured image of the container, the two-dimensional position grid defines M candidate positions where the elements may be located, and the elements are located in 25% or less of the M candidate positions within the two-dimensional position grid. [Item 18] The plastic container described in item 17, wherein more than 75% of the remaining M candidate positions follow the nominal contour of the plastic container. [Item 19] The plastic container according to item 17, wherein, at the boundary of the molded pattern, most of the surface area of ​​the container follows the nominal contour of the container. [Item 20] A method for marking a container to hold multiple symbol payloads, A step of generating a data pattern encoding the payload, wherein the pattern includes elements spaced apart at regular positions in a two-dimensional position grid, the pattern defines a fixed reference signal and a variable data signal, the reference signal facilitates the geometric alignment and extraction of the variable data signal by a decoder presented with a camera-captured image showing a physical counterpart to the data pattern, The steps include forming a physical counterpart of the pattern on the container by printing or texture processing, The two-dimensional position grid defines M positions, each of the M positions has a value of a reference signal corresponding to the M positions, each value representing the relative darkness of the reference signal at that position, and the variable data signal includes binary symbols, each of the binary symbols being associated with a corresponding position in the regular two-dimensional position grid. The above generation step, in particular, By sorting the values ​​of the aforementioned reference signal, a ranking of the N darkest locations is generated. The process involves identifying P darkest locations from the ranking of N darkest locations, leaving Q other locations as they are, and marking each of the P locations with a binary element. A method comprising marking or not marking each of the Q other positions with a binary element, depending on whether the corresponding binary symbol of the variable data signal has a first value or a second value. [Item 21] A recycling system comprising an optical reader and plastic bottles, wherein the plastic bottles have labels, the labels are imprinted with a first digital pattern encoding a first identifier in ink, the plastic is textured with a second digital pattern encoding a second identifier, and the recycling system can separate bottles by plastic type by decoding either identifier, but the two identifiers are different. [Item 22] A recycling system comprising an optical reader and a plastic bottle, wherein the bottle is at least partially wrapped in a sleeve, the sleeve is pre-printed with ink-applied markings while in a planar form, then wrapped around the bottle and heat-shrinked to adhere to the bottle, and the ink-applied markings on the wrapping sleeve are still readable by the optical reader even if they include machine-readable codes geometrically distorted by the heat-shrinkage, thereby controlling the sorting of the plastic bottle for recycling. [Item 23] A POS system comprising an optical reader and a plastic bottle, wherein the plastic bottle has a printed label on which a first digital pattern encoding a first identifier is applied with ink, the plastic is textured with a second digital pattern encoding a second identifier, and the optical reader is configured to decode the first identifier but not the second identifier. [Item 24] A bottle comprising a plastic container that serves as the base for an ink-printed label, wherein the ink-printed label includes a machine-readable code that enables sorting by the plastic type of the base plastic container. [Item 25] A system for processing object streams containing multiple plastic objects, A conveyor belt and One or more light sources arranged to illuminate plastic objects on the conveyor belt, One or more cameras arranged to capture images showing plastic objects on the conveyor belt, (a) First digital watermark information having a first signal protocol, and (b) Second digital watermark information having a different second signal protocol, a watermark reading means for decoding from the image, A system equipped with a sorting machine that reacts to decrypted watermark information. [Item 26] The system according to item 25, further comprising a cue detection means that triggers the watermark reading means in response to a promising portion of an image. [Item 27] A recycling system comprising a conveyor belt equipped with plastic food and beverage containers, further comprising means for (a) transferring specific containers from the conveyor belt based on a watermark printed on the containers, and (b) transferring specific containers from the conveyor belt based on a watermark formed by texture treatment on the plastic surface of the containers, wherein at least one of the containers holds a first watermark formed by printing and a second watermark formed by plastic texture treatment, and the first and second watermarks have different signal protocols. [Item 28] A container having a first watermark using a first signaling protocol, wherein the payload of the first watermark holds data that enables a recycling system to determine the type of plastic from which the container was manufactured, and the container further includes a second watermark using a second signaling protocol different from the first signaling protocol, wherein the payload of the second watermark holds data that enables a recycling system to determine the type of plastic from which the container was manufactured, and the first and second watermarks have different signaling protocols but are both useful for plastic recycling. [Item 29] The container according to item 28, wherein the first watermark is formed by a three-dimensional surface texture treatment that includes a plurality of corner reflector-shaped recesses. [Item 30] The container according to item 28, wherein the first watermark is formed by three-dimensional surface texture processing, the second watermark is formed by ink printing, and the first and second watermarks differ in their configuration and signal protocol. [Item 31] The container according to item 30, wherein the three-dimensional surface texture treatment is asymmetrical, and the depth of the deepest depression on the textured surface is not equal to the height of the highest protrusion on the textured surface. [Item 32] The container according to item 30, wherein the three-dimensional texture processing is asymmetric, and the average depth of the depressions on the textured surface is not equal to the average height of the protrusions on the textured surface. [Item 33] The container according to item 30, wherein the three-dimensional surface texture processing is defined according to the sum of a reference signal and a payload signal, and the reference signal is clipped. [Item 34] The container according to item 30, wherein the three-dimensional surface is textured by both depressions and protrusions, and both the depressions and protrusions hold the payload information of the second watermark. [Item 35] The container according to item 30, wherein the three-dimensional surface texture processing represents a plurality of waxes, the waxes are arranged in a grid array of encoded positions, and each encoded position has sides of 0.0133 inches or less. [Item 36] The container according to item 30, having a front side and a back side, wherein the first digital watermark formed by three-dimensional surface texture processing is present on both the front side and the back side, and the second digital watermark formed by ink printing is present on both the front side and the back side. [Item 37] The container according to item 30, wherein the payload of the second watermark further holds additional data that enables the POS device to identify at least the name and price of the articles to be sold in the container, and the payload of the first watermark lacks at least a portion of the additional data, and the first watermark and the second watermark differ in shape, payload and signaling protocol. [Item 38] The steps include capturing an image showing an item in the object stream, A step of extracting a first digital watermark payload from an image showing a first article in the aforementioned object stream, A step of determining, based on payload data extracted from the first digital watermark, that the first article is formed from a first type of reprocessable plastic, A step of extracting a second digital watermark payload from an image showing a second article in the aforementioned object stream, The steps include determining, based on the payload data extracted from the second watermark, that the second article is formed from a second type of reprocessable plastic, A step of separating the first and second articles from the material stream based on the plastic type determined above, Recycling methods including those mentioned. [Item 39] The recycling method according to item 38, wherein the first type of recyclable plastic is polyethylene terephthalate and the second type of recyclable plastic is high-density polyethylene. [Item 40] A recycling method according to item 38, comprising the step of extracting the first digital watermark payload from an image showing the label of the first item. [Item 41] A recycling method according to item 38, comprising the step of extracting the second watermark payload from an image showing the three-dimensional surface texture of the second article. [Item 42] The recycling method described in item 38, wherein the first item is a bottle. [Item 43] The recycling method according to item 38, wherein the first watermark payload extracted from the description of the first article includes a fixed message portion and a variable message portion, the variable message portion includes a plurality of fields, one of which is a Global Trade Item Number (GTIN) field. [Item 44] The recycling method according to item 38, wherein the first watermark payload includes a code that identifies the plastic used in the first article, and the second digital watermark payload includes linking data, and the recycling method further includes the step of obtaining a code that identifies the plastic used in the second article from a database by using the linking data. [Item 45] The recycling method according to item 38, wherein the captured image includes an image frame, and the recycling method includes the steps of analyzing each of a plurality of pixel blocks in each of the image frame to find clues that suggest the presence of watermark data, and performing further image analysis if clues are found, wherein a first watermark payload is extracted as a result of finding a first clue, and a second watermark payload is extracted as a result of finding a second clue. [Item 46] The recycling method according to item 45, wherein at least two of the plurality of pixel blocks in the image frame overlap each other. [Item 47] The recycling method according to item 45, wherein the first clue includes detecting a region of pixels where each has a value above a threshold. [Item 48] The recycling method according to item 45, wherein the first clue includes detecting a set of spatial image frequencies corresponding to a watermark reference signal. [Item 49] The recycling method described in item 45, wherein the first clue includes output from a classifier indicating that the pixel block may represent a plastic article. [Item 50] The recycling method described in item 45, which includes output from a classifier indicating that the first clue may not represent a conveyor belt. [Item 51] The recycling method described in item 45, wherein the first clue is determined to be the determination that pixels from most of the subblocks within a block have an average value within 1, 2, 3, or 4 digital numbers of histogram peaks based on the previous image. [Item 52] The recycling method according to item 38, wherein the material stream is moved by a conveyor belt passing through a camera, the material on the conveyor belt enters the camera frame field of view along a first edge of the camera frame, the recycling method includes the steps of analyzing a plurality of overlapping blocks extending to the first edge of the camera frame for clues indicating the possible presence of watermark data, and performing further image analysis if clues are found. [Item 53] The recycling method according to item 38, wherein the first digital watermark is a watermark encoded according to a signaling protocol that represents payload data using tiles of 128 × 128 elements, and the second digital watermark is a watermark encoded according to a second different signaling protocol that represents payload data using tiles of N × N elements when N < 128. [Item 54] The recycling method according to item 38, comprising the step of performing an unsharp masking operation on an image subsequently extracted by the first watermark payload. [Item 55] The steps include evaluating the first and second pixel patches of the captured image to determine whether the patches may indicate a conveyor belt, The steps include: applying a watermark to the first pixel patch as a result of the evaluation and determination that the first pixel patch may not represent the conveyor belt; The process includes the step of not watermarking the second pixel patch as a result of the evaluation determination that the second pixel patch may indicate the conveyor belt, The first digital watermark is extracted from an image containing the first pixel patch. Recycling method as described in item 38. [Item 56] The recycling method according to item 38, comprising the steps of illuminating a first region of the object stream with a first light source, and illuminating a second region of the object stream with a second light source of a different type than the first light source, wherein the first watermark is extracted from the depiction of the first article when illuminated by the first light source, and the second watermark is extracted from the depiction of the second article when illuminated by the second light source. [Item 57] The recycling method according to item 56, wherein the first illuminating source emits light of a first color, and the second illuminating source emits light of a second different color. [Item 58] The recycling method according to item 56, wherein the first illuminator emits illumination of a first polarization state, and the second illuminator emits illumination of a second different polarization state. [Item 59] The recycling method according to item 38, wherein the step of extracting the first watermark payload includes determining parameters that characterize the orientation of the first article as shown in the first image, the determination using an iterative process that begins with a first initial set of affine parameters, and the step of extracting the second watermark payload includes determining parameters that characterize the orientation of the second article as shown in the second image, the determination using an iterative process that begins with a second initial set of affine parameters different from the first initial set. [Item 60] The material stream is moved by a conveyor belt at a certain speed, the captured image includes a sequence of captured images at a certain frame rate, the sequence includes first, second and third frames, and the recycling method is The steps include analyzing multiple image blocks of the first frame in order to find a watermark, The steps include detecting a watermark in the first image block of the first frame, The steps include identifying one or more second image blocks for analysis in the second frame based on the conveyor belt speed and the frame rate, Recycling methods as described in item 38, including the above. [Item 61] The recycling method according to item 60, comprising the step of identifying one or more third image blocks for analysis based on the conveyor belt speed and frame rate in the third frame. [Item 62] The recycling method according to item 38, wherein the first watermark includes a first reference signal, the second watermark includes a second reference signal, and when confusion tests are performed using the second reference signal over the entire range of affine transformations, i.e., using scaling the first reference signal in the range between 0.5 and 2.0 in 0.02 increments, using rotation of the first reference signal in the range between -90 and +90 in 1-degree increments, and using translation of the first reference signal in the range across each pixel of possible relative translations, the first reference signal has a correlation of 0.2 > r > -0.2. [Item 63] The recycling method according to item 38, wherein one of the aforementioned watermarks includes a traveling salesman line route that visits 100 or more points only once and changes direction at most of those points. [Item 64] The recycling method according to item 38, wherein one of the aforementioned watermarks includes a mesh of lines that extend into a region and intersect at the vertices to define a glint. [Item 65] The recycling method described in item 64, wherein each of the glints is triangular in shape. [Item 66] The recycling method described in item 64, wherein each of the glints is rectangular in shape. [Item 67] The recycling method according to item 64, wherein the glint is a polygon having a number of sides of varying proportions. [Item 68] The recycling method according to item 38, wherein one of the digital watermarks includes a pattern of multiple curved segments, the multiple segments being curved in a compound manner in multiple directions along their length, with some segments crossing other segments while others do not. [Item 69] The recycling method according to item 38, comprising the step of extracting the second watermark payload from an image showing a three-dimensional surface texture of the second article, which includes a plurality of recesses, each having a corner reflector shape, wherein the corner reflector shapes include three mutually perpendicular surfaces. [Item 70] Each of the first and second articles is marked with two different types of watermarks: (a) a first type of watermark printed on either the article or a label affixed to the article, wherein the first type of watermark uses a first signal protocol; and (b) a second type of watermark formed as a three-dimensional texture on the surface of the article, wherein the second type of watermark uses a second signal protocol different from the first signal protocol. The recycling method includes the step of applying first and second different watermark reading algorithms to the captured image, wherein the first watermark reading algorithm is configured to read the watermark using the first signal protocol, and the second watermark reading algorithm is configured to read the watermark using the second signal protocol. The recycling method can separate the first and second articles from the article stream based on either the first type of watermark or the second type of watermark that marks the article, using payload data extracted by the respective first or second watermark reading algorithms. Recycling method as described in item 38. [Item 71] The recycling method according to item 70, further comprising the step of applying the first and second different watermark reading algorithms to a common pixel patch, wherein the common pixel patch is analyzed to confirm the presence of both the first and second digital watermarks. [Item 72] The recycling method according to item 70, wherein the first watermark reading algorithm performs geometric synchronization using a first reference signal, and the second watermark reading algorithm performs geometric synchronization without using the first reference signal. [Item 73] The recycling method according to item 72, wherein the second watermark reading algorithm performs geometric synchronization using a second reference signal different from the first reference signal. [Item 74] The recycling method according to item 70, wherein the first signaling protocol for the first type of watermark represents the first payload by the position elements of a first-size encoded position array, i.e., a 128 × 128 encoded position array, and the second signaling protocol for the second type of watermark represents the second payload by the position elements of a second-size encoded position array, which is different from the first size. [Item 75] The recycling method according to item 70, wherein the first signal protocol of the first watermark generates an encoded rectangular block pattern having a side dimension of 0.85 inches, and the second signal protocol of the second watermark generates an encoded rectangular block pattern having a side dimension smaller than 0.85 inches. [Item 76] The recycling method according to item 70, wherein the first signal protocol of the first watermark has a first payload capacity, and the second signal protocol of the second watermark has a second different payload capacity. [Item 77] The recycling method according to item 70, wherein the first watermark reading algorithm performs a first type of error correction decoding, and the second watermark reading algorithm performs a second type of error correction decoding. [Item 78] The recycling method according to item 70, wherein the first watermark reading algorithm uses a first key for descrambling, and the second watermark reading algorithm uses a second different key for descrambling. [Item 79] The recycling method according to item 70, wherein the first watermark reading algorithm uses a first diffusion sequence for demodulation, and the second watermark reading algorithm uses a second different diffusion sequence for demodulation. [Item 80] The recycling method according to item 70, wherein the first watermark reading algorithm uses a first scattering table, and the second watermark reading algorithm uses a second different scattering table. [Item 81] A method for processing images showing first and second plastic objects in an object stream, The steps include applying a first digital watermark reading algorithm to a first image showing the first object, The steps include: determining the plastic type of the first object based on the first payload data decoded from the first image by the first digital watermark reading algorithm, and transferring the first object from the object stream to a first sorting destination according to the determined plastic type of the first object; The steps include applying a second digital watermark reading algorithm to a second image showing the second object, The process includes the steps of determining the plastic type of the second object based on second payload data decoded from the second image by the second watermark reading algorithm, and transferring the second object from the object stream to a second sorting destination according to the determined plastic type of the second object, The second sorting destination is the same as the first sorting destination, The first and second plastic objects described above are two instances of the same type of object, Each of the aforementioned objects is marked by both a first digital watermark and a second digital watermark, the first watermark is formed by a first process, the second watermark is formed by a second process different from the first process, the first watermark uses a first signal protocol, and the second watermark uses a second signal protocol different from the first signal protocol. The first digital watermark reading algorithm differs from the second digital watermark reading algorithm, the difference being that the first algorithm is configured to read the watermark using a first signaling protocol, and the second algorithm is configured to read the watermark using a second different signaling protocol. A method wherein, based on the reading of either the first or second watermark by the respective first or second watermark reading algorithm, an object is transferable from the object stream. [Item 82] The method according to item 81, further comprising the steps of applying the first watermark reading algorithm to an image containing a first pixel patch, and further applying the second watermark reading algorithm to an image containing the first pixel patch, wherein the pixel patch is analyzed to confirm the presence of both the first watermark and the second watermark. [Item 83] The method according to item 81, wherein the formation of the first watermark is achieved by printing on a label, and the formation of the second watermark is achieved by three-dimensional texture processing of the plastic. [Item 84] The method according to item 81, wherein the first signal protocol of the first watermark includes a first reference signal, and the second signal protocol of the second watermark signal does not include the first reference signal. [Item 85] The method according to item 84, wherein the second signal protocol of the second watermark includes a second reference signal that is different from the first reference signal. [Item 86] The method according to item 81, wherein the first signaling protocol of the first watermark comprises representing the first payload by position elements in an encoded position block of a first size, i.e., an encoded position block of 128 × 128, and the second signaling protocol of the second watermark comprises representing the second payload by position elements in an encoded position block of a second size different from the first size. [Item 87] The method according to item 81, wherein the first signal protocol of the first watermark generates an encoded rectangular block pattern having a side dimension of 0.85 inches, and the second signal protocol of the second watermark generates an encoded rectangular block pattern having a side dimension of less than 0.85 inches. [Item 88] The method according to item 81, wherein the first signal protocol of the first watermark has a first payload capacity, and the second signal protocol of the second watermark has a second different payload capacity. [Item 89] The method according to item 81, wherein the first signal protocol of the first digital watermark uses a first encoding algorithm, and the second signal protocol of the second digital watermark uses a second different encoding algorithm. [Item 90] The method according to item 89, wherein the first coding algorithm uses a first type of error correction encoder, and the second coding algorithm uses a second different type of error correction encoder. [Item 91] The method according to item 89, wherein the first encoding algorithm uses a first scramble key and the second encoding algorithm uses a second different scramble key. [Item 92] The method according to item 89, wherein the first coding algorithm uses a first spreading modulation sequence and the second coding algorithm uses a second different spreading modulation sequence. [Item 93] The method according to item 89, wherein the first coding algorithm uses a first scattering table and the second coding algorithm uses a second different scattering table. [Item 94] The steps include capturing an image frame showing a conveyor belt for materials, Steps include: examining a plurality of pixel blocks arranged across the frame for clues to indicate a pixel block that may contain watermark data, wherein the plurality of pixel blocks include a first pixel block and a second pixel block, and the pixel block is contained within the plurality of pixel blocks having a first pixel interval; The steps include: discovering a watermark clue in the first pixel block, analyzing the first pixel block as a result, and further analyzing N pixel blocks surrounding the first pixel block, wherein the N pixel blocks have a second pixel spacing smaller than the first pixel spacing; The steps include extracting a first type of watermark from one of the analyzed pixel blocks, A method that includes this. [Item 95] The steps include: discovering a watermarking clue in the second pixel block among the plurality of pixel blocks, thereby watermarking the second pixel block, and further watermarking M pixel blocks surrounding the second pixel block, wherein the M pixel blocks have a third pixel spacing smaller than the first pixel spacing; The method according to item 94, further comprising the step of extracting a second type of watermark, different from the first type, from one of the watermarked pixel blocks. [Item 96] The steps include: illuminating an object stream with a first light source and capturing a first image; The steps include analyzing the first image to detect and decode the first digital watermark formed on the first plastic container, The steps include sending the first plastic container for recycling according to the data decrypted from the first digital watermark, The steps include illuminating the object stream with a second light source different from the first light source and capturing a second image, The steps include analyzing the second image to detect and decode the second digital watermark formed on the second plastic container, The steps include sending the second plastic container for recycling according to the data decrypted from the second digital watermark, Recycling methods including those mentioned. [Item 97] The recycling method according to item 96, wherein the first watermark is formed by printing on the first plastic container, and the second watermark is formed by applying a three-dimensional texture to the second plastic container. [Item 98] The recycling method described in item 96, wherein the first light source is red light. [Item 99] The recycling method described in item 96, wherein the first light source is white light. [Item 100] The recycling method according to item 96, wherein the first illumination includes polarization. [Item 101] The recycling method according to item 96, wherein one of the first and second lights includes infrared or ultraviolet light. [Item 102] A method for creating a machine-readable pattern that holds encoded recycling information on the surface of a plastic container, wherein the machine-readable pattern includes a set of multiple peaks in a transformation region, each peak having a corresponding assigned phase, and the method includes the step of evaluating one hundred or more different sets of phases assigned to the set of peaks to determine which of the sets generates a pattern having the smallest standard deviation in the spatial region. [Item 103] A plastic container having a printed label, wherein the label is printed to hold a first watermark encoding a payload P1 for detection by a POS scanner in a retail store, the first watermark includes a first reference signal that enables geometric alignment of the first watermark for decoding by the POS scanner, and the first reference signal includes a first set of peaks in the two-dimensional Fourier amplitude domain, The surface of the plastic is shaped to hold a second digital watermark encoding a payload P2 different from P1 for sensing by a recycling device, the second digital watermark including a second reference signal enabling geometric alignment of the second digital watermark for decoding, the second reference signal including a second set of peaks in the two-dimensional Fourier amplitude domain, A plastic container, wherein the first digital watermark is encoded as a pattern of local luminance or chrominance changes and the second digital watermark is encoded as a three-dimensional texture pattern. [Item 104] The plastic container according to item 103, wherein the second set of peaks is different from the first set of peaks, thereby preventing a POS scanner attempting to read the payload P1 in a retail store from being confused by the presence of the second digital watermark. [Item 105] The plastic container according to item 104, wherein some but not all of the peaks of the second set overlap the peaks of the first set. [Item 106] The plastic container according to item 104, wherein none of the peaks of the second set overlap the peaks of the first set. [Item 107] [Item 108] The plastic container according to item 106, wherein each of the peaks of the first set is present on a different radial line in the two-dimensional Fourier amplitude plot of the first reference signal, and none of the peaks of the second set is present on one of the radial lines. [Item 109] The plastic container according to item 104, wherein the first set consists of M peaks and the second set consists of N peaks, where N < M. [Item 109] The plastic container according to item 103, wherein the first digital watermark is formed with a spatial resolution of J watermark elements per inch and the second digital watermark is formed with a spatial resolution of K watermark elements per inch, where K is greater than J. [Item 110] The plastic container according to item 103, wherein the payload P1 holds a message longer than the payload P2. [Item 111] The plastic container according to item 103, wherein the first watermark has a first payload-to-reference signal intensity ratio and the second watermark has a second payload-to-reference signal intensity ratio, and the first intensity ratio is different from the second intensity ratio. [Item 112] The plastic container described in item 111, wherein the second strength ratio is smaller than the first strength ratio. [Item 113] A plastic container having a label, wherein the plastic is molded to encode a first watermark including a first reference signal consisting of tiled first blocks, and the label is printed to encode a second watermark including a second reference signal consisting of tiled second blocks, characterized in that when confusion tests are performed using the blocks of the second reference signal over the entire range of affine transforms, i.e., using the scaling of the first reference signal blocks in the range between 0.5 and 2.0 in 0.02 increments, using the rotation of the first reference signal blocks in the range between -90 and +90 in 1-degree increments, and using the translation of the first reference signal blocks over the range of each pixel of possible relative translation, the blocks of the first reference signal have a correlation of 0.2 > r > -0.2. [Item 114] A plastic container molded to encode machine-readable data, characterized in that the plastic molding has the form of a traveling salesman line route that visits 100 or more points only once and changes direction at most of the points. [Item 115] A plastic container molded to encode machine-readable data, characterized in that the plastic molding has the form of a mesh of lines that extend into a region and intersect at the vertices to define a glint. [Item 116] The plastic containers described in item 115, wherein each of the glints is triangular in shape. [Item 117] The plastic containers described in item 115, wherein each of the glints has a rectangular shape. [Item 118] The plastic container according to item 115, wherein the glint is a polygon having a different number of sides. [Item 119] A plastic container molded to encode machine-readable data, wherein the plastic molding has the shape of a pattern of a plurality of curved segments, the plurality of segments are complexly curved in a plurality of directions along their length, some segments crossing other segments while other segments do not cross other segments. [Item 120] A product container made of plastic and having a label base layer attached, wherein the label base layer has printed artwork including text and a label watermark, and the label watermark includes a first synchronization component that enables a retail store terminal to locate and decode the payload of the label watermark that holds a retail identifier, The aforementioned product container The plastic is formed to encode a texture watermark, and the texture watermark includes a second synchronization component that enables a recycling device to locate and decode the texture watermark payload holding a recycling identifier different from the retail identifier, The product container holds two watermarks, one watermark useful for a sales terminal and the other watermark useful for recycling, and each watermark is associated with two different synchronization components, the retail identifier payload of the label watermark being recognizable by the sales terminal and the recycling identifier payload of the texture watermark being recognizable by the recycling device, so that the sales terminal does not mistakenly decode an identifier indicating recycling information instead of price information. A product container characterized by the following features. [Item 121] In a food or beverage container having a label, the label includes printed artwork including text and a first digital watermark, and the first digital watermark encodes information for reading by a sales terminal. The food or beverage container is made of plastic, The plastic is molded to encode a second digital watermark, Each of the first and second watermarks is characterized by a plurality of signal protocol attributes, To avoid confusion at sales terminals due to the second watermark, an improvement is made in which one of the attributes for the first digital watermark is different from the corresponding attribute for the second digital watermark. [Item 122] A food or beverage container as described in item 121, wherein the aforementioned different attributes include a reference signal peak, reference signal phase, scramble key, spread key, scattering table, or coding resolution. [Item 123] A plastic article having a pattern of recesses formed to encode multiple bits of digital data, characterized in that at least some of the recesses have a corner reflector shape including three mutually perpendicular surfaces. [Item 124] The plastic article according to item 123, wherein certain recesses among the recesses are textured to increase the scattering of reflected light, and other recesses among the recesses are not textured. [Item 125] The plastic article according to item 123, wherein each of the corner reflector-shaped recesses has a width dimension of less than 0.015 inches. [Item 126] A variable message payload method for creating a payload in a data structure, The steps include forming a payload item identifier in the first part of the payload field to identify a payload item held in the second part of the payload field, The steps include embedding the payload item identifier and the payload item into the host media signal, A variable message payload method that includes a variable message payload. [Item 127] The variable message payload method according to item 126, wherein the data structure includes a digital watermark. [Item 128] The variable message payload method according to item 126, wherein the embedding step includes embedding such that the data structure is substantially unrecognizable in the host media signal. [Item 129] The variable message payload method according to item 126, wherein the payload item includes at least one selected from a group of identifiers, computer files, machine executable instructions, metadata, dates, names, addresses, and locations. [Item 130] The variable message payload method described in item 126, wherein the identifier includes a Global Trade Item Number (GTIN), an Applicable Business Identifier (AI), or a Recycle Code. [Item 131] A plastic sorting system comprising a first watermark extraction module for extracting first digital data from a first format pattern formed on the surface of a textured plastic object, wherein the first watermark extraction module has an output unit coupled to a sorting mechanism, and the sorting mechanism is able to sort the object based on the first digital data, wherein the system further comprises a second watermark extraction module for ex...

Claims

1. A product container made of plastic and having a first watermark using a first signaling protocol, wherein the multiple symbol payload of the first watermark holds data indicating the type of plastic from which the product container was manufactured, wherein the product container further includes a second watermark using a second signaling protocol different from the first signaling protocol, wherein the multiple symbol payload of the second watermark further holds data indicating the type of plastic from which the product container was manufactured, and although the first and second watermarks have different signaling protocols, both are useful for plastic recycling. The first digital watermark is encoded as a three-dimensional texture pattern on the surface of the product container, and the second digital watermark is encoded as a pattern of printed changes in local brightness or chrominance on a printed label held by the product container. The first digital watermark encodes a multi-symbol payload P1 for detection by a recycling device, and the first digital watermark includes a first reference signal which includes a first set of peaks in the two-dimensional Fourier amplitude domain. The second digital watermark encodes a multi-symbol payload P2 for detection by a POS scanner in a retail store, which is different from P1, and the second digital watermark includes a second reference signal which includes a second set of peaks in the two-dimensional Fourier amplitude domain. A product container characterized in that the set of different peaks in the first reference signal prevents a POS scanner used in a retail store to read the multi-symbol payload P2 from attempting to decode the payload from the first digital watermark.

2. The product container according to claim 1, wherein the first digital watermark is formed by three-dimensional surface texture processing, the second digital watermark is formed by ink printing, and the first digital watermark and the second digital watermark differ in their configuration and signal protocol.

3. The product container according to claim 2, wherein the product container has first and second sides facing opposite directions, the first digital watermark formed by three-dimensional surface texture processing is present on both the first and second sides, and the second digital watermark formed by ink printing is present on both the first and second sides.

4. The product container according to claim 2, wherein the plurality of symbol payloads of the second watermark further hold additional data indicating to a POS device at least the name and price of the articles to be sold in the product container, the plurality of symbol payloads of the first watermark lack at least a portion of the additional data, and the first watermark and the second watermark differ in shape, payload and signal protocol.

5. The product container according to claim 1, wherein the first digital watermark is formed by a three-dimensional surface texture treatment that includes a plurality of corner reflector-shaped recesses.

6. The product container according to claim 1, wherein some but not all of the peaks in the first set overlap with the peaks in the second set.

7. The product container according to claim 1, wherein none of the peaks of the first set overlap with the peaks of the second set.

8. The product container according to claim 7, wherein each of the peaks of the second set lies on different radial lines in the two-dimensional Fourier amplitude plot of the second reference signal, and none of the peaks of the first set lies on one of the radial lines.

9. The product container according to claim 1, wherein the plurality of symbol payloads of the second digital watermark indicate the type of plastic by indicating a record in a database containing information about the type of plastic.

Images