Methods and system for imaging of moving printed material

An array of overlapping cameras with an imaging controller captures high-resolution images of moving printed materials by aligning camera triggers with print movement, addressing the limitations of traditional line scanning systems and enabling efficient image processing and authentication.

JP2024163115AInactive Publication Date: 2024-11-21SYS TECH SOLUTIONS INC
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2024123681
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2020-06-18
Filing Date
2024-07-30
Publication Date
2024-11-21
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing imaging technologies struggle with capturing high-resolution images of moving printed materials, particularly in high-speed applications, due to the need for accurate print movement tracking and the physical constraints of line scanning systems, which are often too large for small manufacturing sites.

Method used

A system utilizing an array of overlapping cameras with an imaging controller that determines the layout of printed content and configures the optical system to capture images of regions of interest at precise times during production, minimizing motion blur and enabling efficient image processing.

Benefits of technology

The system effectively captures sharp images of moving printed materials, allowing for the extraction of signatures and authentication of marks, while efficiently processing large numbers of images with minimal equipment footprint.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024163115000001_ABST
    Figure 2024163115000001_ABST
Patent Text Reader

Abstract

To capture images during production of a printed material.SOLUTION: A system for capturing images during production of a printed material includes an optical device comprising a plurality of cameras arranged in an array with adjacent pairs of cameras having overlapping fields of view. An imaging controller device determines a layout of content on a printed material, and determines, based on the layout, an optical system configuration profile. Determining the optical system configuration profile includes selecting one or more cameras for capturing images of regions of interest on the printed material, and determining a trigger interval for triggering the selected one or more cameras. The imaging controller device triggers the selected cameras at times determined based on the trigger interval to capture images of the regions of interest on the printed material as the printed material moves into fields of view of the one or more cameras during production of the printed material.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] Technical Field This disclosure relates generally to imaging technology, and specifically to print imaging applications. [Background technology]

[0002] background

[0002] Fake products are unfortunately widely available and often difficult to detect. In producing counterfeit goods, counterfeiters typically replicate labels and bar codes in addition to the actual product. At a surface level, the labels and bar codes may appear authentic and may even yield valid data when scanned (e.g., to decode the appropriate code, such as the European Article Number (EAN), Universal Product Code (UPC), Interleaved Two of Five (ITF), Quick Response (QR) code, etc.). There are many technologies currently available to combat such copying, but most of these solutions involve the insertion of various types of codes, patterns, microfibers, microdots, and other indicia to help thwart counterfeiting. Such technologies require manufacturers to use additional equipment and materials and add layers of complexity to the production process. Alternatively, some systems may extract information from a label or barcode known to be genuine, for example by processing an image of the label or barcode, and may then use this information to authenticate products that appear to have the same label or barcode.

[0003]

[0003] Optical systems are sometimes utilized to acquire images of moving objects (e.g., for quality inspection and defect detection during the production of materials and / or to extract useful information from images of printed objects). Such systems often use line scanning techniques to acquire images of the moving objects. Line scanning techniques require precise tracking of the movement of the printed object in order to acquire images with a sufficiently high resolution, which may not be feasible in high speed image acquisition applications. Line scanning systems may also be physically too large to fit comfortably into the small areas that may be available for optical systems at the site where the printed objects are manufactured. Summary of the Invention [Means for solving the problem]

[0004] overview

[0004] In one embodiment, a system for capturing images during production of a printed product includes an optical device including a plurality of cameras arranged in an array, where a plurality of sets of adjacent cameras in the array have overlapping fields of view. The system also includes an imaging controller device configured to determine a layout of content on the printed product and determine an optical system configuration profile based on the layout of content on the printed product. Determining the optical system configuration profile includes i) selecting one or more cameras from the plurality of cameras for capturing images of one or more regions of interest on the printed product, where the one or more cameras are selected such that each region of interest of the one or more regions of interest is generally within a field of view of a particular camera of the one or more cameras, and ii) determining a trigger interval for triggering the selected one or more cameras. The imaging controller device is further configured to trigger the selected one or more cameras at a time determined based on the trigger interval for capturing images of the one or more regions of interest on the printed product when the printed product falls within a field of view of the one or more cameras during production of the printed product.

[0005]

[0005] In another embodiment, a method for capturing images of a printed material by an optical device with a plurality of cameras arranged in an array, adjacent pairs of cameras in the array having overlapping fields of view. The method includes determining a layout of content on the printed material by a processor of the imaging controller device. The method also includes determining an optical system configuration profile by a processor of the imaging controller device based on the layout of content on the printed material, the determining including i) selecting one or more cameras from among the plurality of cameras for capturing images of one or more regions of interest on the printed material, the one or more cameras being selected such that each region of interest of the one or more regions of interest is collectively within a field of view of a particular camera of the one or more cameras, and ii) determining a trigger interval for triggering the selected one or more cameras. The method additionally includes triggering the selected one or more cameras by the imaging controller device at a time determined based on the trigger interval for capturing images of the one or more regions of interest on the printed material when the printed material is within a field of view of the one or more cameras during production of the printed material.

[0006] BRIEF DESCRIPTION OF THE DRAWINGS

[0006] While the appended claims describe the features of the present technology with particularity, these technologies, together with their objects and advantages, can be best understood from the following detailed description taken in conjunction with the accompanying drawings, in which: [Brief description of the drawings]

[0007] [Figure 1] FIG. 7 is a block diagram of an example system in which an imaging system may be used to capture and process images of an area of ​​interest in a moving print according to one embodiment. [Diagram 2]

[0008] 2 is a block diagram of an example content layout on a printed piece that may be imaged in the system of FIG. 1 according to one embodiment. [Diagram 3]

[0009] 1 is a diagram of an exemplary user interface that may be utilized to provide information describing the layout of content on a printed publication according to one embodiment. [Figure 4]

[0010] 2 is a block diagram of an example imaging controller device that may be utilized with the imaging system of FIG. 1 in accordance with one embodiment. [Diagram 5]

[0011] 2 is a diagram of an example optical device that may be utilized with the imaging system of FIG. 1 according to one embodiment. [Figure 6]

[0012] 2 is a diagram of another exemplary optical device that can be utilized with the imaging system of FIG. 1 in accordance with another embodiment. [Figure 7]

[0013] 2 is a flow diagram of a method for capturing an image of a printed matter that may be implemented in the system of FIG. 1 according to one embodiment. [Figure 8]

[0014] 2 is a flow diagram of an exemplary process implemented to process captured images in the system of FIG. 1 according to one embodiment. [Figure 9]

[0015] 2 is a block diagram of a computer system suitable for implementing one or more components of the system of FIG. 1 according to one embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Detailed Description

[0016] In the embodiments described below, the imaging system is utilized to capture and process images of an area of ​​interest on a printed product during a production run performed in producing the printed product. For example, as described in more detail below, the imaging system may capture images of marks on a label during production of the label and process the images of the marks to generate an identifiable electronic signature ("signature") that can later be used to authenticate products that are deemed to have genuine marks. However, the imaging system is generally described herein in the context of printed labels and in the context of generating a signature of a mark on a printed label for illustrative purposes only. In some other embodiments, the imaging system may be utilized in other manufacturing applications. For example, the imaging system may be utilized for detection of defects in printed products or to capture and process images of objects other than printed products.

[0009]

[0017] The imaging system may include an optical device including an imaging array having multiple area-scanning cameras. The imaging array may be positioned such that each camera in the array has an overlapping field of view. The optical device may be installed at a manufacturing site that may utilize production equipment to generate printed products (e.g., a label manufacturer that may utilize label printers, label converters, slitters, rewinders, etc. to produce reels of printed labels). The imaging system may also include a controller device configured to control operation of the optical device during production operations that may be performed by the production equipment. The controller device may determine a layout of content on the printed product (e.g., a layout of a web of labels that may be printed on the printed product). Based on the determined layout of content on the printed product, the controller device may generate an optical system configuration profile that is used to control the optical device during production operations that may be performed by the production equipment in manufacturing the printed product. For example, the controller device may determine a location of an area of ​​interest on the printed product and select one or more cameras in the imaging array to be used to capture images of the area of ​​interest on the printed product. The one or more areas of interest on the printed material may include marks such as a barcode, a 2D code (e.g., a QR code), a logo, etc., which may be printed, for example, on a label. The controller device may also determine a trigger interval for triggering the selected camera or cameras such that the selected cameras are triggered at appropriate times as the printed material moves through the camera's field of view during production of the printed material to accurately capture an image of the area of ​​interest on the printed material.

[0010]

[0018] In operation, as the printed product advances through the field of view of the cameras during production of the printed product, the controller device may trigger a selected camera or cameras at times when one or more areas of interest on the printed product are aligned with the field of view of the selected cameras. In some embodiments, the controller device may be guided by sensor and encoder signals that the controller device may receive from the production equipment to detect reference points on the printed product and the distance of travel of the printed product to ensure that images are taken at the precise times when the areas of interest are aligned with the camera's field of view.

[0011]

[0019] The imaging system may process the captured images, for example, to extract signature information from marks that may be depicted in the images. To enable the imaging system to rapidly process a large number of images that may be captured by the imaging system during a production operation, the imaging system may include a multi-core processor and / or utilize multi-threading techniques to process the images. In one embodiment, the imaging system may include an interface communicatively coupled to a network and may be configured to communicate with other devices over the network. For example, upon processing the captured images, the imaging system may transmit the captured images and / or information extracted from the captured images over the network to a database and / or server device, where the captured images and / or information extracted from the captured images may be stored and subsequently utilized for authentication of products that may have marks depicted in the images.

[0012]

[0020] By triggering selected cameras at appropriate times determined based on the trigger interval, the imaging system may acquire images of the region of interest with suitably short camera exposures that may be required to prevent or minimize motion blur from the images, particularly in applications having fast moving printed matter, and to acquire images that are sharp enough to allow extraction of a signature from the image of the region of interest and / or accurate inspection of the printed matter within the region of interest. Furthermore, providing cameras with overlapping fields of view, and selecting appropriate cameras for capturing images such that each region of interest is captured by a single camera in a single image, at least in some embodiments, allows for fast and efficient processing of images, which in turn allows the imaging system to quickly and efficiently process large volumes of images that may be acquired during a production run.

[0013]

[0021] 1 is a block diagram of an example system 100 in which an imaging system 102 may operate to capture and process images of an area of ​​interest in a printed product 104 produced by a production device 106, according to one embodiment. The production device 106 may be a printer, a label converter, a slitter, a rewinder, or any other equipment that may be used to produce a printed product 104. The printed product 104 may be, for example, a label web, or any other suitable type of printed product. The area of ​​interest on the printed product 104 may include a mark that may be printed on a label, for example. The mark can be something that identifies a brand (e.g., a logo), something that carries information such as a barcode (e.g., one-dimensional ("1D") barcodes such as the European Article Number (EAN), Universal Product Code (UPC), Interleaved Two of Five (ITF) barcodes; two-dimensional ("2D") data matrix barcodes such as those defined in the International Organization for Standardization ("ISO") and International Electrotechnical Commission ("IEC") standard ISO / IEC 16022; Quick Response (QR) codes, etc.), tracking information such as an expiration date, a serial number, or decoration. In some other embodiments, the printed material 104 can include other suitable areas of interest.

[0014]

[0022] The imaging system 102 may include an optical device 108 and an imaging controller device 110. Although the imaging controller device 110 is shown in FIG. 1 as being separate from and external to the optical device 108, the imaging controller device 110 may be integrated with the optical device 108 in some other embodiments. The optical device 108 may include an imaging array 112 having a number of imaging sensors (e.g., cameras) 114. The optical device 108 may be located near (e.g., on) the production equipment 106 such that the printed product 104 moves within the field of view of the camera 114 during production operations that may be performed by the production equipment 106 in producing the printed product 104.

[0015]

[0023] The imaging array 112 may include a linear arrangement of eight cameras 114. In other embodiments, the imaging array 112 may include other suitable numbers of cameras 114 and / or the cameras 114 may be arranged in a suitable non-linear arrangement. The cameras 114 may be area scan cameras configured to capture an image including a two-dimensional (2D) pixel matrix within a single exposure cycle. In at least some embodiments, multiple of the cameras 114 may operate in parallel to capture an image of a wider print compared to a system in which only a single area scan camera is utilized. In one embodiment, the cameras 114 may include a relatively high resolution imaging sensor, such as a resolution of 20 μm / pixel or greater. As an example, a VCXU-123M model camera manufactured by Baumer may be utilized as the cameras 114. In other embodiments, area scan cameras and / or other suitable cameras having other suitable resolutions may be utilized as the cameras 114. The cameras 114 may be arranged such that each camera 114 has an overlapping field of view. For example, in one embodiment, the field of view of camera 114-2 may overlap with the field of view of each of cameras 114-1 and 114-3, the field of view of camera 114-3 may overlap with the field of view of each of cameras 114-2 and 114-4, etc. The degree of overlap between the fields of view of each of cameras 114 may vary in various embodiments. In one embodiment, for example, 50% overlap may be utilized. In some other embodiments, other suitable degrees of overlap (e.g., 25%, 75%, 100%, 125%, 150%, etc.) may be utilized.

[0016]

[0024] The imaging controller device 110 may include an image acquisition controller 116 , a processor 118 , and a computer readable memory 120 that stores computer readable instructions executable by the processor 118 . In various embodiments, the computer readable memory 120 may include volatile memory (such as random access memory (RAM)) for storing computer instructions, and may also include persistent memory, such as a hard disk, hard drive, or any other stable storage space (e.g., a secure digital ("SD") card, flash drive, etc.). The computer readable memory 120 may store a configuration application 122 and an image processing application 124. Although the imaging controller device 110 is shown in FIG. 1 as including a single processor 118, in some embodiments the imaging controller device 110 may include multiple processors 118. In some embodiments, one or more of the processors 118 may be multi-core processors and / or may utilize multi-threading to perform processing operations. For example, the processor 118 may include 12 cores, 16 cores, 64 cores, or any other suitable number of cores. Furthermore, in some embodiments the configuration application 122 and / or the image processing application 124 may be implemented using hardware components, firmware components, software components, or any combination thereof.

[0017]

[0025] The configuration application 122 may obtain information describing the layout of the particular content on the printed material 104 and may determine an optical system configuration profile based on the layout of the particular content on the printed material 104. As an example, in an embodiment where the printed material is a label web sheet, the configuration application 122 may obtain information indicating the width of the label web sheet, the number of lanes of labels that may traverse the width of the label web sheet, the height and width of each label on the label web sheet, the distance between adjacent labels on the web sheet, and the location and size of areas of interest, such as barcodes, within each label on the label web sheet. In an embodiment, the configuration application 122 may determine the particular layout of the content on the printed material 104 based on user input. For example, the configuration application 122 may provide a user interface that may request information describing the particular layout of the content on the printed material 104. Additionally or alternatively, the imaging controller device 110 may determine the layout of the particular content on the printed material 104 by applying a suitable image processing technique to one or more sample images that may depict the content of the printed material 104. One or more sample images may be acquired by the imaging controller device 110 by suitably controlling the operation of the optical device 108 during a production run (e.g., during a sample production run or during an early stage of an actual production run) that may be performed by the production equipment 106 in producing the printed product 104. By way of example only, the imaging controller device 110 may trigger a particular camera 114 (e.g., all cameras 114, or a particular subset or subsets of all cameras 114) at one or more sample trigger intervals when the printed product 104 comes within view of the camera 114 during the production run. In one embodiment, the imaging controller device 110 may process images captured by a particular camera 114 triggered during the production run to determine the layout of content on the printed product 104.In other embodiments, the imaging controller device 110 may acquire one or more sample images of the content on the printed material 104 in other suitable manners and / or may determine the layout of particular content on the printed material 104 by using suitable techniques other than processing sample images of the content on the printed material 104 acquired during production operations performed by the production equipment 106.

[0018]

[0026] Based on information describing the layout of specific content on the printed product 104, the configuration application 122 may determine an optical system configuration profile to be used to control the optical device 108 during production of the printed product 104 by the production equipment 106. Determining the optical system configuration may include selecting one or more cameras 114 to be triggered to capture images of the area of ​​interest during movement of the printed product 104 based on the layout of the content on the printed product 104 as the printed product 104 is generated or processed by the production equipment 106. In one embodiment, for each area of ​​interest across the width of the printed product 104, such as for each barcode (or each portion of each barcode) across the width of the label web sheet, the configuration application 122 selects a specific camera 114 that will have the area of ​​interest in its entirety within its field of view during movement of the printed product 104 through its field of view. In one embodiment, such camera selection ensures that "the appropriate camera 114 is triggered during production of the printed product 104 such that the one or more specific areas of interest (e.g., one or more barcodes) in a single image are captured in their entirety by a single camera 114." In at least some embodiments, ensuring that each area of ​​interest on the print 104 is captured in its entirety within a single image facilitates processing of the images, as the images can be processed independently of each other to extract useful information from the area of ​​interest captured in each image.

[0019]

[0027] In at least some embodiments, arranging the cameras 114 in an array with adjacent cameras 114 having overlapping fields of view ensures that for various layouts of the content of the printed work 104 (such as various layouts of labels) and various locations and sizes of the areas of interest within the labels on the printed work 104, a single camera 114 can be selected to capture each area of ​​interest in its entirety, and ensures that a single image will completely include the area of ​​interest. In some circumstances, for some layouts of the content on the printed work 104, multiple cameras 114 of the multiple cameras 114 may be available to capture the area of ​​interest in its entirety as the printed work 104 moves through the field of view of the camera 114. For example, thanks to the overlap in the fields of view of the multiple cameras 114, each of the multiple cameras 114 may have the area of ​​interest in its entirety within its field of view as the printed work 104 moves through the field of view of the multiple cameras 114. In this case, the configuration application 122 may select one of the multiple available cameras 114 to be used to capture the area of ​​interest during the production process as the printed work 104 moves through the field of view of the selected camera 114. In one embodiment, the configuration application 120 may select a particular camera 114 of the multiple available cameras 114 based on the location of each of the regions of interest within the field of view of the multiple available cameras 114. For example, the configuration application 120 may select a particular camera 114 whose region of interest is closest to the center of its field of view. In other embodiments, the configuration application 120 may utilize various selection criteria to select a particular camera 114 of the multiple available cameras 114. In one embodiment, for example, a user may use a user interface to define the camera 114 to be selected.

[0020]

[0028] Determining the optical system configuration profile may additionally include determining trigger intervals used to trigger the selected camera 114 during production operations on the production equipment 106. The configuration application 122 may determine timing or distance intervals relative to a particular reference line, which may, for example, traverse the width of the printed material 104. As an example, if the area of ​​interest corresponds to a barcode on a label, the configuration application 122 may determine the distance interval along a vertical line from the beginning of a row of the label to the center of the barcode. As another example, the configuration application 122 may determine the time interval for the printed material to move along a vertical line from the beginning of a row of the label to the center of the barcode based on an expected speed of movement of the printed material.

[0021]

[0029] The image acquisition controller 116 may utilize the optical system configuration profile determined by the configuration application 122 to control the operation of the optical device 108 during a production run performed by the production equipment 106. In some embodiments, the configuration application 122 may store the determined optical system configuration profile in an optical system configuration profile memory (not shown in FIG. 1 ). The optical system configuration profile memory may store respective optical system configuration profiles determined for different layouts of printed materials 104 that the production equipment 106 may be configured to produce in different production runs or as part of the same production run. The imaging controller device 110 may be configured to retrieve from the optical system configuration profile memory an appropriate optical system configuration profile used to control the operation of the optical device 108 during a particular production run performed by the production equipment 106. For example, a user may specify via a user interface which particular optical system configuration profile should be retrieved from the memory for a particular production run. As an example, a user may utilize a user interface to select or otherwise define a particular job (e.g., a particular print job) to be performed by the production equipment 106 during a production run and associated with a layout of particular content on the printed material 104. In another embodiment, the imaging controller device 110 (e.g., the image acquisition controller 116, or another component of the imaging controller device 110) may detect the layout of particular content on the printed material 104 produced during a production run based on information the imaging controller device may receive from the production equipment 106. For example, the image acquisition controller 116 may detect the layout of particular content on the printed material 104 based on receiving signals (e.g., Ethernet Internet Protocol (IP) commands or other suitable signals) from the production equipment 106 instructing a particular production run related to the layout of particular content on the printed material 104 produced by the production equipment 106.In yet another embodiment, the imaging controller device 110 may detect the layout of the particular content on the printed product 104 by processing a code, such as a QR code or another suitable code, that may be printed on an area within the printed product 104 (e.g., on one side of a label web that is printed on the printed product 104). The code that may be printed on an area within the printed product 104 may indicate a particular production run (e.g., a particular print job) that may be associated with the layout of the particular content on the printed product 104 generated by the production equipment 106. For example, the camera 114 of the imaging array 112 may be used to capture an image of the area on the printed product 104 during an early stage of a production run performed by the production equipment 106. As another example, a camera (not shown in FIG. 1 ) separate from the imaging array 112 may be provided to capture an image of the area on the printed product 104 during an early stage of a production run performed by the production equipment 106. One or more images captured by the camera 114 of the imaging array 112 or by a camera separate from the imaging array 112 may be processed by the imaging controller device 110 to detect and decode a code that may be printed on that area of ​​the printed material 104. The imaging controller device 110 may then retrieve from the optical system configuration profile memory an appropriate optical system configuration profile that is used to control the operation of the optical device 108 during a production run based on the information indicated by the code.

[0022]

[0030] In some embodiments and / or scenarios (e.g., in scenarios where the layout of the content on the printed material 104 may change dynamically during a production run performed by the production equipment 106), the imaging controller device 110 may dynamically retrieve an appropriate optical system configuration profile from the optical system configuration profile memory during operation of the production equipment 106. In one embodiment, the imaging controller device 110 (e.g., the image acquisition controller 116, or another component of the imaging controller device 110) may detect a particular layout of the content on the printed material 104 at a particular time during a production run, for example, based on receiving a signal (e.g., an Ethernet Internet Protocol (IP) command, or another suitable signal) from the production equipment 106 that indicates a change to the layout of the new content on the printed material 104 during the production run. As another example, the printed material 104 may include a code, such as a QR code or another suitable code, that may be printed on an area of ​​the printed material 104 (e.g., on one side of a label web printed on the printed material 104), as described above, immediately prior to or simultaneously with the change to the layout of the new content on the printed material 104. The imaging controller device 110 may process one or more images of the area on the printed material 104, which may be taken by the cameras 114 of the imaging array 112 or by a camera remote from the imaging array 112 as described above, to detect the switchover to a new layout on the printed material 104. By detecting a particular layout of content on the printed material 104 at a particular time during a production run, the imaging controller device 110 (e.g., the image acquisition controller 116, or another component of the imaging controller device 110) may determine "on the fly" during a production run which particular optical system configuration profile should be retrieved from the optical system configuration profile memory and may retrieve the system configuration profile used to control the operation of the optical device 108 at the appropriate time during the production run to produce the printed material 104.

[0023]

[0031] Based on the optical system configuration profile, the image acquisition controller 116 may trigger one or more cameras 114 selected by the configuration application 122 at times that may be determined by a trigger interval determined by the configuration application 122 such that the selected camera 114 is triggered at the appropriate time to capture an image of an area of ​​interest on the printed material 104 during movement of the printed material 104 through the field of view of the selected camera or cameras 114. In some embodiments, the optical device 108 may also include one or more light sources (not shown in FIG. 1 ), which may be high intensity light emitting devices such as light emitting diodes (LEDs). In such embodiments, the image acquisition controller 116 may trigger the light source of the optical device 108 at least approximately simultaneously with triggering the camera 114 of the optical device 108, for example, to provide a short high intensity flash of light during capture of the image by the camera 114 to capture a sufficiently sharp image of the area of ​​interest on the printed material 104.

[0024]

[0032] The production device 106 may include a sensor 128 and an encoder 130. The sensor 128 may be configured to detect several reference points on the printed product 104 as the printed product 104 moves during operation of the production device 106 and generate a sensor signal indicative of the reference points on the printed product 104. The encoder 130 may track the movement of the printed product 104 and generate an encoder signal indicative of the movement of the printed product 104. The image acquisition controller 116 may receive the sensor signal generated by the sensor 128 and the encoder signal generated by the encoder 130 during operation of the production device 106 and may be guided by the signal to perform precise triggering of the selected camera 114 based on a trigger interval determined by the configuration application 122. As an example, the sensor 128 may detect a label edge in a row of labels and the sensor signal provided to the image acquisition controller 116 may indicate that the label edge of the row of labels has passed the reference point. The encoder signal provided by the encoder 130 to the image acquisition controller 116 may indicate the distance that the printed product 104 has traveled from the reference point. Based on the sensor signal provided by the sensor 128 and the encoder signal provided by the encoder 130, the image acquisition controller 116 may trigger the camera 114 when the printed product 104 has advanced from the reference point a distance (or time) corresponding to a trigger interval determined by the configuration application 122. When triggered, the selected camera 114 may capture images of the area of ​​interest on each label in the row of labels in parallel. This process may be repeated once each row of labels on the printed product 104 has passed the reference point a distance (or time) corresponding to a trigger interval determined by the configuration application 122.

[0025]

[0033] By triggering the selected camera 114 at the appropriate time determined based on the trigger interval, the image acquisition controller 116 may acquire an image of the area of ​​interest on the printed material 104 with a suitably short camera exposure (e.g., a 5 μs exposure time or other suitable short exposure time) that may be required, for example, to prevent or minimize motion blur from the image in applications having fast moving printed material (e.g., moving at 2 m / sec or other relatively high speeds) and to acquire a sufficiently sharp image to enable extraction of a signature from the image of the area of ​​interest on the printed material 104.

[0026]

[0034] The image acquisition controller 116 may provide images acquired from the optical device 108 to the processor 118 for processing of the images by the processor 118. In one embodiment, images may be processed by the processor 118 as they are acquired during production operations performed by the production equipment 106, and the processed images may be discarded so that new images may be acquired and processed by the processor 118. The processor 118 may implement an image processing application 124 to process the images. Processing the images may include using unintentionally generated artifacts in the depicted marks in the image to define identifiable electronic signatures ("signatures") that may later be used to authenticate candidate marks that likely correspond to the depicted marks in the image. As used herein, the term "artifact" is a feature (i.e., anomaly) in a mark that is created by the machine or process that produces the mark but is not due to design or intent. Examples of artifacts include: (a) deviation of the average color of a subarea (e.g., a cell of a 2D barcode) from the average derived within the mark (which may be the average of adjacent cells of the same nominal color); (b) deviation of the position of the subarea relative to a best-fit grid of neighboring subareas; (c) areas of at least one different color out of at least two colors from the nominal color of the cell; (d) deviation of continuous edges within the mark from the nominal shape; and (e) imperfections or other variations resulting from the printed mark. In some embodiments, the artifacts are not controllably reproducible. Processing the image may further include extracting some features of the signature to enhance ease and speed by which an infinite number of authentic signatures may be searched for and compared to the signatures of the candidate marks.

[0027]

[0035] In some embodiments, the processor 118 utilizes multiple cores and / or implements multi-threading techniques to more quickly process images acquired during production of the printed product 104. For example, multiple cores of the processor 118 and / or multiple threads implemented by the processor 118 may operate in parallel to process each region of interest on the printed product 104 captured in each image by each camera 104. As an example, multiple cores of the processor 118 and / or multiple threads implemented by the processor 118 may operate in parallel to process each barcode that may be captured in its entirety by each camera 114. Additionally or alternatively, multiple cores of the processor 118 and / or multiple threads implemented by the processor 118 may operate in parallel to process several portions of a single barcode that may be split into respective portions (e.g., each half of an EAN code that may be separated by a center guard on the EAN code) to allow for parallel processing of each portion of the barcode. In one embodiment, each portion of the barcode may be captured in different images by different cameras 114 during production of the printed product 104. In another embodiment, an entire barcode captured in a single image by a single camera 114 during production of printed products 104 may be pre-processed by processor 118 by using multiple threads implemented by processor 118 and / or to parse several portions of the barcode for parallel processing by multiple cores of processor 118. In one embodiment, parallel processing of each portion of the barcode may include generating a respective signature for each portion of the barcode by each core and / or using multiple threads. The generated respective signatures for each portion of the barcode may then be combined into a single signature corresponding to the barcode, and in some embodiments, an HID of the single signature corresponding to the barcode may then be generated.

[0028]

[0036] Still referring to FIG. 1 , the system 100 may include a server device 140 and / or one or more user devices 142. The imaging controller device 110 may include an interface 144 for communicatively coupling the imaging controller device 110 to the server device 140 and / or to the one or more user devices 142 via a communication network 150. The communication network 150 may be a wide area network (WAN) such as the Internet, a local area network (LAN), or any other suitable type of network. In some embodiments, the communication network 150 may be a single network or may be comprised of multiple different networks. In some embodiments, the system 100 may include a database 152. The database 152 may be communicatively coupled to the imaging controller device 110 and / or the server device 140 via the communication network 150 as shown in FIG. 1 , or may be directly or indirectly coupled to the imaging controller device 110 and / or the server device 140 in any other suitable manner. For example, in some embodiments, the database 152 may be directly connected to the server device 140 or may be included as part of the server device 140. Database 152 may be a single database or may include multiple different databases. User devices 142 may include, for example, personal computers, tablet computers, cellular phones, smartphones, and other suitable web-enabled devices.

[0029]

[0037] The server device 140 is shown in FIG. 1 as including a processor 160 and a computer-readable memory 162 that stores instructions executable by the processor 160. The computer-readable memory 162 may store an authentication application 164. In various embodiments, the computer-readable memory 162 may include a volatile memory, such as a random access memory (RAM) for storing computer instructions, and may also include a persistent memory (e.g., a hard disk, a hard drive, any other stable storage space (e.g., an SD card, a flash drive, etc.)). In some embodiments, the server device 140 includes multiple processors 160. Furthermore, in some embodiments, the authentication application 164 may be implemented by using hardware components, firmware components, software components, or any combination thereof. The imaging controller device 110 may be configured to transmit images captured from the optical device 108, and / or signatures, and / or other information extracted from the images, to the server device 140 and / or the database 152 via the interface 144 and the communication network 150. In one embodiment, interface 144 may include a Google Remote Procedure Call (gRPC) service that may be used to transmit, for example, images acquired from optical device 108, and / or signatures, and / or other information extracted from the images over communication network 150 to server device 140 and / or database 152. In some other embodiments, other suitable interfaces may be utilized. Authentication application 164 may later receive an image of the candidate mark, which may be acquired, for example, by user device 142, and determine whether the mark is authentic by generating a signature of the candidate mark and comparing the signature of the candidate mark to a signature of an authentic mark, which may be stored, for example, in database 152.

[0030]

[0038] A user of the imaging system 102 may provide print layout information to the composition application 122 via a user interface that may be provided to the user via the user device 142. In some embodiments, the user of the imaging system 102 may also monitor the progress of image capture and processing performed by the imaging system 102 via a monitoring interface that may be provided to the user via the user device 142. In some embodiments, a secure (e.g., encrypted) communication channel may be established between the user device 142 and the imaging system 102 via the communication network 150, for example to enable the user device 142 to securely control the configuration and operation of the imaging system 102. The user device 142 may be used in some embodiments to capture images of the candidate marks, and in some cases to generate signature information for the candidate marks. The user device 142 may then transmit the captured images of the candidate marks and / or signature information extracted from the candidate marks to the server device 140 for authentication of the candidate marks by the authentication application 164 of the server device 140.

[0031]

[0039] Some exemplary signature generation techniques (e.g., which in one embodiment may be implemented by the image processing application 124 of the imaging controller device 110 to extract a signature from a mark captured in an image) and some exemplary authentication techniques (e.g., which in one embodiment may be implemented by the authentication application 164 of the server device 140) are described in U.S. Patent No. 9,940,572, entitled “Methods and a Computing Device for Determining Whether a Mark is Genuine,” issued on April 10, 2018, which is incorporated by reference in its entirety.

[0032]

[0040] FIG. 2 is a block diagram of an exemplary content layout on a printed product 204, according to one embodiment. The printed product 204 may correspond to the printed product 104 of FIG. 1, and the printed product 204 is described in the context of FIG. 1 for illustrative purposes. The printed product 204 includes a label web sheet 202 having a number of lanes 206 that run across the travel direction of the printed product 204 during production of the printed product 204, and each lane 206 having a number of labels 208 is shown in FIG. 2 as running along the travel direction of the printed product 204 during production of the printed product 204. Each label 208 may include a mark 210. The mark 210 may be a brand (e.g., a logo), something with information such as a barcode, a QR code, an expiration date, tracking information such as a serial number, or decoration.

[0033]

[0041] 1 and 2, the configuration application 122 may be configured to determine the layout of the label web sheet on the print product 204. For example, the configuration application 122 may determine the following layout information: i) the number of lanes of labels on the web sheet, ii) the horizontal distance between the corresponding left ends of two horizontally adjacent labels 208, iii) the vertical distance between the corresponding bottom ends of two vertically adjacent labels, iv) the horizontal distance between the left end of the web sheet and the center of the mark 210 in the leftmost lane 206, and v) the vertical distance between the bottom end of the label 208 and the center of the mark 210 on the label 208. Briefly referring to FIG. 3, an exemplary user interface 300 may be provided by the imaging controller device 110 to obtain such layout information from a user. The user may input the requested information via the user interface 300, which may be displayed to the user on the user device 142, which may comprise the imaging system 102, or on a local display (not shown). Additionally or alternatively, the imaging controller device 110 may determine the layout of specific content on the printed material 104 by applying suitable image processing techniques to one or more sample images that may depict the content of the printed material 104. For example, the imaging controller device 110 may obtain a sample image of the printed material 204 that may be captured by the camera 114 during a production run (e.g., during a sample production run or during an early stage of an actual production run) that may be performed by the production equipment 106. The sample image may capture, for example, the entire area of ​​the printed material 204. The imaging controller device 110 may process the sample image of the printed material 204 by using suitable image processing and recognition techniques, for example, to recognize that the printed material 204 is a label web sheet, to identify the labels 208 and marks 210 on the label web sheet, and to determine layout information of the label web sheet (e.g., layout information (i)-(v) described above or other suitable information).

[0034]

[0042] 4 is a block diagram of an exemplary imaging controller device 410 according to one embodiment. In one embodiment, the imaging controller device 410 corresponds to the imaging controller device 110 of FIG. 1, and the imaging controller device 410 includes similarly numbered elements with the imaging controller device 110 that are not discussed for simplicity. For example, in one embodiment, the imaging controller device 410 includes an image acquisition controller 416, a processor 418, a memory 420, and an interface 444 that correspond to the image acquisition controller 116, the processor 118, the memory 120, and the interface 144, respectively. In one embodiment, the memory 420 includes a configuration application 422 that corresponds to the configuration application 122, and an image processing application 424 that corresponds to the image processing application 124. The memory 420 additionally includes a user interface module 426, a job training module 428, and a job management module 430.

[0035]

[0043] In some embodiments, the job training module 428 may determine a particular layout of content on the printed material 104 by applying suitable image processing techniques to one or more sample images that may depict the content of the printed material 104. For example, the job training module 428 may control the operation of the optical device 108 during a production run that may be performed by the production equipment 106 (e.g., during a sample production run or during an early stage of an actual production run) and may obtain a sample image of the printed material 104 that may be captured by the camera 114 during a production run that may be performed by the production equipment 106. The sample image may, for example, capture an entire area of ​​the printed material 104. The job training module 428 may process the sample image of the printed material 104 by using suitable image processing and recognition techniques, for example, to recognize the type of content on the printed material 104 and to identify the location of areas of interest on the printed material 104. In some embodiments, the job training module 428 may be omitted from the imaging controller device 410, and instead the imaging controller device 410 may determine information describing the layout of content on the printed material 104 based on user input.

[0036]

[0044] The job management module 430 may be configured to manage various configurations that the imaging controller device 410 may utilize to operate during production runs having various print layouts, for example, that may be performed by the production equipment 106. The job management module 430 may store optical system configuration profiles determined based on the various print layouts in the job configuration database 450, and may later retrieve the appropriate system configuration profile for configuring the imaging controller device 410 for operation during a corresponding production run that may be later performed by the production equipment 106.

[0037]

[0045] The user interface module 426 may provide various user interfaces for configuring the imaging controller device 410 and / or monitoring the operation of the imaging controller device 410. For example, the user interface module 426 may provide a user interface (such as the user interface 300 of FIG. 3) for obtaining information describing the layout of content on the printed article 104. In some embodiments, the user interface module 426 may provide a user interface that allows a user to select or otherwise define a particular production operation such that a corresponding optical system configuration profile may be retrieved from the Job configuration database 450. Additionally or alternatively, the user interface module 426 may provide a user interface for monitoring the operation of the imaging controller device 410 during production of the printed article 104 (e.g., monitoring the progress of acquiring and processing images by the imaging controller device 410), for notifying the user of any corrupted images acquired by the imaging controller device 410 during production of the printed article, for providing alerts to the user, etc.

[0038]

[0046] The image acquisition controller 416 may include or may be directly or indirectly coupled to a trigger device 431 configured to provide control signals to the optical device 108 to control operation of the optical device 108 as described herein. The image acquisition controller 416 may be configured to utilize a camera software development kit (SDK) 432 to communicate with the camera 114 of the optical device 108 and to acquire images captured by the camera 114. The image acquisition controller 416 may temporarily store images acquired from the optical device 108 in an image database 434. The images may then be queued in an image pool 436 for processing by the processor 418. The processor 418 may process the images and temporarily store the processed images and / or information (e.g., signatures) extracted from the images in a database 438 (also referred to herein as a signature database 438). The processed images and / or information extracted from the images may then be queued in a transfer queue 440 for subsequent transmission via a transfer interface 444.

[0039]

[0047] 5 is a diagram of an exemplary optical device 500 that may be utilized as the optical device 108 of FIG. 1 according to one embodiment. The optical device 500 includes an imaging array 512 located above a hood 516. The imaging array 512 includes eight cameras 514 arranged in a linear arrangement in the illustrated embodiment, with adjacent pairs of cameras 514 having overlapping fields of view. In other embodiments, the optical device 500 includes other suitable numbers of cameras 514 and / or the cameras 514 are arranged in other suitable manners. The optical device 500 additionally includes a plurality of light sources 518 including a first light source 518-1 and a second light source 518-2. The light sources 518 may be high intensity light emitting devices such as, for example, strips of light emitting diodes (LEDs). The light sources 518 may be positioned at a 45 degree angle to the surface of the hood 516, with the light emitting surface pointing in the direction of the field of view of the cameras 514.

[0040]

[0048] In one embodiment, the imaging controller device 110 controls the operation of the optical device 500 to trigger the camera 514 to take an image of the printed material 104 as described herein and to obtain the image taken by the camera 514. In one embodiment, each time the imaging controller device triggers the camera 514 to take an image, the imaging controller device 110 also triggers the light source 518 to provide a high intensity flash of light during the capture of the image by the camera 514.

[0041]

[0049] 6 is a diagram of an example optical device 600 that may be utilized as the optical device 108 of FIG. 1 according to another embodiment. The optical device 600 is similar to the optical device 500 of FIG. 5, except that the optical device 600 includes a component 630 (e.g., a mirror) having a reflective surface that may be positioned to bend the optical path of the camera 514. Because the optical path of the camera 514 is bent within the optical device 600, in at least some embodiments, the height of the optical device 600 is reduced relative to the height of the optical device 500. In one embodiment, the reduced height may enable use of the optical device 600 in small areas where, for example, limited space may be available near the production equipment 106.

[0042]

[0050] Figure 7 is a flow diagram of a method 700 for capturing an image of a printed material that may be implemented in the system of Figure 1 according to one embodiment. Method 700 may be implemented by imaging controller device 110 (e.g., processor 118) or imaging controller device 410 (e.g., processor 418) in an exemplary embodiment. For ease of explanation, method 700 is described in the context of imaging controller device 110 of Figure 1. In some other embodiments, method 700 is implemented by a suitable device other than imaging controller device 110 of Figure 1.

[0043]

[0051] In block 702, the imaging controller device 110 determines a layout of content on a printed product that is generated during production of the printed product by a production device, such as production device 106. For example, the configuration application 122 determines the layout of content on the printed product. In one embodiment, the printed product corresponds to the printed product 104 produced by the production device 106 of FIG. 1. In one embodiment, the layout of content on the printed product corresponds to the layout of the label web sheet 202 of FIG. 2, and the determining of the layout of content on the printed product in block 702 is performed as described above with reference to FIG. 2. In other embodiments, determining the layout of content on the printed product in block 702 includes determining the layout of other suitable types of printed products and / or using other suitable determination techniques.

[0044]

[0052] In block 704, the imaging controller device 110 determines an optical system configuration profile to be used to control an optical device (e.g., optical device 108, optical device 500, optical device 600, or another suitable optical device) during production of the printed product by the production equipment based on the layout of the content on the printed product determined in block 702. In one embodiment, determining the optical system configuration profile in block 704 may include selecting one or more cameras of the multiple cameras for capturing images of one or more regions of interest on the printed product. The one or more cameras may be selected such that each region of interest of the one or more regions of interest as a whole falls within a field of view of a particular camera of the one or more cameras. Determining the optical system configuration profile in block 704 may also include determining a trigger interval for triggering the selected one or more cameras.

[0045]

[0053] In block 706, the imaging controller device 110 controls operation of the optical device during production of the printed product by the production equipment. In one embodiment, controlling operation of the optical device in block 706 includes triggering, by the imaging controller device, one or more cameras selected in block 704 at a time determined based on the trigger interval determined in block 704 to capture images of one or more regions of interest on the printed product when the printed product comes within a field of view of the one or more cameras during production of the printed product.

[0046]

[0054] Method 700 may additionally include processing images captured during production operations, for example to generate a signature of the mark that may be captured in the image, and in some embodiments, an HID. In one embodiment, an exemplary process for processing the images is described in further detail below with reference to FIG. 8. In other embodiments, other suitable processes are implemented to process the images. In some embodiments, multiple cores and / or multi-threading techniques are utilized to perform parallel processing of the images. In one embodiment, capturing each area of ​​interest on the printed material 104 in a single image with a single camera 114 facilitates parallel processing of the images by each one of multiple cores and / or using multiple threads, since each core and / or thread may independently process the entirety of each area of ​​interest captured in the respective image.

[0047]

[0055] Figure 8 is a flow diagram of an exemplary process 800 implemented to process images captured in the system of Figure 1 according to one embodiment. In an exemplary embodiment, image processing application 124 implements process 800 to process images acquired by image acquisition controller 116 from optical device 108 during production operations performed by production equipment 106.

[0048]

[0056] In block 802, the image processing application 124 may receive an image acquired by the image acquisition controller 116 and may use the acquired image to measure various features of the mark that may be captured in the image. Measuring various features of the mark may result in a set of metrics that includes data regarding artifacts of the mark (e.g., the mark 210). The set of metrics may be one of several sets of metrics that the image processing application 124 generates for the mark. The image processing application 124 may perform measurements at various locations on the mark. In doing so, the image processing application 124 may divide the mark into multiple sub-areas (e.g., according to industry standards). In one embodiment, if the mark is a 2D barcode, the image processing application 124 performs measurements on all or a subset of the total number of sub-areas of the mark (e.g., all or a subset of the total number of cells). Examples of characteristics of marks that the imaging controller device 110 may measure include: a) feature shape, (b) feature aspect ratio, (c) feature location, (d) feature size, (e) feature contrast, (f) edge linearity, (g) area discontinuity, (h) extraneous marks, (i) print defects, (j) color (e.g., brightness, hue, or both), (k) colorability, and (l) contrast variation. In some embodiments, the image processing application 124 measures the same locations per mark for each feature, but different locations for different features. For example, the image processing application 124 might measure average colorability on a first set of locations of a mark and on that same first set of locations of a subsequent mark, but measure edge linearity on a second set of locations on a mark and on a subsequent mark. Two sets of locations (of different features) may be said to be "different" if there is at least one location that is not common to both sets. In one embodiment, the results of the feature measurements by the image processing application 124 include a set of metrics. There may be one or more sets of metrics for each feature of the measured features.

[0049]

[0057] In block 804, the image processing application 124 may analyze the set of metrics measured in block 802 and, based on this analysis, may generate a signature based on the set of metrics. Since the set of metrics includes data about the artifact (or artifacts) of the mark, the signature is indirectly based on the artifact. If the mark carries data (as in the case of a 2D barcode), the image processing application 124 may also include such data as part of the signature. In other words, in some embodiments, the signature may be based on both the artifact of the mark and the data carried by the mark.

[0050]

[0058] In one embodiment, to generate the signature, for each measured feature of the mark, the image processing application 124 ranks the metrics associated with the feature by magnitude and uses only those metrics that reach a predetermined threshold as part of the signature. For example, the image processing application 124 may refrain from ranking metrics that are below a predetermined threshold. In one embodiment, there is a different predetermined threshold for each characteristic measured. One or more of the predetermined thresholds may be based on a noise threshold and the resolution of the camera 114 used to capture the image.

[0051]

[0059] In one embodiment, the image processing application 124 acquires 100 data points for each feature and collects six groups of measurements: one set of measurements of colorability, one set of measurements of deviation from a best fit grid, one set of measurements of extraneous markings or invalidities, and three separate sets of measurements of edge linearity.

[0052]

[0060] As part of the ranking process, the image processing application 124 may group together metrics that are below a predefined threshold, regardless of their respective location (i.e., regardless of their location on the mark). The image processing application 124 may also order the metrics within each feature category (e.g., by magnitude) as part of the ranking process. Similarly, the image processing application 124 may simply ignore metrics that are below a predefined threshold. The ranking process may also consist solely of separating metrics that are above the threshold from those that are below the threshold.

[0053]

[0061] In one embodiment, the image processing application 124 orders the measured features according to how sensitive the features are to image resolution issues. For example, if the camera 114 of the optical device 108 does not have the ability to capture images at a sufficiently high resolution, it may be difficult for the image processing application 124 to identify edge nonlinearities. However, the image processing application 124 may not have any problem identifying deviations in coloriness. Therefore, the image processing application 124 may prioritize coloriness higher than edge nonlinearities on this basis. According to one embodiment, the image processing application 124 orders the measured features in reverse resolution-dependency order as follows: sub-area coloriness, sub-area position deviation, location of invalid or irrelevant markings, and edge nonlinearities.

[0054]

[0062] According to one embodiment, the image processing application 124 weights the measured features of the mark based on the resolution of one or more of the cameras 114 of the optical device 108 and the resolution of the captured image of the mark. For example, if the resolution of the camera 114 is low, the image processing application 124 may give a higher weight to the average colorability of the various sub-areas of the mark. If the resolution of the camera 114 is high, the image processing application 124 may give a higher weight to the edge irregularity measurements of the various sub-areas than to other features. If the mark includes error correction information as described by ISO / IEC 16022, the image processing application 124 may use the error correction information to weight the measured features. For example, the image processing application 124 may read the error correction information, use the error correction information to determine which sub-areas of the mark have errors, and underweight the measured features of such sub-areas.

[0055]

[0063] At block 806, the image processing application 124 may use the location identifiers corresponding to a subset of the metrics of the signature to derive a hash identifier (HID). In one embodiment, the image processing application 124 uses an exponent corresponding to a subset of the maximum metric of the signature to derive the HID. In some embodiments, the image processing application 124 may use an exponent corresponding to a subset of the metrics of each set as a block within the overall HID when deriving the HID.

[0056]

[0064] The imaging controller device 110 may transmit the signature and the HID via the interface 144 and the communication network 150 to the server device 140 and / or the database 152 so that the HID is associated with the signature. In some embodiments, the HID may also be used to look up the signature (e.g., the server device 140 uses a database program to set the HID as an index key for the signature).

[0057]

[0065] figure

[0058]

[0066] 9 is a block diagram of a computer system 900 suitable for implementing one or more components of the system of FIG. 1 according to one embodiment. In its most basic configuration, the computer system 900 may include at least one processor 902 and at least one memory 904. The computer system 900 may also include a bus (not shown) or other communication mechanism for conveying information data, signals and information between various components of the computer system 900. The components may include input components 910 that process user actions (e.g., selecting a key from a keypad / keyboard, selecting one or more buttons or links) and send corresponding signals to the at least one processor 902. The components may also include output components (such as a display) 911 that may display, for example, results of operations performed by the at least one processor 902. The transceiver or network interface 906 may transmit and receive signals between the computer system 900 and other devices (such as a user device that may utilize the results of processing performed by the computer system 900). In one embodiment, the transmission is wireless, although other transmission media and methods may also be suitable.

[0059]

[0067] At least one processor 902, which may be a microcontroller, digital signal processor (DSP), or other processing component, processes these various signals (e.g., for display on the computer system 900 or for transmission to other devices via communication link 918). The at least one processor 902 may also control transmission of information, such as cookies or IP addresses, to other devices. The at least one processor 902 may execute computer readable instructions stored in memory 904. The computer readable instructions, when executed by the at least one processor 902, may cause the at least one processor 902 to perform video frame processing and / or processing related to object recognition based on a plurality of video frames.

[0060]

[0068] Components of the computer system 900 may also include at least one static storage component 916 (e.g., ROM) and / or at least one disk drive 917. The computer system 900 may perform certain operations by the processor 912 and other components by executing one or more sequences of instructions contained in the system memory 904. Logic may be encoded in a computer readable medium, which may refer to any medium that participates in providing instructions to the at least one processor 902 for execution. Such media may take many forms, including but not limited to non-transitory, non-volatile, or volatile media, and transmission media. In various implementations, non-volatile media include optical or magnetic disks, volatile media include dynamic memory such as the system memory component 914, and transmission media include coaxial cables, copper wire, and fiber optics. In one embodiment, logic is encoded in a non-transitory computer readable medium. In one example, transmission media may take the form of acoustic or light waves, such as those generated during radio, optical, and infrared data communications.

[0061]

[0069] Where applicable, the various embodiments provided by the present disclosure may be implemented using hardware, software, or a combination of hardware and software. Also, where applicable, the various hardware and / or software components described herein may be combined into composite components including software, hardware, and / or both without departing from the spirit of the present disclosure. Where applicable, the various hardware and / or software components described herein may be separated into subcomponents including software, hardware, or both without departing from the scope of the present disclosure. Additionally, where applicable, it is contemplated that software components may be implemented as hardware components and vice versa.

[0062]

[0070] Software (such as program code and / or data) according to the present disclosure may be stored on one or more computer-readable media. It is also contemplated that the software identified herein may be implemented using one or more general purpose or special purpose computers, and / or networked and / or non-networked computer systems. Where applicable, the ordering of the various steps described herein may be changed and combined into composite steps and / or separated into substeps to provide the features described herein.

[0063]

[0071] When implemented in hardware, the hardware may comprise one or more discrete components, an integrated circuit, an application specific integrated circuit (ASIC), a programmable logic device (PLD), or the like.

[0064]

[0072] It should be noted that while various operations are described herein in terms of "modules" or "components," such terms are not limited to a single unit or function. Moreover, the functionality attributed to some of the modules or components described herein may be combined and attributed to fewer modules or components. Furthermore, while the disclosure still refers to specific examples, these examples are intended to be merely illustrative and thus not intended to be limiting in scope. It will be apparent to one of ordinary skill in the art that modifications, additions and / or deletions may be made to the disclosed embodiments without departing from the spirit and scope of the disclosure. For example, one or more parts of the methods described above may be performed in a different order (or simultaneously) and still achieve desirable results.

Claims

1. 1. A system for capturing images during production of printed matter, the system comprising: an optical device including a plurality of cameras arranged in an array, wherein sets of adjacent cameras in the array have overlapping fields of view; an imaging controller device; The imaging controller device determining a layout of content on the printed material; configured to determine an optical system configuration profile based on the layout of content on the printed material; determining the optical system configuration profile includes i) selecting one or more cameras from among the plurality of cameras for capturing images of one or more regions of interest on the printed material, the one or more cameras being selected such that each region of interest of the one or more regions of interest is generally within a field of view of a particular camera of the one or more cameras; and ii) determining a trigger interval for triggering the selected one or more cameras; The system is configured to trigger the selected one or more cameras at a time determined based on the trigger interval to capture images of the one or more areas of interest on the printed product when the printed product comes within the field of view of the one or more cameras during production of the printed product.

2. The system of claim 1 , wherein the imaging controller device is configured to determine the layout of content on the printed material based on user input.

3. The system of claim 1 , wherein the imaging controller device is configured to determine the layout of content on the printed material based on processing one or more sample images of the printed material.

4. The system of claim 1 , wherein the multiple cameras are arranged in a linear array of cameras having overlapping fields of view.

5. the optical device further comprises one or more light emitting devices; The system of claim 1 , wherein the imaging controller device is further configured to trigger the one or more light emitting devices at the determined trigger interval to generate flashes of light during capture of the image.

6. The system of claim 1 , wherein the optical device further comprises a reflective surface configured to bend optical paths of the multiple cameras to reduce a height dimension of the optical device.

7. The imaging controller device further comprises: receiving a sensor signal generated by a sensor, the sensor signal indicating a reference point on the printed product during production of the printed product; receiving an encoder signal generated by an encoder, the encoder signal tracking movement of the printed product during production of the printed product; The system of claim 1 , further configured to trigger the selected one or more cameras at a time determined by using the sensor signal and the motion signal.

8. The system of claim 1 , wherein the imaging controller device includes one or more processors configured to process the captured images.

9. The system of claim 8 , wherein the one or more processors are configured to process the captured images to detect defects for quality control in the production of the printed matter.

10. the one or more areas of interest on the printed material include printed marks; the one or more processors are configured to process the captured image to generate a digital signature of the printed mark; The system of claim 8 , wherein the electronic signature is used to authenticate the printed mark.

11. 10. The system of claim 9, wherein the imaging controller device is further configured to transmit one or both of i) the captured image and ii) the electronic signature generated based on the captured image to a server device over a network.

12. The system of claim 1 , wherein the imaging controller device is further configured to store the optical system configuration profile in a memory for use during production of the printed product.

13. The imaging controller device further comprises: selecting the optical system configuration profile from among a plurality of optical system configuration profiles stored in the memory; The system of claim 12 , configured to, in response to selecting the optical system configuration profile, retrieve the optical system configuration profile from the memory for use during production of the printed product.

14. 1. A method for capturing an image of a printed material with an optical device having a plurality of cameras arranged in an array, wherein sets of adjacent cameras in the array have overlapping fields of view, comprising: The method comprises: determining, by a processor of the imaging controller device, a layout of content on the printed material; determining, by the processor of the imaging controller device, an optical system configuration profile based on the layout of content on the printed material, the determining including: i) selecting one or more cameras from among the plurality of cameras for capturing images of one or more regions of interest on the printed material, the one or more cameras being selected such that each region of interest of the one or more regions of interest is collectively within a field of view of a particular camera of the one or more cameras; and ii) determining a trigger interval for triggering the selected one or more cameras; triggering the selected one or more cameras by the imaging controller device at a time determined based on the trigger interval to capture images of the one or more areas of interest on the printed product when the printed product comes within view of the one or more cameras during production of the printed product.

15. The method of claim 14 , wherein determining the layout of content on the printed material comprises determining the layout of content on the printed material based on user input.

16. The method of claim 14 , wherein determining the layout of content on the printed material comprises determining the layout of content on the printed material based on processing one or more sample images of the printed material.

17. 15. The method of claim 14, wherein the optical device further includes one or more light emitting devices, the method further including triggering the one or more light emitting devices by the imaging controller device at the determined trigger interval to generate flashes of light during capture of the image.

18. receiving at the processor of the imaging controller device a sensor signal indicating a reference point on the printed product during production of the printed product; receiving at the processor of the imaging controller device an encoder signal that tracks movement of the printed product during production of the printed product; 15. The method of claim 14, further comprising triggering the selected one or more cameras at a time determined by using the sensor signal and the encoder signal.

19. The method of claim 14 , further comprising processing the captured images by the processor of the imaging controller device to detect defects for quality control in the production of the printed matter.

20. 15. The method of claim 14, wherein the one or more areas of interest on the printed matter include a printed mark, the method further comprising processing the captured image by the processor of the imaging controller device to generate an electronic signature of the printed mark, the electronic signature being used to authenticate the printed mark.

Citation Information

Patent Citations

  • Printed matter inspection device

    JP1995200792A

  • Printed matter checking device

    JP1997300595A

  • Image processor

    JP2008310415A

  • Device for acquisition of image of predetermined section of moving print product, and method of operating the same

    JP2009153149A

  • Method of inspecting printed matter

    JP2010286256A