System and method for handling variations in printed indicia

Abstract

Embodiments herein relate to a method performed by a system (100) for processing variations in marks (110) printed by a group (105) of industrial printers (101). The system (100) obtains images of printed marks (110) printed by each printer (101) in the group (105). The system (100) creates a composite image from the obtained images. The printed marks (110) appear as a repeating pattern in the composite image. The system (100) compares the printed marks (110) in the composite image to each other or to another mark. The system (100) detects variations in the printed marks (110) in the composite image with a first resolution as a result of the comparison. The system (100) creates an enhanced image, wherein the detected variations are enhanced to a second resolution. The first resolution is lower than the second resolution.

Description

Technical Field

[0001] Embodiments herein generally relate to a system and methods performed by the system. More specifically, embodiments herein relate to handling variations in markings printed by a group of industrial printers. Background Art

[0002] Industrial printing and coding is an essential element of the modern production line, with a vast number of products across a wide range of industries requiring some form of marking. This marking ranges from simple best-of-breed labels to more complex markings that allow data transfer via a scanning process, such as Quick Response (QR) codes and barcodes. According to GS1, the organization responsible for maintaining barcode standards, more than 5 billion barcodes alone are scanned every day.

[0003] Variations in the quality of marks produced by industrial printers can result in reading and scanning errors on the final product and indicate underlying issues with the printer itself. Common errors including low contrast and inconsistent marking are often related to incorrect printer settings (e.g., print head distance, speed, etc.), print head problems (e.g., degradation), or substrate incompatibility. In addition, poor mark quality may indicate a less than ideal printing environment, which can be contaminated by dust or condensation. Mark variations may also not be visible to human operators for some time, as the high resolution of many industrial units enables the printing of very small-scale features.

[0004] Under certain conditions, the visual resolution of the human eye is estimated to be 170 dots per inch (dpi). This value is comparable to the 150 dpi minimum that is typical of high resolution in, for example, inkjet printing of cartons. However, research has shown that human vision reflects only an approximation of the full content of a scene - humans only see the "gist" of what is visible. This limits the ability of the human eye to detect changes between visually similar images or marks. Humans are better at detecting changes in an image when the image is structured or ordered, rather than when content is randomly distributed in the image.

[0005] Technology has developed that allows small changes in visual digital media to be identified and amplified or reduced. Previous research into motion amplification has allowed humans to detect small vibrations in videos, enabling the reconstruction of audio signals associated with the observed vibrations. From this point, further research has seen the development of algorithmic methods for enhancing small changes in images of repetitive structures. The process takes a single image as input and searches for repeating patterns within that image. The algorithm then uses these patterns to smooth out or amplify differences in color or geometric structure across the image. Applications of this method could include visual inspection methods whereby any defects in a repeating structure could be amplified for easy detection by manual or automated means.

[0006] Therefore, these issues need to be at least mitigated or resolved. Summary of the invention

[0007] It is therefore an object of embodiments herein to obviate at least one of the above disadvantages and to provide improved handling of variations in printed indicia.

[0008] According to a first aspect, the object is achieved by a method performed by a system for processing variations in indicia printed by a group of industrial printers. The system obtains images of printed indicia printed by each printer in the group. The system creates a composite image from the obtained images. The printed indicia appear as a repeating pattern in the composite image. The system compares the printed indicia in the composite image to each other or to another indicia. The system detects variations in the printed indicia in the composite image with a first resolution as a result of the comparison. The system creates an enhanced image in which the detected variations are enhanced to a second resolution. The first resolution is lower than the second resolution.

[0009] According to a second aspect, the object is achieved by a system for processing variations in marks printed by a group of industrial printers. The system is adapted to obtain images of printed marks printed by each printer in the group. The system is adapted to create a composite image from the obtained images. The printed marks appear as a repeating pattern in the composite image. The system is adapted to compare the printed marks in the composite image with each other or with another mark. The system is adapted to detect variations in the printed marks in the composite image with a first resolution as a result of the comparison. The system is adapted to create an enhanced image, wherein the detected variations are enhanced to a second resolution. The first resolution is lower than the second resolution.

[0010] Since the printed indicia in the composite image are compared to each other or to another indicia, changes can be detected and provided in the enhanced image with a second resolution. Thus, the handling of changes in printed indicia is improved.

[0011] Embodiments herein provide numerous advantages, a non-exhaustive list of examples of which follows:

[0012] One advantage of embodiments herein is that they enable a human operator to compare relative printer mark quality within a printer network, thereby facilitating identification of changes in mark quality between printers and over time. Embodiments herein also allow an operator to see changes in mark quality between printers. Mark variations are typically very small, and while they may affect the ability to scan printed marks, for example, in a store, a human operator may not be able to observe the variations optically.

[0013] Another advantage of the embodiments herein is that they enable custom and adaptive selection of printer groups to generate mark variability comparisons that can be used to identify relative differences, thereby ensuring that uniform marks are produced across all printers in the group. Multiple printer combinations can be automatically selected and compared to facilitate detection of mark variability and identification of its causes.

[0014] Another advantage of embodiments herein is that they enable an operator to quickly and intuitively identify marking variations between printers, thereby allowing an operator to initiate modification or repair of printers with high marking variations.

[0015] Furthermore, an advantage of embodiments herein is that they enable identification of mark changes early in the printing process due to the enhanced ability of human operators to detect changes. Thus, losses due to catastrophic mark changes or unexpected downtime for printer maintenance can be prevented.

[0016] Another advantage of embodiments herein is that they are able to detect otherwise difficult to detect external factors, such as the operating environment surrounding the printer that cause marking changes.

[0017] The embodiments herein are not limited to the above-described features and advantages. Those skilled in the art will recognize additional features and advantages upon reading the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Embodiments herein will now be described in more detail, by way of example only, in the following detailed description with reference to the accompanying drawings which illustrate the embodiments, in which:

[0019] Figure 1a is a schematic diagram showing an example of a system.

[0020] Figure 1b is a schematic diagram showing an example of printing marks.

[0021] Figure 2 is a schematic diagram showing an example of a system.

[0022] Figure 3 is a flow chart illustrating an example of a method.

[0023] Figure 4 is a schematic diagram illustrating an example of the method.

[0024] Figure 5 is a schematic diagram illustrating an example of the method.

[0025] Figure 6 is a flow chart illustrating an example of a method.

[0026] Figure 7 is a schematic block diagram illustrating an example of a system.

[0027] The drawings are not necessarily drawn to scale and the dimensions of certain features may be exaggerated for the sake of clarity. Instead, emphasis should be placed upon illustrating the principles of the embodiments herein. DETAILED DESCRIPTION

[0028] Variations in printed marks may indicate potential machine issues, which could negatively impact the production line due to unplanned maintenance and product recalls. Detecting variations in the early stages is particularly difficult for human operators because differences may initially be observed at only a few dots per inch for each mark. Therefore, embodiments of the present invention allow printers to be grouped in such a way as to detect minor mark variations that occur between printers, indicating the changes that are occurring and their location in the mark. This allows comparison of print settings, processes, and other environmental factors between grouped printers to identify the root cause of the variation. By identifying the source of mark variations, manufacturers can predict maintenance requirements and prevent losses due to product loss and unplanned downtime.

[0029] Figure 1a is a schematic diagram showing an example of system 100. System 100 can be any suitable device (mobile or fixed) that can adapt to and communicate via a communication connection with at least one industrial printer 101. System 100 can include, but is not limited to, for example, user equipment, mobile phones, smart phones, sensors, meters, vehicles, home appliances, medical devices, media players, cameras, machine-to-machine (M2M) devices, Internet of Things (IOT) devices, terminal devices, communication devices, tablet computers, laptops, or personal computers (PCs). System 100 can be portable, pocket-storable, handheld, including a computer, which can transmit voice and / or data to another entity (e.g., another system or server) via a communication connection. System 100 can be operated by an operator. System 100 can be suitable for executing algorithms or computer programs. System 100 can include various subsystems or modules, and the following descriptions are Figure 2 An example of this is shown in .

[0030] The system 100 is suitable for being connected to one, two or more industrial printers 101. The industrial printer 101 is configured to mark various types of substrates with different types of patterns. This can also be described as a printer 101 suitable for printing marks on substrates or objects. An example of the operation of such an industrial printer 101 is marking patterns on various types of packaging or consumer goods (e.g., on a packaging production line or a manufacturing assembly line). The term "industrial" in industrial printers, industrial printer systems, and industrial printing can refer to that it is related to industry or characterized by industry, designed or suitable for industry. Industry can be described as the process of manufacturing products by using machines and factories. In industry, environmental conditions may change over time, ambient temperature may change, etc. For simplicity, when referring to the industrial printer 101, the term printer 101 may be used in this article. Figure 1a The example in shows five printers 101, but any other n printers 101 are applicable, where n is a positive integer.

[0031] The printer network 103 includes a plurality of printers 101. Some of the printers 101 in the printer network 103 may be grouped into one or more printer groups 105. The printer network 103 is illustrated by an outer dashed box, and the printer groups 105 are illustrated by an inner dashed box. Figure 1a , the printer network 103 is illustrated as including five printers 101 , and the printer group 105 includes three printers 101 in the printer network 103 . Figure 1a The two printers 101 in the printer network 103 illustrated in FIG. 1 are not included in any printer group 105, but in another example, they may be included in another printer group 105. Figure 1a An example with one printer group 105 is shown, and any other m printer groups 105 are equally applicable, where m is a positive integer. The printer network 103 may include a greater number of printers 101 than the printer group 105, or the printer network 103 may include the same number of printers 101 as the printer group 105. The group 105 may be considered a subset of the printer network 103.

[0032] Thus, printer group 105 is a group of printers 101 selected for comparison with one another from the wider printer network 103. When the comparison of printed indicia is made, each printer 101 in printer group 105 will print the same indicia.

[0033] The variability of the mark of interest will be used for comparison of printers 101. The mark variability can be manifested as differences in parameters, including, for example, at least one of:

[0034] Color, and / or

[0035] Geometry, and / or.

[0036] Opacity, etc.

[0037] Multiple printer groups 105 may also be defined to provide in-depth, relevant information about each printer 101 compared to its peer printers 101. During analysis, a particular printer 101 may be included in one or more printer groups 105. A printer group 105 may be composed of:

[0038] Similar printers 101 within the same factory.

[0039] • Printer 101 that encodes the same indicia on different substrates.

[0040] • Printers 101 operating at different factory locations.

[0041] • Printers 101 controlled and / or maintained by different technicians or operators.

[0042] • Printer 101 operating in different settings.

[0043] Other variables from which performance information can be derived.

[0044] The mark printed by printer 101 in printer group 105 may also be compared to previous marks known to have the following characteristics:

[0045] Low variability, representing the ideal or optimal version of the marker being analyzed.

[0046] High variability, representing the worst version of the marker being analyzed.

[0047] • Collection is performed at specific points throughout the operating cycle of a printer 101 within a printer fleet 105, for example, after recalibration, after every 400 marks, etc. Specific collection points can be used for long-term data tracking, giving an accurate indication of usage performance.

[0048] The connection between the industrial printer 101 and the system 100 may be a wireless or wired connection. The connection may use any suitable protocol depending on the type and level of the layer, for example, as shown in the Open Systems Interconnection (OSI) model as understood by those skilled in the art. The connection may be a direct connection or via some other unit ( Figure 1a ) connections are not shown.

[0049] The system 100 and the industrial printer 101 may be located at substantially the same physical location, or they may be located at different physical locations.

[0050] Figure 1aFurther shown is a user interface 108 adapted to be connected to the system 100, or the printer 101, or both the system 100 and the printer 101. The user interface 108 may be integrated into or co-located with the system 100, or may also be a separate user interface 108 adapted to be connected to the system 100 and / or the printer 101. An operator of the system 100 may view the user interface 108. The operator may also interact with the user interface 108, such as providing commands to the printer 101 via the user interface 108, manipulating images printed by the printer 101, initiating changes in settings of the printer 101, etc. The user interface 108 may also be referred to as a display, screen, monitor, touch screen, output module, etc. The user interface 108 may include various modules, and the following descriptions may be used to describe the user interface 108. Figure 2 An example of this is shown in . A trained user can access and control various aspects of the marking variability analysis process through the user interface 108. The user interface 108 can be adapted to provide one-way communication to the operator or to provide two-way communication to the operator. In other words, the user interface 108 can be non-interactive or interactive. When the user interface 108 is non-interactive, it can be adapted to display only information and data that can be viewed by the user, that is, it is adapted to allow one-way communication from the system 100 and / or printer 101 to the user. The user interface 108 can be an interactive user interface in that it is adapted to allow two-way communication between the system 100 and / or printer 101 and the user, that is, the user interface 108 responds to the user's input. When the user interface 108 is an interactive user interface, it can include an input module and an output module. The user may also be referred to as an operator.

[0051] Figure 1b An example of a mark 110 printed by an industrial printer 101 is shown. The mark 110 may be any mark 110 suitable for printing on a substrate (not shown), such as a barcode, QR code, image, font, graphic, code, etc. The mark 110 may be any suitable size and color. Figure 1b Although illustrated as a barcode, any other type of mark 110 is also applicable herein.

[0052] Figure 2 1 is a schematic diagram showing another example of the system 100. The printer group 105 is Figure 2101. However, the printer group 105 may include any other suitable n printers 101, where n is a positive integer. The system 100 may include various subsystems or modules, for example, a composite image construction module 100a and an image change assessment module 100b. The user interface 108 may include various subsystems or modules, for example, a vision module 108a and an input selection module 108b. The vision module 108a may or may not be included in the user interface 108. The input selection module 108b may be an independent module or may be located at the same location in the user interface 108. The input selection module 108b may be located at the same location in the user interface 108, in the form of the user interface 108 may be, for example, a touch screen, it may be a keyboard suitable for connection to the system 100 and / or the printer 101, etc. Reference will be made to Figure 4 and Figure 5 These modules are described in more detail.

[0053] According to some embodiments, reference will now be made to Figure 3 A method for handling variations in indicia 110 printed by group 105 of industrial printers 101 is described with reference to the flowchart in FIG. 1 . In brief, Figure 3 A process for enabling identification of relative variability in printed indicia 110, such as via the human eye, is shown. Figure 3 Also shown is an adaptive grouping of printers 101, allowing identification of mark variability across various machines and locations. An operator of system 100 is intended to evaluate mark variability across a particular printer group 105, where each printer 101 in the printer group 105 produces substantially identical marks 110. The marks 110 produced by the printer group 105 may appear identical to the human eye.

[0054] The method includes at least one of the following steps, which may also be performed in another suitable order than described below:

[0055] Step 300

[0056] An operator may access the user interface 108 and initiate definition of printer groups 105 and indicia 110 to be compared, or the system 100 may initiate definition of printer groups 105 and indicia 110 to be compared. An operator may access the user interface 108, for example, via the input selection module 108b.

[0057] The printer group 105 may be defined as:

[0058] a) manually by an operator via the user interface 108, or

[0059] b) Automatically performed by the system 100, for example as a function of the input selection module 108b. The system 100 may automatically define the printer groups 105 based on predetermined requirements (eg, weekly or daily inspections).

[0060] An operator of the system 100 may identify a particular printer 101 , printer group 105 , indicia 110 , or other parameter(s) for comparison, and the system 100 may automatically populate the printer group 105 with the other printers 101 in the printer group 105 .

[0061] Information indicative of the printer group 105 may be sent from the input selection module 108 b of the user interface 108 to the system 100 , for example to the composite image construction module 100 a in the system 100 .

[0062] Step 310

[0063] The system 100 obtains an image from each printer 101 in the printer group 105. The obtained image may be referred to as an output image. This may be accomplished by the system 100 (e.g., via the composite image construction module 100a) querying the printers 101 in the printer group 105 and receiving the output image from at least some of the printers 101. Instead of querying and receiving the output image from the printer 101, the system 100 may query and obtain the output image from at least one image capture device (not shown) adapted to capture an image of a mark printed by the printer 101.

[0064] A composite image may be constructed from at least some of the output images or for all of the output images. For example, the composite image construction module 100a may construct a composite image from the output images and may send it to the image change assessment module 100b for assessment.

[0065] Output images from the printers 101 may also be retrospectively obtained from an image cache or memory associated with each printer 101 or system 100. The images in the image cache may be obtained by an image capture device connected to the printer 101. The image cache may store output images as well as sample images obtained over a longer time span for a certain period of time, for example, within 24 hours. In this way, a reference set of output images may be available to the system 100, such as its composite image construction module 100a, which increases the potential scope of printer group comparison and increases the temporal accuracy of fault detection. The image cache may be located near the system 100, the image cache may be included in the system 100, the image cache may be adapted to be connected to the system 100 and / or the printer 101, the image cache may be a cloud storage, etc.

[0066] Step 320

[0067] The system 100 analyzes the composite image to identify, enhance, and optionally measure color and spatial variations in the composite image. The variations may be at a first resolution. The first resolution may be a sub-pixel resolution. The first resolution may be variations that are not visible to the human eye. The analysis may be performed by comparing the output images to each other to identify any variability between them. The detected differences are then optically amplified so that the minor variations are visible to the human eye. When amplified, the variations may be at a second resolution. The first resolution is lower than the second resolution. The second resolution may be a pixel resolution. The second resolution may be visible to the human eye. The analysis may be performed, for example, by an image variation assessment module 100b included in the system 100. The analysis results in an enhanced image being created.

[0068] Optionally, the change measurement result may also be obtained by the system 100 (eg, by the image change assessment module 100b).

[0069] Step 330

[0070] The enhanced image is sent from the system 100 to the user interface 108 for display at the second resolution. For example, the enhanced image can be displayed by the vision module 108a. Optionally, the color and spatial variation measurements can also be sent to the user interface 108 and displayed to the operator. When at the second resolution, the operator's human eye can see the changes shown by the enhanced image.

[0071] An operator views the enhanced image, and optionally also the variation measurements, via the user interface 108 (eg, via the vision module 108a of the user interface 108).

[0072] Optionally, the operator or system 100 defines a further subset of synthetic images for further visual analysis based on the evaluation of the enhanced images. This may be performed using a subset generation module used via the user interface 108, for example.

[0073] Figure 4 is a flow chart illustrating an example of a method for processing changes in indicia 110 printed by group 105 of industrial printers 101. The method includes at least one of the following steps, which may be performed in any suitable order other than as described below:

[0074] Step 400

[0075] This step corresponds to Figure 3In addition to selecting the markers 110 to be used in the analysis, the printer set 105 can be selected by the operator, for example, using the input selection module 108b, or can be automatically selected by the system 100 itself. Information about the printer set 105 and the markers 110 is provided to the system 100. The input selection module 108b can be a separate input selection module 108b, such as a keyboard, a mouse device, a joystick, etc., or can be co-located with the vision module 108a in the user interface 108. When co-located, the input selection module 108b can be a feature of the user interface 108, enabling two-way communication between the user and the system 100, such as in the form of a touch screen.

[0076] In an alternative, an operator may define parameters of the marker variability analysis process via the user interface 108 (e.g., via the input selection module 108b). This may include:

[0077] Select a printer group 105 from the printer network 103 for which print marks 110 are to be compared.

[0078] • Select the markers 110 that will form the basis of the comparison.

[0079] Alternatively, the system 100 can automatically select the printer group 105 and / or the mark 110 and can identify the parameters, equipment and processes for comparison. In this alternative, the operator can, for example, identify a specific printer 101 to compare the printed mark 110. The system 100 can then identify other printers 101 currently producing the same mark 110 and assign them to the printer group 105.

[0080] The selection of the printer group 105 may be made by an operator via the user interface 108, or automatically by the system 100 upon request or based on a predetermined schedule. The printer group 105 may be selected based on the specific requirements of the analysis.

[0081] The results of the mark variability analysis can be presented to an operator via the user interface 108 (e.g., via the vision module 108a). The user interface 108 (e.g., the vision module 108a) allows the operator to visually evaluate and act upon any variations between the marks 110. The presented results can include images, measurements, and other relevant data. Other relevant data can include any information that helps determine the cause of the variation, such as temperature, ink brand, date of previous maintenance, etc.

[0082] Steps 401-402

[0083] These steps correspond to Figure 3310 in step 400. The system 100 (e.g., the composite image construction module 100a) uses the printer group information provided by the user interface 108 (e.g., the input selection module 108b) from step 400 to request an image of the mark 110 from each relevant printer 101. Alternatively, the image can be requested from an image capture device (not shown) suitable for capturing an image of the mark 110 printed by the printer 101. Such an image capture device can be a separate device or can be located in the same location in the printer 101. The image can be referred to as an output image. The output image can be captured by an imaging system built into each printer 101 in the printer group 105. The imaging system can produce output images of any sensing modality. Each output image can be tagged with a unique ID number (e.g., a printer ID) to allow the originating printer 101 to be identified when necessary. The output image can be cached or stored by the printer 101 or an external memory (e.g., cloud memory or system memory) for a certain period of time, allowing past images to be compiled into a reference group as needed to provide an assessment over time. Each requested printer 101 or image capture device sends an image of the mark 110 back to the system 100 .

[0084] The system 100, for example, via the composite image construction module 100a, is adapted to create a composite image composed of images of the indicia 110 produced by each printer 101 (e.g., output images from the printer group 105). When comparing multiple printer groups 105, a composite image can be generated for each printer group 105 and labeled with an appropriate image identifier (e.g., a composite image ID).

[0085] The comparison performed by system 100 may employ inputs from multiple printer groups 105 in order to separate and identify multiple causes of variation or the development of variation over time. "Comparison" refers to comparing multiple output images to detect variations between them.

[0086] The system 100 , for example via the composite image construction module 100 a , can create a single composite image for each printer group comparison.

[0087] The composite image may be constructed so that small variations between the markers 110 shown in the output image are visible to the system 100. The variations may be at a first resolution, and this may be, for example, sub-pixel resolution. Variations at the first resolution may not be visible to the human eye.

[0088] The output images included in each composite image may be automatically varied by the system 100 via the selection of the printer group 105 to obtain the desired comparison and analysis, ie, incorporating various comparison parameters and their effects on variability over time.

[0089] The marker 110 in the output image may be displayed in its entirety in the composite image, or a smaller portion of the marker (e.g., a marker segment) may be selected from the output image for analysis. The marker segment may be automatically selected by the system 100 (e.g., by the composite image construction module 100a). Alternatively, an operator may manually select a marker subsegment by using the user interface 108.

[0090] The marks 110 or mark segments in the composite image take the form of an array of repeating structures. Optionally, the system 100 (e.g., the composite image construction module 100a) may include another component that enables the system 100 to correct for or separate different sources of variation. For example, color variation between printers 101 may occur due to using slightly different ink types / levels, but the operator may be specifically searching for vibration or mark geometry issues.

[0091] Step 403

[0092] This step corresponds to Figure 3 The composite image may be provided from the composite image construction module 100a to the image change assessment module 100b. The image change assessment module 100b is a module adapted to assess the composite image for changes in the first resolution between the markers 110. The image change assessment module 100b may perform at least one of the following operations: identifying, enhancing, and measuring:

[0093] · Identification The image change assessment module 100b may detect small changes between markers 110 in (one or more) synthetic images at a first resolution (eg, sub-pixel resolution), ie, small changes that are invisible to the human eye.

[0094] · Enhancement : The image change assessment module 100b can change the detected changes to enhance the composite image by amplifying the differences between the marks 110. The amplified features are compiled into a new enhanced composite image. For simplicity, the term enhanced image will be used herein when referring to the enhanced composite image. In the case of comparing multiple printer groups 105, an enhanced image can be generated for each associated composite image. The best enhanced image for visual inspection, that is, the image produced by the selected combination of printer groups, can be constructed automatically based on many factors such as the possibility of failure, the use of new ink types, environmental changes, registered failures, or events that cause vibrations. The enhanced image can be a second resolution, which is higher than the first resolution.

[0095] · MeasurementThe image variation assessment module 100b may optionally measure the detected variation compilation data, which may be used to accurately quantify subtle differences between the markings 110. The detected variation may be referred to as a variation measurement result.

[0096] A subset of the output image included in the composite image may be extracted for further analysis. The subset of the output image may be referred to as a composite image subset. The generation of the subset may be performed by a subset generation module (not shown) included in the system 100.

[0097] These subsets may consist of, for example, at least one of the following:

[0098] • Output image showing the complete markup 110.

[0099] ·Mark the segment.

[0100] The subset of composite images may be selected, for example, to target marks 110 produced by a particular printer 101 within printer group 105, or to target a particular mark segment known to be problematic.

[0101] The generation of the subset may be initiated after the generation of the enhanced image(s) to allow the operator to see specific combinations of images, printers, or settings groups. In one alternative, the subset may be generated after an initial manual inspection of the enhanced image by the operator when the number of output images included in the enhanced image is sufficiently small. In another alternative, the subset may be automatically generated, whereby the system 100 may select those output images that exhibit the greatest change and combine them with the output images within the median change band to highlight printers / time periods, etc., that have changed.

[0102] Step 404

[0103] This step corresponds to Figure 3 330 in step 330. The output from the image variation assessment module 100b (i.e., the enhanced image and optional variation measurements) may be sent to the user interface 108, such as the vision module 108a, where they may be presented in a manner that allows an operator to intuitively determine the mark variability level and the originating printer(s) 101. Rather than sending the output to the user interface 108, the output may be processed by the system for automatically determining the mark variability level and the originating printer(s) 101, with or without input from the operator.

[0104] Based on this analysis, the operator or system 100 can initiate additional actions to infer potential causes of the variability. These additional actions can be, for example, sensor placement and printing parameter adjustments.

[0105] Steps similar to step 504 described below may be performed before or after step 404, but in Figure 4 Not shown.

[0106] Figure 5 is a flow chart showing an example of a method for handling variations in indicia 110 printed by a set of industrial printers 101. 4 and 5 are in steps 404 and 504. In other words, the other steps are the same in both examples. The method includes at least one of the following steps, which may be performed in any suitable order other than as described below:

[0107] Step 500

[0108] This step corresponds to Figure 3 Step 300 and Figure 4 In addition to selecting the markers 110 to be used in the analysis, a printer group 105 may also be selected by the system 100, or by an operator, for example, via an input selection module 108b. Information about the printer group 105 and the markers 110 is provided to the system 100. Further details about this step are described above in step 400. The input selection module 108b may be considered part of the user interface 108, as shown in the dashed box, or it may be a separate input selection module 108b.

[0109] Steps 501-502

[0110] This step corresponds to Figure 3 Step 310 and Figure 4 The system 100 (e.g., the composite image construction module 100a) uses the printer group information provided by the user interface 108 (e.g., the input selection module 108b) from step 500 to request an image of the mark 110 from each relevant printer 101 or from an image capture device (not shown). Each requested printer 101 or image capture device sends an image of the mark 110 back to the system 100.

[0111] The system 100 is adapted to create a composite image composed of images of the mark 110 produced by each printer 101 (e.g., output images from the printer group 105), for example, via the composite image construction module 100a. The composite image has a first resolution, which is lower than the second resolution of the enhanced image described later. The first resolution may be a sub-pixel resolution.

[0112] Further details regarding these steps are described above in steps 401-402.

[0113] Step 503

[0114] This step corresponds to Figure 3 Step 320 and Figure 4 Step 403 in. The composite image can be provided from the composite image construction module 100a to the image change assessment module 100b. The image change assessment module 100b receives the composite image and creates an enhanced image. The image change assessment module 100b can also obtain variability measurements related to the composite image and / or the enhanced image. The changes shown in the enhanced image can be a second resolution that is higher than the first resolution of the composite image. The second resolution can be a pixel resolution. The second resolution enables the human eye to see the changes between the images.

[0115] Additional details about this step are the same as those described above in step 403 .

[0116] Step 504

[0117] This step can be different from Figure 4 The output from the image variation assessment module 100b (i.e., the enhanced image and optional variation measurements) can be sent to an additional system component referred to as an output module 115, where it can be automatically utilized to initiate process adjustments to reduce variability or additional investigation steps such as sensor operation in each printer 101. As shown in the dashed box, the output module 115 can be included in the user interface 108, or it can be a stand-alone output module 115.

[0118] In other words, step 504 may be described as a step in which the output from the image change assessment module 100b (ie, the enhanced image and optional change measurements) may be used to trigger automatic processing in a printer 101 included in the printer group 105 .

[0119] When the output module 115 receives the enhanced image and possible change measurements from the image change assessment module 100b, it can trigger one or more processes, which can include collecting sensor data or changing printer settings. The triggered process can be automatic or non-automatic. The results of the actions initiated by the output module 115 (e.g., in the form of a data stream or visual, status update, etc.) can be fed back to the user interface 108 for evaluation or approval by the operator or system 100.

[0120] Similar to Figure 4 Step 404 in the above example may be performed before or after step 504, but in Figure 5 Not shown.

[0121] The above method will now be described from the perspective of system 100 . Figure 6is a flow chart describing the present method performed by the system 100 for processing variations in indicia 110 printed by the group 105 of industrial printers 101. The method includes at least one of the following steps to be performed by the system 100, which steps may be performed in any suitable order other than as described herein:

[0122] Step 600

[0123] This step corresponds to Figure 3 Step 300, Figure 4 Step 400 and Figure 5 In step 500 , the system 100 may obtain an identification of the first industrial printer 101 .

[0124] The identification of the first industrial printer 101 may be obtained from an operator, the system 100 , another system, or the user interface 108 .

[0125] Step 601

[0126] This step corresponds to Figure 3 Step 300, Figure 4 Step 400 and Figure 5 The system 100 may identify at least one second industrial printer 101 that is currently printing the same indicia 110 as the first industrial printer 101 . The first industrial printer 101 and the second industrial printer 101 may be included in a printer group 105 .

[0127] Step 602

[0128] This step corresponds to Figure 3 Step 300, Figure 4 Step 400 and Figure 5 The system 100 may determine from which printed indicia 110 the image should be obtained. The group 105 may include a printer 101 that prints the determined indicia 110.

[0129] Step 603

[0130] This step corresponds to Figure 3 Step 310, Figure 4 Steps 401 and 402 and Figure 5 The system 100 obtains an image of the printed indicia 110 printed by each printer 101 in the group 105 .

[0131] Step 604

[0132] This step corresponds to Figure 5The system 100 creates a composite image from the acquired images. The printed indicia 110 appear as a repeating pattern in the composite image.

[0133] Step 605

[0134] This step corresponds to Figure 3 Step 320, Figure 4 Step 403 and Figure 5 5. The system 100 compares the printed indicia 110 in the composite image to each other or to another indicia.

[0135] The other mark 110 to which the printed mark 110 is compared may be at least one of the following:

[0136] · an original version of the printed mark 110, and / or

[0137] · print the worst version of mark 110, and / or

[0138] • Labels 110 printed by another set 105 of industrial printers.

[0139] Step 606

[0140] This step corresponds to Figure 3 Step 320, Figure 4 Step 403 and Figure 5 In step 503. System 100 detects changes in printed indicia 110 in the composite image at a first resolution as a result of the comparison. The changes may be at least one of: color, geometry, and opacity.

[0141] This step may include detecting the position of the change in the composite image. The position may be represented by coordinates in an xy coordinate system, for example.

[0142] Step 607

[0143] This step corresponds to Figure 3 Step 320, Figure 4 Step 403 and Figure 5 The system 100 may measure color changes or spatial changes or both spatial and color changes in the detected changes.

[0144] Step 608

[0145] This step corresponds to Figure 3 Step 320, Figure 4 Step 403 and Figure 5The system 100 creates an enhanced image in which the detected changes are enhanced to a second resolution. The first resolution is lower than the second resolution.

[0146] Step 609

[0147] This step corresponds to Figure 3 Step 320, Figure 4 Step 403 and Figure 5 The system 100 may determine which printer 101 in the group 105 has printed the mark 110 where the change was detected based on the printer ID. Each acquired image may have a printer ID associated with the printer 101 that printed the mark 110.

[0148] Step 610

[0149] This step corresponds to Figure 3 Step 330 and Figure 4 The system 100 may display the augmented image on the user interface 108 .

[0150] Step 611

[0151] This step corresponds to Figure 3 Step 330, Figure 4 Step 404 and Figure 5 Step 504 in . The system can initiate changes to printer settings and collection of sensor data based on the detected changes.

[0152] To execute Figure 3 , Figure 4 and Figure 5 The method steps for processing changes in the mark 110 printed by the group 105 of industrial printers 101 shown in FIG. 1 may include the following: Figure 7 Arrangement shown.

[0153] The system 100 comprises a processor 701, an interface 703 and a memory 705, wherein the memory instructions are stored for performing the above method steps. The system 100 communicates via the interface 703. The interface 703 comprises both an external interface and an internal interface (not shown) for communicating with a transmitter and a receiver.

[0154] The processor 701 may include at least one of the above-mentioned composite image construction module 100a and / or image change assessment module 100b.

[0155] The system 100 is adapted to obtain, for example by means of the processor 701 , an image of a marking 110 printed by each industrial printer 101 of a set of industrial printers 105 .

[0156] The system 100 is adapted to create a composite image from the acquired images, for example by means of the processor 701. The printed indicia 110 appear as a repeating pattern in the composite image.

[0157] The system 100 is adapted to compare the printed marks 110 in the composite image with each other or with another mark, for example by means of the processor 701. The other mark 110 to which the printed mark 110 is compared may be:

[0158] · an original version of the printed mark 110, and / or

[0159] · print the worst version of mark 110, and / or

[0160] • Labels 110 printed by another set 105 of industrial printers.

[0161] The system 100 is adapted to detect, for example by means of the processor 701, changes in the printed marks 110 in the composite image with a first resolution as a result of the comparison.

[0162] The system 100 is adapted to create an enhanced image, for example by means of the processor 701, wherein the detected changes are enhanced to the second resolution.The first resolution is lower than the second resolution.

[0163] The system 100 may be adapted to obtain an identification of the first industrial printer 101, for example by means of the processor 701. The identification of the first industrial printer 101 may be obtained from an operator, the system 100, another system or the user interface 108.

[0164] The system 100 may be adapted to identify, for example by means of the processor 701, at least one second industrial printer 101 currently printing the same marking 110 as the first industrial printer 101. The first industrial printer 101 and the second industrial printer 101 may be comprised in the same group 105 of printers.

[0165] The system 100 may be adapted to determine, for example by means of the processor 701, from which printed indicia 110 the image should be obtained. The set 105 may comprise a printer 101 which prints the determined indicia 110.

[0166] The system 100 may be adapted to measure color and / or spatial variations in the detected changes, for example by means of the processor 701 .

[0167] The system 100 may be adapted to determine, based on the printer ID, for example by means of the processor 701, which printer 101 in the group 105 has printed the mark 110 where the change was detected. Each acquired image may have a printer ID associated with the printer 101 that printed the mark 110.

[0168] The system 100 may be adapted to display the augmented image on the user interface 108 , for example, by means of the processor 701 .

[0169] The system 100 may be adapted to initiate changes in printer settings and collection of sensor data based on detected changes, for example, by means of the processor 701 .

[0170] The current mechanism for handling changes in the indicia 110 printed by the group 105 of industrial printers 101 may be through one or more processors (e.g., Figure 7 The system 100 of the present invention can be implemented by a processor 701 in the system arrangement shown in the figure and a computer program code for executing the functions of the embodiments of the present invention. The processor can be, for example, a digital signal processor (DSP), an application specific integrated circuit (ASIC) processor, a field programmable gate array (FPGA) processor or a microprocessor. The above program code can also be provided as a computer program product, for example, when loaded into the system 100, in the form of a data carrier carrying the computer program code for executing the embodiments of the present invention. One such carrier can be in the form of a CD-ROM disk. However, for other data carriers such as memory sticks, this is feasible. The computer program code can also be provided on a server as a pure program code and downloaded to the system 100.

[0171] The computer program may include, when executed on at least one processor, causing the at least one processor to perform Figure 3 , Figure 4 , Figure 5 and Figure 6 The carrier may include a computer program and the carrier is one of an electronic signal, an optical signal, a radio signal or a computer-readable storage medium.

[0172] In summary, the embodiments herein relate to:

[0173] The system 100 enables an operator to intuitively identify subtle variations in printed indicia 110 based on the relative performance of grouped printers 105 .

[0174] • How to identify subtle variations in the quality of printed indicia 110 based on the relative performance of other printers 101 .

[0175] • How to group printers 101 to create advantageous comparison conditions, thereby allowing an operator or system 100 to determine the location and cause of marking variations.

[0176] • How to enable an operator or system 100 to observe subtle changes in the appearance of the printed indicia 110 using, for example, the human eye.

[0177] How to improve printer fleet management 101 by predicting maintenance needs based on subtle marking variations between printers.

[0178] The method described in this article can be summarized as follows:

[0179] An operator or system 100 wishes to evaluate variations between indicia 110 produced by certain printers 101 in the printer network 103 and identifies, for example, via the user interface 108, the printers 101 associated with the system.

[0180] The system 100 obtains images of the indicia 110 produced by each associated printer 101, e.g., via an image capture device or directly from the printer 101, and merges them into a first image, referred to as a composite image, in which the printed indicia 110 appear as a repeating pattern. The composite image has a first resolution, e.g., sub-pixel resolution.

[0181] The system 100 identifies any variations between the marks 110 at a first resolution and generates a second image, referred to as an enhanced image, in which the variations are magnified to a second resolution so that they can be seen, for example, by a human eye. The enhanced image has a second resolution that is greater than the first resolution. The second resolution may be a pixel resolution.

[0182] The enhanced image may be viewed by an operator via the user interface 108 and the operator or system 100 may act upon any observed variations between the markings 110 or the enhanced image may be sent to the output module 115 at a second resolution where it may be utilized to initiate process adjustments in each printer 101 to reduce variability or additional investigative steps such as sensor operation.

[0183] Herein, a set of images from different printers 101 are used. The printers 101 may be located in different factories.

[0184] Embodiments herein provide a method for manually or automatically facilitating the selection of relevant printers 101 for advantageous performance comparison and printer diagnostics. Embodiments herein enable rapid and intuitive analysis of subtle marking variations, such as by the human eye of an operator. Embodiments herein compile images captured by various printers 101 into a composite image, and further into an enhanced image that may be suitable for marking variability analysis.

[0185] As used herein, the term "enhanced" means that the changes are enhanced or magnified compared to those in the composite image. In other words, the changes in the enhanced image have a higher resolution than those in the composite image.

[0186] The embodiments herein are not limited to the above-described embodiments. Various alternatives, modifications, and equivalents may be used. Therefore, the above-described embodiments should not be considered to limit the scope of the embodiments defined by the appended claims. Features from one embodiment may be combined with one or more features of any other embodiment.

[0187] The term "at least one of A and B" should be understood to mean "only A, only B, or both A and B", where A and B are any parameters, numbers, indicators, etc. used herein.

[0188] It should be emphasized that when the term "includes / comprising" is used in this specification, the term is used to specify the presence of the features, integers, steps or components, but does not exclude the presence or addition of one or more other features, integers, steps, components or groups thereof. It should also be noted that the "a" or "an" preceding an element does not exclude the presence of a plurality of such elements.

[0189] As used herein, the term "configured to" may also be referred to as "arranged to", "adapted to", "capable of" or "operable for".

[0190] It should also be emphasized that the steps of the methods defined in the appended claims may be performed in an order different from the order in which they appear in the claims without departing from the embodiments herein.

Claims

1. A computer-implemented method for processing changes in indicia (110) printed by a set (105) of industrial printers (101), performed by a system (100) comprising a computer, the method comprising: obtaining (310, 401, 402, 501, 502, 603) an image of a printed mark (110) printed by each printer (101) in the group (105); creating (310, 401, 402, 501, 502, 604) a composite image from the obtained image, wherein the printed indicia (110) appear as a repeating pattern in the composite image; comparing the printed marks (110) in the composite image to each other (320, 403, 503, 605) or to another mark; detecting (320, 403, 503, 606) a change in the printed mark (110) in the composite image at a first resolution as a result of the comparison, wherein the change at the first resolution is not visible to a human eye; and creating (320, 403, 503, 608) an enhanced image in which the changes detected between the markers (110) are magnified to be visible to the human eye; The enhanced image is displayed (330, 404, 610) on a user interface (108).

2. The method according to claim 1, further comprising: Obtaining (300, 400, 500, 600) an identification of a first industrial printer (101); and Identifying (300, 400, 500, 601) at least one second industrial printer (101) currently printing the same marking (110) as the first industrial printer (101); Wherein, the first industrial printer (101) and the at least one second industrial printer (101) are included in a printer group (105).

3. The method according to claim 2, wherein: The identification of the first industrial printer (101) is obtained from an operator, from the system (100), from another system or from a user interface (108).

4. The method according to any one of claims 1 to 3, further comprising: It is determined (300, 400, 500, 602) from which printed indicia (110) an image should be obtained, wherein the group (105) includes a printer (101) that prints the determined indicia (110).

5. The method according to any one of claims 1 to 3, further comprising: Color and / or spatial variations in the detected changes are measured (320, 403, 503, 607).

6. The method according to any one of claims 1 to 3, further comprising: Based on the printer identification ID, it is determined (320, 403, 503, 609) which printer (101) in the group (105) has printed the mark (110) in which the change was detected, wherein each obtained image has a printer ID associated with the printer (101) that printed the mark (110).

7. The method according to any one of claims 1 to 3, further comprising: Based on the detected changes, changes to printer settings and collection of sensor data are initiated (330, 404, 504, 611).

8. The method according to any one of claims 1 to 3, wherein: Another mark (110) compared with the printed mark (110) is: the original version of the printed mark (110), and / or the worst version of said printed mark (110), and / or • Labels (110) printed by another set (105) of industrial printers.

9. A system (100) comprising a computer, the system comprising a processor (701), the system (100) being adapted to be connected to a bank (105) of industrial printers (101), wherein: The system (100) is adapted to perform the following operations with the aid of the processor (701): obtaining an image of a mark (110) printed by each industrial printer (101) in a set of industrial printers (105); creating a composite image from the acquired image, wherein the printed indicia (110) appear as a repeating pattern in the composite image; comparing printed indicia (110) in the composite image to each other or to another indicia; detecting a change in the printed mark (110) in the composite image at a first resolution as a result of the comparison, wherein the first resolution is not visible to a human eye; creating an enhanced image in which the changes detected between the markers (110) are magnified to be visible to the human eye; The enhanced image is displayed on a user interface (108).

10. The system (100) according to claim 9, further adapted to: obtaining an identification of a first industrial printer (101); and Identifying at least one second industrial printer (101) currently printing the same mark (110) as the first industrial printer (101); in, The first industrial printer (101) and the second industrial printer (101) are included in a printer group (105).

11. The system (100) according to claim 10, wherein: The identification of the first industrial printer (101) is obtained from an operator, from the system (100), from another system or from a user interface (108).

12. The system (100) according to any one of claims 9 to 11, further adapted to: determining from which printed mark (110) the image should be obtained, and wherein, The set (105) includes a printer (101) that prints the determined mark (110).

13. The system (100) according to any one of claims 9 to 11, further adapted to: Color and / or spatial variations in the detected changes are measured.

14. The system (100) according to any one of claims 9 to 11, further adapted to: Based on the printer identification ID, determining which printer (101) in the group (105) has printed the change detected mark (110), wherein Each acquired image has a printer ID associated with the printer (101) that printed the indicia (110).

15. The system (100) according to any one of claims 9 to 11, further adapted to: Based on the detected changes, changes to printer settings and collection of sensor data are initiated.

16. The system (100) according to any one of claims 9 to 11, wherein: Another mark (110) compared with the printed mark (110) is: the original version of the printed mark (110), and / or the worst version of said printed mark (110), and / or • Labels (110) printed by another set (105) of industrial printers.

17. A computer program product comprising instructions which, when executed on at least one processor, cause the at least one processor to perform the method according to any one of claims 1 to 8.

18. A computer-readable storage medium comprising instructions which, when executed on at least one processor, cause the at least one processor to perform the method according to any one of claims 1-8.

Images