System and method for retrieving and displaying print attributes using augmented reality

Abstract

To provide a system and method for retrieving print attributes and displaying the print attributes over a printed sheet of a print job using augmented reality (AR).SOLUTION: A method of automatically displaying a predetermined set of print attributes of a print job includes: receiving an image of a first printed sheet, the first printed sheet including one or more at least partial machine-readable codes, the one or more at least partial machine-readable codes encoded with data related to the predetermined set of print attributes; decoding the data from the one or more at least partial machine-readable codes; determining if the data includes all of the print attributes in the predetermined set of print attributes; and, if the data includes all of the print attributes in the predetermined set of print attributes, displaying the data using augmented reality (AR) over the first printed sheet.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present disclosure relates to the field of printing systems, more particularly to the automatic retrieval of print attributes for a print job, and even more particularly to a system and method for automatically retrieving print attributes and displaying the print attributes on sheets of the print job using augmented reality. [Background technology]

[0002] An attribute page associated with a print job contains very useful information about the print job in production printing related to print job attributes or characteristics, such as color profile selection, which is important on coated paper stock. Examples of prior art attribute pages showing print job attributes are shown in Figures 1A-1C. The attribute page is printed following the print job. The print job attributes can be both qualitative (i.e., described using words) and / or quantitative (described using numbers). An operator or user can configure the print queue to always print an attribute page. However, the attribute page can still be separated from the rest of the print job and therefore difficult to find. Once the print job is complete, if the user did not choose to print the attribute page, the user cannot go back and print only the attribute page; instead, they must submit the print job again. Furthermore, users who forget to print the attribute page must review the completed job properties in the queue to double-check important information about the print job, such as the detected color profile, droplet or particle size, and rendering intent (e.g., absolute, relative, perceptual, etc.). However, because the job ID file can be modified, the completed queue job may not be the same as the one previously printed. Furthermore, the current print attribute page is simply a list that must be found and then compared to the print job sheet, which is difficult and time-consuming.

[0003] Augmented reality (AR) is an interactive experience of a real-world environment in which objects present in the real world are enhanced with computer-generated sensory information, sometimes across multiple sensory modalities, including vision, hearing, touch, somatosensation, and smell. AR can be defined as a system that incorporates three fundamental characteristics: a combination of the real world and a virtual world, real-time interaction, and precise 3D registration of virtual and real objects. The overlaid sensory information can be constructive (i.e., adding to the natural environment) or destructive (i.e., masking the natural environment). AR is used to enhance a natural environment or situation and provide a perceptually rich experience. With the help of advanced AR technologies (e.g., adding computer vision, incorporating AR cameras into smartphone applications, and object recognition), information about the real world around the user becomes interactive and can be digitally manipulated. Information about the environment and its objects is overlaid on the real world. This information can be virtual. AR is any experience that is artificial and adds to existing reality.

[0004] Therefore, what is needed is a system and method for retrieving print attributes and displaying such print attributes on printed sheets of a print job using AR. Summary of the Invention

[0005] According to aspects presented herein, there is provided a method for automatically displaying a predetermined set of printing attributes for a print job, the method including: receiving an image of a first printed sheet, the first printed sheet including one or more at least partial machine-readable codes, the one or more at least partial machine-readable codes being encoded with data related to the predetermined set of printing attributes; decoding data from the one or more at least partial machine-readable codes; determining whether the data includes all of the printing attributes in the predetermined set of printing attributes; and, if the data includes all of the printing attributes in the predetermined set of printing attributes, displaying the data on the first printed sheet using augmented reality (AR).

[0006] In some embodiments, an image of the first printed sheet is received from the camera. In some embodiments, the method further includes displaying a message if the data does not include all of the printing attributes in the predetermined set of printing attributes and receiving an image of a second printed sheet. In some embodiments, the method further includes receiving input from a user and sending decoded data to a print server based on the input. In some embodiments, the method further includes receiving input from a user, updating the decoded data based on the input, and sending the updated decoded data to the print server. In some embodiments, the method further includes receiving input from a user to enable an AR display function before receiving the image of the first printed sheet. In some embodiments, the method further includes encoding data into one or more at least partial machine-readable codes and printing the one or more at least partial machine-readable codes on the first printed sheet before receiving the image of the first printed sheet. In some embodiments, the one or more at least partial machine-readable codes are disposed along an edge of the first printed sheet. In some embodiments, the one or more at least partial machine-readable codes include a plurality of partial machine-readable codes. In some embodiments, decoding the data from the one or more at least partial machine-readable codes comprises reconstructing a complete machine-readable code from the plurality of partial machine-readable codes and decoding the data from the complete machine-readable code. In some embodiments, the machine-readable code is a quick response (QR) code. In some embodiments, the machine-readable code is selected from the group consisting of a barcode, a code number, and a recognizable image.

[0007] In some embodiments, displaying the data on the first printed sheet using augmented reality (AR) includes virtually displaying a list of printing attributes on the first printed sheet. In some embodiments, displaying the data on the first printed sheet using augmented reality (AR) includes virtually displaying the printing attributes at specific locations on the first printed sheet, the specific locations being based in part on a printed image on the printed sheet. In some embodiments, displaying the data on the first printed sheet using augmented reality (AR) includes virtually displaying one or more objects representing the printing attributes on the first printed sheet.

[0008] According to aspects described herein, there is provided a system for automatically capturing and displaying a predetermined set of printing attributes of a print job, the system comprising: one or more computer processors; one or more computer-readable storage media; a camera; and program instructions stored on the computer-readable storage media for execution by at least one of the one or more computer processors, the program instructions including: program instructions for receiving an image of a first printed sheet, the first printed sheet comprising the printed image and one or more at least partial machine-readable codes encoded with data related to the predetermined set of printing attributes; program instructions for decoding data from the one or more at least partial machine-readable codes; program instructions for determining whether the decoded data includes all of the printing attributes in the predetermined set of printing attributes; and program instructions for displaying the data on the first printed sheet using augmented reality (AR) if the decoded data includes all of the printing attributes in the predetermined set of printing attributes.

[0009] In some embodiments, the program instructions further include program instructions for displaying a message if the decoded data does not include all of the printing attributes in the predetermined set of printing attributes, and program instructions for receiving an image of a second printed sheet. In some embodiments, the program instructions further include program instructions for receiving input from a user and program instructions for sending the decoded data to a print server based on the input. In some embodiments, the program instructions further include program instructions for receiving input from a user, program instructions for updating the decoded data based on the input, and program instructions for sending the updated decoded data to the print server. In some embodiments, the program instructions further include program instructions for encoding the data into one or more at least partial machine-readable codes and program instructions for printing the one or more at least partial machine-readable codes on the first printed sheet before receiving the image of the first printed sheet. In some embodiments, the one or more at least partial machine-readable codes include a plurality of partial machine-readable codes, and the program instructions for decoding data from the one or more at least partial machine-readable codes include reconstructing a complete machine-readable code from the plurality of partial machine-readable codes and decoding the data from the complete machine-readable code. In some embodiments, the machine-readable code includes at least one of a Quick Response (QR) code, a barcode, a code number, and a recognizable image.

[0010] According to aspects presented herein, there is provided a method for automatically detecting and displaying a predetermined set of printing attributes for a print job, the method including: receiving an image of a first printed sheet, the first printed sheet including a plurality of partial machine-readable codes, the plurality of partial machine-readable codes being encoded with data related to the predetermined set of printing attributes; reconstructing a complete machine-readable code from the plurality of partial machine-readable codes; decoding data from the complete machine-readable code; determining whether the decoded data includes all of the printing attributes in the predetermined set of printing attributes; and if the data includes all of the printing attributes in the predetermined set of printing attributes, displaying the data as objects and / or human-readable text on the first printed sheet using augmented reality (AR).

[0011] According to aspects presented herein, there is provided a method for presenting print attributes of a print job, the method including converting alphanumeric data associated with the attributes of the print job into a machine-readable code, printing the machine-readable code at one or more locations on at least one printed sheet of the print job, receiving an image of the at least one printed sheet, constructing the machine-readable code from the image, decoding the alphanumeric data, and displaying the alphanumeric data in an AR display viewable over the at least one printed sheet. In some embodiments, the method further includes uploading the alphanumeric data to a print server to automatically apply the same settings (e.g., media, color profile, etc.) to another job.

[0012] According to aspects presented herein, an application with augmented reality for automating attribute page information is provided.

[0013] In some embodiments, the attribute data is encoded in one or more machine-readable codes, such as a quick response (QR) code, a barcode, a code number, a recognizable image (i.e., a diagnostic image, a service image, a logo, etc.). In some embodiments, the machine-readable code comprises transparent ink. The machine-readable code is printed on at least one sheet of the print job, for example, near an edge of the sheet. In some embodiments, the machine-readable code is printed on all sheets of the print job. In some embodiments, the machine-readable code is printed in a non-printed area of ​​the sheet or extends along the entire edge of the sheet. When a user moves the camera of a computing device, such as a smartphone, over a printed sheet, the program uses AR to display the job attributes in front of or overlaid on the printed sheet.

[0014] In some embodiments, a plurality of machine-readable codes are printed around the periphery of the printed sheet, for example, along the edges of the sheet. The program is configured to operate to scan the entire printed sheet and the plurality of machine-readable codes, so that, whether they are cut or partial, the program gathers a complete set of information about the job attributes based on sufficient of the partial attributes. If a user wants to reuse the printing attributes of a print job, the user may send the printing attributes to the server via the program, and a new print job can be programmed according to such attributes. In some embodiments, the user may change one or more of the printing attributes.

[0015] The present disclosure automatically captures print job attribute data and embeds it in machine-readable code on sheets. The program uses augmented reality to allow a user to instantly retrieve print job attribute data when they hold a camera over a printed sheet of a print job. The present disclosure provides cost savings due to fewer sheets being utilized, a simplified process for the user (the user does not have to remember to select a print attribute page or change the print queue), and print job information embedded in the print job itself in case the attribute page is misplaced.

[0016] According to aspects presented herein, a method is provided for automatically providing print job attribute data hidden in machine-readable code on each sheet of a print job, displaying the job attributes of the print job via a camera-based application using AR, and transmitting the attribute data to a print server (e.g., a XEROX® FREEFLOW® print server) to automatically program the required job attributes for subsequent print jobs.

[0017] According to aspects described herein, a mobile application with AR technology is provided to analyze output pages with QR codes within the page boundaries. The application can piece together truncated QR codes on the page to assemble the entire QR code. Using the QR codes, the application overlays a detailed set of printing attributes used to generate the output onto a physical output sheet, aligning relevant attributes to the physical page content to which they apply. This detail can then be used to verify and easily reproduce the same content or enable modifications knowing all the original print job attributes used. The present disclosure enables the capture of a large amount of configuration data on each output page in QR code format and the ability to piece together partial QR codes and overlay the resulting output onto a physical media sheet using AR technology.

[0018] According to aspects presented herein, a method is provided for placing a machine-readable code on an otherwise unmarked portion of a printed sheet, often on an edge, that contains information about the job itself (i.e., printing attributes). In some embodiments, this information includes details about the media, job programming parameters, printing device information, ink / toner and placement details, etc. A user can hold a phone or other device over the machine-readable code and view these details to learn about the job. With this information, the user can recreate the job or make changes to the job if the source is still available on the print server. The present disclosure allows users to understand a job without additional sheets that define it so that they can recreate it or compare it with other output parameters. The present disclosure intelligently presents information in the context the user is viewing (e.g., stock details when viewing the background, text rendering information when focusing on the text, etc.). In some embodiments, the machine-readable code is printed on the trim margin of the sheet. The present disclosure can be extended to not only provide in-context information but also support analysis / suggestions to aid in problem solving and optimization of user scenarios.

[0019] According to aspects presented herein, a system and method are provided for retrieving and displaying print attributes using augmented reality. Print job attributes in the form of alphanumeric data are encoded into machine-readable codes. The machine-readable codes are printed in multiple locations in the trim area of ​​the printed sheet. Due to page / image alignment, some of the codes may be cut off too close to the edge of the print. Fragments of the machine-readable codes are extracted from the periphery of the printed sheet and reconstructed as a single machine-readable code. The data in the machine-readable codes is decoded and displayed as human-readable text in an AR display, viewed directly above the printed sheet. The data is then uploaded to a print server to automatically apply the same settings (e.g., media, color profile, etc.) to another print job.

[0020] These and other objects, features, and advantages of the present disclosure will become readily apparent upon review of the following detailed description of the disclosure when taken in light of the drawings and the appended claims. [Brief explanation of the drawings]

[0021] Various embodiments are disclosed, by way of example only, with reference to the accompanying schematic drawings in which corresponding reference symbols indicate corresponding parts, and in which: [Figure 1A] 1 shows the prior art attribute page. [Figure 1B] 1 shows the prior art attribute page. [Figure 1C] 1 shows the prior art attribute page. [Figure 2] FIG. 1 is a functional block diagram illustrating an environment in accordance with some embodiments of the present disclosure. [Figure 3] 10 is a flowchart illustrating operational steps for displaying print attributes using augmented reality. [Figure 4] FIG. 1 is an elevation view of a printed sheet. [Figure 5] FIG. 1 is a front view of a portion of a display screen showing an embodiment of an application icon. [Figure 6] FIG. 1 is a front view of a portion of a display screen showing an embodiment of an application icon. [Figure 7] FIG. 1 is a block diagram of internal and external components of a computing system according to some embodiments of the present disclosure. [Figure 8] FIG. 1 is a perspective view of a computing device overlaying a virtual object onto an image of a printed sheet. DETAILED DESCRIPTION OF THE INVENTION

[0022] At the outset, it should be understood that like drawing numbers on different drawings identify identical or functionally similar structural elements. It should be understood that the claims are not limited to the disclosed aspects.

[0023] Furthermore, it is understood that this disclosure is not limited to the particular methodology, materials, and modifications described, as such may, of course, vary. It is also understood that the terminology used herein is for the purpose of describing particular aspects only, and is not intended to limit the scope of the claims.

[0024] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure pertains. It is understood that any methods, devices, or materials similar or equivalent to those described herein can be used in the practice or testing of the exemplary embodiments. The assemblies of the present disclosure can be hydraulically, electronically, pneumatically, and / or spring-driven.

[0025] It is understood that the term "substantially" is synonymous with terms such as "approximately," "very close," "about," "approximately," "surrounding," "close to," "proximately," "essentially," "neighborhood," and the like, and that such terms may be used interchangeably as they appear in the specification and claims. It is understood that the term "approximately" is synonymous with terms such as "near," "close," "adjacent," "vicinity," "immediately," and "adjacent," and that such terms may be used interchangeably as they appear in the specification and claims. The term "approximately" is intended to mean a value within 10 percent of a specified value.

[0026] The use of "or" in this application should be understood to refer to a "non-exclusive" arrangement unless otherwise stated. For example, when saying "item x is A or B," it is understood that this could mean one of the following: (1) item x is either A or B, and (2) item x is both A and B. Alternatively explained, the word "or" is not used to define an "exclusive or" configuration. For example, the "exclusive or" arrangement for the statement "item x is A or B" requires that x can be only one of A and B. Furthermore, as used herein, "and / or" is intended to refer to a grammatical conjunction used to indicate that one or more of the listed elements or conditions may be included or may occur. For example, a device including a first element, a second element, and / or a third element is intended to be construed as any one of the following structural arrangements: a device including the first element, a device including the second element, a device including the third element, a device including the first element and the second element, a device including the first element and the third element, a device including the first element, the second element, and the third element, or a device including the second element and the third element.

[0027] Furthermore, as used herein, the phrases "comprises at least one of" and "comprising at least one of," in connection with a system or element, are intended to mean that the system or element includes one or more of the elements listed after the phrase. For example, a device including at least one of a first element, a second element, and a third element is intended to be interpreted as any one of the following structural arrangements: a device including the first element, a device including the second element, a device including the third element, a device including the first element and the second element, a device including the first element and the third element, a device including the first element, the second element, and the third element, or a device including the second element and the third element. A similar interpretation is intended when the phrase "used in at least one of" is used herein.

[0028] As used herein, the terms "printer," "printer system," "printer device," "printing device," and "multi-functional device" (MFD) encompass any device that performs a print output function for any purpose, such as a digital copier, bookbinding machine, facsimile machine, multifunction peripheral, etc.

[0029] As used herein, "sheet," "web," "substrate," "printable substrate," and "media" refer to, for example, paper, transparency film, parchment, film, cloth, plastic, photofinishing paper, or other coated or uncoated substrate medium in web form upon which information or markings may be visualized and / or reproduced. Specialty sheet refers to a sheet containing cards, labels, stickers, pressure-seal envelopes, mailers, or other elements that are thicker than the substrate on which it resides.

[0030] As used herein, a "printed sheet" is a sheet that has an image printed on it as part of a print job.

[0031] As used herein, print job "attributes" or "print job attributes" refer to qualitative and / or quantitative data related to characteristics of that particular print job. Examples of these characteristics are shown in Figures 1A-1C. As shown in Figures 1A-1C, print job attributes can relate to stock characteristics (e.g., size, color, weight, coating type, etc.), output (e.g., double-sided, stapling, etc.), layout (e.g., landscape, portrait, margins, etc.), image quality (e.g., grayscale, drop size, color scheme / setup), CMYK rendering intent, etc.

[0032] As used herein, "decoding" refers to the conversion of data from a code, such as a machine-readable code, into a human-readable object and / or text. In other words, decoding a machine-readable code (e.g., a QR code) converts the information therein into something that can be easily understood by a human.

[0033] Referring now to the figures, FIG. 2 is a functional block diagram illustrating an AR-attributed environment, generally environment 100, in accordance with some embodiments of the present disclosure. FIG. 2 provides only an illustration of one implementation and does not suggest any limitations regarding the environments in which different embodiments may be implemented. Many modifications to the depicted environment can be made by one of ordinary skill in the art without departing from the scope of the present disclosure, as described by the claims. In some embodiments, environment 100 includes computing device 400, database 120, user input data 130, and printing system 160, all connected to network 110. In some embodiments, environment 100 further includes camera 150, which may be included on computing device 400 or may be a separate component from the computing device. In some embodiments, environment 100 may further include or communicate with a print server or central controller that communicates with printing device 160 (and other printing devices) regarding print jobs. The central controller is the interface between the digital front end or free flow controller software for job information and the various associated components (hardware) of the printing system 160, and can be a machine logic controller (e.g., a power supply in a package controller). In an exemplary embodiment, the central controller is a XEROX® FREEFLOW® Print Server.

[0034] Network 110 may be, for example, a local area network (LAN), a wide area network (WAN) such as the Internet, or a combination of the two, and may include wired, wireless, or fiber optic connections.

[0035] Computing device 400 may be a hardware device that uses AR attribute program 140 to generate augmented images based on information received from database 120, input data 130, printing system 160, and / or camera 150. Computing device 400 can communicate with network 110, database 120, input data 130, printing system 160, camera 150, and, in some embodiments, a print server. In some embodiments, computing device 400 may include a computer. In some embodiments, computing device 400 may include internal and external hardware components, as illustrated and described in more detail with respect to FIG. 7. In some embodiments, AR attribute program 140 is implemented on a web server, which may be an administration server, a web server, or any other electronic device or computing system capable of receiving and transmitting data. A web server may represent a computing system that utilizes clustered computers and components and, when accessed over a network, can function as a single pool of seamless resources. The web server may include internal and external hardware components, as illustrated and described in more detail with respect to FIG. 7.

[0036] The AR attribute program 140 is primarily installed on the computing device 400, but may also be additionally installed on the printing system 160. The AR attribute program 140 is configured to operate to decode data, related to print job attributes, from one or more machine-readable codes printed on a printed sheet. As described in more detail below, the AR attribute program 140 can piece together information from multiple partial machine-readable codes to create and decode a complete machine-readable code. The AR attribute program 140 is configured to operate to display data via AR on a graphic user interface (GUI) of the computing device 400 to be overlaid on the printed sheet. The display may be in the form of overlaying a list of print job attributes on the printed sheet or placing specific print job attributes of the data in specific locations. For example, a stock color (e.g., white) may be placed on portions of the sheet that do not contain ink. Thus, a user can, for example, zoom in on a portion of the sheet that does not contain marking material and determine that the stock color is white on the GUI. The AR attribute program 140 is also configured to, upon a user request, send data related to the print job attributes to the print server so that the data can be used for subsequent print jobs. In some embodiments, the AR attribute program is configured to receive input from a user that modifies the print job attributes, and then send data associated with the modified print job attributes to the print server.

[0037] AR attribute program 140 is configured to operate to encode data into machine-readable code. For example, AR attribute program 140 receives input from a user, e.g., via input data 130, regarding a print job for which the user wants to enable AR attribute capabilities. AR attribute program 140 then encodes print job attributes associated with the print job into a machine-readable code (e.g., a recognizable image such as a QR code, a barcode, a code number, a diagnostic / service image, etc.) and prints it in one or more locations on one or more printed sheets. In some embodiments, printing system 160 may be pre-programmed to encode print job attributes as machine-readable code.

[0038] Database 120 is a central storage device for print attributes. For example, database 120 can contain all print attributes available for any print job. AR attribute program 140 can communicate with database 120 to reference data from the machine-readable code to corresponding print job attributes. Database 120 can also contain data related to various display preferences. For example, a user can select a list-style AR display in which a two-dimensional print job attribute list is overlaid on the printed sheet, a positional AR display in which print job attributes are placed at specific locations on the printed sheet, or a three-dimensional AR display in which print job attributes protrude from or float above the printed sheet. Database 120 can be implemented using any non-volatile storage medium known in the art. For example, the authentication database can be implemented using a tape library, an optical library, one or more independent hard disk drives, or multiple hard disk drives in a redundant array of independent disks (RAID).

[0039] Input data 130 is data entered by a user, such as an input for enabling / disabling AR attribute capabilities, an input for sending decoded print job attribute data to a print server, an input for modifying print job attributes and sending data related to the modified print job attributes to a print server, an input for selecting AR display settings stored in database 120, etc.

[0040] FIG. 3 shows a flowchart 200 illustrating operational steps for displaying print attributes using augmented reality, according to some embodiments of the present disclosure.

[0041] In step 202, the AR attribute program 140 receives input from a user related to a print job, the input enabling AR attribute capabilities for the print job. The print job has print job attributes (see FIGS. 1A-1C) associated with it. The print job includes one or more printed sheets.

[0042] In step 204, the AR attribute program 140 encodes the data associated with the print job attributes into a print attribute identifier, e.g., a machine-readable code. The machine-readable code may be in any suitable format, e.g., a QR code, a barcode, a code number, etc. In some embodiments, the print attribute identifier is a recognizable image, such as a diagnostic / service image. For example, a particular image can be assigned a common print attribute configuration such that the AR attribute program 140 can determine from the recognizable image that a particular set of print job attributes is being used, or that at least some of the print job attributes are being used.

[0043] In step 206, the AR attribute program 140 prints a machine-readable code on the printed sheet. For example, the printing system 160 prints both the image of the print job and the machine-readable code on the same sheet. In some embodiments, the machine-readable code is printed in a trim area of ​​the sheet (i.e., along the edge of the sheet outside the imaging area) so as not to interfere with the printed image of the print job. In some embodiments, the machine-readable code is printed in multiple locations on the sheet. In some embodiments, the machine-readable code is printed as multiple partial machine-readable codes in multiple locations on the sheet. As shown in FIG. 4 , a printed sheet 300 includes a sheet 2, a printed image 4, and multiple partial machine-readable codes 6, e.g., machine-readable codes 6A-6H. In some embodiments, the machine-readable code is printed with transparent ink so that it does not affect the appearance of the image printed on the sheet. In some embodiments, the machine-readable code includes technology, such as yellow microdots, to make the data difficult to detect accidentally. In some embodiments, the machine-readable code is part of the print job design, e.g., embedded in an image of the print job. In some embodiments, the machine-readable code includes optical character recognition (OCR), such that the same code can be both human-readable and machine-readable. For example, the machine-readable code 6 may include an image of typed, handwritten, or printed text that is both human-readable and translatable / readable by the camera 150 of the computing device 400, such that the AR attribute program 140 overlays print job attributes on a printed sheet, as described herein.

[0044] In step 208, AR attribute program 140 receives an image of the first printed sheet of a print job, for example, via camera 150. As is known in the art, a user may scan printed sheet 300 with a camera on a computing device, such as a smartphone, to capture information, i.e., machine-readable codes 6A-6H, on printed sheet 300. It should be understood that in some embodiments, AR attribute program 140 receives the image from a camera or scanner on printing system 160. The image can be sent to computing device 400 (e.g., a mobile device, tablet, etc.), a standard personal computer or laptop, or a user interface on printing system 160, which then displays the decoded objects / text on the printed sheet.

[0045] In step 210, the AR attribute program 140 decodes data from one or more machine-readable codes 6. For example, if there is no complete machine-readable code on the printed sheet 300, the AR attribute program 140 uses multiple machine-readable codes 6 to reconstruct a complete machine-readable code. For example, the AR attribute program 140 may use the upper left portion 6E of the machine-readable code, the upper right portion 6H of the machine-readable code, the lower right portion 6B of the machine-readable code, and the lower left portion 6C of the machine-readable code to reconstruct a complete machine-readable code 6. The AR attribute program 140 decodes data from the complete machine-readable code 6 to determine print job attributes. In some embodiments, as described above, the AR attribute program 140 compares the decoded data with print job attribute data in the database 120 to accurately determine the print job attributes of the instant print job. For example, the AR attribute program 140 looks up data encoded in a field. In some embodiments, AR attribute program 140 determines from the layout of printed sheet 300 that certain print job attributes are associated with it. For example, AR attribute program 140 may detect a very common layout within a print job and therefore determine the print job attributes associated with it from stored print job attributes associated with that layout, for example, stored in database 120.

[0046] In step 212, the AR attribute program 140 determines whether the machine-readable code includes all data corresponding to the print job. For example, according to the print job attribute data in the database 120, the machine-readable code should include data for each field of the print job attribute.

[0047] If, in step 212, the AR attribute program 140 determines that the machine-readable code does not contain all the data corresponding to the instant print job attributes, then, in step 214, the AR attribute program 140 displays a message indicating that there is not enough data available. The message may also instruct the user to attempt to scan another printed sheet.

[0048] In step 216, the AR attribute program 140 receives an image of another printed sheet, e.g., a subsequent printed sheet. The program then proceeds to step 212 to determine whether the machine-readable code contains all data corresponding to the instant print job attributes.

[0049] If, in step 212, the AR attribute program 140 determines that the machine-readable code contains all data associated with the instant print job attributes, then, in step 218, the AR attribute program 140 uses AR to display the print job attribute data as objects and / or human-readable text. As shown in FIG. 5, a portion of a display screen (e.g., GUI) 302 is shown showing print job attributes 10 overlaid in list form on a printed sheet 300. The print job attributes 10 show only a portion of all print job attributes. In some embodiments, a user can scroll through the list of print job attributes 10 to view more print job attributes. As shown in FIG. 6, a portion of a display screen (e.g., GUI) 304 is shown showing print job attributes overlaid at specific locations on a printed sheet 300. For example, the print job attributes 20 show, among other things, the document name, print resolution, and print server release date and time. The print job attributes 22 show a histogram showing color separations. The color histogram 22 is positioned closest to the colored portion of the printed image 4. The print job attributes 26 represent a histogram showing the grayscale separation. The grayscale histogram 26 is positioned closest to the grayscale portion of the printed image 4. This allows a user to compare the colors of the printed image 4 with the print job attribute colors (i.e., compare the colors that should be printed with the colors that are actually printed) to detect errors. Other print job attributes can be similarly positioned for easy comparison by the user; for example, stock colors can be positioned outside the imaged area. In some embodiments, diagnostic or service images 24 are also placed on the printed sheet 300. These diagnostic images have known specific color targets, densities, line weights, etc., which can be automatically recognized by the AR attribute program 140 and used with the programmed attributes for detailed information to assist service personnel. Other features, such as the leading edge, trailing edge, outer edge, and inner edge of the printed sheet 300, can be overlaid on the printed sheet 300 using AR.A user may use such orientation elements, for example, the orientation of sheet 2 on the first pass (i.e., of the print head), to determine the cause of any print defects (e.g., smeared ink, wrinkles, curved corners, etc.). The AR display may include arrows, menus, dials, etc. in two-dimensional or three-dimensional form (e.g., protruding from or floating above printed sheet 300). In some embodiments, the AR display may include objects such as arrows and histograms to represent metadata or attributes about the printed page.

[0050] 8 shows a computing device 400 that includes a display 422 that captures a saved or live image of a printed sheet 306. The printed sheet 306 includes a sheet 2, a printed image 4, and one or more machine-readable codes 6, such as a machine-readable code embedded in the printed image 4 and a machine-readable code 6 positioned proximate the printed image 4. Using the AR attribute program 140, the computing device 400 virtually displays the print job attributes 12 and 14 over the image of the printed sheet 306 shown on the display 422.

[0051] In step 220, the AR attribute program 140 determines whether the user wants to send print job attribute data to the print server to apply those print job attributes to subsequent print jobs. This query may be in the form of an AR button that the user presses on the GUI of the computing device 400 to initiate the transmission of the print job attributes.

[0052] In some embodiments, in step 220, the AR attribute program 140 further determines whether the user wants to change any of the print job attributes before sending the data to the print server. For example, if the user determines that the printed color profile does not match the intended color profile, the user can use the AR attribute program 140 to change the attributes before sending such data to the print server. In some embodiments, the AR attribute program 140 automatically analyzes the programmed attributes versus the printed attributes to detect any differences between them. If there are errors, they can be easily corrected either automatically by the AR attribute program 140 or manually by the user.

[0053] In some embodiments, in an additional step, the AR attribute program 140 provides AR buttons for emulating different printing devices. For example, a user can press various AR buttons on the GUI of the computing device 400 to see, via an AR overlay, how the printed image would look if printed on a different printing device, with a different color profile, with a different stock color or coating, dot pattern, etc. In some embodiments, the emulation buttons allow a user to view prints according to different standards or print formats, such as SWOP Press (emulating US printing standards using specifications for web offset publications), Euroscale Press (emulating Euroscale four-color process printing mode), Commercial Press (emulating four-color process commercial press mode), SNAP Press (emulating standards for printing on uncoated and newsprint using specifications for unheated advertising printing), Japan Color (emulating Japan Color 2001 specifications), ISO Coated and ISO Uncoated (emulating FOGRA 27L and 29L specifications), etc.

[0054] In step 222, the AR attribute program 140 sends data associated with the print job attributes or the modified print job attributes to the print server to automatically apply the attributes to subsequent print jobs.

[0055] 7 is a block diagram of internal and external components of a computer system 400 representing the computing device of FIG. 2 , in accordance with some embodiments of the present disclosure. It should be understood that FIG. 7 provides only an illustration of one implementation and does not suggest any limitations with respect to the environments in which different embodiments may be implemented. Generally, the components shown in FIG. 7 represent any electronic device capable of executing machine-readable program instructions. Examples of computer systems, environments, and / or configurations that may be represented by the components shown in FIG. 7 include personal computer systems, server computer systems, thin clients, thick clients, laptop computer systems, tablet computer systems, cellular phones (i.e., smartphones), multiprocessor systems, microprocessor-based systems, network PCs, minicomputer systems, mainframe computer systems, and distributed cloud computing environments that include any of the above-mentioned systems or devices.

[0056] Computing device 400 includes a communications fabric 402 that provides communications between one or more processing units 404, memory 406, persistent storage 408, communications units 410, and one or more input / output (I / O) interfaces 412. Communications fabric 402 may be implemented with any architecture designed to pass data and / or control information between processors (such as microprocessors, communications, and network processors), system memory, peripheral devices, and any other hardware components in the system. For example, communications fabric 402 may be implemented with one or more buses.

[0057] Memory 406 and persistent storage 408 are computer-readable storage media. In this embodiment, memory 406 includes random access memory (RAM) 416 and cache memory 418. Generally, memory 406 may include any suitable volatile or non-volatile computer-readable storage medium. Software may be stored in persistent storage 408 for execution and / or access by one or more of the respective processors 404 via one or more memories of memory 406.

[0058] Persistent storage 408 may include, for example, multiple magnetic hard disk drives. Alternatively, or in addition to magnetic hard disk drives, persistent storage 408 may include one or more solid-state hard drives, semiconductor storage devices, read-only memory (ROM), erasable programmable read-only memory (EPROM), flash memory, or any other computer-readable storage medium capable of storing program instructions or digital information.

[0059] The media used by persistent storage 408 may also be removable. For example, a removable hard drive may be used for persistent storage 408. Other examples include optical and magnetic disks, thumb drives, and smart cards that are inserted into a drive for transfer onto another computer-readable storage medium that is also part of persistent storage 408.

[0060] The communications unit 410 provides for communication with other computer systems or devices over a network. In this exemplary embodiment, the communications unit 410 includes a network adapter or interface, such as a TCP / IP adapter card, a wireless Wi-Fi interface card, a 3G or 4G wireless interface card, or other wired or wireless communication link. The network may include, for example, copper wire, optical fiber, wireless transmissions, routers, firewalls, switches, gateway computers, and / or edge servers. Software and data used to implement embodiments of the present disclosure may be downloaded to the computing device 400 through the communications unit 410 (i.e., via the Internet, a local area network, or other wide area network). From the communications unit 410, the software and data may be loaded into persistent storage 408.

[0061] One or more I / O interfaces 412 allow for the input and output of data with other devices that may be connected to computing device 400. For example, I / O interface 412 may provide connection to one or more external devices 420, such as a keyboard, a computer mouse, a touchscreen, a virtual keyboard, a touchpad, a pointing device, or other human interface devices. External devices 420 may also include portable computer-readable storage media, such as, for example, thumb drives, portable optical or magnetic disks, and memory cards. I / O interface 412 is also connected to a display 422.

[0062] Display 422 provides a mechanism for displaying data to a user and can be, for example, a computer monitor. Display 422 can also be an integrated display and function as a touch screen, such as the built-in display of a tablet computer.

[0063] The present disclosure may be a system, a method, and / or a computer program product, which may include a computer-readable storage medium (or media) having computer-readable program instructions for causing a processor to perform aspects of the present disclosure.

[0064] A computer-readable storage medium may be a tangible device capable of holding and storing instructions for use by an instruction execution device. The computer-readable storage medium may be, for example, but not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. A non-exhaustive list of more specific examples of computer-readable storage media includes portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital versatile disk (DVD), memory sticks, floppy disks, mechanically coded devices such as punch cards or ridge structures in grooves having instructions recorded thereon, and any suitable combination of the foregoing. As used herein, a computer-readable storage medium should not be construed as being a transitory signal itself, such as an electric wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (e.g., an optical pulse passing through a fiber optic cable), or an electrical signal transmitted through a wire.

[0065] The computer-readable program instructions described herein can be downloaded to each computing / processing device from a computer-readable storage medium or from an external computer or external storage device over a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network may include copper transmission cables, optical fiber transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and transfers the computer-readable program instructions into the respective computing / processing device for storage in a computer-readable storage medium.

[0066] The computer-readable program instructions for carrying out the operations of the present disclosure may be either assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state-setting data, or source or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, and conventional procedural programming languages ​​such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer as a standalone software package, partially on the user's computer, partially on the user's computer, partially on a remote computer, or entirely on a remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (e.g., through the Internet using an Internet Service Provider). In some embodiments, electronic circuitry including, for example, a programmable logic circuit, a field-programmable gate array (FPGA), or a programmable logic array (PLA) can execute computer-readable program instructions using state information of the computer-readable program instructions to perform aspects of the present disclosure.

[0067] Aspects of the present disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present disclosure. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0068] These computer-readable program instructions may be provided to a processor of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus to manufacture a machine, such that the instructions, which execute on the processor of the general-purpose computer, special-purpose computer, or other programmable data processing apparatus, create means for performing the functions / acts specified in the flowchart and / or block diagram blocks. These computer-readable program instructions may also be stored on a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and / or other device to function in a particular manner, and the computer-readable storage medium having instructions stored therein constitutes an article of manufacture containing instructions that implement aspects of the functions / acts specified in the flowchart and / or block diagram blocks.

[0069] The computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause the computer, other programmable data processing apparatus, or other device to perform a series of operational steps to create a computer-implemented process, such that the instructions executing on the computer, other programmable apparatus, or other device implement the functions / acts specified in the flowchart and / or block diagram blocks.

[0070] The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams may represent a module, segment, or portion of instructions, including one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions noted in the blocks may be performed out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be performed substantially simultaneously, or the blocks may be performed in the reverse order, depending on the functionality involved. It should also be noted that each block of the block diagrams and / or flowchart diagrams, and combinations of blocks in the block diagrams and / or flowchart diagrams, may be implemented by a dedicated hardware-based system that performs the specified functions or acts, or may perform a combination of dedicated hardware and computer instructions.

[0071] It will be appreciated that various aspects of the above disclosure and other features and functions, or alternatives thereof, may be desirably combined into many other different systems or applications. Various presently unforeseen or unprecedented alternatives, modifications, variations, or improvements may be made by those skilled in the art thereafter, which are intended to be encompassed by the following claims. [Explanation of symbols]

[0072] 2 seats 4 Printed image 6 Machine-readable code 6A Machine-readable code 6B Machine-readable code 6C Machine-readable code 6D Machine Readable Code 6E machine-readable code 6F Machine-readable code 6G machine readable code 6H machine readable code 10 Print Job Attributes 12 Print Job Attributes 14 Print Job Attributes 20 Print Job Attributes 22 Print Job Attributes 24 Diagnostic or service images 26 Print Job Attributes 100 Augmented Reality (AR) Environment 110 Network 120 databases 130 Input Data 140 Augmented Reality (AR) Attribute Program 150 cameras 160 Printing System 200 Flowchart 202 steps 204 steps 206 steps 208 steps 210 steps 212 steps 214 steps 216 steps 218 steps 220 steps 300 printed sheets 302 Part of the display screen 304 Part of the display screen 306 printed sheets 400 computing devices 402 Communication Fabric 404 Processing Unit 406 memory 408 Persistent Storage 410 Communication Unit 412 Input / Output (I / O) Interface 416 Random Access Memory (RAM) 418 cache memory 420 External Devices 422 Display

Claims

1. 1. A method for automatically displaying a predetermined set of print attributes for a print job, comprising: receiving an image of a first printed sheet, the first printed sheet including one or more at least partial machine-readable codes, the one or more at least partial machine-readable codes encoded with data associated with the predetermined set of printing attributes; Decoding the data from the one or more at least partial machine-readable codes; Placing specific print job attributes of the data at specific locations on the first printed sheet; determining whether the data includes a desired printing attribute within the predetermined set of printing attributes; combining information from the plurality of partial machine-readable codes to generate and decode a complete machine-readable code that includes the desired printing attributes; displaying the data over the first printed sheet using augmented reality (AR) if the data includes the desired printing attribute within the predetermined set of printing attributes. method.

2. The method of claim 1 , wherein the image of the first printed sheet is received from a camera.

3. displaying a message if the data does not contain all of the printing attributes in the predetermined set of printing attributes; and further comprising receiving an image of the second printed sheet. The method of claim 1.

4. Receives input from the user, and and transmitting the decoded data to a print server based on the input. The method of claim 1.

5. Receives input from a user; updating the decoded data based on the input; and and transmitting the updated, decoded data to a print server. The method of claim 1.

6. and receiving an input from a user to enable an AR display function before the step of receiving the image of the first printed sheet. The method of claim 1.

7. encoding the data into the one or more at least partial machine-readable codes prior to the step of receiving the image of the first printed sheet; and further comprising printing the one or more at least partial machine-readable codes on the first printed sheet. The method of claim 1.

8. The method of claim 7 , wherein the one or more at least partial machine-readable codes are disposed along an edge of the first printed sheet.

9. The method of claim 1 , wherein the one or more at least partial machine-readable codes include a plurality of partial machine-readable codes.

10. said decoding said data from said one or more at least partial machine-readable codes, reconstructing a complete machine-readable code from the plurality of partial machine-readable codes; and decoding data from said complete machine-readable code; 10. The method of claim 9.

11. The method of claim 1 , wherein the machine-readable code is a Quick Response (QR) code.

12. The method of claim 1 , wherein the machine-readable code is selected from the group consisting of a bar code, a code number, and a recognizable image.

13. displaying the data on the first printed sheet using augmented reality (AR); virtually displaying the list of printing attributes on the first printed sheet. The method of claim 1.

14. displaying the data on the first printed sheet using augmented reality (AR); virtually displaying the printing attributes at specific locations on the first printed sheet, the specific locations being based in part on a printed image on the printed sheet. The method of claim 1.

15. displaying the data on the first printed sheet using augmented reality (AR); virtually displaying one or more objects representing the printing attributes on the first printed sheet. The method of claim 1.

16. 1. A system for automatically capturing and displaying a predetermined set of printing attributes for a print job, comprising: one or more computer processors; one or more computer-readable storage media; A camera and program instructions stored on the computer-readable storage medium for execution by at least one of the one or more computer processors; wherein the program instructions program instructions for receiving an image of a first printed sheet, the first printed sheet comprising a printed image and one or more at least partial machine-readable codes encoded with data related to the predetermined set of printing attributes; program instructions for decoding the data from the one or more at least partial machine-readable codes located at specific locations on the first printed sheet having specific print job attributes; program instructions for determining whether the decoded data includes all of the desired printing attributes within the predetermined set of printing attributes; program instructions adapted to combine information from a plurality of partial machine-readable codes, the program instructions further adapted to generate and decode a complete machine-readable code that includes the desired printing attributes; and program instructions for displaying the data on the first printed sheet using augmented reality (AR) if the decoded data includes all of the desired printing attributes within the predetermined set of printing attributes. system.

17. The program instructions: program instructions for displaying a message if the decoded data does not contain all of the printing attributes in the predetermined set of printing attributes; program instructions for receiving an image of the second printed sheet; The system of claim 16 further comprising:

18. The program instructions: program instructions for receiving input from a user; program instructions for transmitting the decoded data to a print server based on the input; The system of claim 16 further comprising:

19. The program instructions: program instructions for receiving input from a user; program instructions for updating the decoded data based on the input; program instructions for transmitting the updated, decoded data to a print server; The system of claim 16 further comprising:

20. The program instructions: program instructions for encoding the data into the one or more at least partial machine-readable codes prior to the step of receiving the image of the first printed sheet; program instructions for printing the one or more at least partial machine-readable codes onto the first printed sheet; The system of claim 16 further comprising:

21. the one or more at least partial machine-readable codes include a plurality of partial machine-readable codes; the program instructions for decoding the data from the one or more at least partial machine-readable codes: reconstructing a complete machine-readable code from the plurality of partial machine-readable codes; and decoding data from said complete machine-readable code; 17. The system of claim 16.

22. 17. The system of claim 16, wherein the machine-readable code comprises at least one of a quick response (QR) code, a bar code, a code number, and a recognizable image.

23. 1. A method for automatically detecting and displaying a predetermined set of printing attributes of a print job, comprising: receiving an image of a first printed sheet, the first printed sheet including a plurality of partial machine-readable codes, the plurality of partial machine-readable codes encoded with data associated with the predetermined set of printing attributes; reconstructing a complete machine-readable code from the plurality of partial machine-readable codes; Decoding the data from the complete machine-readable code; Placing specific print job attributes of the data at specific locations on the first printed sheet; determining whether the decoded data includes the desired printing attribute within the predetermined set of printing attributes; combining information from the plurality of partial machine-readable codes to generate and decode a complete machine-readable code that includes the desired printing attributes; displaying the data as objects and / or human-readable text on the first printed sheet using augmented reality (AR) if the data includes the desired printing attributes within the predetermined set of printing attributes. A method comprising:

Images