Information processing device and information processing method

Abstract

To provide an information processing system that can easily facilitate management of a deliverable even when the deliverable is divided into a plurality of parts.SOLUTION: In an information processing system having an information processing device, the information processing device comprises: a color code image generating unit that generates first color code data associated with a first ID and second color code data associated with a second ID associated with the first ID; and a display unit that displays the second ID of the second color code data associated with the first ID when image data of a recording medium on which the second color code data is printed is acquired from the imaging device.SELECTED DRAWING: Figure 15

Description

Technical Field

[0001] The present invention relates to information processing Apparatus and information processing method and is concerned with it.

Background Art

[0002] Conventionally, the progress of a job consisting of a plurality of work processes has been managed by utilizing a barcode or the like printed on a work instruction sheet.

[0003] In addition, an RFID tag is attached to an operator and an object on which work is performed (for example, materials, work-in-progress, or products in a factory, etc.), and the RFID tag is read at an entrance gate that is the entrance to the processing plant and an exit gate that is the exit of the processing plant, thereby managing the working time of the operator and the flow of the object on which work is performed (for example, entering and leaving the workplace). A system has been conventionally known (for example, see Patent Document 1).

Summary of the Invention

Problems to be Solved by the Invention

[0004] In an existing system that manages the progress of a job consisting of a plurality of work processes by utilizing a barcode or the like printed on a work instruction sheet, a user may want to add a new function while retaining the function (function of the work instruction sheet) realized by using the work instruction sheet. However, in the conventional technology, it is not easy to add a new function to the work instruction sheet while minimizing changes to the existing system.

[0005] In addition, in the conventional technology, when there is only one identification information for one job, when the product corresponding to that one job (for example, a bundle of printed materials, etc.) is divided into a plurality, it is difficult to individually manage the divided products.

[0006] An embodiment of the present invention has been made in view of the above points, and it is an object to provide information processing that can easily manage products even when the products are divided into a plurality. Device for this purpose. [Means for solving the problem]

[0007] An information processing device comprising: first image data of a first slip including first color code data associated with information of a first ID; and second image data of a second slip which includes second color code data associated with a second ID associated with the first ID and is different from the first image data; , including a third color code data associated with a third ID associated with the first ID, and a third image data of a third slip that is different from the first image data and the second image data. generate Image data generation unit and When the imaging device acquires image data of a medium on which the second color code data is printed, the second Linked to color code data A screen that displays the second ID linked to the first ID, and which is associated with the first ID The first ID 2 and , the second ID identified based on the captured image data acquired from the imaging device Corresponding The status of the managed item and ,before Record number 3 ID Corresponding Display a screen that simultaneously shows the status of the managed item. Having a display unit It is characterized by the following: [Effects of the Invention]

[0008] According to an embodiment of the present invention, even when the deliverables are divided into multiple parts, the deliverables can be easily managed. [Brief explanation of the drawing]

[0009] [Figure 1] This is a diagram illustrating an example of a job management system according to this embodiment. [Figure 2] This is an illustrative diagram of an example of a work instruction sheet used in the job management system according to this embodiment. [Figure 3] This is a hardware configuration diagram of an example computer. [Figure 4] This is a functional configuration diagram of an example of a work process management system. [Figure 5]This is a diagram showing an example of a table in which a memory unit stores various types of information in association with each other. [Figure 6] This is a diagram showing an example of a table in which a memory unit stores in association with each other the identification information of a camera, which is an example of a photographing device, and the state of a work process. [Figure 7] This is an image diagram showing an example of a work process in a printing factory. [Figure 8] This is a flowchart showing an example of a process for creating a second slip from a first job ID. [Figure 9] This is a flowchart showing an example of a process for generating a color-coded image. [Figure 10] This is a diagram for explaining a coding rule capable of expressing ternary numbers. [Figure 11] This is a diagram showing an example of information for encoding into an optical symbol. [Figure 12] This is a diagram showing an example of an optical symbol when the number of colors assigned to each cell of the optical symbol is four. [Figure 13] This is a diagram showing an image of a process for creating a work instruction sheet with color codes. [Figure 14] This is a flowchart showing an example of a process for updating a job status when passing through a gate. [Figure 15] This is a flowchart showing an example of a process for updating a job status when storing in a temporary storage location. [Figure 16] This is a transition diagram showing an example of a UI screen displayed by a work process management system. [Figure 17] This is a diagram showing an example where a second work product is generated. [Figure 18] This is a diagram showing an example of creating a second slip. [Figure 19] This is a transition diagram showing an example of a UI screen displayed by a work process management system when a second work product is generated. [Figure 20] This is a diagram showing an example of a system according to a third embodiment. [Figure 21] This is a diagram showing an example of the hardware configuration of an information processing terminal. [Figure 22]This figure shows an example of a functional block diagram of the third embodiment. [Figure 23] This figure shows an example of a table in which the memory unit stores various types of information in an associated manner. [Figure 24] This figure shows an example of a screen displayed on a display device. [Figure 25] This figure shows the first example of displaying a message. [Figure 26] This figure shows a second example of displaying a message. [Figure 27] This figure shows a third example of displaying a message. [Modes for carrying out the invention]

[0010] Embodiments of the present invention will be described below with reference to the drawings. In this embodiment, a job management system that manages the work process of a job in a printing factory using a function that utilizes work instructions (slips) (function of work instructions) will be described as an example.

[0011] [First Embodiment] <System Configuration> Figure 1 is a diagram illustrating an example of a job management system according to this embodiment.

[0012] Figure 2 is an illustrative diagram of an example of a work instruction sheet used in the job management system according to this embodiment.

[0013] In the job management system 1 shown in Figure 1, the customer system 10, the work process management system 14, the printer 16, and one or more cameras 18 are connected to each other via a network 20 such as the Internet or LAN, enabling data communication.

[0014] Customer system 10 is an example of an existing system used by the customer, and it creates a work order 800 for customer system 10, as shown in Figure 2(A), which displays a barcode indicating the job ID.

[0015] The job ID is an example of identification information that identifies a job. Additionally, the work order 800 for the customer system 10 displays at least one barcode image 801 used by the customer system 10.

[0016] The job ID may be displayed as a barcode image 801 or as text in the work order 800 for the customer system 10. The customer system 10 provides the user with existing functions realized by the work order 800 for the customer system 10.

[0017] The work process management system 14, the printer 16, and one or more cameras 18 constitute an information processing system 12 that adds new functions to the work instruction sheet 800. The work process management system 14 manages the progress of a job consisting of multiple work processes using a work instruction sheet 810 for the information processing system 12, which is assigned the color code image 811 shown in Figure 2(B). Details of the management will be described later. The information processing system 12 can identify the job ID from the color code image 811, as will be described later.

[0018] Printer 16 prints work instructions 810 for the information processing system 12.

[0019] Camera 18 is positioned to capture images of locations within the printing plant that correspond to the work process of a job. These locations include areas where printed materials pass through during transitions between work processes, and temporary storage areas where printed materials are temporarily stored.

[0020] Camera 18 can be either a PTZ camera or an IP camera. A PTZ camera is a camera that can operate its PTZ (Pan Tilt Zoom) function via the network 20 and can transmit captured images or videos via the network 20. An IP camera is a camera that can be operated via the network 20 and can transmit captured images or videos via the network 20. Captured images or videos taken by camera 18 are transmitted to the work process management system 14 via the network 20.

[0021] In the information processing system 12 that adds new functions to the work instruction sheet 800, a work instruction sheet 810 for the information processing system 12 is affixed to a printed document, which is an example of an intermediate product or material for the job corresponding to the work instruction sheet 810. The work instruction sheet 810 is affixed to the printed document, for example, so that it can be easily photographed by the camera 18.

[0022] The work process management system 14 manages the progress of the work process (job status) of a job based on the work process of the job corresponding to the camera 18 that photographed the work instruction sheet 810, and the job ID identified from the color code image 811 of the work instruction sheet 810. The work process management system 14 also manages the history of the work process of the job, as well as the photographed images or videos showing the work instruction sheet 810.

[0023] Note that the configuration of the job management system 1 shown in Figure 1 is just one example. For example, the job management system 1 may include other systems, and the work process management system 14 may have a different name. The work process management system 14 may be implemented in a single server environment or in a multi-server environment.

[0024] <Hardware Configuration> The customer system 10 and the work process management system 14 are implemented, for example, by a computer 500 with the hardware configuration shown in Figure 3 (note that computer 500 is an example of an information processing device).

[0025] Figure 3 is a hardware configuration diagram of an example computer. Computer 500 includes an input device 501, a display device 502, an external interface 503, RAM 504, ROM 505, a CPU 506, a communication interface 507, and an HDD 508, which are all interconnected via bus B. The input device 501 and the display device 502 may be used in a connected configuration.

[0026] The input device 501 includes a keyboard, mouse, and touch panel, and is used by the user to input various operation signals.

[0027] The display device 502 includes a display and displays the processing results from the computer 500.

[0028] Communication I / F 507 is an interface that connects computer 500 to various networks. This allows computer 500 to perform data communication via communication I / F 507.

[0029] Furthermore, HDD508 is an example of a non-volatile storage device that stores programs or data. The programs and data stored include the OS, which is the basic software that controls the entire computer 500, and application software (hereinafter simply referred to as "applications") that provides various functions on the OS. The computer 500 may also use a drive device that uses flash memory as a storage medium (for example, a solid-state drive: SSD).

[0030] External I / F 503 is an interface to an external device. The external device is, for example, a recording medium 503a. This allows the computer 500 to read from and / or write to the recording medium 503a via the external I / F 503.

[0031] The recording medium 503a is a flexible disk, CD, DVD, SD memory card (registered trademark), or USB memory, etc.

[0032] ROM505 is an example of a non-volatile semiconductor memory (storage device) that can retain programs or data even when the power is turned off. ROM505 stores programs or data such as the BIOS, OS settings, and network settings that are executed when the computer 500 starts up.

[0033] RAM504 is an example of a volatile semiconductor memory (storage device) that temporarily holds programs or data.

[0034] The CPU 506 is a processing unit that controls and implements the overall functions of the computer 500 by reading programs or data from storage devices such as the ROM 505 and HDD 508 onto the RAM 504 and executing processing.

[0035] The customer system 10 and the work process management system 14 can perform various processes described later using, for example, the hardware configuration shown in Figure 3. The hardware configurations of the printer 16 and camera 18 are omitted from this explanation.

[0036] <Software Configuration> Figure 4 is a functional configuration diagram of an example of a work process management system. Note that the functional configuration shown is one in which components unnecessary for the explanation of this embodiment have been appropriately omitted. For example, the work process management system 14 has a functional configuration comprising a first reception unit 401, a job ID detection unit 402, a color code image generation unit 403, a storage unit 404, an image data generation unit 405, a captured image acquisition unit 406, a color code extraction unit 407, and a identification unit 408.

[0037] The first reception unit 401 receives work process data indicating items for multiple work processes, and image data of a work instruction sheet 800 (an example of the first document) containing job ID information (an example of the first image data).

[0038] Furthermore, the first reception unit 401 receives input from the user indicating that when a deliverable (first deliverable) is divided into multiple deliverables (second deliverables) by a certain work process (an example of the first work process), the number of second deliverables and the creation of work instructions (second slips) corresponding to each of the second deliverables.

[0039] Furthermore, if the deliverable that is divided into multiple deliverables due to the work process is the second deliverable, the first reception unit 401 receives the second job ID, described later, corresponding to the second deliverable.

[0040] Furthermore, the first reception unit 401 may control the display of various screens, such as a screen for receiving various settings required by the user, the job status list screen described later, and the job details history screen, and may accept input from the user, or it may accept information output by an information processing terminal that can communicate with the computer 500.

[0041] The job ID detection unit 402 detects, for example, the job ID displayed as a barcode image 801 or text from the first image data showing the work instruction sheet 800 for the customer system 10 in Figure 2(A).

[0042] Furthermore, the job ID detection unit 402 is an example of a job ID generation unit. If the first reception unit 401 has received input indicating the number of second deliverables and the creation of a second slip corresponding to each of the second deliverables, the job ID detection unit 402 generates a job ID (second job ID) by adding a sub-number to the detected job ID.

[0043] Furthermore, if the deliverable that is divided into multiple deliverables by the work process is the second deliverable, the job ID detection unit 402 obtains the first job ID corresponding to the second deliverable from the storage unit 404 (described later) and generates a new second job ID by assigning an unused sub-number to the first job ID.

[0044] The color code image generation unit 403 generates color code data (an example of the first color code data is "A-00") which is a color code that indicates the color code ID corresponding to the first job ID using multiple colors, based on the first job ID detected by the job ID detection unit 402.

[0045] Furthermore, the color code image generation unit 403 generates color code data (an example of second color code data, such as "A-01" or "A-02") which is a color code that indicates the color code ID corresponding to the second job ID in multiple colors, based on the job ID (second job ID) generated by the job ID detection unit 402.

[0046] The storage unit 404 stores the work process data received by the first reception unit 401, the first job ID detected by the job ID detection unit 402, the second job ID generated by the job ID detection unit 402, the first color code data, and the second color code data, each in association with each other.

[0047] Figure 5 shows an example of a table in which the memory unit stores various types of information in association. Table T1 stores the five processes of "printing," "cutting," "folding," "binding," and "inspection" indicated by the work process data received by the first reception unit 401, along with the status of each process and various other types of information in association.

[0048] The image data generation unit 405 generates image data (an example of second image data) showing a second document in which a color code corresponding to the first color code has been added to the first document, based on the first image data and the first color code data.

[0049] Figure 6 shows an example of a table in which the storage unit stores identification information of a camera, which is an example of a shooting device, in association with the state of the work process. For example, as shown in the figure, table T2 is a table that stores camera identification information in association with the state of the work process. The image data generation unit 405 generates image data (an example of third image data) showing a third slip, which is the first slip with a color code corresponding to the second color code added, based on the first image data and the second color code data.

[0050] Figure 2(A) is an example of the first voucher. Figure 2(B) is an example of the second voucher.

[0051] The image acquisition unit 406 acquires captured images and videos from the camera 18.

[0052] The color code extraction unit 407 extracts the color code ID from the color code image 811 of the second slip that appears in the captured image or video.

[0053] Furthermore, the color code extraction unit 407 extracts first color code data from the color code image 811 of the third slip that appears in the captured image or video. Alternatively, the color code extraction unit 407 extracts second color code data from the color code image 811 of the third slip that appears in the captured image or video.

[0054] The color code extraction unit 407 outputs, for example, identification information that identifies the camera 18 that captured the color code image 811 or the work process of the job, and the extracted first color code data or second color code data to the identification unit 408.

[0055] The identification unit 408 identifies the first job ID from the storage unit 404 based on the first color code data extracted by the color code extraction unit 407. The identification unit 408 also identifies the status of the work process corresponding to the camera 18 that captured the color code image 811.

[0056] Alternatively, the identification unit 408 identifies the second job ID from the storage unit 404 based on the second color code data extracted by the color code extraction unit 407. The identification unit 408 also identifies the status of the work process corresponding to the camera 18 that captured the color code image 811.

[0057] As a result, the identification unit 408 can identify the progress information of the job's work process (job status, indicating the state of the work process) based on the status of the work process corresponding to the camera 18 that captured the color code image 811, and the first job ID or second job ID corresponding to the first color code data and second color code data extracted by the color code extraction unit 407.

[0058] <Processing> Figure 7 is an illustrative diagram showing an example of a work process in a printing factory. The work process in Figure 7 is an example of a work process that includes "printing," "cutting," "folding," "binding," "inspection," "temporary storage 1," and "temporary storage 2." In this example, camera 18a is installed at the gate in front of each location where the work processes "printing," "cutting," "folding," "binding," and "inspection" are performed. Camera 18b is installed at each location where the work processes "temporary storage 1" and "temporary storage 2" are performed. Hereinafter, cameras 18a1 to 18a5, as well as cameras 18b1 and 18b2, will be collectively referred to as "camera 18." Cameras 18a1 to 18a5 will be collectively referred to as "camera 18a." Furthermore, cameras 18b1 and 18b2 will be collectively referred to as "camera 18b."

[0059] The work instructions 810 for the information processing system 12 are photographed by camera 18a or camera 18b during the process of moving between work processes or while stored in a temporary storage location. The diagram also shows arrows indicating the movement of jobs that perform all work processes and arrows indicating the movement of jobs that skip some of the work processes.

[0060] For example, in the example shown in Figure 7, after the printout is produced by the "printing" process, the work instruction sheet 810 is affixed to the printout. As a result, in the example shown in Figure 7, the work instruction sheet 810 affixed to the printout is photographed by camera 18a or camera 18b while the printout is passing through the gate or while it is stored in the storage area.

[0061] In the example shown in Figure 7, camera 18a1 corresponds to the "printing" stage, camera 18a2 to the "cutting" stage, camera 18a3 to the "folding" stage, camera 18a4 to the "binding" stage, and camera 18a5 to the "inspection" stage.

[0062] In addition, in the example shown in Figure 7, camera 18b1 corresponds to the "printing process completed" stage, and camera 18b2 corresponds to the "folding process completed" stage.

[0063] Creating work instructions with color codes. Figure 8 is a flowchart showing an example of the process of creating a second document from the first job ID.

[0064] In step S11, the job ID detection unit 402 detects the first job ID, which is displayed as a barcode image 801 or text, on the work instruction sheet 800 for the customer system 10. The detection frame for detecting the first job ID from the work instruction sheet 800 may be set in advance by the operator, or it may be set automatically using OCR or the like.

[0065] In step S12, the color code image generation unit 403 generates first color code data corresponding to a color code that shows information corresponding to the first job ID in multiple colors, based on the first job ID detected by the job ID detection unit 402 in step S11.

[0066] In step S13, the color code image generation unit 403 generates a color code image 811 from the color code ID associated with the job ID using the procedure shown in Figure 9. The procedure shown in Figure 9 utilizes, for example, the technology described in Japanese Patent Application Publication No. 2017-199306.

[0067] Figure 9 is a flowchart of an example of the process for generating a color-coded image.

[0068] In step S21, the color code image generation unit 403 receives input of the color code ID to be color-coded.

[0069] In step S22, the color code image generation unit 403 decomposes the color code ID string into the values ​​of each digit.

[0070] In step S23, the color code image generation unit 403 converts the value of each decomposed digit into a value corresponding to the number of colors assigned to each cell of the optical symbol described in Japanese Patent Application Publication No. 2017-199306. For example, if the number of colors assigned to each cell is four, the color code image generation unit 403 converts the value of each digit into a ternary value according to the coding rule shown in Figure 10.

[0071] Figure 10 illustrates coding rules that can represent ternary numbers. The example shown uses four colors: R (red), G (green), B (blue), and K (black). When using four colors, it is possible to represent the numbers using three values, i.e., ternary numbers.

[0072] For example, as illustrated in Figure 10(a), each clockwise transition, i.e., from R to K, K to B, B to G, and G to R, represents a value of "0". Similarly, each counterclockwise transition, i.e., from R to G, G to B, B to K, and K to R, represents a value of "1". Furthermore, each diagonal transition, i.e., bidirectional transition between R and B, and bidirectional transition between K and G, represents a value of "2".

[0073] For example, consider the case where we view the color transitions of each cell from left to right in the cell sequence shown in Figure 10(b), where each cell is sequentially connected in the order of G, R, B, K, and G. In this case, the transition from G to R represents a value of "0". The transition from R to B represents a value of "2". The transition from B to K represents a value of "1". The transition from K to G also represents a value of "2". Therefore, the array shown in Figure 10(b) represents a value of "3d2120", which is a decimal value of "69". Note that the "3d" at the beginning of the value notation indicates that the following digit is a ternary value.

[0074] The coding rule using four color transitions is not limited to the example shown in Figure 10(a), but may also be the example shown in Figure 10(d). Figure 10(e) shows an example of a conversion table that associates color transitions with values ​​according to the coding rule shown in Figure 10(d). In Figure 10(e), for example, if the source cell's color is R and the value "2" is to be represented, the color of the destination cell adjacent to the source cell is set to B. Similarly, if the source cell's color is K and the value "1" is to be represented, the color of the destination cell is set to G.

[0075] Following step S23 shown in Figure 9, the process proceeds to step S24, in which the color code image generation unit 403 assigns a color to each cell of the optical symbol according to the color of the source cell, the ternary value converted in step S23, and the conversion table of coding rules shown in Figure 10(a). It is assumed that the color code image generation unit 403 has already stored the color sequence of each cell in the cell column of the main code of the optical symbol.

[0076] Figures 11 and 12 illustrate a more specific example of assigning four colors to each cell of an optical symbol.

[0077] Figure 11 shows an example of information to be coded into an optical symbol.

[0078] Figure 12 shows an example of an optical symbol when four colors are assigned to each cell of the optical symbol.

[0079] Figure 11 shows an example where the cell columns of the subcode section 301 connected to the cells "d1", "d2", "d3", and "d4" of the main code section 300 have the values ​​"3d1", "3d1", "3d0", and "3d1".

[0080] Figure 12 shows an example of an optical symbol coded according to the coding rules explained using Figure 10, based on the information illustrated in Figure 11. In this example, the cell row of the main code section 300 contains an even number of cells, with the leading cell being K colored, and K and R colors arranged alternately.

[0081] Furthermore, in the subcode section 301, for example, in the leftmost cell, the cell color is assigned using the K color of the cell in the main code section 300 to which the cell is connected as the initial source color. In the example shown in Figure 12, the R color is assigned to the leftmost cell of the subcode section 301 of the optical symbol, according to the K color of the cell in the main code section 300 which is the source cell, and the cell value "3d1" of the subcode section 301, by referring to the coding rule conversion table in Figure 10(a).

[0082] Following step S13 in Figure 8, the process proceeds to step S14, where the color-coded work instruction creation unit uses the color-coded image 811 generated in step S13 to create a work instruction 810 for the information processing system 12.

[0083] Figure 13 shows an image illustrating the process for creating a work instruction sheet with color codes. Note that the paper size or layout frame settings may be pre-configured by the operator. In Figure 2(A), the work instruction sheet 800 for the customer system 10 is scaled down to create empty space. In Figure 2(B), the work instruction sheet 810 for the information processing system 12 has a color code image 811 pasted onto the empty space created by scaling down the work instruction sheet 800 for the customer system 10.

[0084] Furthermore, the work order sheet 800 for customer system 10 shown in Figure 2(A) displays at least one barcode image 801 used by customer system 10. Therefore, simply reducing the size of the work order sheet 800 for customer system 10 may cause the barcode image 801 to stop functioning (become unrecognizable).

[0085] Therefore, the color-coded work instruction creation unit may check the orientation of the barcode image 801 and perform scaling or other operations in a direction that does not impair the functionality of the barcode image 801 in order to generate empty space without impairing the functionality of the barcode image 801.

[0086] In this way, the work process management system 14 of this embodiment can create empty space by scaling the barcode image 801 in a direction that does not impair its functionality, and can add a remotely readable color code image 811 to that empty space. In this way, even if the work instruction sheet 800 for the customer system 10 is scaled, the functionality of the barcode image 801 is not impaired, and the functionality of the work instruction sheet 800 for the customer system 10 is retained while the functionality of the color code image 811 can be added to the work instruction sheet 810 for the information processing system 12.

[0087] In step S15 of Figure 8, the image data generation unit 405 instructs the printer 16 to print a work instruction sheet 810 (work instruction sheet with color code) for the information processing system 12, to which the color code image 811 created in step S14 is attached. The printer 16 prints a work instruction sheet 810 for the information processing system 12 to which the color code image 811 is attached, for example, as shown in Figure 2(B), based on the instructions from the print instruction unit.

[0088] 《Updating job status upon passing through a gate》 In the job management system 1 according to this embodiment, when a work instruction sheet 810 for the information processing system 12, to which a color code image 811 has been attached, is photographed by cameras 18a1 to 18a5, 18b1, and 18b2, the job status in the storage unit 404 is updated as follows.

[0089] Figure 14 is a flowchart of an example of the job status update process when passing through a gate.

[0090] In step S51, the image acquisition unit 406 of the work process management system 14 acquires captured images or videos from cameras 18a1 to 18a5, 18b1, and 18b2, and then proceeds to step S52.

[0091] In step S52, the color code extraction unit 407 extracts a color code image 811 from the captured image or video captured by the captured image acquisition unit 406.

[0092] In step S53, the color code extraction unit 407 performs recognition processing of the color code image 811 in a manner described, for example, in Japanese Patent Application Publication No. 2017-199306.

[0093] When the color code extraction unit 407 recognizes the color code image 811, it detects the image of each cell from the color code image 811.

[0094] In step S54, the color code extraction unit 407 recognizes the color information of each cell and the connection information of each cell detected in step S53 as symbol information. The color code recognition unit recovers the color code ID that was encoded in the color code image 811 by decoding the symbol information according to the coding rule shown in Figure 10(A), for example.

[0095] In step S55, the color code extraction unit 407 provides the identification unit 408 with, for example, the identification information of the cameras 18a1 to 18a5, 18b1, and 18b2 that captured the color code image 811, and the color code ID recovered by decoding. The identification unit 408 then refers to the storage unit 404 to identify the job ID corresponding to the color code ID.

[0096] Then, the identification unit 408 can update the job status stored in the storage unit 404 from "Not Detected" to "Completed" or "Process Completed," etc., based on, for example, the identification information of the camera 18a that captured the color code image 811 and the job ID corresponding to the color code ID recovered from the color code image 811.

[0097] 《Updating job status when storing in temporary storage location》 In the job management system 1 according to this embodiment, when a work instruction sheet 810 for the information processing system 12, to which a color code image 811 has been attached, is photographed by cameras 18b1 and 18b2, the job status in the storage unit 404 is updated as follows.

[0098] Figure 15 is a flowchart showing an example of the job status update process when a job is stored in a temporary storage location.

[0099] In step S61, the image acquisition unit 406 of the work process management system 14 acquires an image from camera 18b1 or 18b2, and then proceeds to step S62.

[0100] In step S62, the color code extraction unit 407 extracts a color code image 811 from the captured image or video captured by the captured image acquisition unit 406.

[0101] In step S63, the color code extraction unit 407 performs recognition processing of the color code image 811 in a manner described, for example, in Japanese Patent Application Publication No. 2017-199306.

[0102] In step S64, when the color code extraction unit 407 recognizes the color code image 811, it proceeds to step S65.

[0103] In step S65, the color code extraction unit 407 decodes the symbol information recognized from the color code image 811 to restore the color code ID that was encoded in the color code image 811.

[0104] In step S66, the color code extraction unit 407 provides the identification unit 408 with, for example, the identification information of the cameras 18b1 and 18b2 that captured the color code image 811, as well as the color code ID recovered by decoding. The identification unit 408 then refers to the storage unit 404 to identify the job ID corresponding to the color code ID.

[0105] Then, the identification unit 408 determines, for example, whether a predetermined time has elapsed without any change in the job status of a given job ID, based on the identification information of the cameras 18b1 and 18b2 that captured the color code image 811, and the job ID corresponding to the color code ID restored from the color code image 811.

[0106] If the job status remains unchanged for a predetermined time, the specific unit 408 proceeds to step S67.

[0107] In step S67, the specific unit 408 displays a delay alert on the job details history screen, which will be described later, and then proceeds to the process in step S70. On the other hand, if the job status has not changed and a predetermined time has not elapsed, the specific unit 408 proceeds to step S70.

[0108] In step S70, the identification unit 408 can update the job status stored in the storage unit 404 from "Not detected" to "Work in progress," "Work completed," etc.

[0109] Furthermore, if the color code extraction unit 407 does not recognize the color code image 811 in step S64, the color code extraction unit 407 proceeds from step S64 to S68. This is a process to update the job ID, which is currently set to "stored in storage," when the color code image 811 cannot be recognized from the captured image acquired from the camera 18b1 or 18b2 installed in the storage location.

[0110] The color code extraction unit 407 provides identification information of, for example, cameras 18b1 and 18b2 to the identification unit 408. The identification unit 408 then determines whether there are any job IDs among the storage locations corresponding to the provided identification information of cameras 18b1 and 18b2 whose job status is "work process completed" in which a color code image 811 was not recognized from the captured images for a predetermined number of consecutive times.

[0111] In step S68, the identification unit 408 determines whether or not there is a color code for a predetermined number of consecutive times. If there is a job ID whose job status in the storage location is "work process completed" and for which the color code image 811 was not recognized from the captured image for a predetermined number of consecutive times, the identification unit 408 proceeds to step S69.

[0112] In step S69, the specific unit 408 sets the color code ID associated with the job ID to Null and proceeds to step S70.

[0113] Furthermore, there is a possibility that the work instructions 810 for the information processing system 12 may be stored in a way that prevents them from being photographed by the camera 18b, such as when printed materials are stacked on top of each other in the storage location. Taking this into consideration, if there are no job IDs among the job IDs in the storage location whose job status is "work process completed" in which the color code image 811 has not been recognized from the captured images for a predetermined number of consecutive times, the identification unit 408 skips steps S68 to S69 and proceeds to step S70.

[0114] According to the process shown in the flowcharts of Figures 14 and 15, tracking of printed materials with the work instructions 810 for the information processing system 12 attached becomes possible by automatically updating the job status of the printed materials with the work instructions 810 for the information processing system 12 attached.

[0115] Job Inquiry The operator of the job management system 1 can view progress information, history information, and captured image and video files showing the work process of a job in the printing plant, as well as the conditions when the work instruction sheet 810 was photographed, through various UI screens provided by the work process management system 14. The UI screens are displayed by the display device 502.

[0116] Figure 16 is a transition diagram of an example of a UI screen displayed by the work process management system. In the work process management system 14, for example, the job status list screen 1000 is displayed on the display device 502. The job status list screen 1000 displays a list of job information, including the job ID, color code ID, job name, last updated data, and progress information for one or more work processes.

[0117] Progress information for one or more work processes indicates whether the progress of the work process is "Not Detected," "Work Process in Progress," "Work Process Completed," or "Alert."

[0118] A "not detected" status for the progress of a work process indicates that the camera 18 corresponding to that work process has not captured a photograph of the work instruction sheet 810 for the information processing system 12.

[0119] The progress of the work process, "Work in progress," indicates that the work instruction sheet 810 for the information processing system 12 has been photographed by one of the cameras 18a1 to 18a5 corresponding to that work process.

[0120] The progress of the work process, "Work process completed," indicates that the work instruction sheet 810 for the information processing system 12 has been photographed with the final update using either camera 18b1 or 18b2 corresponding to that work process. The progress of the work process, "Alert," indicates that an alert has occurred, such as a delay alert.

[0121] The operator can display the Job Details History screen 1010 by selecting a job from the Job Status List screen 1000. The Job Details History screen 1010 displays buttons to transition to screens that show the start date and time, completion date and time, captured images, and captured videos for each work process. In addition, if the work process is "Temporary Storage 1" or "Temporary Storage 2", the address of the storage area where the data is stored will also be displayed on the Job Details History screen 1010.

[0122] Furthermore, on the job details history screen 1010, the system accepts input from a button that allows transitioning to either the screen 1020 displaying captured images or videos, or the screen 1030 indicating the storage location. When a button is pressed, the first reception unit 401 transitions to either screen 1020 or screen 1030. When the play button is pressed, the screen 1020, which displays captured images or videos, displays a captured image file or video file showing the scene when the work instruction sheet 810 was photographed.

[0123] Examples of cases where a second deliverable is generated. Figure 17 shows an example of when a second deliverable is generated.

[0124] Figure 18 shows an example of creating the second voucher.

[0125] For example, let's consider a case where the manufacturing process for printed materials and other products consists of five steps, as shown in the diagram: the submission process, the printing process, the cutting process, the folding process, and the binding process. Note that the number of steps, the types of steps, the order of steps, and the type of product may differ from those shown in the diagram.

[0126] First, in this example, the print job includes the following processes: submission, printing, cutting, folding, and binding. A job ID is assigned to the job before work begins, either in the manufacturing plan or order. This is the first job ID, which is assigned to the first deliverable before it is divided into the second deliverable.

[0127] Next, we will explain using the example of a case where a second deliverable is derived from the first deliverable. Note that the management of the first or second deliverable may be managed using numbers other than sub-numbers. For example, in the management of the second deliverable, a management number or similar is assigned to the second deliverable.

[0128] For the management number of the second deliverable, information that distinguishes the first and second deliverables from each other (an example of distinguishing information) can be used, such as a combination of characters or letters different from the subscript or job ID, or a symbol.

[0129] First, here is a specific example of when a second deliverable is generated.

[0130] The first example of this occurring is the creation of a new document, the second document, from the first document.

[0131] First, let's explain the case where one work process is performed using multiple devices. The examples shown in Figures 17 and 18 illustrate an example where the printing process is performed using multiple printing presses (the examples shown use two printing presses) in the submission process.

[0132] In Figure 17, during the submission process, a first job ID "A" is assigned to the submitted print job. In the illustrated example, the job ID "A" is also assigned the sub-number "-00" to form the first job ID, but the job ID is not limited to this. In this embodiment, "A-XX" is used as the job ID with a sub-number.

[0133] Furthermore, the generation of the second deliverable is not limited to cases where multiple devices are used. For example, it may also occur when a single task is performed by multiple workers or in multiple locations.

[0134] In the submission process, as shown in the diagram, there is only one job ID, "A-00," so there is only one invoice.

[0135] In the printing process, a new document is created based on the first document. In this example, a first document managed with a sub-numbered job ID "A-00" and a second document [A] managed with a sub-numbered job ID "A-01" are created.

[0136] Second document [A] is created based on the job ID "A-01" with a sub-number. Specifically, second document [A] first contains the same information as the first document.

[0137] Next, the second document [A] is assigned a color code (hereinafter referred to as "second color code 'A'") corresponding to the job ID with a sub-number "A-01". That is, when the second color code 'A' in the second document [A] is recognized in step S63, etc., the status of job ID "A" managed by the second document [A], whose job ID with a sub-number is "A-01", can be managed.

[0138] Furthermore, the second slip [A] contains a number indicating the branch number "01" (hereinafter referred to as the "second management number"). It would be desirable for further information to be included.

[0139] Next, we will explain a case where there is one deliverable before a work process, but multiple deliverables are produced after that process. For example, the example shown in Figures 17 and 18 is an example where one cutting machine is used in the cutting process. Note that there is not limited to one cutting machine, but there may be multiple machines.

[0140] For example, in the case of printed materials, the front cover, body text, and back cover are different deliverables, but they are managed under the same job ID. Therefore, if you want to manage these different deliverables separately, it is desirable to create a new second document.

[0141] Specifically, for job ID "A-00" with a sub-number, the deliverables generated in the cutting process are managed under job IDs "A-00" and "-02" with a sub-number. In other words, in the work processes after the cutting process, the deliverables of the first document with job ID "A-00" and the second document [B] with job ID "A-02" have the same job ID "A," but are managed under different sub-numbers.

[0142] The deliverable corresponding to the second document [B] is "A-00" before the cutting process, and is a single deliverable with "A-00," which is managed based on the first document. The second document [B] is then created based on the first document. Specifically, first, the required information is listed, just like on the first document.

[0143] Next, the second document [B] is assigned a color code (hereinafter referred to as "second color code 'B'") corresponding to the job ID with a sub-number "A-02". That is, when the second color code 'B' in the second document [B] is recognized in step S63, etc., the status of job ID "A" managed by the second document [B], which has the job ID with a sub-number "A-02", can be managed.

[0144] Furthermore, the second slip [B] contains a number indicating the branch number "02" (hereinafter referred to as the "second management number"). It would be desirable for further information to be included.

[0145] As shown in Figure 18, in the cutting process, the status of the deliverable managed by the first document with the sub-numbered job ID "A-00" can be managed by the first document with the sub-numbered job ID "A-00" and the second document [B] with the sub-numbered job ID "A-02".

[0146] The second example involves creating a new document from the second document. The following explanation will use an example of the cutting process illustrated in Figures 17 and 18, where one cutting machine is used. Note that the number of cutting machines is not limited to one; multiple machines may be used.

[0147] Specifically, for job ID "A-01" with a sub-number, the deliverables generated in the cutting process are managed under job IDs "A-01" and "A-03" with sub-numbers. In other words, in the work processes after the cutting process, the deliverables of the second document [A] with job ID "A-01" and the second document [C] with job ID "A-03" have the same job ID "A," but are managed under different sub-numbers.

[0148] The deliverable corresponding to the second document [C] is a single deliverable before the cutting process and is managed based on the second document [A]. Therefore, the second document [C] is created based on the second document [A]. Specifically, first, the required information is listed, similar to the first document.

[0149] Next, the second document [C] is assigned a color code (hereinafter referred to as "second color code 'C'") corresponding to the job ID with a sub-number "A-03". That is, when the second color code 'C' in the second document [C] is recognized in step S63, etc., the status of job ID "A" managed by the second document [C], which has the job ID with a sub-number "A-02", can be managed.

[0150] Furthermore, the second slip [C] contains a number indicating the branch number "02" (hereinafter referred to as the "second management number"). <c>It would be desirable for further information to be included.

[0151] As shown in Figure 18, in the cutting process, the status of the deliverable managed by the second document [A] with the sub-numbered job ID "A-01" can be managed by the second document [A] with the sub-numbered job ID "A-01" and the second document [C] with the sub-numbered job ID "A-03".

[0152] Thus, new deliverables derived from the original deliverable are assigned new color codes, but the contents of the barcode included in the print instructions are retained. Furthermore, a sub-number is assigned to the new job ID assigned to the second document, which is the job ID of the first document. Therefore, in the information system, the deliverables corresponding to the first document and the deliverables corresponding to the second document can be managed as deliverables belonging to the same job ID.

[0153] In other words, it is desirable that a second document be generated for each work process, the deliverables produced by the work process, the materials, the transport equipment, the devices used, or any combination thereof.

[0154] By using sub-numbers and similar methods for management, detailed control becomes much easier.

[0155] Furthermore, the generation of the second document does not necessarily have to be triggered by scanning a code indicating a job ID, as shown in the diagram. For example, the second document may be generated when it is detected that a user has pressed a button or similar on a settings screen.

[0156] Furthermore, the method of creating the second document is not limited to the illustrated method. For example, the second document may contain additional information in addition to the information that is copied. For example, the additional information may be the reason for creating the second document.

[0157] Furthermore, the second management number< / c> Management Number 2 Management Number 2 <c>The printing position, size, and range may be set in advance.

[0158] Next, I will explain the UI screen displayed by the work process management system when a second document is generated.

[0159] Figure 19 is a transition diagram of an example of a UI screen displayed by the work process management system when a second deliverable is generated. For example, the job status list screen (hereinafter referred to as "pre-deployment screen PN1") when the second document shown in the figure is generated is a screen that is generated and displayed in the same way as the job status list screen 1000 shown in Figure 16, etc.

[0160] The pre-deployment screen PN1 differs from the job status list screen 1000 shown in Figure 16 in that it first displays job IDs with sub-numbers corresponding to the second document in a grouped manner. Specifically, when the IFA button on the GUI is pressed, the post-deployment screen PN2, for example, is displayed.

[0161] As shown in the diagram, the expanded screen PN2 displays a list of job IDs with sub-numbers corresponding to the second document, i.e., a list showing the status of jobs managed by sub-numbers, etc.

[0162] Thus, the IFA button accepts an operation to switch between displaying the expanded or compressed version of the job ID with a sub-number, which is managed in association with the job ID. Therefore, if the IFA button is pressed again while the expanded screen PN2 is displayed, the expanded screen PN2 will close, and the screen will return to displaying the pre-expanded screen PN1.

[0163] On the expanded screen PN2, for example, as shown in the diagram, "Last Updated" indicates the most recent date and time when the status of the deliverable corresponding to each second document was updated, and "Location" indicates the location of the deliverable corresponding to the second document.

[0164] In this way, if the job ID with a sub-number corresponding to the second document can also be managed on the job status list screen, etc., the work process can be managed more easily.

[0165] Furthermore, with the above configuration, the status of deliverables corresponding to the second document can be managed collectively using the job ID. This type of management makes it easy to manage jobs derived from a single job ID. And the second document can also be easily created in accordance with the occurrence of jobs, etc.

[0166] Furthermore, if the second document and the corresponding deliverables can be easily managed, it becomes easier to manage physical inventory, progress, and surplus capacity in the work process.

[0167] [Third Embodiment] In the first or second embodiment described above, a job ID with a sub-number is generated, and a second document is created. In this way, even if the deliverables are divided into multiple parts before and after the work process, each of the divided deliverables can be managed separately.

[0168] In the third embodiment, the objective is to enable the worker performing the work process (the second work process) to confirm whether the first work process, which precedes the second work process, has been completed, and whether all the deliverables generated by the first work process are available.

[0169] For example, in the bookbinding process shown in Figure 17, the bookbinding worker cannot proceed with the bookbinding process unless all deliverables are available. Specifically, the bookbinding worker cannot proceed with the bookbinding process unless the deliverables corresponding to the first slip with sub-job ID "A-00", the deliverables corresponding to the sub-job ID "A-01", the deliverables corresponding to the sub-job ID "A-02", the deliverables corresponding to the sub-job ID "A-03", the deliverables corresponding to the sub-job ID "A-04", the deliverables corresponding to the sub-job ID "A-05", the deliverables corresponding to the sub-job ID "A-06", and the deliverables corresponding to the sub-job ID "A-07" are available.

[0170] Therefore, the third embodiment is a system that manages how many deliverables have been divided into by the first work process before the first work process, and when the deliverables from the first work process are complete, it notifies the worker of the second work process, which will be performed after the first work process.

[0171] Figure 20 shows an example of the system according to the third embodiment. The customer system 10, the work process management system 14, the printer 16, and the camera 18 are the same as those in the first and twenty-second embodiments, so their descriptions are omitted.

[0172] The information processing terminal 22 is a terminal held by the worker and is a tablet or smartphone, etc.

[0173] Figure 21 shows an example of the hardware configuration of an information processing terminal. For example, information processing terminal 22 has the same hardware configuration as computer 500 shown in Figure 3.

[0174] The information processing terminal 22 is equipped with an input device 1901, a display device 1902, an external interface 1903, RAM 1904, ROM 1905, CPU 1906, a communication interface 1907, and an HDD 1908, among others, and each is interconnected via bus B. The input device 1901 and the display device 1902 may also be used in a connected configuration.

[0175] The input device 1901 includes a keyboard, mouse, and touch panel, and is used by the user to input various operation signals.

[0176] The display device 1902 includes a display and displays the processing results from the information processing terminal 22.

[0177] Communication I / F 1907 is an interface that connects the information processing terminal 22 to various networks. This allows the information processing terminal 22 to perform data communication via communication I / F 1907.

[0178] Furthermore, HDD1908 is an example of a non-volatile storage device that stores programs or data. The programs and data stored include the OS, which is the basic software that controls the entire information processing terminal 22, and application software that provides various functions on the OS. The information processing terminal 22 may also use a drive device that uses flash memory as a storage medium (for example, an SSD).

[0179] External I / F 1903 is an interface to an external device. The external device is, for example, a recording medium 1903a. This allows the information processing terminal 22 to read from and / or write to the recording medium 1903a via the external I / F 1903.

[0180] Recording medium 1903a is a flexible disk, CD, DVD, SD memory card (registered trademark), or USB memory, etc.

[0181] ROM1905 is an example of a non-volatile semiconductor memory (storage device) that can retain programs or data even when the power is turned off. ROM1905 stores programs or data such as the BIOS, OS settings, and network settings that are executed when the information processing terminal 22 is started up.

[0182] RAM1904 is an example of a volatile semiconductor memory (storage device) that temporarily holds programs or data.

[0183] The CPU 1906 is an arithmetic unit that controls and implements the functions of the entire information processing terminal 22 by reading programs or data from storage devices such as the ROM 1905 and HDD 1908 onto the RAM 1904 and executing processing. The information processing terminal 22 may have a different hardware configuration than the computer 500.

[0184] Figure 22 shows an example of a functional block diagram of the third embodiment. The system of the third embodiment has a functional configuration comprising a first reception unit 401, a job ID detection unit 402, a color code image generation unit 403, a storage unit 404, an image data generation unit 405, a captured image acquisition unit 406, a color code extraction unit 407, a identification unit 408, a second reception unit 2001, an output unit 2002, a first display control unit 2003, and a second display control unit 2004. The following description will omit details common to the first and second embodiments as appropriate.

[0185] The first receiving unit 401 receives the number of deliverables corresponding to the first slip, which have been divided according to the first work process, from the output unit 2002, which will be described later.

[0186] When the job ID detection unit 402 receives from the first reception unit 401 the number of deliverables corresponding to the first slip that have been separated by the first work process, it obtains the first job ID corresponding to the first slip from the storage unit 404 and generates the second job ID shown in the figure below that corresponds to the number of deliverables that have been separated.

[0187] The color code image generation unit 403 generates color code data, which is a color code that represents a color code ID corresponding to the second job ID in multiple colors, based on the second job generated by the job ID detection unit 402.

[0188] The memory unit 404 stores the work process data received by the first reception unit 401, the number of deliverables received by the first reception unit 401, the first job ID detected by the job ID detection unit 402, the second job ID generated by the job ID detection unit 402, the first color code data, and the second color code data, each associated with the other.

[0189] Figure 23 shows an example of a table in which the memory unit stores various types of information in association with each other. In table T3, in addition to the information stored in table T1, the number of times the deliverables have been divided is stored. For example, in a work process of "Printing" with the second job ID "A-01", "Completed / 2" in the "Work process status / Number of divisions" indicates that the printing process is complete and the deliverables have been divided into two. In other words, this is an example in which the first reception unit 401 receives input from the operator indicating that the number of deliverables divided is "2" when the printing process is completed or in progress.

[0190] The image data generation unit 405 generates a third image data based on the first image data and the second color code data.

[0191] The image acquisition unit 406 acquires captured images or videos from the camera 18.

[0192] The color code extraction unit 407 extracts second color code data from the color code image 811 of the third slip that appears in the captured image or video.

[0193] The identification unit 408 identifies the second job ID from the storage unit 404 based on the second color code data extracted by the color code extraction unit 407. The identification unit 408 also obtains from the storage unit 404 the number of deliverables that have been separated for the identified second job ID. Then, the identification unit 408 determines the status of the work process for the second job ID based on the second job ID, the number of deliverables that have been separated, and the status of the work process corresponding to the camera 18 that captured the color code image 811.

[0194] For example, the identification unit 408 determines that the printing process is incomplete if the number of second color code data extracted by the color code extraction unit 407 from the captured image data captured by the camera 18b1 corresponding to "temporary storage location 1" is less than the number of deliverables stored in the storage unit 404.

[0195] Furthermore, the identification unit 408 determines that the printing process is complete if the number of second color code data extracted by the color code extraction unit 407 from the captured image data captured by the camera 18b1 corresponding to "temporary storage location 1" is the same as the number of deliverables stored in the storage unit 404.

[0196] Furthermore, if the storage unit 404 stores a setting for determining the number of deliverables that have been divided and the corresponding status of the work process, the identification unit 408 may determine the status of the work process (for example, the work process will be completed soon, or it will take some time for the work process to be completed) based on that setting.

[0197] For example, let's consider a case where the setting for determining the status of a work process is configured to determine that the work process is about to be completed when the number of second color code data points is 3.

[0198] In this case, the identification unit 408 determines that the printing process is incomplete if the number of second color code data extracted by the color code extraction unit 407 from the captured image data captured by the camera 18b1 corresponding to "temporary storage location 1" is less than 3.

[0199] Furthermore, the identification unit 408 determines that the printing process is about to be completed if the number of second color code data extracted by the color code extraction unit 407 from the captured image data captured by the camera 18b1 corresponding to "temporary storage location 1" is "3", and this number is smaller than the number of deliverables separated (for example, "5").

[0200] Furthermore, the specific unit 408 determines that the printing process is about to be completed if the number of second color code data extracted by the color code extraction unit 407 from the captured image data captured by the camera 18b1 corresponding to "temporary storage location 1" is "4", and this number is smaller than the number of deliverables separated (for example, "5").

[0201] Then, the identification unit 408 determines that the printing process is complete if the number of second color code data extracted by the color code extraction unit 407 from the captured image data captured by the camera 18b1 corresponding to "temporary storage location 1" is 5, and this number is the same as the number of deliverables that have been separated (for example, "5").

[0202] In this way, the identification unit 408 can determine the status of the work process according to the number of second color code data extracted by the color code extraction unit 407, thereby providing the worker with more detailed information.

[0203] The second reception unit 2001 receives input via the input device of the information processing terminal, which indicates the number of deliverables that have been separated by the first work process.

[0204] The output unit 2002 outputs to the first reception unit 401 the number of deliverables that have been divided after being received by the second reception unit 2001.

[0205] The first display control unit 2003 receives the determination result from the identification unit 408 and performs control to display it on the display device.

[0206] The second display control unit 2004 receives the determination result from the specific unit 408 and performs control to display it on the display device.

[0207] Figure 24 shows an example of a screen displayed by the display device 1902. For example, the display device 502, which is an example of a display unit, displays a screen like the one shown. In the screen shown, "●" and "〇" are examples of visual information and indicate the location of the deliverable corresponding to the first or second slip. In the figure, the area 2101, which shows the inside of the printing factory, shows multiple first job IDs and second job IDs derived from the first job IDs. For example, "●" is explained as "Job A" with first job ID "A", and "〇" is explained as "Job B" with first job ID "B".

[0208] The first display control unit 2003 and the second display control unit 2004 may, when the identification unit 408 determines that the second deliverables of "Job B" (for example, deliverables managed with second job IDs such as "B-01", "B-02", etc.) are all present in the area 2102 indicating the storage location, and that the work process of "Job A" is complete (for example, when the printing process is complete), notify the worker of the status of the work process by changing the color of the "〇" corresponding to "B-01" and "B-02" from white to green, etc.

[0209] Alternatively, instead of changing the color of the visual information, the first display control unit 2003 and the second display control unit 2004 may display the message "Job B has finished printing," as shown below.

[0210] Figure 25 shows a first example of how a message can be displayed. For example, as shown in the figure, the message may be displayed on the side of the screen. Note that the format in which the message is displayed is not limited to the format shown in the figure.

[0211] Furthermore, the first display control unit 2003 and the second display control unit 2004 may notify the worker of the status of the work process by changing the color of the "〇" corresponding to "B-01" and "B-02" from white to yellow or another color if the identification unit 408 determines that the second deliverables of "Job B" (for example, deliverables managed with second job IDs such as "B-01", "B-02", etc.) are all present in the area 2102 indicating the storage location and the work process of "Job A" is incomplete (for example, the printing process is incomplete).

[0212] Alternatively, instead of changing the color of the visual information, the first display control unit 2003 and the second display control unit 2004 may display the message "Job B's printing process is incomplete," as shown below.

[0213] Figure 26 shows a second example of displaying a message. For example, similar to the first example, the message is displayed on the side of the screen.

[0214] The colors or messages are not limited to the examples above, and can be pre-set to indicate the status of the work process. For example, blue could be used to indicate completion of the work process, or red could be used to indicate incompleteness. The messages can be any messages that represent the status of the job. For example, as shown below, a number or message indicating how many second deliverables are needed in area 2102, which represents the first storage location, for the work process to be completed may be displayed.

[0215] Figure 27 shows a third example of how messages are displayed. For example, as shown in the figure, the number of remaining deliverables until the printing process is deemed complete is displayed as a message on the side of the screen.

[0216] In this way, by notifying the worker through the first display control unit 2003 and the second display control unit 2004, the worker can know when to start their work and efficiently manage the work process.

[0217] [Fourth Embodiment] The first to third embodiments described above are technologies realized by a work instruction sheet 810 for an information processing system 12, which adds a new code (color code image 811) to a work instruction sheet 800 for a customer system 10. This technology can be applied to transport systems such as AGVs (Automated Guided Vehicles).

[0218] For example, in a transport system for transporting goods, a work instruction sheet 810 for an information processing system 12, with a color code image 811 added, is attached to the goods, and the goods in transport are photographed by a camera 18, allowing the transport device to manage the work process of the goods being transported. Furthermore, since the position of the transport device transporting the goods and the destination of the goods can be identified, the transport system can also control the movement of the transport device transporting the goods.

[0219] [Fifth Embodiment] Although the first and second embodiments described above illustrate the management of work processes for jobs in a printing factory, they can also be applied to the management of work processes for items flowing on a conveyor belt, for example. For instance, applying the technology of this embodiment to the management of work processes for items flowing on a conveyor belt would enable tracking of the items on the belt and control of the conveyor belt's branching.

[0220] The present invention is not limited to the embodiments specifically disclosed above, and various modifications and changes are possible without departing from the scope of the claims. [Explanation of Symbols]

[0221] 1. Job Management System 10 Customer System 12 Information Processing Systems 14. Work Process Management System 16 Printers 18 Cameras 18a Camera 18a1 Camera 18a2 camera 18a3 camera 18a4 camera 18a5 camera 18b Camera 18b1 Camera 18b2 Camera 22 Information Processing Terminals 401 Reception Desk 1 402 Job ID Detection Unit 403 Color Code Image Generation Unit 404 Storage section 405 Image Data Generation Unit 406 Image acquisition unit 407 Color code extraction unit 408 Specific section 500 Computers 800 Work Instructions 801 Barcode image 810 Work Instructions 811 Color Code Image 1000 Job Status List Screen 1010 Job Details History Screen 1020 screen 1030 screens 2001 Second Reception Department 2002 Output Section 2003 First Display Control Unit 2004 Second Display Control Unit 2101 area 2102 area IFA button PN1 Pre-deployment screen PN2 post-expansion screen T1 Table T2 Table T3 Table [Prior art documents] [Patent Documents]

[0222] [Patent Document 1] Japanese Patent Publication No. 2005-100298< / c>

Claims

1. An information processing device, An image data generation unit that generates first image data of a first slip including first color code data associated with information of a first ID, second image data of a second slip including second color code data associated with a second ID associated with the first ID and different from the first image data, and third image data of a third slip including third color code data associated with a third ID associated with the first ID and different from the first image data and the second image data. A display unit that, when image data is obtained from a photographing device of a medium on which the second color code data is printed, displays a screen that associates the second ID associated with the second color code data with the first ID, and simultaneously displays a screen that includes the state of the managed object corresponding to the second ID, which is associated with the first ID and is identified based on the image data obtained from the photographing device, and the state of the managed object corresponding to the third ID, An information processing device characterized by having the following features.

2. The captured image data includes a code image corresponding to the second ID. The information processing apparatus according to claim 1.

3. The code image is a color code image corresponding to the second ID. The information processing apparatus according to claim 2.

4. The aforementioned screen is a screen in which the second ID associated with the first ID and the status of the managed object corresponding to each of the second IDs are displayed in a grouped manner. The information processing apparatus according to any one of claims 1 to 3.

5. The system includes a storage unit that stores the first ID, the second ID associated with the first ID, code data corresponding to the second ID, and the state of the managed object managed by the second ID. Based on the code image contained in the captured image data, the code data corresponding to the second ID is extracted, and based on the extracted code data, the second ID is identified. The information processing apparatus according to claim 2.

6. Based on the identification information of the imaging device that captured the code image corresponding to the second ID, and the state of the managed object associated with the identification information, the state of the managed object corresponding to the second ID is identified. The information processing apparatus according to claim 5.

7. The state of the managed object refers to the state of the work process of the managed object, or the location of the managed object. The information processing apparatus according to any one of claims 1 to 6.

8. An information processing method for an information processing device that stores a first ID and a second ID associated with the first ID, Steps to generate: first image data of a first slip including first color code data associated with the information of the first ID; second image data of a second slip including second color code data associated with the second ID associated with the first ID and different from the first image data; and third image data of a third slip including third color code data associated with the third ID associated with the first ID and different from the first and second image data; The steps include: acquiring image data from a photographing device of a medium on which the second color code data is printed; A screen that displays the second ID associated with the second color code data linked to the first ID, and the second ID is associated with the first ID, and the steps include identifying the second ID based on the captured image data acquired from the imaging device, The steps include displaying a screen that simultaneously includes the state of the managed object corresponding to the identified second ID and the state of the managed object corresponding to the third ID, An information processing method characterized by having the following features.

Images