Information Processing System, Management Method, and Program

Abstract

To provide an information processing system that is easy for a user to check information about progress of a plurality of jobs each of which is composed of a plurality of work processes.SOLUTION: The problem can be solved by an information processing system that manages progress of a job composed of a plurality of work processes and provides a user with information about progress of the jobs. This system comprises: photographing means that, in each of places associated with work processes, photographs a slip on which a code image associated with a job is displayed; recognizing means that recognizes a job from the code image on the slip photographed by the imaging means; managing means that, based on the work process associated with the place where the slip was photographed and based on the job recognized by the recognition means, manages and associates information about progress of the job and photographic data obtained by photographing the slip; and provision means that provides user with information about progress of a plurality of jobs and photographic data obtained by photographing the slip.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to an information processing system, a progress management method, and a program. [Background technology]

[0002] 2. Description of the Related Art It has been common practice to manage the progress of a job consisting of a plurality of work steps by utilizing a barcode or the like printed on a work instruction sheet.

[0003] In addition, a system has been known for some time that assigns RFID tags to workers and the objects they work on (materials, work-in-progress, finished products, etc. in a factory) and manages the working hours of workers and the flow of objects they work on (entry and exit from a workplace) by reading the RFID tags at the entrance gate at the entrance to the processing plant and the exit gate at the exit of the processing plant (see, for example, Patent Document 1). Summary of the Invention [Problem to be solved by the invention]

[0004] In conventional existing systems, the progress of a job consisting of multiple work processes is managed by utilizing barcodes printed on work instructions, etc., but there was a problem that it was difficult for users to check the progress of each job.

[0005] The embodiment of the present invention has been made in consideration of the above points, and has an object to provide an information processing system that allows a user to easily check information relating to the progress of a plurality of jobs consisting of a plurality of work processes. [Means for solving the problem]

[0006] In order to achieve the above object, claim 1 of the present application provides an information processing system for managing the progress of a job consisting of a plurality of work processes and providing a user with information regarding the progress of the job, comprising: a photographing means for photographing a slip on which a code image corresponding to the job is displayed at each location corresponding to the work process; a recognition means for recognizing the job from the code image of the slip photographed by the photographing means; a management means for managing information regarding the progress of the job in association with photographed data when the slip was photographed, based on the work process corresponding to the location where the slip was photographed and the job recognized by the recognition means; and a provision means for providing a user with information regarding the progress of a plurality of the jobs and the photographed data when the slip was photographed. Effect of the Invention

[0007] According to an embodiment of the present invention, it is possible to provide an information processing system that allows a user to easily check information regarding the progress of a plurality of jobs consisting of a plurality of work processes. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating a configuration of an example of a job management system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is an image diagram of an example of a work instruction sheet used in the job management system according to the embodiment. [Diagram 3] FIG. 2 is a diagram illustrating a hardware configuration of an example of a computer. [Figure 4] FIG. 2 is a functional configuration diagram of an example of a work process management system. [Diagram 5] FIG. 1 is an image diagram showing an example of a work process of a job in a printing factory. [Figure 6] 13 is a flowchart illustrating an example of a process for creating a color-coded work instruction sheet. [Figure 7] 11 is a flowchart of an example of a process for generating a color code image. [Figure 8] FIG. 1 is a diagram for explaining coding rules that can express ternary numbers. [Figure 9] FIG. 13 shows an example of information for encoding into an optical symbol. [Figure 10] FIG. 13 is a diagram showing an example of an optical symbol in which the number of colors assigned to each cell of the optical symbol is four. [Figure 11] FIG. 13 is a diagram showing a process image for creating a color-coded work instruction sheet. [Figure 12] 11 is a flowchart of an example of a process for reducing an image including a barcode image. [Figure 13] FIG. 13 is an image diagram of an example of a barcode image. [Figure 14] FIG. 13 is a conceptual diagram of an example of a barcode image before being reduced in the vertical direction. [Figure 15] FIG. 13 is an example of a barcode image after being reduced in the vertical direction. [Figure 16] FIG. 13 is a conceptual diagram of an example of a barcode image before being reduced in the horizontal direction. [Figure 17] FIG. 13 is an example of a barcode image after being reduced in the horizontal direction. [Figure 18] FIG. 11 is an explanatory diagram of an example of a change count confirmation process. [Figure 19] FIG. 13 is an image diagram of an example of a barcode image. [Figure 20] FIG. 11 is an explanatory diagram of an example of a change count confirmation process. [Figure 21] 13 is a flowchart illustrating an example of a job status update process when passing through a gate. [Figure 22] 13 is a flowchart of an example of a job status update process when the job is stored in a temporary storage location. [Diagram 23] 11A to 11C are diagrams showing an example of a transition of a UI screen displayed by the work process management system. [Figure 24] 11 is an explanatory diagram of an example of a grouping process on a UI screen. [Diagram 25] 11 is an explanatory diagram of an example of a search condition designation process on a UI screen. [Figure 26] FIG. 13 is an image diagram of an example of a map display screen of a temporary storage location. [Figure 27] FIG. 13 is an explanatory diagram of an example in which progress information of one or more work processes is represented by markers. [Figure 28] 11 is an explanatory diagram of an example showing switching between a job status list screen and a dashboard display screen; FIG. [Figure 29] FIG. 13 is an image diagram of an example of a dashboard display screen. [Diagram 30] FIG. 2 is an explanatory diagram of an example of a marker. [Diagram 31] FIG. 13 is an image diagram of an example of a flow line display screen. [Diagram 32] FIG. 11 is a functional configuration diagram of another example of a work process management system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In this embodiment, a job management system that realizes management of job work processes in a printing factory by a function (function of the work instruction) using a work instruction (slip) will be described as an example.

[0010] [First embodiment] <System configuration> Fig. 1 is a configuration diagram of an example of a job management system according to this embodiment. Fig. 2 is an image diagram of an example of a work instruction sheet used in the job management system according to this embodiment. In the job management system 1 of Fig. 1, a customer system 10, a work process management system 14, a printer 16, and one or more cameras 18 are connected to each other so as to be able to communicate data with each other via a network 20 such as the Internet or a LAN.

[0011] The customer system 10 is an example of an existing system used by a customer, and a work instruction sheet 800 for the customer system 10 shown in Fig. 2(A) is created, in which a job ID is displayed. The job ID is an example of identification information for identifying a job. In addition, the work instruction sheet 800 for the customer system 10 displays at least one barcode image 801 used on the customer system 10 side.

[0012] The job ID may be displayed as a barcode image 801 or as text in the work instruction sheet 800 for the customer system 10. The customer system 10 provides the user with existing functions realized by the work instruction sheet 800 for the customer system 10.

[0013] The work process management system 14, the printer 16, and one or more cameras 18 constitute the information processing system 12 that adds new functions to the work instruction sheet 800. The work process management system 14 manages the progress of a job consisting of multiple work processes as described below, using a work instruction sheet 810 for the information processing system 12 to which a color code image 811 shown in Fig. 2(B) is added. Note that the information processing system 12 can identify the job ID from the color code image 811 as described below.

[0014] The printer 16 prints out a work instruction sheet 810 for the information processing system 12. The camera 18 is installed so as to be able to photograph locations corresponding to the work steps of a job in the printing factory. Note that locations corresponding to the work steps of a job include locations through which printed materials pass when moving between work steps, temporary storage locations where printed materials are temporarily stored, and the like.

[0015] A PTZ camera or an IP camera can be used as the camera 18. The PTZ camera is a camera whose PTZ (Pan Tilt Zoom) function can be operated via the network 20, and which can transmit captured images and videos via the network 20. The IP camera is a camera which can be operated via the network 20, and which can transmit captured images and videos via the network 20. The captured images and videos taken by the camera 18 are transmitted to the work process management system 14 via the network 20.

[0016] In the information processing system 12 that adds a new function to the work instruction sheet 800, a work instruction sheet 810 for the information processing system 12 is affixed to a printed material that is an example of an intermediate product or material of a job corresponding to the work instruction sheet 810. The work instruction sheet 810 is affixed to a printed material that is likely to be photographed by the camera 18, for example.

[0017] The work process management system 14 manages the progress of the work process of the job (job status) based on the work process of the job corresponding to the camera 18 that captured the work instruction 810 and the job ID identified from the color code image 811 of the work instruction 810. The work process management system 14 also manages the history of the work process of the job, and captured images and videos showing the state when the work instruction 810 was captured.

[0018] 1 is an example. For example, the job management system 1 may include other systems, and the work process management system 14 may have a different name. The work process management system 14 may be realized in a single server environment, or in a multiple server environment.

[0019] <Hardware configuration> The customer system 10 and the work process control system 14 are realized, for example, by a computer 500 having the hardware configuration shown in FIG.

[0020] Fig. 3 is a hardware configuration diagram of an example of a computer. The computer 500 in Fig. 3 includes an input device 501, a display device 502, an external I / F 503, a RAM 504, a ROM 505, a CPU 506, a communication I / F 507, and a HDD 508, all of which are connected to each other via a bus B. The input device 501 and the display device 502 may be connected and used when necessary.

[0021] The input device 501 includes a keyboard, a mouse, a touch panel, etc., and is used by the user to input various operation signals. The display device 502 includes a display, etc., and displays the results of processing by the computer 500.

[0022] The communication I / F 507 is an interface that connects the computer 500 to various networks. This allows the computer 500 to perform data communication via the communication I / F 507.

[0023] The HDD 508 is an example of a non-volatile storage device that stores programs and data. The stored programs and data include an OS, which is basic software that controls the entire computer 500, and application software (hereinafter simply referred to as applications) that provides various functions on the OS. Note that the computer 500 may use a drive device (e.g., a solid-state drive: SSD) that uses a flash memory as a storage medium instead of the HDD 508.

[0024] The external I / F 503 is an interface with an external device. The external device may include a recording medium 503a. This allows the computer 500 to read and / or write data from and to the recording medium 503a via the external I / F 503. The recording medium 503a may include a flexible disk, a CD, a DVD, an SD memory card, a USB memory, and the like.

[0025] The ROM 505 is an example of a non-volatile semiconductor memory (storage device) that can retain programs and data even when the power is turned off. The ROM 505 stores programs and data such as BIOS, OS settings, and network settings that are executed when the computer 500 is started. The RAM 504 is an example of a volatile semiconductor memory (storage device) that temporarily retains programs and data.

[0026] The CPU 506 is a calculation device that reads programs and data from storage devices such as the ROM 505 and HDD 508 onto the RAM 504 and executes processing to realize the overall control and functions of the computer 500. The customer system 10 and the work process control system 14 can realize various processes, which will be described later, by the hardware configuration of the computer 500, for example, as shown in Fig. 3. Note that a description of the hardware configuration of the printer 16 and the camera 18 will be omitted.

[0027] <Software configuration> Fig. 4 is a functional configuration diagram of an example of a work process management system. Note that the functional configuration of Fig. 4 omits configurations that are not necessary for the explanation of this embodiment. The work process management system 14 in Fig. 4 has a UI section 30, a job ID detection section 32, a job management section 34, a color code image generation section 36, a color-coded work instruction sheet creation section 38, a print instruction section 40, a photographed image acquisition section 42, a color code recognition section 44, a color code management table storage section 46, and a job management table storage section 48.

[0028] The UI unit 30 controls the display of various screens such as a screen for accepting various settings required by the user, a job status list screen, a job detail history screen, a dashboard display screen, and a flow line display screen, which will be described later. The job ID detection unit 32 detects a job ID displayed as a barcode image 801 or text on a work instruction sheet 800 for the customer system 10 in FIG. 2(A), for example.

[0029] The job management unit 34 stores and manages available color code IDs in a color code management table storage unit 46. The job management unit 34 limits the number of available color code IDs and narrows the range of values ​​required to express a color code ID, thereby maximizing the size of the color code image 811 and facilitating color code recognition, which will be described later.

[0030] If there is no unused color code ID remaining in the color code management table storage unit 46, the job management unit 34 selects and reuses the oldest color code ID that was last updated from the color code management table storage unit 46. The job management unit 34 manages the job ID detected by the job ID detection unit 32 and the selected color code ID in the color code management table storage unit 46 in association with each other.

[0031] Furthermore, the job management unit 34 stores and manages job information corresponding to the job ID and color code ID in the job management table storage unit 48. The job management table storage unit 48 manages progress information and history information of the work process of the job, photographed image files and photographed video files showing the state when the work instruction sheet 810 was photographed, and is used to display a job status list screen, which will be described later, and the like.

[0032] The color code image generating unit 36 ​​generates a color code image 811 (described later) from a color code ID provided by the job management unit 34. The color-coded work instruction creation unit 38 creates a work instruction 810 for the information processing system 12 to which the color code image 811 in Fig. 2(B) is added from the work instruction 800 for the customer system 10 in Fig. 2(A). The print instruction unit 40 instructs the printer 16 to print the work instruction 810 for the information processing system 12 to which the color code image 811 in Fig. 2(B) is added.

[0033] The captured image acquisition unit 42 acquires captured images and captured videos from the camera 18. The color code recognition unit 44 decodes a color code ID from a color code image 811 captured in the captured image or captured video. The color code recognition unit 44 provides the job management unit 34 with identification information for identifying, for example, the camera 18 that captured the color code image 811 or the work process of the job, and the decoded color code ID. The job management unit 34 refers to the job management table storage unit 48 to identify the job ID corresponding to the decoded color code ID.

[0034] This enables the job management unit 34 to update the progress information (job status) of the job work process managed in the job management table memory unit 48 based on the job work process corresponding to the camera 18 that captured the color code image 811 and the job ID corresponding to the decoded color code ID.

[0035] <Processing> Fig. 5 is an image diagram showing an example of the work processes of a job in a printing factory. The work processes in Fig. 5 include "printing", "cutting", "folding", "binding", "inspection", "temporary storage 1", and "temporary storage 2". Camera 18a is installed at the gate in front of the location where the work processes "printing", "cutting", "folding", "binding", and "inspection" are performed. Camera 18b is installed at the location where the work processes "temporary storage 1" and "temporary storage 2" are performed.

[0036] The work instructions 810 for the information processing system 12 are photographed by the cameras 18a and 18b while they are being moved between work processes or while they are stored in a temporary storage location. As shown in Fig. 5, the movement between work processes is not constant in a printing factory, and depending on the job, there may be cases where the work instructions 810 for the information processing system 12 are not photographed and work processes that are not detected or recorded are included. Fig. 5 shows arrows that represent the movement of jobs that perform all work processes and arrows that represent the movement of jobs that skip some of the work processes.

[0037] In Fig. 5, after a printout is output in the work step "printing", a work instruction sheet 810 is attached to the printout. As a result, in the example of Fig. 5, the work instruction sheet 810 attached to the printout is photographed by the camera 18a or the camera 18b while the printout is passing through the gate or while it is stored in the temporary storage area.

[0038] 《Create color-coded work instructions》 6 is a flowchart of an example of a process for creating a color-coded work instruction sheet. In step S11, the job ID detection unit 32 of the work process management system 14 detects the job ID displayed as a barcode image 801 or text on the work instruction sheet 800 for the customer system 10. The detection frame for detecting the job ID from the work instruction sheet 800 may be set in advance by an operator, or may be set automatically using OCR or the like.

[0039] Proceeding to step S12, the job management unit 34 selects a color code ID to be used from the color code management table storage unit 46, and manages the selected color code ID in association with the job ID detected by the job ID detection unit 32.

[0040] Proceeding to step S13, the color code image generating unit 36 ​​generates a color code image 811 from the color code ID associated with the job ID in the procedure shown in Fig. 7. Note that the procedure shown in Fig. 7 utilizes, for example, the technology described in JP 2017-199306 A.

[0041] FIG. 7 is a flowchart of an example of a process for generating a color code image. In step S21, the color code image generating unit 36 ​​accepts an input of a color code ID to be color coded. In step S22, the color code image generating unit 36 ​​breaks down the character string of the color code ID into the values ​​of each digit. In step S23, the color code image generating unit 36 ​​converts the values ​​of each broken down digit into values ​​according to the number of colors to be assigned to each cell of the optical symbol described in JP 2017-199306 A. For example, if the number of colors to be assigned to each cell is four, the color code image generating unit 36 ​​converts the values ​​of each digit into a ternary value according to the coding rule shown in FIG. 8, for example.

[0042] Fig. 8 is a diagram for explaining the coding rule capable of expressing ternary numbers. Fig. 8 shows an example of the coding rule when four colors, R (red), G (green), B (blue), and K (black), are used. When four colors are used, it is possible to express three values, i.e., ternary numbers.

[0043] For example, as illustrated in Fig. 8(a), clockwise transitions, i.e., from R to K, K to B, B to G, and G to R, represent a value of "0". Counterclockwise transitions, i.e., from R to G, G to B, B to K, and K to R, represent a value of "1". Diagonal transitions, i.e., bidirectional transitions between R and B and bidirectional transitions between K and G, each represent a value of "2".

[0044] For example, consider the case where a cell string is connected in the order of G, R, B, K, and G, as shown in FIG. 8(b), and the color transitions of each cell are viewed from left to right in the figure. In this case, the transition from G to R represents the value "0", the transition from R to B represents the value "2", the transition from B to K represents the value "1", and the transition from K to G represents the value "2". Therefore, the array in FIG. 8(b) represents the value "3d2120", which is the decimal value "69". Note that the leading "3d" in the value notation indicates that the following digits are a ternary value.

[0045] The coding rule using four-color transitions is not limited to the example shown in FIG. 8(a), and may be, for example, the example shown in FIG. 8(d). FIG. 8(e) shows an example of a conversion table that associates color transitions and values ​​according to the coding rule shown in FIG. 8(d). In FIG. 8(e), for example, if the color of the transition source cell is R and it is desired to express a value "2," the color of the transition destination cell adjacent to the transition source cell is set to B. Similarly, if the color of the transition source cell is K and it is desired to express a value "1," the color of the transition destination cell is set to G.

[0046] Proceeding to step S24 following step S23 in Fig. 7, the color code image generating unit 36 ​​assigns a color to each cell of the optical symbol according to the color of the transition source cell, the ternary value converted in step S23, and the conversion table of the encoding rule as shown in Fig. 8(a). Note that the color code image generating unit 36 ​​is assumed to have stored in advance the color arrangement of each cell in the cell row of the main code of the optical symbol.

[0047] A more specific example in which the number of colors assigned to each cell of the optical symbol is four will be described with reference to Figures 9 and 10. Figure 9 is a diagram showing an example of information to be coded into the optical symbol. Figure 10 is a diagram showing an example of the optical symbol in which the number of colors assigned to each cell of the optical symbol is four.

[0048] FIG. 9 shows an example in which the cell strings in the sub-code section 301 connected to the cells "d1", "d2", "d3" and "d4" in the main code section 300 have the values ​​"3d1", "3d1", "3d0" and "3d1".

[0049] Figure 10 shows an example of an optical symbol in which the information shown in Figure 9 is encoded according to the encoding rule described with reference to Figure 8. In this example, the cell row of the main code portion 300 includes an even number of cells, with the leading cell being colored K, and the colors K and R being arranged alternately.

[0050] Also, for example, in the leftmost cell of the sub code section 301, the color of the cell is assigned with the color K of the cell in the main code section 300 to which the cell is connected as the color of the first transition source. In the example of Fig. 10, the color R is assigned to the cell in the sub code section 301 at the leftmost side of the optical symbol by referring to the conversion table of the encoding rule in Fig. 8(a) according to the color K of the cell in the main code section 300 which is the transition source cell and the value "3d1" of the cell in the sub code section 301.

[0051] Proceeding to step S14 following step S13 in FIG. 6, the color-coded work instruction sheet creator 38 creates a work instruction sheet 810 for the information processing system 12 using the color code image 811 created in step S13.

[0052] Fig. 11 is a diagram showing a process image for creating a color-coded work instruction sheet. The paper size and layout frame may be set in advance by the operator. The work instruction sheet 800 for the customer system 10 in Fig. 2(A) is resized or reduced to generate free space. The work instruction sheet 810 for the information processing system 12 in Fig. 2(B) is created by resizing or reducing the work instruction sheet 800 for the customer system 10, and pasting a color code image 811 into the free space generated.

[0053] 2A shows at least one barcode image 801 used by the customer system 10. Therefore, if the work instruction sheet 800 for the customer system 10 is simply reduced in size, there is a possibility that the barcode image 801 will no longer function (will become unrecognizable).

[0054] Therefore, in order to generate free space without impairing the functionality of the barcode image 801, the color-coded work instruction creation unit 38 checks the orientation of the barcode image 801 using the procedure shown in Figure 12, and performs scaling in a direction that does not impair the functionality of the barcode image 801.

[0055] Fig. 12 is a flow chart of an example of a process for reducing an image including a barcode image. In step S31, the color-coded work instruction creation unit 38 extracts the position of the barcode image 801 from the work instruction 800 for the customer system 10 in Fig. 2(A). Proceeding to step S32, the color-coded work instruction creation unit 38 determines whether the extracted barcode image as shown in Fig. 13 is a Bk (monochrome) image or an RGB image. Fig. 13 is an image diagram of an example of a barcode image.

[0056] If it is not a Bk (monochrome) image, the color-coded work instruction creation unit 38 proceeds to step S33, converts the RGB image to a Lab image or Luv image, creates a monochrome image by extracting only the L component after conversion, and proceeds to step S34. On the other hand, if it is a monochrome image, the color-coded work instruction creation unit 38 skips step S33 and proceeds to step S34.

[0057] In step S34, the color-coded work instruction creation unit 38 raster scans all pixels in the barcode image in Fig. 13. Here, the pixel position (x, y) is a position according to the X direction and Y direction shown in Fig. 13. The color-coded work instruction creation unit 38 accumulates the value of pixels with the same pixel position x, that is, accumulates the pixel values ​​in the Y direction.

[0058] Then, the process proceeds to step S35, where the color-coded work instruction creation unit 38 integrates all the pixels. The color-coded work instruction creation unit 38 obtains an average value by dividing the integrated value of all the pixels by the total number of pixels.

[0059] Proceeding to step S36, the color-coded work instruction creation unit 38 checks the number of changes by comparing the integrated values ​​of pixels having the same pixel position x obtained in step S34 with the average value obtained in step S35, as shown in Fig. 18. Fig. 18 is an explanatory diagram of an example of the number of changes checking process. For example, the color-coded work instruction creation unit 38 checks the number of changes by adding up the number of changes from an integrated value higher than the average value to a lower integrated value and the number of changes from an integrated value lower than the average value to a higher integrated value.

[0060] Proceeding to step S37, the color-coded work instruction creation unit 38 judges whether the number of changes confirmed in step S36 is 24 or more. If the number of changes is 24 or more, the process proceeds to step S38, where the color-coded work instruction creation unit 38 performs scaling in the vertical direction to reduce the barcode image in Fig. 14, for example, to the barcode image in Fig. 15. Fig. 14 is an example of a barcode image before vertical reduction. Fig. 15 is an example of a barcode image after vertical reduction.

[0061] For example, when the barcode image shown in Fig. 13 is reduced in the X direction, the black lines come closer together, making it difficult to distinguish between black and white. On the other hand, when the barcode image shown in Fig. 13 is reduced in the Y direction, the spacing between the black lines does not change, so there is no effect on the black and white distinction.

[0062] On the other hand, if the number of changes is less than 24, the process proceeds to step S39, where the color-coded work instruction sheet creation unit 38 performs scaling in the horizontal direction to reduce the barcode image in FIG. 16, for example, to the barcode image in FIG.

[0063] The process in the flowchart of Figure 12 determines the orientation of a barcode image based on the following idea. For example, in the case of a vertical barcode as shown in Figure 13, because the black lines have width, a set of changes occurs: white to black and black to white. The number of changes varies depending on the number of digits displayed in the barcode, but research on general barcodes has shown that if the number of changes is 24 or more, it can be determined to be a vertical barcode like the one in Figure 13.

[0064] Similarly, in the case of a horizontal barcode as shown in Fig. 19, in step S36, the color-coded work instruction sheet creation unit 38 checks the number of changes as shown in Fig. 20. Fig. 19 is an image diagram of an example of a barcode image. Fig. 20 is an explanatory diagram of an example of the number of changes confirmation process.

[0065] In the case of Figure 20, the total number of changes from an integrated value higher than the average to a lower integrated value and the total number of changes from an integrated value lower than the average to a higher integrated value is extremely small, so even if information other than the barcode image is integrated, the number of changes will not exceed 24. Therefore, if the number of changes is less than 24, it can be determined that it is a horizontal barcode as shown in Figure 19.

[0066] Instead of the above-mentioned method for determining the orientation of a barcode image, the orientation of a barcode image can also be determined by using the Fourier transform or the Hough transform, which is a feature extraction method. However, recent printers perform halftone processing. In particular, electrophotographic printers may use line dithering.

[0067] When the Hough transform is used, it is possible to extract the line components in the image. Although the line components of the barcode are dominant, it is difficult to eliminate the effects of halftone processing, especially line dithering. To reduce the effects of line dithering, the position of the barcode image 801 must be precisely specified in step S31. Similarly, when the Fourier transform is used, the problem arises of whether the effects of halftone processing around the barcode can be precisely eliminated.

[0068] On the other hand, in the method of determining the orientation of a barcode image in this embodiment, even if a line dither image or some character or image is included around the barcode image cut out in step S31, this is not counted as the number of changes and is not a problem.

[0069] In this way, in the work process management system 14 of this embodiment, free space is created by varying the size of the barcode image 801 in a direction that does not impair the function of the barcode image 801, and the color code image 811 that can be read remotely can be added to that free space. Even if the work instruction sheet 800 for the customer system 10 is varied in size, the function of the barcode image 801 is not impaired, and the function of the color code image 811 can be added to the work instruction sheet 810 for the information processing system 12 while leaving the function of the work instruction sheet 800 for the customer system 10 intact.

[0070] 6, the process proceeds to step S15, where the print instruction unit 40 instructs the printer 16 to print a work instruction sheet 810 for the information processing system 12 (a work instruction sheet with a color code) to which the color code image 811 created in step S14 has been added. In response to the instruction from the print instruction unit 40, the printer 16 prints out the work instruction sheet 810 for the information processing system 12 to which the color code image 811 has been added, for example, as shown in FIG. 2(B).

[0071] <<Job status update when passing through a gate>> In the job management system 1 according to this embodiment, a work instruction sheet 810 for the information processing system 12, to which a color code image 811 has been added, is photographed by the camera 18a, and the job status in the job management table memory unit 48 is updated as follows.

[0072] 21 is a flowchart of an example of a job status update process when passing through a gate. When the captured image acquisition unit 42 of the work process management system 14 acquires captured images or captured videos from the camera 18a, the process proceeds to step S52.

[0073] In step S52, the color code recognition unit 44 attempts to extract a color code image 811 from the captured image or video captured by the captured image acquisition unit 42. In step S53, the color code recognition unit 44 performs recognition processing of the color code image 811 according to the procedure described in, for example, JP 2017-199306 A.

[0074] When the color code image 811 is recognized, the color code recognition unit 44 detects images of each cell from the color code image 811. In step S54, the color code recognition unit 44 recognizes the color information of each cell and the connection information of each cell detected in step S53 as symbol information. In step S54, the color code recognition unit 44 decodes the symbol information according to the encoding rule shown in Fig. 8(A), for example, to restore the color code ID coded in the color code image 811.

[0075] Proceeding to step S55, the color code recognition unit 44 provides, for example, the identification information of the camera 18a that captured the color code image 811 and the color code ID restored by decoding to the job management unit 34. The job management unit 34 refers to the job management table storage unit 48 and identifies the job ID corresponding to the color code ID.

[0076] Then, the job management unit 34 can update the job status managed in the job management table storage unit 48 from "undetected" to "current process" or "passed", for example, based on the identification information of the camera 18a that captured the color code image 811 and the job ID corresponding to the color code ID restored from the color code image 811.

[0077] Updating job status when storing in temporary storage In the job management system 1 according to this embodiment, the job status in the job management table memory unit 48 is updated as follows when a work instruction sheet 810 for the information processing system 12 to which a color code image 811 has been added is photographed by the camera 18b.

[0078] 22 is a flowchart of an example of a job status update process during storage in a temporary storage location. When the photographed image acquisition unit 42 of the work process management system 14 acquires the photographed image from the camera 18b, the process proceeds to step S62.

[0079] In step S62, the color code recognition unit 44 attempts to extract a color code image 811 from the captured image or video captured by the captured image acquisition unit 42. In step S63, the color code recognition unit 44 performs recognition processing of the color code image 811 according to the procedure described in, for example, JP 2017-199306 A.

[0080] If the color code image 811 is recognized in step S63, the color code recognition unit 44 proceeds from step S64 to step S65, and restores the color code ID that was coded in the color code image 811 by decoding the symbol information recognized from the color code image 811.

[0081] Proceeding to step S66, the color code recognition unit 44 provides, for example, the identification information of the camera 18b that captured the color code image 811 and the color code ID restored by decoding to the job management unit 34. The job management unit 34 refers to the job management table storage unit 48 and identifies the job ID corresponding to the color code ID.

[0082] Then, the job management unit 34 determines, for example, based on the identification information of the camera 18b that captured the color code image 811 and the job ID corresponding to the color code ID restored from the color code image 811, whether or not a predetermined time has passed without any change in the job status of the job ID.

[0083] If the predetermined time has not passed without a change in the job status, the job management unit 34 proceeds to step S70. In step S70, the job management unit 34 can update the job status managed in the job management table storage unit 48 from "undetected" to "current process". If the predetermined time has passed without a change in the job status, the job management unit 34 performs processing to display a retention alert on a job detail history screen described below, and then proceeds to processing in step S70. In step S70, the job management unit 34 can update the job status managed in the job management table storage unit 48 from "current process" to "alert", etc.

[0084] If the color code image 811 is not recognized in step S63, the color code recognition unit 44 proceeds from step S64 to step S68, and performs processing to update the job ID whose job status is stored in the temporary storage location when the color code image 811 cannot be recognized from the image captured by the camera 18b installed in the temporary storage location.

[0085] The color code recognition unit 44 provides, for example, the identification information of the camera 18b to the job management unit 34. The job management unit 34 determines whether or not there is a job ID in which the color code image 811 has not been recognized from the captured image a predetermined number of times consecutively among the job IDs in which the job status of the temporary storage location corresponding to the provided identification information of the camera 18b is “current process”.

[0086] Among the job IDs whose job status in the temporary storage location is "current process", if there is a job ID for which the color code image 811 has not been recognized from the captured image a predetermined number of times in succession, the job management unit 34 proceeds to step S69, sets the color code ID associated with that job ID to Null, and proceeds to step S70. In step S70, the job management unit 34 can update the job status managed in the job management table storage unit 48 from "current process" to "passed", for example.

[0087] Also, there is a possibility that the work instruction sheet 810 for the information processing system 12 is stored in a state where it cannot be photographed by the camera 18b, for example, because printed materials are stacked in the temporary storage location. Taking this into consideration, if there is no job ID in which the color code image 811 has not been recognized from the photographed image a predetermined number of times consecutively among the job IDs in the temporary storage location whose job status is "current process", the job management unit 34 skips step S69 and proceeds to step S70. In step S70, the job management unit 34 can update the job status managed in the job management table storage unit 48 from "current process" to "stacked".

[0088] According to the processing of the flowcharts of Figures 21 and 22, the job status of a printed material to which a work instruction sheet 810 for the information processing system 12 is attached is automatically updated, making it possible to track printed materials to which a work instruction sheet 810 for the information processing system 12 is attached.

[0089] Job Inquiry An operator of the job management system 1 can use various UI screens provided by the work process management system 14 to inquire about progress information and history information of the work process of a job in a printing factory, as well as captured image files and video files showing the state when the work instruction sheet 810 was photographed.

[0090] 23 is a transition diagram of an example of a UI screen displayed by the work process management system. The UI unit 30 of the work process management system 14 displays, for example, a job status list screen 1000 on the display device 502. The job status list screen 1000 displays a list of job information including a job ID, a color code ID, a job name, last update data, and progress information of one or more work processes.

[0091] The progress information of one or more work processes indicates whether the progress of the work process is "not detected," "passed," "current process," "alert," or "stagnant." The progress of a work process "not detected" indicates that the work instruction 810 for the information processing system 12 has not been photographed by the camera 18 corresponding to that work process. The progress of a work process "passed" indicates that the work instruction 810 for the information processing system 12 was photographed by the camera 18 corresponding to that work process before the last update.

[0092] Furthermore, the progress of a work process "current process" indicates that the work instruction sheet 810 for the information processing system 12 was photographed by the camera 18 corresponding to that work process at the last update. The progress of a work process "alert" indicates that an alert, such as a stay alert, has occurred. The progress of a work process "stacked" indicates that the work instruction sheet 810 for the information processing system 12 was photographed by the camera 18 corresponding to that work process before the last update, and that the work instruction sheet 810 for the information processing system 12 was not photographed by the camera 18 corresponding to that work process or another work process at the last update. The progress of a work process "stacked" indicates a state in which it is expected that a printed matter to which the work instruction sheet 810 is attached cannot be photographed by the camera 18 due to stacking or the like.

[0093] Note that the lock mark 1002 on the job status list screen 1000 indicates that the color code ID associated with, for example, a long-term storage job is locked so as not to be automatically released. In this way, the work process management system 14 provides the operator with a lock function that prevents the color code ID from being reused.

[0094] An operator can display a job details history screen 1010 by selecting one job from the job status list screen 1000. The job details history screen 1010 displays buttons for transitioning to a screen that displays the start date and time, completion date and time, and captured images and videos for each work process. If the work process is "temporary storage 1" or "temporary storage 2", the job details history screen 1010 also displays an address indicating the storage area in the temporary storage location. Furthermore, the job details history screen 1010 displays a "traffic line display" button for transitioning to a traffic line display screen 1050, which will be described later.

[0095] Furthermore, when a button for transitioning to a screen 1020 displaying a captured image or a captured video on the job detail history screen 1010 is pressed, the UI unit 30 transitions to the screen 1020 displaying the captured image or the captured video. When a play button is pressed, the screen 1020 displaying the captured image or the captured video displays a captured image file or a captured video file showing the state when the work instruction sheet 810 was captured.

[0096] When a button for transitioning to the map display screen 1030 of a job corresponding to the work process "Temporary storage 1" or "Temporary storage 2" is pressed, the UI unit 30 transitions to the map display screen 1030 shown in Fig. 26. Fig. 26 is an image diagram of an example of a map display screen of a temporary storage location. For example, the UI unit 30 displays a photographed image of the temporary storage location in the background, and then displays the storage area where the printed matter is stored so that it can be identified with a mark such as "●".

[0097] The job status list screen 1000 in FIG. 23 may be displayed by grouping as shown in FIG. 24, or may be configured to accept the designation of search conditions as shown in FIG.

[0098] Fig. 24 is an explanatory diagram of an example of grouping processing on a UI screen. Fig. 24(A) is an example of a job status list screen 1000 before grouping processing. Fig. 24(B) and Fig. 24(C) are examples in which progress information of one or more work processes on the job status list screen 1000 after grouping processing is grouped by "1st floor area" and "2nd floor area" to make it easier to visually grasp.

[0099] In Figure 24(C), the grouped "1st Floor Area" is displayed collapsed. When displaying the progress information of grouped work processes collapsed, the AND (logical product) of the progress information of the work processes included in the group is displayed as the progress information of that group so that the progress information of the work processes included in the collapsed "1st Floor Area" group can be seen. For example, the AND of the progress information of the work processes included in the group is determined as "Alert > Current Process > Stacked > Passed > Not Detected".

[0100] FIG. 25 is an explanatory diagram of an example of a search condition specification process on a UI screen. FIG. 25 is an example of a job status list screen 1000 with a search row. The search row is displayed, for example, by pressing the "Search" button on the job status list screen 1000. The operator can search for jobs that match the search conditions by specifying the search conditions in the search row. The search row provided as in FIG. 25 has the effect of reducing screen transitions and improving immediacy and visibility. FIG. 25(A) is an example of inputting search conditions in the text field (partial match) in the search row. FIG. 25(B) is an example of inputting search conditions in the date and time field (range specification) in the search row. FIG. 25(C) is an example of selecting search conditions in the work process field (match) in the search row using a pull-down menu. Selection using the pull-down menu may be made such that multiple selections can be made using, for example, the control key. In addition, when the "Clear Conditions" button is pressed, the search conditions are cleared all at once and the display returns to full display.

[0101] Furthermore, the progress information of one or more work steps on the job status list screen 1000 may be expressed, for example, with a marker as shown in Fig. 27. Note that in Fig. 27, the color of the marker is expressed in kanji. Time passes in the order of Fig. 27(a) to Fig. 27(e). For example, in Fig. 27, the second work step, whose progress was "current process" in Fig. 27(c), has a progress of "accumulation" in Fig. 27(d).

[0102] The progress information of one or more work processes shown in FIG. 27(d) becomes one of the states shown on the right side of FIG. 27 when the work instruction sheet 810 for the information processing system 12 is photographed again by the camera 18.

[0103] Furthermore, the operator can display a dashboard display screen 1040 by pressing a "Dashboard" button on the job status list screen 1000. Fig. 28 is an explanatory diagram showing an example of switching between the job status list screen and the dashboard display screen. When the "Dashboard" button is pressed while the job status list screen 1000 is accepting the specification of search conditions, the dashboard display screen 1040 takes over and displays the specified search conditions.

[0104] Moreover, the operator can display the job status list screen 1000 by pressing a "return to list" button on the dashboard display screen 1040. The job status list screen 1000 may be configured to display the original search conditions specified before transitioning to the dashboard display screen 1040.

[0105] Fig. 29 is an image diagram of an example of a dashboard display screen. The dashboard display screen 1040 displays information about the progress of multiple jobs using markers (an example of a display object) that indicate the location of the job on a map and the number of jobs at each location. For example, Fig. 29 shows the number of jobs and the number of alerts in each process category for "Process Category A," "Process Category B," and "Process Category C."

[0106] The dashboard display screen 1040 in Fig. 29 may surround process categories with a frame and embed a factory map as a background image. The position where the marker is displayed represents one or more work processes. The size of the marker represents the number of jobs in that work process. The color of a normal marker that does not include a job for which an alert has occurred (e.g., green) is displayed to distinguish from the color of an alert marker that includes a job for which an alert has occurred (e.g., red).

[0107] Fig. 30 is an explanatory diagram of an example of a marker. The marker in Fig. 30 is an example represented by a bubble (circle mark), and is represented by a circle of 5 levels of size according to the number of jobs for a specified work process. The parameters of the marker in Fig. 30 include the range of the number of jobs, center coordinates, radius (size), and color (normal marker / alert marker). Note that the color of the normal marker may be different for each of the 5 levels.

[0108] According to the dashboard display screen 1040, the number of jobs accumulated in each operation step and the operation steps including jobs for which an alert has occurred can be visually displayed in an easy-to-understand manner.

[0109] Furthermore, the operator can display a flow line display screen 1050 by pressing a "flow line display" button on the job details history screen 1010. Fig. 31 is an image diagram of an example of the flow line display screen. The flow line display screen 1050 displays a flow line by connecting the job history with a curve on a map based on information related to the job history displayed on the job details history screen 1010. An example of the curve is a Bezier curve. A Bezier curve is an N-1 degree curve obtained from N control points.

[0110] The flow line display screen 1050 in Fig. 31 displays the points of work processes with circles. The display of the circles is done by specifying the center coordinates, radius, color, and transparency. Work processes that the job has not passed through are hidden. Furthermore, on the flow line display screen 1050 in Fig. 31, the center coordinates of work processes that the job has passed through are connected with a Bezier curve, so that the flow line of the job can be visually represented. On the flow line display screen 1050 in Fig. 31, by hovering the mouse over a circle, information such as the process name / passage time (all of the process if there are multiple) of the work process corresponding to the circle may be displayed.

[0111] As described above, the work process management system 14 according to this embodiment allows the progress information of the work process of a job in a printing factory to be confirmed in a list. Also, the work process management system 14 according to this embodiment allows the history information of the work process of a job in a printing factory, the captured image file and the captured video file showing the state when the work instruction sheet 810 was photographed, the dashboard display screen 1040, the flow line display screen 1050, and the like to be confirmed with a simple operation.

[0112] [Second embodiment] In the first embodiment, the work instruction sheet 810 for the information processing system 12 is created in the work process management system 14. In the second embodiment, the work instruction sheet 810 for the information processing system 12 is created in the customer system 10. The second embodiment is the same as the first embodiment except for some parts. Therefore, the same parts as the first embodiment will not be described as appropriate.

[0113] <System configuration> Fig. 32 is a functional configuration diagram of another example of a work process management system. The work process management system 14a in Fig. 32 has a configuration in which the color-coded work instruction creation unit 38 and the print instruction unit 40 are removed from the work process management system 14 in Fig. 4. On the other hand, a color-coded work instruction creation unit 60 and a print instruction unit 62 are added to the customer system 10a.

[0114] In the job management system 1 according to the second embodiment, the process up to the generation of the color code image 811 is performed by the work process management system 14a in the same manner as in the first embodiment, and steps S14 and S15 in FIG. 6 are performed by the color-coded work instruction creation unit 60 and the print instruction unit 62 of the customer system 10.

[0115] The job management system 1 according to the second embodiment can also achieve the same effects as those of the job management system 1 according to the first embodiment.

[0116] [Third embodiment] The first and second embodiments described above are technologies realized by a work instruction sheet 810 for the information processing system 12 in which a new code (color code image 811) is added to a work instruction sheet 800 for the customer system 10. This technology can be applied to a technology for a transport system represented by an AGV (automated guided vehicle), for example.

[0117] For example, in a transport system that transports an article, a work instruction sheet 810 for the information processing system 12 with a color code image 811 added thereto is attached to the article, and the article is photographed by the camera 18 while being transported, so that the work process of the article being transported by the transport device can be managed. In addition, since the position of the transport device transporting the article and the destination of the article can be identified, the transport system can also control the movement of the transport device transporting the article.

[0118] [Fourth embodiment] The above-mentioned first and second embodiments have been described with respect to the management of the work process of a job in a printing factory, but they can also be applied to the management of the work process of an object flowing on a belt conveyer. For example, if the technology of this embodiment is applied to the management of the work process of an object flowing on a belt conveyer, it becomes possible to track the object flowing on the belt conveyer, and it is also possible to control the branching of the belt conveyer.

[0119] The present invention is not limited to the above-mentioned specifically disclosed embodiment, and various modifications and changes are possible without departing from the scope of the claims. The color code image 811 is an example of a code image associated with a job described in the claims. The work instruction sheet 810 for the information processing system is an example of a slip.

[0120] The camera 18 is an example of an imaging means. The color code recognition unit 44 is an example of a recognition means. The job management unit 34 is an example of a management means. The UI unit 30 is an example of a providing means. A captured image file and a captured video file are examples of captured data. The job status list screen 1000 is an example of a list screen. The job detail history screen 1010 is an example of a detail screen. [Explanation of symbols]

[0121] 1. Job Management System 10 Customer System 12 Information Processing Systems 14 Work process control system 16 Printers 18, 18a, 18b Camera 20 Network 30 UI section 32 Job ID detection unit 34 Job Management Department 36 Color code image generator 38, 60 Color-coded work instruction sheet creation section 40, 62 Print instruction section 42 Image capture unit 44 Color code recognition unit 46 Color code management table storage section 48 Job management table storage section 800 Work Order for Customer System 801 Barcode Images 810 Work instructions for information processing systems 811 color code image 1000 Job status list screen 1010 Job details history screen 1020 Screen for displaying captured images and videos 1030 Job map display screen 1040 Dashboard display screen 1050 Flow line display screen [Prior art documents] [Patent documents]

[0122] [Patent Document 1] JP 2005-100298 A

Claims

1. An information processing system, comprising: an acquisition means for acquiring an image captured by one or more cameras; a recognition means for recognizing identification information from the acquired image; an update means for updating the status corresponding to the identification information when the recognized identification information is no longer recognized; The information processing system having the above.

2. The information processing system according to claim 1, wherein the update means updates the status when the identification information is recognized, and updates the status when the recognized identification information is no longer recognized.

3. The information processing system according to claim 2, wherein the update means updates the status to a first status when the identification information is recognized, and updates the status from the first status to a second status when the recognized identification information can no longer be recognized.

4. The information processing system according to claim 1, further comprising a provision means for providing the updated status to a user.

5. The information processing system according to claim 1, wherein the status includes the status of a storage process for storing an article in a storage location.

6. The information processing system according to claim 5, wherein the update means updates the status corresponding to the identification information to a status indicating that the article is in the storage location when the identification information is recognized.

7. The information processing system according to claim 5, wherein the update means updates the status corresponding to the identification information to a status indicating that the article is not in the storage location when the recognized identification information is not recognized.

8. The information processing system according to claim 5, further comprising a management means for associating and managing the identification information, the status, and address information representing a storage area where the article is stored.

9. The information processing system according to claim 1, wherein the recognition means recognizes the identification information based on a code image included in the acquired image.

10. A management method executed by an information processing system, comprising: an acquisition step of acquiring an image captured by one or more cameras; a recognition step of recognizing identification information from the acquired image; an update step of updating the status corresponding to the identification information when the recognized identification information is no longer recognized; The management method having the above.

11. An information processing system An acquisition means for acquiring an image captured by one or more cameras, A recognition means for recognizing identification information from the acquired image, An update means for updating the status corresponding to the identification information when the recognized identification information is no longer recognized, A program for causing it to function.

Images