Display control device, screen display method and program

Abstract

The inspection device (10) includes a memory unit (13) that stores task setting information related to processing blocks that indicate processing contents related to the inspection, correspondence information that indicates the correspondence between the processing blocks and monitor components, and layout setting information related to setting the layout of a monitor screen using the monitor components selected by a user as display targets, and a layout generation unit (151) that generates monitor layout information for displaying information related to the inspection based on the task setting information, the correspondence information, and the layout setting information.

Description

[Technical field]

[0001] The present disclosure relates to a display control device Place, picture The present invention relates to a surface display method and a program. [Background technology]

[0002] In conventional visual inspection, a person visually checks the object to be inspected and judges whether it is good or defective, but there is an increasing demand to automate visual inspection to detect defective products. To automate visual inspection, it is necessary to have a system to automatically inspect the object instead of a person visually inspecting it, as well as a system to confirm whether the automated inspection was actually performed correctly. In other words, a system to confirm the inspection results of such automated visual inspection is required.

[0003] As a technology for checking the results of such automated visual inspection, Patent Document 1 discloses a technology for easily creating a screen on which a reference tolerance range is set and the result of judging whether the inspected object is good or bad can be checked based on whether it is within the tolerance range. The technology of Patent Document 1 allows the user to easily check the inspection results. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2013-164313 A Summary of the Invention [Problem to be solved by the invention]

[0005] According to the technology described in Patent Document 1, it is possible to confirm the test results. On the other hand, if the test result seems to be an erroneous judgment, it is necessary to check the test situation and whether the test is being performed appropriately.

[0006] If the process that caused the misjudgment can be identified by checking the inspection status, further misjudgments can be prevented and the inspection can be carried out appropriately thereafter. Therefore, it is important to check each inspection process.

[0007] Since the process that a user wants to check primarily changes depending on the situation, a mechanism that allows the user to easily select the process that he or she wants to check is desired.

[0008] In view of the above circumstances, an object of the present disclosure is to provide a display control device and the like that allows a user to easily select and check a process that he or she wishes to check. [Means for solving the problem]

[0009] In order to achieve the above object, a display control device according to the present disclosure includes a storage means for storing task setting information relating to processing blocks indicating processing contents relating to an inspection, correspondence information indicating the correspondence between the processing blocks and monitor parts, and layout setting information relating to the setting of the layout of a monitor screen using the monitor parts selected by a user as display targets, and a layout generating means for generating monitor layout information for displaying information relating to the inspection based on the task setting information, the correspondence information, and the layout setting information; A display means for displaying a screen including a monitor screen and a display item setting area, a display control means for displaying a screen based on the monitor layout information generated by the layout generating means on the monitor screen, and an input means for receiving a user's operation. The monitor part includes: For each processing block Includes a monitor component for notifying the user of the status of the examination. The layout generation means stores in the storage means new layout setting information for displaying monitor components corresponding to the processing block selected based on a user's operation on the display item setting area via the input means, and generates new monitor layout information based on the new layout setting information. Effect of the Invention

[0010] According to the present disclosure, a user can easily select and check a process that he or she wishes to check. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram showing an overall configuration of an inspection system according to an embodiment of the present disclosure. [Diagram 2] FIG. 1 is a diagram showing a network configuration of an inspection system according to an embodiment of the present disclosure. [Diagram 3]FIG. 13 is a diagram illustrating an example of a task setting screen displayed on a terminal device according to an embodiment of the present disclosure. [Figure 4] FIG. 1 is a diagram illustrating an example of a monitor screen displayed on a terminal device according to an embodiment of the present disclosure. [Diagram 5] FIG. 1 is a diagram illustrating an example of a monitor screen displayed on a terminal device according to an embodiment of the present disclosure. [Figure 6] FIG. 1 is a diagram illustrating an example of a monitor screen displayed on a terminal device according to an embodiment of the present disclosure. [Figure 7] FIG. 1 is a block diagram showing a functional configuration of an inspection device according to an embodiment of the present disclosure. [Figure 8] FIG. 1 is a diagram showing an example of correspondence information stored in an inspection device according to an embodiment of the present disclosure. [Figure 9] FIG. 1 is a block diagram showing a functional configuration of a terminal device according to an embodiment of the present disclosure. [Figure 10] FIG. 1 is a diagram illustrating an example of a hardware configuration of an inspection device and a terminal device according to an embodiment of the present disclosure. [Figure 11] 1 is a flowchart showing an example of a data storage operation performed by an inspection device according to an embodiment of the present disclosure. [Figure 12] 1 is a flowchart showing an example of a layout generation operation performed by an inspection apparatus according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, an inspection system according to an embodiment of the present disclosure will be described with reference to the drawings. In each drawing, the same or equivalent parts are denoted by the same reference numerals.

[0013] (Embodiment) With reference to FIG. 1, an inspection system 1 according to an embodiment will be described. The inspection system 1 is an inspection system that inspects a workpiece W, which is a product processed at a production site P, based on a captured image and a trained model. The inspection system 1 includes an inspection device 10, a terminal device 20, a learning device 30, a file server 40, a cloud system 50, a PLC (Programmable Logic Controller) 2, a camera 3, and a light 4. The PLC 2, the camera 3, and the light 4 are installed at the production site P. In addition, a belt conveyor, a robot arm, and the like (not shown) for moving the workpiece W may also be installed at the production site P. Note that, although only one inspection device is shown in FIG. 1, there may be multiple inspection devices. The inspection system 1 is an example of an inspection system according to the present disclosure.

[0014] The inspection device 10 executes various tasks related to the inspection. Hereinafter, the tasks related to the inspection are simply referred to as inspection tasks. The inspection task is a series of processes such as accepting an instruction to start the inspection, capturing an image of the object to be inspected by the camera 3, performing an inspection based on the captured image, and feeding back the inspection result to the user. The inspection task includes one or more inspection-related processes, and the processes are, for example, capturing an image of the work W by the camera 3, setting the lighting 4 required for capturing the image, acquiring the device value of the PLC 2 when inspecting the work W, and inspecting the work W based on the captured image and the learned model. The learned model is stored in the inspection device 10 or the learning device 30. The learned model can also be additionally stored in the file server 40. The inspection device 10 stores various data obtained during the execution of the inspection task in the file server 40 in task units. This allows the inspection device 10 to easily link various data related to the inspection. A task unit is a unit that collectively includes a series of processes from an instruction to start the inspection to feedback of the inspection result. Furthermore, the inspection device 10 transmits monitor layout information to the terminal device 20 for displaying information related to the inspection task on the terminal device 20. Details of the inspection device 10 will be described later. The inspection device 10 is an example of a display control device according to the present disclosure.

[0015] The terminal device 20 is a terminal device equipped with an input unit and a display unit. The terminal device 20 is used by the user to set the inspection task of the inspection device 10 and to monitor information related to the execution of the inspection task by the inspection device 10. The terminal device 20 also realizes a user interface related to the setting related to the generation of the trained model, the setting of the PLC 2, the setting of the camera 3, the setting of the lighting 4, and the like, in a single user interface. This reduces the burden on the user when setting the inspection system 1. The terminal device 20 is, for example, a personal computer, a tablet terminal, or the like. Details of the terminal device 20 will be described later.

[0016] The learning device 30 generates a trained model for inspecting the workpiece W by machine learning, based on captured image data relating to the image of the workpiece W captured by the camera 3. The trained model is stored in the inspection device 10 or the learning device 30 itself. In addition, the learning device 30 downloads templates, frameworks, libraries, etc. used during machine learning from the cloud system 50. The user operates the terminal device 20 to set which templates, frameworks, libraries, etc. the learning device 30 will use.

[0017] The file server 40 stores various data obtained by the inspection device 10 through the execution of the inspection task. The file server 40 stores the trained model generated by the learning device 30.

[0018] The cloud system 50 provides templates, frameworks, libraries, etc. used during machine learning.

[0019] The network configuration of the inspection system 1 will be described with reference to Fig. 2. The inspection system 1 includes a factory network FN and an information network IN. The learning device 30 and the inspection device 10 are both connected to both the factory network FN and the information network IN. The PLC 2, the camera 3, and the lighting 4 installed at the production site P are connected to the factory network FN. The terminal device 20, the file server 40, and the cloud system 50 are connected to the information network IN.

[0020] Setting of an inspection task by the terminal device 20 and display of information related to the inspection task will be generally described with reference to FIGS.

[0021] A user operates the terminal device 20 to call up a task setting screen shown in Fig. 3. On the task setting screen, one or more processing blocks B1 to B6 (hereinafter collectively referred to as "processing blocks B") can be combined to configure one inspection task. In principle, the processing blocks B have a chronological relationship, that is, a flow, such as processing blocks B1 to B5, but there are also processing blocks that do not have a chronological relationship, such as processing block B6.

[0022] Processing block B6 (hereinafter also referred to as "pause block B6"), which is a processing block related to suspension (hereinafter referred to as "pause block"), is a processing block for pausing a running task in response to a user operation. When an inspection task includes the pause block B6, the user can pause the inspection task. The pause block B6 can also be used to resume a task that has already been paused. Note that resumption of a task includes not only resumption of a task paused by the pause block B6, but also resumption of a task paused for some reason. How to pause and resume a task will be described later. In this way, processing block B includes a processing block (hereinafter also referred to as "operation block") that executes processing based on a user operation.

[0023] In principle, each processing block B outputs something. For example, processing blocks B1 and B3, which are processing blocks related to imaging, output data related to captured images. Furthermore, processing blocks B2 and B4, which are processing blocks related to inspection, output data related to inspection results. Processing block B5 related to device value acquisition outputs data related to acquired device values. In addition, a processing block B may process and output data output by another processing block B. For example, there may be a processing block B that performs preprocessing on data related to captured images and outputs the preprocessed image data. This processing block related to preprocessing is provided between the processing block related to imaging and the processing block related to inspection in the flow of the inspection task. In addition to the processing block related to preprocessing, processing blocks related to data calculation, generation of new images, etc. may be provided between the processing block related to imaging and the processing block related to inspection.

[0024] The inspection device 10 stores the data output by each processing block in the file server 40 for each inspection task based on the inspection task set by the user. Although not shown in FIG. 3, the user can set the task setting screen to store only a portion of the data output by each processing block. For example, the user can set which type of data is to be stored among the data output by each processing block. Alternatively, the user can set the data to be stored for each processing block individually.

[0025] After setting the inspection task, the user can operate the terminal device 20 to call up the monitor screen shown in FIG. 4. The monitor screen shown in FIG. 4 is displayed based on monitor layout information generated by the inspection device 10. The monitor screen shown in FIG. 4 includes monitor components C1-C4 (hereinafter also collectively referred to as "monitor components C"). The monitor component C1 related to the front surface inspection corresponds to the processing block B2 of the front surface inspection shown in FIG. 3, the monitor component C2 related to the back surface inspection corresponds to the processing block B4 of the back surface inspection shown in FIG. 3, the monitor component C3 related to the pause button (hereinafter also referred to as "pause button C3") corresponds to the pause block B6 shown in FIG. 3, and the monitor component C4 related to the device value corresponds to the processing block B5 of the device value acquisition shown in FIG. 3. Due to the display item setting described later, the monitor component corresponding to the processing block B1 of the front surface imaging and the monitor component corresponding to the processing block B3 of the back surface imaging are not displayed in FIG. 4.

[0026] In this way, the layout of the monitor screen is generated by combining monitor parts C in order to display information about each processing block B that constitutes the inspection task side by side in accordance with the inspection task settings made on the task setting screen. This allows the user to check the inspection status on a monitor screen suitable for the inspection task that he or she has set, making it easy to check the inspection status.

[0027] The user can operate the terminal device 20 to set which monitor component is to be displayed from the display item setting area R as shown in FIG. 5. For example, when "Memo" is checked, a monitor component C5 relating to memos is added to the monitor screen as shown in FIG. 6. This "Memo" monitor component C5 is a monitor component in which the user can freely enter text. Unlike the monitor components C1-C4, the "Memo" monitor component C5 is not associated with the processing block B. In this way, the monitor components include those that are not associated with the processing block B but are for the convenience of the user.

[0028] The functional configuration of the inspection device 10 will be described with reference to Fig. 7. The inspection device 10 includes a first communication unit 11, a second communication unit 12, a storage unit 13, a task management unit 14, and a layout management unit 15.

[0029] The first communication unit 11 communicates with each device connected to the factory network FN.

[0030] The second communication unit 12 communicates with each device connected to the information network IN.

[0031] The storage unit 13 stores task setting information indicating the setting contents of the inspection task, correspondence information indicating the correspondence between the processing block B and the monitor component C, and layout setting information regarding the setting of the layout of the monitor screen. The storage unit 13 is an example of a storage means according to the present disclosure.

[0032] The task setting information includes information about the process blocks B that constitute the inspection task, information about the flow between the process blocks B that constitute the inspection task, and information about the data set by the user as the object to be saved. The correspondence information is expressed, for example, in a table as shown in FIG. 8. The correspondence information makes it possible to identify the monitor component C that corresponds to the process block B indicated in the task setting information. The correspondence information is created in advance, for example, by the manufacturer of the inspection device 10 and stored in the storage unit 13. The layout setting information includes information indicating which monitor component C is to be displayed and where the monitor component C to be displayed is to be displayed. The layout setting information is determined, for example, based on a user's operation in the display item setting area R shown in FIG. 5 described above.

[0033] The task management unit 14 manages the inspection tasks and particularly includes a data acquisition unit 141, a task setting unit 142, a task execution unit 143, and a data storage unit 144.

[0034] The data acquisition unit 141 acquires a device value from the PLC 2 via the first communication unit 11, and acquires captured image data relating to a captured image of the workpiece W from the camera 3 via the first communication unit 11. Note that this data acquisition can be performed as part of the processing of a processing block executed by a task execution unit 143 described later.

[0035] The task setting unit 142 sets the inspection task based on a user's operation via a task setting screen displayed by the terminal device 20. As described later, the terminal device 20 transmits information based on the user's operation via the task setting screen to the inspection device 10. The task setting unit 142 acquires this information via the second communication unit 12 and sets the inspection task based on this information. The task setting unit 142 stores task setting information indicating the setting contents of the inspection task in the storage unit 13. The user operates the terminal device 20 to select data to be saved, and the task setting unit 142 sets the data to be saved when setting the inspection task, so that the data selected by the user can be saved on an inspection task basis.

[0036] The task execution unit 143 refers to the task setting information stored in the storage unit 13, sequentially executes a plurality of processing blocks B constituting the inspection task, and retains data outputted by each processing block B that the user has set as a target to be saved, for each inspection task. The task execution unit 143 also retains the referred task setting information for each inspection task. When the user operates the terminal device 20 to operate a monitor component C corresponding to an operation block, the task execution unit 143 executes the processing of the corresponding operation block. For example, when the operation block is a pause block B6, the task execution unit 143 pauses the execution of the inspection task when the inspection task is not paused. Also, when the inspection task is paused, the task execution unit 143 resumes the execution of the paused task. The task execution unit 143 is an example of a task execution means according to the present disclosure.

[0037] The data storage unit 144 stores the data held by the task execution unit 143 on an inspection task basis in the file server 40 via the second communication unit 12. For example, the data storage unit 144 stores the data when the task execution unit 143 completes execution of the inspection task. This means that various data related to the inspection are automatically linked and stored on an inspection task basis. Since the task execution unit 143 also holds task setting information on an inspection task basis, the task setting information is also stored on the file server 40 on an inspection task basis. Therefore, the user can refer to the various data and task setting information stored on the file server 40 on an inspection task basis as necessary, and reproduce and verify the inspection task.

[0038] The layout management unit 15 manages the layout of the monitor screen displayed on the terminal device 20. The layout management unit 15 includes a layout generation unit 151, a layout transmission unit 152, and an operation acquisition unit 153.

[0039] The layout generating unit 151 refers to the task setting information, the correspondence information, and the layout setting information stored in the storage unit 13, and generates monitor layout information for generating a monitor screen shown in FIG. 4, for example. The monitor layout information includes information regarding which monitor component C is to be placed at which position, what is to be displayed on each monitor component C, and the like. Since most of the monitor components C display information related to the output of the processing block B, the layout generating unit 151 refers to data held by the task executing unit 143 on an inspection task basis as necessary. The monitor layout information is expressed by Web content including, for example, an HTML (Hyper Text Markup Language) file, an image file, and the like. The layout generating unit 151 is an example of a layout generating means according to the present disclosure.

[0040] When the user performs an operation related to a change in the layout settings, for example, an operation in the display item setting area R shown in Fig. 5, the layout generating unit 151 stores new layout setting information in the storage unit 13 and generates new monitor layout information based on the new layout setting information. The operation related to the change in the layout settings is acquired by the operation acquiring unit 153 described later.

[0041] The layout transmission unit 152 transmits the monitor layout information generated by the layout generation unit 151 to the terminal device 20 via the second communication unit 12. For example, as described above, when the monitor layout information is represented by Web content, the layout transmission unit 152 is realized by implementing a function as a Web server.

[0042] The operation acquisition unit 153 acquires information indicating an operation related to a change in layout setting by a user from the terminal device 20 via the second communication unit 12. For example, when a user operates the display item setting region R shown in FIG. 5 to turn on the "Memo" item, the terminal device 20 transmits information regarding the operation to the inspection device 10, and the operation acquisition unit 153 acquires the information regarding the operation. Based on the information regarding the operation acquired by the operation acquisition unit 153, the layout generation unit 151 newly stores in the storage unit 13 layout setting information indicating that the "Memo" monitor component C is to be displayed. Then, the layout generation unit 151 newly generates monitor layout information including the "Memo" monitor component C.

[0043] The functional configuration of the terminal device 20 will be described with reference to Fig. 9. The terminal device 20 includes a communication unit 21, a display unit 22, an input unit 23, and a control unit 24.

[0044] The communication unit 21 communicates with each device connected to the information network IN.

[0045] The display unit 22 displays a screen based on the control of the control unit 24. The display unit 22 is, for example, a liquid crystal display. The display unit 22 may also be a touch screen integrated with the input unit 23 described below. The display unit 22 is an example of a display means according to the present disclosure.

[0046] The input unit 23 receives a user operation and outputs a signal indicating the user operation to the control unit 24. The input unit 23 includes an input device such as a mouse or a keyboard. Alternatively, the input unit 23 may be a touch screen integrated with the display unit 22. The input unit 23 is an example of an input means according to the present disclosure.

[0047] The control unit 24 performs overall control of the terminal device 20. In particular, the control unit 24 acquires monitor layout information from the inspection device 10 via the communication unit 21, and displays a monitor screen on the display unit 22 based on the monitor layout information. When the user calls up a task setting screen by operating the input unit 23 and performs an operation for setting a task, the control unit 24 transmits information indicating the setting content of the task to the inspection device 10. When the user operates a monitor component C corresponding to an operation block on the monitor screen by operating the input unit 23, the control unit 24 transmits information indicating the operation to the inspection device 10. When the user operates a display item setting operation for the monitor component C to be displayed on the monitor screen by operating the input unit 23, the control unit 24 transmits information indicating the selected display item to the inspection device 10. The control unit 24 is an example of a display control means according to the present disclosure.

[0048] Furthermore, the control unit 24 causes the display unit 22 to display a setting screen related to model generation by the learning device 30, a setting screen for the PLC 2, a setting screen for the camera 3, and a setting screen for the lighting 4 as setting screens that can be operated by the same user interface. The control unit 24 can set the PLC 2, the camera 3, and the lighting 4 via the inspection device 10 or the learning device 30. The control unit 24 sets the learning device 30, the PLC 2, the camera 3, and the lighting 4 based on a user's operation via the setting screens.

[0049] The control unit 24 has a function as, for example, a Web browser. The control unit 24 functioning as a Web browser communicates with the inspection device 10 or the learning device 30 functioning as a Web application server, and acquires Web content representing various setting screens from the inspection device 10 or the learning device 30. The control unit 24 displays a setting screen based on the acquired Web content on the display unit 22. The inspection device 10 or the learning device 30 functioning as a Web application server can realize various setting screens that can be operated by the same user interface, for example, by generating Web content representing various setting screens using the same Web framework. The control unit 24 transmits information representing user operations on the various setting screens to the inspection device 10 or the learning device 30 functioning as a Web application server. The inspection device 10 or the learning device 30 that receives the information sets the PLC 2, the camera 3, and the lighting 4 based on the information.

[0050] An example of the hardware configuration of the inspection device 10 and the terminal device 20 will be described with reference to Fig. 10. The inspection device 10 and the terminal device 20 shown in Fig. 10 are realized by a computer such as a personal computer or a microcontroller.

[0051] The inspection device 10 and the terminal device 20 each include a processor 1001 , a memory 1002 , an interface 1003 , and a secondary storage device 1004 , which are connected to each other via a bus 1000 .

[0052] The processor 1001 is, for example, a CPU (Central Processing Unit). The processor 1001 loads an operation program stored in a secondary storage device 1004 into a memory 1002 and executes the program, thereby implementing each function of the inspection device 10 and the terminal device 20.

[0053] The memory 1002 is a main storage device formed of, for example, a RAM (Random Access Memory). The memory 1002 stores an operating program that the processor 1001 reads from the secondary storage device 1004. The memory 1002 also functions as a working memory when the processor 1001 executes the operating program.

[0054] The interface 1003 is an I / O (Input / Output) interface such as a serial port, a USB (Universal Serial Bus) port, or a network interface.

[0055] The secondary storage device 1004 is, for example, a flash memory, a hard disk drive (HDD), or a solid state drive (SSD). The secondary storage device 1004 stores the operating programs executed by the processor 1001.

[0056] An example of the data storage operation by the inspection device 10 will be described with reference to Fig. 11. The operation shown in Fig. 11 is executed for each inspection task.

[0057] The task execution unit 143 of the task management unit 14 of the inspection device 10 refers to the task setting information stored in the storage unit 13, and executes the processing of the first processing block of the inspection task (step S101).

[0058] The task execution unit 143 holds the data output by the processing block (step S102). Since the operation shown in Fig. 11 is executed for each inspection task, the data output by the processing block is held for each inspection task.

[0059] The task execution unit 143 determines whether there is an unprocessed process block (step S103). Note that the unprocessed process block does not include an operation block independent of the flow, such as the paused block B6 shown in FIG.

[0060] If there is an unprocessed process block (step S103: Yes), the task execution unit 143 executes the process of the next process block (step S104) and repeats the operations from step S102.

[0061] When there is no unprocessed processing block (step S103: No), the data storage unit 144 of the task management unit 14 stores the data that the task execution unit 143 held in step S102 in the file server 40 (step S105). Then, the task management unit 14 ends the data storage operation.

[0062] An example of the layout generation operation by the inspection device 10 will be described with reference to Fig. 12. The operation shown in Fig. 12 is started, for example, when a user operates the terminal device 20 to call up a monitor screen, and the operation acquisition unit 153 of the layout management unit 15 of the inspection device 10 acquires information about the operation from the terminal device 20.

[0063] The layout generation unit 151 of the layout management unit 15 of the inspection device 10 refers to the task setting information, the correspondence information, and the layout setting information stored in the storage unit 13 (step S201).

[0064] The layout generating unit 151 refers to the data held by the task executing unit 143 for each inspection task based on the task setting information referred to in step S201 (step S202).

[0065] The layout generating unit 151 generates monitor layout information based on the task setting information, correspondence information, and layout setting information referred to in step S201, and the data held for each inspection task referred to in step S202 (step S203). As a result, a layout for a monitor screen including a monitor component C that displays data output by the processing block B is generated.

[0066] The layout transmission unit 152 of the layout management unit 15 transmits the monitor layout information generated in step S203 to the terminal device 20 (step S204). Then, the layout management unit 15 ends the layout generation operation.

[0067] The inspection system 1 according to the embodiment has been described above. According to the inspection system 1, the data storage unit 144 of the inspection device 10 automatically stores data obtained by executing the processing block B of the inspection task for each inspection task, so that various data related to the inspection can be easily linked. Also, according to the inspection system 1, the user can set which data to save for each inspection task, so that the user can freely extract and save data.

[0068] Moreover, according to the inspection system 1, by simply setting an inspection task on the task setting screen, monitor layout information for an appropriate monitor screen is generated according to the setting of the inspection task, so that the user can easily check the status of the inspection. Moreover, according to the inspection system 1, monitor layout information for an appropriate monitor screen is generated, and display items can be easily set, so that the user can easily create a monitor screen that suits his / her preferences. Therefore, the user can easily select and check the process that he / she wants to check.

[0069] Furthermore, the inspection system 1 allows the user to reduce the number of monitor parts displayed on the monitor screen as needed, thereby improving the processing speed and reducing the communication load.

[0070] Furthermore, according to the inspection system 1, the settings related to learning of the learning device 30, the settings of the PLC 2, the settings of the camera 3, and the settings of the lighting 4 can be set using the same user interface by operating the terminal device 20, thereby reducing the burden on the user when setting up the inspection system 1.

[0071] (Modification) In the embodiment, the inspection system 1 includes both the file server 40 and the cloud system 50, but may include only one of them. For example, the file server 40 may provide templates, frameworks, libraries, etc., and the cloud system 50 may store data for each inspection task.

[0072] In the embodiment, the inspection device 10 and the learning device 30 are separate devices, but they may be integrated into a single device. In particular, when machine learning is performed in real time in parallel with the inspection, it is highly likely that the efficiency will be improved by integrating them into a single device.

[0073] In the embodiment, the terminal device 20 and the inspection device 10 are separate devices, but the inspection device 10 may have each function of the terminal device 20 and also function as the terminal device 20. In this case, for example, the inspection device 10 functions as both a Web application server and a Web browser. When a user sets the PLC 2, the camera 3, and the lighting 4 using the inspection device 10, the function of the Web application server generates Web content representing a setting screen, and the function of the Web browser acquires the generated Web content and displays various setting screens based on the acquired Web content.

[0074] In the embodiment, the inspection device 10 includes the layout management unit 15 and the storage unit 13 in which the task setting information, the correspondence information, and the layout setting information are stored, but these may be included in the terminal device 20. In that case, the terminal device 20 generates the monitor layout information. The inspection device 10 or the terminal device 20 that generates the monitor layout information may be called a display control device.

[0075] 10, the inspection device 10 and the terminal device 20 are equipped with a secondary storage device 1004. However, the present invention is not limited to this, and the secondary storage device 1004 may be provided outside the inspection device 10 and the terminal device 20, and the inspection device 10 and the terminal device 20 may be connected to the secondary storage device 1004 via an interface 1003. In this embodiment, removable media such as a USB flash drive and a memory card can also be used as the secondary storage device 1004.

[0076] 10, the inspection device 10 and the terminal device 20 may be configured by a dedicated circuit using an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), etc. In the hardware configuration shown in FIG. 10, a part of the functions of the inspection device 10 and the terminal device 20 may be realized by a dedicated circuit connected to the interface 1003, for example.

[0077] The programs used in the inspection device 10 and the terminal device 20 can be distributed by storing them in computer-readable recording media such as CD-ROMs (Compact Disc Read Only Memory), DVDs (Digital Versatile Discs), USB flash drives, memory cards, HDDs, etc. By installing such programs in a specific or general-purpose computer, the computer can function as the inspection device 10 and the terminal device 20.

[0078] Furthermore, the above-mentioned program may be stored in a storage device owned by another server on the Internet, and the above-mentioned program may be downloaded from that server.

[0079] Various embodiments and modifications of the present disclosure are possible without departing from the broad spirit and scope of the present disclosure. The above-described embodiments are for explaining the present disclosure and do not limit the scope of the present disclosure. In other words, the scope of the present disclosure is indicated by the claims, not the embodiments. Various modifications made within the scope of the claims and within the scope of the disclosure equivalent thereto are considered to be within the scope of the present disclosure. [Explanation of symbols]

[0080] 1 inspection system, 2 PLC, 3 camera, 4 lighting, 10 inspection device, 11 first communication unit, 12 second communication unit, 13 memory unit, 14 task management unit, 15 layout management unit, 20 terminal device, 21 communication unit, 22 display unit, 23 input unit, 24 control unit, 30 learning device, 40 file server, 50 cloud system, 141 data acquisition unit, 142 task setting unit, 143 task execution unit, 144 data storage unit, 151 layout generation unit, 152 layout transmission unit, 153 operation acquisition unit, 1000 bus, 1001 processor, 1002 memory, 1003 interface, 1004 secondary storage device, B1-B6 processing block, C1-C5 monitor parts, FN factory network, IN information network, P production site, R display item setting area, W work.

Claims

1. a storage means for storing task setting information on processing blocks indicating processing contents related to an inspection, correspondence information indicating correspondence between the processing blocks and monitor components, and layout setting information on the setting of the layout of a monitor screen using the monitor components selected by a user as display targets; a layout generating means for generating monitor layout information for displaying information related to the examination based on the task setting information, the correspondence information, and the layout setting information; a display means for displaying a screen including the monitor screen and a display item setting area; a display control means for displaying on the monitor screen a screen based on the monitor layout information generated by the layout generation means; An input means for accepting a user's operation; Equipped with the monitor component includes a monitor component for notifying a user of a status of the inspection for each of the processing blocks; the layout generating means stores in the storage means new layout setting information for displaying the monitor components corresponding to the processing blocks selected based on the user's operation on the display item setting area via the input means, and generates new monitor layout information based on the new layout setting information. Display control device.

2. The task setting information includes information on a plurality of processing blocks constituting an inspection task, which is a task related to the inspection and includes a plurality of processes related to the inspection, and information on a flow between the plurality of processing blocks. The display control device according to claim 1 .

3. the layout generating means generates the monitor layout information for displaying information about each of the plurality of processing blocks in an arranged manner; The display control device according to claim 2 .

4. The plurality of processing blocks include a processing block related to imaging of an inspection object, a processing block related to inspection of the inspection object, and a processing block related to processing executed between the imaging and the inspection. The display control device according to claim 2 .

5. The layout generation means generates the monitor layout information further including an interface that allows the user to select which processing block information is to be displayed, and stores the new layout setting information based on the user's operation on the interface in the storage means. The display control device according to claim 1 .

6. Further comprising a task execution means for executing the inspection based on the task setting information, the processing block includes an operation block that executes a process based on an operation of the user; the correspondence information includes information regarding a correspondence between the operation block and an operation component that is a monitor component corresponding to the operation block; the task execution means, when the operational component is operated by the user's operation via the input means, executes a process by the operational block corresponding to the operational component. The display control device according to claim 1 .

7. The operational blocks include a pause block for pausing execution of the test and for resuming execution of the test that has been paused; the operation component includes a pause button corresponding to the pause block, When the pause button is pressed by the user's operation via the input means, the task execution means executes a process according to the pause block to pause the execution of the test, and resumes the execution of the paused test. The display control device according to claim 6.

8. generating monitor layout information for displaying information relating to the inspection based on task setting information relating to a processing block indicating processing contents relating to the inspection, correspondence information indicating correspondence between the processing block and a monitor component, and layout setting information relating to setting of a layout of a monitor screen using the monitor component selected by a user as a display target; displaying a screen based on the monitor layout information on a monitor screen of a display means for displaying a screen including a monitor screen and a display item setting area; Accepting a user's operation via an input means; the monitor component includes a monitor component for notifying a user of a status of the inspection for each of the processing blocks; generating new monitor layout information based on new layout setting information for displaying the monitor components corresponding to the processing blocks selected based on an operation of the user on the display item setting area via the input means; Screen display method.

9. On the computer, generating monitor layout information for displaying information relating to the inspection based on task setting information relating to a processing block indicating processing contents relating to the inspection, correspondence information indicating correspondence between the processing block and a monitor component, and layout setting information relating to setting of a layout of a monitor screen using the monitor component selected by a user as a display target; displaying a screen based on the monitor layout information on a monitor screen of a display means for displaying a screen including a monitor screen and a display item setting area; Accepting a user's operation via an input means; the monitor component includes a monitor component for notifying a user of a status of the inspection for each of the processing blocks; generating new monitor layout information based on new layout setting information for displaying the monitor parts corresponding to the processing blocks selected based on an operation of the user on the display item setting area via the input means; program.