Display control device, inspection system, screen image display method, and program

The display control device and inspection system address the challenge of automating visual inspection by enabling users to easily select and confirm inspection processes through customizable monitor layouts, enhancing inspection efficiency and reducing errors.

WO2025004238A1PCT designated stage expired Publication Date: 2025-01-02MITSUBISHI ELECTRIC CORP
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2023/024046
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-06-28
Publication Date
2025-01-02

AI Technical Summary

Technical Problem

Conventional visual inspection systems lack the ability to automate the confirmation of inspection results and allow users to easily select and confirm specific processes, leading to potential misjudgments and inefficiencies.

Method used

A display control device and inspection system that includes task setting information, correspondence information, and a layout generation mechanism to create customizable monitor layouts, enabling users to easily select and confirm inspection processes through a terminal device.

Benefits of technology

Facilitates efficient automation of visual inspection by allowing users to easily confirm inspection results and processes, reducing misjudgments and improving inspection efficiency by providing a user-friendly interface for monitoring and managing inspection tasks.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2023024046_02012025_PF_FP_ABST
    Figure JP2023024046_02012025_PF_FP_ABST
Patent Text Reader

Abstract

An inspection device (10) comprises: a storage unit (13) that stores task setting information relating to a processing block indicating processing content related to an inspection, correspondence information indicating an association between the processing block and a monitor component, and layout setting information relating to setting of a layout of a monitor screen image using a monitor component selected as a display target by a user; and a layout generation unit (151) that, on the basis of the task setting information and the layout setting information, generates monitor layout information for displaying the information related to the inspection.
Need to check novelty before this filing date? Find Prior Art

Description

Display control device, inspection system, screen display method and program

[0001] The present disclosure relates to a display control device, an inspection system, a screen display method, and a program.

[0002] In conventional visual inspections, a person visually checks the object to be inspected and judges whether it is a good or bad product, but there is an increasing demand for automating visual inspections to detect defective products. To automate visual inspections, it is necessary to have a system that automatically inspects the object instead of a person visually inspecting it, as well as a system to confirm whether the automated inspection was actually performed correctly. In other words, a system for confirming the inspection results is required for such automated visual inspections.

[0003] As a technique for checking the results of such automated visual inspection, Patent Document 1 discloses a technique for easily creating a screen on which a reference tolerance range is set and the result of determining whether an inspection target falls within the tolerance range can be checked to see whether the product is good or bad. The technique disclosed in Patent Document 1 allows the user to easily check the inspection results.

[0004] JP 2013-164313 A

[0005] According to the technology described in Patent Document 1, it is possible to confirm the test results. However, if the test results appear to be erroneous, it is necessary to check the status of the test and whether the test is being carried out appropriately.

[0006] By checking the inspection status, if it is possible to identify the process that caused the incorrect judgment, further incorrect judgments can be prevented and inspections can be carried out appropriately thereafter. Therefore, it is important to check each inspection process.

[0007] The process that a user wants to check primarily varies depending on the situation, so a mechanism that allows the user to easily select the process that they want to check is desired.

[0008] In view of the above circumstances, an object of the present disclosure is to provide a display control device and the like that allows a user to easily select and check a process that the user wants to check.

[0009] In order to achieve the above object, the display control device of the present disclosure includes a storage means for storing task setting information related to processing blocks that indicate processing contents related to an inspection, correspondence information that indicates the correspondence between the processing blocks and monitor components, and layout setting information related to setting the layout of a monitor screen using the monitor components selected by the user as the display target, and a layout generation means for generating monitor layout information for displaying information related to the inspection based on the task setting information, correspondence information, and layout setting information.

[0010] According to the present disclosure, a user can easily select and check a process that the user wants to check.

[0011] FIG. 1 is a diagram showing the overall configuration of an inspection system according to an embodiment of the present disclosure. FIG. 2 is a diagram showing the network configuration of an inspection system according to an embodiment of the present disclosure. FIG. 3 is a diagram showing an example of a task setting screen displayed on a terminal device according to an embodiment of the present disclosure. FIG. 4 is a diagram showing an example of a monitor screen displayed on a terminal device according to an embodiment of the present disclosure. FIG. 5 is a diagram showing an example of a monitor screen displayed on a terminal device according to an embodiment of the present disclosure. FIG. 6 is a block diagram showing the functional configuration of an inspection device according to an embodiment of the present disclosure. FIG. 7 is a block diagram showing the functional configuration of a terminal device according to an embodiment of the present disclosure. FIG. 8 is a diagram showing an example of hardware configurations of an inspection device and a terminal device according to an embodiment of the present disclosure.

[0012] An inspection system according to an embodiment of the present disclosure will be described below with reference to the drawings. In each drawing, the same or equivalent parts are denoted by the same reference numerals.

[0013] (Embodiment) An inspection system 1 according to an embodiment will be described with reference to FIG. 1 . The inspection system 1 is an inspection system that inspects a workpiece W, which is a manufactured product processed at a production site P, based on a captured image and a trained model. The inspection system 1 includes an inspection device 10, a terminal device 20, a learning device 30, a file server 40, a cloud system 50, a PLC (Programmable Logic Controller) 2, a camera 3, and a light 4. The PLC 2, the camera 3, and the light 4 are installed at the production site P. In addition, a belt conveyor, a robot arm, and the like (not shown) for moving the workpiece W may also be installed at the production site P. Note that while FIG. 1 shows only one inspection device, multiple inspection devices may be used. The inspection system 1 is an example of an inspection system according to the present disclosure.

[0014] The inspection device 10 executes various inspection-related tasks. Hereinafter, inspection-related tasks are simply referred to as inspection tasks. An inspection task is a series of processes, such as receiving an instruction to start an inspection, capturing an image of the object to be inspected using the camera 3, performing an inspection based on the captured image, and providing feedback on the inspection results to the user. An inspection task includes one or more inspection-related processes, such as capturing an image of the workpiece W using the camera 3, setting the lighting 4 required for capturing the image, obtaining device values ​​for the PLC 2 during inspection of the workpiece W, and inspecting the workpiece W based on the captured image and a trained model. The trained model is stored in the inspection device 10 or the learning device 30. The trained model can also be additionally stored in the file server 40. The inspection device 10 stores various data obtained during the execution of an inspection task in the file server 40 on a task-by-task basis. This allows the inspection device 10 to easily link various inspection-related data. A task unit is a unit that collectively encompasses a series of processes from receiving an instruction to start an inspection to providing feedback on the inspection results. The inspection device 10 also transmits monitor layout information to the terminal device 20 for displaying information related to the inspection task on the terminal device 20. Details of the inspection device 10 will be described later. The inspection device 10 is an example of a display control device according to the present disclosure.

[0015] The terminal device 20 is a terminal device equipped with an input unit and a display unit. The terminal device 20 is used by a user to configure settings related to the inspection tasks of the inspection device 10 and to monitor information related to the execution of the inspection tasks by the inspection device 10. The terminal device 20 also provides a single user interface for configuring the trained model, the PLC 2, the camera 3, the lighting 4, and the like. This reduces the burden on the user when configuring the inspection system 1. The terminal device 20 is, for example, a personal computer or a tablet terminal. Details of the terminal device 20 will be described later.

[0016] The learning device 30 generates a trained model for inspecting the workpiece W by machine learning based on captured image data relating to the image of the workpiece W captured by the camera 3. The trained model is stored in the inspection device 10 or the learning device 30 itself. The learning device 30 also downloads templates, frameworks, libraries, etc. used during machine learning from the cloud system 50. The user operates the terminal device 20 to set which templates, frameworks, libraries, etc. the learning device 30 will use.

[0017] The file server 40 stores various data obtained by the inspection device 10 when the inspection task is executed. The file server 40 stores the trained model generated by the learning device 30.

[0018] The cloud system 50 provides templates, frameworks, libraries, etc. used during machine learning.

[0019] The network configuration of the inspection system 1 will be described with reference to Figure 2. The inspection system 1 includes a factory network FN and an information network IN. The learning device 30 and the inspection device 10 are both connected to both the factory network FN and the information network IN. The PLC 2, camera 3, and lighting 4 installed at the production site P are connected to the factory network FN. The terminal device 20, file server 40, and cloud system 50 are connected to the information network IN.

[0020] Setting of an inspection task by the terminal device 20 and display of information related to the inspection task will be described briefly with reference to FIGS. 3 to 6. FIG.

[0021] The user operates the terminal device 20 to call up the task setting screen shown in Fig. 3. On the task setting screen, one or more processing blocks B1 to B6 (hereinafter collectively referred to as "processing blocks B") can be combined to form one inspection task. In principle, processing blocks B have a chronological relationship, i.e., a flow, such as processing blocks B1 to B5, but there are also processing blocks that do not have a chronological relationship, such as processing block B6.

[0022] Processing block B6 (hereinafter also referred to as "pause block B6"), which is a processing block related to suspension (hereinafter referred to as "pause block"), is a processing block for pausing a running task in response to a user's operation. When an inspection task includes pause block B6, the user can pause the inspection task. Pause block B6 can also be used to resume a task that has already been paused. Note that resuming a task includes not only resuming a task paused by pause block B6, but also resuming a task that has been paused for some reason. How to pause and resume a task will be described later. In this way, processing block B includes a processing block (hereinafter also referred to as "operation block") that executes processing based on a user's operation.

[0023] In principle, each processing block B outputs something. For example, processing blocks B1 and B3, which are processing blocks related to imaging, output data related to captured images. Furthermore, processing blocks B2 and B4, which are processing blocks related to inspection, output data related to inspection results. Processing block B5 related to device value acquisition outputs data related to acquired device values. In addition, a processing block B may process and output data output by another processing block B. For example, there may be a processing block B that performs preprocessing on data related to captured images and outputs the preprocessed image data. This processing block related to preprocessing is provided between the processing block related to imaging and the processing block related to inspection in the flow of the inspection task. In addition to the processing block related to preprocessing, processing blocks related to data calculation, generation of new images, etc. can be provided between the processing block related to imaging and the processing block related to inspection.

[0024] The inspection device 10 stores the data output by each processing block in the file server 40 on an inspection task basis based on the inspection task set by the user. Although not shown in FIG. 3, the user can use the task setting screen to set the storage of only some of the data output by each processing block. For example, the user can set which types of data to store among the data output by each processing block. Alternatively, the user can set the data to be stored individually for each processing block.

[0025] After setting the inspection task, the user can operate the terminal device 20 to call up the monitor screen shown in FIG. 4 . The monitor screen shown in FIG. 4 is displayed based on monitor layout information generated by the inspection device 10. The monitor screen shown in FIG. 4 includes monitor components C1-C4 (hereinafter collectively referred to as “monitor component C”). The monitor component C1 related to front surface inspection corresponds to the front surface inspection process block B2 shown in FIG. 3 , the monitor component C2 related to back surface inspection corresponds to the back surface inspection process block B4 shown in FIG. 3 , the monitor component C3 related to the pause button (hereinafter also referred to as “pause button C3”) corresponds to the pause block B6 shown in FIG. 3 , and the monitor component C4 related to device values ​​corresponds to the device value acquisition process block B5 shown in FIG. 3 . Due to the display item settings described below, the monitor component corresponding to the front surface imaging process block B1 and the monitor component corresponding to the back surface imaging process block B3 are not displayed in FIG. 4 .

[0026] In this way, the layout of the monitor screen is generated by combining monitor components C in order to display information about each processing block B that constitutes the inspection task in accordance with the settings of the inspection task set on the task setting screen. This allows the user to check the status of the inspection on a monitor screen that is suitable for the inspection task that the user has set, making it easy to check the status of the inspection.

[0027] The user can operate the terminal device 20 to set which monitor components to display in the display item setting area R, as shown in FIG. 5. For example, if "Memo" is checked, a monitor component C5 related to memos is added to the monitor screen, as shown in FIG. 6. This "Memo" monitor component C5 is a monitor component into which the user can freely enter text. Unlike the monitor components C1-C4, the "Memo" monitor component C5 is not associated with a processing block B. In this way, monitor components include those that are not associated with a processing block B but are provided for the user's convenience.

[0028] The functional configuration of the inspection device 10 will be described with reference to Fig. 7. The inspection device 10 includes a first communication unit 11, a second communication unit 12, a storage unit 13, a task management unit 14, and a layout management unit 15.

[0029] The first communication unit 11 communicates with each device connected to the factory network FN.

[0030] The second communication unit 12 communicates with each device connected to the information network IN.

[0031] The storage unit 13 stores task setting information indicating the setting contents of the inspection task, correspondence information indicating the correspondence between the processing block B and the monitor component C, and layout setting information regarding the setting of the layout of the monitor screen. The storage unit 13 is an example of a storage means according to the present disclosure.

[0032] The task setting information includes information about the process blocks B that make up the inspection task, information about the flow between the process blocks B that make up the inspection task, and information about data that the user has set as a target for saving. The correspondence information is represented, for example, in the table shown in FIG. 8. The correspondence information makes it possible to identify the monitor component C that corresponds to the process block B indicated in the task setting information. The correspondence information is created in advance, for example, by the manufacturer of the inspection device 10 and stored in the storage unit 13. The layout setting information includes information indicating which monitor component C is to be displayed and where the monitor component C to be displayed is to be displayed. The layout setting information is determined, for example, based on a user's operation in the display item setting area R shown in FIG. 5.

[0033] The task management unit 14 manages the inspection tasks and particularly includes a data acquisition unit 141, a task setting unit 142, a task execution unit 143, and a data storage unit 144.

[0034] The data acquisition unit 141 acquires a device value from the PLC 2 via the first communication unit 11, and acquires captured image data relating to a captured image of the workpiece W from the camera 3 via the first communication unit 11. Note that this data acquisition can be performed as part of the processing of a processing block executed by a task execution unit 143 described below.

[0035] The task setting unit 142 sets an inspection task based on a user's operation via a task setting screen displayed by the terminal device 20. As will be described later, the terminal device 20 transmits information based on the user's operation via the task setting screen to the inspection device 10. The task setting unit 142 acquires this information via the second communication unit 12 and sets an inspection task based on this information. The task setting unit 142 stores task setting information indicating the setting contents of the inspection task in the storage unit 13. The user operates the terminal device 20 to select data to be saved, and the task setting unit 142 sets the data to be saved when setting the inspection task, thereby making it possible to save the data selected by the user on an inspection task basis.

[0036] The task execution unit 143 references the task setting information stored in the storage unit 13, sequentially executes multiple processing blocks B that constitute the inspection task, and retains, for each inspection task, data output by each processing block B that the user has set as data to be saved. The task execution unit 143 also retains the referenced task setting information for each inspection task. When the user operates the terminal device 20 to operate a monitor component C corresponding to an operation block, the task execution unit 143 executes processing of the corresponding operation block. For example, when the operation block is a paused block B6, the task execution unit 143 pauses execution of the inspection task if the inspection task is not paused. Furthermore, when the inspection task is paused, the task execution unit 143 resumes execution of the paused task. The task execution unit 143 is an example of a task execution means according to the present disclosure.

[0037] The data storage unit 144 stores the data that the task execution unit 143 holds for each inspection task in the file server 40 via the second communication unit 12. For example, the data storage unit 144 stores the data when the task execution unit 143 completes execution of the inspection task. As a result, various data related to the inspection are automatically linked and stored for each inspection task. The task execution unit 143 also holds task setting information for each inspection task, and therefore the task setting information is also stored in the file server 40 for each inspection task. Therefore, the user can refer to the various data and task setting information stored for each inspection task in the file server 40 as needed, and reproduce and verify the inspection task.

[0038] The layout management unit 15 manages the layout of the monitor screen displayed on the terminal device 20. The layout management unit 15 includes a layout generation unit 151, a layout transmission unit 152, and an operation acquisition unit 153.

[0039] The layout generation unit 151 references the task setting information, correspondence information, and layout setting information stored in the storage unit 13, and generates monitor layout information for generating a monitor screen, for example, as shown in FIG. 4 . The monitor layout information includes information such as which monitor component C to place and where, and what is to be displayed on each monitor component C. Since most monitor components C display information related to the output of processing block B, the layout generation unit 151 references data stored by the task execution unit 143 for each inspection task as necessary. The monitor layout information is expressed by web content including, for example, an HTML (Hyper Text Markup Language) file, an image file, and the like. The layout generation unit 151 is an example of a layout generation means according to the present disclosure.

[0040] When the user performs an operation related to a change in layout settings, for example, an operation in the display item setting area R shown in Fig. 5, the layout generation unit 151 stores new layout setting information in the storage unit 13 and generates new monitor layout information based on the new layout setting information. The operation related to the change in layout settings is acquired by the operation acquisition unit 153, which will be described later.

[0041] The layout transmission unit 152 transmits the monitor layout information generated by the layout generation unit 151 to the terminal device 20 via the second communication unit 12. For example, as described above, when the monitor layout information is expressed by Web content, the layout transmission unit 152 is realized by implementing a function as a Web server.

[0042] The operation acquisition unit 153 acquires information indicating an operation related to a change in layout settings by the user from the terminal device 20 via the second communication unit 12. For example, when a user operates the display item setting region R shown in FIG. 5 to turn on the "Memo" item, the terminal device 20 transmits information regarding the operation to the inspection device 10, and the operation acquisition unit 153 acquires the information regarding the operation. Based on the information regarding the operation acquired by the operation acquisition unit 153, the layout generation unit 151 stores new layout setting information indicating that the "Memo" monitor component C is to be displayed in the storage unit 13. Then, the layout generation unit 151 generates new monitor layout information including the "Memo" monitor component C.

[0043] The functional configuration of the terminal device 20 will be described with reference to Fig. 9. The terminal device 20 includes a communication unit 21, a display unit 22, an input unit 23, and a control unit 24.

[0044] The communication unit 21 communicates with each device connected to the information network IN.

[0045] The display unit 22 displays a screen under the control of the control unit 24. The display unit 22 is, for example, a liquid crystal display. The display unit 22 may also be a touch screen integrated with the input unit 23 described below. The display unit 22 is an example of a display means according to the present disclosure.

[0046] The input unit 23 receives a user operation and outputs a signal indicating the user operation to the control unit 24. The input unit 23 includes an input device such as a mouse or a keyboard. Alternatively, the input unit 23 may be a touch screen integrated with the display unit 22. The input unit 23 is an example of an input means according to the present disclosure.

[0047] The control unit 24 comprehensively controls the terminal device 20. In particular, the control unit 24 acquires monitor layout information from the inspection device 10 via the communication unit 21 and causes the display unit 22 to display a monitor screen based on the monitor layout information. When a user invokes a task setting screen by operating the input unit 23 and performs a task setting operation, the control unit 24 transmits information indicating the task setting content to the inspection device 10. When a user operates a monitor component C corresponding to an operation block on the monitor screen by operating the input unit 23, the control unit 24 transmits information indicating the operation to the inspection device 10. When a user operates a display item setting operation related to the monitor component C to be displayed on the monitor screen by operating the input unit 23, the control unit 24 transmits information indicating the selected display item to the inspection device 10. The control unit 24 is an example of a display control means according to the present disclosure.

[0048] Furthermore, the control unit 24 causes the display unit 22 to display a setting screen for model generation by the learning device 30, a setting screen for the PLC 2, a setting screen for the camera 3, and a setting screen for the lighting 4 as setting screens that can be operated using the same user interface. The control unit 24 can set the PLC 2, the camera 3, and the lighting 4 via the inspection device 10 or the learning device 30. The control unit 24 sets the learning device 30, the PLC 2, the camera 3, and the lighting 4 based on user operations via the setting screens.

[0049] The control unit 24 functions as, for example, a web browser. The control unit 24 functioning as a web browser communicates with the inspection device 10 or the learning device 30 functioning as a web application server and acquires web content representing various setting screens from the inspection device 10 or the learning device 30. The control unit 24 displays a setting screen based on the acquired web content on the display unit 22. The inspection device 10 or the learning device 30 functioning as a web application server can realize various setting screens that can be operated using the same user interface by, for example, generating web content representing various setting screens using the same web framework. The control unit 24 transmits information representing user operations on the various setting screens to the inspection device 10 or the learning device 30 functioning as the web application server. The inspection device 10 or the learning device 30 that receives the information configures the PLC 2, the camera 3, and the lighting 4 based on the information.

[0050] An example of the hardware configuration of the inspection device 10 and the terminal device 20 will be described with reference to Fig. 10. The inspection device 10 and the terminal device 20 shown in Fig. 10 are realized by a computer such as a personal computer or a microcontroller.

[0051] The inspection device 10 and the terminal device 20 each include a processor 1001 , a memory 1002 , an interface 1003 , and a secondary storage device 1004 , which are connected to each other via a bus 1000 .

[0052] The processor 1001 is, for example, a CPU (Central Processing Unit). The processor 1001 loads an operating program stored in the secondary storage device 1004 into the memory 1002 and executes the program, thereby realizing the functions of the inspection device 10 and the terminal device 20.

[0053] The memory 1002 is a main storage device configured, for example, by a RAM (Random Access Memory). The memory 1002 stores the operating program that the processor 1001 reads from the secondary storage device 1004. The memory 1002 also functions as a working memory when the processor 1001 executes the operating program.

[0054] The interface 1003 is an I / O (Input / Output) interface such as a serial port, a USB (Universal Serial Bus) port, or a network interface.

[0055] The secondary storage device 1004 is, for example, a flash memory, a hard disk drive (HDD), or a solid state drive (SSD). The secondary storage device 1004 stores the operating programs executed by the processor 1001.

[0056] An example of the data storage operation by the inspection device 10 will be described with reference to Fig. 11. The operation shown in Fig. 11 is executed for each inspection task.

[0057] The task execution unit 143 of the task management unit 14 of the inspection device 10 references the task setting information stored in the storage unit 13 and executes the processing of the first processing block of the inspection task (step S101).

[0058] The task execution unit 143 holds the data output by the processing block (step S102). Since the operation shown in Fig. 11 is executed for each inspection task, the data output by the processing block is held for each inspection task.

[0059] The task execution unit 143 determines whether there is an unprocessed processing block (step S103). Note that the unprocessed processing block does not include an operation block that is independent of the flow, such as the paused block B6 shown in FIG. 3.

[0060] If there is an unprocessed processing block (step S103: Yes), the task execution unit 143 executes the processing of the next processing block (step S104) and repeats the operations from step S102.

[0061] If there are no unprocessed processing blocks (step S103: No), the data storage unit 144 of the task management unit 14 stores the data that the task execution unit 143 held in step S102 in the file server 40 (step S105). Then, the task management unit 14 ends the data storage operation.

[0062] An example of the layout generation operation by the inspection device 10 will be described with reference to Fig. 12. The operation shown in Fig. 12 is started, for example, when a user operates the terminal device 20 to call up a monitor screen, and the operation acquisition unit 153 of the layout management unit 15 of the inspection device 10 acquires information about the operation from the terminal device 20.

[0063] The layout generation unit 151 of the layout management unit 15 of the inspection device 10 refers to the task setting information, correspondence information, and layout setting information stored in the storage unit 13 (step S201).

[0064] The layout generating unit 151 refers to the data held by the task executing unit 143 for each inspection task based on the task setting information referred to in step S201 (step S202).

[0065] The layout generation unit 151 generates monitor layout information based on the task setting information, correspondence information, and layout setting information referenced in step S201, and the data held for each inspection task referenced in step S202 (step S203). This generates a layout for a monitor screen including a monitor component C that displays data output by processing block B.

[0066] The layout transmission unit 152 of the layout management unit 15 transmits the monitor layout information generated in step S203 to the terminal device 20 (step S204), and the layout management unit 15 then ends the layout generation operation.

[0067] The above describes the inspection system 1 according to the embodiment. According to the inspection system 1, the data storage unit 144 of the inspection device 10 automatically stores data obtained by executing processing block B of an inspection task on an inspection task basis, making it possible to easily link various data related to the inspection. Furthermore, according to the inspection system 1, the user can set which data to save on an inspection task basis, allowing the user to freely extract and save data.

[0068] Furthermore, according to the inspection system 1, by simply setting an inspection task on the task setting screen, monitor layout information for an appropriate monitor screen is generated in accordance with the setting of the inspection task, allowing the user to easily check the status of the inspection. Furthermore, according to the inspection system 1, monitor layout information for an appropriate monitor screen is generated and display items can be easily set, allowing the user to easily create a monitor screen that suits their preferences. Therefore, the user can easily select and check the process they want to check.

[0069] Furthermore, the inspection system 1 allows the user to reduce the number of monitor components displayed on the monitor screen as needed, thereby improving the processing speed and reducing the communication load.

[0070] Furthermore, according to the inspection system 1, the settings related to learning of the learning device 30, the settings of the PLC 2, the settings of the camera 3, and the settings of the lighting 4 can be set using the same user interface by operating the terminal device 20, thereby reducing the burden on the user when setting up the inspection system 1.

[0071] (Modification) In the embodiment, the inspection system 1 includes both the file server 40 and the cloud system 50. However, the inspection system 1 may include only one of them. For example, the file server 40 may provide templates, frameworks, libraries, etc., or the cloud system 50 may store data for each inspection task.

[0072] In the embodiment, the inspection device 10 and the learning device 30 are separate devices, but they may be combined into a single device. In particular, when machine learning is performed in real time in parallel with inspection, combining them into a single device is likely to be more efficient.

[0073] In the embodiment, the terminal device 20 and the inspection device 10 are separate devices, but the inspection device 10 may have each function of the terminal device 20 and also function as the terminal device 20. In this case, for example, the inspection device 10 functions as both a web application server and a web browser. When a user sets the PLC 2, the camera 3, and the lighting 4 using the inspection device 10, the web application server function generates web content representing a setting screen, and the web browser function acquires the generated web content and displays various setting screens based on the acquired web content.

[0074] In the embodiment, the inspection device 10 includes the layout management unit 15 and the storage unit 13 in which task setting information, correspondence information, and layout setting information are stored, but these may be included in the terminal device 20. In this case, the terminal device 20 generates the monitor layout information. The inspection device 10 or the terminal device 20 that generates the monitor layout information may be referred to as a display control device.

[0075] 10 , the inspection device 10 and the terminal device 20 are equipped with a secondary storage device 1004. However, the present invention is not limited to this, and the secondary storage device 1004 may be provided outside the inspection device 10 and the terminal device 20, and the inspection device 10 and the terminal device 20 may be connected to the secondary storage device 1004 via an interface 1003. In this configuration, removable media such as a USB flash drive or a memory card may also be used as the secondary storage device 1004.

[0076] 10, the inspection device 10 and the terminal device 20 may be configured by a dedicated circuit using an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), etc. In the hardware configuration shown in FIG. 10, some of the functions of the inspection device 10 and the terminal device 20 may be realized by a dedicated circuit connected to the interface 1003, for example.

[0077] The programs used in the inspection device 10 and the terminal device 20 can be stored and distributed on computer-readable recording media such as CD-ROMs (Compact Disc Read Only Memory), DVDs (Digital Versatile Discs), USB flash drives, memory cards, HDDs, etc. By installing such programs on a specific or general-purpose computer, the computer can function as the inspection device 10 and the terminal device 20.

[0078] Furthermore, the above-mentioned program may be stored in a storage device owned by another server on the Internet, and the program may be downloaded from that server.

[0079] The present disclosure allows various embodiments and modifications without departing from the broad spirit and scope of the present disclosure. Furthermore, the above-described embodiments are intended to explain the present disclosure and do not limit the scope of the present disclosure. In other words, the scope of the present disclosure is defined by the claims, not the embodiments. Various modifications made within the scope of the claims and the meaning of equivalent disclosures are considered to be within the scope of the present disclosure.

[0080] 1 Inspection system, 2 PLC, 3 Camera, 4 Lighting, 10 Inspection device, 11 First communication unit, 12 Second communication unit, 13 Memory unit, 14 Task management unit, 15 Layout management unit, 20 Terminal device, 21 Communication unit, 22 Display unit, 23 Input unit, 24 Control unit, 30 Learning device, 40 File server, 50 Cloud system, 141 Data acquisition unit, 142 Task setting unit, 143 Task execution unit, 144 Data storage unit, 151 Layout generation unit, 152 Layout transmission unit, 153 Operation acquisition unit, 1000 Bus, 1001 Processor, 1002 Memory, 1003 Interface, 1004 Secondary storage device, B1-B6 Processing block, C1-C5 Monitor component, FN Factory system network, IN Information system network, P Production site, R Display item setting area, W Work.

Claims

1. A display control device comprising: a storage means for storing task setting information relating to processing blocks that indicate processing contents related to an inspection, correspondence information that indicates the correspondence between the processing blocks and monitor parts, and layout setting information relating to the setting of the layout of a monitor screen using the monitor parts selected by a user as display targets; and a layout generation means for generating monitor layout information for displaying information related to the inspection based on the task setting information, the correspondence information, and the layout setting information.

2. The display control device according to claim 1, wherein the task setting information includes information regarding a plurality of processing blocks that constitute an inspection task, which is a task related to the inspection and includes a plurality of processes related to the inspection, and information regarding the flow between the plurality of processing blocks.

3. The display control device according to claim 2, wherein said layout generating means generates said monitor layout information for displaying information relating to each of said plurality of processing blocks in an arranged manner.

4. A display control device as described in claim 2 or 3, wherein the plurality of processing blocks include a processing block related to imaging of an object to be inspected, a processing block related to inspection of the object to be inspected, and a processing block related to processing executed between the imaging and the inspection.

5. An inspection system comprising: a display control device according to any one of claims 1 to 4; a display means; and a display control means for causing the display means to display a screen based on the monitor layout information generated by the layout generation means of the display control device.

6. The inspection system of claim 5, further comprising an input means for accepting user operation, wherein the layout generation means of the display control device stores new layout setting information based on the user operation via the input means in the storage means, and newly generates the monitor layout information based on the new layout setting information.

7. The inspection system of claim 6, wherein the layout generation means of the display control device generates the monitor layout information further including an interface that allows the user to select which processing block information is to be displayed, and stores in the storage means the new layout setting information based on the user's operation on the interface.

8. The inspection system of claim 5, further comprising an input means for accepting user operation, wherein the display control device further comprises a task execution means for executing the inspection based on the task setting information, wherein the processing block includes an operation block for executing processing based on the user's operation, wherein the correspondence information includes information regarding the correspondence between the operation block and an operation component which is a monitor component corresponding to the operation block, and wherein the task execution means executes processing by the operation block corresponding to the operation component when the operation component is operated by the user's operation via the input means.

9. The inspection system described in claim 8, wherein the operation block includes a pause block that pauses the execution of the inspection and resumes the execution of the paused inspection, the operation component includes a pause button corresponding to the pause block, and the task execution means, when the pause button is pressed by the user's operation via the input means, executes processing by the pause block to pause the execution of the inspection and resumes the execution of the paused inspection.

10. A screen display method, which generates monitor layout information for displaying information relating to the inspection based on task setting information relating to a processing block indicating processing contents relating to the inspection, correspondence information indicating the correspondence between the processing block and a monitor component, and layout setting information relating to the setting of the layout of a monitor screen using the monitor component selected by a user as the display target, and displays a screen based on the monitor layout information on a display means.

11. A program that causes a computer to generate monitor layout information for displaying information relating to the inspection based on task setting information relating to processing blocks that indicate processing contents relating to the inspection, correspondence information that indicates the correspondence between the processing blocks and monitor parts, and layout setting information relating to the setting of the layout of a monitor screen using the monitor parts selected by the user as the display target.

Citation Information

Patent Citations

  • Interactive interface building method and device, electronic equipment and storage medium

    CN115794091A

  • Display method, display device and full-automatic inspection device equipped with display device

    JP2007101351A

  • Inspection support system

    JP2009122035A

  • Information processing device, control method thereof, and program

    JP2015143982A

  • Program creation device and program creation method of image inspection program, and creation program

    JP2019175408A