Image processing device and information processing method

The image processing device accurately evaluates program components by tracking executions, OKs, and NGs, distinguishing between creation/editing and operational phases, thereby improving the assessment of program components within image processing programs.

JP7810051B2Active Publication Date: 2026-02-03OMRON CORP
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2022061561
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-04-01
Publication Date
2026-02-03
Estimated Expiration
2042-04-01

AI Technical Summary

Technical Problem

Existing image processing devices for factory automation lack accurate evaluation methods for program components within image processing programs, as simply counting the number of calls does not provide sufficient insight into their usage and performance.

Method used

An image processing device that includes a counting unit to track the number of executions, OKs, and NGs for each program component, with a switching unit to differentiate between pre-phase and operation phase to ensure accurate evaluation by disabling counting during program creation and enabling it during normal operation.

Benefits of technology

Enables accurate evaluation of program components by distinguishing between program creation/editing phases and operational phases, providing clearer insights into component performance and usage.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007810051000001
    Figure 0007810051000001
  • Figure 0007810051000002
    Figure 0007810051000002
  • Figure 0007810051000003
    Figure 0007810051000003
Patent Text Reader

Abstract

To provide an information processing method that facilitates evaluation of a program component that constitutes an image processing program.SOLUTION: An information processing method comprises a step of counting, for each of a plurality of program components, an execution frequency that image processing according to an image processing program including the program components is performed, a frequency that an object is determined to be good by the image processing, and a frequency that the object is determined to be defective by the image processing. The information processing method further comprises a step of disabling the counting step when it is determined that the image processing system is operating in a preliminary phase, and counting when it is determined that the image processing system is operating in an operation phase.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to an image processing device and an information processing method. [Background technology]

[0002] It is desirable for program developers to proceed with the development of new programs while checking the usage status of programs already distributed to users. International Publication No. 91 / 14223 (Patent Document 1) discloses a device for counting the number of times an application package is called, in order to support developers. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 91 / 14223 Summary of the Invention [Problem to be solved by the invention]

[0004] In the field of factory automation (FA), image processing devices for automatically inspecting objects are becoming widespread. Image processing programs for inspecting objects may include various program components. Therefore, developers of program components that make up image processing programs are expected to understand the usage status of program components that have already been distributed to users. The device disclosed in Patent Document 1 counts the number of times an application package is called. However, the number of times alone cannot adequately evaluate the program components that make up an image processing program.

[0005] The present disclosure has been made in consideration of the above-mentioned problems, and its purpose is to provide an image processing device and an information processing method that make it easy to evaluate program parts that make up an image processing program. [Means for solving the problem]

[0006] According to an example embodiment of the present disclosure, an image processing device includes a library including a plurality of program components and a program execution unit that, in response to an execution instruction, performs image processing on an image of an object according to an image processing program to determine whether the object is good or bad. The image processing program includes a program component specified from the plurality of program components. The image processing device further includes a counting unit and a switching unit. For each of the plurality of program components, the counting unit counts at least two of the following: the number of times image processing is performed according to the image processing program including the program component; the number of times the object is determined to be good by image processing according to the image processing program including the program component; and the number of times the object is determined to be bad by image processing according to the image processing program including the program component. The switching unit switches the operation of the counting unit between enabled and disabled. Based on the status of the image processing device, the switching unit determines whether the image processing device is operating in a pre-phase in which at least one of creating and editing an image processing program is being executed, or an operation phase in which the image processing device is operating according to the image processing program. The switching unit switches the operation of the counting unit to disabled when it determines that the image processing device is operating in the pre-phase, and switches the operation of the counting unit to enabled when it determines that the image processing device is operating in the operation phase.

[0007] According to this disclosure, program components can be more easily evaluated by checking the number of times counted by the counting unit. However, in the pre-phase, when at least one of creating and editing an image processing program is being performed, the image processing program is executed while adjusting the values ​​of parameters that define the operating conditions of the image processing items, resulting in an increased number of NGs. Therefore, if the NGs counted in the pre-phase are included in the statistical information, there is a possibility that the program components cannot be evaluated accurately. However, according to the above disclosure, when it is determined that the image processing device is operating in the pre-phase, the operation of the counting unit is disabled. Therefore, the program components can be evaluated accurately.

[0008] In the above disclosure, the image processing device is communicably connected to a camera. The switching unit determines that the image processing device is operating in the operation phase when an image acquired from the camera in response to an imaging command is to be subjected to image processing. The switching unit determines that the image processing device is operating in the pre-phase when an image stored in the image processing device or a storage device communicably connected to the image processing device is to be subjected to image processing.

[0009] In the operation phase, image processing is performed on images obtained by sequentially capturing images of multiple objects with a camera. On the other hand, in the pre-phase, the image processing program is typically evaluated using the results of image processing on sample images prepared in advance. Therefore, according to this disclosure, it is possible to accurately determine whether the image processing device is operating in the pre-phase or the operation phase.

[0010] In the above disclosure, the image processing device further includes a signal output unit that outputs a signal indicating whether or not the image processing device is capable of operating in cooperation with an external device, and the switching unit determines that the image processing device is operating in the operation phase when the signal indicates that the image processing device is capable of operating in cooperation with the external device, and determines that the image processing device is operating in the pre-operation phase when the signal indicates that the image processing device is not capable of operating in cooperation with the external device.

[0011] In the operation phase, the image processing device and an external device typically operate in cooperation with each other, and a pass / fail judgment of the target object is automatically performed. On the other hand, in the pre-operation phase, it is not desirable for the image processing device to operate automatically in response to instructions from the external device. Therefore, in the pre-operation phase, the image processing device is typically configured not to operate in cooperation with the external device. Therefore, according to this disclosure, it is possible to accurately determine whether the image processing device is operating in the pre-operation phase or the operation phase.

[0012] In the above disclosure, the image processing device further includes a providing unit that provides a user interface screen, and a switching unit that determines that the image processing device is operating in the operation phase when the user interface screen restricts creation and editing of the image processing program, and determines that the image processing device is operating in the preparation phase when the user interface screen does not restrict creation and editing of the image processing program.

[0013] In the operation phase, a user interface screen that restricts creation and editing of image processing programs is provided to prevent unintentional editing of the image processing programs. Therefore, according to this disclosure, it is possible to accurately determine whether the image processing device is operating in the pre-operation phase or the operation phase.

[0014] In the above disclosure, the switching unit determines whether the image processing device is operating in the pre-operation phase or the operation phase, depending on the logged-in user.

[0015] Typically, in the pre-phase, a user who creates and edits an image processing program uses the image processing device, and in the operation phase, a user who checks the quality of the target object uses the image processing device. Thus, typically, the users who use the image processing device are different in the pre-phase and the operation phase. Therefore, according to this disclosure, it is possible to accurately determine whether the image processing device is operating in the pre-phase or the operation phase.

[0016] In the above disclosure, the image processing device further includes a providing unit that provides a user interface screen, and the switching unit determines that the image processing device is operating in the operation phase when an execution instruction is received from an external device without via the user interface screen, and determines that the image processing device is operating in the pre-operation phase when the execution instruction is received via the user interface screen.

[0017] In the operation phase, the image processing device typically operates in cooperation with an external device and receives execution instructions from the external device. Meanwhile, in the pre-operation phase, the image processing device receives execution instructions via a user interface screen. Therefore, according to this disclosure, it is possible to accurately determine whether the image processing device is operating in the pre-operation phase or the operation phase.

[0018] In the above disclosure, the image processing device further includes a providing unit that provides a screen showing the counting result by the counting unit for each of the plurality of program parts.

[0019] According to this disclosure, by referring to the screen provided, the user can save the trouble of searching for program components to incorporate into a new image processing program.

[0020] According to an example embodiment of the present disclosure, an image processing device includes a library including a plurality of program components and an execution unit that, in response to an execution instruction, performs image processing on an image of an object according to an image processing program to determine whether the object is good or bad. The image processing program includes a program component specified from among the plurality of program components. An information processing method for the image processing device includes a first step and a second step. The first step counts, for each of the plurality of program components, at least two of the following: the number of times image processing is performed according to the image processing program including the program component; the number of times the object is determined to be good by image processing according to the image processing program including the program component; and the number of times the object is determined to be bad by image processing according to the image processing program including the program component. The second step switches the first step between enabled and disabled. The second step includes a step of determining, based on the status of the image processing device, whether the image processing device is operating in a pre-phase in which at least one of creating and editing an image processing program is being executed, or an operation phase in which the image processing device is operating according to the image processing program. Furthermore, the second step includes a step of disabling the first step when it is determined that the image processing device is operating in the pre-phase, and a step of enabling the first step when it is determined that the image processing device is operating in the operation phase.

[0021] This disclosure also makes it easier to evaluate program components that make up an image processing program. [Effects of the Invention]

[0022] According to the present disclosure, it becomes easier to evaluate program components that make up an image processing program. [Brief explanation of the drawings]

[0023] [Figure 1] 1 is a diagram showing an example of a scene in which an image processing device according to an embodiment is applied; [Figure 2]1 is a schematic diagram showing the overall configuration of an image processing system including an image processing device according to an embodiment of the present invention. [Figure 3] FIG. 1 is a schematic diagram illustrating a hardware configuration of an image processing device. [Figure 4] FIG. 10 is a diagram illustrating an example of a component package. [Figure 5] FIG. 2 illustrates an example of a functional configuration of an image processing apparatus. [Figure 6] FIG. 10 is a diagram showing a method for creating scene data. [Figure 7] FIG. 10 is a diagram showing a method for creating layout data. [Figure 8] FIG. 10 is a diagram showing an example of a UI screen displayed on a display when an image processing program is executed. [Figure 9] FIG. 10 is a diagram showing another example of a UI screen displayed on the display when the image processing program is executed. [Figure 10] FIG. 10 is a diagram illustrating an example of statistical information generated by a counting unit. [Figure 11] 10 is a flowchart showing the flow of a statistical information accumulation process in the image processing device. [Figure 12] FIG. 10 is a diagram illustrating an example of a method for compressing statistical information in a computer device. DETAILED DESCRIPTION OF THE INVENTION

[0024] The present invention will be described in detail with reference to the accompanying drawings. The same or corresponding parts in the drawings are designated by the same reference numerals, and the description thereof will not be repeated. The following modifications may be combined as appropriate.

[0025] §1 Application Examples An overview of an information processing method of an image processing device according to this embodiment will be described. Fig. 1 is a diagram showing an example of a scene in which an image processing device according to this embodiment is applied. An image processing device 100 is installed, for example, at a production site and inspects an object to be inspected.

[0026] As shown in Fig. 1, image processing device 100 includes library 170 and execution unit 15. Library 170 includes a plurality of program components 180. In response to an execution instruction, execution unit 15 performs image processing on an image of an object to be inspected in accordance with an image processing program, thereby determining whether the object is good or bad. The image processing program includes a program component specified from the plurality of program components 180.

[0027] The information processing method in the image processing device 100 includes the following steps (1) and (2).

[0028] Step (1): For each of the multiple program components 180, count the number of times image processing is executed in accordance with the image processing program including that program component 180, the number of times the inspection object is judged to be good by image processing in accordance with the image processing program including that program component, and the number of times the inspection object is judged to be bad by image processing in accordance with the image processing program including that program component. Hereinafter, the number of times the inspection object is judged to be good by image processing in accordance with the image processing program including that program component will be referred to as the "OK number." The number of times the inspection object is judged to be bad by image processing in accordance with the image processing program including that program component will be referred to as the "NG number." Note that judging the quality of an inspection object by performing image processing in accordance with an image processing program on an image of the inspection object is also referred to as "image measurement." Therefore, the "number of executions" will also be referred to as the "number of measurements."

[0029] Step (2): Switching the above step (1) between enabled and disabled. Step (2) includes the following steps (2a) to (2c).

[0030] Step (2a): Based on the status of the image processing device 100, it is determined whether the image processing device 100 is operating in a pre-phase in which at least one of creating and editing an image processing program is being performed, or in an operational phase in which the image processing device 100 is operating according to the image processing program.

[0031] Step (2b): When it is determined that the image processing device 100 is operating in the preliminary phase, step (1) is disabled.

[0032] Step (2c): If it is determined that the image processing device 100 is operating in the operation phase, step (1) is switched to valid.

[0033] According to the information processing method of the present embodiment, the number of executions, the number of OKs, and the number of NGs are counted for each of a plurality of program segments. By checking statistical information indicating the number of executions, the number of OKs, and the number of NGs, it becomes easier to evaluate the program segments. For example, by checking the number of executions, it is possible to evaluate the frequency of use of the program segments.

[0034] As described above, the execution unit 15 judges whether an object to be inspected is good or bad by performing image processing on the image in accordance with the image processing program. Depending on the content of the image processing, the object to be inspected may be judged to be defective even though there is no abnormality in the object to be inspected. Therefore, for example, if the number of NGs is higher than expected, it is possible that an incorrect judgment is being made due to a program component. Therefore, by checking the number of NGs, the quality of the program component itself can be evaluated.

[0035] Note that one of the execution count, the OK count, and the NG count is calculated from the remaining two. For example, the execution count is the sum of the OK count and the NG count. The NG count is obtained by subtracting the OK count from the execution count. The OK count is obtained by subtracting the NG count from the execution count. Therefore, in step (1), only two of the execution count, the OK count, and the NG count may be counted.

[0036] By checking the statistical information indicating the number of execution times, the number of OK times, and the number of NG times in this way, it becomes easier to evaluate program components. However, in the pre-phase where at least one of the creation and editing of the image processing program is being executed, the image processing program is executed while adjusting the values of the parameters that define the operating conditions of the image processing items, so the number of NG times increases. Therefore, if the number of NG times counted in the pre-phase is included in the statistical information, there is a possibility that the program components cannot be accurately evaluated. According to the above steps (2a) to (2c), when it is determined that the image processing apparatus 100 is operating in the pre-phase, the counting of the number of execution times, the number of OK times, and the number of NG times is switched to invalid. Therefore, by checking the statistical information, the program components can be accurately evaluated.

[0037] §2 Specific Example <A. Overall Configuration of Image Processing System> FIG. 2 is a schematic diagram showing the overall configuration of an image processing system including the image processing apparatus according to the present embodiment. As shown in FIG. 2, the image processing system 1 includes, as main components, an image processing apparatus 100 also referred to as a vision sensor, a camera 8 connected to the image processing apparatus 100, and a PLC (Programmable Logic Controller) 5 capable of communicating with the image processing apparatus 100.

[0038] The image processing apparatus 100 is incorporated in a production site and executes image processing such as inspection for defects and dirt on the inspection object W, measurement of the size and arrangement orientation of the inspection object W, and recognition of characters and figures on the surface of the inspection object W. That is, the image processing apparatus 100 executes image processing on the image generated by imaging the inspection object W. The inspection object W is conveyed by a conveyance mechanism 6 such as a belt conveyor and sequentially imaged by the camera 8. The PLC 5 executes control of the conveyance mechanism 6 and the like in cooperation with the image processing apparatus 100.

[0039] The camera 8, as an example, includes an imaging device divided into a plurality of pixels, such as a CCD (Coupled Charged Device) or a CMOS (Complementary Metal Oxide Semiconductor) sensor, in addition to an optical system such as a lens. Image data (hereinafter referred to as "camera image") acquired by imaging with the camera 8 is transmitted to the image processing device 100. Then, the image processing device 100 performs image processing on the camera image captured by the camera 8. The image processing system 1 may further include an illumination device that irradiates light onto the inspection object W imaged by the camera 8.

[0040] When inspecting inspection objects W of multiple varieties, the image processing device 100 changes the image processing program for each variety. Therefore, the user sets the image processing program for each variety.

[0041] <B. Hardware Configuration of Image Processing Device> FIG. 3 is a schematic diagram showing the hardware configuration of the image processing device. As shown in FIG. 3, the image processing device 100 typically has a structure following a general-purpose computer architecture, and the processor executes a pre-installed program to realize various processes as described below.

[0042] More specifically, the image processing device 100 includes a processor 110 such as a CPU (Central Processing Unit) or a MPU (Micro-Processing Unit), a RAM (Random Access Memory) 112, a display controller 114, a system controller 116, an I / O (Input Output) controller 118, a hard disk 120, a camera interface 122, an input interface 124, a PLC interface 126, a communication interface 128, and a memory card interface 130. These components are connected to each other so as to be able to communicate data with each other around the system controller 116.

[0043] The processor 110 exchanges programs (codes) with the system controller 116 and executes them in a predetermined order to achieve the desired arithmetic processing.

[0044] The system controller 116 is connected to the processor 110, RAM 112, display controller 114, and I / O controller 118 via buses, and controls the overall processing of the image processing device 100 while exchanging data with each of these components.

[0045] RAM 112 is typically a volatile storage device such as a dynamic random access memory (DRAM), and stores programs read from hard disk 120, camera images acquired by camera 8, measurement results for the images, and the like.

[0046] The display controller 114 is connected to the display 200, and outputs signals for displaying various types of information to the display 200 in accordance with internal commands from the system controller 116. Examples of the display 200 include a liquid crystal display, an organic EL (Electro Luminescence) display, and an organic EL.

[0047] The I / O controller 118 controls data exchange with recording media and external devices connected to the image processing device 100. More specifically, the I / O controller 118 is connected to a hard disk 120, a camera interface 122, an input interface 124, a PLC interface 126, a communication interface 128, and a memory card interface 130.

[0048] The hard disk 120 is typically a non-volatile magnetic storage device, and stores one or more image processing programs 160 in addition to the control program 150 executed by the processor 110. The hard disk 120 also stores a library 170. The control program 150 installed on the hard disk 120 is distributed in a state stored on a memory card 106 or the like. Images are also stored on the hard disk 120. Instead of the hard disk 120, a semiconductor storage device such as a flash memory or an optical storage device such as a DVD-RAM (Digital Versatile Disk Random Access Memory) may be used.

[0049] The library 170 includes one or more component packages 172. Each component package 172 includes a plurality of program components 180. The component packages 172 are created by program component developers and distributed to the image processing apparatus 100.

[0050] FIG. 4 is a diagram showing an example of a component package. As shown in FIG. 4, the component package 172 includes, as program components 180, one or more scene components 182 (182_1, 182_2, ...) and one or more layout components 184 (184_1, 184_2, ...). Each of the one or more scene components 182 indicates one or more image processing items and their execution order. Each of the one or more layout components 184 indicates the configuration of a screen displayed on the display 200 when the image processing program is being executed. Note that the component package 172 may include program components 180 other than the scene components 182 and layout components 184. For example, the component package 172 may include a dialog component that indicates a dialog box that is displayed while the image processing program 160 is being executed.

[0051] Furthermore, the component package 172 includes statistical information 190 that indicates the count results of the number of executions, the number of OKs, and the number of NGs for each program component 180 included in the component package 172. The statistical information 190 is created at regular intervals after the component package 172 is installed in the image processing device 100.

[0052] Returning to FIG. 3 , camera interface 122 accepts a camera image generated by capturing an image of inspection object W. Camera interface 122 mediates data transmission between processor 110 and camera 8. More specifically, camera interface 122 can be connected to one or more cameras 8, and an image capture instruction is output from processor 110 to camera 8 via camera interface 122. In response to this, camera 8 captures an image of the subject and outputs the generated camera image to processor 110 via camera interface 122.

[0053] The input interface 124 mediates data transmission between the processor 110 and input devices such as the keyboard 300, a mouse, a touch panel, a dedicated console, etc. In other words, the input interface 124 accepts operation commands given by the user operating the input device.

[0054] The PLC interface 126 mediates data transmission between the processor 110 and the PLC 5. More specifically, the PLC interface 126 transmits signals controlled by the PLC 5 to the processor 110.

[0055] The communication interface 128 mediates data transmission between the processor 110 and another personal computer or server device (not shown). The communication interface 128 is typically implemented by Ethernet (registered trademark), USB (Universal Serial Bus), or the like. As will be described later, instead of installing a program stored in the memory card 106 into the image processing device 100, a program downloaded from a distribution server or the like via the communication interface 128 may be installed into the image processing device 100.

[0056] The memory card interface 130 mediates data transmission between the processor 110 and the memory card 106, which is a recording medium. That is, the memory card 106 is distributed in a state in which a control program 150 to be executed by the image processing device 100 and the like are stored therein. The memory card interface 130 reads the control program 150 from the memory card 106. Alternatively, the memory card 106 is connected to the image processing device 100 in a state in which a newly developed component package 172 is stored therein. The memory card interface 130 reads the component package 172 from the memory card 106 and includes the read component package 172 in the library 170.

[0057] The memory card 106 may be a general-purpose semiconductor storage device such as an SD (Secure Digital) memory card, a magnetic recording medium such as a flexible disk, or an optical recording medium such as a CD-ROM (Compact Disk Read Only Memory).

[0058] When using a computer having a structure according to a general-purpose computer architecture as described above, in addition to an application for providing the functions according to the present embodiment, an OS (Operating System) for providing basic functions of the computer may be installed. In this case, the program according to the present embodiment may execute processing by calling necessary modules among program modules provided as a part of the OS in a predetermined order and / or timing. That is, the program according to the present embodiment itself does not include the above-described modules, and processing may be executed in cooperation with the OS.

[0059] Furthermore, the control program 150 according to the present embodiment may be provided by being incorporated into a part of another program. Also in that case, the program itself does not include modules included in the other program to be combined as described above, and processing is executed in cooperation with the other program. That is, the control program 150 according to the present embodiment may be in a form incorporated into such another program.

[0060] Alternatively, part or all of the functions provided by the execution of the control program 150 may be implemented as a dedicated hardware circuit.

[0061] <C. Functional Configuration of Image Processing Apparatus> FIG. 5 is a diagram illustrating an example of the functional configuration of an image processing device. As shown in FIG. 5, the image processing device 100 includes a storage unit 10, an authentication unit 11, a signal output unit 12, a providing unit 13, a program creation unit 14, an execution unit 15, a counting unit 16, and a switching unit 17. The storage unit 10 is implemented by a hard disk 120 and a RAM 112. The authentication unit 11 and the program creation unit 14 are implemented by an input interface 124, a display controller 114, and a processor 110 that executes a control program 150. The signal output unit 12 is implemented by a PLC interface 126, a communication interface 128, and the processor 110 that executes the control program 150. The providing unit 13 is implemented by the input interface 124, the display controller 114, and the processor 110 that executes the control program 150 or the image processing program 160. The execution unit 15 is implemented by the processor 110 executing the image processing program 160. The counting unit 16 and the switching unit 17 are realized by the processor 110 executing the control program 150 .

[0062] The storage unit 10 stores a plurality of program parts 180, one or more pieces of statistical information 190, one or more image processing programs 160, and one or more image files 165. The one or more pieces of statistical information 190 are created by the counting unit 16 and stored in the storage unit 10. The one or more image processing programs 160 are created by the program creation unit 14 and stored in the storage unit 10. Each of the one or more image files 165 is a sample image prepared in advance for creating and editing the image processing program 160, or an image previously acquired from the camera 8.

[0063] The authentication unit 11 authenticates a user who uses the image processing device 100. Specifically, the authentication unit 11 authenticates the user by comparing information entered into a login screen displayed on the display 200 with a user ID and password registered in advance for each user. If the authentication unit 11 is successful in authenticating the user, it accepts user input to the image processing device 100.

[0064] Note that authentication unit 11 may disable the operation of program creation unit 14 depending on the user who has been successfully authenticated. As will be described later, program creation unit 14 creates and edits an image processing program. By disabling the operation of program creation unit 14 depending on the authority of the user who has been successfully authenticated, it is possible to prevent the image processing program 160 from being unintentionally edited.

[0065] The signal output unit 12 outputs a signal (hereinafter referred to as a "linkage possibility signal") indicating whether or not linkage with an external device (including PLC 5) is possible. When the linkage possibility signal is in an ON state, the image processing device 100 operates in linkage with the external device. That is, the image processing device 100 operates in response to a signal from, for example, PLC 5. When the linkage possibility signal is in an OFF state, the image processing device 100 does not operate in linkage with the external device. That is, the image processing device 100 does not accept a signal from, for example, PLC 5. The signal output unit 12 switches the state of the linkage possibility signal in response to a user input.

[0066] The providing unit 13 provides a user interface screen (hereinafter referred to as a "UI screen") according to the operations of the authentication unit 11, the program creation unit 14, and the execution unit 15. Specifically, the providing unit 13 causes the display 200 to display the UI screen.

[0067] The program creation unit 14 creates and edits the image processing program 160 in accordance with user input. The program creation unit 14 stores the created image processing program 160 in the storage unit 10.

[0068] The image processing program 160 includes scene data that defines one or more image processing items and the order in which they are executed, and layout data that defines the configuration of a screen that is displayed on the display 200 when image processing is executed according to the scene data. The image processing program 160 may further include dialog data that defines a dialog that is displayed on the display 200.

[0069] 6 is a diagram showing a method for creating scene data. The program creation unit 14 creates new scene data in accordance with user input on the UI screen 20. As shown in FIG. 6, the UI screen 20 includes an input field 21, a plurality of radio buttons, a selection field 23, and a button 24.

[0070] The input field 21 is used to input an identification number that identifies new scene data. The multiple radio buttons are used to select a method for creating new scene data. The multiple radio buttons include radio buttons 22a to 22d. Radio button 22a is selected when creating new scene data by arbitrarily selecting one or more image processing items and their execution order. Radio button 22b is selected when creating new scene data using scene components 182 included in the library 170. Radio button 22c is selected when creating new scene data from a file stored in a storage device. Radio button 22d is selected when creating new scene data by copying existing scene data. In the example shown in Figure 6, radio button 22b is selected. The selection field 23 is used to select the scene components 182 to use when radio button 22b is selected.

[0071] The providing unit 13 provides the next UI screen according to the radio button that was selected when the button 24 was operated. For example, when the button 24 is operated while the radio button 22b is selected, the providing unit 13 displays on the display 200 a UI screen 25 that shows one or more image processing items defined by the scene part 182 selected in the selection field 23 and the order in which they are executed.

[0072] The program creation unit 14 creates new scene data in response to operations on the UI screen 25. For example, the program creation unit 14 receives inputs on the UI screen 25, such as adding an image processing item, deleting an image processing item, changing the execution order, and setting parameters for each image processing item, and creates new scene data in accordance with the received inputs. That is, the scene data indicates one or more image processing items, the execution order of the one or more image processing items, and setting values ​​of various parameters that define the operating conditions of each of the one or more image processing items.

[0073] Furthermore, the program creation unit 14 creates layout data that defines the configuration of the screen to be displayed on the display 200 when image processing is performed in accordance with the new scene data.

[0074] Fig. 7 is a diagram showing a method for creating layout data. Fig. 7 shows a method for creating layout data using layout components 184 included in the library 170. The program creation unit 14 creates layout data using selected layout components 184 in response to an operation on a UI screen 40 showing a list of layout components 184 in the library 170.

[0075] In response to an execution instruction, the execution unit 15 performs image processing on an image of the inspection object W in accordance with the image processing program 160, thereby determining whether the inspection object W is acceptable or not. The execution unit 15 accepts a selection of the image processing program 160 to be executed, and executes the selected image processing program 160. The execution unit 15 can operate in both the pre-phase and the operation phase. For example, in the pre-phase, the execution unit 15 executes the image processing program 160 to evaluate the validity of the determination result of the image processing program 160 being edited.

[0076] Fig. 8 is a diagram showing an example of a UI screen displayed on the display when the image processing program is executed. Fig. 9 is a diagram showing another example of a UI screen displayed on the display when the image processing program is executed. The UI screen 30 shown in Figs. 8 and 9 is provided by the providing unit 13. As shown in Figs. 8 and 9, the UI screen 30 includes areas 31 and 34, tabs 32 and 33, and display columns 35 and 36.

[0077] An image of the object is displayed in area 31. Furthermore, area 31 may display measurement results obtained by executing image processing items defined by image processing program 160. For example, in the case of the image processing item "search" which searches for a characteristic part in an image, a frame indicating the position of the searched characteristic part is displayed.

[0078] Tabs 32 and 33 are used to select an image to be subjected to image processing. Tab 32 is operated when selecting a file image stored in the storage unit 10 or an external storage device. FIG. 8 shows the UI screen 30 when tab 32 is operated. As shown in FIG. 8, the UI screen 30 includes a button 32a for selecting a file image and a button 32b for issuing an instruction to start execution of the image processing program 160 on the selected file image. When button 32b is operated, the execution unit 15 reads out the selected file image and starts execution of the image processing program 160 on the read file image. Note that the execution unit 15 may receive a signal indicating an execution instruction from an external device (e.g., PLC 5), and may consider that button 32b has been operated in response to the reception of the signal.

[0079] Tab 33 is operated when selecting a camera image. FIG. 9 shows UI screen 30 when tab 33 is operated. As shown in FIG. 9, UI screen 30 includes button 33a for issuing an instruction to acquire a camera image and to start execution of image processing program 160 on the acquired camera image. When button 33a is operated, execution unit 15 acquires the camera image from camera 8 by outputting an image capture instruction to camera 8, and starts execution of image processing program 160 on the acquired camera image. Note that execution unit 15 may receive a signal indicating an execution instruction from an external device (e.g., PLC 5), and may consider button 33a to have been operated in response to receiving the signal.

[0080] Area 34 displays one or more image processing items defined by scene data included in image processing program 160 to be executed, along with the execution order. UI screen 30 accepts the selection of one image processing item in area 34. The selected image processing item is displayed in a different display format from the remaining image processing items. In the example shown in FIGS. 8 and 9, the selected image processing item "Image Input" is highlighted.

[0081] The execution unit 15 executes one or more image processing items displayed in the area 34 in the execution order. The execution unit 15 determines whether the processing result for each image processing item satisfies a predetermined condition. For example, if the condition "image was acquired" is the predetermined image processing item "image input," the execution unit 15 determines that the condition is satisfied if an image (camera image or file image) was acquired. Also, if the condition "the position of the searched characteristic part is within a specified range" is the predetermined image processing item "search," the execution unit 15 determines that the condition is satisfied if the position of the searched characteristic part is within a specified range.

[0082] Furthermore, the execution unit 15 determines whether the object to be inspected is good or bad in accordance with the determination results for all image processing items displayed in the area 34. For example, the execution unit 15 determines that the object to be inspected is good in accordance with the determination that the processing results for all of the one or more image processing items displayed in the area 34 satisfy predetermined conditions. The execution unit 15 determines that the object to be inspected is bad in accordance with the determination that the processing results for any of the one or more image processing items displayed in the area 34 do not satisfy predetermined conditions.

[0083] Display field 35 shows the result of a determination as to whether the processing result for the image processing item selected in area 34 satisfies the predetermined conditions. When "OK" is displayed in display field 35, it indicates that the processing result satisfies the predetermined conditions. When "NG" is displayed in display field 35, it indicates that the processing result does not satisfy the predetermined conditions.

[0084] The result of the judgment of whether the object to be inspected is good or bad is displayed in display field 36. When "OK" is displayed in display field 36, it indicates that the object to be inspected is good. When "NG" is displayed in display field 36, it indicates that the object to be inspected is bad.

[0085] The counting unit 16 shown in FIG. 5 counts the number of executions, the number of OKs, and the number of NGs for each of the multiple program segments 180. As described above, the number of executions is the number of times image processing is executed in accordance with the image processing program 160 including the corresponding program segment 180. The number of OKs is the number of times an inspection object is judged to be good by image processing in accordance with the image processing program 160 including the corresponding program segment 180. The number of NGs is the number of times an inspection object is judged to be bad by image processing in accordance with the image processing program 160 including the corresponding program segment 180. The counting unit 16 counts the number of executions, the number of OKs, and the number of NGs over a certain period (e.g., one day) and generates statistical information 190 indicating the counting results. The counting unit 16 stores the generated statistical information 190 in the storage unit 10.

[0086] FIG. 10 is a diagram illustrating an example of statistical information generated by the counting unit. FIG. 10 shows statistical information 190 corresponding to the period "2022 / 2 / 1 8:30-18:00." The statistical information 190 is provided with date and time information indicating the corresponding period. As shown in FIG. 10, the statistical information 190 includes records 190a corresponding to each of a plurality of program components. Each record 190a associates component identification information that identifies the corresponding program component with the counted number of executions, the number of OKs, and the number of NGs.

[0087] 5 switches the operation of the counting unit 16 between enabled and disabled. Based on the status of the image processing device 100, the switching unit 17 determines whether the image processing device 100 is operating in a pre-phase in which at least one of creating and editing the image processing program 160 is being executed, or in an operation phase in which the image processing device 100 is operating in accordance with the image processing program 160. When the switching unit 17 determines that the image processing device 100 is operating in the pre-phase, it switches the operation of the counting unit 16 to disabled, and when the switching unit 17 determines that the image processing device 100 is operating in the operation phase, it switches the operation of the counting unit 16 to enabled.

[0088] The switching unit 17 determines whether the image processing device 100 is operating in the preparatory phase or the operational phase, according to one of the following first to fifth methods.

[0089] (First method) The image processing device 100 is installed in a production site and performs image processing on an image generated by capturing an image of an inspection object W. In the operation phase, as shown in FIG. 2, for example, image processing is performed on a camera image obtained by a camera 8 capturing an image of the inspection object W transported by a transport mechanism 6. On the other hand, in the pre-phase, image processing is often performed on the same file image for creating and editing an image processing program 160. Therefore, the switching unit 17 determines that the image processing device 100 is operating in the operation phase when a camera image acquired from the camera 8 in response to an imaging command is to be subjected to image processing. On the other hand, the switching unit 17 determines that the image processing device 100 is operating in the pre-phase when a file image stored in the image processing device 100 or a storage device communicably connected to the image processing device 100 is to be subjected to image processing.

[0090] Specifically, the switching unit 17 determines that the image processing device 100 is operating in the pre-phase when the button 32b in Fig. 8 is operated or when it is determined that the button 32b has been operated in response to receipt of a signal from an external device (e.g., PLC 5). The switching unit 17 determines that the image processing device 100 is operating in the operation phase when the button 33a in Fig. 9 is operated or when it is determined that the button 33a has been operated in response to receipt of a signal from an external device (e.g., PLC 5).

[0091] (Second method) In the operation phase, the image processing device 100 normally executes the image processing program 160 in response to a signal from an external device (such as the PLC 5). On the other hand, in the pre-phase, the image processing program 160 is being created and edited, so it is not desirable for the image processing device 100 to operate in response to a signal from an external device (such as the PLC 5). Therefore, in the operation phase, the linkage possibility signal is switched to the ON state, and in the pre-phase, the linkage possibility signal is switched to the OFF state.

[0092] Therefore, the switching unit 17 monitors the state of the linkage possibility signal. When the linkage possibility signal is in an ON state (i.e., when the linkage possibility signal indicates that the image processing device 100 can operate in linkage with an external device), the switching unit 17 determines that the image processing device 100 is operating in the operation phase. On the other hand, when the linkage possibility signal is in an OFF state (i.e., when the linkage possibility signal indicates that the image processing device 100 cannot operate in linkage with an external device), the switching unit 17 determines that the image processing device 100 is operating in the pre-phase.

[0093] (Third Method) In the operation phase, if the image processing program 160 is unintentionally edited due to an erroneous operation by an operator, the quality of the inspection target W may be erroneously determined. Therefore, in the operation phase, the providing unit 13 may provide a UI screen that restricts the creation and editing of the image processing program 160. On the other hand, in the pre-operation phase, the providing unit 13 provides a UI screen that does not restrict the creation and editing of the image processing program 160.

[0094] If the providing unit 13 is capable of providing a UI screen that restricts the creation and editing of the image processing program 160, the switching unit 17 determines, based on the UI screen, whether the image processing device 100 is operating in the pre-phase or the operation phase.

[0095] Specifically, the switching unit 17 stores in advance a table that associates each of a plurality of UI screens that can be provided by the providing unit 13 with restriction information indicating whether or not creation and editing of the image processing program 160 are restricted. Using the table, the switching unit 17 determines that the image processing device 100 is operating in the operation phase when the provided UI screen restricts creation and editing of the image processing program 160. On the other hand, the switching unit 17 determines that the image processing device 100 is operating in the pre-operation phase when the provided UI screen does not restrict creation and editing of the image processing program 160.

[0096] (Fourth Method) As described above, the authentication unit 11 may disable the operation of the program creation unit 14 depending on the user who has been successfully authenticated. Disabling the operation of the program creation unit 14 can prevent the image processing program 160 from being unintentionally edited. Therefore, a user account that disables the operation of the program creation unit 14 is assigned to a user who uses the image processing device 100 in the operation phase. In this case, the switching unit 17 determines whether the image processing device 100 is operating in the pre-phase or the operation phase depending on the logged-in user.

[0097] Specifically, the switching unit 17 stores in advance a table that associates user accounts with restriction information indicating whether the operation of the program creation unit 14 is disabled. Using the table, the switching unit 17 determines that the image processing device 100 is operating in the operation phase when the restriction information corresponding to the currently logged-in user account indicates that the operation of the program creation unit 14 is "disabled." On the other hand, the switching unit 17 determines that the image processing device 100 is operating in the pre-phase when the restriction information corresponding to the currently logged-in user account indicates that the operation of the program creation unit 14 is "not" disabled.

[0098] (5th method) In the operation phase, the image processing device 100 normally executes the image processing program 160 in response to a signal from an external device (such as the PLC 5). On the other hand, in the pre-operation phase, the image processing program 160 is created and edited by a user, and therefore the image processing program 160 is normally executed in response to an operation on the UI screen. Therefore, the switching unit 17 determines whether the image processing device 100 is operating in the pre-operation phase or the operation phase, depending on the method of accepting an execution instruction.

[0099] Specifically, when the switching unit 17 receives an execution instruction of the image processing program 160 from an external device without going through the UI screen, it determines that the image processing apparatus 100 is operating in the operation phase. On the other hand, when the switching unit 17 receives an execution instruction of the image processing program 160 through the UI screen, it determines that the image processing apparatus 100 is operating in the pre-phase.

[0100] <D. Flow of Processing of Image Processing Apparatus> FIG. 11 is a flowchart showing the flow of the accumulation process of statistical information in the image processing apparatus. First, the processor 110 determines whether the image processing apparatus 100 is operating in the pre-phase or the operation phase based on the state of the image processing apparatus 100 (step S1). Specifically, the processor 110 executes step S1 according to any one of the above first to fifth methods.

[0101] When the image processing apparatus 100 is operating in the pre-phase, the processor 110 invalidates the counting operations of the execution times, OK times, and NG times for each of the plurality of program components 180 (step S2).

[0102] On the other hand, when the image processing apparatus 100 is operating in the operation phase, the processor 110 enables the counting operations of the execution times, OK times, and NG times for each of the plurality of program components 180, and counts these times (step S3). Then, the processor 110 generates statistical information 190 indicating the count results (step S4). The generated statistical information 190 is stored in the hard disk 120. Note that the processor 110 may generate statistical information 190 regarding the program components included in the component package 172 for each component package 172, and store the generated statistical information 190 in the component package 172. After step S4, the accumulation process of the statistical information ends.

[0103] <E. Example of Use of Statistical Information > A method for using the statistical information 190 accumulated in the image processing device 100 will be described. The providing unit 13 may provide a screen showing the counting results by the counting unit 16. For example, the providing unit 13 displays on the display 200 a UI screen showing the transition of the number of executions, the number of OKs, and the number of NGs for each program part indicated by the statistical information 190.

[0104] This allows the user to save time and effort in searching for program components to be incorporated into the new image processing program 160 by referring to the UI screen.

[0105] Furthermore, at a production site, multiple image processing devices 100 may be installed to perform the same measurement. In this case, the same image processing program 160 is executed in the multiple image processing devices 100. However, due to an erroneous operation by a user, for example, the parameter values ​​defining the operating conditions of an image processing item may be set differently in one of the multiple image processing devices 100 from those in the remaining image processing devices 100. In such a case, the rate at which the inspection target W is determined to be defective differs between the image processing device 100 in which the erroneous value is set and the remaining image processing devices 100. Therefore, the user can identify the image processing device 100 in which the erroneous value is set by comparing the trends in the number of executions, the number of OKs, and the number of NGs among the multiple image processing devices 100.

[0106] Furthermore, a program component developer may collect statistical information 190 from the image processing device 100 and use the statistical information 190 as a reference when developing new program components. At production sites, the image processing device 100 is not usually connected to a public network. Therefore, the program component developer collects statistical information 190 from multiple image processing devices 100 into his / her own computer, for example, during maintenance. A large amount of statistical information 190 is collected in the computer. Therefore, it is preferable that the computer compress the statistical information 190.

[0107] 12 is a diagram showing an example of a method for compressing statistical information in a computer device. As shown in FIG. 12, statistical information 190 is collected from multiple image processing devices 100 to a computer device 400. As described above, date and time information is attached to the statistical information 190. Furthermore, when copying the statistical information 190 from an image processing device 100, the computer device 400 attaches a serial number that identifies the image processing device 100 to the statistical information 190. Therefore, by checking the date and time information and serial number attached to the statistical information 190, it is possible to determine which image processing device 100 generated the statistical information 190 and when.

[0108] The computer device 400 compresses the statistical information 190 for each image processing device 100 based on the serial number. For example, assume that the date and time indicated by the date and time information <Date and Time 1> is earlier than the date and time indicated by the date and time information <Date and Time 3>. In this case, the computer device 400 combines the statistical information 190_1 with the date and time information <Date and Time 1> and the statistical information 190_2 with the date and time information <Date and Time 3> to generate compressed statistical information 191 with the date and time information <Date and Time 3>. Then, the computer device 400 deletes the statistical information 190_1 with the date and time information <Date and Time 1> and the statistical information 190_2 with the date and time information <Date and Time 3> before they were combined.

[0109] At the next timing of maintenance or the like, statistical information 190_1 with date and time information <Date and Time 1> may be collected by the computer device 400 from the same image processing device 100. In this case, the computer device 400 may delete the statistical information 190_1 with date and time information <Date and Time 1> that indicates a date and time earlier than the date and time information <Date and Time 3> that is attached to the compressed statistical information 191. Then, the computer device 400 may leave the statistical information 190_3 with date and time information <Date and Time 4> that indicates a date and time later than the date and time information <Date and Time 3> that is attached to the compressed statistical information 191.

[0110] The statistical information 190 collected in this way by the computer device 400 is used to develop new component packages 172. For example, the developer may avoid including program components that are executed infrequently in the new component package 172. The developer may also consider improving scene components 182 that have a high number of NGs. Furthermore, the developer may analyze trends in program components that are easy to use based on the number of executions of each program component.

[0111] The number of executions indicated by the statistical information 190 may also be used for pay-per-use billing of the program part 180 .

[0112] §3 Supplementary Note As described above, the present embodiment includes the following disclosures.

[0113] (Configuration 1) An image processing device (100), a library (170) containing a plurality of program parts (180); a program execution unit (15, 110) that, in response to an execution instruction, performs image processing on an image containing an object (W) according to an image processing program (160) to determine whether the object (W) is good or bad; the image processing program (160) includes a program part designated from among the plurality of program parts (180); The image processing device (100) further a counting unit (16, 110) that counts, for each of the plurality of program parts (180), at least two of the number of times image processing is executed according to the image processing program (160) including that program part, the number of times the object (W) is judged to be good by the image processing according to the image processing program (160) including that program part, and the number of times the object (W) is judged to be bad by the image processing according to the image processing program (160) including that program part; a switching unit (17, 110) that switches the operation of the counting unit (16, 110) between enabled and disabled, The switching unit (17, 110) determining whether the image processing device (100) is operating in a pre-phase in which at least one of creating and editing the image processing program (160) is being executed, or in an operation phase in which the image processing device (100) is operating according to the image processing program (160), based on the status of the image processing device (100); An image processing device that disables the operation of the counting unit (16, 110) when it determines that the image processing device (100) is operating in the pre-phase, and enables the operation of the counting unit (16, 110) when it determines that the image processing device (100) is operating in the operation phase.

[0114] (Configuration 2) The image processing device (100) is communicably connected to a camera (8), The switching unit (17, 110) When an image acquired from the camera (8) in response to an imaging command is to be subjected to the image processing, the image processing device (100) determines that it is operating in the operation phase; The image processing device (100) according to configuration 1, wherein when an image stored in the image processing device (100) or a storage device communicatively connected to the image processing device (100) is to be subjected to the image processing, the image processing device (100) is determined to be operating in the pre-phase.

[0115] (Configuration 3) A signal output unit (12, 126) for outputting a signal indicating whether or not the device is operable in cooperation with an external device, The switching unit (17, 110) determining that the image processing device (100) is operating in the operational phase when the signal indicates that the image processing device (100) is capable of operating in cooperation with the external device (5); The image processing device (100) of configuration 1, wherein the image processing device (100) determines that it is operating in the pre-phase if the signal indicates that it is not capable of operating in conjunction with the external device (5).

[0116] (Configuration 4) Further provided is a providing unit (13, 110) for providing a user interface screen; The switching unit (17, 110) determining that the image processing device (100) is operating in the operational phase when the user interface screen restricts creation and editing of the image processing program (160); The image processing device (100) according to configuration 1, wherein the image processing device (100) is determined to be operating in the preliminary phase if the user interface screen does not restrict creation and editing of the image processing program (160).

[0117] (Configuration 5) The switching unit (17, 110) The image processing device (100) according to configuration 1, which determines whether the image processing device (100) is operating in the pre-phase or the operation phase depending on the logged-in user.

[0118] (Configuration 6) Further provided is a providing unit (13, 110) for providing a user interface screen; The switching unit (17, 110) When the execution instruction is received from an external device (5) without via the user interface screen, the image processing device (100) determines that it is operating in the operation phase; The image processing device (100) according to configuration 1, wherein when the execution instruction is received via the user interface screen, the image processing device (100) determines that it is operating in the preliminary phase.

[0119] (Configuration 7) The image processing device (100) according to configuration 1, further comprising a providing unit (13, 110) that provides a screen showing a count result by the counting unit (16, 110) for each of the plurality of program parts (180).

[0120] (Configuration 8) An information processing method in an image processing device (100), The image processing device (100) a library (170) containing a plurality of program parts (180); an execution unit (15, 110) that, in response to an execution instruction, performs image processing on an image containing an object (W) according to an image processing program to determine whether the object (W) is good or bad; the image processing program (160) includes a program part designated from among the plurality of program parts (180); The information processing method includes: a step of counting, for each of the plurality of program parts (180), at least two of the number of times image processing is executed according to the image processing program (160) including the program part, the number of times the object (W) is judged to be good by the image processing according to the image processing program (160) including the program part, and the number of times the object (W) is judged to be bad by the image processing according to the image processing program (160) including the program part; and switching the counting step between enabled and disabled, The switching step includes: determining whether the image processing device (100) is operating in a pre-phase in which at least one of creating and editing the image processing program (160) is being executed, or in an operation phase in which the image processing device (100) is operating according to the image processing program (160), based on the status of the image processing device (100); a step of disabling the counting step when it is determined that the image processing device (100) is operating in the pre-phase; and switching the counting step to enabled when it is determined that the image processing device (100) is operating in the operation phase.

[0121] Although the embodiments of the present invention have been described, the embodiments disclosed herein should be considered to be illustrative and not restrictive in all respects. The scope of the present invention is defined by the claims, and it is intended to include all modifications within the meaning and scope of the claims. [Explanation of symbols]

[0122] 1 image processing system, 5 PLC, 6 transport mechanism, 8 camera, 10 memory unit, 11 authentication unit, 12 signal output unit, 13 provision unit, 14 program creation unit, 15 execution unit, 16 count unit, 17 switching unit, 20, 25, 30, 40 UI screen, 21 input field, 22a to 22d radio buttons, 23 selection field, 24, 32a, 32b, 33a button, 31, 34 area, 32, 33 tab, 35, 36 display field, 100 image processing device, 106 memory card, 110 processor, 112 RAM, 114 display controller, 116 system controller, 118 I / O controller, 120 hard disk, 122 camera interface, 124 input interface, 126 PLC interface, 128 communication interface, 130 memory card interface, 150 control program, 160 Image processing program, 165 image file, 170 library, 172 parts package, 180 program parts, 182 scene parts, 184 layout parts, 190 statistical information, 190a record, 191 compressed statistical information, 200 display, 300 keyboard, 400 computer equipment, W inspected object.

Claims

1. An image processing device, a library containing a plurality of program parts; a program execution unit that, in response to an execution instruction, performs image processing on an image containing an object according to an image processing program to determine whether the object is good or bad; the image processing program includes a program part designated from the plurality of program parts, The image processing device further comprises: a counting unit that counts, for each of the plurality of program parts, at least two of the number of times image processing is executed in accordance with the image processing program including that program part, the number of times the object is judged to be good by the image processing in accordance with the image processing program including that program part, and the number of times the object is judged to be bad by the image processing in accordance with the image processing program including that program part; a switching unit that switches the operation of the counting unit between enabled and disabled, The switching unit is determining whether the image processing device is operating in a pre-phase in which at least one of creating and editing the image processing program is being executed, or in an operation phase in which the image processing device is operating in accordance with the image processing program, based on the status of the image processing device; An image processing device that disables the operation of the counting unit when it determines that the image processing device is operating in the pre-phase, and enables the operation of the counting unit when it determines that the image processing device is operating in the operation phase.

2. the image processing device is communicably connected to a camera; The switching unit is determining that the image processing device is operating in the operation phase when an image acquired from the camera in response to an imaging command is to be subjected to the image processing; The image processing device according to claim 1 , wherein the image processing device is determined to be operating in the preliminary phase when an image stored in the image processing device or a storage device communicatively connected to the image processing device is to be the subject of the image processing.

3. a signal output unit that outputs a signal indicating whether or not the device is operable in cooperation with an external device; The switching unit is determining that the image processing device is operating in the operational phase when the signal indicates that the image processing device is capable of operating in cooperation with the external device; The image processing device of claim 1 , wherein the image processing device determines that the image processing device is operating in the preliminary phase if the signal indicates that the image processing device is not operational in conjunction with the external device.

4. a providing unit for providing a user interface screen; The switching unit is determining that the image processing device is operating in the operational phase when the user interface screen restricts creation and editing of the image processing program; The image processing device of claim 1 , wherein the image processing device is determined to be operating in the preliminary phase when the user interface screen does not restrict creation and editing of the image processing program.

5. The switching unit is The image processing device according to claim 1 , wherein the image processing device determines whether the image processing device is operating in the pre-phase or the operation phase depending on a logged-in user.

6. a providing unit for providing a user interface screen; The switching unit is determining that the image processing device is operating in the operation phase when the execution instruction is received from an external device without via the user interface screen; The image processing device according to claim 1 , wherein the image processing device determines that the image processing device is operating in the preliminary phase when the execution instruction is received via the user interface screen.

7. The image processing device according to claim 1 , further comprising a providing unit that provides a screen showing a count result by said counting unit for each of said plurality of program parts.

8. An information processing method in an image processing device, The image processing device includes: a library containing a plurality of program parts; an execution unit that, in response to an execution instruction, performs image processing on an image showing an object in accordance with an image processing program to determine whether the object is good or bad; the image processing program includes a program part designated from the plurality of program parts, The information processing method includes: a step of counting, for each of the plurality of program parts, at least two of the number of times image processing is executed in accordance with the image processing program including that program part, the number of times the object is judged to be good by the image processing in accordance with the image processing program including that program part, and the number of times the object is judged to be bad by the image processing in accordance with the image processing program including that program part; and switching the counting step between enabled and disabled, The switching step includes: determining whether the image processing device is operating in a pre-phase in which at least one of creating and editing the image processing program is being executed, or in an operation phase in which the image processing device is operating in accordance with the image processing program, based on the status of the image processing device; a step of disabling the counting step when it is determined that the image processing device is operating in the pre-phase; and switching the counting step to enabled when it is determined that the image processing device is operating in the operation phase.

Citation Information

Patent Citations

  • Picture processor

    JP1995037092A

  • Method of providing operation information for application software, information terminal device, and method of processing operation information for application software

    JP2005038152A

  • Image processing system and visual inspection method

    JP2012021914A

  • Visual inspection device, visual inspection method and computer program

    JP2013142558A

  • Inspection device

    JP2018066660A