Measuring device and procedure

Abstract

A measurement device and a program that enable an operator to easily understand a measurement process recorded for a measurement object to be measured are provided. The measurement device includes a mounting table on which a measurement object is placed, an image capturing unit that captures an image of the measurement object placed on the mounting table, a storage unit that stores a measurement program recording a measurement process for a standard workpiece in association with a thumbnail image of the standard workpiece, a display unit that displays the image of the measurement object captured by the image capturing unit and a user interface of a measurement application software for analyzing the image, and a control unit that executes the measurement application software. The control unit prompts an operator to select a measurement program by displaying the thumbnail image associated with each measurement program on the display unit by means of the measurement application software, and executes the measurement process recorded in the selected measurement program.

Description

Technical Field

[0001] This disclosure relates to a measuring apparatus and program for measuring the dimensions of an object. Background Technology

[0002] An image measuring apparatus is a device that captures an image of a measured object and measures the dimensions of measurement points of the object by analyzing the image (see, for example, JP2010-169584A). The image measuring apparatus performs measurement through a series of steps: specifying the elements or dimensions of interest in the captured image of the measured object, obtaining the measured values, setting the display mode and tolerances for these values, and saving the measurement results that reflect these settings.

[0003] Measurements using image measuring devices can be summarized into the series of measurement processes described above. However, for each individual object being measured, the elements and dimensions of interest during measurement differ, making it challenging for the operator to execute the measurement after understanding the correct procedure for each individual object. To address this, a function has been implemented to record the measurement procedure for each individual object and execute the recorded procedure. This makes it easier for the operator to understand the specific measurement procedure for each individual object. Summary of the Invention

[0004] Technical problems to be solved

[0005] An operator can correctly perform a measurement by executing a pre-recorded measurement procedure (also known as a measurement program) on the object to be measured. However, when measurement procedures are recorded for a wide variety of objects, finding the correct procedure for the intended object is not easy. This can lead to delays in executing the procedure or incorrect execution of the procedure on the wrong object.

[0006] In view of the above problems, embodiments of the present invention are made, the purpose of which is to provide a measuring device and program that enables the operator to easily understand the recorded measurement process for the object to be measured.

[0007] Technical means to solve the problem

[0008] A measuring apparatus according to an embodiment of the present invention captures an image of a measurement object and measures the dimensions of measurement points of the measurement object by analyzing the image. The measuring apparatus includes: a mounting stage on which the measurement object is placed; an image capture unit that captures an image of the measurement object placed on the mounting stage; a storage unit that stores a measurement program that records measurement processes for a master workpiece associated with a thumbnail image of the master workpiece; a display unit that displays an image of the measurement object captured by the image capture unit and a user interface for measurement application software used to analyze the image; and a control unit that executes the measurement application software. The control unit prompts the operator to select a measurement program by displaying a thumbnail image associated with each measurement process on the display unit using the measurement application software, and executes the measurement process recorded in the selected measurement program. Attached Figure Description

[0009] Figure 1 An example showing the appearance of the image measuring device 1.

[0010] Figure 2 This is a schematic diagram showing the internal structure of the image measuring device 1.

[0011] Figure 3 A functional block diagram of the image measuring device 1 is shown.

[0012] Figure 4 This is a diagram showing an example of a screen displayed on display unit 6 by measurement application software.

[0013] Figure 5 This is a diagram showing an example state of the menu panel displayed on the screen of a measurement application software.

[0014] Figure 6 An example display of the menu related to program measurements is shown.

[0015] Figure 7 An example display of the measurement program operation window is shown.

[0016] Figure 8 Another example of a measurement procedure operation window is shown.

[0017] Figure 9 An example display of candidate measurement procedures identified by the automatic scanning function is shown. Detailed Implementation

[0018] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In the following description and drawings, the same reference numerals are used for the same functional parts, and functional parts that have been explained are omitted or explained to the extent necessary.

[0019] Figure 1 This is a schematic diagram showing an example of the appearance of the image measuring device 1. Figure 2 This is a schematic diagram showing the internal structure of the image measuring device 1. Figure 3 A functional block diagram of the image measuring device 1 is shown. In this embodiment, the case of using coaxial episcopic illumination as the illumination method is explained as an example, but any illumination method is acceptable as long as an image of the object being measured can be captured.

[0020] The image measuring device 1 includes a mounting platform 2, an image capture unit 3, a control and processing unit 4, a storage unit 5, a display unit 6, a telecentric optical system 7, an illumination unit 8, and an input unit 10.

[0021] Mounting stage 2 is a platform on which the object to be measured, W, is placed. Image capture unit 3 is positioned opposite mounting stage 2 and captures an image of the object W mounted on mounting stage 2 by receiving light from the direction of the mounting stage 2. Image capture unit 3 includes an image sensor that converts the brightness or darkness of the image formed on its light-receiving surface into an electrical signal, thereby generating image data. For the image sensor, a semiconductor solid-state imaging device, such as a CCD (charge-coupled device) or CMOS (complementary metal-oxide-semiconductor), is used.

[0022] Storage unit 5 is any storage device capable of storing digital data. Storage unit 5 stores the measurement results obtained by image measuring device 1, the program executed by control processing unit 4, and various data used by the program. In addition, storage unit 5 stores the measurement program, in which the operation process for measuring each measurement object W using image measuring device 1 is recorded in association with the image (reference image and thumbnail image) of the measurement object W.

[0023] Display unit 6 is any display device, and displays images of the measured object W captured by image capture unit 3, etc.

[0024] The telecentric optical system 7 includes an objective lens 71 that collects light from the direction of the mounting stage 2 and an imaging lens 72 that forms an image of the light arriving through the objective lens 71 on the light-receiving surface of the image capturing unit 3. The objective lens 71 and the imaging lens 72 may each have multiple lens surfaces.

[0025] The illumination unit 8 is a coaxial incident illumination device, which includes a light source 81 that emits illumination light and a beam splitter 82. The beam splitter 82 deflects (interrupts) the illumination light from the light source 81 into the telecentric optical system 7, and directs the coaxial incident illumination light, whose optical axis coincides with that of the image capture unit 3, toward the mounting stage 2. For image clarity and other purposes, the illumination unit 8 may be equipped with transmitted illumination or side illumination in addition to coaxial incident illumination.

[0026] The input unit 10 accepts input from the operator. The input unit 10 may be configured, for example, as a touch panel display integrated with the display unit 6. Alternatively, in addition to or replacing a touch panel display, the input unit 10 may also be equipped with a mouse.

[0027] The control processing unit 4 is composed of a CPU. The control processing unit 4 controls various parts of the image measuring device 1 and performs necessary arithmetic operations by executing various programs to achieve image capture and image measurement through the image measuring device 1. The various programs include programs describing the functions of the image capture unit 3, the illumination unit 8, etc., and programs for image measurement applications that use images of the object W captured by the image capture unit 3 to perform measurements, such as measuring the dimensions of various parts of the object W. The programs can be read from the storage unit 5 or from another storage medium.

[0028] Next, the measurement application software, one of the programs executed by the control processing unit 4, will be described.

[0029] Figure 4 This diagram illustrates an example of a screen displayed on display unit 6 by the measurement application software. Camera view R1 is the area displaying the image captured by image capture unit 3. Toolbar R2 is the area displaying icons IC for frequently used functions in the measurement application software. When the operator clicks an icon displayed on toolbar R2, the function corresponding to the clicked icon is executed. Option panel R3 is the area displaying various user interfaces required for measurement operations, including buttons such as confirmation button B1 and menu button B2, icons, sliders, text boxes, and toggle switches.

[0030] Measurements using such measurement application software typically follow a series of steps: when the image captured by the image capture unit 3 is displayed in the camera view R1, the operator specifies the element or dimension of interest for measurement, obtains the measured value, sets the display mode or tolerance of the measured value, and saves the measurement results that reflect these settings.

[0031] Measurements using image measuring devices can be summarized into the series of processes described above. However, for each individual object being measured, the elements and dimensions of interest during measurement differ, making it challenging for the operator to perform measurements after understanding the appropriate measurement content and process for each individual object. The measurement application software of this embodiment includes a program measurement function that records the measurement procedure for each individual object and executes the recorded measurement procedure. This function helps the operator understand the specific measurement process for each object. These functions of the measurement application software are described below.

[0032] like Figure 5 As shown, pressing the menu button B2 in the upper right corner of the measurement application software screen opens the menu panel R4, which displays menus related to program measurement, as well as file menus for opening and saving measurement result files and option menus for various settings of the image measurement device 1.

[0033] Figure 6 An example display of the menu related to program measurement is shown. The menu includes a toggle switch SW1 for enabling or disabling automatic scanning (described later), a selection list L1 displaying thumbnail images and names of pre-registered measurement programs arranged in a predetermined number, and a slider SB for scrolling the display of selection list L1 left and right. The number of measurement programs that can be displayed in the selection list is arbitrary. By displaying thumbnail images, the operator can quickly and accurately identify the desired measurement program for the measurement object W by observing the thumbnail images.

[0034] For measurement procedures subject to the automatic scanning function described later, a marker M indicating eligibility for the automatic scanning function is displayed in association with the thumbnail image. Figure 6 In the example shown, the measurement procedures named "Bracket Outer" and "Ring Adapter" undergo automatic scanning. The display position of the markers is arbitrary, but it is recommended, for example, to overlay them on the thumbnail image. Note that in a configuration where all measurement procedures undergo automatic scanning and automatic scanning is not allowed for individual procedures, it is not necessary to display the marker M indicating eligibility for automatic scanning.

[0035] When the operator clicks on one of the thumbnails of the measurement program displayed in selection list L1, or clicks on the blank area marked with "+", a pop-up window appears. Figure 7The measurement program operation window W1 is shown. In the measurement program operation window W1, the name of the selected measurement program is displayed at the top, and there are an execute button B3, a record button B4, a rename button B5, a thumbnail image editing button B6, a delete button B7, and a toggle switch SW2. The toggle switch SW2 is an input interface used to toggle whether the selected measurement program is eligible for the automatic scanning function. When the toggle switch SW2 is set to "ON", a mark M appears on the thumbnail image corresponding to the selected measurement program in the selection list L1.

[0036] The Execute button B3 is a command button used to execute the selected measurement program. When the measurement program operation window W1 pops up and an existing measurement program is selected from the selection list L1, the Execute button B3 becomes active. By clicking the Execute button B3, the measurement process recorded in the measurement program is executed. That is, the control unit automatically performs each step of the measurement (such as extracting elements, selecting elements, selecting measurement values, editing, confirming, saving, etc.), following the same process as when the measurement program was recorded. Once execution begins, the Execute button B3 becomes a Stop button, which is the command button to stop execution. During the execution of the measurement program, at steps requiring manual operation by the operator, prompts for the operation are displayed to the operator, and automatic progress is temporarily paused.

[0037] The record button B4 is a command button used to record the measurement program. To record the measurement program, press the record button B4 with the standard workpiece placed on the mounting table 2. This records the subsequent measurement process. Here, if an existing measurement program is selected from the selection list L1 when the measurement program operation window W1 pops up, the existing measurement program is overwritten by the new measurement program. Furthermore, if the "+" button is selected from the selection list L1, a new measurement program is recorded. Once recording begins, the record button B4 becomes a stop button, which is the command button to stop recording.

[0038] After recording begins, the operator uses various functions of the measurement application software on the standard workpiece to perform a series of measurement processes, including: setting imaging conditions (such as illumination), capturing images, extracting elements, selecting elements, selecting dimensions, and editing dimensions. Simultaneously, the measurement application software records the performed operations. Upon completion of the measurement process and the operator pressing the stop button, the measurement application software stops recording the measurement steps and captures reference images and thumbnail images. At this point, the illumination conditions used to capture the reference images are set to the predetermined reference image illumination conditions. These recorded measurement processes, reference images, and thumbnail images are then associated with each other and saved as a measurement program. For the saved measurement program, a thumbnail image and the measurement program name are displayed in the selection list L1.

[0039] The Rename button B5 is a command button used to change the name of the measurement program. By pressing the Rename button B5 in the measurement program operation window W1, a text box T for editing the measurement program name, an OK button B8, and a Cancel button B9 are displayed within the measurement program operation window W1, as shown below. Figure 8 As shown. By entering the desired name in the text box T and pressing the confirmation button B8, the change of the measurement program name can be confirmed.

[0040] return Figure 7 The thumbnail image editing button B6 is a command button for editing the thumbnail image of the measurement program. By pressing the thumbnail image editing button B6 in the measurement program operation window W1, an editing window for editing the thumbnail image is displayed, showing the current thumbnail image. In this editing window, using a user interface similar to traditional drawing software, lines, graphics, text, symbols, etc., can be drawn on the thumbnail image, and the thumbnail image can be overwritten by confirming the edit. When the image measurement device 1 uses a touch panel display, it is advantageous to configure the device to allow handwriting on the thumbnail image. By drawing characters, graphics, etc., on the thumbnail image, it becomes easier to distinguish measurement programs for objects with similar shapes based on the thumbnail image.

[0041] The delete button B7 is a command button used to delete the selected measurement program. When the delete button B7 is pressed, the selected measurement program will be deleted. However, a confirmation message can be displayed before deletion to warn the operator and confirm their intention to delete the measurement program.

[0042] To more efficiently identify measurement programs for the object of interest W, the measurement application software includes an automatic scanning function. This function identifies measurement programs from a large number of measurement programs that are highly likely to be for the object of interest W. This automatic scanning function can be enabled by turning the toggle switch SW1 ON in the Program Measurement menu displayed on the menu panel R4.

[0043] When the automatic scanning function is enabled, the illumination conditions are set to predetermined automatic scanning illumination conditions. The automatic scanning illumination conditions and the reference image illumination conditions can differ, but to enhance comparison accuracy, it is preferable to set them to the same level. Imaging by the image capture unit 3 is performed continuously under the predetermined illumination conditions, regardless of whether the object being measured W is placed on the mounting stage 2. When the object being measured W is placed on the mounting stage 2, the image capture unit 3 detects the placement of the object based on changes in the captured image and initiates comparison processing. The image of the object being measured W obtained through this imaging is then compared with the reference image stored in the storage unit 5 for each measurement procedure. A matching rate (i.e., a score indicating the similarity between the object being measured W placed on the mounting stage 2 and the object depicted in the reference image) is calculated. By ensuring that the illumination conditions of the object being measured W match the illumination conditions of the reference image, the accuracy of the comparison can be improved. Based on the calculated matching rate, the measurement application software performs processing to assist in selecting an appropriate measurement procedure.

[0044] As a supplementary step in selecting measurement programs, the measurement application software can, for example, identify one or more candidate measurement programs that are highly likely to be suitable for the object W placed on the mounting table 2 based on the matching rate, and display them on the menu panel R4. When displaying multiple candidate measurement programs identified by the automatic scanning function, it is preferable to display them as a list L2 sorted in order of probability of suitability for the object W (i.e., in descending order of matching rate), such as... Figure 9 As shown. At this point, it is expected that at least a thumbnail image, name, and match rate should be displayed for each measurement procedure shown as a candidate. Then, when the operator clicks on any of the displayed candidates, the measurement procedure should be executed.

[0045] Alternatively, the measurement program most likely suitable for the object W placed on the mounting table 2 can be executed automatically. To prevent the automatic execution of an unsuitable measurement program, a notification can be provided that no suitable measurement program exists if no measurement program has a matching rate exceeding a predetermined threshold (e.g., 80%).

[0046] According to the image measurement apparatus 1 of this embodiment described above, by displaying thumbnail images of the measurement object W in the selection list, the operator can immediately identify the measurement program suitable for the desired measurement object W. Even if measurement programs for similar measurement objects exist, by editing the thumbnail images, the measurement object corresponding to each individual measurement program can be easily identified. Furthermore, since the thumbnail images displayed in the selection list occupy a fixed area on the display unit 6, they are suitable for operation on touch panel displays where fine manipulation is not preferred.

[0047] In addition, the automatic scanning function can filter out the most likely suitable measurement programs from a large number of programs, or automatically execute the measurement programs that have been determined to be suitable, thereby making the measurement more efficient.

[0048] In the above embodiments, as an example, the measuring device is described as an image measuring device, but the measuring device in the present invention can be a contour projector and an image measuring device.

[0049] This invention is not limited to the embodiments and variations described above. The above embodiments and variations are merely illustrative, and anything having a substantially identical configuration and producing the same effect as the technical concept described in the claims of this invention is included within the technical scope of this invention. In other words, modifications can be made as appropriate within the scope of the technical concept expressed in this invention, and such modifications and improvements are also included within the technical scope of this invention.

[0050] For example, in the above embodiment, in the automatic scanning function, the image capture unit 3 detects that the object to be measured, W, has been placed on the mounting stage 2 based on changes in continuously captured images. However, other methods can also be used to detect that the object to be measured, W, is placed on the mounting stage 2. For example, sensors that detect weight or contact, or sensors that detect distance or position (e.g., LiDAR, ultrasonic sensors, millimeter-wave radar, etc.) can be used to detect that the object to be measured, W, is placed on the mounting stage 2, without using the images captured by the image capture unit 3.

[0051] The following appendix further discloses the embodiments and their modifications.

[0052] (Appendix 1)

[0053] A measuring device that captures an image of a measured object and measures the dimensions of a measurement point of the measured object by analyzing the image, the measuring device comprising:

[0054] Mounting platform, on which the object to be measured is placed;

[0055] An image capture unit that captures images of the object being measured, which is placed on a mounting platform;

[0056] A storage unit that stores a measurement program that records the measurement process for a standard workpiece associated with a thumbnail image of the standard workpiece.

[0057] The display unit displays an image of the measured object captured by the image capture unit and a user interface for the measurement application software used to analyze the image; and

[0058] The control unit executes the measurement application software.

[0059] The control unit prompts the operator to select a measurement program by displaying a thumbnail image associated with each measurement program on the display unit using measurement application software, and then executes the measurement process recorded in the selected measurement program.

[0060] (Appendix 2) The measuring apparatus according to Appendix 1, wherein the storage unit stores reference images associated with the measuring program, and

[0061] When the object to be measured is placed on the mounting table, the control unit causes the image capture unit to capture an image of the object to be measured, and compares the image of the object to be measured captured by the image capture unit with a reference image associated with the measurement program in order to identify the measurement program of a standard workpiece similar to the object to be measured on the mounting table.

[0062] (Appendix 3) The measuring apparatus according to Appendix 2, wherein the control unit identifies one or more measuring procedures based on the matching rate between the image of the measuring object captured by the image capture unit and the reference image associated with the measuring procedure, and causes the display unit to display a thumbnail image associated with the identified measuring procedure on the display unit to prompt the operator to make a selection.

[0063] (Appendix 4) The measuring device according to Appendix 2, wherein the control unit identifies a measurement program for a standard workpiece similar to the object to be measured placed on the mounting table, and executes the identified measurement program.

[0064] (Appendix 5) According to the measuring device described in Appendix 1, the control unit records the measurement process performed on a standard workpiece placed on the mounting table as a measurement program for the standard workpiece, and causes the image capture unit to capture an image of the standard workpiece placed on the mounting table, and records the captured image as a reference image associated with the measurement program.

[0065] (Appendix 6) The measuring device according to Appendix 5 further includes an illumination unit that illuminates the mounting platform with light, and

[0066] The control unit enables the image capture unit to capture a reference image while the illumination unit illuminates the object under predetermined illumination conditions, and compares the image of the measured object captured by the image capture unit while the illumination unit illuminates the object under predetermined illumination conditions with the reference image.

[0067] (Appendix 7) The measuring device according to Appendix 1, wherein the control unit causes the display unit to display an editing window for editing a thumbnail image, accepts input in the editing window for overlaying and drawing lines, graphics, characters or symbols on the thumbnail image, and associates the edited thumbnail image with the measurement program in the storage unit.

[0068] (Appendix 8) The measuring apparatus according to Appendix 2, wherein the control unit calculates the matching rate between the image of the object to be measured captured by the image capture unit and the reference image associated with each measurement procedure, and displays thumbnail images corresponding to multiple measurement procedures on the display unit, the thumbnails being sorted in descending order of matching rate.

[0069] (Appendix 9) The measuring apparatus according to Appendix 2, wherein the control unit causes the image capture unit to continuously perform image capture, detects that the object to be measured has been placed on the mounting table based on changes in the captured image, and initiates a comparison between the image of the object to be measured and the reference image in response to the detection.

[0070] (Appendix 10) A computer-readable storage medium storing a program for causing a processor to perform a method for controlling various parts of the measuring apparatus as described in any one of Appendices 1 to 9.

Claims

1. A measuring device that captures an image of a measured object and measures the size of a measurement point of the measured object by analyzing the image, the measuring device comprising: Mounting platform, on which the measuring object is placed; An image capture unit that captures an image of the object to be measured, which is placed on the mounting platform; A storage unit that stores a measurement program that records the measurement process for the standard workpiece associated with a thumbnail image of the standard workpiece; The display unit displays an image of the object being measured captured by the image capture unit and a user interface for measurement application software used to analyze the image; as well as The control unit executes the measurement application software. The control unit prompts the operator to select the measurement program by displaying a thumbnail graphic associated with each measurement program on the display unit using the measurement application software, and executes the measurement process recorded in the selected measurement program.

2. The measuring device according to claim 1, wherein, The storage unit stores reference images associated with the measurement program, and When the object to be measured is placed on the mounting table, the control unit causes the image capture unit to capture an image of the object to be measured, and compares the image of the object to be measured captured by the image capture unit with a reference image associated with the measurement program in order to identify a measurement program for a standard workpiece similar to the object to be measured on the mounting table.

3. The measuring device according to claim 1, wherein, The control unit identifies one or more measurement programs based on the matching rate between the image of the measurement object captured by the image capture unit and the reference image associated with the measurement program, and causes the display unit to display a thumbnail image associated with the identified measurement program to prompt the operator to make a selection.

4. The measuring device according to claim 2, wherein, The control unit identifies a measurement program for a standard workpiece similar to the object being measured placed on the mounting table, and executes the identified measurement program.

5. The measuring device according to claim 2, wherein, The control unit records the measurement process performed on the standard workpiece placed on the mounting table as a measurement program for the standard workpiece, and causes the image capture unit to capture an image of the standard workpiece placed on the mounting table, and records the captured image as a reference image associated with the measurement program.

6. The measuring device according to claim 5 further includes an illumination unit that illuminates the mounting platform with illumination light, and in, The control unit causes the image capture unit to capture the reference image while the illumination unit illuminates the object under predetermined illumination conditions, and compares the image of the measured object captured by the image capture unit while the illumination unit illuminates the object under predetermined illumination conditions with the reference image.

7. The measuring device according to claim 1, wherein, The control unit causes the display unit to display an editing window for editing the thumbnail image, accepts input within the editing window for overlaying and drawing lines, graphics, characters, or symbols on the thumbnail image, and associates the edited thumbnail image with the measurement program in the storage unit.

8. The measuring device according to claim 2, wherein, The control unit calculates the matching rate between the image of the measurement object captured by the image capture unit and the reference image associated with each measurement procedure, and displays thumbnail images corresponding to multiple measurement procedures on the display unit, the thumbnails being sorted in descending order of matching rate.

9. The measuring device according to claim 2, wherein, The control unit causes the image capture unit to continuously perform image capture, detects that the object being measured has been placed on the mounting table based on changes in the captured image, and initiates a comparison between the image of the object being measured and the reference image in response to the detection.

10. A computer program product comprising instructions for causing a control unit to perform a method for controlling various parts of a measuring device according to any one of claims 1 to 9.

Images