Information processing device, information processing method, and program

Abstract

To calculate an evaluation value of an object in image data on the basis of pixels inside and around a predetermined area regardless of the size of pixels of the image data.SOLUTION: The data reading unit 1 reads target image data IMG. A reference frame setting part 2 sets a reference frame defined in reference image data having a pixel size different from that of target image data IMG to the target image data IMG. An inclusion area evaluation value-calculating part 3 calculates inclusion area evaluation values E1 on the basis of pixels included in the reference frame. A reference frame conversion evaluation value-calculating part 4 calculates reference frame conversion evaluation values E1 on the basis of the inclusion region evaluation values E2 and a predetermined coefficient. An extended area evaluation value-calculating part 5 calculates an extended area evaluation value E3 on the basis of the pixels included in the reference frame and the pixels partially included in the reference frame. The evaluation determination unit 6 determines one of the inclusive area evaluation E1, the converted reference frame evaluation E2, and the extended area evaluation as the evaluation E calculated for the reference frame based on the magnitude relationship among the inclusive area evaluation LA, the converted reference frame evaluation LA, and the extended area evaluation.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, an information processing method, and a program.

Background Art

[0002] With the miniaturization of semiconductor process nodes, there is an urgent need for further higher sensitivity in the inspection of semiconductor wafers, photomasks, and the like. For example, as a technique for inspecting a sample such as a mask, a technique for performing inspection by imaging the sample is widely known (Patent Documents 1 and 2).

[0003] In addition, in order to evaluate the size of an object shown in the captured image, etc., a method is known in which an evaluation value is calculated based on the pixel values of the pixels in the region where the object appears, and the object is evaluated according to the magnitude of the evaluation value (Non-Patent Document 1). In this method, it has been proposed to calculate, as an evaluation value, a value obtained by removing a background component from the sum of pixel values in a predetermined region including an integer number of pixels at the position where the object appears in the image.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Non-Patent Documents

[0005]

Non-Patent Document 1

[0006] In the inspection of samples such as photomasks, inspection may be performed using multiple inspection devices. However, when imaging a sample with multiple inspection devices, the pixel size may differ due to differences in the devices themselves or their models. If the pixel size differs, even when imaging the same-sized area of ​​the sample, the number of pixels that produce pixel values ​​reflecting the image of the same object will differ.

[0007] On the other hand, it is desirable that the same object can be evaluated similarly even if the pixel sizes of the images captured by the inspection device differ. Therefore, it is necessary to calculate an evaluation value that is equivalent or approximates it to an equivalent degree. However, when calculating the evaluation value, even if one image contains an integer number of pixels within a predetermined area of ​​size, due to differences in pixel size, it is conceivable that in the other image, only a portion of the pixels may be included within a predetermined area of ​​the same size. In this case, it is not possible to simply calculate the evaluation value as proposed in Non-Patent Document 1.

[0008] Therefore, even when the pixel sizes of the images captured by the inspection device differ, a method is needed to calculate evaluation values ​​that are equivalent or approximate to an equivalent degree. [Means for solving the problem]

[0009] The information processing device according to this disclosure includes: a data reading unit that reads target image data obtained by imaging a sample; a reference frame setting unit that sets a reference frame defined to include an integer number of pixels of reference image data with different pixel sizes from the target image data for the target image data; a first evaluation value calculation unit that calculates a first evaluation value based on the pixels included within the reference frame in the target image data; a second evaluation value calculation unit that calculates a second evaluation value based on the first evaluation value and a predetermined coefficient based on the relationship between the area of ​​the region consisting of pixels included within the reference frame in the target image data and the area of ​​the reference frame; a third evaluation value calculation unit that calculates a third evaluation value based on the pixels included within the reference frame and pixels partially included within the reference frame in the target image data; and an evaluation value determination unit that determines one of the first to third evaluation values ​​as the evaluation value calculated for the reference frame based on the relative magnitudes of the first to third evaluation values.

[0010] The information processing device according to this disclosure includes: a data reading unit that reads target image data obtained by imaging a sample; a reference frame setting unit that sets a reference frame defined to include an integer number of pixels of reference image data with different pixel sizes from the target image data for the target image data; a first evaluation value calculation unit that calculates a first evaluation value based on the pixels included within the reference frame in the target image data; a second evaluation value calculation unit that calculates a second evaluation value based on the first evaluation value and a predetermined coefficient based on the relationship between the area of ​​the region consisting of pixels included within the reference frame in the target image data and the area of ​​the reference frame; and an evaluation value determination unit that determines the second evaluation value as the evaluation value calculated for the reference frame.

[0011] The information processing method according to this disclosure reads target image data obtained by imaging a sample, sets a reference frame defined to include an integer number of pixels of reference image data with different pixel sizes from the target image data, calculates a first evaluation value based on the pixels included within the reference frame in the target image data, calculates a second evaluation value based on the first evaluation value and a predetermined coefficient based on the relationship between the area of ​​the region consisting of pixels included within the reference frame in the target image data and the area of ​​the reference frame, calculates a third evaluation value based on the pixels included within the reference frame and pixels partially included within the reference frame in the target image data, and determines one of the first to third evaluation values ​​as the evaluation value calculated for the reference frame based on the relative magnitudes of the first to third evaluation values.

[0012] The program according to this disclosure causes a computer to perform the following steps: read target image data obtained by imaging a sample; set a reference frame defined to include an integer number of pixels of reference image data with different pixel sizes from the target image data for the target image data; calculate a first evaluation value based on the pixels included within the reference frame in the target image data; calculate a second evaluation value based on the first evaluation value and a predetermined coefficient based on the relationship between the area of ​​the region consisting of pixels included within the reference frame in the target image data and the area of ​​the reference frame; calculate a third evaluation value based on the pixels included within the reference frame and pixels partially included within the reference frame in the target image data; and determine one of the first to third evaluation values ​​as the evaluation value calculated for the reference frame based on the relative magnitudes of the first to third evaluation values. [Effects of the Invention]

[0013] According to this disclosure, regardless of the size of the pixels in the image data, an evaluation value of an object in the image data can be calculated based on the pixels inside and around a predetermined region. [Brief explanation of the drawing]

[0014] [Figure 1] This is a diagram showing an example of an optical device having an information processing apparatus according to Embodiment 1. [Figure 2] This is a diagram schematically showing reference image data and target image data. [Figure 3] This is a diagram showing a case where a reference frame in reference image data is applied to target image data. [Figure 1] [Figure 4] This is a diagram showing a configuration example of the information processing apparatus according to Embodiment 1. [Figure 5] This is an enlarged view of the target image data in FIG. 3. [Figure 6] This is a diagram schematically showing Case 1 which is an example of the relationship between a reference frame and a target object. [Figure 7] This is a diagram schematically showing Case 2 which is an example of the relationship between a reference frame and a target object. [Figure 8] This is a diagram schematically showing Case 3 which is an example of the relationship between a reference frame and a target object. [Figure 9] This is a flowchart showing an evaluation value calculation operation in the information processing apparatus according to Embodiment 1. [Figure 10] This is a diagram showing a configuration example of a computer for realizing the information processing apparatus.

Mode for Carrying Out the Invention

[0015] Hereinafter, the specific configuration of the embodiment will be described with reference to the drawings. The following description shows a preferred embodiment of the present disclosure, and the scope of the present disclosure is not limited to the following embodiment. In the following description, those denoted by the same reference numerals indicate substantially the same content.

[0016] Embodiment 1 The information processing apparatus according to Embodiment 1 will be described. The information processing apparatus according to the present embodiment is configured to calculate an evaluation value of a target object in target image data having a different pixel size from the reference image data by a method according to the size of the target object.

[0017] In the following, image data may be data that has not yet been converted into an image, such as so-called RAW data, acquired by capturing images with an imaging device such as a camera. Alternatively, image data may be an image generated by performing a predetermined process on numerical data such as RAW data.

[0018] Figure 1 shows an example of an optical device having an information processing device according to Embodiment 1. The optical device 1000 includes an imaging device 1100 and an information processing device 100 according to Embodiment 1. The imaging device 1100 images a sample 1200 and outputs the acquired target image data IMG to the information processing device 100.

[0019] The information processing device 100 calculates an evaluation value for the area in the target image data (IMG) that contains the object. Here, the reference frame, which is the area containing the pixels used to calculate the evaluation value, is predetermined based on the pixel size in reference image data, which is captured by a reference imaging device and has a different pixel size than the target image data. In this example, the reference frame is defined as a rectangular area containing an integer number of pixels in the reference image data. However, the reference frame is not limited to this, and may be an area of ​​a shape other than a rectangle, such as a cross shape, that contains an integer number of pixels in the reference image data.

[0020] As described below, the information processing device 100 applies a reference frame to target image data that has a different pixel size from the reference image data, and calculates an evaluation value based on the pixels inside the reference frame, or the pixels inside and around the reference frame.

[0021] Next, we will explain the problems caused by the difference in pixel size between the reference image data and the target image data. Figure 2 is a schematic diagram showing the reference image data and the target image data. The same object present on the sample is present in both the reference image data REF and the target image data IMG. In Figure 2, the pixel value of each pixel is displayed in grayscale. The white pixels near the center of the reference image data REF and the target image data IMG indicate the pixels in which the object is captured.

[0022] To evaluate an object in image data, an evaluation value is calculated based on the pixel values ​​of the pixels in which the object is captured. Here, the evaluation value is calculated as the sum of the pixel values ​​of pixels within a predetermined reference frame. When calculating the sum of the pixel values ​​of pixels within the reference frame, the background component may be removed from the sum of the pixel values, for example, as described in Non-Patent Document 1.

[0023] In the reference image data REF shown in Figure 2, a reference frame F is predetermined, with a size of 2x2, or 2x2 = 4 pixels. In the reference image data REF, the reference frame F is positioned so that its upper left corner coincides with the upper left corner of a single pixel. By sequentially changing the pixel that serves as the reference for positioning the reference frame F in the reference image data REF, the entire reference image data REF can be swept by the reference frame F. This allows for the calculation of evaluation values ​​for objects reflected within the reference image data REF.

[0024] However, if the models of the imaging devices used to capture the sample differ, or if there are differences between devices of the same type, the pixel size of the reference image data REF and the target image data IMG may differ, as shown in Figure 2. For example, even when imaging a sample with different imaging devices that have the same optical system structure, the pixel size of the imaging devices may not match due to manufacturing errors, etc. Also, for example, the pixel size may differ between an older imaging device and a newer imaging device due to differences in resolution.

[0025] Even in this case, it is desirable to be able to perform the same evaluation on the same object. Therefore, evaluation values ​​calculated from image data acquired with different devices should be equivalent or as close as possible. However, when attempting to calculate the evaluation value of an object using multiple images with different pixel sizes, the following problems arise.

[0026] Figure 3 shows the case where the reference frame F in the reference image data REF is applied to the target image data IMG. In Figure 3, the reference image data REF contains 4 pixels in the reference frame F. In contrast, in the target image data IMG, each side of the reference frame F is 4.1 times the length of the pixel side. Therefore, when the upper left corner of the reference frame F is aligned with the upper left corner of one pixel in the target image data IMG, the reference frame F contains 4 × 4 = 16 pixels, and the right and bottom sides of the reference frame F traverse 9 pixels.

[0027] Therefore, in the target image data IMG, the number of pixels included within the reference frame F is not an integer, as in the reference image data REF, and some pixels are only partially included. Consequently, it becomes impossible to simply calculate the evaluation value as in the reference image data REF.

[0028] Therefore, the following describes an information processing device that calculates an appropriate evaluation value using pixel values, even when there are pixels that are only partially included in the reference frame F, as shown in the target image data IMG in Figure 3.

[0029] Figure 4 shows an example of the configuration of an information processing device according to Embodiment 1. The information processing device 100 includes a data reading unit 1, a reference frame setting unit 2, an inclusion area evaluation value calculation unit 3, a reference frame converted evaluation value calculation unit 4, an extended area evaluation value calculation unit 5, and an evaluation value determination unit 6.

[0030] The data reading unit 1 reads the target image data (IMG) to be used for calculating the evaluation value. The data reading unit 1 may also read the target image data (IMG) from an imaging device that images a sample. Alternatively, for example, the target image data (IMG) may be stored in a storage device (not shown) beforehand, and the data reading unit 1 may read the target image data (IMG) from the storage device as needed.

[0031] The reference frame setting unit 2 holds information indicating a reference frame F of a predetermined size, which is determined in advance based on the size of the pixels in the reference image data REF. Figure 5 is an enlarged view of the target image data IMG in Figure 3. The reference frame setting unit 2 sets the reference frame F within a two-dimensional plane in which the pixels of the target image data IMG are arranged. In this example, as shown in Figure 5, the reference frame F is set so that its upper left corner coincides with the upper left corner of the pixels.

[0032] The reference frame setting unit 2 may pre-store information specifying the size and arrangement of the reference frame F. The reference frame F may also be provided to the reference frame setting unit 2 via various input means or communication means. Furthermore, the reference frame setting unit 2 may, as necessary, acquire information specifying the size and arrangement of the reference frame F stored in a storage device (not shown), either directly or via a reading means (not shown).

[0033] In this embodiment, the region consisting of pixels contained within the reference frame F, that is, pixels that are inside the reference frame F without being crossed by the reference frame F, is referred to as the containing region A1. The region including the containing region A1 and the pixels that the reference frame F crosses, that is, the region including the region inside the reference frame F and the portion of the pixels outside the reference frame F that the reference frame F crosses, is referred to as the extended region A2.

[0034] The inclusion region evaluation value calculation unit 3 calculates the sum of the pixel values ​​of the pixels included in the inclusion region A1 as the inclusion region evaluation value E1. In the example in Figure 5, the inclusion region evaluation value E1 is calculated for the pixel values ​​of the 16 pixels included in the inclusion region A1. The inclusion region evaluation value calculation unit 3 may also calculate other statistical values, such as the average value of the pixel values ​​of the pixels included in the inclusion region A1, as the inclusion region evaluation value E1.

[0035] The standard frame conversion evaluation value calculation unit 4 is: inclusionThe reference frame equivalent evaluation value E2 is calculated based on the region evaluation value E1 and a predetermined coefficient α based on the relationship between the area of ​​the containing region A1, which consists of pixels contained within the reference frame F, and the area of ​​the reference frame F. For example, the reference frame equivalent evaluation value calculation unit 4 calculates the reference frame equivalent evaluation value E2 as the value obtained by dividing the total value of pixels contained within the reference frame F by the predetermined coefficient α. In this case, for example, the coefficient α may be the value obtained by dividing the area of ​​the containing region A1 by the area of ​​the reference frame F. In the example in Figure 5, it is assumed that the length of each side of the reference frame F is 4.1 times the number of pixels in the target image data IMG. Therefore, since 16 / (4.1*4.1)=0.9518..., for example, 0.95 may be used as the coefficient α.

[0036] The standard frame conversion evaluation value calculation unit 4 may pre-store information indicating the coefficient α. Furthermore, information indicating the coefficient α may be provided to the standard frame conversion evaluation value calculation unit 4 via various input means or communication means. The standard frame conversion evaluation value calculation unit 4 may also acquire information indicating the coefficient α stored in a storage device (not shown) directly or via a reading means (not shown) as needed.

[0037] The extended region evaluation value calculation unit 5 calculates the total value of the pixels contained within the extended region A2 as the extended region evaluation value E3. In the example in Figure 5, the extended region evaluation value E3 is calculated for the pixel values ​​of the 25 pixels contained within the extended region A2. The extended region evaluation value calculation unit 5 may also calculate other statistical values, such as the average value of the pixel values ​​of the pixels contained within the extended region A2, as the extended region evaluation value E3.

[0038] The evaluation value determination unit 6 determines the relative magnitudes of the inclusion area evaluation value E1, the reference frame equivalent evaluation value E2, and the extended area evaluation value E3. Based on the determination result, the evaluation value determination unit 6 selects the evaluation value E for the pixels within the reference frame F.

[0039] Next, the relationship between the reference frame F, the object OBJ, and the evaluation value calculated by the evaluation value determination unit 6 will be explained. In this embodiment, the size of the object OBJ is estimated based on the relative sizes of the inclusion area evaluation value E1, the reference frame conversion evaluation value E2, and the expanded area evaluation value E3, and the evaluation value E is determined based on the estimation result. In this embodiment, the size of the object OBJ is divided into the following cases 1 to 3, and the evaluation value E is calculated accordingly.

[0040] Case 1 Let's assume that the object OBJ is small enough to be contained within the containment area A1. Figure 6 schematically shows Case 1, which is an example of the relationship between the reference frame F and the object OBJ. In this case, the object OBJ is contained within both the containment area A1 and the extended area A2. Therefore, the containment area evaluation value E1 and the extended area evaluation value E3 can be expected to be the same value or an approximate value that can be considered the same value. On the other hand, the reference frame conversion evaluation value E2 will be a larger value than the containment area evaluation value E1 and the extended area evaluation value E3.

[0041] Therefore, if the standard frame conversion evaluation value E2 is greater than the inclusion area evaluation value E1 and the expanded area evaluation value E3, it can be determined that the object OBJ is of a size that is included in the inclusion area A1. In this case, the standard frame conversion evaluation value E2 is considered to be overestimating the area occupied by the object OBJ. Therefore, in Case 1, by using the inclusion area evaluation value E1 or the expanded area evaluation value E3 as the evaluation value E of the object OBJ, the proportion of the area occupied by the object OBJ within the standard frame F can be suitably reflected.

[0042] Case 2 Assume a case where the object OBJ does not fit within the inclusion area A1 but has a size that is included within the reference frame F. FIG. 7 is a diagram schematically showing Case 2, which is an example of the relationship between the reference frame F and the object OBJ. In this case, since the object OBJ extends outside the inclusion area A1, it is assumed that the extended area evaluation value E3 is larger than the inclusion area evaluation value E1. Also, since the area of the portion of the object OBJ that does not fit within the inclusion area A1 but protrudes within the reference frame F is small, the reference frame conversion evaluation value E2 calculated by dividing the inclusion area evaluation value E1 by the coefficient α = 0.95 is assumed to be larger than the inclusion area evaluation value E1 and the extended area evaluation value E3.

[0043] Therefore, when the reference frame conversion evaluation value E2 is the largest and the inclusion area evaluation value E1 is the smallest, that is, when E1 < E3 < E2, it can be determined that the object OBJ does not fit within the inclusion area A1 but has a size that is included within the reference frame F. At this time, it is considered that the inclusion area evaluation value E1 underestimates the area occupied by the object OBJ, and the reference frame conversion evaluation value E2 overestimates the area occupied by the object OBJ. Therefore, in Case 2, by using the extended area evaluation value E3 as the evaluation value E of the object OBJ, the ratio of the area occupied by the object OBJ within the reference frame F can be suitably reflected.

[0044] Case 3 Assume a case where the object OBJ extends outside the reference frame F. FIG. 8 is a diagram schematically showing Case 3, which is an example of the relationship between the reference frame F and the object OBJ. In this case, the object OBJ occupies the area within the reference frame F and also occupies all or part of the extended area A2. Therefore, the extended area evaluation value E3 is larger than the inclusion area evaluation value E1 and the reference frame conversion evaluation value E2. Note that, similar to Case 2, the reference frame conversion evaluation value E2 is larger than the inclusion area evaluation value E1.

[0045] Therefore, when the extended region evaluation value E3 is the largest and the inclusion region evaluation value E1 is the smallest, that is, when E1 < E2 < E3, it can be determined that the object OBJ extends outside the reference frame F. At this time, it is considered that the inclusion region evaluation value E1 underestimates the region occupied by the object OBJ. Also, since the extended region evaluation value E3 incorporates many pixel values outside the reference frame F, it is considered that the evaluation value of the object OBJ within the reference frame F is an excessive value. Therefore, in Case 3, by using the reference frame conversion evaluation value E2 as the evaluation value E of the object OBJ, the ratio of the region occupied by the object OBJ within the reference frame F can be suitably reflected.

[0046] Next, the evaluation value calculation operation in the information processing apparatus 100 will be described. FIG. 9 is a flowchart showing the evaluation value calculation operation in the information processing apparatus according to the first embodiment.

[0047] Step S1 The data reading unit 1 reads the target image data IMG that is the target of evaluation value calculation.

[0048] Step S2 The reference frame setting unit 2 sets the reference frame F in the pixel array in the target image data IMG. In this example, the reference frame F is arranged so that the upper left end of the reference frame F coincides with the upper left end of one pixel. In this example, 16 pixels are included in the reference frame F, and these 16 pixels constitute the inclusion region A1. And right side On the left and lower sides, the reference frame F crosses 9 pixels. Therefore, the extended region A2 includes 16 + 9 = 25 pixels.

[0049] Step S3 The inclusion region evaluation value calculation unit 3 calculates the total value of the pixel values of the pixels included in the inclusion region A1 as the inclusion region evaluation value E1.

[0050] Step S4 The reference frame conversion evaluation value calculation unit 4 calculates, as the reference frame conversion evaluation value E2, a value obtained by dividing the sum of the pixel values included in the reference frame F by a predetermined coefficient α. Here, α is set to 0.95.

[0051] Step S5 The extended area evaluation value calculation unit 5 calculates, as the extended area evaluation value E3, the sum of the pixels included in the extended area A2.

[0052] Step S6 The evaluation value determination unit 6 determines whether the extended area evaluation value E3 is greater than the reference frame conversion evaluation value E2. Thereby, the evaluation value determination unit 6 can determine whether the size of the object OBJ corresponds to Case 3.

[0053] Step S7 When the extended area evaluation value E3 is greater than the reference frame conversion evaluation value E2, that is, when the size of the object OBJ corresponds to Case 3, the evaluation value determination unit 6 selects the reference frame conversion evaluation value E2 as the evaluation value E.

[0054] Step S8 When the extended area evaluation value E3 is less than or equal to the reference frame conversion evaluation value E2, that is, when the size of the object OBJ does not correspond to Case 3, the evaluation value determination unit 6 determines whether the difference between the extended area evaluation value E3 and the inclusion area evaluation value E1 is less than a predetermined value β. That is, the evaluation value determination unit 6 determines whether -β < E3 - E1 < β, or in other words, whether |E3 - E1| < β. Thereby, the evaluation value determination unit 6 can determine whether the size of the object OBJ corresponds to Case 1.

[0055] The evaluation value determination unit 6 may hold in advance information indicating the predetermined value β. Also, the information indicating the predetermined value β may be given to the evaluation value determination unit 6 via various input means and communication means. Further, the evaluation value determination unit 6 may obtain, as necessary, information indicating the predetermined value β stored in a storage device (not shown) directly or via a reading means (not shown).

[0056] Step S9 If the difference between the expanded area evaluation value E3 and the inclusion area evaluation value E1 is smaller than a predetermined value β, that is, if the size of the object OBJ corresponds to Case 1, the evaluation value determination unit 6 selects the inclusion area evaluation value E1 as the evaluation value E.

[0057] Step S10 If the difference between the expanded area evaluation value E3 and the inclusion area evaluation value E1 is greater than or equal to a predetermined value β, that is, if the size of the object OBJ corresponds to Case 2, the evaluation value determination unit 6 determines the expanded area evaluation value E3 as the evaluation value E in the reference frame F.

[0058] According to the above procedure, a suitable value E can be determined from the inclusion area evaluation value E1, the reference frame conversion evaluation value E2, and the expanded area evaluation value E3, depending on the size of the object OBJ within the reference frame F.

[0059] This makes it possible to calculate an evaluation value equivalent to, or close to, that of the reference image data REF, even for target image data IMG, which has a different pixel size than the reference image data REF.

[0060] As a result, it is possible to evaluate objects captured in image data using evaluation values ​​with equivalent or comparable accuracy, regardless of the imaging device used to acquire the image data.

[0061] Other embodiments Although the present disclosure has been described above with reference to embodiments, the present disclosure is not limited to the embodiments described above. Various modifications to the structure and details of the present disclosure can be made as can be understood by those skilled in the art within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0062] In the above-described embodiment, it was explained that the evaluation value E is determined to be one of the inclusion area evaluation value E1, the reference frame conversion evaluation value E2, or the expanded area evaluation value E3. In contrast, the evaluation value determination unit 6 may determine the evaluation value E as the value obtained by converting the inclusion area evaluation value E1 calculated for the inclusion area A1 to a value corresponding to the size of the reference frame F. The evaluation value determination unit 6 may also determine the evaluation value E as the reference frame conversion evaluation value E2 calculated based on the inclusion area evaluation value E1 and the coefficient α. Thus, the information processing device 100 consists of a data reading unit 1, a reference frame setting unit 2, an inclusion area evaluation value calculation unit 3, and a reference frame conversion evaluation value calculation unit 4 and extended area evaluation value calculation unit 5 A simpler configuration having the above may also be used.

[0063] In the above-described embodiment, the reference frame conversion evaluation value calculation unit 4 was described as calculating the reference frame conversion evaluation value E2 by dividing the total value of pixel values ​​contained within the reference frame F by a coefficient α, which is the value obtained by dividing the area of ​​the containing region A1 by the area of ​​the reference frame F. In contrast, although the calculation process is substantially the same, the reference frame conversion evaluation value calculation unit 4 may also calculate the reference frame conversion evaluation value E2 by multiplying the total value of pixel values ​​contained within the reference frame F by a coefficient, which is the value obtained by dividing the area of ​​the reference frame F by the area of ​​the containing region A1.

[0064] Although the evaluation value determination unit 6 has been described as determining the relative magnitude of two values ​​in steps S6 and S8 of Figure 9, the method for determining the relative magnitude of the values ​​is not limited to this. The evaluation value determination unit 6 may determine whether the first value is greater than the second value, as in step S6 of Figure 9, or whether the first value is greater than or equal to the second value. Furthermore, the evaluation value determination unit 6 may determine whether the first value is less than the second value, as in step S8 of Figure 9, or whether the first value is less than or equal to the second value. In other words, when determining the relative magnitude of two values, the evaluation value determination unit 6 only needs to be able to distinguish at least when the first value is greater than the second value and when it is less than or equal to the second value. When the first value and the second value are equal, the evaluation value determination unit 6 may perform the same processing as when the first value is greater than the second value, or it may perform the same processing as when the first value is less than the second value.

[0065] In the above-described embodiment, the data reading unit 1 was described as reading target image data IMG from the imaging device 1100, but this is merely an example. For example, the data reading unit 1 may read target image data IMG that has been pre-stored in a storage device (not shown) as needed. The storage device in which the target image data IMG is stored may be part of the information processing device 100, or it may be provided separately from the information processing device 100. The image data and other information used by the information processing device 100 may be read as needed from the imaging device 1100 and part or all of a storage device that is part of the information processing device 100 or an external storage device.

[0066] The size and placement of the reference frame are merely examples; it can be any size as needed and placed at any position relative to the pixels of the target image data (IMG).

[0067] In the embodiments described above, the optical device according to the disclosure has been described primarily as a hardware configuration, but it is not limited thereto. It is also possible to realize the optical device according to the disclosure by having a computer execute a computer program to perform any processing. These processing may be realized by having a computer, which includes at least one processor (e.g., a microprocessor, CPU, GPU, MPU, or DSP (Digital Signal Processor)), execute a program. Specifically, one or more programs containing a set of instructions for causing a computer to perform algorithms related to these transmission signal processing or reception signal processing can be created and supplied to the computer.

[0068] Computer programs can be stored and supplied to a computer using various types of non-transitory computer-readable media. Non-transitory computer-readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, and semiconductor memory (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, and RAMs (random access memory)). Programs may also be supplied to a computer using various types of transient computer-readable media. Examples of transient computer-readable media include electrical signals, optical signals, and electromagnetic waves. Transitory computer-readable media can be supplied to a computer via wired communication channels such as electric wires and optical fibers, or via wireless communication channels.

[0069] The following shows an example of a computer configuration for realizing the information processing device 100. Figure 10 is a diagram showing an example of a computer configuration for realizing the information processing device 100. The information processing device 100 can be realized by a computer 9000 such as a dedicated computer or a personal computer (PC). However, the computer does not need to be physically single; there may be multiple computers when performing distributed processing. As shown in Figure 10, the computer 9000 has, for example, a processor 9001, ROM (Read Only Memory) 9002, RAM (Random Access Memory) 9003, a storage unit 9004, a communication interface 9005, and a user interface 9006.

[0070] The processor 9001, ROM 9002, RAM 9003, memory unit 9004, communication interface 9005, and user interface 9006 are interconnected via bus 9007, enabling them to communicate with each other. While the operating system software necessary to run the computer is not described here, it will be implemented in the computer 9000 as appropriate.

[0071] ROM is composed of, for example, non-volatile semiconductor memory devices. ROM 9002 stores information such as various programs used by the computer 9000.

[0072] The storage unit 9004 is composed of various storage devices, such as hard disks and solid-state disks. Furthermore, the storage unit 9004 is not limited to storage devices installed in the computer 9000, but may also be external storage devices. External storage devices may include various communication means, such as cloud storage connected to the computer 9000 via a network. The storage unit 9004 stores information such as various programs and data used by the computer 9000.

[0073] RAM 9003 is composed of volatile semiconductor memory devices. Programs and data used by the processor 9001 are loaded into RAM 9003 as needed from either ROM 9002 or memory unit 9004, or both.

[0074] The processor 9001 may be composed of, for example, a CPU (Central Processing Unit). Alternatively, the processor 9001 may include not only a CPU but also a GPU (Graphics Processing Unit). A GPU is suitable for parallel processing of routine tasks, and by applying it to, for example, neural network processing, it is possible to improve processing speed compared to a CPU. The processor 9001 executes various processes as appropriate, based on various programs stored in the ROM 9002 or various programs and data held in the RAM 9003. The processor 9001 may also store the data generated by the processing in the RAM 9003 or the storage unit 9004 as appropriate.

[0075] The communication interface 9005 is an interface that connects the computer 9000 to a communication network such as the Internet or an intranet via various wired or wireless communication means. This allows the computer 9000 to communicate with other devices, systems, and sensors connected to the communication network.

[0076] The user interface 9006 includes, for example, a display unit that provides information so that the user can perceive it, such as through a display device, and an audio output unit that provides audio. The user interface 9006 also includes an input unit that allows the user to input information into the computer 9000 through user operation, such as a keyboard, mouse, and touch panel. Furthermore, the user interface 9006 may include devices such as sensors that acquire information useful to the user.

[0077] Here, the computer 9000 is described as a single device, but this is merely an example. The computer 9000 may consist of multiple physically separate devices. Some of these devices may be portable, while others may be stationary.

[0078] Although the present disclosure has been described above with reference to embodiments, the present disclosure is not limited to the embodiments described above. Various modifications to the structure and details of the present disclosure can be made as can be understood by those skilled in the art within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0079] Each drawing is merely illustrative to illustrate one or more embodiments. Each drawing may be associated with one or more other embodiments rather than with only one specific embodiment. As those skilled in the art will understand, various features or steps described with reference to any one drawing can be combined with features or steps shown in one or more other drawings, for example, to create embodiments not explicitly shown or described. Not all features or steps shown in any one drawing to illustrate an exemplary embodiment are necessarily required, and some features or steps may be omitted. The order of steps shown in any of the drawings may be changed as appropriate. [Explanation of Symbols]

[0080] 1. Data reading unit 2. Reference frame setting section 3. Inclusion Area Evaluation Value Calculation Unit 4. Calculation unit for evaluation value converted to standard framework 5. Extended Area Evaluation Value Calculation Unit 6. Evaluation Value Determination Unit 100 Information Processing Devices 1000 optical equipment 1100 Imaging device 1200 samples 9000 Computers 9001 Processor 9002 ROM 9003 RAM 9004 Storage section 9005 Communication Interface 9006 User Interface 9007 Bus A1 Inclusion area A2 expansion area E1 Inclusion Area Evaluation Value E2 Standard Framework Equivalent Evaluation Value E3 Extended Domain Evaluation Value F Standard Frame IMG Target Image Data OBJ object REF reference image data

Claims

1. A data reading unit that reads the target image data captured from the sample, A reference frame setting unit sets a reference frame for the target image data, which is defined to include an integer number of pixels of reference image data that have different pixel sizes from the target image data. A first evaluation value calculation unit calculates a first evaluation value based on pixels included within the reference frame in the target image data, A second evaluation value calculation unit calculates a second evaluation value based on the first evaluation value and a predetermined coefficient based on the relationship between the area of ​​the region consisting of pixels contained within the reference frame in the target image data and the area of ​​the reference frame. A third evaluation value calculation unit calculates a third evaluation value based on the pixels included within the reference frame and the pixels partially included within the reference frame in the target image data. The system includes an evaluation value determination unit that determines one of the first to third evaluation values ​​as the evaluation value calculated for the reference frame based on the relative magnitudes of the first to third evaluation values, Information processing device.

2. The evaluation value determination unit, If the third evaluation value is greater than the second evaluation value, the second evaluation value is determined to be the evaluation value calculated for the reference frame. When the third evaluation value is smaller than the second evaluation value, If the difference between the third evaluation value and the first evaluation value is smaller than a predetermined value, the first evaluation value is determined to be the evaluation value calculated for the standard frame. If the difference between the third evaluation value and the first evaluation value is greater than a predetermined value, the third evaluation value is determined to be the evaluation value calculated for the standard frame. The information processing apparatus according to claim 1.

3. The evaluation value determination unit determines the second evaluation value as the evaluation value calculated for the reference frame when the third evaluation value and the second evaluation value are equal. The information processing apparatus according to claim 2.

4. The evaluation value determination unit determines the first evaluation value or the third evaluation value as the evaluation value calculated for the reference frame when the third evaluation value is less than or equal to the second evaluation value and the difference between the third evaluation value and the first evaluation value is equal to the predetermined value. The information processing apparatus according to claim 2.

5. The evaluation value determination unit determines the first evaluation value or the third evaluation value as the evaluation value calculated for the reference frame when the third evaluation value is smaller than the second evaluation value and the difference between the third evaluation value and the first evaluation value is equal to the predetermined value. The information processing apparatus according to claim 3.

6. The first and third evaluation value calculation units calculate the first and third evaluation values, respectively, based on the sum of the pixel values ​​of the pixels to be calculated. The information processing apparatus according to claim 1 or 2.

7. The first and third evaluation value calculation units calculate the first and third evaluation values, respectively, by removing the background component from the sum of the pixel values ​​of the pixels to be calculated. The information processing apparatus according to claim 6.

8. The aforementioned reference frame is a rectangular area, The reference frame setting unit sets the reference frame such that the vertices of the rectangle coincide with the vertices of one of the pixels. The information processing apparatus according to claim 1 or 2.

9. The predetermined coefficient is the value obtained by dividing the area of ​​the region consisting of pixels contained within the reference frame in the target image data by the area of ​​the reference frame. The information processing apparatus according to claim 1 or 2.

10. The predetermined coefficient is the value obtained by dividing the area of ​​the region consisting of pixels contained within the reference frame in the target image data by the area of ​​the reference frame. The second evaluation value calculation unit calculates the second evaluation value by dividing the first evaluation value by the predetermined coefficient. The information processing apparatus according to claim 1 or 2.

11. A data reading unit that reads the target image data captured from the sample, A reference frame setting unit sets a reference frame for the target image data, which is defined to include an integer number of pixels of reference image data that have different pixel sizes from the target image data. A first evaluation value calculation unit calculates a first evaluation value based on pixels included within the reference frame in the target image data, A second evaluation value calculation unit calculates a second evaluation value based on the first evaluation value and a predetermined coefficient based on the relationship between the area of ​​the region consisting of pixels contained within the reference frame in the target image data and the area of ​​the reference frame. The system includes an evaluation value determination unit that determines the second evaluation value as the evaluation value calculated for the reference frame, Information processing device.

12. The target image data obtained by imaging the sample is read, A reference frame is defined to include an integer number of pixels from a reference image data whose pixel size differs from that of the aforementioned target image data, and this reference frame is set for the aforementioned target image data. A first evaluation value is calculated based on the pixels contained within the reference frame in the target image data. A second evaluation value is calculated based on the first evaluation value and a predetermined coefficient based on the relationship between the area of ​​the region consisting of pixels contained within the reference frame in the target image data and the area of ​​the reference frame. In the aforementioned target image data, a third evaluation value is calculated based on the pixels that are included within the reference frame and the pixels that are partially included within the reference frame. Based on the relative magnitudes of the first to third evaluation values, one of the first to third evaluation values ​​is determined as the evaluation value calculated for the standard frame. Information processing methods.

13. The process involves reading the target image data captured from the sample, A process of setting a reference frame for the target image data, defined to include an integer number of pixels from a reference image data whose pixel size differs from that of the target image data, A process for calculating a first evaluation value based on the pixels contained within the reference frame in the target image data, A process for calculating a second evaluation value based on the first evaluation value and a predetermined coefficient based on the relationship between the area of ​​the region consisting of pixels contained within the reference frame in the target image data and the area of ​​the reference frame, A process for calculating a third evaluation value based on the pixels included within the reference frame and the pixels partially included within the reference frame in the target image data, The computer is instructed to perform a process of determining one of the first to third evaluation values ​​as the evaluation value calculated for the reference frame, based on the relative magnitudes of the first to third evaluation values. program.

Images