Drawing processing device, drawing processing method, and program

Abstract

This does not reduce the reliability of extracting the difference between the reference connection area in the reference drawing and the comparison connection area in the comparison drawing. [Solution] The drawing processing device binarizes the luminance values ​​of multiple pixels included in the reference drawing and the comparison drawing, extracts multiple reference connected regions and multiple comparison connected regions defined by pixels with consecutive line drawing luminance values ​​from among the multiple pixels in the reference drawing and the comparison drawing, calculates feature quantities for each of the multiple reference connected regions and multiple comparison connected regions, combines the multiple reference connected regions and the comparison connected regions whose feature quantities are relatively close, and rotates the combined reference connected region and comparison connected region with respect to each other so that the difference between them becomes smaller.

Description

Technical Field

[0001] The present disclosure relates to a drawing processing apparatus, a drawing processing method, and a program.

Background Art

[0002] The drawing processing apparatus etc. described in Patent Document 1 aims to easily visually recognize the differences when comparing two drawing data (for example, paragraph 0005 of Patent Document 1). In order to achieve the above object, the drawing processing apparatus etc. specifies a reference drawing region that surrounds a drawing element that specifies the shape and dimensions of an object, which is included in the reference drawing data serving as a reference, and a comparison drawing region that surrounds the drawing element, which is included in the comparison drawing data to be compared (for example, claim 1 of Patent Document 1). Here, the drawing element is more specifically composed of lines (for example, outline lines, dimension lines, hidden lines, center lines, imaginary lines) and characters (for example, dimensions, tolerances, processing instructions) for specifying the shape and dimensions of parts etc. (for example, paragraph 0019 of Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, there may be a case where there are lines or characters that are not directly related to the above-described object (the above-described parts etc.) in the vicinity of the above-described drawing element, for example, in the vicinity of drawing element 11-1A (FIG. 5 of Patent Document 1), such as lines or characters indicating an assembly drawing (reference drawing) when assembled using the above-described parts etc.

[0005] On the other hand, the aforementioned reference drawing area is a polygon such as a quadrilateral (for example, paragraph 0032 of Patent Document 1), in other words, there is a margin (for example, the part of drawing area 10-1A in which the aforementioned drawing element 11-1A does not exist, that is, the part of drawing area 10-1A defined by dotted and solid lines (Figure 5 of Patent Document 1)).

[0006] Therefore, in the drawing processing device described above, the assembly drawing (reference drawing) may be included within the margins of the drawing area 10-1A, which is the reference drawing area, and as a result, the reliability of displaying the differences when comparing the reference drawing area and the comparison drawing area, which is the purpose described above, may be reduced.

[0007] The purpose of this disclosure is to provide a drawing processing device, a drawing processing method, and a program that do not reduce the reliability of extracting the difference between a reference connecting region in a reference drawing and a comparison connecting region in a comparison drawing. [Means for solving the problem]

[0008] To solve the above-mentioned problems, the drawing processing apparatus according to the present disclosure includes: a binarization unit that binarizes the luminance values ​​of a plurality of pixels included in a reference drawing and binarizes the luminance values ​​of a plurality of pixels included in a comparison drawing; an extraction unit that extracts a plurality of reference connected regions defined by pixels in the plurality of pixels in the reference drawing whose line drawing luminance values, of the two luminance values ​​obtained by the binarization, are consecutive, and extracts a plurality of comparison connected regions defined by pixels in the plurality of pixels in the comparison drawing whose line drawing luminance values ​​are consecutive; a calculation unit that calculates a feature quantity for each of the plurality of reference connected regions and calculates a feature quantity for each of the plurality of comparison connected regions; a combination unit that combines the plurality of reference connected regions and a reference connected region and a comparison connected region whose feature quantities are relatively close; and a rotation unit that rotates the combined reference connected region and the comparison connected region so that the difference between the combined reference connected region and the comparison connected region becomes smaller. [Effects of the Invention]

[0009] According to the drawing processing apparatus of this disclosure, (1) it is possible to avoid adverse effects on the calculation of feature quantities of the reference connection area or comparison connection area caused by lines or characters that are located near the reference connection area or comparison connection area but are not directly related to the reference connection area or comparison connection area; (2) the difference between the combined reference connection area and the comparison connection area can be made clearer with higher accuracy compared to the case where the rotation is not performed; and (3) data representing multiple reference connection areas and data representing multiple comparison connection areas can be used as part data to be used as reference when searching for other comparison drawings similar to other reference drawings. [Brief explanation of the drawing]

[0010] [Figure 1] The configuration of the drawing processing system ZSS according to the embodiment is shown. [Figure 2] The configuration of the drawing processing device ZS of the embodiment is shown. [Figure 3] The configuration of the terminal TM in this embodiment is shown. [Figure 4] This is a flowchart showing the operation of the drawing processing system ZSS according to the embodiment. [Figure 5] The pixel GS of the reference drawing KZ of the embodiment is shown. [Figure 6] This shows the binarization of the reference drawing KZ of the embodiment. [Figure 7] The binarized pixel GS and reference concatenation region KRR are shown in the reference drawing KZ of the embodiment. [Figure 8] The reference connection region KRR of the reference drawing KZ of the embodiment is shown. [Figure 9] The reference connecting regions KRR1, KRR2, and KRR3 of the reference drawing KZ of the embodiment are shown. [Figure 10] The comparative diagram of the embodiment shows the comparative linking regions HRR1, HRR2, and HRR3 of HZ. [Figure 11] The feature quantities TO of the reference concatenation region KRR and the feature quantities TO of the comparison concatenation region HRR of the embodiment are shown. [Figure 12] Shows the combination KU of the reference connection area KRR and the comparison connection area HRR in the embodiment. [Figure 13] Shows the combination KU1 of the reference connection area KRR1 and the comparison connection area HRR1 in the embodiment. [Figure 14] Shows the overlay KA of the reference connection area KRR1 and the comparison connection area HRR1 in the embodiment. [Figure 15] Shows the rotation KT of the reference connection area KRR1 and the comparison connection area HRR1 in the embodiment. [Figure 16] Shows the difference SB between the reference connection area KRR and the comparison connection area HRR1 in the embodiment. [Figure 17] Shows the hardware configuration of the drawing processing device ZS and the terminal TM in the embodiment. [Figure 18] Shows the hardware configuration based on the software implementation of the drawing processing device ZS and the terminal TM in the embodiment.

Mode for Carrying Out the Invention

[0011] An embodiment of the drawing processing system according to the present disclosure will be described.

[0012] 〈Embodiment〉 The drawing processing system ZSS in the embodiment will be described.

[0013] 〈Configuration of Embodiment〉 FIG. 1 shows the configuration of the drawing processing system ZSS in the embodiment.

[0014] As shown in FIG. 1, the drawing processing system ZSS in the embodiment includes a drawing processing device ZS and a terminal TM.

[0015] As shown in FIG. 1, the drawing processing device ZS and the terminal TM are interconnected via a network NW (for example, the Internet).

[0016] The drawing processing device ZS, in response to a request from the user US terminal TM, displays to the terminal TM the difference SB (e.g., shown in Figure 16) between the reference linkage region KRR (e.g., shown in Figure 11) in the reference drawing KZ (e.g., shown in Figure 11) and the comparison linkage region HRR (e.g., shown in Figure 11) in the comparison drawing HZ (e.g., shown in Figure 11).

[0017] Here, reference drawing KZ is the drawing used as the basis for comparison when making a comparison, while comparison drawing HZ is the drawing that is the subject of comparison when making the comparison.

[0018] Terminal TM is used by user US.

[0019] In the following, for the sake of ease of explanation and understanding, multiple names may be collectively referred to as a single name. For example, the reference linkage regions KRR1, KRR2, and KRR3 (shown in Figure 9) may be collectively referred to as the reference linkage region KRR.

[0020] <Configuration of the drawing processing device ZS> Figure 2 shows the configuration of the drawing processing device ZS according to the embodiment.

[0021] The drawing processing device ZS of the embodiment, as shown in Figure 2, includes an input / output unit NY(ZS), a processing unit SY(ZS), a storage unit KI(ZS), and a communication unit TU(ZS).

[0022] The input / output unit NY(ZS) is used, for example, by the administrator (not shown) of the drawing processing device ZS to perform input / output for monitoring and controlling the operation of the drawing processing device ZS. The input / output unit NY(ZS) is, for example, a keyboard, mouse, LCD monitor, or printer.

[0023] The processing unit SY(ZS) performs tasks such as binarizing the reference drawing KZ and comparison drawing HZ, extracting the reference linkage region KRR and comparison linkage region HRR, calculating the feature quantity TO of the reference linkage region KRR and comparison linkage region HRR, combining the reference linkage region KRR and comparison linkage region HRR, rotating between the reference linkage region KRR and comparison linkage region HRR, and extracting the difference SB between the reference linkage region KRR and comparison linkage region HRR.

[0024] The memory unit KI(ZS) stores, for example, data necessary for processing by the processing unit SY(ZS), and pre-stores, for example, multiple drawings ZM (including a reference drawing KZ and a comparison drawing HZ).

[0025] The communication unit TU(ZS) communicates via the network NW. For example, the communication unit TU(ZS) receives a request from the terminal TM to compare the reference drawing KZ and the comparison drawing HZ with each other, and also transmits the difference SB between the reference linkage area KRR and the comparison linkage area HRR to the terminal TM.

[0026] <Terminal™ Configuration> Figure 3 shows the configuration of the terminal TM in the embodiment.

[0027] As shown in Figure 3, the terminal TM of the embodiment includes an input / output unit NY(TM), a processing unit SY(TM), a storage unit KI(TM), and a communication unit TU(TM).

[0028] The input / output unit NY(TM) is used by the user US to use the terminal TM. Examples of input / output units NY(TM) include a keyboard, mouse, LCD monitor, and printer.

[0029] The processing unit SY(TM) performs, for example, requests the drawing processing unit ZS for the difference SB between the reference drawing KZ and the comparison drawing HZ, and displays the difference SB between the reference drawing KZ and the comparison drawing HZ, received from the drawing processing unit ZS, on the input / output unit NY(TM).

[0030] The memory unit KI(TM) stores, for example, the data necessary for processing by the processing unit SY(TM).

[0031] The communication unit TU(TM) communicates via the network NW. For example, the communication unit TU(TM) sends a request to the drawing processing device ZS to compare the reference drawing KZ and the comparison drawing HZ, and receives the difference SB between the reference linkage area KRR and the comparison linkage area HRR from the drawing processing device ZS.

[0032] <Correspondence> The processing unit SY(ZS) of the drawing processing device ZS corresponds to the "binarization unit," "extraction unit," "calculation unit," "combination unit," and "rotation unit."

[0033] <Operation of the Embodiment> Figure 4 is a flowchart showing the operation of the drawing processing system ZSS according to the embodiment.

[0034] Figure 5 shows the pixel GS of the reference drawing KZ of the embodiment.

[0035] Figure 6 shows the binarization of the reference drawing KZ of the embodiment.

[0036] Figure 7 shows the binarized pixel GS and reference concatenation region KRR of the reference drawing KZ of the embodiment.

[0037] Figure 8 shows the reference connection region KRR of the reference drawing KZ of the embodiment.

[0038] Figure 9 shows the reference connection regions KRR1, KRR2, and KRR3 of the reference drawing KZ of the embodiment.

[0039] Figure 10 shows the comparative linking regions HRR1, HRR2, and HRR3 of the HZ comparative drawing of the embodiment.

[0040] Figure 11 shows the feature quantities TO of the reference concatenation region KRR and the comparison concatenation region HRR in the embodiment.

[0041] Figure 12 shows the combination KU of the reference linkage region KRR and the comparison linkage region HRR in the embodiment.

[0042] Figure 13 shows the combination KU1 of the reference linkage region KRR1 and the comparison linkage region HRR1 of the embodiment.

[0043] Figure 14 shows the superposition KA of the reference linkage region KRR1 and the comparison linkage region HRR1 of the embodiment.

[0044] Figure 15 shows the rotation KT between the reference connection region KRR1 and the comparison connection region HRR1 in the embodiment.

[0045] Figure 16 shows the difference SB between the reference linkage region KRR and the comparison linkage region HRR1 in the embodiment.

[0046] The operation of the drawing processing system ZSS of this embodiment will be described with reference to Figures 4 to 16.

[0047] In the following explanation, for the sake of clarity and ease of understanding, we will assume that a user US (shown in Figure 1) identifies a reference drawing KZ (for example, shown in Figure 9) and a comparison drawing HZ (for example, shown in Figure 10) from among the image data of multiple drawings ZM (shown in Figure 2) stored in the memory unit KI(ZS) (shown in Figure 2) of the drawing processing device ZS (shown in Figure 1) via a terminal TM (shown in Figure 1), and requests the difference SB (shown in Figure 16) between the reference drawing KZ and the comparison drawing HZ.

[0048] Here, multiple drawings ZM (including reference drawing KZ and comparison drawing HZ) have multiple pixels GS (e.g., pixels GS1, GS2, GS3, ...) as shown in Figure 5, and each pixel GS has, for example, one of 246 luminance values.

[0049] Step ST10: User US specifies the reference drawing KZ and the comparison drawing HZ from among multiple drawings ZM to the drawing processing device ZS from the terminal TM.

[0050] In the drawing processing device ZS, the processing unit SY(ZS), acting as a binarization unit, binarizes the luminance values ​​of multiple pixels GS (e.g., GS1, GS2, GS3, ..., GS(m-1), GSm) included in the reference drawing KZ, as is evident from the comparison between Figure 5 (before binarization) and Figure 6 (after binarization).

[0051] The processing unit SY(ZS), similar to the binarization of the reference drawing KZ, acts as a binarization unit, binarizing the luminance values ​​of multiple pixels (e.g., GS1, GS2, GS3, ..., GS(m-1), GSm) included in the comparison drawing HZ.

[0052] Here, "binarization" refers to, for example, maintaining or converting the luminance value of each pixel GS in the reference drawing KZ and comparison drawing HZ to a luminance value of "white" if the luminance value is between "white" and "gray" (intermediate between white and black), while converting or maintaining the other luminance values, between "white" and "black" (intermediate between white and black), to a luminance value of "black". In other words, pixels below a predetermined luminance threshold are converted to white, and pixels above the threshold are converted to black. The threshold can be set arbitrarily; for example, all pixels that are not white may be made black, or conversely, all pixels that are not black may be made white. Here, before or after the binarization process, the processing unit SY(ZS) may perform dilation of the lines in the reference drawing and / or comparison drawing. For example, lines may be thickened by converting or maintaining the brightness value of all adjacent pixels to the brightness value "black" before binarization, where the brightness value is "gray to black" (pixels whose brightness exceeds the threshold). Alternatively, lines may be thickened by converting or maintaining the brightness value of adjacent pixels to the brightness value "black" after binarization. Furthermore, lines may be thickened not only by converting adjacent pixels to black, but also by converting pixels adjacent to pixels with a predetermined brightness value before or after binarization to black, so that the line becomes a fixed thickness. By thickening lines, it is possible to connect lines that are unintentionally broken (not continuous) on the drawing due to, for example, the original drawing being too light in color or the lines being too thin, thereby improving the accuracy of extracting connected regions.

[0053] "Binarization" also refers to, for example, maintaining the luminance value "white" for each pixel GS in the reference drawing KZ and comparison drawing HZ, while converting or maintaining other luminance values, such as "gray to black that is very close to white," to the luminance value "black."

[0054] Here, the maintained or converted luminance value "black" is referred to as the "luminance value for line drawings" used to draw line drawings.

[0055] Step ST20: In the drawing processing device ZS, the processing unit SY(ZS), as an extraction unit, defines a reference connected region KRR1 by line segments SE1, SE2, SE3, SE4 that virtually pass through pixels GS1, GS2, GS3, ..., GS(m-1), GSm, among multiple pixels GS in the reference drawing KZ, where the above-mentioned "luminance value for line drawing" (i.e., luminance value "black") is continuous, as shown in Figure 7, and extracts the reference connected region KRR1 as shown in Figure 8.

[0056] Similarly, the processing unit SY(GS) extracts other reference connection regions KRR2 and KKR3 from the reference drawing KZ, as shown in Figure 9, and as a result extracts multiple reference connection regions KRR1 to KRR3 from the reference drawing KZ. A connection region can be a ring-shaped region such as a polygon, circle, or ellipse enclosed by continuous lines (straight or curved). Through this connection region extraction process, for example, lines or characters that exist in the vicinity of reference connection region KRR1 but are not directly related to reference connection region KRR1 will not be extracted as reference connection regions KRR1 to KRR3.

[0057] The processing unit SY(ZS) extracts multiple comparison link regions HRR1 to HRR3 in the comparison drawing HZ, as shown in Figure 10, similar to the extraction of reference link regions KRR1 to KRR3 in the reference drawing KZ.

[0058] Step ST30: In the drawing processing device ZS, the processing unit SY(ZS), as a calculation unit, calculates the respective feature quantities TO of the reference connected regions KRR1 to KRR3 in the reference drawing KZ, namely feature quantity TO(KRR1), feature quantity TO(KRR2), and feature quantity TO(KRR3), in the same manner as previously known, as shown in Figure 11 (upper half).

[0059] The method for calculating the feature vector (TO) is not particularly limited, but for example, by inputting data from the reference connected region and the comparison connected region into a feature inference model, features (e.g., feature vectors) can be calculated (inferred). The inference model can be one that applies, for example, a neural network, but any machine learning model can be used. Such inference models are stored in memory beforehand. The number of inference models is not limited to one; for example, multiple inference models with different conditions, such as machine learning methods or differences in data, may be stored and used selectively or in parallel. The feature inference model is machine-learned so that the similarity between the reference connected region and the comparison connected region increases as they become more similar. Similarity is defined, for example, by the distance between the features of the images, and distance metrics such as Euclidean distance and Manhattan distance, or similarity metrics such as cosine similarity may be used.

[0060] Features (feature information) are output as vector data consisting of fixed-length numerical arrays, for example, but are not limited to vector format and may be output in other data formats. Features may include, for example, SIFT features, SURF features, ORB features, AKAZE features, etc.

[0061] Similarly, the processing unit SY(ZS), as a calculation unit, calculates the respective feature quantities TO of the comparison linkage regions HRR1 to HRR3 in the comparison drawing HZ, namely feature quantity TO(HRR1), feature quantity TO(HRR2), and feature quantity TO(HRR3), as shown in Figure 11 (lower half).

[0062] Step ST40: In the drawing processing device ZS, the processing unit SY(ZS) combines one of the reference connection regions KRR1~KRR3 and one of the comparison connection regions HRR1~HRR3 from among the multiple reference connection regions KRR1~KRR3 and multiple comparison connection regions HRR1~HRR3, as shown in Figures 11 and 12, where the feature quantity TO is relatively close. For example, the processing unit SY(ZS) determines the combination of feature quantities TO that are relatively close based on the similarity obtained by comparing the feature quantities of each connection region. That is, it calculates the similarity of all combinations of the multiple reference connection regions KRR1~KRR3 and multiple comparison connection regions HRR1~HRR3, and for each of the reference connection regions KRR1~KRR3, it selects one of the comparison connection regions HRR1~HRR3 with the highest similarity.

[0063] Here, we assume the following: (1) The feature TO(KRR1) of the reference linked region KRR1 is closest to the feature TO(HRR1) of the comparison linked region HRR1~HRR3, specifically the feature TO(HRR1)~TO(HRR3). (2) The feature TO(KRR2) of the reference connection region KRR2 is closest to the feature TO(HRR1)~TO(HRR3) of the comparison connection region HRR1~HRR3. (3) The feature TO(KRR3) of the reference connection region KRR1 is closest to the feature TO(HRR1)~TO(HRR3) of the comparison connection region HRR1~HRR3.

[0064] Under the above assumptions, the processing unit SY(ZS) establishes, as shown in Figure 12, (1) combination KU1 between the reference connection region KRR1 and the comparison connection region HRR1, (2) combination KU2 between the reference connection region KRR2 and the comparison connection region HRR2, and (3) combination KU3 between the reference connection region KRR3 and the comparison connection region HRR3.

[0065] Step ST50: In the drawing processing device ZS, the processing unit SY(ZS) superimposes, for example, the reference linking region KRR1 and the comparison linking region HRR1, which are the targets of combination KU1, onto each other, as shown in Figures 13 and 14, i.e., performs superposition KA.

[0066] The superposition KA is performed, for example, so that the centroid (not shown) of the reference connection region KRR1 coincides with the centroid (not shown) of the comparison connection region HRR1, or so that the center (not shown) of the reference connection region KRR1 coincides with the center (not shown) of the comparison connection region HRR1. Alternatively, the superposition may be performed so that points other than the centroid or center, such as specific corners, coincide.

[0067] After the superposition KA described above, the processing unit SY(ZS) performs rotation KT between the reference connection region KRR1 and the comparison connection region HRR1, as shown in Figures 14, 15, and 16, so that the differences SB1 and SB2 between the reference connection region KRR1 and the comparison connection region HRR1, which are the targets of the superposition KA, become smaller. More specifically, the processing unit SY(ZS) reduces the differences SB1 and SB2 between the reference connection region KRR1 and the comparison connection region HRR1 by, for example, keeping the orientation of the reference connection region KRR1 fixed and rotating the orientation of the comparison connection region HRR1. In this case, the orientation of the comparison connection region HRR1 may be rotated around the center of gravity of the reference connection region KRR1 while keeping the orientation of the reference connection region KRR1 fixed. Alternatively, the orientation of the comparison connection region HRR1 may be rotated around the center of gravity of the reference connection region KRR1. Furthermore, the processing unit SY(ZS) may calculate the differences SB1 and SB2 between the reference connection region KRR1 and the comparison connection region HRR1 before rotation, and repeatedly calculate the differences SB1 and SB2 by rotating the orientation of the comparison connection region HRR1 little by little in the left and right directions over a predetermined range (for example, a range of 10° to the left and right, 15° to the right, 20° to the left and right from the initial state, which can be arbitrarily set) in predetermined angles (for example, 0.5°, 1°, 3° from the initial state, which can be arbitrarily set), and determine the angle at which the total area of ​​the differences SB1 and SB2 is smallest as the final rotation angle. In other words, if the state before rotation has the smallest total area of ​​the differences SB1 and SB2, the state before rotation may become the final angle. The reference point for rotation is not limited to the center of gravity, but may also be other points such as the corners of the reference connection region of the polygon or the intersection of the diagonals.

[0068] The processing unit SY(ZS) may, as a size adjustment unit, perform size adjustment processing before or after rotation processing, or in place of rotation processing. For example, it may compare the area of ​​difference SB1 (the total area of ​​multiple difference SB1s if there are multiple difference SB1s) where the comparison connection region HRR1 is larger than the reference connection region KRR1 (the total area of ​​multiple difference SB2s if there are multiple difference SB2s), and if a predetermined ratio condition is met (for example, 2 times or more, 5 times or more, 10 times or more, 0.5 times or less, 0.1 times or less, etc., which can be set arbitrarily), it may enlarge or reduce the comparison connection region HRR1 so that the difference becomes smaller. The size adjustment may be performed, for example, by enlarging or reducing the comparison connection region HRR1 so that it becomes a similar shape (i.e., the same shape) based on the position of the centroid of the comparison connection region HRR1. Alternatively, the comparison linking region HRR1 may be enlarged or reduced within a predetermined range at predetermined magnifications (which can be arbitrarily set to 0.001x, 0.01x, 0.1x, etc.), the areas of difference SB1 and difference SB2 may be calculated, and the magnification that results in the area ratio of difference SB1 to difference SB2 closest to 1 may be determined as the final magnification. The reference point for size adjustment is not limited to the centroid, but may also be other points such as the corners of the reference linking region of the polygon or the intersection of the diagonals.

[0069] Alternatively, the processing unit SY(ZS) may compare the area of ​​the comparison linkage region HRR1 with the area of ​​the reference linkage region KRR1 and perform size adjustment processing so that the areas are the same, or the difference in area is less than or equal to a predetermined value (for example, a percentage of the area of ​​the reference linkage region, or the absolute value of the area, which can be set arbitrarily).

[0070] Here, as shown in Figure 16, difference SB1 is the portion where the comparison-connected region HRR1 is larger than the reference-connected region KRR1 (convex portion), while difference SB2 is the portion where the comparison-connected region HRR1 is smaller than the reference-connected region KRR1 (concave portion). The method for calculating and evaluating the difference (degree of image overlap) is not particularly limited, but for example, the IoU (Intersection over Union) evaluation index can be used. The IoU evaluation index is an index that shows the degree of overlap between two regions. The IoU evaluation index is the value obtained by dividing the common part of the two regions by the union of those regions. For example, the IoU evaluation index takes a value between 0 and 1, and the closer the value is to 1, the closer the two regions are evaluated to be. The method for calculating and evaluating the difference is not limited to the IoU evaluation index, and any evaluation index can be used, for example, the DICE coefficient, the distance between the centers of the regions, the area of ​​the region, the aspect ratio, etc.

[0071] The processing unit SY(ZS) performs superposition KA and rotation KT on the reference linking region KRR2 and comparison linking region HRR2, which are the targets of combination KU2, and on the reference linking region KRR3 and comparison linking region HRR3, which are the targets of combination KU3, in the same manner as described above.

[0072] Step ST60: In the drawing processing device ZS, the processing unit SY(ZS) extracts the differences SB1 and SB2 between the reference linkage region KRR1 and the comparison linkage region HRR1 in the same manner as conventionally known, as shown in Figure 16, i.e., identifies the differences SB1 and SB2.

[0073] After the extraction described above, the processing unit SY(ZS) transmits the reference linkage region KRR1, the comparison linkage region HRR1, and the differences SB1 and SB2 between the reference linkage region KRR1 and the comparison linkage region HRR1, as shown in Figure 16, from the communication unit TU(ZS) to the drawing processing unit ZS.

[0074] In terminal TM, the processing unit SY(TM) displays the above-mentioned reference linkage area KRR1, comparison linkage area HRR1, and the differences SB1 and SB2 between the reference linkage area KRR1 and the comparison linkage area HRR1 on the input / output unit NY(TM).

[0075] The processing unit SY(ZS), the communication unit TU(ZS), and the processing unit SY(TM) perform the extraction, transmission, and display described above for the reference linkage area KRR2 and comparison linkage area HRR2, which are the target of combination KU2, and for the reference linkage area KRR3 and comparison linkage area HRR3, which are the target of combination KU3.

[0076] <Effects of the Embodiment> As described above, the drawing processing system ZSS of the embodiment has the following effects. (1) For example, lines or characters that exist in the vicinity of the reference connection region KRR1 but are not directly related to the reference connection region KRR1 can be prevented from negatively affecting the calculation of the feature TO(KRR1) of the reference connection region KRR1.

[0077] (2) For example, the differences SB1 and SB2 between the reference connection region KRR1 and the comparison connection region HRR1, which are the targets of combination KU1, can be clearly defined with higher accuracy compared to the case where the rotation KT described above is not performed.

[0078] (3) Data representing multiple reference linkage regions KRR1 to KRR3, and data representing multiple comparison linkage regions HRR1 to HRR3, can be used as reference component data when searching for other comparison drawings (comparison drawings HZ other than comparison drawing HZ) that are similar to other reference drawings (reference drawings other than reference drawing KZ).

[0079] <Hardware configuration of the embodiment> Figure 17 shows the hardware configuration of the drawing processing device ZS and terminal TM according to the embodiment.

[0080] The drawing processing apparatus ZS and terminal TM of the embodiment include a processing circuit SYO, as shown in Figure 16, to perform the functions described above, and optionally further include an input circuit NYU and an output circuit SYU.

[0081] The processing circuit SYO is dedicated hardware. The processing circuit SYO implements the functions of the drawing processing device ZS, the terminal TM's processing unit SY(ZS), and the processing unit SY(TM) (shown in Figures 2 and 3).

[0082] The processing circuit SYO can be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or a combination of these.

[0083] The input circuit NYU and output circuit SYU exchange inputs and outputs related to the operation of the processing circuit SYO with, for example, the drawing processing device ZS and the outside of the terminal TM.

[0084] <Hardware configuration based on software implementation of the embodiment> Figure 18 shows the hardware configuration based on the software implementation of the drawing processing device ZS and terminal TM of the embodiment.

[0085] The embodiment of the processing apparatus ZS, terminal TM, as shown in Figure 18, includes a processor PRO and a memory circuit KIO, and optionally further includes an input circuit NYU and an output circuit SYU.

[0086] The processor PRO is a CPU (also known as a Central Processing Unit, processing unit, arithmetic unit, microprocessor, microcomputer, or DSP (Digital Signal Processing)) that executes programs. The processor PRO implements the functions of the drawing processing unit ZS, the terminal TM's processing unit SY(ZS), and the processing unit SY(TM) (shown in Figures 2 and 3).

[0087] Processor PRO implements the above-mentioned functions through software, firmware, or a combination of software and firmware. The software and firmware are written as a program PRG and stored in the memory circuit KIO.

[0088] The processor PRO achieves the above-described functions by reading and executing the program PRG described above from the memory circuit KIO. The program PRG described above can also be said to cause the computer to execute the procedures and methods of the drawing processing unit ZS, the terminal TM's processing unit SY(ZS), and the processing unit SY(TM).

[0089] Here, memory circuits (KIO) include, for example, non-volatile or volatile semiconductor memories such as RAM (Random Access Memory), ROM (Read Only Memory), flash memory, EPROM (Erasable Programmable Read Only Memory), and EEPROM (Electrically Erasable Programmable Read-Only Memory), as well as magnetic disks, flexible disks, optical disks, compact disks, minidiscs, DVDs (Digital Versatile Discs), etc.

[0090] Some of the functions of the drawing processing device ZS, the terminal TM's processing unit SY(ZS), and processing unit SY(TM) may be implemented by the processing circuit SYO (shown in Figure 17), while other functions may be implemented by the processor PRO (shown in Figure 18).

[0091] As described above, the functions of the drawing processing unit ZS, the terminal TM's processing unit SY(ZS), and the processing unit SY(TM) can be realized through hardware, software, firmware, or a combination thereof.

[0092] The input circuit NYU and output circuit SYU exchange inputs and outputs related to the operation of the processor PRO with, for example, the drawing processing device ZS and the outside of the terminal TM.

[0093] <Example of structure> The drawing processing device, drawing processing method, and program relating to this disclosure have, for example, the following configuration.

[0094] [Item 1] A binarization unit that binarizes the luminance values ​​of multiple pixels included in the reference drawing, and also binarizes the luminance values ​​of multiple pixels included in the comparison drawing, An extraction unit extracts a plurality of reference connected regions defined by consecutive pixels among the plurality of pixels in the reference drawing, where the line drawing luminance values ​​used to draw the line drawing are among the two luminance values ​​of the binarization, and extracts a plurality of comparison connected regions defined by consecutive pixels among the plurality of pixels in the comparison drawing, A calculation unit that calculates feature quantities for each of the plurality of reference connected regions, and calculates feature quantities for each of the plurality of comparison connected regions, A combination unit that combines the aforementioned plurality of reference connection regions and a comparison connection region among the plurality of reference connection regions in which the feature quantities are relatively close, A rotating part rotates the combined reference linkage region and the comparison linkage region so that the difference between the combined reference linkage region and the comparison linkage region becomes smaller, A drawing processing device that includes [a specific component]. [Item 2] The drawing processing apparatus according to claim 1, wherein the rotating part rotates the reference connecting region or the comparison connecting region around the center of gravity of the reference connecting region. [Item 3] The drawing processing apparatus according to claim 1 or 2, wherein the rotating part rotates the reference connecting region or the comparison connecting region by predetermined angles within a predetermined range of angles, repeatedly calculates the difference, and determines the angle with the smallest difference as the rotation angle. [Item 4] The drawing processing apparatus according to claim 1 or 2, further comprising a size adjustment unit that adjusts the size of the comparison linkage region so that the difference between the combined reference linkage region and the comparison linkage region becomes smaller. [Item 5] The drawing processing apparatus according to claim 4, wherein the process of adjusting the size is performed before the process of rotating. [Item 6] The drawing processing apparatus according to claim 4, wherein the process of adjusting the size is performed after the process of rotating. [Item 7] The drawing processing apparatus according to claim 1 or 2, wherein the binarization unit performs a process of thickening lines included in at least one of the reference drawing and the comparison drawing. [Item 8] The drawing processing apparatus according to claim 7, wherein the line thickening process is performed before the binarization process. [Item 9] The drawing processing apparatus according to claim 7, wherein the line thickening process is performed after the binarization process. [Item 10] A binarization process that binarizes the luminance values ​​of multiple pixels included in the reference drawing, and also binarizes the luminance values ​​of multiple pixels included in the comparison drawing, Extraction steps include: extracting a plurality of reference connected regions defined by consecutive pixels among the plurality of pixels in the reference drawing, where the line drawing luminance values ​​used to draw the line drawing are among the two luminance values ​​of the binarization; and extracting a plurality of comparison connected regions defined by consecutive pixels among the plurality of pixels in the comparison drawing, where the line drawing luminance values ​​are among the consecutive pixels; A calculation step of calculating feature quantities for each of the plurality of reference connected regions, and calculating feature quantities for each of the plurality of comparison connected regions, A combination step of combining the plurality of reference connection regions, and a reference connection region and a comparison connection region from among the plurality of reference connection regions whose feature quantities are relatively close, A rotation step of rotating the combined reference connection region and the comparison connection region relative to each other so that the difference between the combined reference connection region and the comparison connection region becomes smaller, A drawing processing method that includes this. [Item 11] On the computer, A binarization process that binarizes the luminance values ​​of multiple pixels included in the reference drawing, and also binarizes the luminance values ​​of multiple pixels included in the comparison drawing, Extraction steps include: extracting a plurality of reference connected regions defined by consecutive pixels among the plurality of pixels in the reference drawing, where the line drawing luminance values ​​used to draw the line drawing are among the two luminance values ​​of the binarization; and extracting a plurality of comparison connected regions defined by consecutive pixels among the plurality of pixels in the comparison drawing, where the line drawing luminance values ​​are among the consecutive pixels; A calculation step of calculating feature quantities for each of the plurality of reference connected regions, and calculating feature quantities for each of the plurality of comparison connected regions, A combination step of combining the plurality of reference connection regions, and a reference connection region and a comparison connection region from among the plurality of reference connection regions whose feature quantities are relatively close, A rotation step of rotating the combined reference connection region and the comparison connection region relative to each other so that the difference between the combined reference connection region and the comparison connection region becomes smaller, A program to execute. [Explanation of Symbols]

[0095] ZSS drawing processing system, US user, TM terminal, ZS drawing processing device, NW network.

Claims

1. A binarization unit that binarizes the luminance values ​​of multiple pixels included in the reference drawing, and also binarizes the luminance values ​​of multiple pixels included in the comparison drawing, An extraction unit extracts a plurality of reference connected regions defined by consecutive pixels among the plurality of pixels in the reference drawing, where the line drawing luminance values ​​used to draw the line drawing are among the two luminance values ​​of the binarization, and extracts a plurality of comparison connected regions defined by consecutive pixels among the plurality of pixels in the comparison drawing, A calculation unit that calculates feature quantities for each of the plurality of reference connected regions, and calculates feature quantities for each of the plurality of comparison connected regions, A combination unit that combines the aforementioned plurality of reference connection regions and a comparison connection region among the plurality of reference connection regions in which the feature quantities are relatively close, A rotating part rotates the combined reference linkage region and the comparison linkage region so that the difference between the combined reference linkage region and the comparison linkage region becomes smaller, A drawing processing device that includes [a specific component].

2. The drawing processing apparatus according to claim 1, wherein the rotating part rotates the reference connecting region or the comparison connecting region around the center of gravity of the reference connecting region.

3. The drawing processing apparatus according to claim 1 or 2, wherein the rotating part rotates the reference connecting region or the comparison connecting region by predetermined angles within a predetermined range of angles, repeatedly calculates the difference, and determines the angle with the smallest difference as the rotation angle.

4. The drawing processing apparatus according to claim 1 or 2, further comprising a size adjustment unit that adjusts the size of the comparison linkage region so that the difference between the combined reference linkage region and the comparison linkage region becomes smaller.

5. The drawing processing apparatus according to claim 4, wherein the process of adjusting the size is performed before the process of rotating.

6. The drawing processing apparatus according to claim 4, wherein the process of adjusting the size is performed after the process of rotating.

7. The drawing processing apparatus according to claim 1 or 2, wherein the binarization unit performs a process of thickening lines included in at least one of the reference drawing and the comparison drawing.

8. The drawing processing apparatus according to claim 7, wherein the line thickening process is performed before the binarization process.

9. The drawing processing apparatus according to claim 7, wherein the line thickening process is performed after the binarization process.

10. A binarization process that binarizes the luminance values ​​of multiple pixels included in the reference drawing, and also binarizes the luminance values ​​of multiple pixels included in the comparison drawing, Extraction steps include: extracting a plurality of reference connected regions defined by consecutive pixels among the plurality of pixels in the reference drawing, where the line drawing luminance values ​​used to draw the line drawing are among the two luminance values ​​of the binarization; and extracting a plurality of comparison connected regions defined by consecutive pixels among the plurality of pixels in the comparison drawing, where the line drawing luminance values ​​are among the consecutive pixels; A calculation step of calculating feature quantities for each of the plurality of reference connected regions, and calculating feature quantities for each of the plurality of comparison connected regions, A combination step of combining the plurality of reference connection regions, and a reference connection region and a comparison connection region from among the plurality of reference connection regions whose feature quantities are relatively close, A rotation step of rotating the combined reference connection region and the comparison connection region relative to each other so that the difference between the combined reference connection region and the comparison connection region becomes smaller, A drawing processing method that includes this.

11. On the computer, A binarization process that binarizes the luminance values ​​of multiple pixels included in the reference drawing, and also binarizes the luminance values ​​of multiple pixels included in the comparison drawing, Extraction steps include: extracting a plurality of reference connected regions defined by consecutive pixels among the plurality of pixels in the reference drawing, where the line drawing luminance values ​​used to draw the line drawing are among the two luminance values ​​of the binarization; and extracting a plurality of comparison connected regions defined by consecutive pixels among the plurality of pixels in the comparison drawing, where the line drawing luminance values ​​are among the consecutive pixels; A calculation step of calculating feature quantities for each of the plurality of reference connected regions, and calculating feature quantities for each of the plurality of comparison connected regions, A combination step of combining the plurality of reference connection regions, and a reference connection region and a comparison connection region from among the plurality of reference connection regions whose feature quantities are relatively close, A rotation step of rotating the combined reference connection region and the comparison connection region relative to each other so that the difference between the combined reference connection region and the comparison connection region becomes smaller, A program to execute.

Images