Drawing processing device, drawing processing method, and program

Abstract

The reliability of extracting the difference between the reference connected region in the reference drawing and the comparison connected region in the comparison drawing is not reduced. [Solution] The drawing processing device binarizes the brightness values ​​of multiple pixels contained in a reference drawing and a comparison drawing, extracts multiple reference connection areas and multiple comparison connection areas defined by pixels in the reference drawing and the comparison drawing that have consecutive line drawing brightness values, calculates features for each of the multiple reference connection areas and multiple comparison connection areas, combines reference connection areas and comparison connection areas among the multiple reference connection areas and multiple reference connection areas that have relatively similar features, and rotates the combined reference connection areas and comparison connection areas relative to each other so that the difference between the combined reference connection areas and comparison connection areas becomes smaller.

Description

[Technical field]

[0001] The present disclosure relates to a drawing processing device, a drawing processing method, and a program. [Background technology]

[0002] The drawing processing device and the like described in Patent Document 1 aims to easily visually identify differences when two pieces of drawing data are compared (for example, paragraph 0005 of Patent Document 1). In order to achieve the aim, the drawing processing device and the like specifies a reference drawing area that surrounds a drawing element that specifies the shape and dimensions of an object and is included in reference drawing data that serves as a reference, and a comparison drawing area that surrounds the drawing element and is included in comparison drawing data that is the comparison target (for example, claim 1 of Patent Document 1). Here, the drawing element is more specifically composed of lines (for example, outline lines, dimension lines, hidden lines, center lines, imaginary lines) and characters (for example, dimensions, tolerances, processing instructions) that specify the shape and dimensions of parts, etc. (for example, paragraph 0019 of Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 7522514 Summary of the Invention [Problem to be solved by the invention]

[0004] However, it may occur that near the above-mentioned drawing elements, for example, drawing element 11-1A (Figure 5 of Patent Document 1), there are lines or characters that are not directly related to the above-mentioned object (the above-mentioned parts, etc.) (for example, lines or characters indicating an assembly drawing (reference drawing) when assembled using the above-mentioned parts, etc.).

[0005] On the other hand, the above-mentioned reference drawing areas, etc. are polygons such as rectangles (for example, paragraph 0032 of Patent Document 1), in other words, there are marginal areas (for example, the part in drawing area 10-1A where the above-mentioned drawing element 11-1A does not exist, i.e., the part in drawing area 10-1A defined by dotted lines and solid lines (Figure 5 of Patent Document 1)).

[0006] Therefore, in the above-mentioned drawing processing device, etc., it is possible that the above-mentioned assembly drawing (reference drawing) will be included in the margins of the drawing area 10-1A, which is the above-mentioned reference drawing area, and as a result, the reliability of the above-mentioned purpose of displaying the differences when comparing the above-mentioned reference drawing area and the above-mentioned comparison drawing area may be reduced.

[0007] An object of the present disclosure is to provide a drawing processing device, a drawing processing method, and a program that do not reduce the reliability of extracting the difference between a reference connected area in a reference drawing and a comparison connected area in a comparison drawing. [Means for solving the problem]

[0008] In order to solve the above-mentioned problems, the drawing processing device of the present disclosure includes a binarization unit that binarizes the brightness values ​​of a plurality of pixels included in a reference drawing and binarizes the brightness values ​​of a plurality of pixels included in a comparison drawing; an extraction unit that extracts a plurality of reference connection areas defined by pixels in the reference drawing having consecutive line drawing brightness values ​​among the two binarized brightness values ​​used for drawing line drawings, and extracts a plurality of comparison connection areas defined by pixels in the comparison drawing having consecutive line drawing brightness values ​​among the plurality of pixels; a calculation unit that calculates a feature amount for each of the plurality of reference connection areas and calculates the feature amount for each of the plurality of comparison connection areas; a combination unit that combines the plurality of reference connection areas and the plurality of reference connection areas with reference connection areas and comparison connection areas among the plurality of reference connection areas whose feature amounts are relatively close; and a rotation unit that rotates the combined reference connection area and comparison connection area between each other so that the difference between the combined reference connection area and comparison connection area is smaller. Effect of the Invention

[0009] According to the drawing processing device of the present disclosure, (1) it is possible to prevent lines or characters that are present in the vicinity of the reference connection area or the comparison connection area and that are not directly related to the reference connection area or the comparison connection area from adversely affecting the calculation of the feature values ​​of the reference connection area or the comparison connection area, (2) it is possible to clarify the difference between the combined reference connection area and the comparison connection area with greater accuracy than when the rotation is not performed, and (3) it is possible to use data representing multiple reference connection areas and data representing multiple comparison connection areas as component data to be used as a reference when searching for other comparison drawings that are similar to other reference drawings. [Brief description of the drawings]

[0010] [Figure 1] 1 shows the configuration of a drawing processing system ZSS according to an embodiment. [Diagram 2] 1 shows the configuration of a drawing processing apparatus ZS according to an embodiment. [Diagram 3] 2 shows the configuration of a terminal TM according to an embodiment. [Figure 4] 1 is a flowchart showing the operation of the drawing processing system ZSS of the embodiment. [Diagram 5] 1 shows a pixel GS of a reference drawing KZ of the embodiment. [Figure 6] 13 shows binarization of the reference drawing KZ of the embodiment. [Figure 7] 1 shows binarized pixels GS and a reference connected region KRR of a reference drawing KZ of the embodiment. [Figure 8] 1 shows a reference connection region KRR of a reference drawing KZ of an embodiment. [Figure 9] 1 shows reference connection regions KRR1, KRR2, and KRR3 of a reference drawing KZ of the embodiment. [Figure 10] The comparative diagram of the embodiment shows comparative linking regions HRR1, HRR2, and HRR3 of HZ. [Figure 11] 13 shows the feature amount TO of the reference connected region KRR and the feature amount TO of the comparison connected region HRR in the embodiment. [Figure 12] 1 shows a combination KU of a reference linking region KRR and a comparison linking region HRR in an embodiment. [Figure 13] 1 shows a combination KU1 of a reference linkage region KRR1 and a comparison linkage region HRR1 in an embodiment. [Figure 14] 1 shows an overlay KA of the reference linkage region KRR1 and the comparison linkage region HRR1 in the embodiment. [Figure 15] 1 shows a rotation KT between a reference link region KRR1 and a comparison link region HRR1 in the embodiment. [Figure 16] 1 shows a difference SB between a reference link region KRR and a comparison link region HRR1 in the embodiment. [Figure 17] 1 shows the hardware configuration of a drawing processing device ZS and a terminal TM according to an embodiment. [Figure 18] 1 shows a hardware configuration based on software realization of the drawing processing device ZS and terminal TM of the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] An embodiment of a drawing processing system according to the present disclosure will be described.

[0012] <Embodiment> The drawing processing system ZSS according to the embodiment will be described.

[0013] Configuration of the embodiment FIG. 1 shows the configuration of a drawing processing system ZSS according to an embodiment.

[0014] As shown in FIG. 1, the drawing processing system ZSS of the embodiment includes a drawing processing device ZS and a terminal TM.

[0015] The drawing processing device ZS and the terminal TM are connected to each other via a network NW (for example, the Internet) as shown in FIG.

[0016] In response to a request from the terminal TM of the user US, the drawing processing device ZS displays on the terminal TM the difference SB (e.g., shown in FIG. 16) between the reference connection region KRR (e.g., shown in FIG. 11) in the reference drawing KZ (e.g., shown in FIG. 11) and the comparison connection region HRR (e.g., shown in FIG. 11) in the comparison drawing HZ (e.g., shown in FIG. 11).

[0017] Here, the reference drawing KZ is a drawing that serves as a reference for comparison when making a comparison, while the comparison drawing HZ is a drawing that is the subject of comparison when making the comparison.

[0018] The terminal TM is used by a user US.

[0019] In the following, for ease of explanation and understanding, for example, a plurality of names may be collectively referred to as one name, and for example, the reference link regions KRR1, KRR2, and KRR3 (shown in FIG. 9) may be collectively referred to as the reference link region KRR.

[0020] <Configuration of drawing processing device ZS> FIG. 2 shows the configuration of the drawing processing device ZS of the embodiment.

[0021] As shown in FIG. 2, the drawing processing device ZS of the embodiment includes an input / output unit NY(ZS), a processing unit SY(ZS), a memory unit KI(ZS), and a communication unit TU(ZS).

[0022] The input / output unit NY(ZS) is used, for example, by an administrator (not shown) of the drawing processing device ZS to perform input / output for monitoring and controlling the operation of the drawing processing device ZS. The input / output unit NY(ZS) is, for example, a keyboard, a mouse, an LCD monitor, and a printer.

[0023] The processing unit SY (ZS) performs, for example, binarization of the reference drawing KZ and the comparison drawing HZ, extraction of the reference connection region KRR and the comparison connection region HRR, calculation of the feature values ​​TO of the reference connection region KRR and the comparison connection region HRR, combination of the reference connection region KRR and the comparison connection region HRR, rotation between the reference connection region KRR and the comparison connection region HRR, extraction of the difference SB between the reference connection region KRR and the comparison connection region HRR, etc.

[0024] The storage unit KI(ZS) stores, for example, data necessary for the processing of the processing unit SY(ZS), and stores, for example, a plurality of drawings ZM (including a reference drawing KZ and a comparison drawing HZ) in advance.

[0025] The communication unit TU(ZS) performs communication via the network NW. For example, the communication unit TU(ZS) receives a request to compare the reference drawing KZ and the comparison drawing HZ with each other from the terminal TM, and transmits the difference SB between the reference link region KRR and the comparison link region HRR to the terminal TM.

[0026] <Configuration of Terminal TM> FIG. 3 shows the configuration of a terminal TM according to the embodiment.

[0027] As shown in FIG. 3, the terminal TM of the embodiment includes an input / output unit NY(TM), a processing unit SY(TM), a storage unit KI(TM), and a communication unit TU(TM).

[0028] The input / output unit NY(TM) is used by the user US to use the terminal TM. The input / output unit NY(TM) is, for example, a keyboard, a mouse, a liquid crystal monitor, and a printer.

[0029] The processing unit SY (TM), for example, requests the drawing processing device ZS for the difference SB between the reference drawing KZ and the comparison drawing HZ, and displays the difference SB between the reference drawing KZ and the comparison drawing HZ received from the drawing processing device ZS on the input / output unit NY (TM).

[0030] The storage unit KI(TM) stores, for example, data necessary for processing by the processing unit SY(TM).

[0031] The communication unit TU(TM) performs communication via the network NW. For example, the communication unit TU(TM) transmits a request to compare the reference drawing KZ and the comparison drawing HZ to the drawing processing device ZS, and also receives a difference SB between the reference linked region KRR and the comparison linked region HRR from the drawing processing device ZS.

[0032] Correspondence The processing unit SY(ZS) of the drawing processing device ZS corresponds to a "binarization unit," an "extraction unit," a "calculation unit," a "combination unit," and a "rotation unit."

[0033] <Operation of the embodiment> FIG. 4 is a flowchart showing the operation of the drawing processing system ZSS of the embodiment.

[0034] FIG. 5 shows a pixel GS of the reference drawing KZ of the embodiment.

[0035] FIG. 6 shows the binarization of the reference drawing KZ in the embodiment.

[0036] FIG. 7 shows binarized pixels GS and a reference connected region KRR of a reference drawing KZ of the embodiment.

[0037] FIG. 8 shows a reference connection region KRR of a reference drawing KZ of the embodiment.

[0038] FIG. 9 shows reference connection regions KRR1, KRR2, and KRR3 of the reference drawing KZ of the embodiment.

[0039] FIG. 10 shows comparative linking regions HRR1, HRR2, and HRR3 of a comparative drawing HZ of an embodiment.

[0040] FIG. 11 shows the feature amount TO of the reference connected region KRR and the feature amount TO of the comparison connected region HRR in the embodiment.

[0041] FIG. 12 shows a combination KU of a reference linking region KRR and a comparison linking region HRR in the embodiment.

[0042] FIG. 13 shows a combination KU1 of a reference linkage region KRR1 and a comparison linkage region HRR1 according to the embodiment.

[0043] FIG. 14 shows an overlap KA between the reference linkage region KRR1 and the comparison linkage region HRR1 in the embodiment.

[0044] FIG. 15 shows the rotation KT between the reference link region KRR1 and the comparison link region HRR1 in the embodiment.

[0045] FIG. 16 shows the difference SB between the reference link region KRR and the comparison link region HRR1 in the embodiment.

[0046] The operation of the drawing processing system ZSS of the embodiment will be described with reference to FIGS.

[0047] In the following, for ease of explanation and understanding, it is assumed that a user US (shown in Figure 1) identifies a reference drawing KZ (shown in Figure 9, for example) and a comparison drawing HZ (shown in Figure 10, for example) from the image data of multiple drawings ZM (shown in Figure 2) stored in a memory unit KI (ZS) (shown in Figure 2) of a drawing processing device ZS (shown in Figure 1) from a terminal TM (shown in Figure 1), and requests a difference SB (shown in Figure 16) between the reference drawing KZ and the comparison drawing HZ.

[0048] Here, multiple drawings ZM (including reference drawing KZ and comparison drawing HZ) have multiple pixels GS (e.g., pixels GS1, GS2, GS3, ...), as shown in Figure 5, and each pixel GS has, for example, one of 246 brightness levels.

[0049] Step ST10: The user US designates a reference drawing KZ and a comparison drawing HZ from among a plurality of drawings ZM to the drawing processing device ZS from the terminal TM.

[0050] In the drawing processing device ZS, the processing unit SY(ZS) serves as a binarization unit and binarizes the brightness values ​​of multiple pixels GS (e.g., GS1, GS2, GS3, . . . GS(m-1), GSm) contained in the reference drawing KZ, as is clear from a comparison between Figure 5 (before binarization) and Figure 6 (after binarization).

[0051] The processing unit SY(ZS) binarizes the brightness values ​​of multiple pixels (e.g., GS1, GS2, GS3, . . . , GS(m-1), GSm) contained in the comparison drawing HZ, similar to the binarization of the reference drawing KZ.

[0052] Here, "binarization" refers to, for example, maintaining or converting the brightness value "white to gray intermediate between white and black" to the brightness value "white" for each pixel GS of the reference drawing KZ and the comparison drawing HZ, while converting or maintaining the other brightness values ​​"gray to black intermediate between white and black" to the brightness value "black". In other words, pixels below a predetermined brightness threshold are converted to white, and pixels exceeding the threshold are converted to black. The threshold can be set arbitrarily, and, for example, all non-white pixels may be black, or conversely, all non-black pixels may be white. Here, before or after the binarization process, the processing unit SY (ZS) may perform a process of thickening (dilation) the lines of the reference drawing and / or the comparison drawing. For example, the line may be thickened by converting or maintaining all pixels adjacent to the pixel with the luminance value "gray to black between white and black" (pixel whose luminance exceeds a threshold) before binarization to the luminance value "black", or by converting or maintaining pixels adjacent to the pixel with the luminance value "black" after binarization to the luminance value "black". In addition, not only adjacent pixels but also pixels adjacent to pixels with a predetermined luminance value before or after binarization may be thickened to a certain line thickness by converting them to black. By thickening the line, for example, a line that is unintentionally broken (disconnected) on the drawing due to a light color or a line that is too thin on the original drawing can be connected, and the accuracy of extracting the connected area can be improved.

[0053] "Binarization" also means, for example, maintaining the luminance value "white" as the luminance value "white" for each pixel GS of the reference drawing KZ and the comparison drawing HZ, while converting or maintaining other luminance values ​​"gray to black that is as close to white as possible" to the luminance value "black."

[0054] Here, the maintained or converted luminance value "black" is referred to as a "luminance value for line drawing" used for drawing line drawings.

[0055] Step ST20: In the drawing processing device ZS, the processing unit SY(ZS), as an extraction unit, defines a reference connected region KRR1 by line segments SE1, SE2, SE3, and SE4 that virtually pass through pixels GS1, GS2, GS3, . . ., GS(m-1), and GSm that have consecutive "line drawing brightness values" (i.e., brightness value "black") among the multiple pixels GS in the reference drawing KZ, as shown in Figure 7, and extracts the reference connected region KRR1 as shown in Figure 8.

[0056] The processing unit SY (GS) similarly extracts other reference connected regions KRR2 and KKR3 from the reference drawing KZ as shown in Fig. 9, and as a result, extracts a plurality of reference connected regions KRR1 to KRR3 from the reference drawing KZ. A connected region can be an annular region such as a polygon surrounded by continuous lines (straight lines or curves), a circle, an ellipse, etc. By such a connected region extraction process, for example, a line or character that exists near the reference connected region KRR1 but is not directly related to the reference connected region KRR1 is not extracted as the reference connected regions KRR1 to KRR3.

[0057] The processing unit SY(ZS) extracts a plurality of comparison connected regions HRR1 to HRR3 in the comparison drawing HZ, as shown in FIG. 10, in the same way as in the extraction of the reference connected regions KRR1 to KRR3 in the reference drawing KZ.

[0058] Step ST30: In the drawing processing device ZS, the processing unit SY(ZS) serves as a calculation unit and calculates the feature values ​​TO of each of the reference connected regions KRR1 to KRR3 in the reference drawing KZ, i.e., feature value TO(KRR1), feature value TO(KRR2), and feature value TO(KRR3), in a manner similar to that conventionally known, as shown in FIG. 11 (upper half).

[0059] The method of calculating the feature amount TO is not particularly limited, but for example, the feature amount (for example, a feature vector) can be calculated (inferred) by inputting data of the reference link region and the comparison link region into a feature amount inference model. For example, a model that applies a neural network or the like is used as the inference model, but any machine learning model can be used. Such an inference model is stored in advance in a storage unit. The number of inference models is not limited to one, and for example, multiple inference models with different conditions, such as machine learning methods and data differences, may be stored and used selectively or in parallel. For example, machine learning is performed on the feature amount inference model so that the more similar the reference link region and the comparison link region are, the higher the similarity when the features are compared. The similarity is, for example, defined by the distance when the features of the images are compared, and for example, a distance index such as Euclidean distance or Manhattan distance, or a similarity index such as cosine similarity may be used.

[0060] The feature amount (feature information) is output, for example, as vector data based on a fixed-length numeric array, but may be output in other data formats without being limited to vector format. The feature amount may be, for example, a SIFT feature amount, a SURF feature amount, an ORB feature amount, an AKAZE feature amount, or the like.

[0061] Similarly, the processing unit SY(ZS), as a calculation unit, calculates the feature values ​​TO of each of the comparison connected regions HRR1 to HRR3 in the comparison drawing HZ, i.e., feature value TO(HRR1), feature value TO(HRR2), and feature value TO(HRR3), as shown in Figure 11 (lower half).

[0062] Step ST40: In the drawing processing device ZS, the processing unit SY(ZS) combines one of the reference linked regions KRR1-KRR3 and one of the comparison linked regions HRR1-HRR3, which have relatively similar feature values ​​TO, among the multiple reference linked regions KRR1-KRR3 and the multiple comparison linked regions HRR1-HRR3, as shown in Fig. 11 and Fig. 12. The processing unit SY(ZS) determines a combination of relatively similar feature values ​​TO based on the similarity obtained by comparing the feature values ​​of each linked region, for example. That is, it calculates the similarity of all combinations of the multiple reference linked regions KRR1-KRR3 and the multiple comparison linked regions HRR1-HRR3, and selects one of the comparison linked regions HRR1-HRR3 with the highest similarity for each of the reference linked regions KRR1-KRR3.

[0063] Here, the following is assumed: (1) The feature amount TO(KRR1) of the reference linked region KRR1 is closest to the feature amount TO(HRR1) of the comparison linked region HRR1 among the feature amounts TO(HRR1) to TO(HRR3) of the comparison linked regions HRR1 to HRR3. (2) The feature amount TO(KRR2) of the reference linked region KRR2 is closest to the feature amount TO(HRR2) of the comparison linked region HRR2 among the feature amounts TO(HRR1) to TO(HRR3) of the comparison linked regions HRR1 to HRR3. (3) The feature amount TO(KRR3) of the reference linked region KRR1 is closest to the feature amount TO(HRR3) of the comparison linked region HRR3 among the feature amounts TO(HRR1) to TO(HRR3) of the comparison linked regions HRR1 to HRR3.

[0064] Under the above assumptions, as shown in Figure 12, the processing unit SY (ZS) (1) establishes a combination KU1 between the reference link region KRR1 and the comparison link region HRR1, (2) establishes a combination KU2 between the reference link region KRR2 and the comparison link region HRR2, and (3) establishes a combination KU3 between the reference link region KRR3 and the comparison link region HRR3.

[0065] Step ST50: In the drawing processing system ZS, the processing unit SY(ZS) overlaps, for example, the reference connected region KRR1 and the comparison connected region HRR1, which are the objects of combination KU1, with each other, that is, performs overlapping KA, as shown in FIG. 13 and FIG.

[0066] The overlapping KA is performed, for example, so that the center of gravity of the reference link region KRR1 (not shown) coincides with the center of gravity of the comparison link region HRR1 (not shown), or, for example, so that the center of the reference link region KRR1 (not shown) coincides with the center of the comparison link region HRR1 (not shown). Note that the overlapping may be performed so that a point other than the center of gravity or the center, such as a specific corner, coincides.

[0067] After the above-mentioned overlapping KA, the processing unit SY(ZS) performs a rotation KT between the reference connection region KRR1 and the comparison connection region HRR1, which are the objects of the overlapping KA, so that the differences SB1 and SB2 between the reference connection region KRR1 and the comparison connection region HRR1 become smaller, as shown in Figs. 14, 15, and 16. More specifically, the processing unit SY(ZS) reduces the differences SB1 and SB2 between the reference connection region KRR1 and the comparison connection region HRR1, for example, by keeping the orientation of the reference connection region KRR1 fixed and rotating the orientation of the comparison connection region HRR1. At that time, the orientation of the comparison connection region HRR1 may be rotated around the center of gravity of the comparison connection region HRR1 while keeping the orientation of the reference connection region KRR1 fixed. Alternatively, the orientation of the comparison connection region HRR1 may be rotated around the center of gravity of the reference connection region KRR1. In addition, the processing unit SY (ZS) may calculate the differences SB1 and SB2 between the reference connection region KRR1 before rotation and the comparison connection region HRR1, and may rotate the attitude of the comparison connection region HRR1 in the left and right directions little by little over a predetermined range (for example, a range of 10° to the left and right from the initial state, 15° to the right and 20° to the left and right, etc., which may be set arbitrarily) by a predetermined angle (for example, 0.5°, 1°, 3° from the initial state), and may repeatedly calculate the differences SB1 and SB2, and may determine the angle at which the total area of ​​the differences SB1 and SB2 is the smallest as the final rotation angle. In other words, if the total area of ​​the differences SB1 and SB2 is the smallest in the state before rotation, the state before rotation may be the final angle. The reference point for rotation is not limited to the center of gravity, and may be another point such as a corner of the reference connection region of a polygon or an intersection of diagonals.

[0068] The processing unit SY (ZS) may perform a size adjustment process before or after the rotation process, or instead of the rotation process, as a size adjustment unit. For example, the area of ​​the difference SB1 in which the comparative link region HRR1 is larger than the reference link region KRR1 (if there are multiple differences SB1, the total area of ​​the multiple differences SB1) is compared with the area of ​​the difference SB2 in which the comparative link region HRR1 is smaller than the reference link region KRR1 (if there are multiple differences SB2, the total area of ​​the multiple differences SB2) and, if a predetermined ratio condition is satisfied (for example, 2 times or more, 5 times or more, 10 times or more, 0.5 times or less, 0.1 times or less, etc., can be set arbitrarily), the comparative link region HRR1 may be enlarged or reduced so that the difference becomes smaller. The size adjustment may be, for example, enlarged or reduced so that the shape is similar (i.e., the same shape) based on the position of the center of gravity of the comparative link region HRR1. In addition, at that time, the comparison connected area HRR1 may be enlarged or reduced little by little within a predetermined range for each predetermined magnification (which can be set arbitrarily, such as 0.001x, 0.01x, 0.1x, etc.), the areas of the differences SB1 and SB2 may be calculated, and the final magnification may be the magnification at which the area ratio of the differences SB1 and SB2 is closest to 1. The reference point for size adjustment is not limited to the center of gravity, and may be another point, such as a corner of the reference connected area of ​​a polygon or an intersection of diagonals.

[0069] As another method, the processing unit SY (ZS) may compare the area of ​​the comparison connection region HRR1 with the area of ​​the reference connection region KRR1 and perform a size adjustment process so that the areas are the same or the difference in area is less than a predetermined value (for example, which may be a percentage (%) of the area of ​​the reference connection region, or the absolute value of the area, which can be set arbitrarily).

[0070] Here, as shown in FIG. 16, the difference SB1 is a portion (convex portion) where the comparison connected region HRR1 is larger than the reference connected region KRR1, while the difference SB2 is a portion (concave portion) where the comparison connected region HRR1 is smaller than the reference connected region KRR1. The calculation and evaluation method of the difference (degree of overlap of images) is not particularly limited, and for example, the IoU (Intersection over Union) evaluation index can be used. The IoU evaluation index is an index indicating the degree of overlap of two regions. The IoU evaluation index is a value obtained by dividing the common part of two regions by the union of those regions. The IoU evaluation index takes a value of, for example, 0 or more and 1 or less, and the closer the value is to 1, the closer the two regions are evaluated to be. The calculation and evaluation method of the difference is not limited to the IoU evaluation index, and any evaluation index such as the DICE coefficient, the center distance of the region, the area of ​​the region, and the aspect ratio can be used.

[0071] The processing unit SY (ZS) performs overlap KA and rotation KT on the reference link region KRR2 and comparison link region HRR2 that are the subject of combination KU2, and on the reference link region KRR3 and comparison link region HRR3 that are the subject of combination KU3, in the same manner as described above.

[0072] Step ST60: In the drawing processing device ZS, the processing unit SY(ZS) extracts the differences SB1, SB2 between the reference connected region KRR1 and the comparison connected region HRR1 in a manner similar to that conventionally known, as shown in FIG. 16, i.e., identifies the differences SB1, SB2.

[0073] After the above-mentioned extraction, the processing unit SY(ZS) transmits the reference connection area KRR1, the comparison connection area HRR1, and the differences SB1 and SB2 between the reference connection area KRR1 and the comparison connection area HRR1, shown in Figure 16, from the communication unit TU(ZS) to the drawing processing device ZS.

[0074] In the terminal TM, the processing unit SY(TM) displays the above-mentioned reference link region KRR1, comparison link region HRR1, and differences SB1, SB2 between the reference link region KRR1 and comparison link region HRR1 on the input / output unit NY(TM).

[0075] The processing unit SY(ZS), communication unit TU(ZS), and processing unit SY(TM) also perform the above-mentioned extraction, transmission, and display of the reference link area KRR2 and comparison link area HRR2 that are the subject of combination KU2, and the reference link area KRR3 and comparison link area HRR3 that are the subject of combination KU3.

[0076] Effects of the embodiment As described above, the drawing processing system ZSS according to the embodiment has the following advantages. (1) For example, it is possible to prevent a line or character that exists in the vicinity of the reference connected region KRR1 but is not directly related to the reference connected region KRR1 from adversely affecting the calculation of the feature amount TO(KRR1) of the reference connected region KRR1.

[0077] (2) For example, the differences SB1, SB2 between the reference link region KRR1, which is the subject of the combination KU1, and the comparison link region HRR1 can be clarified with higher accuracy than when the above-mentioned rotation KT is not performed.

[0078] (3) Data representing multiple reference connection regions KRR1 to KRR3 and data representing multiple comparison connection regions HRR1 to HRR3 can be used as part data to refer to when searching for other comparison drawings (comparison drawings HZ other than comparison drawing HZ) that are similar to other reference drawings (reference drawings other than reference drawing KZ).

[0079] Hardware Configuration of the Embodiment FIG. 17 shows the hardware configuration of the drawing processing device ZS and the terminal TM according to the embodiment.

[0080] In order to perform the above-mentioned functions, the drawing processing device ZS and terminal TM of the embodiment include a processing circuit SYO as shown in FIG. 16, and further include an input circuit NYU and an output circuit SYU as necessary.

[0081] The processing circuit SYO is a dedicated hardware, and realizes the functions of the drawing processing device ZS, the processing unit SY(ZS) of the terminal TM, and the processing unit SY(TM) (shown in FIG. 2 and FIG. 3).

[0082] The processing circuit SYO is, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or a combination of these.

[0083] The input circuit NYU and the output circuit SYU exchange inputs and outputs related to the operation of the processing circuit SYO with, for example, the drawing processing device ZS and the outside of the terminal TM.

[0084] Hardware configuration based on software implementation of the embodiment FIG. 18 shows a hardware configuration based on software implementation of the drawing processing device ZS and terminal TM of the embodiment.

[0085] As shown in FIG. 18, the drawing processing device ZS and terminal TM of the embodiment include a processor PRO and a memory circuit KIO, and further include an input circuit NYU and an output circuit SYU as necessary.

[0086] The processor PRO is a CPU (also called a Central Processing Unit, a processor, an arithmetic unit, a microprocessor, a microcomputer, or a DSP (Digital Signal Processing)) that executes programs. The processor PRO realizes the functions of the drawing processor ZS, the processing unit SY(ZS) of the terminal TM, and the processing unit SY(TM) (shown in Figs. 2 and 3).

[0087] The processor PRO realizes the above-mentioned functions by software, firmware, or a combination of software and firmware. The software and firmware are written as a program PRG and stored in the memory circuit KIO.

[0088] The processor PRO realizes the above-mentioned functions by reading and executing the above-mentioned program PRG from the memory circuit KIO. The above-mentioned program PRG can also be said to cause the computer to execute the procedures and methods of the drawing processing device ZS, the processing unit SY(ZS) of the terminal TM, and the processing unit SY(TM).

[0089] Here, the memory circuit KIO is, for example, a non-volatile or volatile semiconductor memory such as a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory, an EPROM (Erasable Programmable Read Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), etc., as well as a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, a DVD (Digital Versatile Disc), etc.

[0090] Among the functions of the drawing processing device ZS, the processing unit SY(ZS) of the terminal TM, and the processing unit SY(TM), some of the functions may be realized by a processing circuit SYO (shown in Figure 17), while some other functions may be realized by a processor PRO (shown in Figure 18).

[0091] As described above, the functions of the drawing processing device ZS, the processing unit SY(ZS) of the terminal TM, and the processing unit SY(TM) can be realized by hardware, software, firmware, or a combination of these.

[0092] The input circuit NYU and the output circuit SYU exchange inputs and outputs related to the operation of the processor PRO with, for example, the drawing processing device ZS and the outside of the terminal TM.

[0093] <Example of composition> The drawing processing device, drawing processing method, and program according to the present disclosure have, for example, the following configuration.

[0094] [Item 1] a binarization unit that binarizes luminance values ​​of a plurality of pixels included in the reference drawing and binarizes luminance values ​​of a plurality of pixels included in the comparison drawing; an extracting unit that extracts a plurality of reference connected regions defined by pixels having consecutive line drawing luminance values, one of the two luminance values ​​obtained by the binarization, used for drawing a line drawing, from among the plurality of pixels in the reference drawing, and extracts a plurality of comparison connected regions defined by pixels having consecutive line drawing luminance values ​​from among the plurality of pixels in the comparison drawing; a calculation unit that calculates a feature amount for each of the plurality of reference linked regions and calculates a feature amount for each of the plurality of comparison linked regions; a combination unit that combines the plurality of reference link regions and a comparison link region among the plurality of reference link regions, the comparison link regions having relatively similar feature amounts; a rotation unit that rotates the combined reference connection region and comparison connection region relative to each other so that a difference between the combined reference connection region and comparison connection region becomes smaller; A drawing processing device including: [Item 2] The image processing apparatus according to claim 1 , wherein the rotation unit rotates the reference connection area or the comparison connection area around a center of gravity of the reference connection area. [Item 3] 3. The drawing processing device according to claim 1, wherein the rotation unit rotates the reference connection area or the comparison connection area by a predetermined angle increment within a predetermined angle range to repeatedly calculate the difference, and determines the angle that results in the smallest difference as the rotation angle. [Item 4] 3. The drawing processing apparatus according to claim 1, further comprising a size adjusting unit that adjusts a size of the comparison connected region so that a difference between the combined reference connected region and comparison connected region becomes smaller. [Item 5] The drawing processing apparatus according to claim 4 , wherein the process of adjusting the size is performed before the process of rotating. [Item 6] The drawing processing apparatus according to claim 4 , wherein the process of adjusting the size is performed after the process of rotating. [Item 7] 3. The drawing processing apparatus according to claim 1, wherein the binarization unit performs a process of thickening lines included in at least one of the reference drawing and the comparison drawing. [Item 8] The drawing processing apparatus according to claim 7 , wherein the thickening process is performed before the binarization process. [Item 9] The drawing processing apparatus according to claim 7, wherein the thickening process is performed after the binarization process. [Item 10] a binarization step of binarizing the luminance values ​​of a plurality of pixels included in the reference drawing and binarizing the luminance values ​​of a plurality of pixels included in the comparison drawing; an extraction step of extracting a plurality of reference connected regions defined by pixels having consecutive line drawing luminance values, one of the two luminance values ​​obtained by the binarization, used for drawing a line drawing, from among the plurality of pixels in the reference drawing, and extracting a plurality of comparison connected regions defined by pixels having consecutive line drawing luminance values ​​from among the plurality of pixels in the comparison drawing; a calculation step of calculating a feature amount for each of the plurality of reference linked regions and calculating a feature amount for each of the plurality of comparison linked regions; a combining step of combining a reference link region and a comparison link region, the reference link region and the comparison link region having a feature amount relatively close to each other, among the plurality of reference link regions; a rotating step of rotating the combined reference link region and the combined comparison link region relative to each other so that a difference between the combined reference link region and the combined comparison link region becomes smaller; A drawing processing method comprising: [Item 11] On the computer, a binarization step of binarizing the luminance values ​​of a plurality of pixels included in the reference drawing and binarizing the luminance values ​​of a plurality of pixels included in the comparison drawing; an extraction step of extracting a plurality of reference connected regions defined by pixels having consecutive line drawing luminance values, one of the two luminance values ​​obtained by the binarization, used for drawing a line drawing, from among the plurality of pixels in the reference drawing, and extracting a plurality of comparison connected regions defined by pixels having consecutive line drawing luminance values ​​from among the plurality of pixels in the comparison drawing; a calculation step of calculating a feature amount for each of the plurality of reference linked regions and calculating a feature amount for each of the plurality of comparison linked regions; a combining step of combining a reference link region and a comparison link region, the reference link region and the comparison link region having a feature amount relatively close to each other, among the plurality of reference link regions; a rotating step of rotating the combined reference link region and the combined comparison link region relative to each other so that a difference between the combined reference link region and the combined comparison link region becomes smaller; A program for executing. [Explanation of symbols]

[0095] ZSS drawing processing system, US user, TM terminal, ZS drawing processing device, NW network.

Claims

1. a binarization unit that binarizes luminance values ​​of a plurality of pixels included in the reference drawing and binarizes luminance values ​​of a plurality of pixels included in the comparison drawing; an extracting unit that extracts a plurality of reference connected regions defined by pixels having consecutive line drawing luminance values, one of the two luminance values ​​obtained by the binarization, used for drawing a line drawing, from among the plurality of pixels in the reference drawing, and extracts a plurality of comparison connected regions defined by pixels having consecutive line drawing luminance values ​​from among the plurality of pixels in the comparison drawing; a calculation unit that calculates a feature amount for each of the plurality of reference linked regions and calculates a feature amount for each of the plurality of comparison linked regions; a combination unit that combines a reference connected region and a comparison connected region, the feature amounts of which are relatively close to each other, from among the plurality of reference connected regions and the plurality of comparison connected regions.

2. The drawing processing device described in Claim 1, wherein the combination unit determines combinations of each of the reference connection areas and the comparison connection areas by calculating and comparing the similarities of all combinations of the multiple reference connection areas and the multiple comparison connection areas based on the features.

3. The drawing processing apparatus according to claim 2 , further comprising a size adjusting unit that adjusts a size of the comparison connected region so that a difference between the combined reference connected region and comparison connected region becomes smaller.

4. The drawing processing apparatus according to claim 1 , wherein the binarization unit performs a process of thickening lines included in at least one of the reference drawing and the comparison drawing.

5. The drawing processing apparatus according to claim 4 , wherein the thickening process is performed before the binarization process.

6. The drawing processing apparatus according to claim 4 , wherein the thickening process is performed after the binarization process.

7. a binarization step of binarizing the luminance values ​​of a plurality of pixels included in the reference drawing and binarizing the luminance values ​​of a plurality of pixels included in the comparison drawing; an extraction step of extracting a plurality of reference connected regions defined by pixels having consecutive line drawing luminance values, one of the two luminance values ​​obtained by the binarization, used for drawing a line drawing, from among the plurality of pixels in the reference drawing, and extracting a plurality of comparison connected regions defined by pixels having consecutive line drawing luminance values ​​from among the plurality of pixels in the comparison drawing; a calculation step of calculating a feature amount for each of the plurality of reference linked regions and calculating a feature amount for each of the plurality of comparison linked regions; a combining step of combining the plurality of reference connected regions and a comparison connected region among the plurality of reference connected regions, the comparison connected region having a feature amount that is relatively close to the plurality of reference connected regions.

8. On the computer, a binarization step of binarizing the luminance values ​​of a plurality of pixels included in the reference drawing and binarizing the luminance values ​​of a plurality of pixels included in the comparison drawing; an extraction step of extracting a plurality of reference connected regions defined by pixels having consecutive line drawing luminance values, one of the two luminance values ​​obtained by the binarization, used for drawing a line drawing, from among the plurality of pixels in the reference drawing, and extracting a plurality of comparison connected regions defined by pixels having consecutive line drawing luminance values ​​from among the plurality of pixels in the comparison drawing; a calculation step of calculating a feature amount for each of the plurality of reference linked regions and calculating a feature amount for each of the plurality of comparison linked regions; A program for executing a combination process of combining the plurality of reference connection regions and a reference connection region and a comparison connection region among the plurality of reference connection regions, the feature amounts of which are relatively close to each other.

Images