Image processing device, image processing method, and image processing program

Abstract

To provide an image processing device, an image processing method and an image processing program which increase efficiency of processing in a case where a drawing is compared.SOLUTION: In an image processing device 10, a CPU 20A includes an acquisition unit for acquiring a plurality of drawings, an extraction unit for extracting a graphic element in each of the acquired drawings, a calculation unit for calculating similarity between different images for each of the extracted graphic elements, and an output unit for outputting a difference in the image for a graphic element having the calculated similarity of a first threshold or more and less than a second threshold, as a changed graphic element, to a display device 24.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an image processing apparatus, an image processing method, and an image processing program.

Background Art

[0002] Patent Document 1 discloses an image processing apparatus that extracts a difference between images of a plurality of drawings, and extracts a difference considering image displacement only for the image within the frame of the drawing.

[0003] Further, Patent Document 2 discloses a difference extraction apparatus that freely adjusts absorption of displacement or the like while visually recognizing the state of difference extraction. The difference extraction apparatus includes a displacement absorption unit that performs dilation processing based on a plurality of different dilation degrees specified by a user on at least one of the drawings to be compared, and a difference extraction unit that extracts a difference between the drawings to be compared for each of the plurality of different dilation degrees.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] In the image processing apparatus of Patent Document 1, it is necessary to perform alignment before comparing the drawings and then extract the difference between graphic elements. Further, in the difference extraction apparatus of Patent Document 2, it is necessary to expand one graphic based on the dilation degree set by the user when comparing the drawings. That is, the techniques of Patent Document 1 and Patent Document 2 need to perform preprocessing in advance when comparing the graphic elements of each drawing, and there is room for improvement.

[0006] The present invention aims to provide an image processing apparatus, an image processing method, and an image processing program that improve the efficiency of the process when comparing drawings. [Means for solving the problem]

[0007] The first embodiment is an image processing apparatus comprising: an acquisition unit for acquiring a plurality of images; an extraction unit for extracting graphic elements from each of the acquired plurality of images; a calculation unit for calculating the similarity between different images for each of the extracted graphic elements; and an output unit for outputting the difference in the image as a modified graphic element to a display unit for graphic elements whose calculated similarity is greater than or equal to a first threshold and less than a second threshold.

[0008] The first embodiment of the image processing apparatus extracts graphic elements from multiple images and calculates a different degree of similarity between images for each graphic element. Then, based on the similarity, it compares the graphic elements of one image with those of other images to determine whether the graphic elements have been modified. Therefore, this image processing apparatus does not require any pre-processing such as alignment during the comparison, thus improving processing efficiency.

[0009] In the second embodiment of the image processing apparatus, the output unit outputs to the display unit the graphic elements whose calculated similarity is equal to or greater than the second threshold as graphic elements that have not been changed.

[0010] The image processing apparatus in the second embodiment compares the graphic elements of one image with the graphic elements of another image based on similarity and determines that there are no changes to the graphic elements. Therefore, with this image processing apparatus, there is no need to perform pre-processing such as alignment during the comparison, and the processing efficiency can be improved.

[0011] In the third embodiment of the image processing apparatus, the output unit outputs to the display unit any graphic elements for which the calculated similarity is less than the first threshold, as graphic elements for which there is no comparison target.

[0012] In the third embodiment of the image processing apparatus, graphic elements of one image are compared with graphic elements of another image based on similarity, and it is determined that there is no comparison between the two. Examples of cases where there is "no comparison" include the addition or deletion of graphic elements. Therefore, with this image processing apparatus, there is no need to perform pre-processing such as alignment during comparison, and the processing efficiency can be improved.

[0013] The fourth embodiment of the image processing apparatus is an image processing apparatus according to any one of the first to third embodiments, wherein the extraction unit is capable of changing the extraction region of the graphic elements to be extracted in the image.

[0014] According to the image processing apparatus of the fourth embodiment, by making the extraction region changeable, it is possible to compare various images, such as images with dense graphic elements and images with simple graphic elements.

[0015] The fifth embodiment of the image processing apparatus is an image processing apparatus according to any one of the first to fourth embodiments, wherein the output unit superimposes the graphic elements compared in different images onto the display unit in different colors for each image.

[0016] According to the image processing apparatus of the fifth embodiment, the parts where there are differences are displayed with different colors for each image, making it easier for the user to understand the changes.

[0017] The sixth embodiment of the image processing apparatus is an image processing apparatus of the fifth embodiment in which the output unit displays on the display unit parts of graphic elements that do not differ in the comparison between different images, in a color that is different from the color of each image and less conspicuous than the color of each image.

[0018] According to the sixth embodiment of the image processing apparatus, parts that do not have differences do not belong to either image and are displayed on the display unit in an inconspicuous color, so that the changes can be communicated to the user more clearly.

[0019] The seventh aspect is an image processing method, which includes acquiring a plurality of images, extracting graphic elements in each of the acquired plurality of images, calculating the similarity between different images for each of the extracted graphic elements, and for the graphic elements whose calculated similarity is greater than or equal to a first threshold value and less than a second threshold value, outputting the difference in the image as a modified graphic element to a display unit by a computer.

[0020] The eighth aspect is an image processing program, which includes acquiring a plurality of images, extracting graphic elements in each of the acquired plurality of images, calculating the similarity between different images for each of the extracted graphic elements, and causing a computer to execute a process of outputting the difference in the image as a modified graphic element to a display unit for the graphic elements whose calculated similarity is greater than or equal to a first threshold value and less than a second threshold value.

Advantages of the Invention

[0021] According to the present invention, it is possible to improve the efficiency of the process when comparing drawings.

Brief Description of the Drawings

[0022] [Figure 1] It is a diagram showing the schematic configuration of an image processing apparatus according to an embodiment. [Figure 2] It is a block diagram showing the configuration of a storage of an embodiment. [Figure 3] It is a block diagram showing the functional configuration of a CPU of an embodiment. [Figure 4] It is a diagram for explaining a screen displayed on a display device of an embodiment. [Figure 5] It is a flowchart showing the flow of comparison processing of an embodiment. [Figure 6] It is a flowchart showing the flow of setting processing of an embodiment. [Figure 7] It is a flowchart showing the flow of comparison calculation processing of an embodiment. [Figure 8] It is a flowchart showing the flow of display processing of an embodiment. [Figure 9]This diagram illustrates the relationship between the offset value and the region in the embodiment. [Figure 10] This is an example of a difference drawing in an embodiment. [Modes for carrying out the invention]

[0023] Embodiments of the present invention will be described below with reference to the drawings. (composition) Figure 1 shows an image processing apparatus 10 of an embodiment of the present invention. The image processing apparatus 10 is exemplified by a personal computer, and a comparison process is performed to compare the differences between two drawings by executing a processing program 100, which will be described later. Specifically, the image processing apparatus 10 compares the individual graphic elements contained in each drawing and extracts the differences. The drawings are examples of images.

[0024] The image processing device 10 is comprised of a CPU (Central Processing Unit) 20A, ROM (Read Only Memory) 20B, RAM (Random Access Memory) 20C, storage 20D, input / output interface (Interface) 20E, and communication interface 20F. The CPU 20A, ROM 20B, RAM 20C, storage 20D, input / output interface 20E, and communication interface 20F are interconnected via a bus 20G so that they can communicate with each other.

[0025] The CPU 20A is the central processing unit, which executes various programs and controls various components. Specifically, the CPU 20A reads programs from ROM 20B or storage 20D and executes them using RAM 20C as the working area.

[0026] ROM20B stores various programs and data. RAM20C temporarily stores programs or data as a working area.

[0027] The storage 20D is composed of an HDD (Hard Disk Drive) or an SSD (Solid State Drive) and stores various programs and data. As shown in Figure 2, the storage 20D in this embodiment stores the processing program 100, drawing data 110, and differential data 120.

[0028] The processing program 100 is a program for performing comparison processing. This processing program 100 is an example of an image processing program. The drawing data 110 stores drawing files related to design drawings. In this embodiment, drawing files with the extensions tif, png, jpg, bmp, and pdf are applicable. The difference data 120 is a file that shows the difference between two drawings generated by the comparison processing. The processing program 100, drawing data 110, and difference data 120 may be stored in ROM 20B.

[0029] As shown in Figure 1, the input / output interface 20E is an interface for communicating with the input device 22 and the display device 24. The input device 22 and the display device 24 may also be directly connected to the bus 20G.

[0030] Communication I / F20F is an interface for connecting to external devices. For example, communication I / F20F is connected to the public network N.

[0031] The input device 22 is an input device such as a keyboard or mouse. The display device 24, which serves as the display unit, is a display device such as a liquid crystal display.

[0032] As shown in Figure 3, in the image processing apparatus 10 of this embodiment, the CPU 20A functions as an acquisition unit 200, an extraction unit 210, a calculation unit 220, and an output unit 230 by executing the processing program 100.

[0033] The acquisition unit 200 has the function of acquiring multiple drawings for comparison. Specifically, the acquisition unit 200 reads drawing files from drawing data 110 stored in storage 20D. Alternatively, the acquisition unit 200 may read drawing files via a public network N. In this embodiment, the acquisition unit 200 acquires two drawings by reading two drawing files: one drawing (hereinafter referred to as "drawing 1") and another drawing (hereinafter referred to as "drawing 2").

[0034] The extraction unit 210 has the function of extracting geometric elements from each of the multiple drawings acquired by the acquisition unit 200. The extraction unit 210 allows the extraction area of ​​the geometric elements to be changed. Specifically, the extraction area surrounding the geometric elements is changed by changing the offset value. This changes the geometric elements that are extracted.

[0035] The calculation unit 220 has the function of calculating the similarity of each graphic element extracted by the extraction unit 210. Specifically, the calculation unit 220 calculates the similarity between graphic elements in Figure 1 and graphic elements in Figure 2. The calculation of similarity by the calculation unit 220 is performed for all combinations of all graphic elements in Figure 1 and all graphic elements in Figure 2. The similarity is set to a value from 0 to 1, with a value of 1 indicating a higher degree of similarity (1 being a perfect match). In addition, the calculation unit 220 sets the combination with the highest similarity from among the graphic elements in Figure 2 for each graphic element in Figure 1. Therefore, for example, if there are 22 graphic elements in Figure 1 and 21 graphic elements in Figure 2, 22 combinations of graphic elements will be set (in this case, there will be combinations in Figure 2 where graphic elements overlap).

[0036] The output unit 230 has the function of displaying graphic elements to the display device 24. In this embodiment, the output unit 230 outputs the difference in the drawing to the display device 24 as "modified graphic elements" for combinations of graphic elements where the similarity between the graphic elements of drawing 1 and the graphic elements of drawing 2 is above the first threshold and below the second threshold. The output unit 230 also outputs to the display device 24 as "unmodified graphic elements" for combinations of graphic elements where the similarity is above the second threshold. Furthermore, the output unit 230 outputs to the display device 24 as "graphic elements with no comparison target" for combinations of graphic elements below the first threshold. Here, the first threshold is a threshold for identifying whether graphic elements are similar or not, and when the similarity is set in the range of 0 to 1, for example, a value of 0.7 is set. The second threshold is a threshold for identifying whether graphic elements match or not, and when the similarity is set in the range of 0 to 1, for example, a value of 0.9999 is set.

[0037] The output unit 230 superimposes the graphic elements compared between Figure 1 and Figure 2 onto the display device 24 in different colors for each figure. Furthermore, for parts of the graphic elements compared between Figure 1 and Figure 2 that do not have differences, the output unit 230 displays those parts on the display device 24 in a color that is different from the color of each image and less conspicuous than the color of each image.

[0038] (Regarding the screen) Figure 4 shows the screen 40 displayed on the display device 24 of this embodiment. As shown in Figure 4, the screen 40 displayed on the display device 24 includes a drawing view 42 in the center, an operation view 44 on the left, and a list view 46 on the right. The drawing view 42 displays the two drawings being compared, and a difference drawing showing the result of comparing the two drawings. The list view 46 on the right displays a list of geometric elements set as a combination. By selecting each geometric element on the list, the selected geometric element is displayed in the center of the drawing view 42.

[0039] Operation View 44 is a screen containing operation buttons for comparing two drawings and loading each drawing. Operation View 44 includes a Select 1 button 50 for selecting the drawing file of Drawing 1, and a Select 2 button 52 for selecting the drawing file of Drawing 2. Operation View 44 also includes a Calculation button 54 for performing calculations for comparison, and a Change bar 56 for changing the offset value.

[0040] Furthermore, the operation view 44 includes radio buttons: a Drawing 1 button 60 to display Drawing 1 in the drawing view 42, a Drawing 2 button 61 to display Drawing 2 in the drawing view 42, and a Difference button 62 to display the difference in the drawing view 42. Additionally, the operation view 44 includes a checkbox: an Area button 64 to display the border line EL (see Figure 9) indicating the extraction area of ​​the geometric elements. Moreover, the operation view 44 includes radio buttons: a Unit button 66 to display the difference between geometric elements in the drawing view 42, and an Overall button 67 to display the difference between drawings in the drawing view 42.

[0041] (Control flow) The flow of the comparison process performed in the image processing apparatus 10 of this embodiment will be explained using the flowcharts in Figures 5 to 8. The processing in the image processing apparatus 10 is realized by the CPU 20A functioning as the acquisition unit 200, extraction unit 210, calculation unit 220, and output unit 230 described above. The comparison process includes setting processing, comparison calculation processing, and display processing.

[0042] In step S100 of Figure 5, the CPU 20A accepts input from the operation buttons in the operation view 44.

[0043] In step S101, the CPU 20A determines whether or not an operation button has been pressed. If the CPU 20A determines that an operation button has been pressed (YES in step S101), it proceeds to step S102. On the other hand, if the CPU 20A determines that no operation button has been pressed (NO in step S101), it proceeds to step S104.

[0044] In step S102, CPU20A executes a configuration process. Details of the configuration process will be described later.

[0045] In step S103, CPU20A executes the display process. Details of the display process will be described later.

[0046] In step S104, the CPU 20A determines whether or not to terminate the program. If the CPU 20A determines to terminate the program (YES in step S104), it terminates the comparison process. On the other hand, if the CPU 20A determines not to terminate the program (NO in step S104), it returns to step S100.

[0047] Next, we will explain the setting process in step S102. In step S200 of Figure 6, the CPU 20A determines whether or not the Select 1 button 50 was operated. If the CPU 20A determines that the Select 1 button 50 was operated (YES in step S200), it proceeds to step S201. On the other hand, if the CPU 20A determines that the Select 1 button 50 was not operated (NO in step S200), it proceeds to step S202.

[0048] In step S201, CPU20A executes the process of reading drawing 1. For example, it displays a dialog box and prompts the user to select a file.

[0049] In step S202, the CPU 20A determines whether or not the Select 2 button 52 has been operated. If the CPU 20A determines that the Select 2 button 52 has been operated (YES in step S202), it proceeds to step S203. On the other hand, if the CPU 20A determines that the Select 2 button 52 has not been operated (NO in step S202), it proceeds to step S204.

[0050] In step S203, CPU20A executes the process of reading drawing 2. For example, it displays a dialog box and prompts the user to select a file.

[0051] In step S204, the CPU 20A determines whether the offset value has been changed. Specifically, the CPU 20A determines whether the change bar 56 has been manipulated. If the CPU 20A determines that the offset value has been changed (YES in step S204), it proceeds to step S205. On the other hand, if the CPU 20A determines that the offset value has not been changed (NO in step S204), it proceeds to step S207.

[0052] In step S205, the CPU 20A determines whether both drawing 1 and drawing 2 have been loaded. If the CPU 20A determines that both drawing 1 and drawing 2 have been loaded (YES in step S205), it proceeds to step S206. On the other hand, if the CPU 20A determines that neither drawing 1 nor drawing 2 have been loaded (NO in step S205), it terminates the setup process.

[0053] In step S206, the CPU 20A performs region recognition processing. Specifically, the CPU 20A determines the region surrounding the geometric element using an extracted region based on the default offset value or a modified offset value. Then, the CPU 20A completes the setup process.

[0054] In step S207, the CPU 20A determines whether both drawing 1 and drawing 2 have been loaded. If the CPU 20A determines that both drawing 1 and drawing 2 have been loaded (YES in step S207), it proceeds to step S208. On the other hand, if the CPU 20A determines that neither drawing 1 nor drawing 2 have been loaded (NO in step S207), it terminates the setup process.

[0055] In step S208, the CPU 20A determines whether or not the calculation button 54 has been operated. If the CPU 20A determines that the calculation button 54 has been operated (YES in step S208), it proceeds to step S209. On the other hand, if the CPU 20A determines that the calculation button 54 has not been operated (NO in step S208), it terminates the setting process.

[0056] In step S209, CPU20A performs the comparison calculation process. Then, CPU20A completes the setup process.

[0057] Next, the comparison calculation process in step S209 will be described. In the comparison calculation process of this embodiment, a comparison is performed using so-called template matching. In step S250 of Figure 7, the CPU 20A calculates the similarity and sets the combination of graphic elements. First, the CPU 20A calculates the similarity of the graphic elements in each drawing. Then, for each element in Drawing 1, the CPU 20A sets the combination with the highest similarity from the elements in Drawing 2.

[0058] In the next steps, from S251 to S255, the similarity between the combined geometric elements of Figure 1 and Figure 2 is compared with a threshold value.

[0059] In step S251, CPU 20A determines whether the similarity is equal to or greater than the second threshold. If CPU 20A determines that the similarity is equal to or greater than the second threshold (YES in step S251), it proceeds to step S252. On the other hand, if CPU 20A determines that the similarity is not equal to or greater than the second threshold, that is, that the similarity is less than the second threshold (NO in step S251), it proceeds to step S253.

[0060] In step S252, the CPU 20A determines that the combination of geometric elements being compared remains unchanged. In other words, each geometric element in the combination is determined to be unchanged. Then, the process proceeds to step S256.

[0061] In step S253, CPU 20A determines whether the similarity is equal to or greater than the first threshold. If CPU 20A determines that the similarity is equal to or greater than the first threshold (YES in step S253), it proceeds to step S254. On the other hand, if CPU 20A determines that the similarity is not equal to or greater than the first threshold, that is, that the similarity is less than the first threshold (NO in step S253), it proceeds to step S255.

[0062] In step S254, the CPU 20A determines that the combination of geometric elements being compared has been modified. In other words, each geometric element in the combination is determined to be a modified geometric element. Then, the process proceeds to step S256.

[0063] In step S255, the CPU 20A determines that there is no corresponding combination of geometric elements. In other words, each geometric element in the combination is determined to be a geometric element that does not have a corresponding counterpart. Then, the process proceeds to step S256.

[0064] In step S256, the CPU 20A determines whether or not there are any undetermined combinations of geometric elements. If the CPU 20A determines that there are no undetermined combinations of geometric elements (YES in step S256), it terminates the comparison calculation process. On the other hand, if the CPU 20A determines that there are undetermined combinations of geometric elements (NO in step S256), it returns to step S251. Then, the similarity of the next combination is compared with the threshold.

[0065] Next, the display process in step S103 will be explained. In step S300 of Figure 8, the CPU 20A determines whether button 60 (Drawing 1) is selected. If the CPU 20A determines that button 60 (Drawing 1) is selected (YES in step S300), the process proceeds to step S301. On the other hand, if the CPU 20A determines that button 60 (Drawing 1) is not selected (NO in step S300), the process proceeds to step S304.

[0066] In step S301, the CPU 20A determines whether the area button 64 is selected. If the CPU 20A determines that the area button 64 is selected (YES in step S301), it proceeds to step S302. On the other hand, if the CPU 20A determines that the area button 64 is not selected (NO in step S301), it proceeds to step S303.

[0067] In step S302, the CPU 20A displays drawing 1, including the border line EL of the extracted area, in drawing view 42. Then, the CPU 20A terminates the display process.

[0068] In step S303, CPU 20A displays drawing 1 in drawing view 42, excluding the border line EL of the extracted area. Then, CPU 20A terminates the display process.

[0069] In step S304, the CPU 20A determines whether button 61 in the diagram is selected. If the CPU 20A determines that button 61 in the diagram is selected (YES in step S304), it proceeds to step S305. On the other hand, if the CPU 20A determines that button 61 in the diagram is not selected (NO in step S304), it proceeds to step S308.

[0070] In step S305, the CPU 20A determines whether the area button 64 is selected. If the CPU 20A determines that the area button 64 is selected (YES in step S305), it proceeds to step S306. On the other hand, if the CPU 20A determines that the area button 64 is not selected (NO in step S305), it proceeds to step S307.

[0071] In step S306, the CPU 20A displays drawing 2, including the border line EL of the extracted area, in drawing view 42. Then, the CPU 20A terminates the display process.

[0072] In step S307, CPU 20A displays drawing 2 in drawing view 42, excluding the border line EL of the extracted area. Then, CPU 20A terminates the display process.

[0073] In step S308, the CPU 20A determines whether the difference button 62 is selected. If the CPU 20A determines that the difference button 62 is selected (YES in step S308), it proceeds to step S309. On the other hand, if the CPU 20A determines that the difference button 62 is not selected (NO in step S308), it terminates the display process.

[0074] In step S309, the CPU 20A determines whether the unit button 66 is selected or not. If the CPU 20A determines that the unit button 66 is selected (YES in step S309), it proceeds to step S310. On the other hand, if the CPU 20A determines that the unit button 66 is not selected, that is, that the overall button 67 is selected (NO in step S309), it proceeds to step S311.

[0075] In step S310, the CPU 20A displays the difference between the drawing elements of drawing 1 and the drawing elements of drawing 2 in drawing view 42. In this case, the CPU 20A displays the difference between the selected geometric elements in list view 46 in the center of drawing view 42. Then, the CPU 20A terminates the display process.

[0076] In step S311, the CPU 20A displays the difference between the entirety of drawing 1 and the entirety of drawing 2 in drawing view 42. Therefore, if the overall button 67 is selected and the position of graphic elements changes between drawing 1 and drawing 2, this difference is displayed in drawing view 42. Then, the CPU 20A terminates the display process.

[0077] (Regarding the offset value) Figure 9 shows the relationship between the offset value and the region. In the image processing device 10 of this embodiment, the more the offset value is increased, the smaller the number of recognized graphic elements becomes, that is, the larger the recognized region (the range of the frame line EL) becomes. Figure 9(A) is an example where the offset value is set to "5". In this case, within the range of the figure, three regions are recognized: region A1 which includes a pair of structures and leader lines, region A2 which consists of the center line, and region A3 which is an annotation.

[0078] Furthermore, Figure 9(B) shows an example where the offset value is set to "10". In this case, within the range of the figure, two areas are recognized: area B1, which includes a pair of structures, a leader line, and a center line, and area B2, which is the annotation. Furthermore, Figure 9(C) shows an example where the offset value is set to "15". In this case, within the range of the figure, one area is recognized: area C1, which includes a pair of structures, a leader line, a center line, and an annotation.

[0079] Each recognized element is enclosed by a border line EL, making it visible to the user viewing the display device 24 so that the area is clear. According to this embodiment, by making the extraction area changeable, it is possible to compare various types of drawings, such as drawings with dense geometric elements like circuits and circuit boards, and drawings with simple geometric elements like the exterior of equipment.

[0080] (Regarding displaying differences) Figure 10 shows an example of visualizing the differences between Figure 1 and Figure 2. First, when only Figure 1 is displayed in drawing view 42, graphic elements are displayed with solid red lines. When only Figure 2 is displayed in drawing view 42, graphic elements are displayed with solid blue lines. On the other hand, when the differences between Figure 1 and Figure 2 are displayed in drawing view 42, as shown in Figure 10, common parts in Figure 1 and Figure 2, i.e., parts that have not changed, are displayed with solid gray lines (see L1). In other words, graphic elements displayed only with solid gray lines are displayed as graphic elements that have not changed.

[0081] Furthermore, areas where only Figure 1 exists are indicated by a solid red line (see L2). Similarly, areas where only Figure 2 exists are indicated by a solid blue line (see L3). In Figure 10, L2 is shown as a dashed line and L3 as a dotted line to indicate color differences. In other words, graphic elements displayed with different colors will be shown as modified graphic elements. If only one color graphic element exists, it will be displayed as a graphic element with no comparison.

[0082] According to the image processing device 10 of this embodiment, areas where there are differences between drawings are displayed with different colors for the graphic elements in each drawing, making it easier for the user to understand the changes. Furthermore, areas where there are no differences are not associated with either image and are displayed on the display device 24 in an inconspicuous color, making it possible to communicate the changes to the user more clearly.

[0083] (Summary of the embodiments) The image processing device 10 of this embodiment extracts graphic elements from multiple drawings and calculates a similarity score between different drawings for each graphic element. Based on the similarity score, it is determined whether the graphic element has been changed, whether the graphic element has not been changed, or whether there is no comparison target. In the case of "no comparison target," examples include the addition or deletion of graphic elements. According to this embodiment, there is no need to perform pre-processing such as alignment during comparison, thus improving processing efficiency.

[0084] [remarks] In the above embodiment, the example shown is comparing drawings, but this is not limited to this case; any image containing a graphic, such as a painting or a photograph, may be compared.

[0085] Furthermore, the various processes that the CPU 20A reads and executes in the above embodiment may be executed by various processors other than the CPU. Examples of such processors include PLDs (Programmable Logic Devices) such as FPGAs (Field-Programmable Gate Arrays) whose circuit configuration can be changed after manufacturing, and dedicated electrical circuits that are processors with circuit configurations specifically designed to execute specific processes, such as ASICs (Application Specific Integrated Circuits). In addition, each of the above processes may be executed by one of these various processors, or by a combination of two or more processors of the same or different types (for example, multiple FPGAs, and a combination of a CPU and an FPGA). More specifically, the hardware structure of these various processors is an electrical circuit that combines circuit elements such as semiconductor elements.

[0086] Furthermore, in the above embodiment, each program was described as being pre-stored (installed) on a non-temporary recording medium that can be read by a computer. For example, the processing program 100 in the image processing device 10 is pre-stored on the storage 20D. However, the program is not limited to this, and each program may be provided in a form recorded on a non-temporary recording medium such as a CD-ROM (Compact Disc Read Only Memory), DVD-ROM (Digital Versatile Disc Read Only Memory), and USB (Universal Serial Bus) memory. Alternatively, the program may be provided in a form downloaded from an external device via a network.

[0087] The processing flow described in the above embodiment is just one example, and unnecessary steps may be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose. [Explanation of symbols]

[0088] 10 Image Processing Device 24 Display device (display section) 100 Image Processing Programs (Processing Programs) 200 Acquisition Department 210 Extraction part 220 Calculation Unit 230 Output section

Claims

1. An acquisition unit that acquires multiple images, An extraction unit for extracting graphic elements from each of the acquired plurality of images, A calculation unit calculates the similarity between different images for each of the extracted graphic elements, For graphic elements whose calculated similarity is greater than or equal to the first threshold and less than the second threshold, the output unit outputs the difference between the graphic elements to the display unit as modified graphic elements. Equipped with, The calculation unit calculates the similarity for all combinations of the graphic elements between different images, and sets the combination with the highest similarity for each graphic element. An image processing device in which the similarity compared to the threshold is the similarity to the graphic element set as the combination with the highest similarity.

2. The output unit is, The image processing apparatus according to claim 1, wherein the calculated similarity of graphic elements equal to or greater than the second threshold is output to the display unit as graphic elements that have not been changed.

3. The extraction unit is The image processing apparatus according to claim 1 or 2, wherein the extraction region of the graphic element to be extracted in the aforementioned image can be changed.

4. The output unit is, The image processing apparatus according to any one of claims 1 to 3, wherein the parts of the graphic elements that have differences when compared in different images are superimposed on the display unit in different colors for each image.

5. The output unit is, The image processing apparatus according to claim 4, wherein, for parts of the graphic elements compared in different images that do not have differences, the display unit displays them in a color that is different from the color of each image and less conspicuous than the color of each image.

6. Acquire multiple images, In each of the acquired images, geometric elements are extracted, The similarity is calculated for all combinations of the aforementioned graphic elements between different images. For each of the aforementioned geometric elements, set the combination with the highest similarity. For graphic elements whose similarity to the graphic element set as the most similar combination is equal to or greater than the first threshold and less than the second threshold, the difference between the graphic elements is output to the display unit as the modified graphic element. An image processing method in which a computer performs the processing.

7. Acquire multiple images, In each of the acquired images, geometric elements are extracted, The similarity is calculated for all combinations of the aforementioned graphic elements between different images. For each of the aforementioned geometric elements, set the combination with the highest similarity. For graphic elements whose similarity to the graphic element set as the most similar combination is equal to or greater than the first threshold and less than the second threshold, the difference between the graphic elements is output to the display unit as the modified graphic element. An image processing program that instructs a computer to perform image processing.

8. An acquisition unit that acquires multiple images, An extraction unit for extracting graphic elements from each of the acquired plurality of images, A calculation unit calculates the similarity between different images for each of the extracted graphic elements, For graphic elements whose calculated similarity is greater than or equal to the first threshold and less than the second threshold, an output unit outputs the difference in the image as a modified graphic element to the display unit. Equipped with, The output unit is, An image processing device that outputs to the display unit a graphic element whose calculated similarity is less than the first threshold as a graphic element for which there is no comparison.

Images