Drawing display device

The drawing display device addresses data processing challenges by converting and coloring drawing data to reduce processing, enabling efficient display of differences using primary colors and machine learning alignment.

JP7865219B2Active Publication Date: 2026-05-26TOYOTA JIDOSHA KK

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
TOYOTA JIDOSHA KK
Filing Date
2023-01-13
Publication Date
2026-05-26

AI Technical Summary

Technical Problem

Existing CAD systems face significant data processing challenges in displaying differences between new and old drawing data due to the large amount of processing required for creating and comparing bitmap information.

Method used

The drawing display device converts drawing data to monochrome and assigns different primary colors to each set of data, overlaying them on a background image to display differences using a combination of colors, reducing data processing by employing machine learning for alignment and feature point matching.

Benefits of technology

This approach allows for efficient display of differences between drawing data sets while significantly reducing data processing requirements.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007865219000001
    Figure 0007865219000001
  • Figure 0007865219000002
    Figure 0007865219000002
  • Figure 0007865219000003
    Figure 0007865219000003
Patent Text Reader

Abstract

To provide an image display device which displays a difference between two pieces of drawing data while reducing the data processing volume.SOLUTION: An image display device includes a control unit which executes: a process for changing first drawing data into monochrome, and independently giving a first color among the three primary colors of light to the first drawing data after being changed to the monochrome; a process for changing second drawing data into monochrome, and independently giving a second color among the three primary colors of light to the second drawing data after being changed to the monochrome; and a process for displaying a difference between the first drawing data and the second drawing data on the basis of overlapping of the first drawing data after being given with the first color and the second drawing data after being given with the second color.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a drawing display device.

Background Art

[0002] There is known a CAD (Computer Aided Design) system that overlays each drawing element by aligning the reference positions of new drawing data and old drawing data, detects the parts where the elements do not match as the differences between the new and old drawings, and displays them with different brightness and display colors for those parts. Also, there is known a technique for displaying the added parts of the new drawing data and the deleted parts from the old drawing data in different colors among the differences (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, in the above-described technology, a process of creating bitmap information of old drawing data corresponding to the display range of new drawing data is carried out. Also, a process of extracting the differences between the new and old drawing data by a comparison process based on the bitmap image of the display range of the new drawing data and this bitmap information is carried out. Further, a process of displaying the extracted differences together with the new drawing data with a display attribute different from the display attribute of the new drawing data is carried out. Thus, in the above-described technology, various processes are carried out, and there is a problem that the data processing amount is enormous.

[0005] Therefore, an object of the present invention is to provide a drawing display device that suppresses the data processing amount and displays the differences between two drawing data.

Means for Solving the Problems

[0006] The drawing display device according to the present invention converts the first drawing data into monochrome, and the first drawing data after being converted into monochrome background area The process involves assigning the first of the three primary colors of light to the second drawing data, and then converting the second drawing data to monochrome. background area The process involves assigning the second color from the three primary colors to it individually, The process involves overlaying the first and second drawing data, each assigned the first and second colors respectively, onto a background image data to which the third color of the three primary colors has been applied, thereby displaying a white background created by combining the first, second, and third colors. It also involves displaying the third color in the overlapping portion between the first and second drawing data images so that the background shows through, and displaying the combined color of the first and second colors applied to the other drawing data and the third color as a difference between the images in the portion where one of the first and second drawing data images exists. It has a control unit that performs the following actions.

[0008] In the above configuration, the first color, the second color, and the third color are all different colors, and each may be represented by numerical data that represents the brightest brightness among the brightness levels classified into 256 gradations.

[0009] In the above configuration, the control unit may perform the following processes: dividing a first region representing one page of the first media data into a plurality of first unit regions, and dividing a second region representing one page of the second media data into a plurality of second unit regions; identifying the correspondence between each of the plurality of first unit regions and each of the plurality of second unit regions based on a predetermined feature point matching method using machine learning; aligning the positions of the first drawing data included in the first media data and the second drawing data included in the second media data based on the movement of either the first unit region or the second unit region having the correspondence to the other of the first unit region or the second unit region having the correspondence; and, after aligning the positions, converting the first drawing data and the second drawing data into monochrome. [Effects of the Invention]

[0010] According to the present invention, it is possible to display the differences between two drawing data sets while reducing the amount of data processing required. [Brief explanation of the drawing]

[0011] [Figure 1] This is an example of a hardware configuration for a drawing display device. [Figure 2] This is an example of the functional configuration of a drawing display device. [Figure 3] (a) is an example of data from the first media. (b) is an example of data from the second media. [Figure 4] This is a flowchart illustrating an example of the operation of the control unit. [Figure 5] (a) is an example of a difference image. (b) is another example of a difference image. [Modes for carrying out the invention]

[0012] Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings.

[0013] First, the hardware configuration of the drawing display device 100 will be described with reference to Figure 1. The drawing display device 100 includes a CPU (Central Processing Unit) 100A as a processor, and RAM (Random Access Memory) 100B and ROM (Read Only Memory) 100C as memory. The drawing display device 100 also includes a network I / F (interface) 100D and an HDD (Hard Disk Drive) 100E. An SSD (Solid State Drive) may be used instead of the HDD (Hard Disk Drive) 100E.

[0014] The drawing display device 100 may include, as necessary, at least one of the following: input I / F 100F, output I / F 100G, input / output I / F 100H, and drive device 100I. The CPU 100A to the drive device 100I are connected to each other by an internal bus 100J. In other words, the drawing display device 100 can be implemented by a computer.

[0015] An input device 11 is connected to the input interface 100F. Examples of input devices 11 include a keyboard, mouse, and touch panel. A display device 12 is connected to the output interface 100G. Examples of display devices 12 include an LCD. A semiconductor memory 13 is connected to the input / output interface 100H. Examples of semiconductor memory 13 include a USB (Universal Serial Bus) memory and flash memory. The input / output interface 100H reads a predetermined program stored in the semiconductor memory 13. The input interface 100F and input / output interface 100H are equipped with, for example, a USB port. The output interface 100G is equipped with, for example, a DisplayPort.

[0016] A portable recording medium 14 is inserted into the drive unit 100I. The portable recording medium 14 may be a removable disk such as a CD (Compact Disc)-ROM or DVD (Digital Versatile Disc). The drive unit 100I reads a predetermined program recorded on the portable recording medium 14. The network interface 100D includes, for example, a LAN (Local Area Network) port and communication circuits.

[0017] A predetermined program stored in at least one of the ROM 100C, HDD 100E, and semiconductor memory 13 is temporarily stored in RAM 100B by the CPU 100A. A predetermined program recorded on the portable recording medium 14 is also temporarily stored in RAM 100B by the CPU 100A. By executing the stored predetermined program, the CPU 100A realizes various functions described later and also performs various processes described later. The predetermined program may be one that corresponds to the flowchart described later.

[0018] The functional configuration of the drawing display device 100 will be explained with reference to Figures 2 and 3. Figure 2 shows the main functions of the drawing display device 100.

[0019] As shown in FIG. 2, the drawing display device 100 includes a storage unit 110, a control unit 120, an input unit 130, and an output unit 140. The storage unit 110 can be realized by the above-described RAM 100B, HDD 100E, etc. The control unit 120 can be realized by the above-described CPU 100A. The input unit 130 can be realized by the above-described input I / F 100F. The output unit 140 can be realized by the above-described output I / F 100G. Therefore, the storage unit 110, the control unit 120, the input unit 130, and the output unit 140 are connected to each other.

[0020] Here, the storage unit 110 includes a first medium storage unit 111, a second medium storage unit 112, and a display drawing storage unit 113. At least one of the first medium storage unit 111, the second medium storage unit 112, and the display drawing storage unit 113 may be provided in an information processing device (not shown) different from the drawing display device 100. In this case, the drawing display device 100 may access the information processing device and refer to the stored contents of the first medium storage unit 111, the second medium storage unit 112, etc.

[0021] The first medium storage unit 111 stores first medium data. The first medium data is a data file or an electronic file of an information transmission medium. The information transmission medium includes, for example, documents such as reports and instructions. In this embodiment, as shown in FIG. 3(a), the first medium data 50 is a document created with multiple pages, but it may also be a document created with a single page. When the first medium data 50 is a document created with multiple pages, each document includes drawing data 51, 52 respectively. The drawing data 51, 52 is, for example, a design drawing of a finished product or a part. The shapes of the drawing data 51, 52 are different from each other.

[0022] The second media storage unit 112 stores the second media data. The second media data, like the first media data 50, is a data file or electronic file for an information transmission medium. In this embodiment, as shown in Figure 3(b), the second media data 60 is a document created with multiple pages, but it may also be a document created with a single page. The number of pages in the second media data 60 may be the same as or different from the number of pages in the first media data 50. If the second media data 60 is a document created with multiple pages, each document includes drawing data 61, 62. The drawing data 61, 62 include, for example, design drawings of finished products or parts. The shapes of the drawing data 61, 62 are different from each other.

[0023] The first media data 50 described above is stored in the first media storage unit 111 based on the operation of the input device 11. The second media data 60 is similarly stored in the second media storage unit 112. In this embodiment, the first media data 50 represents the comparison source for the second media data 60, and the second media data 60 represents the comparison target or comparison object for the first media data 50. Therefore, below, the drawing data 51 and 52 will be referred to as base drawings 51 and 52 as the comparison source, and the drawing data 61 and 62 will be referred to as new drawings 61 and 62 as the comparison target or comparison object.

[0024] The display drawing storage unit 113 stores images of drawings to be displayed on the display device 12. As will be described in detail later, the display drawing storage unit 113 stores an image of a drawing in which a base drawing image corresponding to the base drawing 51 described above and a new drawing image corresponding to either the new drawing 61 or 62 corresponding to this base drawing image are superimposed, and the differences are represented in different colors. The display drawing storage unit 113 also stores an image of a drawing in which a base drawing image corresponding to the base drawing 52 described above and a new drawing image corresponding to the other of the new drawing 61 or 62 corresponding to this base drawing image are superimposed, and the differences are represented in different colors. The base drawing image is an example of first drawing data, and the new drawing image is an example of second drawing data. Both the base drawing image and the new drawing image are image data.

[0025] Returning to Figure 2, the control unit 120 includes an image generation unit 121, an image processing unit 122, and a display unit 123.

[0026] The image generation unit 121 acquires the first media data 50 from the first media storage unit 111 and converts the first media data 50 into an image. That is, the image generation unit 121 generates a first media image representing the first media data 50 from the acquired first media data 50. If the first media data 50 is a document made up of multiple pages, the first media image also includes multiple page images. The multiple page images included in the first media image include the base drawing image described above.

[0027] Similarly, the image generation unit 121 acquires the second media data 60 from the second media storage unit 112 and converts the second media data 60 into an image. That is, the image generation unit 121 generates a second media image representing the second media data 60 from the acquired second media data 60. If the second media data 60 is a document made up of multiple pages, the second media image also includes multiple page images. The multiple page images included in the second media image include the new drawing images described above.

[0028] The image processing unit 122 performs various image processing operations on the first media image and the second media image, as well as the base drawing image and the new drawing image. Details of the image processing unit 122 will be described later, but for example, the image processing unit 122 compares multiple page images contained in the first media image with multiple page images contained in the second media image and identifies page images that are similar to each other. The image processing unit 122 also divides the area representing the page image into multiple unit regions and identifies corresponding parts of the unit regions based on a known feature point matching method using machine learning. The shape of the unit regions may be rectangular or other shapes (e.g., circular). The number of corresponding parts of the unit regions may be the same or different. In addition, the image processing unit 122 monochromeizes (specifically monochrome binarizes) the base drawing image and the new drawing image and assigns different colors to the base drawing image and the new drawing image.

[0029] For known feature point matching methods, you can refer to, for example, the following references 1 and 2. Reference 1: PF Alcantarilla, A. Bartoli, and AJ Davison. “KAZE features”, ECCV, (2012), pp.214?227. Reference 2: P. F, Alcantarilla, J. Nuevo, A. Bartoli, “Fast Explicit Diffusion for Accelerated Features in Nonlinear Scale Spaces”, BMVC, (2013), pp.13.1-13.11.

[0030] The display unit 123 acquires an image of the drawing stored in the display drawing storage unit 113 and displays the acquired drawing on the display device 12. As described above, the display drawing storage unit 113 stores an image of the drawing in which, for example, the parts corresponding to the differences between the base drawing image and the new drawing image are represented in different colors. Therefore, the display unit 123 acquires and displays this drawing.

[0031] Next, the processes executed by the control unit 120 will be described with reference to Figures 4 and 5.

[0032] First, as shown in Figure 4, the image generation unit 121 converts the media data into an image (step S1). More specifically, the image generation unit 121 acquires first media data from the first media storage unit 111 and generates a first media image. The image generation unit 121 also acquires second media data from the second media storage unit 112 and generates a second media image.

[0033] When the media data is converted into an image, the image processing unit 122 identifies similar pages (step S2). Specifically, the image processing unit 122 compares multiple page images contained in the first media image with the page images contained in the second media image, page by page, and calculates the similarity between the page images. After calculating the similarity, the image processing unit 122 identifies the page images with the highest similarity as similar pages. This uniquely identifies similar pages.

[0034] Once similar pages are identified, the image processing unit 122 performs region segmentation (step S3). That is, the image processing unit 122 divides the two page images identified as similar pages into multiple unit regions. After performing region segmentation, the image processing unit 122 uses the feature point matching method described above to identify the correspondence between the unit regions (step S4). This makes it possible to determine a correspondence between any unit region of a page image contained in the first media image and any unit region of a page image contained in the second media image identified as a similar page.

[0035] The page image contained in the first media image contains the base drawing image, and therefore its unit area contains a portion of the base drawing image. Similarly, the page image contained in the second media image contains the new drawing image, and therefore its unit area contains a portion of the new drawing image.

[0036] Once the correspondence is identified, the image processing unit 122 moves one of the corresponding unit regions to the other to align the positions of the base drawing image and the new drawing image (step S5). After aligning the positions of the base drawing image and the new drawing image, the image processing unit 122 converts the base drawing image to monochrome and adds green as the sole color (step S6). Green is one of the three primary colors of light and can be represented as (R,G,B)=(0,255,0) in the RGB color representation of brightness classified into 256 levels. In the brightness classified into 256 levels, the numerical data "255" represents the brightest brightness. Through the processing in step S6, the base drawing image can be represented in green.

[0037] Once the processing in step S6 is complete, the image processing unit 122 converts the new drawing image to monochrome and adds red as the sole color (step S7). Red is one of the three primary colors of light and can be represented in RGB color representation as (R,G,B)=(255,0,0). The processing in step S7 allows the new drawing image to be represented in red. Alternatively, green may be added to the new drawing image and red to the base drawing image.

[0038] Once the processing in step S7 is complete, the image processing unit 122 overlays the base drawing image and the new drawing image onto a blue background (step S8). Blue is one of the three primary colors of light and can be represented in RGB color representation as (R,G,B)=(0,0,255). The background is an example of predetermined data. When the base drawing image and the new drawing image are overlaid onto a blue background, (R,G,B)=(255,255,255), so white can be represented.

[0039] Thus, the portion of the image that consists only of the green base drawing image against a white background has (R,G,B)=(255,255,255)-(0,255,0)=(255,0,255), and can therefore be represented in magenta, which includes pink. Similarly, the portion of the image that consists only of the red new drawing image against a white background has (R,G,B)=(255,255,255)-(255,0,0)=(0,255,255), and can therefore be represented in cyan, which includes light blue. Furthermore, the portion of the image that overlaps the green base drawing image and the red new drawing image against a white background has (R,G,B)=(255,255,255)-(0,255,0)-(255,0,0)=(0,0,255), and can therefore be represented in blue.

[0040] When the processing in step S8 is completed, the image processing unit 122 stores the image of the drawing in the display drawing storage unit 113. Once the image of the drawing is stored in the display drawing storage unit 113, the display unit 123 displays the image of the drawing on the display device 12 (step S9), and the process ends. As a result, as shown in Figures 5(a) and (b), the base drawing image and the new drawing image are superimposed, and an image of the drawing represented in partially different colors appears on the display device 12.

[0041] For example, as shown in Figure 5(a), the difference between the base drawing image corresponding to base drawing 51 and the new drawing image corresponding to new drawing 62 appears on the display device 12 as difference images 71 and 72 of different colors. In this case, difference image 71, which is part of the base drawing image, is displayed in magenta, and difference image 72, which is part of the new drawing image, is displayed in cyan. The superimposed image 73, which is the overlapping portion of the base drawing image and the new drawing image, is displayed in blue.

[0042] Furthermore, as shown in Figure 5(b), the difference between the base drawing image corresponding to the base drawing 52 and the new drawing image corresponding to the new drawing 61 appears on the display device 12 as a difference image 81 of a different color. In this case, the difference image 81, which is a part of the base drawing image, is displayed in magenta, but since the new drawing image is superimposed on the base drawing image as a whole, the new drawing image is displayed in blue as a superimposed image 83.

[0043] Thus, the drawing display device 100 according to this embodiment can extract the differences between the base drawing image and the new drawing image based on the color difference using the three primary colors of light. Therefore, the amount of data processing can be reduced compared to when data processing is performed without relying on the color difference using the three primary colors of light. In addition, the image of the drawing that appears on the display device 12 allows, for example, a person in charge of checking the old and new drawings to easily determine the differences between the drawings.

[0044] Although preferred embodiments of the present invention have been described in detail above, the present invention is not limited to these specific embodiments, and various modifications and changes are possible within the scope of the gist of the invention as described in the claims.

[0045] For example, in the embodiment described above, green was used as the first color, red as the second color, and blue as the third color. However, the combination of the first, second, and third colors may be changed as appropriate, as long as the first, second, and third colors are different from each other among the three primary colors of light. [Explanation of symbols]

[0046] 50 First Media Data 51, 52 Base drawings 60 Second Media Data 61, 62 New drawings 71, 72, 81 Difference Images 73,83 Superimposed images 100 Drawing Display Device 120 Control Unit

Claims

1. A process of converting the first drawing data to monochrome, and then applying the first of the three primary colors of light to the background area of ​​the monochrome first drawing data, The process involves converting the second drawing data to monochrome, and then applying the second of the three primary colors to the background area of ​​the monochrome second drawing data. The process involves overlaying the first and second drawing data, each assigned the first and second colors respectively, onto a background image data to which the third color of the three primary colors has been assigned, thereby displaying a white background created by combining the first, second, and third colors. It also involves displaying the third color in the overlapping portion between the first and second drawing data images so that the background shows through, and displaying the combined color of the first color assigned to the other drawing data and the third color as a difference between the images in the portion where one of the first or second drawing data images exists. A drawing display device having a control unit that performs the following actions.

2. The first, second, and third colors are all different colors, and each is represented by numerical data that represents the brightest brightness among the 256 brightness levels. The drawing display device according to feature 1.

3. The control unit, The process involves dividing a first area representing one page of the first media data into multiple first unit areas, and dividing a second area representing one page of the second media data into multiple second unit areas. A process to identify the correspondence between each of the multiple first unit regions and each of the multiple second unit regions based on a predetermined feature point matching method using machine learning, A process to align the positions of the first drawing data contained in the first media data and the second drawing data contained in the second media data based on the movement of either the first unit region or the second unit region having the aforementioned correspondence to the other of the first unit region or the second unit region having the aforementioned correspondence, After aligning the positions, the process of converting the first drawing data and the second drawing data into monochrome is performed, A drawing display device according to claim 1 or 2, characterized by performing the following: