Work support device, work support method, and work support system
The work support device enhances table detection in circuit drawings by converting geometric data to pixel data, using line and symbol detection to accurately identify table areas and cells, addressing the issue of irrelevant objects and improving digitization accuracy.
Patent Information
- Application Number
- JP2022162715
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-10-07
- Publication Date
- 2026-01-08
- Estimated Expiration
- 2042-10-07
AI Technical Summary
Conventional technologies struggle to accurately detect table structures in circuit drawings due to the presence of objects unrelated to table lines, such as circuit symbols or diagram symbols, leading to incorrect shape calculations.
A work support device and method that converts circuit drawing data from a geometric information format to a pixel-based format, employs line detection, character detection, and symbol detection units to identify table objects, and utilizes threshold values and intersection analysis to accurately detect table areas and cells, even in the presence of irrelevant objects.
Enables precise analysis of table structures by distinguishing between different line types and symbols, improving the accuracy of table area and cell detection, and facilitating the digitization of handwritten data for work progress tracking.
Smart Images

Figure 0007795995000001 
Figure 0007795995000002 
Figure 0007795995000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to a work support device, a work support method, and a work support system, and more particularly to a work support device that can be suitably used to extract a table from image data representing a drawing. [Background technology]
[0002] Labor shortages are becoming more serious due to population decline and an aging society with a declining birthrate. There is a shortage of highly skilled experts in manufacturing sites, and the situation where only certain people can perform certain tasks, known as personalization, is becoming a problem. When passing on advanced technology, the successor also needs to have a certain level of skill, but due to a shortage of mid-career engineers in this position, the current situation is that technology transfer is not progressing well in many companies. In order to promote the transfer of technology to younger skilled workers, it is necessary to create a system in which explicit knowledge such as work procedures and know-how can be compiled into manuals and work can be carried out regardless of skill level. In response to this situation, attention is being focused on activities to digitize business operations using wearable devices such as electronic paper.
[0003] Patent Document 1 discloses a frame line recognition device in which an intersection extraction unit extracts intersections between ruled lines extracted from an input image, a storage unit stores intersection information including arm vectors each moving toward or away from the intersection along each ruled line belonging to the intersection and a flag indicating whether the arm vector has been used in a route search, and the frame line extraction unit performs a route search starting from a predetermined intersection and according to the direction of the arm vector, and when a closed route is detected, the frame line extraction unit extracts the closed route as a frame line and updates the flag corresponding to the arm vector used to detect the closed route to "used," and when all flags have been updated to "used," ends the route search. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2012-64098 Summary of the Invention [Problem to be solved by the invention]
[0005] However, when the shape of the intersections is calculated based on the coordinate information of all lines, as in conventional technology, the table area may not be detected correctly if there are objects unrelated to the table lines, such as circuit symbols or diagram symbols. An object of the present invention is to provide a task support device, a task support method, and a task support system that can correctly analyze a table structure even if an object unrelated to the table lines exists. [Means for solving the problem]
[0006] In order to solve the above problems, the present invention provides a work support device comprising: a conversion unit that converts first circuit drawing data created in a first data format configured to represent lines that constitute figures that describe circuit components using geometric information, into second circuit drawing data created in a second data format configured to represent figures that describe circuit components using pixels; a line detection unit that detects lines from at least one of the first circuit drawing data and the second circuit drawing data; a character detection unit that detects characters from at least one of the first circuit drawing data and the second circuit drawing data; a circuit symbol detection unit that detects circuit symbols excluding conductors from an image area of the second circuit drawing data; a graphic symbol detection unit that detects graphic symbols based on the detected lines and characters; a conductor line detection unit that detects circuit symbols and lines that contact graphic symbols from the lines detected by the line detection unit as conductor lines; a table object detection unit that detects the remaining parts of the lines detected by the line detection unit excluding the circuit symbols, graphic symbols, and conductor lines as table objects that constitute a table; a first table area detection unit that detects a table area that is an area of a table in a drawing based on the table object; and a table cell detection unit that detects cells within the table area.
[0007] The line detection unit can classify the detected lines by line type, which is the type of line, and in this case, it is possible to determine whether the lines are the same cell or not by the line type. Furthermore, the line detection unit can classify the detected lines into a group representing lines and a group representing points based on a first threshold value set for the line length, which makes it easy to classify the lines into a group representing lines and a group representing points. Furthermore, the line detection unit can set a second threshold value for each interval in the direction in which the detected lines extend, and classify the groups representing lines into solid lines and dashed lines based on the second threshold value. In this case, it is possible to easily classify the lines into solid lines and dashed lines. Furthermore, the table cell detection unit can determine that cells adjacent to each other across a dashed line are the same cell, thereby improving the accuracy of cell detection. Furthermore, the first table area detection unit can detect a table area after converting the shape of the intersections of the lines that make up the table, thereby improving the accuracy of table area detection. Furthermore, the first table area detection unit can convert the shape of the intersections by excluding lines whose length is equal to or less than a predetermined threshold, thereby further improving the accuracy of table area detection. Furthermore, after converting the shape of the intersections by excluding lines with a length equal to or less than a predetermined threshold, the first table area detection unit can further convert the shape of the intersections for the steps of the cells that make up the table using a predetermined conversion table, thereby further improving the accuracy of table area detection. The first table area detection unit can convert the shape of the intersection when the table comes into contact with the outline of the drawing, thereby detecting the table area even when the table comes into contact with the outline of the drawing. In addition, the table cell detection unit can traverse the outer frame of the table to extract the intersections where the outer frame intersects with the ruled lines that make up the table, and can detect cells based on the extracted intersections. In this case, cells can be easily detected. Furthermore, the table cell detection unit can extract the ruled lines that form the cells by repeating the process of extracting straight lines that touch the intersections, then extracting straight lines that touch the extracted straight lines, and then extracting straight lines that touch the extracted straight lines until no new straight lines can be extracted, thereby improving the accuracy of ruled line extraction.
[0008] The present invention also provides a conversion unit that converts first circuit drawing data created in a first data format configured to represent lines constituting a figure describing a circuit component by geometric information into second circuit drawing data created in a second data format configured to represent a figure describing the circuit component by pixels; a line detection unit that detects lines from at least one of the first circuit drawing data and the second circuit drawing data; a character detection unit that detects characters from at least one of the first circuit drawing data and the second circuit drawing data; and a character detection unit that detects characters derived from an image area of the second circuit drawing data. This work support device includes a circuit symbol detection unit that detects circuit symbols excluding lines, a graphic symbol detection unit that detects graphic symbols based on the detected lines and characters, a conductor detection unit that detects circuit symbols and lines that contact graphic symbols from the lines detected by the line detection unit as conductor lines, a table object detection unit that detects the remaining parts of the lines detected by the line detection unit excluding the circuit symbols, graphic symbols, and conductor lines as table objects that make up a table, a second table area detection unit that determines the table type, which is the type of table, and separates a table area, which is the area of the table in the drawing, and an intra-table cell detection unit that detects cells within the table area.
[0009] In the task support device according to claim 12, the second table area detection unit separates the table from the other elements using lines shared by them as boundaries, converts the shape of the intersections, and then detects the table area. In this case, the table area can be separated with high accuracy.
[0010] Furthermore, the present invention provides a work support method for converting first circuit drawing data created in a first data format configured to represent lines that constitute figures that describe circuit components using geometric information into second circuit drawing data created in a second data format configured to represent figures that describe circuit components using pixels, by having a processor execute software recorded in a memory; detecting lines from at least one of the first circuit drawing data and the second circuit drawing data; detecting characters from at least one of the first circuit drawing data and the second circuit drawing data; detecting circuit symbols excluding conductors from an image area of the second circuit drawing data; detecting graphical symbols based on the detected lines and characters; detecting circuit symbols and lines that contact the graphical symbols from the detected lines as conductors; detecting the remaining parts of the detected lines excluding the circuit symbols, graphical symbols, and conductors as table objects that constitute a table; detecting a table area that is the area of the table in the drawing based on the table object; and detecting cells within the table area.
[0011] Furthermore, the present invention comprises a work terminal on which work is performed by handwriting in cells of a table in a drawing, and a work support device that detects the cells and analyzes the content handwritten in the cells, the work support device including a conversion unit that converts first circuit drawing data created in a first data format configured to represent lines constituting a figure describing a circuit component by geometric information into second circuit drawing data created in a second data format configured to represent the figure describing the circuit component by pixels, a line detection unit that detects lines from at least one of the first circuit drawing data and the second circuit drawing data, and a line detection unit that detects lines from at least one of the first circuit drawing data and the second circuit drawing data. The second work support system includes a character detection unit that detects characters, a circuit symbol detection unit that detects circuit symbols excluding conductor lines from the image area of the second circuit drawing data, a symbol detection unit that detects symbols based on the detected lines and characters, a conductor line detection unit that detects circuit symbols and lines that contact the symbols from the lines detected by the line detection unit as conductor lines, a table object detection unit that detects the remaining parts of the lines detected by the line detection unit excluding the circuit symbols, symbols, and conductor lines as table objects that make up a table, a first table area detection unit that detects a table area that is the area of a table in the drawing based on the table object, and a table cell detection unit that detects cells within the table area. [Effects of the Invention]
[0012] According to the present invention, it is possible to provide a task support device, a task support method, and a task support system that can correctly analyze a table structure even if an object unrelated to the table lines exists. [Brief explanation of the drawings]
[0013] [Figure 1] 10A and 10B are diagrams showing examples of tables that are used when using the work support system of this embodiment. [Figure 2] 1A is a diagram showing an example of a drawing including unnecessary objects, and FIG. 1B is a diagram showing a table after unnecessary objects have been removed from the drawing. [Figure 3]1 is a block diagram showing a functional configuration of a work support system according to a first embodiment. [Figure 4] 10A and 10B are diagrams illustrating a process in which a line detection unit classifies detected lines by line type. [Figure 5] FIG. 10 is a diagram showing a method for detecting cells using line types. [Figure 6] FIG. 10 is a diagram showing the result of removing unnecessary objects from a drawing. [Figure 7] FIG. 10 is a diagram illustrating cases where the circuit symbol detection unit detects circuit symbols using a template matching method, a deep learning (object detection model) method, and a deep learning (object detection + object identification method). [Figure 8] 10(A) to 10(D) are diagrams showing examples of graphic symbols. [Figure 9] 10(A) and 10(B) are diagrams showing a method in which a first table area detection unit detects a table area. [Figure 10] (A) is a diagram showing a table to be detected. (B) is an example of intersections arranged in the Y direction extracted from the table shown in (A). (C) is an example of intersections arranged in the X direction extracted from the table shown in (A). [Figure 11] 10A to 10E are diagrams showing how the table cell detection unit extracts intersections of table ruled lines. [Figure 12] (A) shows the case where two tables are adjacent to each other, and (B) shows the case where an L-shaped table is treated as a rectangular table and cells are extracted. [Figure 13] 10A to 10D are diagrams showing a method for detecting cells in a rectangular table with missing corners. [Figure 14] 4 is a flowchart showing the operation of the work support system according to the first embodiment. [Figure 15] FIG. 10 is a diagram showing an example of adding information to circuit components in a drawing. [Figure 16] 1A is a diagram showing a case where the shape of an intersection cannot be detected correctly, and FIG. 1B is a diagram showing a minute line. [Figure 17] FIG. 10 is a diagram showing a conversion table for converting the shape of an intersection when there is a small step between adjacent cells. [Figure 18] 1A is a diagram showing a case where the outline of a drawing and the outer frame of a table come into contact, and FIGS. 1B and 1C are diagrams showing a method in which the first table area detection unit converts the shape of the intersection when the table comes into contact with the outline of a drawing. [Figure 19] 10 is a flowchart illustrating the operation of a first table area detection unit in the second embodiment. [Figure 20] (A) shows a case where the table is in contact with other elements, and (B) shows a case where the outer frame of the table is made up of the outline of the drawing and the four corners cannot be distinguished. [Figure 21] FIG. 10 is a block diagram showing the functional configuration of a work support system according to a third embodiment. [Figure 22] 10 is a flowchart illustrating a process of determining a table type and detecting a table area based on the table type. [Figure 23] FIG. 23 is a diagram showing a method in which the second table area detection unit determines the table type in step S301 of FIG. [Figure 24] 23 is a flowchart illustrating special table area detection performed by a second table area detection unit in step S303 of FIG. 22. [Figure 25] 25(A) to 25(C) are diagrams illustrating steps S401 to S403 in FIG. 24 in more detail. [Figure 26] 10 is a flowchart showing the operation of the work support system according to the third embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0014] <Overall explanation of work support system 1> 1(A) and 1(B) are diagrams showing examples of tables that are used when using the task support system 1 of this embodiment. Figure 1(A) shows table H1 before the work of marking it in red, and Figure 1(B) shows table H2 after the work of marking it in red. In this case, when the contents of each cell of table H1 shown in Figure 1(A) are consistent, the worker handwrites over table H1 and marks it in red.
[0015] Because handwritten data includes time-series data, using a wearable device makes it possible to obtain information that cannot be obtained from paper work, such as work procedures and work times.In addition, the work progress rate can be calculated from the total number of check items and the total number of items checked. However, this handwritten data is merely point cloud data, and is not directly linked to the table. To digitize the results of the vermilion painting work, it is necessary to identify which cells have been checked by comparing the coordinates of the handwritten data on the drawing with the coordinates of the table cells.
[0016] Data describing a drawing, such as CAD drawing data, may be described using unique information within the data (e.g., circuit symbol type, identifier, coordinates of figures that make up a table or circuit symbol, etc.). When checking table cells by hand for data created in this data format, it is relatively easy to identify the table cell on the handwritten path. This is because it is sufficient to identify the coordinates of the handwritten path and compare them with the coordinates of the cell in the table.
[0017] On the other hand, terminal devices, such as wearable devices, used by workers at work sites may not have the processing power to display drawings created in such a data format. In this case, the drawing data must be converted into a data format that can be displayed by the terminal device. Examples of data formats that can be displayed by terminal devices include raster data, which represents shapes using pixels. When checking a table cell by hand on a drawing in such a data format, as shown in Figure 1(B), it is not easy to identify the table cell. This is because the coordinate information of the table is lost when the data format is converted, and the data becomes mere pixel information.
[0018] Furthermore, to identify cells in a table, it is necessary to detect the borders that make up the table, but there are many unnecessary objects other than the borders of the table in the drawing. These objects hinder the detection of the table. The following explains unnecessary objects.
[0019] FIG. 2A is a diagram showing an example of a drawing that includes unnecessary objects. As shown in the figure, there are cases where circuits are written inside the table, wiring is written outside the table, and symbols such as caution marks are in contact with the table. These can cause false detection of ruled line intersections. FIG. 2B is a diagram showing the table when unnecessary object Ob1 is removed from FIG. 2A. By removing unnecessary objects, the intersections of lines become clearer, making it less likely that false positives will occur, thereby improving the accuracy of table detection.
[0020] The task support system 1 according to the present embodiment will be described below with reference to first to third embodiments.
[0021] [First embodiment] First, a description will be given of a first embodiment of the task support system 1. In the first embodiment, a case will be described in which unnecessary objects are removed from a drawing and table cells are detected.
[0022] FIG. 3 is a block diagram showing the functional configuration of the task support system 1 according to the first embodiment. The illustrated work support system 1 comprises a work support device 2 that detects table cells in a drawing and analyzes the content handwritten in the cells, and a work terminal 3 on which a worker performs work by handwriting in the table cells in the drawing. The work support device 2 is a device that extracts handwritten portions from a drawing that a worker has handwritten using the work terminal 3. The work terminal 3 is a terminal device on which the worker works on the drawing, and is, for example, a wearable terminal used when applying red lacquering as shown in FIG. 2(B) above.
[0023] The work support device 2 includes a drawing analysis unit 10 that analyzes drawing data, which is data representing a drawing, and detects table cells present in the drawing, a handwritten data analysis unit 20 that analyzes handwritten data created by a worker on the work terminal 3, a communication unit 30 that communicates with the work terminal 3, and a DB (Data Base) 40.
[0024] The illustrated work support system 1 operates generally as follows. After the worker handwrites on the drawing at the work terminal 3, the drawing data is sent to the work support device 2. The sent drawing data is received by the communication unit 30 of the work support device 2 and sent to the handwritten data analysis unit 20. Meanwhile, the drawing analysis unit 10 of the work support device 2 analyzes the drawing data before the worker overwrites it, and detects each cell of the table present in the drawing. Then, the handwritten data analysis unit 20 of the work support device 2 extracts the part handwritten by the worker in each cell. This corresponds to the part shaded in red in Figure 1(B). Then, the analysis result of the handwritten part is saved in the DB 40.
[0025] <Explanation of Drawing Analysis Unit 10> Next, the drawing analysis unit 10 will be described in detail. The drawing analysis unit 10 includes a conversion unit 11 that converts the format of image data, a drawing analysis unit 12 that detects table objects that exist in the drawing and constitute a table, a first table area detection unit 13 that detects table areas that are areas of tables that exist in the drawing, and a table cell detection unit 14 that detects cells within a table.
[0026] The conversion unit 11 converts first circuit drawing data created in a first data format F1 into second circuit drawing data created in a second data format F2. In this case, the first data format F1 is a data format configured to represent lines constituting a figure describing circuit components using geometric information. The first data format F1 is, for example, CAD drawing data. The second data format F2 is a data format configured to represent a figure describing circuit components using pixels. The second data format F2 is, for example, raster format data. The drawing analysis unit 12 detects table objects, which are objects that make up a table, from the converted drawing data. Table objects are, for example, ruled lines. The first table area detection unit 13 detects a table area, which is a table area in a drawing, based on a table object. The table cell detection unit 14 detects cells in a table area, that is, the table cell detection unit 14 detects cells separated by ruled lines in a table.
[0027] <Detailed explanation of drawing analysis unit 12> Next, the drawing analysis unit 12 will be described in detail. The drawing analysis unit 12 also includes a circuit symbol detection unit 121 , a line detection unit 122 , a character detection unit 123 , a conductor detection unit 124 , a diagram symbol detection unit 125 , and a table object detection unit 126 .
[0028] The circuit symbol detection unit 121 detects circuit symbols excluding conductors from the image area of the second circuit drawing data. The line detection unit 122 detects lines from at least one of the first circuit diagram data and the second circuit diagram data. The character detection unit 123 detects characters from at least one of the first circuit diagram data and the second circuit diagram data. Conductor detection unit 124 detects, from the lines detected by line detection unit 122, lines that contact circuit symbols and graphic symbols as conductors. The graphic symbol detection unit 125 detects graphic symbols based on the detected lines and characters. The table object detection unit 126 detects the remaining parts, excluding circuit symbols, diagram symbols, and conducting wires, from the lines detected by the line detection unit 122 as table objects that make up a table.
[0029] The line detection unit 122 detects lines from the image data and classifies the detected lines according to their line types. FIG. 4 is a diagram showing the process in which the line detection unit 122 classifies the detected lines according to their line types. The line detection unit 122 classifies detected lines into a group representing lines and a group representing points, based on a first threshold set for the line length. That is, if the length of the detected line is equal to or greater than the first threshold, it is classified into the line group. On the other hand, if the length of the detected line is less than the first threshold, it is classified into the point group. The first threshold is set to a length that allows dotted lines created with drawing software to be detected as points.
[0030] Next, the line detection unit 122 sets a second threshold value for each interval in the direction in which the detected lines extend, and classifies the group representing the lines into solid lines and dashed lines based on the second threshold value. That is, if similar lines exist in the direction in which the detected lines extend and the interval between them exceeds the second threshold value, these are separate lines, and the detected lines are classified as solid lines. On the other hand, if the interval is equal to or less than the second threshold value, the detected lines are classified as dashed lines.
[0031] Furthermore, when a detected line is classified as a dashed line, the line detection unit 122 classifies the type of dashed line according to the number of points present between the detected lines. That is, if the number of points is 0, the line is classified as a normal dashed line. If the number of points is 1, the line is classified as a chain line (one-dot chain line). If the number of points is 2, the line is classified as a two-dot chain line.
[0032] The line detection unit 122 then sets a third threshold for each interval in the direction in which the detected line extends, and classifies the group of points into points and dotted lines based on the third threshold. That is, if similar lines exist in the direction in which the detected line extends and the interval between them exceeds the third threshold, these are separate points, and the detected line is classified as a point. On the other hand, if the interval is equal to or less than the third threshold, the detected line is classified as a dotted line.
[0033] FIG. 5 is a diagram showing a method for detecting cells using line types. The table consists of horizontal and vertical lines. By analyzing horizontal and vertical lines, excluding diagonal lines that are unrelated to the table, the processing speed and accuracy of the analysis when detecting cells are improved. The dotted lines in table H3 shown in Figure 5 are not lines that divide cells, but lines that align characters. In this case, it is more convenient to consider the first through fourth rows as one cell. In this case, the table cell detection unit 14 considers cells that are adjacent to each other on either side of the dashed line to be the same cell. By distinguishing and using line types, table information can be digitized correctly as intended by the drawing creator.
[0034] FIG. 6 shows the result of removing unnecessary objects from a drawing. The input drawing Z0 indicates that characters, lines, circuit symbols, diagram symbols, and conductors exist as unnecessary objects in the drawing. In this case, in this embodiment, first, the character detection unit 123, the line detection unit 122, and the circuit symbol detection unit 121 detect characters, lines, and circuit symbols, respectively. Drawing Z1 shows the result of detecting characters in the diagram by the character detection unit 123. Drawing Z2 shows the result of detecting lines in the diagram by the line detection unit 122. Drawing Z3 shows the result of detecting circuit symbols in the diagram by the circuit symbol detection unit 121.
[0035] Furthermore, in this embodiment, graphic symbol detection unit 125 detects graphic symbols based on the detected characters and lines. Then, in this embodiment, conductor detection unit 124 detects, as conductors, circuit symbols and lines that contact graphic symbols from the lines detected by line detection unit 122. Drawing Z4 shows the results of detection of graphic symbols in a drawing by graphic symbol detection unit 125. Furthermore, drawing Z5 shows the results of detection of conductor lines in a drawing by conductor detection unit 124. Then, the table object detection unit 126 removes these unnecessary objects from the input drawing Z0. Drawing Z6 shows a case where the table object detection unit 126 removes the unnecessary objects and detects, as the remainder, a table object Ob2 that constitutes a table.
[0036] To detect circuit symbols, methods such as template matching, deep learning (object detection model), and deep learning (object detection + object identification) can be used. FIG. 7 is a diagram showing a case where the circuit symbol detection unit 121 detects a circuit symbol by a template matching method, a deep learning (object detection model) method, and a deep learning (object detection+object identification method). (Method A) The template matching method detects circuit symbols by performing template matching using a template image prepared in advance against the input drawing Z0. The template matching method is easy to implement, but is vulnerable to image scaling and rotation. (Method B) Deep learning (object detection model) method detects circuit symbols using a detector trained using object detection models such as R-CNN, YOLO, and SSD. Because it is a single model, it is difficult to train it to eliminate detection errors. (Method C) Deep learning (object detection + object identification method) detects circuit symbols using a detector trained with an object detection model as well as an object identification model such as ResNet, DenseNet, AmoebaNet, or EfficientNet. This allows the identification model to reject detection errors, improving the accuracy of circuit symbol detection.
[0037] 8(A) to 8(D) are diagrams showing examples of graphic symbols. In this case, in addition to the attention mark shown in Fig. 8(A), the arrow shown in Fig. 8(B), and the brackets shown in Fig. 8(C), simple character strings may also be treated as graphic symbols, as shown in Fig. 8(D). In this case, if lines touch the left and right or top and bottom of the character area and these lines are on the same straight line, it is detected that the character is being treated as a symbol. These graphic symbols can be detected using a rule base.
[0038] <Detailed Description of First Table Area Detection Unit 13> Next, the first table area detection unit 13 will be described in detail. The first table area detection unit 13 detects a table area as follows. 9(A) and 9(B) are diagrams showing a method in which the first table area detection unit 13 detects a table area. The first table area detection unit 13 detects table areas by circulating the outer frame of the table based on the extracted table object.
[0039] The rotation direction at this time is shown as (A-1) rotation direction in Fig. 9(A). That is, there are two ways, clockwise or counterclockwise, and either one is adopted. Furthermore, when the robot reaches an intersection where the lines that make up the table intersect during its rotation, the direction of travel is determined by the shape of the intersection. The shape of the intersection is where the horizontal and vertical lines that make up the table intersect. For example, the horizontal and vertical lines intersect in a shape that forms a ""[ shape. Note that there are four shapes for this orientation, rotated 90 degrees each. Also, the horizontal and vertical lines intersect in a shape that forms a "T" shape. Note that there are four shapes for this orientation, rotated 90 degrees each. Furthermore, the horizontal and vertical lines intersect in a shape that forms a "+". The rules for the direction of travel when an intersection is reached are shown as (A-2) Direction of Travel in Figure 9(A). Here, the rules for the direction of travel when circling the outer frame of the table are shown for both clockwise and counterclockwise directions.
[0040] An actual example of traversing the outer frame of a table will be explained with reference to FIG. 9(B). First, the starting point is one of the intersections on the outer frame of the table as shown in the figure. In this case, the starting point is the intersection located in the upper left corner as shown in (a). The shape of the intersection at this point corresponds to the "upper left" in the clockwise direction of (A-2). The direction of travel at this intersection is given priority in the direction of No. 1, and if it is not possible to travel in the direction of No. 1, it will move in the direction of No. 2. In this case, since it is not possible to travel upward, it will move to the right.
[0041] From then on, if the shape of the intersection does not reach any of the intersections of "top left", "top right", "bottom right", or "bottom left" in (A-2), this rule will be maintained, but if it does reach any of them, the rule will be changed to the rule described in (A-2). Therefore, the second intersection shown in (b) is not an intersection of "upper left", "upper right", "lower right", or "lower left", so the "upper left" rule is maintained. In this case, No. 1 is the upward direction, and you can proceed in that direction, so you proceed upward. The third intersection shown in (c) is the "upper left" intersection, so this rule is maintained and we proceed to the right of No. 2. The fourth intersection shown in (d) is not an "upper left", "upper right", "lower right", or "lower left" intersection, so the "upper left" rule is maintained. In this case, proceed to the right of No. 2. The fifth intersection shown in (e) is an "upper right" intersection, so the rule is changed to "upper right." In this case, since it is not possible to proceed to the right of No. 1, it proceeds downwards to No. 2. This process is repeated from (f) to (h) and returns to the original starting point at (h). This allows the table area to be detected as shown in (i).
[0042] <Detailed Description of Table Cell Detection Unit 14> Next, the table cell detection unit 14 will be described in detail. The table cell detection unit 14 detects cells in a table as follows. 10(A) is a diagram showing table H4 to be detected. As shown in the figure, table H4 is formed by a plurality of lines (ruled lines) that make up table H4, which are arranged vertically (up and down in the figure, Y direction) and horizontally (left and right in the figure, X direction) and intersect. In this embodiment, cells in table H4 are detected by focusing on the intersections of the ruled lines. Figure 10(B) is an example of extracting intersections aligned in the Y direction from table H4 shown in Figure 10(A). In this case, the intersections are indicated by "●" or "◯". At this time, four intersections indicated by Y1 to Y4 are detected in the Y direction. The thick lines connecting these intersections in the Y direction are the ruled lines. As a result, it can be seen that the cell arrangement is three rows. In this way, the number of cell rows can be defined by the number of intersections aligned in the Y direction. Also, Figure 10(C) is an example of extracting intersections aligned in the X direction from table H4 shown in Figure 10(A). In this case, the intersections are indicated by "●" or "◯". At this time, five intersections indicated by X1 to X5 are detected in the X direction. The thick lines connecting these intersections in the X direction are the ruled lines. As a result, it can be seen that the cell arrangement is in four columns. In this way, the number of cell columns can be defined by the number of intersections aligned in the X direction.
[0043] However, the detected table object is not necessarily a table border, and the detected intersections are not necessarily table border intersections. 11(A) to 11(E) are diagrams showing a method in which the table cell detection unit 14 extracts intersections of ruled lines in a table. FIG. 11(A) shows a case where table H5 contains lines other than ruled lines. In this case, the L-shaped table object Ob3 is not a ruled line of table H5. Furthermore, the intersections indicated by "★" in FIG. 11(B) are not intersections of ruled lines of table H5. Note that the intersections of ruled lines of table H5 are indicated here by "●". In this embodiment, the table cell detection unit 14 excludes the intersections indicated by "★" in the following manner. 11(C), the table cell detection unit 14 traverses the outer frame of table H5 to detect the intersections between the outer frame and the ruled lines that make up table H5. The starting point for traversing the outer frame of table H5 is, for example, the upper left corner, and the outer frame of table H5 is traced clockwise or counterclockwise. When the table cell detection unit 14 returns to the original starting point, it determines that this is the end point. The table cell detection unit 14 then detects cells based on the extracted intersections. Specifically, as shown in FIG. 11(D), the table cell detection unit 14 extracts lines that touch these intersections. Furthermore, the table cell detection unit 14 extracts lines that further touch the extracted straight lines. The table cell detection unit 14 then repeats the process of extracting lines that further touch the extracted straight lines until no new lines can be extracted. In this way, the table cell detection unit 14 extracts the ruled lines that form the cells. As shown in FIG. 11(E), the table cell detection unit 14 detects the intersections on the extracted lines as intersections of the ruled lines of table H5. According to this method, the L-shaped table object Ob3 is not extracted, and the intersections indicated by "★" are excluded.
[0044] When detecting cells in a table that are not rectangular, the table cell detection unit 14 can do so by the following method. 12(A) shows the case where two tables are adjacent to each other, one of which is an L-shaped table H6 and the other is a rectangular table H7. In the method shown in Figure 10, the L-shaped table H6 may be treated as a rectangular table, as shown in Figure 12(B), and cells may be extracted. In the example shown, the areas of the two tables H6 and H7 may overlap. It is rare for tables to be used in a modified form, and it is common for tables to have a shape other than a rectangle, with one or more of the four corners missing.
[0045] 13A to 13D are diagrams showing a method for detecting cells in a rectangular table with missing corners. FIG. 13(A) shows an example of a rectangular table H8 with the four corners cut off. In this case, the areas around the four corners of the rectangle are not table areas, but non-table areas, as shown in Fig. 13(B).The non-table areas are detected in the following manner. First, as shown in Fig. 13(C), the coordinates of the four corners are calculated from the combination of maximum and minimum values in the X and Y directions of the table area. Here, the four corners are designated as corners 1 to 4. Next, as shown in Figure 13(D), among the calculated coordinates of the four corners, the four corners that are not included in the outer frame of the table H8 are set as starting points. In this case, all four corners are set as starting points. Here, these are shown as starting points 1 to 4. The distance from each start point to the nearest intersection in the horizontal direction is defined as the width, and the distance to the nearest intersection in the vertical direction is defined as the height. In this case, as shown in Figure 13(D), widths 1 to 4 and heights 1 to 4 are defined for start points 1 to 4, respectively. The four rectangles with widths 1 to 4 and heights 1 to 4 become non-table areas.
[0046] 14 is a flowchart showing the operation of the task support system 1 in the first embodiment. Note that this describes the processing after the conversion unit 11 converts image data from the first data format F1 to the second data format F2. First, the line detection unit 122 detects lines from at least one of the first circuit diagram data and the second circuit diagram data (step S101). Next, the character detection unit 123 detects characters from at least one of the first circuit diagram data and the second circuit diagram data (step S102). Furthermore, the circuit symbol detection unit 121 detects circuit symbols excluding conductors from the image area of the second circuit drawing data (step S103). Furthermore, conductor detection unit 124 detects, from the lines detected by line detection unit 122, lines that contact the circuit symbols and graphic symbols as conductors (step S104). Then, the graphic symbol detection unit 125 detects graphic symbols based on the detected lines and characters (step S105).
[0047] Next, the table object detection unit 126 detects the remaining parts, excluding the circuit symbols, diagram symbols, and conducting wires, from the lines detected by the line detection unit 122 as table objects that make up a table (step S106). Furthermore, the first table area detection unit 13 detects a table area, which is an area of a table in the drawing, based on the table object (step S107). Here, the detection of the table area is illustrated as first table area detection. Then, the table cell detection unit 14 detects cells in the table area (step S108).
[0048] Meanwhile, the communication unit 30 sends the image data to the work terminal 3 (step S109). At the work terminal 3, the worker performs the vermilion painting work as shown in FIG. 1 (step S110). Then, the handwritten data by the worker is sent to the work support device 2 and received by the communication unit 18 (step S111). Next, the handwritten data analysis unit 20 analyzes the handwritten data handwritten in the cells (step S112). At this time, the information of the cells detected in step S108 is used, and the handwritten data is analyzed for each cell. Then, the analysis results are registered in the DB 40 (step S113). Thereafter, the worker is notified that the work has been completed (step S114).
[0049] FIG. 15 is a diagram showing an example of adding information to circuit components in a drawing. For example, an electronic component such as a CPU may have a table inside it that shows the wiring connections. Table H9 inside the CPU on the left side of the drawing in Figure 15 shows that the CPU's IF1 signal is connected to terminals 1 and 2. It also shows that the CPU's IF2 signal is connected to terminals 3 and 4. The diagram on the right side of the drawing in Figure 15 shows the case where the ammeter is in contact with table H10. The ammeter on the left is for the power supply, and the ammeter on the right is for the standby power supply. In this way, by adding the information from tables H9 and H10 to the circuit components, the drawing can be digitized in more detail.
[0050] [Second embodiment] Next, a description will be given of a second embodiment of the task support system 1. In the second embodiment, the first table area detection unit 13 detects a table area after converting the shape of the intersections of lines that make up a table.
[0051] FIG. 16A is a diagram showing a case where the shape of the intersection cannot be detected correctly. Figure 16(A) shows an intersection point K1 at the corner of a table, and illustrates a case where the intersection point K1 is originally shaped like ""[, but because the table object protrudes from the corner, it is detected as a "T" shape, as shown in the speech bubble. In such a case, it becomes impossible to cycle as shown in Figure 9, making it difficult to correctly detect the table area.
[0052] Therefore, in this embodiment, the first table area detection unit 13 calculates the length of lines in each direction with the intersection K1 as the origin, and determines the shape of the intersection by ignoring lines that are less than a threshold. That is, if the length of the "△" shown in the left diagram of FIG. 16(B) is a very small line that is less than this threshold, this part is ignored, and the shape is determined to be " " as shown in the speech bubble in the right diagram of FIG. 16(B). This can also be said to mean that the first table area detection unit 13 converts the shape of the intersection by ignoring lines that are less than a predetermined threshold in length.
[0053] However, as shown in Figure 16, if the shape of the intersection is determined while ignoring lines of minute length, the intersection of the table may not be detected correctly if there is a slight step between adjacent cells in the table. FIG. 17 shows a conversion table for converting the shape of an intersection when there is a small step between adjacent cells. The first table area detection unit 13 converts the shape of the intersections by assuming that there are no lines with a length less than a predetermined threshold, and then further converts the shape of the intersections using a predetermined conversion table for the steps of the cells that make up the table. For example, in the case shown in (1), the shape of the intersection is a combination of upper left and upper right, and a slight step occurs between adjacent cells C1 and C2. The first table area detection unit 13 then shows the conditions under which it determines that such a step occurs and the conversion method. In other words, since the vertical line L1 of this minute step portion is of a very small length, the intersection shape, which is actually a "T", is judged to be a "" shape. Therefore, a process is performed to convert the intersection shape from the "" shape to the original shape, that is, a "T" shape.
[0054] Furthermore, if a table contacts a contour line in the drawing, the table area cannot be detected correctly. FIG. 18(A) shows a case where the outline Lr of the drawing and the outer frame of the table H11 come into contact. In this case, the detected shape of the intersection at the top right corner of table H11 is different from the correct answer because it touches the contour line Lr. Similarly, the detected shape of the intersection at the right side of table H11 is also different from the correct answer because it touches the contour line Lr.
[0055] 18(B) and 18(C) are diagrams showing a method in which the first table area detection unit 13 converts the shape of the intersection when the table H11 contacts the contour line Lr of the drawing. First, the first table area detection unit 13 detects the contour line Lr. Here, as shown in Fig. 18(B), the first table area detection unit 13 detects the longest horizontal and vertical lines that are closest to the origin (the lower left corner of the rectangular contour line Lr) and the longest horizontal and vertical lines that are farthest from the origin as the contour line Lr. Alternatively, the first table area detection unit 13 may detect a line that forms a rectangular area with a large area as the contour line Lr. 18(B), the first table area detection unit 13 converts the shapes of the T and cross in accordance with the contour line Lr. For example, the T (pointing up) that touches the bottom frame is deleted, and the cross is converted to a T (pointing down). As shown in Figure 18(C), the first table area detection unit 13 starts from one of the four corners of the table H11 and moves clockwise or counterclockwise around the outer frame of the table H11. When the first table area detection unit 13 comes into contact with the contour line Lr, it converts the shape of the intersection point based on the decision table at the bottom of Figure 18(C). The decision table in Figure 18(C) shows the starting point, rotation direction, and the converted shape of the intersection point when it comes into contact with the contour line Lr.
[0056] FIG. 19 is a flowchart illustrating the operation of the first table area detection unit 13 in the second embodiment. First, the first table region detection unit 13 adjusts the lengths of the lines that make up the table (step S201). Specifically, if the gap between the horizontal and vertical lines is equal to or smaller than a threshold, the lines are extended to eliminate the gap. Next, the first table area detection unit 13 detects the intersections of the lines that make up the table (step S202). The coordinates of the intersections can be detected from the coordinate relationship between the start and end points of the horizontal and vertical lines. Next, the first table area detection unit 13 converts the shape of the intersection of the protruding ruled lines (step S203). Specifically, as shown in Fig. 16, the first table area detection unit 13 calculates the length of the lines in each direction using the intersection as the origin, and determines the shape of the intersection while ignoring lines that are equal to or shorter than a threshold.
[0057] Next, the first table area detection unit 13 converts the shape of the intersection of the minute step (step S204). Specifically, as shown in Fig. 17, the first table area detection unit 13 converts the shape of the intersection while referring to a conversion table. Next, the first table area detection unit 13 converts the shapes of the intersections on the contour line (step S205). Specifically, as shown in Fig. 18, the first table area detection unit 13 converts the shapes of the T and cross in the outer frame of the table H11 that contacts the contour line Lr by referring to a conversion table. Then, the first table area detection unit 13 detects the table area (step S206). Specifically, the first table area detection unit 13 starts from one of the four corners of the table, circles around the outer frame, and when it returns to the start point, it detects it as a candidate for a table.
[0058] [Third embodiment] Next, a description will be given of a third embodiment of the task support system 1. In the third embodiment, the algorithm for detecting a table area is changed depending on the table type, which is the type of table.
[0059] FIG. 20(A) is a diagram showing a case where the table is in contact with another component. The left diagram in Figure 20(A) shows a case where table H12 comes into contact with non-table object Ob4. The right diagram in Figure 20(A) shows a case where table H13 and table H14 come into contact with each other. In this case, the other components that come into contact with the table are object Ob4 and another table, respectively. FIG. 20(B) shows a case where the outer frame of table H15 is formed by the outline Lr of the drawing and the four corners cannot be distinguished. In this case, it can be said that the table H15 and the outline Lr of the drawing are in contact. In this case, the other components that are in contact with the table are the outlines Lr.
[0060] FIG. 21 is a block diagram showing the functional configuration of a task support system 1 according to the third embodiment. The task support system 1 shown in FIG. 21 is different from the task support system 1 in the first embodiment shown in FIG. 3 in that a second table area detection unit 15 is added, but is otherwise similar. Therefore, in the following description of the task support system 1, the second table area detection unit 15 will be mainly described, and a description of the other functional units will be omitted. In this embodiment, the second table area detection unit 15 determines the table type, which is the type of table, and changes the algorithm for detecting the table area.
[0061] FIG. 22 is a flowchart illustrating the process of determining the table type and detecting the table area based on the table type. First, the second table area detection unit 15 determines the table type (step S301). Here, "table type" refers to the type of table classified according to whether or not the table is in contact with other components. Here, if the table is not in contact with other components, it is classified as a general table. On the other hand, if the table is in contact with other components, it is classified as a special table. If the table is a general table that is not in contact with other components (if it is a general table in step S301), the first table area detection unit 13 performs general table area detection, which is a process for detecting a normal table area (step S302). That is, the first table area detection unit 13 detects a table area by the method described in the first and second embodiments. On the other hand, if the table is a special table that is in contact with other components (special table in step S301), the second table area detection unit 15 performs special table area detection, which is a process of detecting the table area of the special table (step S303). After steps S302 and S303, the table cell detection unit 14 performs processing to detect cells in the table area (step S304), as in the cases described in the first and second embodiments. In this way, the second table area detection unit 15 determines the table type, which is the type of table, separates the table area, which is the area of the table in the drawing, and detects the table area, which is the area of the table in the drawing.
[0062] <Explanation of surface species determination> FIG. 23 is a diagram showing a method in which the second table area detection unit 15 determines the table type in step S301 of FIG. In this embodiment, the type of table is determined based on the information in the title field that has been registered in advance. For example, if the name of a drawing in H16 is registered in advance as "Connection order of XX device" = special table, the special table can be determined. In this embodiment, in the case of a special table, the second table area detection unit 15 detects the table area.
[0063] <Explanation of special tablespace detection> FIG. 24 is a flowchart illustrating the special table area detection performed by the second table area detection unit 15 in step S303 of FIG. First, the second table area detection unit 15 separates the table areas (step S401). Next, the second table area detection unit 15 converts the shape of the intersection (step S402). Then, the second table area detection unit 15 detects the table area (step S403).
[0064] 25(A) to 25(C) are diagrams explaining steps S401 to S403 in FIG. 24 in more detail. Here, the user separates the mutually adjacent tables H13 and H14 displayed on the screen while looking at the screen, and the second table area detection unit 15 acquires the results.
[0065] FIG. 25A is a diagram showing the process of separating table areas in step S401 of FIG. When the user clicks or drags on the screen with a pointing device such as a mouse, a selection screen D1 for separation areas or shared lines is displayed. To specify a line that constitutes either table H13 or H14, the user selects "Separation Area" on selection screen D1. To specify a line that is commonly used in tables H13 and H14, the user selects "Shared Line" on selection screen D1. Figure 25(A) shows that "Shared Line" on selection screen D1 was selected, and the shared line L2 was selected with cursor Cu1 shown on the left. Figure 25(A) also shows that "Separation Area" on selection screen D1 was selected, and the lines that constitute table H14 were selected with two rectangular areas R1 and R2 with cursor Cu2 shown on the right.
[0066] FIG. 25B is a diagram showing the process of transforming the shape of the intersection in step S402 of FIG. When the table regions are separated, a separate screen for each table region is displayed on the screen. In this state, when the user drags the mouse, a selection screen D2 is displayed, allowing the user to select upper left, upper right, lower left, lower right, or none. The user then specifies the erroneously detected location using regions R3 and R4, and selects either upper left, upper right, lower left, lower right, or none to change the shape of the intersection. Figure 25(B) shows a case where the shape of the intersection where the shared line L2 extends beyond the tables H13 and H14 is changed.
[0067] FIG. 25C is a diagram showing the process of detecting a table area in step S403 of FIG. This process is the same as the process described with reference to FIG. 9, and for each of tables H13 and H14, the table area is detected by traversing the outer frame of the table. In this way, the second table area detection unit 15 separates the table from other elements using the lines shared by them as boundaries, converts the shapes of the intersections, and then detects the table area.
[0068] FIG. 26 is a flowchart showing the operation of the task support system 1 in the third embodiment. In steps S507 to S509 in Fig. 26, the processing explained in Fig. 22 is performed. Other steps S501 to S506 and steps S510 to S515 in the flowchart are the same as steps S101 to S106 and steps S109 to S114 in the flowchart in Fig. 14.
[0069] According to the above-described aspects, it is possible to provide a task support device, a task support method, and a task support system that can correctly analyze a table structure even if an object unrelated to the table lines exists.
[0070] <Explanation of work support method> The above-described processes performed by the task support device 2 are realized by the cooperation of software and hardware resources. That is, a processor in a computer provided in the task support device 2 loads software that realizes each of the above-described functions into memory and executes it to realize each of these functions. Therefore, the processing performed by the work support device 2 can be considered to be a work support method in which, by the processor executing software recorded in the memory, the processor converts first circuit drawing data created in a first data format configured to represent lines that make up figures describing circuit components using geometric information into second circuit drawing data created in a second data format configured to represent figures describing circuit components using pixels, detects lines from at least one of the first circuit drawing data and the second circuit drawing data, detects characters from at least one of the first circuit drawing data and the second circuit drawing data, detects circuit symbols excluding conductors from the image area of the second circuit drawing data, detects graphic symbols based on the detected lines and characters, detects circuit symbols and lines that contact the graphic symbols from the detected lines as conductors, detects the remaining parts of the detected lines excluding the circuit symbols, graphic symbols and conductors as table objects that make up a table, detects a table area that is the area of the table in the drawing based on the table object, and detects cells within the table area.
[0071] Although the present embodiment has been described above, the technical scope of the present invention is not limited to the scope of the above embodiment. It is clear from the claims that various modifications and improvements to the above embodiment are also included in the technical scope of the present invention. [Explanation of symbols]
[0072] 1...work support system, 2...work support device, 3...work terminal, 10...drawing analysis unit, 11...conversion unit, 12...drawing analysis unit, 13...first table area detection unit, 14...table cell detection unit, 15...second table area detection unit, 20...overwrite data analysis unit, 30...communication unit, 40...DB, 121...circuit symbol detection unit, 122...line detection unit, 123...character detection unit, 124...conductor detection unit, 125...graphic symbol detection unit, 126...table object detection unit, H1 to H16...table
Claims
1. a conversion unit that converts first circuit drawing data created in a first data format configured to represent lines constituting a figure describing a circuit component by geometric information into second circuit drawing data created in a second data format configured to represent the figure describing the circuit component by pixels; a line detection unit that detects lines from at least one of the first circuit diagram data and the second circuit diagram data; a character detection unit that detects characters from at least one of the first circuit diagram data and the second circuit diagram data; a circuit symbol detection unit that detects circuit symbols excluding conductors from an image area of the second circuit drawing data; a graphic symbol detection unit that detects a graphic symbol based on the detected line and character; a conductor detection unit that detects, from the lines detected by the line detection unit, lines that contact the circuit symbol and the graphic symbol as conductors; a table object detection unit that detects the remaining parts of the lines detected by the line detection unit, excluding the circuit symbol, the graphic symbol, and the conductor wire, as table objects that constitute a table; a first table area detection unit that detects a table area in a drawing based on the table object; a table cell detection unit that detects cells in the table area; A work support device comprising:
2. The work support device according to claim 1 , wherein the line detection unit classifies the detected lines according to line types.
3. The task support device according to claim 2 , wherein the line detection unit classifies the detected lines into a group representing lines and a group representing points, based on a first threshold value set for the length of the line.
4. 4. The work support device according to claim 3, wherein the line detection unit sets a second threshold value for each interval in the direction in which the detected lines extend, and classifies the groups representing the lines into solid lines and dashed lines based on the second threshold value.
5. The work support device according to claim 4 , wherein the table cell detection unit determines that the cells adjacent to each other on either side of the dashed line are the same cell.
6. The work support device according to claim 1 , wherein the first table area detection unit detects the table area after converting the shape of the intersections of lines that make up the table.
7. The work support device according to claim 6 , wherein the first table area detection unit converts the shape of the intersections by excluding lines having a length equal to or less than a predetermined threshold value.
8. 8. The work support device according to claim 7, wherein the first table area detection unit converts the shape of the intersections by assuming that there are no lines having a length equal to or less than a predetermined threshold, and then further converts the shape of the intersections using a predetermined conversion table for steps of cells that make up the table.
9. The work support device according to claim 6 , wherein the first table area detection unit converts the shape of the intersection when the table contacts the contour of the drawing.
10. The work support device according to claim 1, wherein the table cell detection unit circulates around the outer frame of the table to extract intersections where the outer frame intersects with ruled lines that make up the table, and detects the cells based on the extracted intersections.
11. 11. The work support device according to claim 10, wherein the table cell detection unit extracts the ruled lines that form the cells by repeating the process of extracting straight lines that are tangent to the intersections, further extracting straight lines that are tangent to the extracted straight lines, and further extracting straight lines that are tangent to the extracted straight lines until no new straight lines can be extracted.
12. a conversion unit that converts first circuit drawing data created in a first data format configured to represent lines constituting a figure describing a circuit component by geometric information into second circuit drawing data created in a second data format configured to represent the figure describing the circuit component by pixels; a line detection unit that detects lines from at least one of the first circuit diagram data and the second circuit diagram data; a character detection unit that detects characters from at least one of the first circuit diagram data and the second circuit diagram data; a circuit symbol detection unit that detects circuit symbols excluding conductors from an image area of the second circuit drawing data; a graphic symbol detection unit that detects a graphic symbol based on the detected line and character; a conductor detection unit that detects the lines that contact the circuit symbol and the graphic symbol as conductors from the lines detected by the line detection unit; a table object detection unit that detects the remaining parts of the lines detected by the line detection unit, excluding the circuit symbol, the graphic symbol, and the conductor wire, as table objects that constitute a table; a second table area detection unit that identifies the table type and separates a table area that is a table area in the drawing; a table cell detection unit that detects cells in the table area; A work support device comprising:
13. The task support device according to claim 12 , wherein the second table area detection unit separates a table from another element using a line shared by the table and the other element as a boundary, converts the shape of the intersection, and then detects the table area.
14. The processor executes the software stored in the memory. converting first circuit drawing data created in a first data format configured to represent lines constituting a figure describing a circuit component by geometric information into second circuit drawing data created in a second data format configured to represent the figure describing the circuit component by pixels; Detecting lines from at least one of the first circuit drawing data and the second circuit drawing data; Detecting characters from at least one of the first circuit drawing data and the second circuit drawing data; Detecting circuit symbols excluding conductor lines from the image area of the second circuit drawing data; Detecting a graphic symbol based on the detected line and character; Detecting the circuit symbol and the wires contacting the graphic symbol as conductors from the detected wires; detecting the remaining parts of the detected lines, excluding the circuit symbol, the graphic symbol, and the conductor, as table objects constituting a table; Detecting a table area in the drawing based on the table object; Find cells in the table area Work support method.
15. a work terminal on which work is performed by handwriting in table cells in the drawing; a work support device that detects the cells and analyzes the contents handwritten in the cells; Equipped with The work assistance device includes: a conversion unit that converts first circuit drawing data created in a first data format configured to represent lines constituting a figure describing a circuit component by geometric information into second circuit drawing data created in a second data format configured to represent the figure describing the circuit component by pixels; a line detection unit that detects lines from at least one of the first circuit diagram data and the second circuit diagram data; a character detection unit that detects characters from at least one of the first circuit diagram data and the second circuit diagram data; a circuit symbol detection unit that detects circuit symbols excluding conductors from an image area of the second circuit drawing data; a graphic symbol detection unit that detects a graphic symbol based on the detected line and character; a conductor detection unit that detects, from the lines detected by the line detection unit, lines that contact the circuit symbol and the graphic symbol as conductors; a table object detection unit that detects the remaining parts of the lines detected by the line detection unit, excluding the circuit symbol, the graphic symbol, and the conductor wire, as table objects that constitute a table; a first table area detection unit that detects a table area in a drawing based on the table object; a table cell detection unit that detects the cells in the table area; A work support system comprising:
Citation Information
Patent Citations
Method and device for preparing program and method and device for preparing printing image data
JP1995129391A
Device, method and program for defining business form
JP2005056010A
Image processing apparatus and program
JP2008090785A
Frame line recognizing method and frame line recognizing device
JP2012064098A
Data generation system and data generation program
JP2022015969A