Drawing operation assistance system

Abstract

The present invention provides a drawing work assistance system that extracts a start point, an end point, and an entire path between the start point and the end point from a drawing automatically in a case where a drawing is displayed on a work terminal to assist work. The drawing work assistance system of the present invention generates connection information between a wiring and a drawing symbol within a drawing, extracts the wiring or the drawing symbol as a start point or end point element that represents a connection, discriminates the start point and the end point based on the start point or end point element, and extracts a path between the start point and the end point.

Description

Technical Field

[0001] This invention relates to a system for assisting drawing operations using portable terminals. Background Technology

[0002] In recent years, the digitization of maintenance work sites has accelerated, replacing the previous paper-based operations with the widespread use of portable terminals for inputting work information. In drawing operations using diagrams containing electrical connection information such as circuits, traces are manually recorded on wiring or drawing symbols. To digitize this work, the drawing is parsed to extract elements such as strings, wiring, and drawing symbols. The coordinates of the handwritten point groups are compared with the coordinates of the extracted elements, allowing it to be determined whether each element has been checked. Based on the element check results, work progress can be confirmed, and appropriate work assistance can be provided from the manager to the operator's portable terminal (e.g., indicating omissions or the optimal steps corresponding to the check stage).

[0003] Patent Document 1 describes a technique for using a scanner to read paper drawings to extract strings and wiring information, thereby retrieving the wiring desired by the operator. Patent Document 2 describes a technique for searching the shortest path between a start point and an end point by manually selecting start and end point elements on a GUI.

[0004] In existing technologies, manually specifying the start and end points for a job generates only one path—the shortest path between the start and end points. However, maintenance jobs require checking all wiring and graphic markings between the start and end points, thus necessitating the generation of all paths between them. Furthermore, the conventional method of manually specifying the start and end points for each job is time-consuming when there are many combinations between them.

[0005] Patent Document 1: Japanese Patent Application Publication No. 2022-162482

[0006] Patent Document 2: Japanese Patent Application Publication No. 2007-293589 Summary of the Invention

[0007] The present invention was made in view of the above-mentioned problems, and its object is to automatically extract the start point, the end point, and the entire path between the start point and the end point from the map when displaying a map on the work terminal to assist in the work.

[0008] The drawing operation assistance system of the present invention generates connection information between wiring and drawing symbols in the drawing, extracts the wiring or drawing symbols as start-end point elements representing the start or end point of the connection, determines the start point and the end point based on the start-end point elements, and extracts the path between the start point and the end point.

[0009] The drawing operation assistance system according to the present invention can improve operation efficiency by automatically generating start and end points and operation paths. Furthermore, it can track the location of all operation paths from the start to the end point, thus enabling progress management of work units. Attached Figure Description

[0010] Figure 1A It is a diagram that represents the work record of maintenance and repair operations using drawings.

[0011] Figure 1B It is a diagram that represents the work record of maintenance and repair operations using drawings.

[0012] Figure 2 This is a graph representing the analytical results after comparing the handwritten text with the coordinates of the elements.

[0013] Figure 3 This is a structural diagram of the drawing operation assistance system 100 according to embodiment 1.

[0014] Figure 4A This represents the registration information for the characters.

[0015] Figure 4B This indicates the registration information for the wiring.

[0016] Figure 4C This indicates the registration information for the symbols on the drawing.

[0017] Figure 5A This is a diagram illustrating the power supply detection method.

[0018] Figure 5B This is a diagram illustrating the power supply detection method.

[0019] Figure 6A This diagram illustrates the idea behind function block detection.

[0020] Figure 6B This diagram illustrates the idea behind function block detection.

[0021] Figure 7A This is a diagram illustrating the idea of ​​load detection.

[0022] Figure 7B This is a diagram illustrating the idea of ​​load detection.

[0023] Figure 8A This is an example of a trapezoidal diagram.

[0024] Figure 8B It is a flowchart illustrating the order of detecting start and end points within a ladder diagram.

[0025] Figure 9A This is an example of FBD.

[0026] Figure 9B This is a flowchart illustrating the order of detecting start and end points within the FBD.

[0027] Figure 10A This is an example of SFC.

[0028] Figure 10B This is a flowchart illustrating the order in which start and end point elements within the SFC are detected.

[0029] Figure 11 This is a diagram representing the table containing the starting and ending elements 154 within database 150.

[0030] Figure 12A This is a diagram illustrating the method for extracting the path between the starting point and the ending point.

[0031] Figure 12B This is a diagram illustrating the method for extracting the path between the starting point and the ending point.

[0032] Figure 12C This is a diagram illustrating the method for extracting the path between the starting point and the ending point.

[0033] Figure 13A This is a structural diagram of the drawing operation assistance system 100 according to embodiment 2.

[0034] Figure 13B This is a structural diagram of the drawing operation assistance system 100 according to embodiment 2.

[0035] Figure 13C This is a structural diagram of the drawing operation assistance system 100 according to embodiment 2.

[0036] Figure 14A This is a diagram illustrating the function of linking symbols.

[0037] Figure 14B This is a diagram illustrating the function of linking symbols.

[0038] Figure 15A It is a diagram that represents the wiring and drawing symbols around the link symbols.

[0039] Figure 15B This is a flowchart illustrating the order in which link tokens are extracted.

[0040] Figure 15C This is a graph representing the database linked by symbol 156.

[0041] Figure 16A This indicates the page where the starting point is located.

[0042] Figure 16B Indicates the page where the destination is located;

[0043] Figure 16C A database representing the path generated by combining the start and end points.

[0044] Figure 17A This diagram illustrates the operation of the path extraction unit 140 between the start and end points when the start and end points exist on the same page.

[0045] Figure 17B This diagram illustrates the operation of the path extraction unit 140 between the start and end points when the start and end points exist on the same page.

[0046] Figure 18A This diagram illustrates the actions of the path generation unit when the start and end points exist on different pages.

[0047] Figure 18B This diagram illustrates the actions of the path generation unit when the start and end points exist on different pages.

[0048] Figure 19A This is a structural diagram of the drawing operation assistance system 100 according to embodiment 3.

[0049] Figure 19B This is a structural diagram of the drawing operation assistance system 100 according to embodiment 3.

[0050] Figure 19C This is a structural diagram of the drawing operation assistance system 100 according to embodiment 3.

[0051] Figure 20 This diagram illustrates an example of displaying task assistance content on a portable terminal 300.

[0052] Figure 21 This example shows the result of the analysis of the work unit analysis unit 160 being displayed to the display unit 400.

[0053] Figure 22A This diagram illustrates the flexible use of the handover function in the work record during drawing replacement.

[0054] Figure 22B This diagram illustrates the flexible use of the handover function in the work record during drawing replacement. Detailed Implementation

[0055] <Implementation Method 1>

[0056] In Embodiment 1 of the present invention, maintenance and repair work using a portable terminal (operation terminal) and its analysis results will be described. First, maintenance and repair work using a portable terminal will be described.

[0057] Figures 1A-1B It is a diagram that represents the work record of maintenance and repair operations using drawings. Figure 1A A drawing that represents an object. Figure 1B Represents handwritten work records on the object drawing. Figure 1A The diagram 110 is displayed on the portable terminal 300 and includes elements such as diagram symbols 151, wiring 152, and characters 153. Figure 1A In the drawing, only a representative subset of elements are numbered, but the drawing symbols 151, 152, and 153 can each contain multiple elements.

[0058] In maintenance and repair work using the portable terminal 300, for example, electrical measurements such as voltage and resistance are performed using a tester, and the work is carried out by handwriting on the confirmed drawing marks 151 and wiring 152. Figure 1B This example demonstrates the operation of confirming the connection from the AC100V power supply to the CPU, showing the result of the operation of drawing the confirmed drawing marks 151 and wiring 152 using handwriting 310 (shown by dashed lines). In this operation, all drawing marks 151 and wiring 152 connecting the AC100V power supply and the CPU need to be drawn. Furthermore, in this invention, the AC100V power supply is referred to as the starting point, the CPU as the ending point, and the connection from the starting point through drawing marks 151 and wiring 152 to the ending point is called a path. In this example, there are four paths 155-1 to 155-4; to complete this operation, these four paths need to be drawn using handwriting 310.

[0059] Figure 2 This section represents the analysis results after comparing handwritten coordinates with element coordinates. It shows the result of comparing the coordinate data of the handwritten point group 310 with the coordinate areas of drawing marks 151 and wiring 152 to determine whether an inspection was performed. Drawing marks 151 that were determined to have been inspected are indicated with a thick box, and wiring 152 is indicated with a thick line. By analyzing the work records performed between the start and end points in this way, it is confirmed whether all paths between the start and end points have been inspected, thus determining whether the confirmation work between the start and end points has been completed. In this example, by confirming the completion of the confirmation work between the start and end points, progress management can be performed on the confirmation of the power line from the AC100V power supply to the CPU. Furthermore, this analysis allows for assigning inspection time to each element, thus effectively utilizing not only the presence or absence of inspected elements but also the work process of the inspection sequence.

[0060] Figure 3This is a structural diagram of the drawing operation assistance system 100 according to Embodiment 1 of the present invention. The drawing operation assistance system 100 is connected to a portable terminal 300 used by the operator via a transceiver server 200. The drawing operation assistance system 100 exchanges data such as files with the portable terminal 300 via the transceiver server 200. The drawing operation assistance system 100 includes a drawing 110, a drawing element extraction unit 120, a start-end point element extraction unit 130, a start-end point path extraction unit 140, and a database 150. The database 150 stores drawing symbols 151, wiring 152, characters 153, start-end point elements 154, and paths 155. A database 150 exists for each drawing, and each database 150 contains drawing symbols 151, wiring 152, characters 153, start-end point elements 154, and paths 155.

[0061] Taking map 110 as input, the map feature extraction unit 120 parses the map 110, extracts map symbols 151, lines 152, and characters 153, and registers them in the database 150. Regarding the extraction method, any method can be used, such as obtaining information by decoding the map or obtaining information through image analysis.

[0062] Figures 4A to 4C This represents the registration information of characters, wiring, and graphic symbols in database 150. Figure 4A Registration information representing characters, Figure 4B This indicates the registration information for the wiring. Figure 4C This indicates the registration information for the symbols on the drawing.

[0063] A character consists of a character number, name, coordinates of the bounding box, and direction of the string, all incremented in the detection order. A wiring consists of a wiring number, name, coordinates of the wiring endpoints, the endpoints of multiple wirings when they are connected, and the drawing symbol number connected to the wiring endpoints, all incremented in the detection order. The drawing symbol number connected to the wiring endpoints indicates which of coordinates 1 and 2 each drawing symbol number is connected to. Two drawing symbol numbers are recorded when connecting to both sides of a wiring, and one drawing symbol number is recorded when only one side is open. A drawing symbol consists of a drawing symbol number, name, coordinates of the bounding box, and direction of connection to the wiring, all incremented in the detection order.

[0064] The start-endpoint element extraction unit 130 extracts the start-endpoint elements 154 from the map symbols 151, wiring 152, and characters 153 output by the map element extraction unit 120, and registers them in the database 150. The start-endpoint path extraction unit 140 extracts the path 155 between the start and end points from the start-endpoint elements 154 and registers it in the database 150.

[0065] The following describes the specific extraction methods of the start-end point element extraction unit and the start-end point path extraction unit of the present invention. First, the specific extraction method of the start-end point elements of the start-end point element extraction unit will be explained. The start-end point elements 154 vary depending on the type of drawing. Therefore, in this invention, in addition to the expanded connection diagram, representative PLC language diagrams, namely ladder diagrams, function block diagrams (FBD), and sequential function charts (SFC), will be used as the subject of the description.

[0066] First, let's explain the expanded connection diagram. In the expanded connection diagram, the elements that serve as the starting and ending points are the power supply, functional blocks such as the CPU, and the load.

[0067] Figures 5A-5B This is a diagram illustrating the power supply detection method. Figure 5A This is a screenshot showing only the power supply section. Figure 5B This describes the process of extracting power.

[0068] Explain the concept of power supply testing. Power supplies are broadly classified into AC (Alternating Current) and DC (Direct Current). On Figure 110, the characters containing "AC" and "DC" are used... Figure 5A There is a power line near the character 153 in the middle. Figure 5A The wiring is 152. Power cords have names; in AC, they are generally labeled R / N, 1 / 3 (in single-phase cases). Figure 5A In standard power supply configurations, names often begin with 1Δ, 3Δ, or U / N. In three-phase configurations, they often begin with U / V / W or R / S / T, or are expressed as L1 / L2 / L3. In DC configurations, names like V+ / V- are often added with + and -, or P24 or N24 are often added. Power supply identification involves finding these names and associating them with the wiring.

[0069] Figure 5BThis is a flowchart illustrating the sequence of power supply detection, executed by the drawing element extraction unit 120. First, strings containing AC or DC are extracted (S1001). If the string contains AC (S1002: Yes), it is determined whether a string containing any one of R / N, 1 / 3, U / N, U / V / W, R / S / T, or L1 / L2 / L3 exists in the surrounding area (S1003). If the string does not contain AC but contains DC (S1002: No, S1004: Yes), it is determined whether a string containing any one of + / - or P / N exists in the surrounding area (S1005). If the corresponding string exists in S1003 or S1005, the drawing element is stored as a power line name (S1006). Next, the wiring closest to the power line name is searched, and the found wiring is associated with the power line name (S1007). The extracted strings containing AC and DC, power line names, and associated wiring are registered as a power supply list in the start and end element 154 of the database 150 (S1008).

[0070] Figures 6A-6B This diagram illustrates the concept of function block detection. A function block generally consists of a four-sided border, a name, and terminals. The name is a name that includes the function; for example, it may contain the function name within a part of the name. Figure 6A The diagram shows a CPU (Central Processing Unit) with control functions, and PIOs (Programmed Input / Output) that act as the interface between the CPU and peripheral devices. The terminals include power (at least two terminals if single-phase) and signal inputs (IFs), thus the characteristic is that there are at least three terminals. Therefore, a functional block is defined by including a functional name on its four-sided border and having three or more terminals, and detection is performed accordingly.

[0071] Figure 6B This is a flowchart illustrating the sequence of function block detection, executed by the drawing element extraction unit 120. First, the four borders are extracted (S2001). The size can be specified during border extraction. For example, for function blocks like the outer frame within drawing 110, excessively large blocks or very small quadrilaterals are excluded. Next, the characters at the top of the four borders are extracted, and it is determined whether they contain characters for CPU or PIO (S2002). The characters are specified as CPU or PIO, but if it is a string representing a function, it is not limited to CPU or PIO and can be included in the determination. Next, it is determined whether the number of terminals is 3 or more (S2003). If the number of terminals is 3 or more, it is registered as a function block in the start and end point elements 154 of the database 150.

[0072] Figures 7A-7BThis diagram illustrates the concept of load detection. The load is characterized by being located at the end of a wiring harness, with all wiring connected to terminals other than GND in the same direction. The diagram representing the load shows wiring arranged in one direction within a four-sided frame, and includes a GND terminal. Figure 7A In this example, three terminals are arranged along the top edge of the four-sided frame, and the wiring connects from the top. For example, Figure 7A The load on the left is a three-phase motor. Figure 7A The load on the right is a phase compensator. Therefore, it can be determined whether it is a load by observing the arrangement of the four sides and terminals.

[0073] Figure 7B This is a flowchart illustrating the sequence of load detection, executed by the drawing element extraction unit 120. First, the four borders are detected (S3001). Next, the terminals connected to the four borders are detected (S3002). It is determined whether there is a terminal other than GND on one side, i.e., whether the y-coordinates of the terminals are the same (S3003). If the determination is "true", it is registered as a start and end point element 154 in the database 150 as a load (S3004).

[0074] Next, we will use the representative diagrams of PLC language, namely ladder diagrams, function block diagrams (FBDs), and sequential function charts (SFCs), as examples for explanation.

[0075] Figure 8A This is an example of a ladder diagram. A ladder diagram consists of contact conditions and commands sandwiched between a left bus and a right bus. On the left side of the left bus, there is a circuit number representing one execution unit, and each circuit number has a function. For example, in circuit number (0000), if contact a of J081 is closed and contact b of S0BF is open, the output of the coil of R043, which is the output, becomes high. When contact a of J001 is closed, the function execution blocks of ADD and SUB connected to the right bus of circuit number (0002) are executed, i.e., the arithmetic functions. ADD, as an addition function, executes FW000+FW001 and stores it in FW002. SUB, as a subtraction function, executes FW000-FW001 and stores it in FW003. In the ladder diagram, the contact a or b connected to the left bus becomes the start marker, and the element enclosed by the dashed box on the left bus becomes the start element. Furthermore, the coil and arithmetic function connected to the right busbar become the execution unit, and the element enclosed by a single-dot dash on the right busbar becomes the endpoint element. Therefore, it is necessary to perform a process of detecting contact a, contact b, the coil, and the arithmetic function and registering them to the start and end point elements.

[0076] Figure 8BThis is a flowchart illustrating the sequence of detecting start and end point elements within a ladder diagram, executed by the start and end point element extraction unit 130. First, the left and right busbars are detected (S4001). The two longest vertical lines of equal length within the drawing 110 are identified as busbars. The line with the smaller x-coordinate is designated as the left busbar, and the line with the larger x-coordinate as the right busbar. Next, contact a is detected (S4002). Contact a is characterized by closely spaced parallel vertical lines, identical y-coordinates at the endpoints of the vertical lines, and horizontal lines intersecting on both sides of the parallel vertical lines. It is also determined whether one end of the horizontal line connecting to the left side of the vertical line is in contact with the left busbar. If in contact, this contact is considered contact a. Next, contact b is detected (S4003). Contact b is detected using the characteristic that a diagonal line rising from the right shoulder intersects with contact a. Next, the output coil is detected (S4004). First, a circle is detected; if characters such as S (set coil) or R (reset coil) are present within the circle, these characters are also detected simultaneously. Next, the operation function is detected (S4005). The operation function is detected based on the presence of characters within the four borders. Regarding characters, those containing... Figure 8A The F, T (on-delay timer), C (counter), and U (single-timer) are shown. Finally, the start and end point elements 154 (S4006) of the a contact, b contact, coil, and arithmetic function are registered in the database 150.

[0077] Figure 9A This is an example of an FBD (Functional Block Design). An FBD consists of function blocks and multiple input elements. Input elements include: elongated circles containing characters with input signals, quadrilaterals containing characters, and block arrows containing characters that set conditions for the function block. Function blocks connect to each other and provide output results. Figure 9A In this context, elements within dashed boxes become starting elements, and elements within dotted-line boxes become ending elements.

[0078] Figure 9BThis is a flowchart illustrating the detection sequence of start and end point elements within the FBD, executed by the start and end point element extraction unit 130. First, to detect signal input elements, a long circle and a four-sided border are detected (S5001). The long circle is detected by two parallel horizontal lines whose endpoints have the same x-coordinate, and by the endpoints of the parallel horizontal lines connecting to each other via a semicircle. Additionally, characters contained within the long circle are detected. These characters include "To" and "From". Next, the four-sided border is detected. Characters contained within the four-sided border include "G". Furthermore, it is determined whether there is only one wiring connecting the long circle or the four-sided border. If there is only one wiring, it is detected as a signal input element. Next, to detect condition setting elements, a block arrow is detected (S5002). The block arrow is detected by two parallel horizontal lines whose endpoints have the same x-coordinate, whose ends are connected by a vertical line, and whose other ends are connected by two diagonal lines. Additionally, the block arrow contains characters related to function settings. Figure 9A The system includes AUTs (Automatic Undertake Units) for automatic processing. Additionally, it determines whether there is only one wire connected to the block arrow. If there is only one wire, it is detected as a condition setting element. Next, the function block is extracted (S5003). The function block has an input on the left side of its four-sided border and an output on the right side. The input and output sides are divided into multiple blocks, enabling the input and output of multiple signals. The module name is contained in the center of the four-sided border, and the service name is contained at the top. The four-sided border is checked; if it contains a table with 5 cells in the column direction and 2 or more cells in the row direction, it is detected as a function block. Finally, the signal input element, condition setting element, and function block are registered in the database 150 as start and end point elements 154 (S5004).

[0079] Figure 10A This is an example of SFC (Simplified Process Control). SFC consists of a process start / end block, an execution block, and a condition block. The process begins in the start block, executes its defined steps when it reaches the execution block, and waits until the condition block is met. If the condition is met, it proceeds to the next process. Finally, when the end block is reached, the corresponding process completes. Figure 10A In the diagram, the starting block of the dashed box is the starting element, and the ending block of the dotted-dash box is the ending element.

[0080] Figure 10BThis is a flowchart illustrating the detection sequence of start and end point elements within the SFC, executed by the start and end point element extraction unit 130. First, to detect the start of a process, the rightward direction of the block arrow is detected (S6001). The block arrow is detected by using two parallel horizontal lines, with the endpoints of the horizontal lines having the same x-coordinate, and the ends of the horizontal lines connected by a vertical line, while the other end is connected by two diagonal lines. In the case of a start process, detection is based on the horizontal line end with the smaller x-coordinate being connected by a vertical line, while the other end is connected by two diagonal lines. Next, the end of a process is detected (S6002). The detection method for the end of a process is the same as for the start process, but it is based on the horizontal line end with the larger x-coordinate being connected by a vertical line, while the other end is connected by two diagonal lines. Finally, the start and end processes are registered in the start and end point elements 154 in the database 150 (S6003).

[0081] Figure 11 This table represents the start and end point elements 154 within database 150. The table for start and end point elements 154 consists of the start and end point element numbers in ascending order of detection, the page number where the start and end point elements reside, the category, the attribute, the wiring name used to associate with the power line in the case of power supply, the wiring number connected to the start and end point elements, and the wiring name connected to the start and end point elements. For example, if there are four types of diagrams: expanded connection diagram, ladder diagram, FBD, and SFC, one table is registered for each diagram (a total of four tables) to represent start and end point elements 154. (Except for...) Figure 11 In addition to the information shown, for example, map categories can be stored for each table.

[0082] Figures 12A-12C Explain the method for extracting the path between the starting point and the ending point. Figure 12A This represents an example of extracting the path between the starting and ending point elements 154-1 and the starting and ending point elements 154-2. Figure 12B This is a flowchart illustrating the path extraction order, executed by the path extraction unit 140 between the start and end points. Figure 12C A table representing path 155 between the starting point and the ending point.

[0083] S7001: Determine the start and end points in element 154. Diagrams depicting electrical characteristics often show current flowing from the side with the smaller x-coordinate to the side with the larger x-coordinate, and from the side with the larger y-coordinate to the side with the smaller y-coordinate. Therefore, the start point is usually the side with the smaller x-coordinate and the side with the larger y-coordinate. Figure 12A In the example, the start and end point element 154-1 is positioned on the side with the smaller x-coordinate. Therefore, start and end point element 154-1 is determined as the start point, and start and end point element 154-2 is determined as the end point. The following explanation will use start and end point element 154-1 as the start point and start and end point element 154-2 as the end point.

[0084] S7002: There are 11 map symbols, 151-1 to 151-11, between the starting and ending points. For example... Figure 11 As shown, the start and end point elements contain wiring information, such as... Figure 4B As shown, the wiring information includes connection diagram markings. Diagram marking 151-1 is obtained using two connection details.

[0085] Next, the drawing mark 151-1 is stored as the retrieval object in a temporary buffer (S7003), from... Figure 4B The system searches for wiring information connected to drawing symbol 151-1 (S7004). After searching for wiring with drawing symbol 151-1 as drawing symbol information, it determines whether the wiring has more than two drawing symbol information (S7005). The reason for this determination is that if a wiring has no drawing symbol information other than drawing symbol 151-1, it is considered an endpoint. Therefore, in step S7009, if there is no search object in the temporary buffer, the search ends. In this example, the two wirings have drawing symbols 151-2 and 151-6 as drawing symbol information other than drawing symbol 151-1, respectively. Therefore, the information of drawing symbols 151-2 and 151-6 is stored in the temporary buffer as search objects (S7006). As the stored drawing symbol information, it is determined whether there is an endpoint (S7007). If there is an endpoint, it is stored in the database (S7008).

[0086] like Figure 12C As shown, the database consists of a list of path numbers, starting points, the page number of the starting point, the ending point, the page number of the ending point, and the map symbol numbers of the paths between the starting and ending points. In this example, there are four paths between the starting and ending points. If no ending point exists, the search returns to step S7004 (S7007: No) to continue the search. In step S7005, if the wiring information at the intermediate stage has only one map symbol, that is, if the endpoint of the wiring is open and a connection cannot be generated, the search for that map symbol ends. In this case, the path between the starting and ending points is not registered. The search is repeated until there are no map symbols for the search object in the temporary buffer, and the paths connected to the CPU through map symbols 151-1 to 151-11 are extracted. The above is the specific extraction method of the path extraction unit between the starting and ending points.

[0087] <Implementation Method 1: Summary>

[0088] The drawing operation assistance system 100 of Implementation Method 1 generates connection information between wiring and drawing symbols within the drawing, extracts wiring or drawing symbols as start-endpoint elements representing the start or end point of a previous connection, and extracts the path between the start and end points based on the start-endpoint elements. By extracting the connection path between the start and end points, this connection path can be considered as a single work unit. Therefore, in addition to simply extracting connections within the drawing in a comprehensive manner, it is possible to identify elements within the drawing for each work unit implemented by the operator. As a result, progress management for each work unit becomes easier.

[0089] <Implementation Method 2>

[0090] Embodiment 2 of the present invention describes a structural example for shortening the path generation time for starting and ending points that span multiple pages.

[0091] Figures 13A-13C This is a structural diagram of the drawing operation assistance system 100 according to embodiment 2. Figure 13A It is a diagram representing the overall structure. Figure 13B This is a diagram showing the structure of the drawing feature extraction unit 120. Figure 13C This is a diagram showing the structure of the path extraction unit 140 between the starting point and the ending point.

[0092] Compared to Embodiment 1, the difference lies in that link symbols 156 are added to the database 150; the drawing element extraction unit 120 is composed of a character / wiring / drawing symbol extraction unit 120-1 and a link symbol extraction unit 120-2; the starting point-to-end point path extraction unit 140 is composed of a starting point-to-end point combination generation unit 140-1 and a starting point-to-end point path generation unit 140-2. Hereinafter, the drawing element extraction unit 120 and the starting point-to-end point path extraction unit 140, which are the changed parts, will be mainly described.

[0093] First, the function of link symbols in the drawing and the operation of link symbol extraction unit 120-2 will be explained. Then, the operation of path extraction unit 140 between the start and end points using link symbols will be explained.

[0094] Figures 14A-14B This indicates the function of the linking symbol. Figure 14A This indicates the page where the starting point is located. Figure 14B Indicates the page where the destination is located. Figures 14A-14BThe diagram shown is a two-page structure of P001 and P002. Link symbols 156-1 and 156-2 exist in P001, and link symbol 156-3 exists in P002. Link symbols are used to connect lines between pages. Link symbol 156-1 connects P001 and P002 across pages, and link symbol 156-2 connects P001 and P003 across pages. In this example, the link symbols indicate links to pages, but they can also be inherent numbers representing links to specific locations. For example, a symbol with a circle surrounding a number or a long circle surrounding a letter. Link symbols are effectively used when generating paths between start and end points across pages. For example, when generating a path from start point 154-1 in P001 to end point 154-3 in P002, the path can be generated by tracing link symbol 156-1.

[0095] Figures 15A-15C It is a diagram that illustrates the method for extracting link symbols. Figure 15A It is a diagram that represents the wiring and drawing symbols around the link symbols. Figure 15B This is a flowchart illustrating the extraction order of link tokens, executed by the link token extraction unit 120-2. Figure 15C This is a graph representing the database linked by symbol 156.

[0096] like Figure 15A As shown, link symbol 156-1 exists at the endpoint of wiring 152. Search for the endpoint of wiring 152 within database 150. During the search, check... Figure 4B The number of connection symbols on the drawing table can be used to determine whether wiring 152 has endpoints. For example, when examining wiring number 2, it can be seen that there is only one connection symbol number, and there are no connections on the coordinate 2 side. Such wiring 152 can be extracted, and the connection symbol can be extracted as well.

[0097] As described above, the link token extraction unit 120-2 first extracts all wirings with endpoints and stores the link tokens in a temporary buffer (S8001) to retrieve them from all wirings. Next, it searches for characters around the endpoints (S8002). The search is performed considering the direction of the wiring 152. Figure 15AIn the diagram, a link symbol 156-1 exists on the +x direction side of wiring 152-1. However, if the coordinates of wiring 152-1 are [(200, 300), (300, 300)] and the connected drawing symbol number is 10 (coordinate 1), it is known that the endpoint is on the coordinate 2 side and a link symbol exists on the +x direction side of the wiring. Therefore, only the +x direction side is searched. Conversely, based on the information of wiring 152, if a link symbol exists on the -x direction side, only the -x direction side is searched. The same applies to the y direction. As a result of the search, if a character exists around the endpoint, the character 153 around the endpoint is associated with the corresponding wiring 152 (S8003). The association of the character 153 around the endpoint can be either associated with the corresponding name in the database of wiring 152, or a new column can be added and the character 153 around the endpoint can be stored. If there are no characters around the endpoint, determine if there is a wiring for the target data in the temporary buffer (S8007). If there is a target data, perform the same process on other wirings; otherwise, end the process. Next, check if there are parentheses around the characters around the endpoint (S8004). Register the parentheses as character 153 or as drawing symbol 151. If there are parentheses, proceed to S8005; otherwise, proceed to S8007. Next, search if there are characters representing pages around the parentheses (S8005). Examples of characters representing pages include Sh.No., Sheet No., P, and p. If character 153 containing such a page-representing character exists, register character 153 as link symbol 156 in the database (S8006). Next, in S8007, determine if there is a target data in the temporary buffer. If there is a target data, return to S8002 and perform the same process on other wirings. If there is no target data, end the process.

[0098] Figure 15C The database for link token 156 consists of a link token number, its corresponding character number, name, the page number containing the link token, and the wiring corresponding to the link token. Page numbers are used to manage the source page of a link, while names are used to manage the destination page.

[0099] Next, the operation of the start-endpoint combination generation unit 140-1, which effectively utilizes link symbols, will be explained. This is the process generated in the start-endpoint element extraction unit 130. Figure 11 There are multiple starting and ending points. Figure 12C The database describes examples of combinations within the same page, but many combinations are generated when spanning multiple pages. However, there are also many combinations that are not connected by path. To shorten retrieval time, appropriate combinations need to be generated. Therefore, link notation is used to generate combinations of start and end points.

[0100] Figures 16A-16C This is a diagram illustrating the action of the starting and ending point combination generation unit 140-1. Figure 16A This indicates the page where the starting point is located. Figure 16B Indicates the page where the destination is located. Figure 16C A database representing the path generated by combining the start and end points. Figure 16B In this configuration, start-endpoint elements 154-3, 154-4, and 154-5 are respectively configured in P002, P003, and P004. Link symbol Sh.No.P001 exists in P002 and P003, connecting to start-endpoint elements 154-3 and 154-4 via wiring 152. Link symbol 156-5 exists in P004, connecting to start-endpoint element 154-5 via wiring 152.

[0101] First, focusing on the start and end elements of P001, combinations are generated. Combinations are processed separately for the same page and other pages. First, within the same page, start and end elements 154-1 and 154-2 are combined. Next, combination processing with other pages is performed. In the combination of start and end element 154-1 with other pages, the start and end elements of the pages represented by link symbols 156-1 and 156-2 (i.e., P002 and P003) are identified. Start and end element 154-3 exists in P002, and start and end element 154-4 exists in P003; therefore, start and end element 154-1 is combined with start and end elements 154-3 and 154-4 respectively. At this point, P001 does not have a link to P004, so it is not combined; only the page number represented by link symbol 156 in P001 is retrieved. This process avoids generating a large number of start-endpoint element combinations across multiple pages, instead focusing on path searches only on start-endpoint element combinations with a high probability of path existence, thus shortening retrieval time. The start-endpoint element 154-2 in P001 is also used to generate start-endpoint element combinations using link tokens 156-1 and 156-2. Once the combinations in P001 are completed sequentially, the process moves on to generating start-endpoint element combinations for P002 and subsequent pages.

[0102] Figure 16C This is a database of paths generated from the combination of start and end point elements 154 in P001. In this example, the combination of start and end points is stored, including those within the page and other pages. The path between the start and end points is processed and stored by the path generation unit 140-2 (described later), and is therefore currently empty. Furthermore, the combination of start and end points can not only determine the relationship between coordinates but also whether it contains... Figure 11The start / endpoint elements 154 shown are used to generate the start / endpoint combination according to the categories described. The start / endpoint combinations are the following five patterns: (1) power (+) (or power (-)) / function block, (2) function block / function block, (3) power (+) / GND (or power (-)), (4) power / load, (5) function block / load. Therefore, after generating the above start / endpoint combinations that effectively utilize the link notation, a process for determining whether the combination conforms to the five patterns can be added. As a result of determining whether the five patterns conform, if they do, they are stored... Figure 16C The path is stored in the database, and if it does not match, it is not stored in the database.

[0103] Next, the operation of the path extraction unit 140, which effectively utilizes link markers, will be explained. First, the method for generating a path when the start and end points are on the same page will be explained, followed by the method for generating a path when the start and end points exist on different pages.

[0104] Figures 17A-17B This diagram illustrates the operation of the path extraction unit 140 when the start and end points exist on the same page. When searching for a path between start point 154-1 and end point 154-2, the path search for the wiring connected to link markers 156-1 and 156-2 is not a path connecting start point 154-1 and end point 154-2, thus becoming a useless search. Therefore, by setting the path connected to the link markers as an exception to the search object, the path search is sped up.

[0105] Figure 17B This indicates that the path connected to the link symbol is set outside the path search object of the graph. A dashed line indicates a path set outside the object. Link symbol 156 has... Figure 15C The connection information of wiring 152 is provided, and wiring 152 has connection information with drawing mark 151. Therefore, by tracing the wiring connected to link mark 156 and the drawing mark, the connection points of drawing marks 151-20 to 151-23 are reached. The connection points are recorded in the branch portion of wiring 152, so wiring 152 connected to link mark 156 is excluded by tracing to the connection point. At this time, if tracing from link mark 156 leads to another block instead of the connection point, wiring 152 connected to link mark 156 is also excluded. Through this process, only paths with a high probability of being the path between start point 154-1 and end point 154-2 are searched, which can shorten the time.

[0106] Figures 18A-18B This diagram illustrates the actions of the path generation unit when the start and end points exist on different pages. Figure 18A There is a starting point in it. Figure 18BThere is an endpoint. The following example illustrates the path generation between the starting point and the endpoint when the starting point is set to 154-1 and the endpoint to 154-3.

[0107] The combination of start and end points exists Figure 16C In the path database, the starting point 154-1 exists in P001, and the ending point 154-3 exists in P002. Therefore, from... Figure 15C Extract and utilize the link symbol 156-1 that connects P001 and P002. This differs from the action of the path generation unit 140-2 within the same page, such as... Figure 18A As shown, only the wiring connected to link symbol 156-1 is considered for path search. Therefore, wiring 152 and map symbol 151 connected to other link symbols 156-2 and other start / endpoint elements 154-2 are excluded. The exclusion process uses the method described above for tracing to the connection point to exclude wiring associated with other link symbols 156-2 and other start / endpoint elements 154-2. Similarly, if other link symbols or start / endpoint elements exist within P002 where endpoint 154-3 is located, they are also excluded. This allows for the extraction of the path from startpoint 154-1 to link symbol 156-1 in a short time. Furthermore, the path from link symbol 156-1 to endpoint 154-3 is determined based on the characteristics of link symbol 156-1. Figure 15C The connection wiring shown Figure 4B The character 153 is used to search for the name in the database to find the matching link token 156-3 and associate it with the wiring 152 in P002, thereby searching for the path.

[0108] <Implementation Method 3>

[0109] In Embodiment 3 of the present invention, a structural example is described that enables work unit work management and can display attention reminders when working using the accompanying drawings.

[0110] Figures 19A-19C This is a structural diagram of the drawing operation assistance system 100 according to embodiment 3. Figure 19A Indicates the overall structure. Figure 19B This indicates the structure of the path extraction unit 140 between the start and end points. Figure 19C This refers to the database for work unit 157.

[0111] Compared to Embodiment 2, Embodiment 3 adds the following: (a) a display unit 400, (b) a work unit parsing unit 160 within the drawing operation assistance system 100, (c) work units (i.e., work units 157) of on-site personnel in the database 150, and a past work record list (i.e., a work record list 158), and (d) a work unit generation unit 140-3 within the origin-endpoint path extraction unit 140. The work record list 158 ​​contains work units and their work records (work time, sequence, etc.) from past drawing operations.

[0112] The path information between the start and end points is output from the path generation unit 140-2. The work unit generation unit 140-3 treats each combination of start and end points as a work unit and stores the corresponding path number in the work unit 157. Furthermore, based on the start and end point elements 154, the categories of the start and end points are determined and therefore output as the work name to the work unit 157. For example, in... Figure 11 In this context, the category of start and end point element 154-1 can be presumed to be power supply, and the category of start and end point element 154-2 is function block. The job name is "Power Connection Confirmation between Power Supply and Function Block". The result of generating the job unit as described above is... Figure 19C This indicates acceptance. Figure 12C The output of the work unit generation unit 140-3 is the path information. Work unit 157 consists of work unit number, start point, end point, work name, path number, and remarks. Work unit parsing unit 160 receives and parses the work records of drawing 110 from work unit 157 in database 150, work record list 158, and portable terminal 300, outputs the results to display unit 400, and displays work assistance content on the portable terminal 300 held by the operator via transceiver server 200. Furthermore, as a work unit, in the ladder diagram of Figure 8, the circuit number (0001) located on the left side of the circuit surrounded by the left and right busbars is set as the work unit. In the FBD of Figure 9, the four input conditions as the start point and the one function block as the end point are set as the work unit. Additionally, in SFC, the start of process A is set as the start point, and the end of process A is set as the end point, thus setting the work unit as...

[0113] Figure 20 This shows an example of displaying task assistance content on a portable terminal 300. Figure 20 The operator's portable terminal 300 displays a warning 301 based on the work unit, prompting them to wear gloves due to the risk of electric shock from the power source. This warning is provided by the work unit analysis unit 160, which determines the work to be electrical based on the work name within the corresponding work unit 157 and sends a notification to the portable terminal 300, thus providing the operator with the warning.

[0114] Figure 21 This example shows the result of the analysis of the work unit analysis unit 160 being displayed to the display unit 400. Figure 21 The management-side screen is envisioned, showing who is currently performing the work for each work unit. It displays the average completion time for similar past work tasks based on a list of past work records (158), and the completion time for similar past work tasks for each worker. The similarity between past and current work units can vary significantly depending on the case; therefore, coordinate information such as wiring (152) and drawing symbols (151) can be used to calculate similarity based on the number of identical elements. If the similarity exceeds 70%, for example, it can be considered a slightly modified drawing, indicating high work similarity. Furthermore, based on the work unit analysis results, work unit No. W001 may be delayed; therefore, as a recommended item based on past experience, it is possible to know in advance that worker A's work needs to be followed up.

[0115] Figures 22A-22B This diagram illustrates the flexible use of the handover function for work records during drawing replacement. It explains the actions of the handover function for work records during drawing replacement. The work unit parsing unit 160 first retrieves the data before and after the drawing replacement stored in work unit 157. Then, it compares the coordinates of elements such as drawing symbols 151, wiring 152, characters 153, and link symbols 156 before and after the replacement to determine the replaced area. After determining the replaced area, it determines the path within the corresponding work unit. Once the path is determined, the work record for that path is deleted.

[0116] Figure 22A This represents the work record before the drawing was replaced. Figure 22B This indicates the work record after the drawing replacement. Based on the analysis results of the work unit analysis unit 160, the part enclosed by the dotted line is the added portion after the replacement. Three drawing symbols 151-30, 151-31, and 151-32 were added, along with two wiring lines 152-30 and 152-31. The path connecting drawing symbol 151-33 to drawing symbol 151-31 has changed and is therefore deleted as a work completion path. This allows for effective use of existing work and provides an understanding of the number of completed paths. Figure 22A In the middle, all four paths are completed and have 100% progress (=4 / 4 path), but... Figure 22B The middle is 60% (=3 / 5 of the path). By managing by work unit in this way, the progress of the work can also be managed when the work is changed.

[0117] <Regarding variations of the present invention>

[0118] This invention is not limited to the embodiments described above, and includes various modifications. For example, without departing from the spirit of the invention, a portion of the structure of one embodiment can be replaced with the structure of another embodiment; furthermore, the structure of another embodiment can be added to the structure of one embodiment. Additionally, regarding a portion of the structure of each embodiment, other structures can be added, deleted, or replaced.

[0119] In the above implementation, the link source page / link destination page via the link symbol can be distinguished, for example, by considering the page with the smaller page number as the link source page and the page with the larger page number as the link destination page.

[0120] In the above embodiments, the various functional units (map element extraction unit 120, start-end point element extraction unit 130, and path extraction unit between start and end points 140) of the map operation assistance system 100 can be composed of hardware such as circuit devices with these functions installed, or they can be composed of software with these functions installed by a computing device such as a CPU (Central Processing Unit).

[0121] Explanation of reference numerals in the attached figures

[0122] 100 Drawing Operation Auxiliary System

[0123] 110 map

[0124] 120 Map Element Extraction Department

[0125] 120-1 Character / Wiring / Drawing Mark Extraction Section

[0126] 120-2 Link Mark Extraction Department

[0127] 130 Starting and Endpoint Element Extraction Department

[0128] 140 Path extraction section between start and end points

[0129] 140-1 Starting Point and End Point Combination Generation Department

[0130] 140-2 Path Generation Department between Start and End Points

[0131] 140-3 Production Unit

[0132] 150 databases

[0133] 151 Drawing Marks

[0134] 152 wiring

[0135] 153 characters

[0136] 154 Starting and Ending Elements

[0137] 155 path

[0138] 156 link mark

[0139] 157 work units

[0140] 158 Homework Record List

[0141] 160 Work Unit Analysis Department

[0142] 200 transceiver server

[0143] 300 portable terminal

[0144] 310 handwritten

[0145] 400 Display Unit.

Claims

1. A drawing operation assistance system, which assists in operations on a drawing, characterized in that, The drawing operation assistance system has the following features: The drawing element extraction unit extracts at least one of wiring, drawing symbols, and characters from the drawing, and generates connection information representing the connection between the wiring and the drawing symbols. The start and end point extraction unit extracts the wiring or graphic symbol based on the character, the wiring or the graphic symbol as start and end point elements representing the start or end point of the connection; as well as The path extraction unit between the start and end points determines the start point and the end point from the start and end point elements and extracts the path between the start point and the end point.

2. The drawing operation assistance system according to claim 1, characterized in that, When the drawing is a trapezoidal diagram, the start and end point extraction parts extract the left generatrix and the right generatrix of the trapezoidal diagram, respectively. The start-end point extraction unit extracts the contacts connected to the left busbar from the circuit elements sandwiched between the left busbar and the right busbar as the start-end point elements, and extracts the elements connected to the right busbar as the start-end point elements.

3. The drawing operation assistance system according to claim 1, characterized in that, When the map is a Function Block Diagram (FBD), the start-end point extraction unit extracts the input features and function blocks within the FBD. The start and end point extraction unit extracts the function block as the start and end point elements, and extracts the input elements as the start and end point elements.

4. The drawing operation assistance system according to claim 1, characterized in that, When the diagram is a Sequential Function Chart (SFC), the start and end point extraction unit extracts the start process and the end process within the SFC. The start-end point extraction unit extracts the starting process as the start-end point element and extracts the ending process as the start-end point element.

5. The drawing operation assistance system according to claim 1, characterized in that, The path extraction unit between the start and end points identifies the start point of the path formed by the two start and end point elements, with the element having a smaller x-coordinate and a larger y-coordinate on the map, as the start point, and identifies the other start and end point element as the end point.

6. The drawing operation assistance system according to claim 1, characterized in that, The image element extraction unit extracts link symbols that link elements contained in the first page of the image to elements contained in the second page of the image. When the first page and the second page are linked by the link symbol, the path extraction unit extracts the start point and the end point from the path that intersects the first page and the second page.

7. The drawing operation assistance system according to claim 6, characterized in that, When two start-point and end-point elements exist on the same page, the path extraction unit extracts the path by taking one of the two start-point and end-point elements as the start point and the other as the end point. When the start-end point path extraction unit extracts the start-end point element on the link source side of the link mark as the start point when the start-end point element existing in the first page and the start-end point element existing in the second page are linked by the link mark, the start-end point element on the link destination side is extracted as the end point.

8. The drawing operation assistance system according to claim 6, characterized in that, The drawing element extraction unit extracts a string representing a page within the drawing from a string located within a predetermined distance from the open end of the wiring that is not connected to other elements, and uses this string as the link symbol.

9. The drawing operation assistance system according to claim 1, characterized in that, The start and end point extraction unit determines whether the graphic symbol is a power supply, a function block, or a load. The start and end point extraction unit extracts only one of the following: the power supply and the function block, the function block and the function block, the power supply and the power supply, the power supply and the load, and the function block and the load, as a combination of the start and end points of the path.

10. The drawing operation assistance system according to claim 6, characterized in that, When searching whether a path is formed between elements existing on the same page, the origin-end point path extraction unit excludes the origin-end point elements, wiring, and graphic symbols connected to the link mark on the source page of the link mark, as well as the origin-end point elements, wiring, and graphic symbols connected to the link mark on the destination page of the link mark, from the search objects.

11. The drawing operation assistance system according to claim 6, characterized in that, When searching for a path that intersects the first page and the second page, the origin-end point path extraction unit excludes from the search objects the origin-end point elements, the map, and the wiring that are not connected to the link mark on the first page, and also excludes from the search objects the origin-end point elements, the map, and the wiring that are not connected to the link mark on the second page.

12. The drawing operation assistance system according to claim 1, characterized in that, The path extraction unit between the start point and the end point records the path formed by the start point and the end point as the work unit of the operation.

13. The drawing operation assistance system according to claim 12, characterized in that, The drawing operation assistance system also includes a work unit analysis unit, which determines the portion of the work unit that is replaced after the path is determined. The work unit parsing unit deletes records of the work performed before the replacement for paths that contain portions of the path that have been changed by the replacement.

14. The drawing operation assistance system according to claim 12, characterized in that, The drawing operation assistance system also includes a work unit analysis unit, which analyzes whether a power source is included within the work unit. If the work unit contains a power source, when the operator is performing work on the work unit, the work unit analysis unit sends an alarm to the terminal used by the operator.

15. The drawing operation assistance system according to claim 12, characterized in that, The drawing operation assistance system also includes a work unit analysis unit, which provides at least one of the standard time and the estimated working hours of the work unit.

Images