Work support system and work support method

Abstract

To suppress user's maloperation of a tying work.SOLUTION: A work support system 200 comprises a drawing 100, a work recording table 214, a handwritten display determination part 230, a display control part 240, and an input means 300. The drawing includes both parts and handwriting. The work recording table stores handwriting on a part as work recording. The handwritten display determination part determines handwriting that is not associated with a part as a candidate for writing based on the work recording table. The display control part displays the candidate handwriting and parts on a data display part 400 of the user's terminal so that it can be selected by the input means 300.SELECTED DRAWING: Figure 9

Description

Technical Field

[0001] The present invention relates to a work support system.

Background Art

[0002] In recent years, digitalization at work sites has accelerated, and work using a portable terminal for inputting work information has become widespread. Workers record work at the relevant locations by handwriting on the portable terminal in the same way as conventional paper work. On the other hand, in order to grasp whether the work at the relevant location has been carried out, the management side collects worker data in the management side system, accumulates it in the server, and analyzes it to effectively utilize the necessary data. In order to link whether the work at the relevant location has been done, it is necessary to link it with the handwritten work record. However, Patent Document 1 discloses that an answer sheet is read by a scanner, the read image data is analyzed, and a question mark and a handwritten string are linked using question mark information and handwritten string information.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Patent Document 1 describes that when linking a question mark and a handwritten string, linking information is generated according to the distance. However, in work on drawings including circuit symbols etc. whose format is not fixed, there is a possibility that a handwritten work record for the target may be made above, to the left, or below where the question mark is not assumed. In order to accurately link the distance between the question mark and the handwriting, it is necessary to calculate considering the areas of the question mark and the handwriting. However, Patent Document 1 does not mention distance calculation considering the areas of the question mark and the handwriting.

[0005] Therefore, the present invention has been made in view of the above problems, and its purpose is to provide a technology that suppresses user errors in the linking process. [Means for solving the problem]

[0006] To solve the above objective, the present invention comprises a drawing including parts and handwritten markings; a work record table for storing the handwritten markings for the parts as work records; a handwritten marking display determination unit that determines, based on the work record table, that handwritten markings not associated with the parts are candidates for writing; and a display control unit that displays the candidates for writing and the parts on the display unit of the user's terminal, wherein the display control unit displays the candidates for writing and the parts on the display unit of the user's terminal in a way that allows them to be selected as the writes associated with the parts. [Effects of the Invention]

[0007] According to the present invention, user errors can be suppressed. [Brief explanation of the drawing]

[0008] [Figure 1] A diagram showing the drawing of the first embodiment. [Figure 2] This diagram shows an example of a worker manually recording their work on a drawing. [Figure 3] A diagram showing an example of a handwritten work record. [Figure 4] A diagram showing an example of point cloud coordinates for a handwritten checkmark. [Figure 5] A diagram showing the handwritten information that each handwritten entry holds as data. [Figure 6] A diagram showing a UI screen where a worker links parts with handwritten labels. [Figure 7] A magnified view of the area enclosed by the dotted line in Figure 6. [Figure 8] A diagram showing a work record table after linking handwritten notes with parts. [Figure 9] A diagram showing the configuration of the work support system. [Figure 10]Figure showing the details of the component data table. [Figure 11] Figure showing the internal blocks of the handwritten display determination unit. [Figure 12] Figure showing an example of the screen presented to the user after the work completion determination unit processes. [Figure 13] Figure showing the screen display presented to the user after the work completion determination unit processes. [Figure 14] Figure showing the means for associating a handwritten note not on a component with the component. [Figure 15] Figure showing the flow of the determination method for extracting handwritten candidates for a component. [Figure 16] Figure showing the information of the work record table after processing by the handwritten display determination unit. [Figure 17] Figure showing an example of the means for associating a component based on a single point of a handwritten note. [Figure 18] Figure showing an example of calculating the distance from a handwritten note using areas other than the corners of a component area. [Figure 19] Figure showing an example of the display on the UI before and after the user selects a handwritten note. [Figure 20] Figure showing the configuration of the handwritten display determination unit of the second embodiment. [Figure 21] Figure showing the point cloud data when a check mark is written in handwriting. [Figure 22] Figure showing the handwritten internal table. [Figure 23] Figure showing an example where a comment is written by a leader line for a character. [Figure 24] Figure showing the work record table reflecting the comment.

Modes for Carrying Out the Invention

[0009] Hereinafter, a specific example of the work support system according to the embodiment of the present invention will be described while referring to the drawings. Note that the present invention is not limited by the examples, but is indicated by the claims. The work support system according to the present embodiment displays write candidates and parts on the display unit of the user's terminal so that they can be selectively displayed as writes associated with the parts. According to this example, the user can appropriately select a write associated with a part from the write candidates, and can suppress incorrect operations by the user.

Example

[0010] FIG. 1 is a diagram showing the drawing of the first example.

[0011] On the drawing 100 displayed on the user's terminal, three types of parts, namely, the character 11, the wiring 12, and the drawing symbol 13, are described as examples of "parts". In FIG. 1, each part is numbered, and a plurality of parts are included in the drawing 100. In the drawing 100, the wiring 12 and the drawing symbol 13 are connected, and a circuit diagram showing an electric current is taken as an example.

[0012] FIG. 2 is a diagram showing an example in which an operator records work on the drawing by handwriting.

[0013] On the drawing 100, a handwritten 111 as a work record on the character 11 and a handwritten 112 as a work record on the wiring 12 are described by an operator (hereinafter also referred to as a user) as an example of "user". That is, the handwritten 111 and 112 are work records in which the operator has performed electronic handwriting at an arbitrary position on the drawing 100. The work record is performed, for example, when the operator checks the wiring name described on the actual wiring with respect to the character 11 indicating the wiring name, and the confirmed wiring name matches the character 11 described on the drawing 100. Further, with respect to the wiring 12, when the operator measures the voltage or resistance value on the wiring 12 and a desired voltage or resistance value is observed, handwriting is performed as a work record. As described above, the operator checks the actual physical object and electrical characteristics, and when a desired result is obtained, performs the work record by handwriting.

[0014] Figure 3 shows an example of a handwritten work record.

[0015] A major difference from the example in Figure 2 is that there is no handwriting on the component itself. The work record for character 11 is marked with handwriting 1111 as a checkmark to the right of character 11. The work record for wiring 12 is marked with handwriting 1112 at a large distance below wiring 12. Furthermore, in some cases, it is unclear which surrounding character the handwriting 1113 refers to. In this embodiment, handwriting such as handwriting 1111 and handwriting 1113, which are not linked to a component and are located around the component, are also called writing candidates. It is preferable that the handwriting be located near the component that is expected to be recorded. However, when the component and the handwriting are far apart, it is unclear which component was recorded, and it is very difficult to automatically link the component and the handwriting in order to understand the worker's intent and leave accurate evidence of the component's work record. Therefore, in order to leave accurate evidence, a mechanism that allows the user who performed the work to link the component and the handwriting on the UI (User Interface) is effective.

[0016] Figure 4 shows the point cloud coordinates of handwritten checkmarks, and Figure 5 shows the handwritten information held as data for each handwritten mark.

[0017] Handwriting is represented as a collection of point clouds. In Figure 4, it consists of n points from (x1, y1) to (xn, yn). This point cloud is used to link to parts. Furthermore, each handwritten entry has handwriting information as shown in Figure 5. This handwriting information includes the time the handwriting started, a device ID indicating the user who wrote it, and attributes of the handwriting such as color, thickness, transparency, type, and the point cloud coordinates shown in Figure 4. The point cloud coordinates are based on the stroke written in a single continuous line. However, strokes written within a certain time after the initial continuous line are managed as the same handwriting. This is because if comments or other information are included, the handwriting is recognized as a single set.

[0018] Figure 6 shows a UI screen where an operator links parts with handwritten information.

[0019] The drawing 100 displayed on the user's terminal contains three handwritten notes: handwritten notes 114, 115, and 116. Furthermore, a pointer 22 is positioned on the UI to allow the user to select handwritten notes and parts. The user can freely move the pointer 22 on the screen using either the mouse or keyboard. Handwritten note 116 is written on drawing symbol 13 and is linked to drawing symbol 13. However, handwritten notes 114 and 115 are not written on parts. The user selects whether handwritten note 114 is linked to text 11A or text 11B, and links the handwritten notes, which are not on the part, to the part.

[0020] Next, we will explain how users can link their handwritten drawings with components on the UI.

[0021] Figure 7 is a magnified view of the area enclosed by the dotted line in Figure 6. The upper part is a magnified view of the area around handwritten 114, showing the user's handwritten selection operation, and the lower part shows the user's component selection operation.

[0022] The user moves the pointer 22 using a mouse or other means and selects the handwritten character 114. After selecting the character, they select the character 11A to link it to. By performing this operation themselves, the handwritten character is linked to the component, and accurate evidence is left behind.

[0023] Figure 8 shows the work record table after linking handwritten entries with parts. The upper part shows the work record before linking, and the lower part shows the work record after linking by the user.

[0024] The work record table stores handwritten notes for parts as work records. For example, by performing the operation described in Figure 7, handwritten information is added to the row corresponding to character 11A in the work record table 213. Here, the time, handwritten ID, work sequence calculated from the time, and equipment ID are included. However, additional items may be added if necessary from the handwritten information.

[0025] With the mechanism described above, users can accurately record evidence by linking their handwriting with components, reflecting their own intentions. However, since this is an operation performed by the user, there is a possibility of unintended errors causing the linking. To further ensure accurate linking of handwriting and components, it is desirable to provide a UI that minimizes unintended errors. Therefore, in this embodiment, the display is limited to only handwriting that has the potential to be linked to components, thereby preventing unintended errors and providing a UI that makes linking easier for the user.

[0026] Figure 9 shows the configuration of the work support system.

[0027] First, let's explain the configuration of the work support system 200.

[0028] The work support system 200 includes a data storage unit 210, a file information reading unit 220, a handwriting display determination unit 230, a display control unit 240, a selected coordinate acquisition unit 250, and a handwriting / part selection determination unit 260. Furthermore, the work support system 200 includes a work record table update unit 270, a selected handwriting / part highlighting unit 280, an input IF 290, an output IF 291, an input means 300 as an example of an "input unit," and a data display unit 400 as an example of a "display unit." The data storage unit 210 includes a drawing 100, a handwriting data table 211, a part data table 212, and a work record table 213.

[0029] Next, we will explain the operation of the work support system 200.

[0030] The file information reading unit 220 reads the data from the drawing 100, handwritten data table 211, parts data table 212, and work record table 213 in the data storage unit 210. The file information reading unit 220 imports the drawing 100 as a PDF or image to generate a user input screen. The file information reading unit 220 then uses the information from the handwritten table 211, parts data table 212, and work record table 213 to highlight parts that already have work records, i.e., parts linked to handwritten entries, using the data display unit 400. The highlighting can be done by filling the bounding box of the part with color, or by coloring the frame. Any notation that is different from other parts and makes it clear that work has been recorded is acceptable.

[0031] The handwriting display determination unit 230 determines, based on the work record table 213, that handwriting that is not associated with a part and is located around a part is a candidate for writing. Specifically, the handwriting display determination unit 230 uses the data read by the file information reading unit 220 to select handwriting to be presented to the user. The display control unit 240 displays the writing candidates and parts on the data display unit 400 of the user's terminal. That is, the display control unit 240 displays the writing candidates and parts on the data display unit 400 of the user's terminal so that they can be selected as writes associated with parts. Specifically, the display control unit 240 generates display data to be displayed to the user on the data display unit 400 based on the handwriting, part data, and work record data selected by the handwriting display determination unit 230.

[0032] Next, the processing of user operations on the displayed UI will be explained. The user selects either handwritten text or a part using the input means 300. After the selection, the selection coordinate acquisition unit 250 acquires the coordinate position selected by the pointer 22. The handwritten text / part selection determination unit 260 uses the data from the handwritten text data table 211 and the part data table 212 to identify the handwritten text or part corresponding to the coordinates acquired by the selection coordinate acquisition unit 250. Subsequently, in order to clearly indicate the selected handwritten text or part to the user on the data display unit 400, the handwritten text / part selection determination unit 260 sends the identified handwritten text or part data to the selected handwritten text / part emphasis unit 280, which performs emphasis processing and outputs the data to the display control unit 240. When both handwritten text and a part are selected by the user, the handwritten text / part selection determination unit 260 sends the corresponding handwritten text data and part data to the work record table update unit 270. The work record table update unit 270, upon receiving the data, writes the handwritten text information to the corresponding part in the work record table 213 and updates the work record table 213. The above describes the operation of the work support system 200.

[0033] Next, we will explain each component of the work support system 200.

[0034] Figure 10 shows the details of the parts data table.

[0035] The top row shows text information, the middle row shows wiring information, and the bottom row shows drawing symbol information. Each piece of text, wiring, and drawing symbol includes an index ("No."), a name, and coordinates including the start and end points. In addition, text includes information indicating whether the characters in the string are written in the x or y direction (string direction). For example, if the text is written horizontally, it includes information indicating the x direction; if it is written vertically, it includes information indicating the y direction. Wiring can consist of a single line and is represented by the coordinates of its start and end points. However, if the wiring is a U-shape composed of multiple lines, the line information includes the start and end points of each individual line. Drawing symbols have electrical input and output directions and include information indicating whether they connect to the wiring in the x or y direction (connection direction to wiring).

[0036] Figure 11 shows the internal blocks of the handwriting recognition unit.

[0037] The handwriting display determination unit 230 includes a work completion determination unit 231 and a parts-related handwriting extraction unit 232.

[0038] First, let's explain the function of the work completion determination unit 231.

[0039] The work completion determination unit 231 receives information from the handwritten table 211, the parts data table 211, and the work record table 213 output from the file information reading unit 220, as well as screen information to be presented to the user. The work completion determination unit 231 determines whether the work for a part has been completed based on the information for that part in the work record table 213. Handwritten information associated with parts for which the work has been completed is removed from the screen information presented to the user.

[0040] Figure 12 shows an example of a screen that is presented to the user after the work completion determination unit has finished processing.

[0041] The left side shows an example of screen information presented to the user before processing by the work completion determination unit 231, and the right side shows an example of screen information presented to the user after processing by the work completion determination unit 231. The work completion determination unit 231 deletes the handwritten text 116 that was on the drawing symbol 13 before processing. This process prevents the user from accidentally selecting already associated handwritten text. Furthermore, in this example, the drawing symbol 13 is highlighted by the file information reading unit 220, which in this case makes the border thicker.

[0042] Next, we will explain the function of the parts-related handwritten extraction unit 232.

[0043] Figure 13 shows the screen display presented to the user after the work completion determination unit has finished processing.

[0044] The component-related handwriting extraction unit 232 processes handwriting that is not on the component, such as handwriting 114 and handwriting 115, and extracts candidate handwriting for the component.

[0045] Figure 14 shows a method for linking handwritten notes that are not present on the parts to the parts themselves.

[0046] The component-related handwriting extraction unit 232 determines whether a handwriting sample is a candidate for a component by comparing the bounding box, which is the region encompassing the point cloud of the handwriting sample 114, with the bounding boxes of characters 11A and 11B, and the distances L1 and L2 between the bounding boxes of the handwriting sample and the characters.

[0047] Figure 15 shows the flowchart of the determination method for extracting handwritten candidate parts.

[0048] First, the parts-related handwritten data extraction unit 232 detects the start and end points of the bounding box from the point cloud data of the handwritten data table 211 (S1). More specifically, the parts-related handwritten data extraction unit 232 determines the start and end points from the minimum and maximum values ​​of the x and y coordinates of the point cloud. The coordinates may be set with the lower left corner of the text information and drawing symbol information as the origin, and the starting point may be closer to the lower left corner. Once the start and end points are determined, the parts-related handwritten data extraction unit 232 calculates the width in the x direction and the height in the y direction of the handwritten bounding box.

[0049] Next, the part-related handwriting extraction unit 232 extracts candidate parts using the x-direction width and y-direction height of the calculated bounding box of the handwriting (S2). At this time, the part-related handwriting extraction unit 232 determines parts that are within a predetermined range from the handwriting. Specifically, the handwriting display determination unit 230 expands the area of ​​the handwriting's width and height from its own bounding box in the up, down, left, right, and diagonal directions, and searches for parts that fall within the expanded area. That is, the handwriting display determination unit 230 determines parts in the area surrounding the rectangular area that encompasses the point cloud coordinates of the handwriting. If a part exists in the expanded predetermined area, the part-related handwriting extraction unit 232 calculates the distance between the part and the handwriting using the coordinates of the nearest corners of the handwriting and the part, respectively (S3). The handwriting display determination unit 230 may also determine handwriting within a predetermined range from the part as a writing candidate. The predetermined area is an area that is extended diagonally in the up, down, left, and right directions around the rectangular area that encompasses the point cloud coordinates of the handwriting, with an area equivalent to the rectangular area touching the rectangular area.

[0050] Next, the parts-related handwritten input extraction unit 232 writes the handwritten input as a candidate for that part in the work record table 213 (S4). The method of writing to the work record table 213 will be described later. Furthermore, if there are multiple parts candidates associated with the handwritten input, the parts-related handwritten input extraction unit 232 compares the distances (S5). The parts-related handwritten input extraction unit 232 compares the distances and writes ranking information to the work record table 213, assigning the handwritten input with the shortest distance to the part as 1st place, and the one with the next shortest distance as 2nd place (S6). At this time, not only the ranking information but also the distance information may be written to the work record table 213 in a usable format.

[0051] If the handwriting is judged as NO in S2, it is not a candidate to be associated with a part, so the work completion determination unit 231 deletes the handwriting from the screen information presented to the user (S7). An example of the handwriting to be deleted is the handwriting 115 shown in Figure 12. The handwriting 115 is a memo and is not related to the work record of a part. Therefore, by removing the display from the screen presented to the user, it is possible to prevent it from being mistakenly associated with a part.

[0052] Figure 16 shows the information in the work record table after processing by the handwriting recognition unit.

[0053] In the work record table 213, the information included in the part is at least one of the following: whether or not it is linked, and whether or not it is a candidate for writing. When the work record table update unit 270 selects a write associated with a part on the user's terminal data display unit 400, it links the part with the selected write and updates the work record table 213. Specifically, when the work record table update unit 270 links a handwritten entry with a part, it displays the handwritten ID column as a candidate and changes the notation to distinguish it from an actual linked entry. For example, in this embodiment, since it is still a candidate, it is distinguished using parentheses. Regardless of parentheses, any method that can distinguish it from an actual linked entry is acceptable, and other symbols may be used, or numbers or symbols may be written in the header of the notation. Furthermore, the candidate handwritten ID is written to the work record table 213, and if the same candidate handwritten ID exists in other parts, its rank is written. In this embodiment, only the rank is shown. However, distance information may also be added.

[0054] Furthermore, in Figure 14, the handwritten bounding box was used as the bounding box for comparison with the bounding box of the component. However, a single point from the handwritten point cloud could also be used for the comparison.

[0055] Figure 17 shows an example of a means for linking parts based on a single point drawn by hand.

[0056] In FIG. 17, the distance is calculated by comparing the end point coordinates of the handwritten text with corner A' of character 11A. As shown in FIG. 14, when the handwritten text is regarded as a bounding box, comparison cannot be made at points on the sides of the bounding box. By comparing each point of the handwritten text, the distance between the handwritten text and the component can be calculated more accurately. As a calculation method, first, as shown in S2 of FIG. 15, the component-related handwritten text extraction unit 232 extracts whether there are candidate components associated with the handwritten text. Instead of comparing all points of the handwritten text with the extracted components, the component-related handwritten text extraction unit 232 uses the start point, end point, or turning point of the handwritten text that is likely to be an end point based on the positional relationship between the handwritten text and the component, and calculates the distance between the point of the handwritten text that is the shortest and the corner of the component. In the example of FIG. 17, since character 11A is on the right side of the handwritten text, the end point coordinates of the handwritten text are used to calculate the distance between the end point of the handwritten text and corner A' of the component that is the closest to the end point of the handwritten text. Incidentally, in calculating the distance from the handwritten text, comparison may be made not only with the corners of the component area but also with points within the component area.

[0057] FIG. 18 is a diagram showing an example of calculating the distance from the handwritten text using points other than the corners of the component area.

[0058] The component-related handwritten text extraction unit 232 performs the calculation based on the start point of the handwritten text. Let the coordinates of the start point be (xhs, yhs), and the coordinates of the corners of the component be B'(xpb, ypb) and C'(xpc, ypc). When the relationship is ypc < yhs < ypb, the distance obtained by dropping a perpendicular from the start point to line segment B'C' is the shortest distance between the start point of the handwritten text and the component. Therefore, the distance is calculated as L1 = xhs - xpb (= xpc). Thus, by using the coordinates of the corners of the component area in the calculation and using points within the area for the actual distance calculation, an accurate distance can be calculated.

[0059] Next, an example of a screen on the UI highlighted by the selected handwritten text / component highlighting unit 280 is shown.

[0060] FIG. 19 is a diagram showing an example of the display on the UI before and after the user selects the handwritten text.

[0061] The top image shows the UI display before the user selects handwriting, while the bottom image shows the UI display after the user selects handwriting.

[0062] When the user selects a handwritten character, the display control unit 240 highlights the candidate characters 11A and 11B that are associated with it. In Figure 19, they are outlined with dotted lines. However, they could also be filled with semi-transparent ink or their color could be changed. Anything that makes them stand out from other parts is acceptable. This highlighting clarifies which parts are to be associated, thus limiting the user's selection and enabling accurate association. Furthermore, when there are multiple candidates, the UI display of the parts may be changed based on ranking information or distance information. Since parts that are closer are more likely to be associated, the transparency of the coloring could be changed according to the distance value, for example, with a higher transparency for parts that are farther away, or parts with a high probability could be represented in red and parts with a low probability in blue, etc. In addition, the display control unit 240 may prevent the selection of parts other than the candidate parts. As mentioned above, handwriting outside of the parts is done around the parts, so the system should not react if something other than a candidate part is selected. This is also effective in preventing incorrect associations.

[0063] In the example in Figure 19, the handwritten text was selected first, but similarly, if a component is selected first, the handwritten text that is a candidate for linking can be highlighted, or its color and transparency can be changed according to the distance. Furthermore, handwritten text around other components does not need to be displayed if it is linked to another component, so handwritten text other than the target handwritten text can be hidden. [Examples]

[0064] A second embodiment of the present invention will now be described.

[0065] Figure 20 shows the configuration of the handwriting recognition unit in the second embodiment.

[0066] The second embodiment differs from the configuration of the first embodiment only in that a handwriting analysis unit 233 is added to the handwriting display determination unit 230; other processes are the same as in the first embodiment.

[0067] The operation of the handwriting analysis unit 233 will be explained below.

[0068] The recording of text and drawing symbols is often done with check marks, and wiring work records are often drawn with long single lines. The purpose of the handwriting analysis unit 233 is to take advantage of the characteristics of these recording methods and accurately link handwritten notes with parts.

[0069] Figure 21 shows the point cloud data when a checkmark was drawn by hand.

[0070] Let the starting point be (xhs, yhs), the turning point be (xhc, yhc), and the ending point be (xhe, yhe). The points for detecting a checkmark are whether the starting point and turning point, and the ending point and turning point, are drawn in a way that is close to a straight line, and whether they are composed of two straight lines. For example, it is necessary to distinguish between handwritten characters such as a "W" and characters with wavy lines.

[0071] The slopes between the starting point and the turning point, and between the ending point and the turning point, can be determined as follows. The slope between the starting point and the turning point: Aslope = (yhc - yhs) / (xhc - xhs) The slope between the endpoint and the turning point: Bslope = (yhe - yhc) / (xhe - xhc)

[0072] The handwriting analysis unit 233 calculates the slope of the starting point and all points between the starting point and the turning point for the slope Aslope, compares all the calculated slopes with Aslope, and if the difference in slope is only about 10%, it considers that the line from the starting point to the turning point was drawn in a straight line. Similarly, the handwriting analysis unit 233 calculates the slope of the ending point and all points between the ending point and the turning point for Bslope, compares all the calculated slopes with Bslope, and if the difference in slope is only about 10%, it considers that the line from the ending point to the turning point was drawn in a straight line. In this way, the handwriting analysis unit 233 analyzes the checkmark.

[0073] Figure 22 shows a handwritten internal table.

[0074] The handwriting data table 211 read by the handwriting display determination unit 230 is used as the internal handwriting table. After analyzing the handwriting as a checkmark, the handwriting analysis unit 233 adds the linked items to the internal handwriting table, which incorporates the handwriting data table 211, in order to pass information to the subsequent parts-related handwriting extraction unit 232 that the handwriting is linked to characters and drawing symbols. The parts-related handwriting extraction unit 232 then looks at this internal handwriting table and processes the analysis of the checkmarks and handwriting to link them to characters and drawing symbols. Furthermore, in the case of a long wire like the handwriting 112 in Figure 3, if its length is more than twice that of the bounding boxes of the surrounding characters and drawing symbols, the linked item may be recorded as a wire in the internal handwriting table.

[0075] Furthermore, if handwritten notes around a part on drawing 100 are not used in work records, the method of displaying the handwritten notes may be changed.

[0076] Figure 23 shows an example where comments are written next to text using leader lines.

[0077] Comments on character 11A are recorded as work information associated with character 11A, and are unrelated to the work log.

[0078] The handling of comments on text is explained below.

[0079] First, the handwriting analysis unit 233 checks whether the handwritten data 118, as an example of "writing," contains characters, drawing symbols, and wiring within its bounding box. If it does, the handwriting analysis unit 233 checks the area around the endpoint coordinates of the handwritten data 118 to see if there is any handwriting nearby. The distance from the endpoint may be within the width of one standard character on the drawing. The handwriting analysis unit 233 finds that there is handwriting 119, as an example of "writing," located near the endpoint, and writes this handwriting 119 to the work record table 213 as a comment related to character 11A.

[0080] Figure 24 shows a work log table that incorporates comments.

[0081] In the work log table 213, the information contained in the part includes at least one of the following: whether or not there is a link, whether or not there are candidates for writing, and comments on the part. Specifically, in the work log table 213, for each part, there is a handwritten ID with a corresponding handwritten comment 119. The comment is enclosed in parentheses. However, other methods of description are also acceptable as long as they differ from the link and candidate handwritten descriptions. As described above, the handwriting analysis unit 213 of the handwriting display determination unit 230 operates. [Explanation of symbols]

[0082] 100...Drawing, 11...Text, 11A...Text, 11B...Text, 12...Wiring, 13...Drawing Symbol, 111...Handwritten, 112...Handwritten, 1111...Handwritten, 1112...Handwritten, 1113...Handwritten, 114...Handwritten, 115...Handwritten, 116...Handwritten, 118...Handwritten, 119...Handwritten, 200...Work Support System, 213...Work Record Table, 230...Handwritten Display Determination Unit, 231...Work Completion Determination Unit, 232...Parts-Related Handwritten Extraction Unit, 233...Handwritten Analysis Unit, 240...Display Control Unit, 270...Work Record Table Update Unit, 300...Input Means, 400...Data Display Unit

Claims

1. Drawings that include parts and handwritten notes, A work record table that stores the handwritten notes for the aforementioned parts as work records, A handwriting display determination unit determines, based on the work record table, that the handwritten text not associated with the part is a candidate for writing, It includes a display control unit that displays the write candidates and the components on the display unit of the user's terminal, The display control unit displays the write candidates and the components on the display unit of the user's terminal so that they can be selected as write candidates associated with the components. The handwriting display determination unit includes a component-related handwriting extraction unit that calculates the distance between the corner of a rectangular region encompassing the handwritten point cloud coordinates and the corner of the region encompassing the component that is closest to the corner of the rectangular region, and extracts the writing candidates whose calculated distance falls within a predetermined range. Work support system.

2. The handwriting display determination unit determines that the handwriting within a predetermined range from the component is the candidate for writing. The work support system according to claim 1.

3. The predetermined range is an area that extends diagonally in all directions (up, down, left, right, and right) around the rectangular area, with an area equivalent to the rectangular area, so as to be adjacent to the rectangular area. The work support system according to claim 1.

4. The user's terminal display unit further includes a work record table update unit that updates the work record table by linking the component with the selected write candidate when the user selects the write candidate associated with the component via an input means. The work support system according to claim 1.

5. In the aforementioned work record table, the information included in the part includes at least one of the following: whether or not it is linked, whether or not it is a candidate for writing, and comments on the part. The work support system according to claim 1.

6. The display unit of the user's terminal further includes a display control unit that, when the user selects the component or the writing candidate via an input means, changes the color and transparency of the component or the writing candidate and highlights it based on the work record table. The work support system according to claim 1.

7. The component-related handwriting extraction unit calculates the distance between the point on the side and the reference point of the writing candidate if the x or y coordinate of the reference point of the writing candidate is located between the coordinates of the first and second corners that form the ends of one side of the region of the component. The work support system according to claim 1.

8. The component-related handwriting extraction unit sets the reference point of the writing candidate to one of the starting point, the endpoint including the turning point, or the ending point among the point cloud coordinates of the writing candidate. The work support system according to claim 1.

9. The handwriting display determination unit includes a handwriting analysis unit that narrows down the components associated with the writing candidate to two or fewer from among characters, wiring diagrams, and drawing symbols, and outputs them to the component-related handwriting extraction unit. The work support system according to claim 1.

10. The handwriting analysis unit detects that the writing candidate is a check mark. The work support system according to claim 9.

11. The handwriting analysis unit analyzes the connected handwriting between the part and the handwriting separated from the part, associates the part with the handwriting, and records it as related information in the work record table. The work support system according to claim 9.

12. A determination step in which, based on a work record table that stores handwritten notes on parts constituting a drawing displayed on the user's terminal as work records, a handwritten note that is not associated with a part is determined to be a candidate for writing, The work support system is instructed to perform a display step, which involves displaying the write candidates and the components on the display unit of the user's terminal. The display step involves displaying the write candidates and the components on the display unit of the user's terminal so that they can be selected as the write candidates associated with the components. When determining the writing candidates, the distance between the corner of the rectangular region encompassing the handwritten point cloud coordinates and the corner of the region encompassing the component that is closest to the corner of the rectangular region is calculated, and the writing candidates whose calculated distance falls within a predetermined range are extracted. Work support method.

Images