Data collection program
The data collection program addresses the time-consuming nature of manual input in existing data collection processes by automating image type identification, region recognition, and character recognition, thereby reducing labor and facilitating efficient data collection.
Patent Information
- Application Number
- JP2023206591
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-12-07
- Publication Date
- 2025-06-19
AI Technical Summary
The existing data collection processes for drawing data are time-consuming due to the need for manual input of additional information such as drawing names.
A data collection program that automates the identification of image types, recognition of main and sub-subject regions, character recognition, and displays a data collection screen with pre-filled information, reducing the need for manual input.
The program significantly reduces the labor required for inputting drawing names and other information, facilitating the collection of large datasets by automating the data collection process.
Smart Images

Figure 2025091448000001_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a data collection program and the like.
Background Art
[0002] Conventionally, as in Patent Document 1, a drawing management system has been proposed.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] However, when collecting a plurality of drawing data, it is necessary to input additional information such as drawing names, which is time-consuming.
[0005] Therefore, an object of the present invention is to provide a data collection program and the like that reduce the labor of input.
Means for Solving the Problems
[0006] The data collection program according to the present invention executes a type identification step of identifying the type of an image of data to be collected, a region recognition step of identifying a main subject region and a sub-subject region in the image of the data to be collected, a character recognition step of identifying at least one of character information in the main subject region and character information in the sub-subject region, and an additional information setting step of displaying a data collection screen. The data collection screen includes an image information display area for displaying image information of the data to be collected and an additional information display area for setting additional information related to the image information of the data to be collected. In at least one of the area for setting a name corresponding to the type of the image of the data to be collected and the area for specifying a number corresponding to the type of the image of the data to be collected in the additional information display area, a selection area including character information that is a candidate for the character information to be set is displayed based on the information obtained in the character recognition step.
[0007] The labor of inputting drawing names and the like can be omitted, and the collection of a large number of data to be collected can be facilitated.
[0008] Preferably, the data collection program further executes a recording step of recording the image information and the additional information set in the additional information setting step. In the recording step, among the character information displayed in the selection area, first weighting information of those set in the additional information setting step and second weighting information of those not set in the additional information setting step are recorded. In at least one of the area for setting the name and the area for specifying the number in the additional information display area, the selection area is displayed based on at least one of the first weighting information and the second weighting information and the information obtained in the character recognition step.
[0009] The character information with the weighting score added is more likely to be listed as a candidate in the next additional information setting step, and the character information with the weighting score subtracted is less likely to be listed as a candidate in the next additional information setting step S16. Therefore, the possibility that correct character information is listed in the name selection area or the like is increased.
[0010] Also, preferably, in the area for setting the type of the image of the data to be collected in the additional information display area, based on the information obtained in the type specifying step, the character information corresponding to the type that is a candidate for the set type is displayed so as to be different from the character information corresponding to other types.
[0011] The labor of inputting the type of the image can be omitted, and the collection of a large number of data to be collected can be facilitated.
[0012] The terminal according to the present invention executes a type identification step of identifying the type of the image of the data to be collected, a region recognition step of identifying a main subject region and a sub-subject region in the image of the data to be collected, a character information recognition step of identifying at least one of the character information in the main subject region and the character information in the sub-subject region, and an additional information setting step of displaying a data collection screen, and displays the data collection screen in the data collection program. The data collection screen includes an image information display area for displaying the image information of the data to be collected, and an additional information display area for setting additional information related to the image information of the data to be collected. In the additional information display area, in at least one of a region for setting a name corresponding to the type of the image of the data to be collected and a region for identifying a number corresponding to the type of the image of the data to be collected, a selection region including character information that is a candidate for the character information to be set is displayed based on the information obtained in the character recognition step.
Advantages of the Invention
[0013] As described above, according to the present invention, it is possible to provide a data collection program that reduces the input effort.
Brief Description of the Drawings
[0014]
Figure 1
Figure 2
Figure 3
Embodiments for Carrying Out the Invention
[0015] Hereinafter, the present embodiment will be described with reference to the drawings (see FIGS. 1 to 3). Note that the embodiments are not limited to the following embodiments. In principle, the content described in one embodiment is also applicable to other embodiments. In addition, each embodiment and each modification can be combined as appropriate.
[0016] (Data collection system 1) The data collection system 1 in this embodiment includes a terminal 10 and a server 30 (see FIG. 1). A plurality of terminals 10 may be provided. FIG. 1 shows an example in which one terminal 10 is provided. Note that the figures, dimensions, product names, etc. in the images of the data dg to be collected shown in FIGS. 1 to 3 are fictional ones created for the purpose of explaining this embodiment.
[0017] (Terminal 10) The terminal 10 has a first communication unit 11, a first control unit 13, an output unit 15, an input unit 17, and a data acquisition unit 19. The terminal 10 is used to upload the data dg to be collected. The first communication unit 11 communicates with the second communication unit 31 of the server 30 via a network. The first control unit 13 controls each part of the terminal 10. In particular, the first control unit 13 executes a data collection program installed in the recording unit 34 of the server 30. Details of the data collection program will be described later. The output unit 15 displays an execution screen (such as a data collection screen P) of the data collection program. The input unit 17 is used to operate the data collection program. For example, the data acquisition unit 19 includes an imaging device and obtains the data dg to be collected by imaging the object to be collected. In addition, the data acquisition unit 19 may include a recording medium reading device and obtain the data dg to be collected by reading a file recorded on the recording medium. Alternatively, the first communication unit 11 may function as a data acquisition unit 19 to obtain the data dg to be collected by receiving a file transmitted from another device via a network.
[0018] (Server 30) The server 30 includes a second communication unit 31, a second control unit 33, and a recording unit 34. The second communication unit 31 communicates with the first communication unit 11 of the terminal 10 via a network. The second control unit 33 controls each part of the server 30. The recording unit 34 records the data dg to be collected uploaded from the terminal 10 together with additional information. A data collection program is installed in the recording unit 34.
[0019] (Data collection program) The data collection program executes a data collection step S11, an upload step S12, a type identification step S13, a region recognition step S14, a character recognition step S15, an additional information setting step S16, and a recording step S17.
[0020] (Data collection step S11) In the data collection step S11, the data acquisition unit 19 acquires the data dg to be collected.
[0021] (Upload step S12) In the upload step S12, the first communication unit 11 transmits the data dg to be collected to the second communication unit 31.
[0022] (Type identification step S13) In the type identification step S13, the second control unit 33 identifies the type (file type) of the image of the data dg to be collected.
[0023] In this embodiment, in the type identification step S13, it is identified which of "drawing", "estimate", "inspection report", "defect management table", "process instruction", "product sample", "work sample", "3D", "CAM" the type of the image is. The identification of the type of image is performed based on the name of the file of the data dg to be collected, the extension of the file, the characters, figures, and table patterns included in the image of the data dg to be collected, and the like. For example, if a figure is included in the center of the image of the data dg to be collected, it is determined that the type of the image is "drawing", and if a table including amount information is included in the center of the image of the data dg to be collected, it is determined that the type of the image is "estimate".
[0024] (Region recognition step S14) In the region recognition step S14, the second control unit 33 identifies the main subject region A1 and the sub - subject region A2 in the image of the data dg to be collected. The main subject region A1 is a region including the main content of the image of the data dg to be collected. For example, when the data dg to be collected is drawing data, the region including the figure is the main subject region A1, and the region including the title bar, the revision column, and the table of tolerance grades is the sub - subject region A2. Also, for example, when the data dg to be collected is estimate data, the region including the estimated amount is the main subject region A1, and the region including the destination of the estimate, the issue date, the estimate number, etc. is the sub - subject region A2. For example, the identification of the main subject region A1 and the sub - subject region A2 is performed as follows. The region including a figure at the center of the image is determined to be the main subject region A1. The region including a table at the lower right of the image is determined to be the sub - subject region A2.
[0025] Also, the entire character recognition of the image of the data dg to be collected may be performed, and the main subject region A1 and the sub - subject region A2 may be identified from the character content. In this case, for example, the region where many numbers are arranged at the center of the image is determined to be the main subject region A1, and the region where many characters are arranged at the lower right of the image is determined to be the sub - subject region A2.
[0026] However, the identification of the main subject region A1 and the sub - subject region A2 may be performed by other methods.
[0027] (Character Recognition Step S15) In the character recognition step S15, the second control unit 33 identifies the character information included in the subject area A1 and the character information in the subtitle area A2.
[0028] (Additional Information Setting Step S16) In the additional information setting step S16, the second control unit 33 causes the output unit 15 to display a data collection screen P or the like (see FIG. 2).
[0029] (Data Collection Screen P) The data collection screen P has a first area P1, a second area P2, and a third area P3.
[0030] (First Area P1) The first area P1 includes the name of the file of the uploaded data dg to be collected and information regarding the creation date of the file.
[0031] (Second Area P2) The second area P2 includes the image information of the uploaded data dg to be collected.
[0032] (Third Area P3) The third area P3 is an area for setting additional information regarding the image information of the data dg to be collected, and includes a first setting area P31, a second setting area P32, a third setting area P33, and a fourth setting area P34. The additional information includes the type of the image of the data dg to be collected, the name corresponding to the type of the image of the data dg to be collected, the number corresponding to the type of the image of the data dg to be collected, and the case information linked to the type of the image of the data dg to be collected.
[0033] (First Setting Area P31) The first setting area P31 is an area for setting the type (file type) of the image of the data dg to be collected. In the first setting area P31, items preset (character information corresponding to the type of the image such as "drawing", "estimate", etc.) are displayed in a selectable state when the user of the terminal 10 operates the input unit 17. The selected item is displayed differently from other items (see Figure 3, such as highlighting). Among the items in the first setting area P31, those that are candidates for selection may be displayed differently from other items. The items that are candidates for selection are items corresponding to the type of image specified in the type specifying step S13.
[0034] That is, in the third area (additional information display area) P3, in the first setting area (area for setting the type of the image of the data dg to be collected) P31, based on the information obtained in the type specifying step S13, the character information corresponding to the type that is a candidate for the set type is displayed differently from the character information corresponding to other types.
[0035] For example, when it is determined in the type specifying step S13 that the type of the image of the data dg to be collected is "drawing", the item "drawing" in the first setting area P31 is displayed differently from other items.
[0036] However, there may be a case where the determination result of the type specifying step S13 is incorrect, and the user of the terminal 10 may operate the input unit 17 to switch to the selection of other items.
[0037] (Second setting area P32) The second setting area P32 is an area for setting a name (such as a drawing name) corresponding to the type of the image of the data dg to be collected. When an operation is performed via the input unit 17 in the area for inputting the name in the second setting area P32, a name selection area Sa is superimposed and displayed in the vicinity of the second setting area P32. The name selection area Sa is displayed in a state where candidates for the name can be selected when the user of the terminal 10 operates the input unit 17. The candidates for the name are selected by the second control unit 33 based on the type of the image of the data dg to be collected specified in the type specifying step S13, the character information in the subtitle area A2 specified in the area recognition step S14 and the character recognition step S15, the weighted information of the character information recorded in the recording unit 34, etc.
[0038] For example, when the type of the image of the data dg to be collected is "drawing", and "PaCk", "packing", and "A001-003" are specified as the character information in the subtitle area A2, "PaCk", "packing", and "A001-003" are displayed in the name selection area Sa. Note that the character information "packing" and "A001-003" are actually described in the subtitle area A2, showing an example that is correctly specified as character information. Also, the character information "PaCk" is not actually described in the subtitle area A2, showing an example that is mistakenly specified as character information.
[0039] However, there may be cases where the judgment results of the character recognition process S15 and the like are incorrect, and the user of the terminal 10 may operate the input unit 17 to input other names. Note that the selection of name candidates may also be performed based on the character information in the main topic area A1 and the like.
[0040] (Third setting area P33) The third setting area P33 is an area for setting a number (such as a drawing number) corresponding to the type of the image of the data dg to be collected. When an operation is performed via the input unit 17 in the area for inputting the number in the third setting area P33, a number selection area (not shown) is superimposed and displayed in the vicinity of the third setting area P33. The number selection area is displayed in a state where candidates for the number can be selected when the user of the terminal 10 operates the input unit 17. The candidates for the number are selected by the second control unit 33 based on the type of the image of the data dg to be collected specified in the type identification process S13, the character information in the subtitle area A2 specified in the area recognition process S14 and the character recognition process S15, the weighting information of the character information recorded in the recording unit 34, and the like.
[0041] However, there may be cases where the judgment results of the character recognition process S15 and the like are incorrect, and the user of the terminal 10 may operate the input unit 17 to input other numbers. Note that the selection of number candidates may also be performed based on the character information in the main topic area A1 and the like.
[0042] (Fourth setting area P34) The fourth setting area P34 is an area for setting linked case information corresponding to the type of image of the data dg to be collected.
[0043] (Recording step S17) In the recording step S17, when the user of the terminal 10 operates the input unit 17 to instruct the storage of the set additional information, the second control unit 33 causes the recording unit 34 to record the image information of the data dg to be collected uploaded in the upload step S12 and the additional information set or selected in the additional information setting step S16. Also, the character information listed as candidates in the name selection area Sa and the number selection area, and the character information selected or input by the user operating the input unit 17 are recorded, weight setting is performed on each piece of character information, and it is recorded as weight information. For example, among the character information "PaCk", "packing", and "A001 - 003" listed as candidates in the name selection area Sa, if "packing" is selected, the first weight information obtained by adding the weight score of the character information "packing" is recorded, and the second weight information obtained by subtracting the weight scores of the character information "PaCk" and "A001 - 003" is recorded.
[0044] That is, in the third area (additional information display area) P3, in at least one of the second setting area (area for setting a name) P32 and the third setting area (area for specifying a number) P33, a selection area (such as the name selection area Sa) is displayed based on at least one of the first weight information and the second weight information and the information obtained in the character recognition step S15.
[0045] (Effect of listing character information candidates in the name selection area Sa, etc.) The trouble of inputting drawing names, etc. can be omitted, and the collection of a large number of data dg to be collected can be facilitated.
[0046] (Effect of recording weight information considering the selection result) The character information with the weighted score added is more likely to be listed as a candidate in the next additional information setting step S16, and the character information with the weighted score subtracted is less likely to be listed as a candidate in the next additional information setting step S16. Therefore, the possibility that the correct character information is listed in the name selection area Sa or the like increases.
[0047] (Effect of listing candidates for the type of image) The labor of inputting the type of image can be omitted, and the collection of a large number of data dg to be collected can be facilitated.
[0048] (Application example of the execution entity of the data collection program) In this embodiment, an example has been described in which the data collection program is installed in the recording unit 34 of the server 30, and the first control unit 13 of the terminal 10 and the second control unit of the server 30 perform operation control corresponding to the execution of the data collection program. However, the data collection program is installed in the storage (not shown) of the terminal 10, and the first control unit 13 of the terminal 10 performs operation control corresponding to the execution of the data collection program (Such as the type identification step S13, the area recognition step S14, the character recognition step S15, the additional information setting step S16, the recording step S17, etc.) may be performed.
[0049] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and its equivalent scope.
Explanation of reference numerals
[0050] 1 Data collection system 10 Terminal 11 First communication unit 13 First control unit 15 Output section 17 Input section 19 Data acquisition section 30 Server 31 Second communication section 33 Second control section 34 Recording section dg Data to be collected A1 Main theme area (content area) A2 Sub - theme area (supplementary information area) P Data collection screen P1 First area (file name display area) P2 Second area (image display area) P3 Third area (additional information display area) P31 First setting area P32 Second setting area P33 Third setting area P34 Fourth setting area Sa Name selection area
Claims
1. A type identification step for identifying the type of the image of the data to be collected, A region recognition step for identifying the main subject region and the sub - subject region in the image of the data to be collected, A character recognition step for identifying at least one of the character information in the main subject region and the character information in the sub - subject region, An additional information setting step for displaying a data collection screen, and a data collection program that executes these steps, The data collection screen includes an image information display area for displaying the image information of the data to be collected and an additional information display area for setting additional information related to the image information of the data to be collected. In at least one of the area for setting the name corresponding to the type of the image of the data to be collected and the area for identifying the number corresponding to the type of the image of the data to be collected in the additional information display area, a selection area including character information candidates for the character information to be set based on the information obtained in the character recognition step is displayed. A data collection program.
2. The data collection program further executes a recording step of recording the image information and the additional information set in the additional information setting step. In the recording step, among the character information displayed in the selection area, the first weighting information of what was set in the additional information setting step and the second weighting information of what was not set in the additional information setting step are recorded. In at least one of the area for setting the name and the area for identifying the number in the additional information display area, the selection area is displayed based on at least one of the first weighting information and the second weighting information and the information obtained in the character recognition step. The data collection program according to Claim 1.
3. In the area for setting the type of the image of the data to be collected in the additional information display area, character information corresponding to a type that is a candidate for the set type is displayed so as to be different from the character information corresponding to other types, based on the information obtained in the type identification step. The data collection program according to claim 1 or claim 2.
4. A terminal for displaying the data collection screen in a data collection program that executes a type identification step for identifying the type of the image of the data to be collected, a region recognition step for identifying a main subject region and a sub - subject region in the image of the data to be collected, a character recognition step for identifying at least one of the character information in the main subject region and the character information in the sub - subject region, and an additional information setting step for displaying a data collection screen, wherein the data collection screen includes an image information display area for displaying the image information of the data to be collected and an additional information display area for setting additional information regarding the image information of the data to be collected. In at least one of the area for setting the name corresponding to the type of the image of the data to be collected and the area for identifying the number corresponding to the type of the image of the data to be collected in the additional information display area, a selection area including character information that is a candidate for the set character information is displayed based on the information obtained in the character recognition step.
Citation Information
Patent Citations
Chart management server and chart management system using the same
JP2014092836A