GENERATION DEVICE, GENERATION METHOD, AND GENERATION PROGRAM
The generation device automates the creation of machine learning data from block diagrams, reducing user effort by generating two types of diagrams, thus facilitating efficient training data production.
Patent Information
- Application Number
- JP2024538648
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-08-12
- Publication Date
- 2024-11-29
- Estimated Expiration
- 2042-08-12
AI Technical Summary
Generating large amounts of training data for machine learning using block diagrams is burdensome for users.
A generation device that automatically generates diagrams by acquiring element setting information and drawing styles, and produces two types of diagrams: one for learning and another without specific drawing styles for reduced user burden.
Reduces user burden by automating the generation of learning data, enabling efficient machine learning with diverse training data.
Smart Images

Figure 0007592227000001 
Figure 0007592227000002 
Figure 0007592227000003
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a generating device, a generating method, and a generating program. [Background technology]
[0002] Block diagrams are used in a variety of documents, such as drawings in patent documents, configuration diagrams in software design documents, and flow diagrams in manuals. Here, a technology has been proposed that extracts parts of a structured drawing, which is a paper or electronic image, to generate multiple drawing pieces to be used as recognition targets for machine learning (see Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2019-101514 A Summary of the Invention [Problem to be solved by the invention]
[0004] Incidentally, diagrams may be used as learning data. Machine learning requires a large amount of learning data. Therefore, in machine learning, a large amount of various diagrams are prepared. The various diagrams (i.e., the large amount of learning data) are generated by the user. However, generating the learning data by the user increases the burden on the user.
[0005] An object of the present disclosure is to reduce the burden on users. [Means for solving the problem]
[0006] A generating device according to one aspect of the present disclosure is provided. The generating device includes an acquisition unit that acquires element setting information, which is information used when setting elements in a diagram, and a drawing style list that indicates a drawing style, a first element generating unit that generates first element information indicating elements in the diagram based on the element setting information, a second element generating unit that generates at least one of an arbitrary part of elements and a relationship between the arbitrary part of elements as second element information based on the first element information, a first drawing style generating unit that generates first drawing style information based on the first element information and the drawing style list, a second drawing style generating unit that generates information of the first drawing style information that is not included in the second element information as second drawing style information, and generates a first diagram based on the first drawing style information. A diagram obtained by fading the color of the second drawing style information in the first diagram or by deleting the second drawing style information in the first diagram. a second drawing based on the first drawing style information, and an output unit that outputs the first drawing and the second drawing. Effect of the Invention
[0007] According to the present disclosure, the burden on the user can be reduced. [Brief description of the drawings]
[0008] [Figure 1] FIG. 2 is a block diagram showing the functions of a generating device. [Diagram 2] FIG. 2 is a diagram illustrating hardware included in a generating device. [Diagram 3] FIG. 11 is a diagram showing an example of first element information. [Figure 4] FIG. 1 shows an example of a diagram. [Diagram 5] FIG. 11 is a diagram showing an example of second element information. [Figure 6] FIG. 13 is a diagram showing an example of a drawing style list. [Figure 7] FIG. 11 is a diagram showing an example of first drawing style information. [Figure 8] A figure showing an example of second drawing style information. [Figure 9] FIG. 1 is a diagram showing an example of the first diagram. [Figure 10] FIG. 2 is a diagram showing an example of a second diagram. [Figure 11] 13 is a flowchart illustrating an example of a process executed by the generating device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] Hereinafter, an embodiment will be described with reference to the drawings. The following embodiment is merely an example, and various modifications are possible within the scope of the present disclosure.
[0010] Embodiment 1 is a block diagram showing the functions of a generating device. The generating device 100 is a device that executes a generating method. The generating device 100 is a smartphone, a tablet computer, a personal computer, a server computer, or the like.
[0011] Here, the hardware of the generation device 100 will be described. 2 is a diagram showing hardware included in the generating device 100. The generating device 100 includes a processor 101, a volatile storage device 102, and a non-volatile storage device 103.
[0012] The processor 101 controls the entire generating device 100. For example, the processor 101 is a central processing unit (CPU), a field programmable gate array (FPGA), a digital signal processor (DSP), or the like. The processor 101 may be a multiprocessor. The generating device 100 may also have a processing circuit. Furthermore, the generating device 100 may have a microcomputer or a system on chip (SoC).
[0013] The volatile storage device 102 is a main storage device of the generating device 100. For example, the volatile storage device 102 is a random access memory (RAM). The non-volatile storage device 103 is an auxiliary storage device of the generating device 100. For example, the non-volatile storage device 103 is a read only memory (ROM), a hard disk drive (HDD), or a solid state drive (SSD). Returning to FIG. 1, the function of the generating device 100 will be described.
[0014] The generation device 100 has a memory unit 110, an acquisition unit 120, a first element generation unit 130, a second element generation unit 140, a first drawing style generation unit 150, a second drawing style generation unit 160, a diagram generation unit 170, and an output unit 180.
[0015] The storage unit 110 may be realized as a storage area secured in the volatile storage device 102 or the non-volatile storage device 103 . A part or all of the acquisition unit 120, the first element generation unit 130, the second element generation unit 140, the first drawing style generation unit 150, the second drawing style generation unit 160, the diagram generation unit 170, and the output unit 180 may be realized by a processing circuit. Also, a part or all of the acquisition unit 120, the first element generation unit 130, the second element generation unit 140, the first drawing style generation unit 150, the second drawing style generation unit 160, the diagram generation unit 170, and the output unit 180 may be realized as a module of a program executed by the processor 101. For example, the program executed by the processor 101 is also called a generation program. For example, the generation program is recorded on a recording medium.
[0016] The acquisition unit 120 acquires the element setting information. For example, the acquisition unit 120 acquires the element setting information from the storage unit 110. For example, the acquisition unit 120 acquires the element setting information from an external device connectable to the generating device 100. Note that the external device is omitted from the drawing.
[0017] Element setting information is information used when setting elements in a diagram. For example, element setting information may be an integer between 1 and 10, an arbitrary character string, an inclusion relationship, a connection relationship by an arrow, a connection relationship by a line, a parallel relationship, etc. The arrows may include one-way arrows and two-way arrows. In the following description, elements are referred to as blocks.
[0018] The first element generating unit 130 generates first element information indicating elements in the diagram based on the element setting information. An example of the first element information is shown below.
[0019] FIG. 3 is a diagram showing an example of the first element information. Here, the generation of the first element information will be specifically described. For example, the first element generation unit 130 generates the number of blocks based on an integer between 1 and 10. In FIG. 3, the number of blocks is shown as "number of blocks: 4". Also, for example, the first element generation unit 130 generates block names based on an arbitrary character string. In FIG. 3, the block names are shown as "block names: XXX, YYY, ZZZ, AAA". For example, the first element generation unit 130 generates an inclusion relationship between blocks based on an inclusion relationship. For example, in FIG. 3, the inclusion relationship is shown as "relationship between XXX and YYY: YYY is included in XXX." For example, the first element generation unit 130 generates a connection relationship between blocks based on a connection relationship by an arrow. For example, in FIG. 3, the connection relationship is shown as "relationship between YYY and ZZZ: YYY and ZZZ are connected by a downward arrow."
[0020] In this way, the first element generating unit 130 generates an element of one drawing (for example, drawing ID "Drawing 1") as the first element information. Here, a state in which a drawing is created based on the element of drawing ID "Drawing 1" is shown.
[0021] Fig. 4 is a diagram showing an example of a drawing, which is created based on an element with a drawing ID "Drawing 1".
[0022] Similarly, the first element generating unit 130 generates other first element information based on the element setting information. For example, the first element generating unit 130 generates first element information indicating an element of the drawing ID "Drawing 2". In this manner, a plurality of first element information is generated by the generation of the first element generating unit 130. FIG. 4 illustrates a plurality of first element information 200.
[0023] The second element generating unit 140 generates at least one of an arbitrary part of elements and a relationship between the arbitrary part of elements as second element information based on the first element information. An example of the second element information is shown below.
[0024] FIG. 5 is a diagram showing an example of second element information. Here, the generation of the second element information will be specifically described. For example, the second element generation unit 140 generates an element "block XXX" as the second element information based on the first element information. For example, the second element generation unit 140 generates an inter-element relationship "relationship between XXX and ZZZ: ZZZ is included in XXX" as the second element information based on the first element information.
[0025] Similarly, the second element generating unit 140 generates other second element information based on other first element information. For example, the second element generating unit 140 generates second element information corresponding to the drawing ID "Drawing 2" based on the first element information corresponding to the drawing ID "Drawing 2". In this manner, a plurality of second element information is generated by the generation of the second element generating unit 140. FIG. 5 illustrates a plurality of second element information 201.
[0026] The acquisition unit 120 acquires the drawing style list. For example, the acquisition unit 120 acquires the drawing style list from the storage unit 110 or an external device. An example of the drawing style list will be described below.
[0027] 6 is a diagram showing an example of a drawing style list. The drawing style list 300 indicates drawing styles. For example, the drawing style list 300 indicates the drawing style of a block shape, a block color, a color of text in a block, a block border, and a connecting line. The drawing style list 300 may also indicate the block size, the block arrangement position, font, line thickness, arrow shape, etc.
[0028] The first drawing style generation unit 150 generates the first drawing style information based on the first element information and the drawing style list 300. An example of the first drawing style information is shown below.
[0029] FIG. 7 is a diagram showing an example of the first drawing style information. Here, the generation of the first drawing style information will be specifically described. For example, the first drawing style generation unit 150 generates the first drawing style information "Block XXX is rectangular" based on the first element information "Block XXX" and the shape of the block in the drawing style list 300. For example, the first drawing style generation unit 150 generates the first drawing style information "The border of block ZZZ is a dashed line" based on the first element information "Block ZZZ" and the border of the block in the drawing style list 300.
[0030] Similarly, the first drawing style generation unit 150 generates other first drawing style information based on other first element information and the drawing style list 300. For example, the first drawing style generation unit 150 generates first drawing style information based on first element information indicating an element of the drawing ID "Drawing 2" and the drawing style list 300. In this manner, a plurality of first drawing style information are generated by the generation of the first drawing style generation unit 150. FIG. 7 illustrates a plurality of first drawing style information 202.
[0031] The second drawing style generation unit 160 generates, as the second drawing style information, information that is not included in the second element information out of the first drawing style information. An example of the second drawing style information is shown below.
[0032] Fig. 8 is a diagram showing an example of the second drawing style information, which is generated by the second drawing style generation unit 160 and corresponds to the drawing ID "Drawing 1".
[0033] The second drawing style generation unit 160 generates other second drawing style information in the same manner. For example, the second drawing style generation unit 160 generates second drawing style information corresponding to the drawing ID "Drawing 2". In this manner, a plurality of second drawing style information is generated by the generation of the second drawing style generation unit 160. FIG. 8 illustrates a plurality of second drawing style information 203.
[0034] The diagram generating unit 170 generates a first diagram based on the first drawing style information. The first diagram may be generated as a raster image. The diagram generating unit 170 may generate the first diagram using the first element information and the first drawing style information.
[0035] Fig. 9 is a diagram showing an example of a first diagram, which is generated based on the first drawing style information of the drawing ID "Drawing 1".
[0036] The image generating unit 170 generates an image based on the first drawing style information as a second image, which is an image for preventing the second drawing style information from being used as learning data. For example, the image generating unit 170 generates the second image obtained by fading the color of the second drawing style information in the first image. The second image is illustrated below.
[0037] FIG. 10 is a diagram showing an example of the second diagram. For example, the diagram generation unit 170 lightens the color of the block AAA, which is the second drawing style information. Also, for example, the diagram generation unit 170 lightens the color of the "connection line between block YYY and block ZZZ", which is the second drawing style information. FIG. 10 shows the second diagram. The colors of "block AAA" and "connection line between block YYY and block ZZZ" in the second diagram are light. Here, FIG. 10 shows the light color state with dotted lines. Also, the color of "AAA" in FIG. 10 is lightened.
[0038] The second drawing style information is not used as learning data because the color of the second drawing style information becomes lighter. That is, the diagram in which "block AAA" and "connecting line between block YYY and block ZZZ" are not read into the learning device (i.e., the second diagram) is used as learning data.
[0039] Also, the diagram generating unit 170 may delete the second drawing style information in the first diagram. As a result, the second drawing style information is not used as learning data. That is, a diagram without "block AAA" and "connecting line between block YYY and block ZZZ" is used as learning data. The second diagram may be generated as a raster image.
[0040] The diagram generator 170 may also reformat the first diagram into a unified modeling language. For example, the unified modeling language is UML (Unified Modeling Language). The diagram generator 170 may also reformat the second diagram into the unified modeling language.
[0041] In this manner, the diagram generating unit 170 generates a first diagram. The diagram generating unit 170 generates other first diagrams in the same manner. For example, the diagram generating unit 170 generates a first diagram based on the first drawing style information of the drawing ID "Drawing 2". As a result, a plurality of first diagrams are generated. Also, the diagram generating unit 170 generates other second diagrams in the same manner. As a result, a plurality of second diagrams are generated.
[0042] The output unit 180 outputs a plurality of first diagrams and a plurality of second diagrams. For example, the output unit 180 outputs the plurality of first diagrams and the plurality of second diagrams to the storage unit 110 or an external device. The output unit 180 may also output a plurality of first element information and a plurality of second element information. Then, the plurality of first diagrams and the plurality of second diagrams are used as learning data.
[0043] Next, the process executed by generation device 100 will be described with reference to a flowchart. Fig. 11 is a flowchart showing an example of a process executed by the generating device, and Fig. 11 illustrates a case where one first diagram and one second diagram are generated. (Step S11) The acquiring unit 120 acquires element setting information. (Step S12) The first element generating unit 130 generates first element information based on the element setting information. (Step S13) The second element generating unit 140 generates second element information based on the first element information.
[0044] (Step S14) The first drawing style generation unit 150 generates first drawing style information based on the first element information and the drawing style list 300. (Step S15) The second drawing style generation unit 160 generates, as second drawing style information, information that is not included in the second element information, out of the first drawing style information. (Step S16) The diagram generating unit 170 generates a first diagram based on the first drawing style information. (Step S17) The image generating unit 170 generates, as a second image, an image for preventing the second drawing style information from being used as learning data, based on the first drawing style information. (Step S18) The output unit 180 outputs the first and second diagrams to the storage unit 110.
[0045] According to the embodiment, the generating device 100 automatically generates a first diagram (i.e., learning data). Thus, the generating device 100 can reduce the burden on the user. Moreover, the generating device 100 automatically generates a second diagram (i.e., learning data). Thus, the generating device 100 can reduce the burden on the user. Moreover, the second diagram is different from the first diagram. Therefore, in machine learning, different learning can be realized by using the second diagram. [Explanation of symbols]
[0046] 100 generation device, 101 processor, 102 volatile storage device, 103 non-volatile storage device, 110 memory unit, 120 acquisition unit, 130 first element generation unit, 140 second element generation unit, 150 first drawing style generation unit, 160 second drawing style generation unit, 170 diagram generation unit, 180 output unit, 200 multiple first element information, 201 multiple second element information, 202 multiple first drawing style information, 203 multiple second drawing style information, 300 drawing style list.
Claims
1. an acquisition unit that acquires element setting information, which is information used when setting elements in a diagram, and a drawing style list that indicates drawing styles; a first element generating unit that generates first element information indicating an element in a drawing based on the element setting information; a second element generating unit that generates, based on the first element information, at least one of an arbitrary part of elements and a relationship between the arbitrary part of elements as second element information; a first drawing style generation unit that generates first drawing style information based on the first element information and the drawing style list; a second drawing style generation unit that generates, as second drawing style information, information of the first drawing style information that is not included in the second element information; a diagram generating unit that generates a first diagram based on the first drawing style information, and generates a diagram as a second diagram by fading a color of the second drawing style information in the first diagram or by deleting the second drawing style information in the first diagram, based on the first drawing style information; an output unit that outputs the first diagram and the second diagram; A generating device having the following:
2. The generating device, obtaining element setting information, which is information used when setting elements in a diagram, and a drawing style list indicating a drawing style; generating first element information indicating elements in the diagram based on the element setting information; generating at least one of an arbitrary part of elements and a relationship between the arbitrary part of elements as second element information based on the first element information; generating first drawing style information based on the first element information and the drawing style list; and generating information of the first drawing style information that is not included in the second element information as second drawing style information; generating a first figure based on the first drawing style information, and generating a second figure based on the first drawing style information by fading the color of the second drawing style information in the first figure or deleting the second drawing style information in the first figure; outputting the first diagram and the second diagram; Generation method.
3. A generating device, obtaining element setting information, which is information used when setting elements in a diagram, and a drawing style list indicating a drawing style; generating first element information indicating elements in the diagram based on the element setting information; generating at least one of an arbitrary part of elements and a relationship between the arbitrary part of elements as second element information based on the first element information; generating first drawing style information based on the first element information and the drawing style list; and generating information of the first drawing style information that is not included in the second element information as second drawing style information; generating a first figure based on the first drawing style information, and generating a second figure based on the first drawing style information by fading the color of the second drawing style information in the first figure or deleting the second drawing style information in the first figure; outputting the first diagram and the second diagram; The generating program that causes the processing to occur.
Citation Information
Patent Citations
Processing device and method for preparing diagram
JP1995287754A
Chart graphic processor
JP1998011599A
Drawing machine learning support system, drawing machine learning system, drawing structuring system, drawing machine learning support method, and drawing machine learning support program
JP2019101514A
