Image generation assisting device and image generation assisting method
By reading the design drawings and extracting component data from the database to generate candidate screen data, the corrections increase caused by the difference between the design drawings and the display device operators is solved, and efficient and accurate generation of the display screen is achieved.
Patent Information
- Application Number
- CN202180010036.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-01-17
- Filing Date
- 2021-01-14
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2041-01-14
AI Technical Summary
When generating a display screen, the operators of the design drawings and display devices are usually different, resulting in frequent correction of the position and shape of the components during the generation of the display screen, which increases the workload and error.
Through the image generation auxiliary device, the design drawing is read to generate input screen data, and the corresponding component data is extracted from the database, and candidate screen data is generated based on group definition information and additional information, reducing the correction part and ensuring faithful reproduction of the design.
It effectively reduces the corrected part when generating the display screen, improves the faithful reproduction of the design, and improves the efficiency and accuracy of the user-generated display screen.
Smart Images

Figure CN115004234B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to an image generation assisting device and an image generation assisting method for presenting candidate screen data of a display screen designed arbitrarily based on a design drawing of the display screen. Background Art
[0002] In a control device for controlling the operation of industrial machinery such as a machine tool, a display device (e.g., a touch panel display device) that displays numerical values, control parameters, etc. for indicating the state of a controlled object has components such as buttons, labels, or list boxes for selecting a process or function to be controlled arranged on a display screen that displays these numerical values and control parameters. The user of the control device can select the operation or function of the controlled object by touching these components.
[0003] The display device used in such a control device generally functions as a user interface capable of inputting or displaying selection actions such as on / off performed by the user, and therefore the layout of the above components on the display screen needs to be studied to facilitate user input. In addition, image generation assistance technology is used to determine or generate the layout of these components on the display screen.
[0004] As an example of image generation assistance technology for such a display device, patent document 1 discloses a screen data editing device for a programmable display, which is equipped with a data storage unit for storing a plurality of components belonging to a certain category among a plurality of categories and a component collection screen including one or more components, generates a component collection screen for a programmable display by allowing a user to edit the component collection screen on an editing screen, stores the generated component collection screen in the data storage unit, generates project data including the stored one or more component collection screens, and the screen data editing device for a programmable display has: a usage information generating unit, which, for each component collection screen stored in the data storage unit, calculates the usage information for each component type based on the size of each component included in the component collection screen and the number of edits Calculate the actual use area, select the category with the largest actual use area as the inherent category, determine the purpose of the component set screen according to the inherent category, and generate the purpose information indicating the purpose of the component set screen; attribute information storage unit, which stores the actual use area and purpose information of the inherent category generated by the purpose information generation unit for each component set screen stored in the data storage unit; extract the component set screen with the same purpose as the purpose specified when the component set screen is newly generated from the component set screen stored in the data storage unit according to the purpose information stored in the attribute information storage unit, and set the order of the actual use area based on the inherent category stored in the attribute information storage unit for each extracted component set screen; and display the extracted component set screens at a glance according to the set order. According to such an apparatus, it is easy to reuse existing project data and easy to search for desired data, so there is no need to newly generate similar screens multiple times, and it is not necessary to spend time searching for target data when reusing project data.
[0005] In addition, Patent Document 2 discloses a display screen generation auxiliary device, which includes: a display data storage unit that stores display data, which is used for the display screen of a programmable display and is data of a display component that indicates the component state; a display screen generation unit that uses screen components to generate a display screen; and a display unit that displays a screen that accepts search conditions for searching display data, wherein the display screen generation unit has a search execution unit that accepts the search conditions and searches for display data in the display data storage unit based on the search conditions. According to such a device, by aggregating the screen components corresponding to the display data assigned a search tag that matches the search keyword into groups classified by display attributes and displaying them at a glance for each group, the user can efficiently generate a display screen with a unified design.
[0006] Prior art literature
[0007] Patent Literature
[0008] Patent Document 1: Japanese Patent Application Publication No. 2012-155367
[0009] Patent Document 2: International Publication No. 2018 / 073871 Summary of the invention
[0010] Problems to be solved by the invention
[0011] However, when generating the display screen of the display device, a design drawing of the display screen is generally used. In such a case, the person who generates the design drawing for designing the display screen is often different from the person who generates the display screen of the display device in the control device.
[0012] In this way, refer to the design Figure 1 When generating a display screen, even if the auxiliary technology disclosed in Patent Document 1 or Patent Document 2 is used, the operation is limited to extracting reference component data from a stored database for the types and shapes of various components shown in the design drawing to be generated and presenting them. Therefore, the operator who generates the display screen needs to select appropriate component data from the component data presented by the auxiliary device and correct the position, shape of the detailed part, etc. according to the referenced design drawing.
[0013] Under such background, there is a demand for an image generation assisting technology that can faithfully reproduce a design that is referred to when generating a display screen and reduce the amount of correction.
[0014] Means for solving problems
[0015] An image generation assistance device according to one embodiment of the present invention prompts candidate screen data of a display screen of any design based on a design drawing of the display screen, and the image generation assistance device comprises: an image input unit, which reads the design drawing to generate input screen data; a database, which stores component data of display components constituting display screens of past designs; and a screen data generation unit, which obtains component data from the database to generate candidate screen data corresponding to the display screen, the database also stores types of component data and group definition information based on combinations of component data, the screen data generation unit includes: a type determination unit, which determines the types of input components included in the input screen data; and an additional information generation unit, which generates additional information combined with the types of input components based on the group definition information, and generates candidate screen data corresponding to the input screen data based on the types of these input components and the additional information.
[0016] An image generation assisting method according to one embodiment of the present invention automatically generates candidate screen data of a display screen based on a design drawing of a display screen of any design. After the design drawing is read to generate input screen data, the component data is obtained from a database storing component data of display components constituting display screens of past designs to generate candidate screen data corresponding to the display screen. Types of component data and group definition information based on combinations of component data are stored in the database. After the types of input components contained in the input screen data are identified and additional information combined with the types of input components is generated based on the group definition information, candidate screen data is generated based on the types of these input components and the additional information.
[0017] Effects of the Invention
[0018] According to one embodiment of the present invention, the image input unit reads a design drawing to generate input screen data, and the screen data generation unit generates candidate screen data corresponding to the input screen data based on the type of input components and additional information, thereby being able to faithfully reproduce the design referenced when generating a display screen and reduce the amount of revisions. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] Figure 1 This is a block diagram showing an overview of the image generation support device according to the first embodiment.
[0020] Figure 2 This is a block diagram showing an example of a specific structure of the screen data generating unit of the first embodiment.
[0021] Figure 3 This is a schematic diagram showing an example of a design diagram applied to the image generation support method of Example 1.
[0022] Figure 4A This is a schematic diagram showing an example of input screen data generated by the image input unit and the determination result of the type determination unit.
[0023] Figure 4B This is a schematic diagram showing an example of input screen data generated by the image input unit and the determination result of the type determination unit.
[0024] Figure 4C This is a schematic diagram showing an example of input screen data generated by the image input unit and the determination result of the type determination unit.
[0025] Figure 5A This is a schematic diagram showing an example of the type of corrective action performed based on the additional information generated by the additional information generating unit.
[0026] Figure 5B This is a schematic diagram showing an example of the type of corrective action performed based on the additional information generated by the additional information generating unit.
[0027] Figure 5C This is a schematic diagram showing an example of the type of corrective action performed based on the additional information generated by the additional information generating unit.
[0028] Fig. 6A This is a schematic diagram showing an example of candidate screen data generated by the screen data generating unit.
[0029] Figure 6B This is a schematic diagram showing an example of candidate screen data generated by the screen data generating unit.
[0030] Fig. 7A It is a schematic diagram showing a modified example of the additional information generated by the additional information generating unit.
[0031] Figure 7B It is a schematic diagram showing a modified example of the additional information generated by the additional information generating unit.
[0032] Figure 8 This is a block diagram showing an overview of an image generation support device according to the second embodiment.
[0033] Fig. 9 This is a block diagram showing an example of a specific structure of the screen data generating unit of the second embodiment.
[0034] Fig. 10A An overview of the operations performed by the frequency calculation unit of the second embodiment is shown.
[0035] Fig. 10B An overview of the operations performed by the frequency calculation unit of the second embodiment is shown.
[0036] Fig.11 This is a block diagram showing a modified example of the screen data generating unit of the second embodiment. DETAILED DESCRIPTION
[0037] Hereinafter, specific embodiments of an image generation support device and an image generation support method for presenting candidate screen data of a display screen based on a design drawing of an arbitrarily designed display screen, which are representative examples of the present invention, will be described with reference to the accompanying drawings.
[0038] <Example 1>
[0039] First, use Figure 1 to Figure 6B An overview of an image generation support device and an image generation support method for presenting candidate screen data of a display screen designed arbitrarily based on a design drawing of the display screen according to Embodiment 1 as a representative example of the present invention will be described. Figure 1 FIG. 1 is a block diagram showing an overview of an image generation support device according to Embodiment 1 of the present invention. Figure 1As shown, as an example of an image generation assistance device 100, for example, it is applied in combination with a display device 10 provided in a control object such as industrial machinery, and includes: a main control unit 110, which exchanges data with the above-mentioned display device 10 and also controls the operation of the entire image generation assistance device 100; an image input unit 120, which reads a design drawing P generated as a paper medium or electronic data to generate an input screen data ID; a database 130, which stores component data of display components constituting a display screen designed in the past; and a screen data generation unit 140, which obtains the above-mentioned component data from the database 130 to generate candidate screen data CD corresponding to the display screen.
[0040] The display device 10 includes a display unit 12, which constitutes a part of the controlled object and displays a numerical value, a control parameter, etc. for indicating the state of the controlled object. In addition, the display device 10 is preferably configured as a user interface including an input mechanism (not shown) that allows a user to select a function and input a numerical value to be controlled. As such a display device, a touch panel type display device can be exemplified.
[0041] The main control unit 110 of the image generation support device 100 has a function of receiving the candidate screen data CD from the screen data generation unit 140 described later and sending the candidate screen data CD to the display device 10. At this time, the main control unit 110 is electrically connected to the display device 10 via wire or wireless, and is configured to be able to send and receive signals to each other. In addition, the main control unit 110 also controls the operation of the entire image generation support device 100 including the image input unit 120 and the screen data generation unit 140.
[0042] The image input unit 120 has a function of reading a design drawing P of a display screen generated in advance by a designer or the like and generating electronic input screen data ID. As an example of the design drawing P, Figure 3 As shown in the figure, it is a design drawing recorded on a medium such as paper as a full-color handwritten picture or printed text. Figure 3 In the example shown, the design drawing P includes a single or multiple of the following components: labels LA1, LA2 for displaying parameters and numerical values, lights LP1, LP2 that light up or go out in a single color or multiple colors, a button BT that can input whether or not to select something by touching (pressing) the screen, and a list box LB that records scheduled articles, etc.
[0043] The image input unit 120 reads the entire area of the design drawing P as data, and the labels LA1, LA2, lamps LP1, LP2, buttons BT, list boxes LB, etc. are taken in as "component data" of the design drawing P. Examples of such an image input unit 120 include an optical scanner, a device having a function of converting a captured image into pixel data, and the like.
[0044] As an example of input screen data ID, Figure 4A As shown, for example, the entire surface area of the design drawing P is divided into the first quadrant Q1 to the fourth quadrant Q4, and the parts included in each quadrant are digitized in the form of adding the quadrant name as the position information. Figure 4B As shown in Figure 1, each component is given shape, color, position, etc. as basic information. Figure 4A to Figure 4C In the present invention, types such as "label", "button", "light", and "list box" are added to each component, but at the stage where the design drawing is read by the image input unit 120 and converted into electronic data, the type of each component cannot be determined.
[0045] The database 130 stores "component data" of display screens used or read in the past. In this case, in the stored "component data", in addition to the above-mentioned shape, color, and position, the type is also added and stored as "component information" PI. In addition, in the component information PI of the "component data", for a specific component, "frequency information" CI, which shows how many times its shape, color, position, or type has been used for each factor, and a combination of shape, color, position, and type when multiple specific components are gathered together to form a group, is also included as "group definition information" GI.
[0046] Figure 2 FIG. 1 is a block diagram showing an example of a specific structure of the screen data generating unit of Example 1. Figure 2 As shown, the screen data generating unit 140 includes: a type determination unit 142 that determines the type PT of the input component included in the input screen data ID; and an additional information generating unit 144 that generates additional information AI for the type PT of the input component based on the group definition information GI. Furthermore, the screen data generating unit 140 is configured to generate candidate screen data CD corresponding to the input screen data ID based on the type PT of the component determined by the type determination unit 142 and the additional information AI generated by the additional information generating unit 144, and send the candidate screen data CD to the main control unit 110.
[0047] Next, the steps of the image generation support method using the image generation support device 100 of the first embodiment will be described.
[0048] First, as an example, the image input unit 120 reads Figure 3 The design diagram P shown in the figure generates Figure 4A Then, the generated input screen data ID is accumulated in the database 130 and sent to the screen data generating unit 140.
[0049] like Figure 2As shown, the screen data generating unit 140 receives the input screen data ID from the image input unit 120 and accesses the database 130 to obtain the group definition information GI, etc. On the other hand, the screen data generating unit 140 sends the component information PI including the type PT of the component identified by the type identifying unit 142 and the additional information AI generated by the additional information generating unit 144 to the database 130. Thus, the information stored in the database 130 is updated.
[0050] like Figure 4B As shown, the type determination unit 142 extracts the components included in the first quadrant Q1 of the input screen data ID. At this time, as an example of a method for the type determination unit 142 to determine the type of component PT, a method can be applied in which the shape of the component is defined in combination with the type, and the shape of the component to be determined is prioritized as a determination index. Figure 4B In the first quadrant Q1 shown, for example, for one tag LA2 and three lamps LP1, component information PI, which is basic information of component data including the type PT of each component, is extracted.
[0051] Similarly, in Figure 4C In the fourth quadrant Q4 shown, for example, the component information PI including the component data of the type PT of each component is extracted for three lamps LP2 and one list box LB. The component information PI thus extracted is sent to the database 130 as new reference data for determination and is additionally stored.
[0052] On the other hand, the image generation support device 100 of the first embodiment generates additional information AI for correcting the type PT of the component identified by the type identification unit 142 as needed. That is, first, the type PT of the component data identified by the type identification unit 142 is sent to the additional information generation unit 144.
[0053] Next, the screen data generator 140 accesses the database 130 and receives group definition information GI based on previously accumulated component data. At this time, the component information PI of the currently identified component is referenced to select the group to which the shape, color or position of the identified component belongs.
[0054] For example, if Figure 5A As shown, in the first quadrant Q1 of the input screen data ID, when the component data identified as one label LA2, one button BT, and two lamps LP1 are extracted, the Figure 5BIn this case, the extracted component data contains a mixture of buttons BT and lamps LP1, but the group definition information GI based on the display screen generated in the past contains only three lamps LP1. Therefore, the additional information generation unit 144 generates additional information AI that corrects the type PT of the component identified as a button BT by the type identification unit 142 to lamps LP1. Then, by combining these information, as shown in FIG. Figure 5C As shown, with respect to the input screen data ID input this time, the type PT of the component 3 determined as the button BT is recognized as the lamp LP1.
[0055] Then, if Fig. 6A As shown, the screen data generating unit 140 integrates the input screen data ID, the type PT of the component identified by the type identifying unit 142, and the additional information AI generated by the additional information generating unit 144, arranges the extracted components in the first quadrant Q1 to the fourth quadrant Q4 to generate candidate screen data CD, and sends it to the main control unit 110. Then, the generated candidate screen data CD is transmitted from the main control unit 110 to the display device 10 to be displayed on the display unit 12.
[0056] At this time, if there is no need to correct the detailed position of the configured components, such as Figure 6B As shown, it is directly determined to display screen D. On the other hand, for example, Fig. 6A As shown, when the user determines that the position of a component in the candidate screen data CD generated by the screen data generating unit 140 should be corrected or wants to correct the position, the following function can be added: the user selects input for directly moving the component on the candidate screen data CD displayed in the display unit 12, thereby making the final display screen D.
[0057] in addition, Fig. 7A as well as Figure 7B is a schematic diagram showing a modified example of the additional information generated by the additional information generating unit. Fig. 7A As shown in FIG. 1 , it is assumed that the group definition information GI stored in the database 130 stores groups such as the pattern A1 or A2. Figure 7B As shown, when four buttons BT are extracted from one position, if the case of pattern A1 is accumulated as a case that is frequently used and recommended, it is possible to present that six buttons BT are included in the candidate screen data CD.
[0058] As described above, according to the image generation assistance device and image generation assistance method for presenting candidate screen data of a display screen based on a design drawing of an arbitrarily designed display screen according to the first embodiment of the present invention, the image input unit reads the design drawing to generate input screen data, and the screen data generation unit generates candidate screen data corresponding to the input screen data based on the type of input components and additional information, thereby being able to faithfully reproduce the design referenced when generating the display screen and reduce the revised portion. In addition, the revision is made to the candidate screen data with reference to past data and is proposed, thereby being able to assist the user when generating the display screen.
[0059] <Example 2>
[0060] Next, use Figure 8 to Figure 11 The following is an overview of an image generation assistance device and an image generation assistance method for presenting candidate screen data of a display screen based on a design drawing of an arbitrarily designed display screen according to a second embodiment of the present invention. In the description of the image generation assistance device and the image generation assistance method of the second embodiment, the same reference numerals are used in the drawings for the same or common parts as those in the first embodiment, and the description thereof is omitted.
[0061] Figure 8 FIG. 2 is a block diagram showing an overview of an image generation support device according to a second embodiment of the present invention. Figure 8 As shown, as an example of an image generation support device 100, it is applied in combination with the display device 10 in the same way as in Example 1, and includes a main control unit 110, an image input unit 120, a database 130, a screen data generation unit 140, and a frequency calculation unit 150 that calculates the usage frequency FI of each type PT of component data based on the number of times information CI included in the component information PI accumulated in the database 130.
[0062] When receiving the component information PI of the currently identified component from the screen data generating unit 140, the frequency calculating unit 150 accesses the database 130 to receive the frequency information CI corresponding to the component information PI, performs a predetermined operation on the frequency information CI, and thereby obtains the usage frequency FI of each type BT of the component. The frequency calculating unit 150 is configured to send the usage frequency FI to the screen data generating unit 140.
[0063] Fig. 9 FIG. 1 is a block diagram showing an example of a specific structure of the screen data generating unit of Example 2. Fig. 9As shown, the screen data generating unit 140 includes: a type determination unit 142; and an additional information generating unit 144, which generates additional information AI for the type PT of the input component based on the group definition information GI and the use frequency FI calculated by the frequency calculation unit 150. In addition, the screen data generating unit 140 is configured to generate candidate screen data CD corresponding to the input screen data ID based on the type PT determined by the type determination unit 142 and the additional information AI generated by the additional information generating unit 144, and send it to the main control unit 110.
[0064] Next, an example of an image generation support method using the image generation support device 100 of the second embodiment will be described.
[0065] In the image generation support device 100 of the second embodiment, as Fig. 10A As shown, the type determination unit 142 extracts the components contained in the first quadrant Q1 of the input screen data ID. Fig. 10A In the first quadrant Q1 shown, for example, component information PI is extracted for one label LA2, one lamp LP1, one button BT, and one component of unknown type.
[0066] Here, in the image generation support device 100 of the second embodiment, for such unknown types of parts, the usage frequency FI of each part data is calculated based on the number of times information CI based on the past usage of each part data accumulated in the database 130, and the calculation result is sent to the screen data generation unit 140.
[0067] That is, for example, Fig. 10B As shown, the frequency calculation unit 150 reads the frequency information CI that summarizes the number of times the type was used in the past according to the shape, color and position of the component. Here, the frequency information CI sets a weight coefficient that determines the items that are prioritized over others in the determination of the type PT and weights each item. The weight coefficient can be arbitrarily determined in consideration of the purpose of the device to which the display screen is applied, etc.
[0068] As a method of calculating the usage frequency FI from the frequency information CI, for example, the frequency value is applied to the following mathematical formula for each type of component to perform calculation.
[0069] (Frequency of lamp use)
[0070] [Formula 1]
[0071]
[0072] (Frequency of button usage)
[0073] [Formula 2]
[0074]
[0075] (Frequency of use of tags)
[0076] [Formula 3]
[0077]
[0078] (Frequency of use of list box)
[0079] [Formula 4]
[0080]
[0081] Then, in the screen data generating unit 140, the additional information generating unit 144 determines based on the above calculation results that Fig. 10B The lamp usage frequency FI is the largest in the number of times information CI shown, and the additional information AI is generated that the type PT of the unknown component is estimated to be the lamp LP1. This can improve the accuracy of determining the type PT of the component in the candidate screen data CD.
[0082] in addition, Fig.11 This is a block diagram showing a modified example of the screen data generating unit of the second embodiment.
[0083] like Fig.11 As shown, the screen data generating unit 140 of the image generation supporting device 100 of the second embodiment may be configured to have a built-in Figure 8 In this case, the frequency calculation unit 150 can share the information of the type PT of the component identified by the type identification unit 142 within the screen data generation unit 140, and no special structure for transmitting information is required, so the structure of the entire image generation support device 100 can be simplified.
[0084] As described above, according to the second embodiment of the present invention, the image generation assistance device and the image generation assistance method for prompting candidate screen data of a display screen based on a design drawing of an arbitrarily designed display screen, in addition to the effects obtained in the first embodiment, can also infer the type of unknown components based on the frequency of use of the components in the past, and can improve the accuracy of component type discrimination when generating final candidate screen data.
[0085] The present invention is not limited to the above-described embodiment, and can be appropriately modified without departing from the gist of the invention. The present invention can modify any constituent element of the embodiment or omit any constituent element of the embodiment within the scope of the invention.
[0086] Description of Reference Numerals
[0087] 10 Display device
[0088] 12 Display unit
[0089] 100 Image generation auxiliary device
[0090] 110 Main control unit
[0091] 120 Image input unit
[0092] 130 Database
[0093] 140 Screen data generation unit
[0094] 142 Type Identification Department
[0095] 144 Additional information generation unit
[0096] 150 Frequency calculation unit.
Claims
1. An image generation assisting device for presenting candidate screen data of a display screen based on a design drawing of a display screen designed arbitrarily, characterized in that: have: An image input unit that reads the design drawing to generate input screen data; a database storing component data of display components constituting the display screen designed in the past; and a screen data generating unit that acquires the component data from the database to generate the candidate screen data corresponding to the display screen, The database stores the types of the component data and group definition information based on the combination of the component data. The screen data generating unit includes: a type determination unit that determines the type of input components included in the input screen data; and an additional information generating unit that generates additional information for correcting the type of the input component determined by the type determining unit based on the group definition information, Furthermore, the screen data generating unit generates the candidate screen data corresponding to the input screen data based on the type of the input component and the additional information.
2. The image generation support device according to claim 1, characterized in that: The database further accumulates frequency information based on the frequency of use of each of the component data. The image generation support device further includes a frequency calculation unit that calculates a usage frequency of each type of the component data based on the number of times information. The screen data generating unit generates the candidate screen data by taking into account the use frequency in addition to the type of the input component and the additional information.
3. The image generation support device according to claim 2, characterized in that: The frequency calculation unit is built in the screen data generation unit.
4. The image generation support device according to any one of claims 1 to 3, characterized in that: The group definition information includes the number of the component data in the same group, and the additional information generating unit adds the recommended number of the input components included in the input screen data to the additional information based on the number of the component data.
5. The image generation support device according to any one of claims 1 to 3, characterized in that: The screen data generating unit has a function of correcting the candidate screen data based on a selection from a user.
6. An image generation assisting method, which automatically generates candidate screen data of a display screen based on a design drawing of an arbitrarily designed display screen, characterized in that: After the design drawing is read to generate input screen data, the component data is acquired from a database storing component data of display components constituting the display screen designed in the past to generate candidate screen data corresponding to the display screen. The database stores the types of the component data and group definition information based on the combination of the component data. After the type of the input component included in the input screen data is determined and additional information correcting the determined type of the input component is generated based on the group definition information, the candidate screen data is generated based on the type of the input component and the additional information.
7. The image generation assisting method according to claim 6, characterized in that: The database also stores frequency information based on the frequency of use of each of the component data. calculating the usage frequency of each type of the component data based on the number of times information, Furthermore, the candidate screen data is generated by taking into account the usage frequency in addition to the type of the input component and the additional information.
8. The image generation assisting method according to claim 6 or 7, characterized in that: The group definition information includes the number of the component data in the same group, and the recommended number of the input components included in the input screen data is added to the additional information based on the number of the component data.
9. The image generation assisting method according to claim 6 or 7, characterized in that: After the candidate screen data is displayed, the candidate screen data can be modified based on a selection from the user.
