GUI application creation support apparatus, GUI application creation support method, and program

Abstract

To provide a GUI application creation support apparatus, a GUI application creation support method, and a program with which a screen can be created more simply regardless of the skill of a user.SOLUTION: A GUI application creation support apparatus 3 includes a frame designation processing unit 31, a component acquisition processing unit 32, and a screen creation support unit 33. The frame designation processing unit 31 designates a frame. The component acquisition processing unit 32 acquires one or more components according to the frame. The screen creation processing unit 33 creates a screen by arranging the one or more components on the frame in accordance with arrangement conditions on the frame.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to a GUI application creation support device, a GUI application creation support method, and a program. [Background technology]

[0002] As a related technique, a GUI application creation (development) support device that supports the creation (development) of a graphical user interface (GUI) application for embedded devices is known (see, for example, Patent Document 1). This GUI application creation support device includes GUI component general-purpose structure data that can be used in a general-purpose programming language, and a GUI screen editing means that uses GUI components included in the GUI component general-purpose structure data to generate a GUI screen as GUI screen structure data that can be used in a general-purpose programming language. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2009-20705 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the related technologies described above, when creating a GUI screen, in order to select an appropriate part from a large number of parts, which may amount to several hundred, it is necessary to understand what each part means and in what cases it is used, and depending on the user's level of skill, creating the screen can be difficult.

[0005] An object of the present invention is to provide a GUI application creation support device, a GUI application creation support method, and a program that enable a user to create a screen more easily, regardless of the user's level of skill. [Means for solving the problem]

[0006] A GUI application creation support device according to one aspect of the present invention includes a frame designation processing unit, a parts acquisition processing unit, and a screen creation processing unit. The frame designation processing unit designates a frame. The parts acquisition processing unit acquires one or more parts according to the frame. The screen creation processing unit creates a screen by arranging the one or more parts on the frame in accordance with an arrangement condition for the frame.

[0007] A GUI application creation support method according to another aspect of the present invention includes specifying a frame, obtaining one or more parts according to the frame, and creating a screen by placing the one or more parts on the frame in accordance with placement conditions for the frame.

[0008] A program relating to another aspect of the present invention is a program for causing one or more processors to execute the following steps: specifying a frame; obtaining one or more parts according to the frame; and creating a screen by placing the one or more parts on the frame in accordance with placement conditions for the frame. Effect of the Invention

[0009] According to the present invention, it is possible to provide a GUI application creation support device, a GUI application creation support method, and a program that enable a user to create a screen more easily, regardless of the user's level of skill. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a schematic block diagram of an image processing device according to the first embodiment. [Diagram 2] FIG. 2 is a schematic diagram showing the appearance of the image processing device according to the first embodiment. [Diagram 3] FIG. 3 is a schematic diagram showing an example of a screen displayed on the display unit of the image processing device according to the first embodiment. [Figure 4]FIG. 4 is a schematic block diagram of the GUI application creation support device according to the first embodiment. [Diagram 5] FIG. 5 is a schematic diagram showing an example of a frame used in the GUI application creation support device according to the first embodiment. [Figure 6] FIG. 6 is a schematic diagram showing an example of a screen created by the GUI application creation support device according to the first embodiment. [Figure 7] FIG. 7 is a schematic diagram showing an example of a screen created by the GUI application creation support device according to the first embodiment. [Figure 8] FIG. 8 is a table showing an example of data relating to the specifications of each of a plurality of frames used in the GUI application creation support device according to the first embodiment. [Figure 9] FIG. 9 is a schematic diagram showing an example of a screen created by the GUI application creation support device according to the first embodiment. [Figure 10] FIG. 10 is a schematic diagram showing an example of a screen created by the GUI application creation support device according to the first embodiment. [Figure 11] FIG. 11 is a schematic diagram showing an example of a screen created by the GUI application creation support device according to the first embodiment. [Figure 12] FIG. 12 is a flowchart illustrating an example of the operation of the GUI application creation support device according to the first embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. The following embodiment is an example of the present invention, and is not intended to limit the technical scope of the present invention.

[0012] (Embodiment 1) [1] Overall configuration of image processing device First, the overall configuration of an image processing device 10 according to this embodiment will be described with reference to FIGS.

[0013] The image processing device 10 according to the present embodiment is, for example, a multifunction device having multiple functions such as a scanning function for acquiring image data from an original, a printing function for forming an image based on image data, a facsimile function, and a copy function. The image processing device 10 only needs to have an image processing function including at least one of a function for forming an image and a function for acquiring image data, and may be a printer, a scanner, a facsimile machine, a copy machine, or the like.

[0014] As shown in FIG. 2, the image processing device 10 is roughly divided into a main body 1 (main unit) and an extension device 2 (enhancement unit). The main body 1 has an image processing function (at least one of a function of forming an image and a function of acquiring image data). The "extension device" in this disclosure is a device that is removably connected to the main body 1, and is an enhancement that adds various extension functions to the image processing device. The main body 1 and the extension device 2 are used in a state of being electrically and mechanically connected. That is, the image processing device 10 can realize various extension functions desired by the user by combining the main body 1 with the desired extension device 2 while based on the functions of the main body 1. Specific examples of the extension device 2 include devices such as a stapler, a folding machine, an inserter, a booklet folder, and a mail folder. These extension devices 2 perform post-processing such as stapling on sheets on which an image is formed by the main body 1, for example.

[0015] In the present embodiment, as an example, the image processing device 10 includes a finisher having a function as a stapler as the extended device 2, and further includes any extended device 2 selected from a folder, an inserter, a booklet folder, a mail folder, etc. In other words, the image processing device 10 is capable of connecting one or more extended devices 2 to one main body 1.

[0016] 1, the main body 1 of the image processing device 10 includes an automatic document feeder 11, an image reading unit 12, an image forming unit 13, a paper feed unit 14, a display unit 15, an operation unit 16, a control unit 17, and a storage unit 18. The automatic document feeder 11 is an ADF (Auto Document Feeder), and is therefore written as "ADF" in FIG. 1, and will also be referred to as "ADF 11" in the following description.

[0017] The ADF 11 transports an original document whose image is to be read by the image reading unit 12. The ADF 11 includes an original document setting unit, a plurality of transport rollers, an original document pressing unit, and a paper ejection unit.

[0018] The image reading unit 12 reads an image from a document and outputs image data corresponding to the read image. The image reading unit 12 includes a document table, a light source, a plurality of mirrors, an optical lens, a CCD (Charge Coupled Device), and the like.

[0019] The image forming unit 13 forms an image on a sheet by an electrophotographic method based on image data output from the image reading unit 12. The image forming unit 13 also forms an image on a sheet based on image data input from an information processing device external to the image processing device 10, such as a personal computer. The image forming unit 13 has four image forming units corresponding to four colors, C (cyan), M (magenta), Y (yellow), and K (black), an optical scanning device, an intermediate transfer belt, a secondary transfer roller, a fixing device, and the like. The image forming unit 13 may be configured to form an image on a sheet by an image forming method other than the electrophotographic method, such as an inkjet method, for example.

[0020] The image forming unit 13 forms an image on a sheet using toner as a developer. When the image forming unit 13 forms an image by an inkjet method, ink (another example of a developer) is supplied instead of toner. Examples of toner supplied to the image forming unit 13 include toner of multiple colors, such as C (cyan), M (magenta), Y (yellow), and K (black). After the image is formed in the image forming unit 13, the sheet is discharged (supplied) to an extension device or the like for post-processing.

[0021] The paper feed unit 14 supplies a sheet to the image forming unit 13. The paper feed unit 14 has a paper feed cassette, a manual feed tray, a sheet transport path, a plurality of transport rollers, etc. The image forming unit 13 forms an image on the sheet supplied from the paper feed unit 14. The sheet supplied to the image forming unit 13 is paper as an example, but is not limited to paper and may be, for example, a resin film, etc.

[0022] The display unit 15 is a user interface for presenting (displaying) information to a user in the image processing device 10. The display unit 15 displays various information in response to a control instruction from the control unit 17. As an example in the present embodiment, the display unit 15 includes a liquid crystal display, and displays a display screen including various information on the liquid crystal display.

[0023] The operation unit 16 is, for example, a user interface for accepting operation input by a user to a display screen displayed on the display unit 15. The operation unit 16 accepts various operations by a user, for example, by outputting an electrical signal according to the user's operation. As an example in this embodiment, the operation unit 16 has a switch, a touch panel, or the like.

[0024] Furthermore, the image processing device 10 may include, in addition to or instead of the display unit 15 and the operation unit 16, for example, an audio output unit and an audio input unit, etc., as a user interface.

[0025] The control unit 17 mainly comprises a computer system having one or more processors and one or more memories, and performs overall control of the image processing device 10. In the image processing device 10, the one or more processors execute programs to realize the functions of the control unit 17. In this embodiment, as an example, the control unit 17 includes a CPU (Central Processing Unit).

[0026] The program may be pre-recorded in one or more memories, or may be provided via a telecommunication line such as the Internet, or may be provided by recording it in a non-transitory recording medium readable by a computer system, such as a memory card or an optical disk. The one or more processors are composed of one or more electronic circuits including a semiconductor integrated circuit. Furthermore, the computer system referred to here includes a microcontroller having one or more processors and one or more memories. The control unit 17 may be a control unit provided separately from a main control unit that comprehensively controls the image processing device 10.

[0027] The storage unit 18 includes one or more non-volatile memories, and stores information such as control programs for causing the control unit 17 to execute various processes in advance.

[0028] The image processing device 10 further includes a communication unit and a storage unit, etc. The communication unit is an interface that executes data communication between the image processing device 10 and an external device connected via a communication network such as the Internet or a LAN (Local Area Network).

[0029] [2] Details of the control unit Next, each functional unit included in the control unit 17 will be described in more detail with reference to Fig. 1. The control unit 17 has a display processing unit 171. That is, the image processing device 10 has the display processing unit 171 as one function of the control unit 17.

[0030] The display processing unit 171 executes display processing for displaying various screens on the display unit 15. In this disclosure, a "screen" refers to an image (picture) displayed on the display unit 15, and includes icons, figures, photographs, text, videos, and the like. That is, the display processing unit 171 is capable of generating various screens and displaying them on the display unit 15. Here, when a screen includes a video or the like, the screen does not include a fixed image, but includes an image that changes from moment to moment.

[0031] Here, the display processing unit 171 is configured to display a graphical user interface (GUI) screen on the display unit 15 and to be able to accept user operations on the screen at the operation unit 16. That is, the display processing unit 171 configures a GUI that displays, for example, buttons, figures, icons (images), messages (text), and the like on the screen and accepts operations (including selections) of buttons and the like on the screen. In other words, the display processing unit 171 is a GUI application for embedded devices.

[0032] As an example of the present embodiment, the display unit 15 is integrated with the operation unit 16 and configures a touch panel display together with the operation unit 16. Therefore, the operation unit 16 is configured to be able to accept user operations such as touch (tap), swipe, or drag on the screen displayed on the display unit 15.

[0033] The display processing unit 171 displays on the display unit 15 a screen (GUI screen) for accepting operations for controlling the image processing device 10. As an example, as shown in Fig. 3, a screen G1 displayed on the display unit 15 by the display processing unit 171 includes a plurality of parts P10 to P19. In the present disclosure, a "part" is an object that is arranged and displayed on the screen G1, such as a button, a figure, an icon (image), a message (text), or a combination of these.

[0034] The screen G1 illustrated in FIG. 3 accepts an operation for setting the staple function of the image processing device 10. Specifically, the component P10 is a component that displays a message ("Staple" in FIG. 3) indicating that the screen G1 is a setting screen for the staple function. The component P11 is a button for turning off the staple function. The components P12 to P17 are buttons for setting details of the staple function such as the staple position. The component P18 is a button for applying the setting for the staple function, and the component P19 is a button for canceling the setting for the staple function. When the user operates any of the components P11 to P19 while the screen G1 is displayed on the display unit 15, the control unit 17 activates a function corresponding to the operated component P11 to P19.

[0035] In the drawings showing the screens such as Fig. 3, the dashed lines, leader lines and reference symbols representing areas are merely added for the purpose of explanation and are not actually displayed on the display unit 15. In addition, the design, arrangement and size of objects on the screens described below are merely examples and can be changed as appropriate. Objects or areas on the screens may or may not be clearly separated by boundaries.

[0036] [3] GUI application creation support device Next, a GUI application creation support device (hereinafter, also simply referred to as a "creation support device") 3 that supports the creation of a GUI screen to be displayed on the display unit 15 by the display processing unit 171 will be described with reference to Fig. 4. That is, the creation support device 3 according to this embodiment is used in the creation of a GUI screen such as screen G1 illustrated in Fig. 3, and supports the creation of the GUI screen by a user (operator).

[0037] 3 is developed (created) for each device (image processing device 10 in this embodiment) in which the GUI application is to be installed, depending on the specifications (including configuration and functions) of the device. The created GUI screen is stored in the storage unit 18, for example, and is displayed on the display unit 15 by the display processing unit 171 (control unit 17).

[0038] As a related technique to this type of creation support device, a GUI application creation (development) support device that supports the creation (development) of a Graphical User Interface (GUI) application for embedded devices is known. This GUI application creation support device includes GUI component general-purpose structure data that can be used in a general-purpose programming language, and a GUI screen editing means that uses GUI components included in the GUI component general-purpose structure data to generate a GUI screen as GUI screen structure data that can be used in a general-purpose programming language.

[0039] In the above-mentioned related technologies, when creating a GUI screen, in order to select an appropriate part from a large number of parts, which may amount to several hundred, it is necessary to understand what each part means and in what cases it is used, and depending on the user's level of skill, creating the screen can be difficult.

[0040] In contrast, in this embodiment, a creation support device 3 that allows a user to create a screen more easily, regardless of the user's level of skill, is realized with the configuration described below.

[0041] That is, as shown in Fig. 4, the creation support device 3 according to this embodiment includes a frame designation processing unit 31, a part acquisition processing unit 32, and a screen creation processing unit 33. The frame designation processing unit 31 designates a frame F1 (see Fig. 5). The part acquisition processing unit 32 acquires one or more parts P10 to P19 (see Fig. 3) according to the frame F1. The screen creation processing unit 33 creates a screen G1 (see Fig. 3) by placing one or more parts P10 to P19 on the frame F1 in accordance with the placement conditions for the frame F1.

[0042] In short, the screen creation processing unit 33 that creates a GUI screen such as the screen G1 illustrated in FIG. 3 creates the screen G1 by arranging one or more parts P10-P19 on the frame F1 according to the arrangement conditions for the frame F1. In this way, the screen creation processing unit 33 automatically arranges one or more parts P10-P19 on the frame F1 according to the frame F1, so that the user can reduce the man-hours involved in creating the screen. Therefore, the appropriate parts P10-P19 can be automatically arranged for the frame F1, and even a user who does not understand what each part means and in what cases it is used can create (develop) the screen G1 relatively easily. As a result, it is possible to realize a creation support device 3 that allows the user to create the screen G1 more easily regardless of the user's level of skill.

[0043] As shown in FIG. 4, the creation support device 3 according to this embodiment further includes, in addition to a frame designation processing unit 31, a part acquisition processing unit 32 and a screen creation processing unit 33, a setting value database 34, a frame memory unit 35, a part memory unit 36, a screen data memory unit 37, a specification memory unit 38, a part change processing unit 39, a condition selection processing unit 40 and an operation display unit 41.

[0044] In this embodiment, as an example, the creation support device 3 is mainly composed of a computer system having one or more processors and one or more memories. In the creation support device 3, the one or more processors execute programs to realize the functions of a frame designation processing unit 31, a part acquisition processing unit 32, a screen creation processing unit 33, a setting value database 34, a frame storage unit 35, a part storage unit 36, a screen data storage unit 37, a specification storage unit 38, a part change processing unit 39, and a condition selection processing unit 40.

[0045] The programs executed in the creation support device 3 may be pre-recorded in one or more memories, or may be provided via a telecommunication line such as the Internet, or may be provided by being recorded on a non-transitory recording medium readable by a computer system, such as a memory card or an optical disk. The one or more processors are composed of one or more electronic circuits including a semiconductor integrated circuit. Furthermore, the computer system referred to here includes a microcontroller having one or more processors and one or more memories.

[0046] The frame designation processing unit 31 executes a frame designation process for designating a desired frame F1 in accordance with a user's operation. Specifically, the frame designation processing unit 31 acquires data of the designated frame F1 from the frame storage unit 35. In this disclosure, a "frame" refers to the framework of the screen G1, and includes the arrangement of a plurality of subframes when the screen G1 is divided into a plurality of subframes.

[0047] The part acquisition processing unit 32 executes a part acquisition process to acquire one or more parts such as parts P10 to P19. The part acquisition processing unit 32 acquires one or more parts P10 to P19 according to the frame F1 specified by the frame designation processing unit 31. Specifically, the part acquisition processing unit 32 acquires data of one or more parts P10 to P19 according to the frame F1 from the part storage unit 36.

[0048] The screen creation processing unit 33 executes a screen creation process for creating a GUI screen such as screen G1. The screen creation processing unit 33 creates screen G1 by arranging one or more parts P10-P19 acquired by the part acquisition processing unit 32 on the frame F1 specified by the frame designation processing unit 31. Here, the screen creation processing unit 33 automatically arranges one or more parts P10-P19 on the frame F1 in accordance with the arrangement conditions for the frame F1. The one or more parts P10-P19 acquired by the part acquisition processing unit 32 are also automatically determined in accordance with the arrangement conditions.

[0049] The setting value database 34 is a database that stores setting values ​​related to the placement conditions. That is, the placement conditions used by the part acquisition processing unit 32 when acquiring and by the screen creation processing unit 33 when placing one or more parts P10 to P19 on the frame F1 are determined by referring to the setting value database 34.

[0050] The frame storage unit 35 stores data of a plurality of frames including the above-mentioned frame F1. The data of the plurality of frames is created in advance and written to the frame storage unit 35. The frame data stored in the frame storage unit 35 can be updated at any time.

[0051] The part storage unit 36 ​​stores data on a large number of parts including the above-mentioned parts P10 to P19. The data on a large number of parts is created in advance and written in the part storage unit 36. The part data stored in the part storage unit 36 ​​can be updated at any time.

[0052] The screen data storage unit 37 stores data of a plurality of screens including the screen G1 created by the screen creation processing unit 33. That is, the GUI screen created using the creation support device 3 is stored in the screen data storage unit 37, read out from the screen data storage unit 37, and output appropriately to the image processing device 10, etc.

[0053] The specification storage unit 38 stores data relating to the specifications of each of a plurality of frames (see FIG. 8). The data relating to the specifications of the plurality of frames is created in advance and written to the specification storage unit 38. The data relating to the frame specifications stored in the specification storage unit 38 can be updated at any time.

[0054] The part change processing unit 39 executes part change processing to change the parts placed by the screen creation processing unit 33. The part change processing unit 39 changes at least some of the one or more parts P10 to P19 placed on the frame F1 by the screen creation processing unit 33 to another part as the change target. In this way, while the screen creation processing unit 33 automatically places one or more parts P10 to P19 on the frame F1, it is possible to place desired parts by changing at least some of the parts to another part.

[0055] The condition selection processing unit 40 executes a condition selection process for selecting a placement condition from among a plurality of conditions. That is, the condition selection processing unit 40 can select from a plurality of conditions a placement condition to be used when the screen creation processing unit 33 places one or more parts P10-P19 on the frame F1. This makes it possible to automatically place one or more parts P10-P19 on the frame F1 according to the desired condition.

[0056] The operation display unit 41 is a user interface for presenting (displaying) information to a user and accepting operation input by the user in the creation support device 3. In the present embodiment, as an example, the operation display unit 41 has a display device such as a liquid crystal display, and an operation device such as a switch or a touch panel.

[0057] [4] GUI application creation support method Next, a GUI application creation support method (hereinafter, simply referred to as a "creation support method") executed by the creation support device 3 according to this embodiment will be described with reference to FIGS.

[0058] The GUI application creation support method of this embodiment includes specifying a frame F1, obtaining one or more parts P10-P19 according to the frame F1, and creating a screen G1 by placing the one or more parts P10-P19 on the frame F1 in accordance with placement conditions for the frame F1.

[0059] The procedure for creating a (GUI) screen using the creation support method will be described below with a specific example. The creation support device 3 uses an operation display unit 41 as a user interface to support a user (operator) in creating a GUI screen. The format of the created (GUI) screen is, for example, XML (Extensible Markup Language), but is not limited to this.

[0060] First, the frame designation processing unit 31 obtains data of a desired frame F1 from the frame storage unit 35, and displays the frame F1 on the operation display unit 41, as shown in Fig. 5. The frame storage unit 35 stores data of a plurality of frames with frame names such as "Frame1", "Frame2", "Frame3", ..., and here, as an example, it is assumed that the frame F1 of "Frame2" is designated.

[0061] Frame F1 includes multiple subframes SF1, SF2, and SF3. Subframe SF1 is given the subframe name "Frame2-1," subframe SF2 is given the subframe name "Frame2-2," and subframe SF3 is given the subframe name "Frame2-3." At this time, on the operation display unit 41, only ruled lines separating the multiple subframes SF1, SF2, SF3, etc. are displayed as frame F1, and the subframe names such as "Frame2-1" shown in FIG. 5 are internal values ​​and are not actually displayed on the operation display unit 41.

[0062] Next, the screen creation processing unit 33 requests the parts to be placed in each of the multiple sub-frames SF1, SF2, and SF3 of the frame F1 from the part acquisition processing unit 32. At this time, the part acquisition processing unit 32 refers to the setting value database 34 to confirm the setting values ​​related to the placement conditions. In this embodiment, the placement conditions include two types of placement conditions: a history priority condition and a specification priority condition. Therefore, the setting values ​​related to the placement conditions in the setting value database 34 correspond to either the history priority condition or the specification priority condition. The setting values ​​related to the placement conditions are selected by the condition selection processing unit 40.

[0063] That is, in this embodiment, the placement conditions include a history priority condition based on the use history of parts in frame F1. When a history priority condition is selected as a setting value for the placement conditions, the placement conditions based on the history of placement of parts used in the past in frame F1 are applied, and the parts are placed by the screen creation processing unit 33. As a result, an appropriate placement of parts is applied according to the use history of parts in frame F1, regardless of the specifications of frame F1.

[0064] The placement conditions also include specification priority conditions based on the specifications of frame F1. When specification priority conditions are selected as the setting values ​​for the placement conditions, placement conditions based on the specifications (attributes) of frame F1, such as the shapes, placement, and sizes of subframes SF1, SF2, and SF3, are applied, and the screen creation processing unit 33 places the parts. As a result, an appropriate placement of parts according to the specifications of frame F1 is applied, regardless of the use history of parts in frame F1.

[0065] The part acquisition processing unit 32 checks the setting values ​​for the placement conditions, and acquires data for one or more parts corresponding to the frame F1 from the part storage unit 36 ​​in accordance with the placement conditions, either the history priority condition or the specification priority condition described above.

[0066] When the history priority condition is applied, the parts acquisition processing unit 32 extracts screens G1-G4 in which the specified frame F1 (here, "Frame2") is used, as shown in Fig. 6, from a plurality of screens stored in the screen data storage unit 37. Although four screens G1-G4 are given as an example in Fig. 6, in reality, many more screens are extracted. The parts acquisition processing unit 32 statistically analyzes part placement information, i.e., what parts are placed where in frame F1, from these extracted screens G1-G4, and feeds back parts that match such placement information to the screen creation processing unit 33 together with the placement information.

[0067] In the example of Figure 6, we can see that there are many screens with layout information like the one below. Placement information 1: A button component (ButtonA) is placed on the left edge of subframe SF2 (Frame2-2). Placement information 2: A button component (ButtonB) is placed on the right edge of subframe SF2 (Frame2-2). Placement information 3: A message part (Message) is placed in the center of subframe SF2 (Frame2-2). Layout information 4: A button component (Button C) is placed at the top of subframe SF3 (Frame 2-3), and an average of three button components (Button D) are placed below it.

[0068] Here, the part acquisition processing unit 32 acquires the most frequently used part from the part storage unit 36 ​​based on the above "Layout information 1" to "Layout information 4", and outputs it to the screen creation processing unit 33. At this time, the part acquisition processing unit 32 acquires data on a plurality of parts from the part storage unit 36 ​​in descending order of frequency of use, in addition to the most frequently used part.

[0069] The screen creation processing unit 33 places the parts acquired by the part acquisition processing unit 32 on the frame F1, and creates a screen G5 as shown in Fig. 7. In the screen G5 illustrated in Fig. 7, a part P59 (Button A), a part P50 (Message), and a part P58 (Button B) are arranged in this order from the left in the subframe SF2 (Frame2-2). Also, a part P51 (Button C), a part P52 (Button D), a part P53 (Button D), and a part P54 (Button D) are arranged in this order from the top in the subframe SF3 (Frame2-3). The names of the parts, such as "Button A", are internal values ​​and are not actually displayed on the operation display unit 41.

[0070] On the other hand, when the specification priority condition is applied, the part acquisition processing unit 32 reads out data on the specifications of the specified frame F1 (here, "Frame2") as shown in Fig. 8 from data on the specifications of multiple frames stored in the specification storage unit 38. In Fig. 8, as an example, the following specifications are defined for subframe SF1 (Frame2-1): "No parts are placed," for subframe SF2 (Frame2-2): "The height of the parts is equal to the height of Frame2-2," and for subframe SF3 (Frame2-3): "The width of all parts is equal to the width of Frame2-3."

[0071] Here, the part acquisition processing unit 32 acquires a part from the part storage unit 36 ​​based on the specifications of the above-mentioned frame F1, and outputs it to the screen creation processing unit 33. If there are multiple parts that match the specifications, the part acquisition processing unit 32 further acquires from the part storage unit 36 ​​one part that is selected according to a specific condition (for example, old creation date and time, etc.).

[0072] The screen creation processing unit 33 places the parts acquired by the part acquisition processing unit 32 in the frame F1, and creates a screen G6 as shown in Fig. 9. In the screen G6 illustrated in Fig. 9, a part P69 (Button A), a part P60 (Message), and a part P68 (Button B) are arranged in this order from the left in the subframe SF2 (Frame2-2). Also, a part P61 (Button C) and a part P62 (Button D) are arranged in this order from the top in the subframe SF3 (Frame2-3). The names of the parts, such as "Button A", are internal values ​​and are not actually displayed on the operation display unit 41.

[0073] After the screen G6 is created by the screen creation processing unit 33, when the user selects any part on the screen G6, parts that are candidates to be placed on the screen G6 in place of the selected part are displayed on the operation display unit 41. As an example, as shown in Fig. 10, when the user performs an operation to select a part P61 (Button C) on the screen G6 displayed on the operation display unit 41, the part P61 is selected as a change target, and parts P63 (Button D) and P64 (Button E) that are candidates (change candidates) to be placed in place of the part P61 are displayed on the operation display unit 41. As an example in Fig. 10, a candidate screen G60 including a plurality of change candidate parts P63 and P64 is displayed as a pop-up on the screen G6.

[0074] When the user selects any part on the candidate screen G60, the change target is replaced with the selected part on the screen G6. As an example, when the user performs an operation to select a part P63 (Button D) on the candidate screen G60 of Fig. 10, a screen G6 in which the part P61 (Button C) as the change target is replaced with the selected part P63 is displayed on the operation display unit 41, as shown in Fig. 11. Such a part change process can be performed not only on the screen G6 shown in Fig. 9, but also on the screen G5 shown in Fig. 7, for example.

[0075] In this way, when the user selects at least some of the one or more parts placed by the screen creation processing unit 33 as the part to be changed, the part change processing unit 39 presents (for example, displays) parts that are candidates for the part to be changed. This allows the user to confirm the part to be placed in place of the part to be changed simply by selecting the part to be changed.

[0076] Furthermore, the part change processing unit 39 presents (for example, displays) a plurality of parts that are candidates for change, and changes the change target to one part selected by the user from the plurality of parts that are candidates for change. This allows the user to change the change target to an arbitrary part by simply selecting the part from the plurality of parts that are candidates for change.

[0077] Finally, screen creation processing unit 33 stores (preserves) the data of the completed screen in screen data storage unit 37.

[0078] Hereinafter, an example of the operation of the creation support device 3 according to this embodiment will be described with reference to Fig. 12. Here, steps S1, S2, etc. in the flowchart shown in Fig. 12 each indicate the number of a processing procedure (step) executed by the creation support device 3.

[0079] <Steps S1 and S2> In step S1, the frame designation processing unit 31 acquires data of the desired frame F1 from the frame storage unit 35 in accordance with a user's operation. In step S2, the parts acquisition processing unit 32, which has been requested by the screen creation processing unit 33 to designate parts in a frame, refers to the setting value database 34 to confirm whether the current setting values ​​are history priority conditions or specification priority conditions. If the history priority condition is set (S2: Yes), the parts acquisition processing unit 32 shifts the process to step S3. On the other hand, if the specification priority condition is set (S2: No), the parts acquisition processing unit 32 shifts the process to step S4.

[0080] <Steps S3 and S4> In step S3, the part acquisition processing unit 32 statistically analyzes part placement information, such as what parts are placed where in the frame, from multiple screens stored in the screen data storage unit 37, and acquires frequently used parts from the part storage unit 36. Meanwhile, in step S4, the part acquisition processing unit 32 refers to data related to frame specifications stored in the specification storage unit 38, and acquires parts that match the specified frame specifications from the part storage unit 36.

[0081] <Steps S5 and S6> In step S5, the screen creation processing unit 33 places the parts acquired by the part acquisition processing unit 32 on a frame to create a screen. In step S6, the part change processing unit 39 determines whether or not a user operation for changing a part is performed on the screen created by the screen creation processing unit 33. If a part is to be changed (S6: Yes), the part change processing unit 39 shifts the process to step S7. On the other hand, if a part is not to be changed (S6: No), the part change processing unit 39 skips step S7 and shifts the process to step S8.

[0082] <Steps S7 and S8> In step S7, the part change processing unit 39 displays a candidate screen including a plurality of change candidate parts corresponding to the part selected as the change target. Then, when a user operation to select one of the change candidates on the candidate screen is accepted, the part change processing unit 39 changes (replaces) the part to be changed to the change candidate. In step S8, the screen creation processing unit 33 stores (saves) the data of the completed screen in the screen data storage unit 37.

[0083] The procedure described above is merely an example, and the order of the processes shown in the flowchart of FIG. 12 may be changed as appropriate.

[0084] [5] Variations The multiple components included in the creation support device 3 may be distributed across multiple housings. For example, at least one of the frame designation processing unit 31, the part acquisition processing unit 32, the screen creation processing unit 33, and the setting value database 34 may be provided separately.

[0085] Furthermore, the display unit 15 is not limited to a liquid crystal display, and may include a display such as electronic paper or a projector instead of or in addition to an organic EL display.

[0086] Furthermore, the GUI screen created using the creation support device 3 of this embodiment is not limited to being used for the image processing device 10, and may be used for various devices (including devices, equipment, and systems) other than the image processing device 10.

[0087] [Appendix to the invention] The following will provide an overview of the invention extracted from the above-described embodiment. Note that the configurations and processing functions described in the following supplementary notes can be selected and combined as desired.

[0088] <Appendix 1> a frame designation processing unit that designates a frame; a part acquisition processing unit that acquires one or more parts according to the frame; a screen creation processing unit that creates a screen by placing the one or more components on the frame in accordance with a placement condition for the frame. A GUI application creation support device.

[0089] <Appendix 2> a part change processing unit that changes at least a part of the one or more parts arranged on the frame by the screen creation processing unit to another part as a change target, 2. A GUI application creation support device according to claim 1.

[0090] <Appendix 3> the part change processing unit, when at least a part of the one or more parts arranged by the screen creation processing unit is selected by a user as a change target, presents parts that are change candidates for the change target; 3. A GUI application creation support device as described in appendix 2.

[0091] <Appendix 4> the part change processing unit presents a plurality of parts as change candidates, and changes the change target to one part selected by a user from the plurality of parts as change candidates. 4. A GUI application creation support device according to claim 3.

[0092] <Appendix 5> the placement condition includes a history priority condition based on a usage history of a part in the frame; 5. A GUI application creation support device according to any one of claims 1 to 4.

[0093] <Appendix 6> the placement conditions include specification priority conditions based on specifications of the frame; 6. A GUI application creation support device according to any one of appendixes 1 to 5.

[0094] <Appendix 7> Further comprising a condition selection processing unit that selects the placement condition from a plurality of conditions. 7. A GUI application creation support device according to any one of claims 1 to 6. [Explanation of symbols]

[0095] 3. GUI Application Creation Support Device 31 Frame specification processing section 32 Parts acquisition processing unit 33 Screen creation processing section 39 Parts change processing section 40 Condition selection processing section F1 Frame G1~G6 screen P10~P19, P50~P59, P60~P69 Parts

Claims

1. a frame designation processing unit that designates a frame; a part acquisition processing unit that acquires one or more parts according to the frame; a screen creation processing unit that creates a screen by arranging the one or more parts on the frame in accordance with an arrangement condition for the frame, GUI application creation support device.

2. a part change processing unit that changes at least a part of the one or more parts arranged on the frame by the screen creation processing unit to another part as a change target, 2. The GUI application creation support device according to claim 1.

3. the part change processing unit, when at least a part of the one or more parts arranged by the screen creation processing unit is selected by a user as a change target, presents parts that are change candidates for the change target; 3. The GUI application creation support device according to claim 2.

4. the part change processing unit presents a plurality of parts as change candidates, and changes the change target to one part selected by a user from the plurality of parts as change candidates.

4. The GUI application creation support device according to claim 3.

5. the placement condition includes a history priority condition based on a usage history of a part in the frame; 5. The GUI application creation support device according to claim 1.

6. the placement conditions include specification priority conditions based on specifications of the frame; 5. The GUI application creation support device according to claim 1.

7. Further comprising a condition selection processing unit that selects the placement condition from a plurality of conditions.

5. The GUI application creation support device according to claim 1.

8. Specifying a frame; obtaining one or more parts according to the frame; creating a screen by arranging the one or more parts on the frame in accordance with an arrangement condition for the frame; A method for supporting the creation of GUI applications.

9. Specifying a frame; obtaining one or more parts according to the frame; creating a screen by arranging the one or more components on the frame in accordance with an arrangement condition for the frame; A program for executing the above on one or more processors.

Images