GUI application creation support apparatus, GUI application creation support method, and program

The GUI application creation support device addresses the inefficiency of creating multiple screens by using an acquisition and screen creation processing unit to generate screens with varying sizes and aspect ratios from a common data set, thereby reducing development time.

JP2025016037APending Publication Date: 2025-01-31KYOCERA DOCUMENT SOLUTIONS INC
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023119043
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-07-21
Publication Date
2025-01-31

AI Technical Summary

Technical Problem

Existing GUI application creation support devices require significant time to create multiple screens with different sizes, as they are typically created one at a time, leading to inefficiencies in the development process.

Method used

The GUI application creation support device employs an acquisition processing unit to obtain common screen data and a screen creation processing unit that generates multiple individual screens with varying sizes and aspect ratios from a single common screen data set, allowing simultaneous creation of these screens.

Benefits of technology

This approach significantly reduces the time required to create multiple screens by enabling the simultaneous generation of GUI screens with different sizes and aspect ratios, enhancing efficiency in the development process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025016037000001_ABST
    Figure 2025016037000001_ABST
Patent Text Reader

Abstract

To provide a GUI application creation support apparatus, a GUI application creation support method, and a program with which the time required for creating a plurality of screens can be easily reduced.SOLUTION: A GUI application creation support apparatus 3 includes an acquisition processing unit and a screen creation processing unit. The acquisition processing unit acquires common screen data Dc1 including information on one or more components P1 to be arranged on a frame F1. The screen creation processing unit collectively creates, from one piece of common screen data Dc1, a plurality of individual screens G11, G12 different in size and aspect ratio. The plurality of individual screens G11, G12 are screens each formed by arranging the one or more components P1 on the frame F1.SELECTED DRAWING: Figure 6
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a GUI application creation support device, a GUI application creation support method, and a program. [Background technology]

[0002] As a related technique, a GUI application creation support device (source code generation device) that supports the creation (development) of graphical user interface (GUI) applications for embedded devices is known (see, for example, Patent Document 1). This GUI application creation support device edits screen designs that correspond to a plurality of different execution environments of a computer, generates GUI display data, and generates source code that uses the GUI display data to display a GUI display screen. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2008-269554 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the above-mentioned related technology, for example, when creating multiple screens (GUI display screens) of different sizes, one screen is created and then another screen is created, which can take time to create these multiple screens.

[0005] An object of the present invention is to provide a GUI application creation support device, a GUI application creation support method, and a program that can easily reduce the time required to create a plurality of screens. [Means for solving the problem]

[0006] A GUI application creation support device according to one aspect of the present invention includes an acquisition processing unit and a screen creation processing unit. The acquisition processing unit acquires common screen data including information about one or more components arranged on a frame. The screen creation processing unit collectively creates a plurality of individual screens, each differing from the other in at least one of size and aspect ratio, from one of the common screen data. Each of the plurality of individual screens is a screen formed by arranging the one or more components on the frame.

[0007] A method for supporting creation of a GUI application according to another aspect of the present invention includes: acquiring common screen data including information on one or more components to be arranged on a frame; and collectively creating, from the common screen data, a plurality of individual screens differing from each other in at least one of size and aspect ratio, each of the plurality of individual screens being formed by arranging the one or more components on the frame.

[0008] A program according to another aspect of the present invention is a program for causing one or more processors to execute the following steps: acquiring common screen data including information on one or more parts to be arranged on a frame; and collectively creating, from one of the common screen data, a plurality of individual screens differing from each other in at least one of size and aspect ratio. Each of the plurality of individual screens is a screen formed by arranging the one or more parts on the frame. Effect of the Invention

[0009] According to the present invention, it is possible to provide a GUI application creation support device, a GUI application creation support method, and a program that can easily reduce the time required to create a plurality of screens. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a schematic block diagram of an image processing device according to the first embodiment. [Diagram 2] FIG. 2 is a schematic diagram showing the appearance of the image processing device according to the first embodiment. [Diagram 3] FIG. 3 is a schematic diagram showing an example of a screen displayed on the display unit of the image processing device according to the first embodiment. [Figure 4] FIG. 4 is a schematic block diagram of the GUI application creation support device according to the first embodiment. [Diagram 5] FIG. 5 is a schematic diagram showing an example of a frame used in the GUI application creation support device according to the first embodiment. [Figure 6] FIG. 6 is a schematic diagram showing an example of a screen displayed on the GUI application creation support device according to the first embodiment. [Figure 7] FIG. 7 is a schematic diagram showing an example of a frame used in the GUI application creation support device according to the first embodiment. [Figure 8] FIG. 8 is an explanatory diagram illustrating an example of common screen data used in the GUI application creation support device according to the first embodiment. [Figure 9] FIG. 9 is an explanatory diagram showing an example of creating individual screen data using a screen data conversion program in the GUI application creation support device according to the first embodiment. [Figure 10] FIG. 10 is an explanatory diagram showing an example of creating individual screen data using a screen data conversion program in the GUI application creation support device according to the first embodiment. [Figure 11] FIG. 11 is a schematic diagram showing an example of an individual screen created by the GUI application creation support device according to the first embodiment. [Figure 12] FIG. 12 is an explanatory diagram showing an example of correction of the screen data conversion program in the GUI application creation support device according to the first embodiment. [Figure 13] FIG. 13 is a flowchart illustrating an example of the operation of the GUI application creation support device according to the first embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. The following embodiment is an example of the present invention, and is not intended to limit the technical scope of the present invention.

[0012] (Embodiment 1) [1] Overall configuration of image processing device First, the overall configuration of an image processing device 10 according to this embodiment will be described with reference to FIGS.

[0013] The image processing device 10 according to the present embodiment is, for example, a multifunction device having multiple functions such as a scanning function for acquiring image data from an original, a printing function for forming an image based on image data, a facsimile function, and a copy function. The image processing device 10 only needs to have an image processing function including at least one of a function for forming an image and a function for acquiring image data, and may be a printer, a scanner, a facsimile machine, a copy machine, or the like.

[0014] As shown in FIG. 2, the image processing device 10 is roughly divided into a main body 1 (main unit) and an extension device 2 (enhancement unit). The main body 1 has an image processing function (at least one of a function of forming an image and a function of acquiring image data). The "extension device" in this disclosure is a device that is removably connected to the main body 1, and is an enhancement that adds various extension functions to the image processing device. The main body 1 and the extension device 2 are used in a state of being electrically and mechanically connected. That is, the image processing device 10 can realize various extension functions desired by the user by combining the main body 1 with the desired extension device 2 while based on the functions of the main body 1. Specific examples of the extension device 2 include devices such as a stapler, a folding machine, an inserter, a booklet folder, and a mail folder. These extension devices 2 perform post-processing such as stapling on sheets on which an image is formed by the main body 1, for example.

[0015] In the present embodiment, as an example, the image processing device 10 includes a finisher having a function as a stapler as the extended device 2, and further includes any extended device 2 selected from a folder, an inserter, a booklet folder, a mail folder, etc. In other words, the image processing device 10 is capable of connecting one or more extended devices 2 to one main body 1.

[0016] 1, the main body 1 of the image processing device 10 includes an automatic document feeder 11, an image reading unit 12, an image forming unit 13, a paper feed unit 14, a display unit 15, an operation unit 16, a control unit 17, and a storage unit 18. The automatic document feeder 11 is an ADF (Auto Document Feeder), and is therefore written as "ADF" in FIG. 1, and will also be referred to as "ADF 11" in the following description.

[0017] The ADF 11 transports an original document whose image is to be read by the image reading unit 12. The ADF 11 includes an original document setting unit, a plurality of transport rollers, an original document pressing unit, and a paper ejection unit.

[0018] The image reading unit 12 reads an image from a document and outputs image data corresponding to the read image. The image reading unit 12 includes a document table, a light source, a plurality of mirrors, an optical lens, a CCD (Charge Coupled Device), and the like.

[0019] The image forming unit 13 forms an image on a sheet by an electrophotographic method based on image data output from the image reading unit 12. The image forming unit 13 also forms an image on a sheet based on image data input from an information processing device external to the image processing device 10, such as a personal computer. The image forming unit 13 has four image forming units corresponding to four colors, C (cyan), M (magenta), Y (yellow), and K (black), an optical scanning device, an intermediate transfer belt, a secondary transfer roller, a fixing device, and the like. The image forming unit 13 may be configured to form an image on a sheet by an image forming method other than the electrophotographic method, such as an inkjet method, for example.

[0020] The image forming unit 13 forms an image on a sheet using toner as a developer. When the image forming unit 13 forms an image by an inkjet method, ink (another example of a developer) is supplied instead of toner. Examples of toner supplied to the image forming unit 13 include toner of multiple colors, such as C (cyan), M (magenta), Y (yellow), and K (black). After the image is formed in the image forming unit 13, the sheet is discharged (supplied) to an extension device or the like for post-processing.

[0021] The paper feed unit 14 supplies a sheet to the image forming unit 13. The paper feed unit 14 has a paper feed cassette, a manual feed tray, a sheet transport path, a plurality of transport rollers, etc. The image forming unit 13 forms an image on the sheet supplied from the paper feed unit 14. The sheet supplied to the image forming unit 13 is paper as an example, but is not limited to paper and may be, for example, a resin film, etc.

[0022] The display unit 15 is a user interface for presenting (displaying) information to a user in the image processing device 10. The display unit 15 displays various information in response to a control instruction from the control unit 17. As an example in the present embodiment, the display unit 15 includes a liquid crystal display, and displays a display screen including various information on the liquid crystal display.

[0023] The operation unit 16 is, for example, a user interface for accepting operation input by a user to a display screen displayed on the display unit 15. The operation unit 16 accepts various operations by a user, for example, by outputting an electrical signal according to the user's operation. As an example in this embodiment, the operation unit 16 has a switch, a touch panel, or the like.

[0024] Furthermore, the image processing device 10 may include, in addition to or instead of the display unit 15 and the operation unit 16, for example, an audio output unit and an audio input unit, etc., as a user interface.

[0025] The control unit 17 mainly comprises a computer system having one or more processors and one or more memories, and performs overall control of the image processing device 10. In the image processing device 10, the one or more processors execute programs to realize the functions of the control unit 17. In this embodiment, as an example, the control unit 17 includes a CPU (Central Processing Unit).

[0026] The program may be pre-recorded in one or more memories, or may be provided via a telecommunication line such as the Internet, or may be provided by recording it in a non-transitory recording medium readable by a computer system, such as a memory card or an optical disk. The one or more processors are composed of one or more electronic circuits including a semiconductor integrated circuit. Furthermore, the computer system referred to here includes a microcontroller having one or more processors and one or more memories. The control unit 17 may be a control unit provided separately from a main control unit that comprehensively controls the image processing device 10.

[0027] The storage unit 18 includes one or more non-volatile memories, and stores information such as control programs for causing the control unit 17 to execute various processes in advance.

[0028] The image processing device 10 further includes a communication unit and a storage unit, etc. The communication unit is an interface that executes data communication between the image processing device 10 and an external device connected via a communication network such as the Internet or a LAN (Local Area Network).

[0029] [2] Details of the control unit Next, each functional unit included in the control unit 17 will be described in more detail with reference to Fig. 1. The control unit 17 has a display processing unit 171. That is, the image processing device 10 has the display processing unit 171 as one function of the control unit 17.

[0030] The display processing unit 171 executes display processing for displaying various screens on the display unit 15. In this disclosure, a "screen" refers to an image (picture) displayed on the display unit 15, and includes icons, figures, photographs, text, videos, and the like. That is, the display processing unit 171 is capable of generating various screens and displaying them on the display unit 15. Here, when a screen includes a video or the like, the screen does not include a fixed image, but includes an image that changes from moment to moment.

[0031] Here, the display processing unit 171 is configured to display a graphical user interface (GUI) screen on the display unit 15 and to be able to accept user operations on the screen at the operation unit 16. That is, the display processing unit 171 configures a GUI that displays, for example, buttons, figures, icons (images), messages (text), and the like on the screen and accepts operations (including selections) of buttons and the like on the screen. In other words, the display processing unit 171 is a GUI application for embedded devices.

[0032] As an example of the present embodiment, the display unit 15 is integrated with the operation unit 16 and configures a touch panel display together with the operation unit 16. Therefore, the operation unit 16 is configured to be able to accept user operations such as touch (tap), swipe, or drag on the screen displayed on the display unit 15.

[0033] The display processing unit 171 displays on the display unit 15 a screen (GUI screen) for accepting operations for controlling the image processing device 10. As an example, as shown in Fig. 3, a screen G1 displayed on the display unit 15 by the display processing unit 171 includes a plurality of parts P10 to P19. In the present disclosure, a "part" is an object that is arranged and displayed on the screen G1, such as a button, a figure, an icon (image), a message (text), or a combination of these.

[0034] The screen G1 illustrated in FIG. 3 accepts an operation for setting the staple function of the image processing device 10. Specifically, the component P10 is a component that displays a message ("Staple" in FIG. 3) indicating that the screen G1 is a setting screen for the staple function. The component P11 is a button for turning off the staple function. The components P12 to P17 are buttons for setting details of the staple function such as the staple position. The component P18 is a button for applying the setting for the staple function, and the component P19 is a button for canceling the setting for the staple function. When the user operates any of the components P11 to P19 while the screen G1 is displayed on the display unit 15, the control unit 17 activates a function corresponding to the operated component P11 to P19.

[0035] In the drawings showing the screens such as Fig. 3, the dashed lines, leader lines and reference symbols representing areas are merely added for the purpose of explanation and are not actually displayed on the display unit 15. In addition, the design, arrangement and size of objects on the screens described below are merely examples and can be changed as appropriate. Objects or areas on the screens may or may not be clearly separated by boundaries.

[0036] [3] GUI application creation support device Next, a GUI application creation support device (hereinafter, also simply referred to as a "creation support device") 3 that supports the creation of a GUI screen to be displayed on the display unit 15 by the display processing unit 171 will be described with reference to Fig. 4. That is, the creation support device 3 according to this embodiment is used in the creation of a GUI screen such as screen G1 illustrated in Fig. 3, and supports the creation of the GUI screen by a user (operator).

[0037] 3 is developed (created) for each device (image processing device 10 in this embodiment) in which the GUI application is to be installed, depending on the specifications (including configuration and functions) of the device. The created GUI screen is stored in the storage unit 18, for example, and is displayed on the display unit 15 by the display processing unit 171 (control unit 17).

[0038] As a related technique to this type of creation support device, a GUI application creation support device (source code generation device) that supports the creation (development) of Graphical User Interface (GUI) applications for embedded devices is known. This GUI application creation support device edits screen designs that correspond to a number of different execution environments of a computer, generates GUI display data, and generates source code that uses the GUI display data to display a GUI display screen.

[0039] In the above-mentioned related technology, for example, when creating multiple screens (GUI display screens) of different sizes, one screen is created and then another screen is created, which can take time to create these multiple screens.

[0040] In contrast, in this embodiment, a creation support device 3 that can easily reduce the time required to create multiple screens is realized by using the configuration described below.

[0041] That is, the creation support device 3 according to this embodiment includes an acquisition processing unit 32 and a screen creation processing unit 33, as shown in Fig. 4. The acquisition processing unit 32 acquires common screen data Dc1 (see Fig. 6) including information about one or more parts P1 (see Fig. 3) arranged on a frame F1 (see Fig. 5). The screen creation processing unit 33 collectively creates a plurality of individual screens G11, G12 (see Fig. 6) that differ from each other in at least one of size and aspect ratio from one common screen data Dc1. Each of the plurality of individual screens G11, G12 is a screen formed by arranging one or more parts P1 on a frame F1.

[0042] The "size and aspect ratio" here refers to the size and aspect ratio of the individual screens G11, G12, which are GUI screens. In other words, the display unit 15 on which the individual screens G11, G12 are displayed has display areas of various sizes and aspect ratios. Therefore, for example, a plurality of individual screens G11, G12 are created as GUI screens corresponding to the display unit 15 having display areas of different sizes.

[0043] In short, the screen creation processing unit 33 that creates GUI screens such as the screen G1 illustrated in Fig. 3 collectively creates multiple individual screens G11, G12 that differ from each other in at least one of size and aspect ratio from a single common screen data Dc1. This makes it possible to simultaneously create (develop) GUI screens (individual screens G11, G12) for multiple display units 15 that differ from each other in at least one of size and aspect ratio of the display area. As a result, it is possible to realize a creation support device 3 that can easily shorten the time required to create multiple screens (individual screens G11, G12).

[0044] As shown in FIG. 4, the creation support device 3 according to this embodiment further includes, in addition to the acquisition processing unit 32 and the screen creation processing unit 33, a screen designation processing unit 31, a presentation processing unit 34, an error detection unit 35, a correction processing unit 36, a screen data memory unit 37, and an operation display unit 41.

[0045] In this embodiment, as an example, the creation support device 3 is mainly composed of a computer system having one or more processors and one or more memories. In the creation support device 3, the one or more processors execute programs to realize the functions of a screen designation processing unit 31, an acquisition processing unit 32, a screen creation processing unit 33, a presentation processing unit 34, an error detection unit 35, a correction processing unit 36, a screen data storage unit 37, and an operation display unit 41.

[0046] The programs executed in the creation support device 3 may be pre-recorded in one or more memories, or may be provided via a telecommunication line such as the Internet, or may be provided by being recorded on a non-transitory recording medium readable by a computer system, such as a memory card or an optical disk. The one or more processors are composed of one or more electronic circuits including a semiconductor integrated circuit. Furthermore, the computer system referred to here includes a microcontroller having one or more processors and one or more memories.

[0047] The screen designation processing unit 31 executes a screen designation process for designating a desired screen size and aspect ratio in accordance with a user operation. Specifically, the screen designation processing unit 31 outputs the designated screen size and aspect ratio to the screen creation processing unit 33.

[0048] The acquisition processing unit 32 executes an acquisition process to acquire common screen data Dc1. The common screen data Dc1 is data including information on at least one part P1 arranged on the frame F1. The acquisition processing unit 32 acquires the desired common screen data Dc1 in accordance with a user's operation.

[0049] The screen creation processing unit 33 executes a screen creation process for creating GUI screens such as the screen G1, etc. The screen creation processing unit 33 creates the screen G1 by placing one or more parts P1 on the frame F1.

[0050] Here, the screen creation processing unit 33 can collectively create a plurality of individual screens G11, G12, which are different from each other in at least one of size and aspect ratio, from one common screen data Dc1. That is, when a plurality of screen sizes and aspect ratios are specified by the screen specification processing unit 31, the screen creation processing unit 33 can create the individual screens G11, G12 for each specified size and aspect ratio. Specifically, the screen creation processing unit 33 creates the individual screens G11, G12 by converting the common screen data Dc1 read from the screen data storage unit 37 according to a screen data conversion program for each screen size and aspect ratio.

[0051] The presentation processing unit 34 executes a presentation process for presenting the multiple individual screens G11, G12 created by the screen creation processing unit 33. Examples of the presentation by the presentation processing unit 34 include displaying on the operation display unit 41, printing, and transmitting to another terminal. In this embodiment, the presentation processing unit 34 presents the individual screens G11, G12 by displaying them on the operation display unit 41. This allows the user to check the multiple individual screens G11, G12 created by the screen creation processing unit 33.

[0052] The error detection unit 35 executes an error detection process that detects the presence or absence of an error in each of the multiple individual screens G11, G12, and notifies the user of the detection result at least when an error is present. In other words, when an error occurs in the multiple individual screens G11, G12 created by the screen creation processing unit 33, the error detection unit 35 detects the error and notifies the user. This allows the user to know the presence or absence of an error in the multiple individual screens G11, G12 created by the screen creation processing unit 33.

[0053] The correction processing unit 36 ​​executes a correction process for correcting the location where the error has occurred at least when an error exists. In other words, when an error has occurred in the multiple individual screens G11, G12 created by the screen creation processing unit 33, the correction processing unit 36 ​​appropriately corrects the location where the error has occurred, thereby eliminating the error. This allows the user to eliminate the error when an error has occurred in the multiple individual screens G11, G12.

[0054] The screen data storage unit 37 stores a plurality of common screen data Dc1. The plurality of common screen data Dc1 are created in advance and written in the screen data storage unit 37. The common screen data Dc1 stored in the screen data storage unit 37 can be updated at any time. Furthermore, the screen data storage unit 37 stores data of a plurality of screens including the screen G1 created by the screen creation processing unit 33. That is, the GUI screen created using the creation support device 3 is stored in the screen data storage unit 37, read out from the screen data storage unit 37, and output appropriately to the image processing device 10, etc.

[0055] The operation display unit 41 is a user interface for presenting (displaying) information to a user and accepting operation input by the user in the creation support device 3. In the present embodiment, as an example, the operation display unit 41 has a display device such as a liquid crystal display, and an operation device such as a switch or a touch panel.

[0056] [4] GUI application creation support method Next, a GUI application creation support method (hereinafter, simply referred to as a "creation support method") executed by the creation support device 3 according to this embodiment will be described with reference to FIGS.

[0057] The GUI application creation support method according to this embodiment includes acquiring common screen data Dc1 including information on one or more parts P1 arranged on a frame F1, and collectively creating a plurality of individual screens G11, G12, which are different from each other in at least one of size and aspect ratio, from the common screen data Dc1. Here, the plurality of individual screens G11, G12 are each a screen formed by arranging one or more parts P1 on the frame F1.

[0058] The procedure for creating a (GUI) screen using the creation support method will be described below with a specific example. The creation support device 3 uses an operation display unit 41 as a user interface to support a user (operator) in creating a GUI screen. The format of the created (GUI) screen is, for example, XML (Extensible Markup Language), but is not limited to this.

[0059] First, as a premise, various screens G1 such as individual screens G11, G12 created by the screen creation processing unit 33 are configured by arranging one or more parts P1 on a frame F1 as exemplified in Fig. 5. In this disclosure, the term "frame" means the framework of the screen G1, and includes the arrangement of multiple subframes when the screen G1 is divided into multiple subframes.

[0060] Frame F1 includes multiple subframes SF1, SF2, and SF3. Subframe SF1 is given the subframe name "Frame1", subframe SF2 is given the subframe name "Frame2", and subframe SF3 is given the subframe name "Frame3". Here, the frame F1 of the created screen G1 only displays ruled lines separating the multiple subframes SF1, SF2, SF3, etc., and the subframe names such as "Frame1" shown in Fig. 5 are internal values ​​and are not actually displayed.

[0061] The creation support method will be described below with specific examples. Here, a case where two individual screens G11 and G12 with different sizes and aspect ratios are created will be illustrated. That is, the screen designation processing unit 31 outputs the sizes and aspect ratios of two types of screens (referred to as "screen 1" and "screen 2") to the screen creation processing unit 33.

[0062] The acquisition processing unit 32 of the creation support device 3 reads out one common screen data Dc1 from the screen data storage unit 37, and the screen creation processing unit 33 converts the one common screen data Dc1 according to the screen size and aspect ratio in accordance with the screen data conversion program Pg1 (see FIG. 9), thereby creating individual screens G11, G12 in a lump. At this time, the presentation processing unit 34 displays, on the operation display unit 41, the common screen data Dc1, the individual screen data Di1, Di2 for each screen ("screen 1" and "screen 2") created based on the common screen data Dc1, and the individual screens G11, G12 which are the rendering results of the individual screen data Di1, Di2, as shown in FIG.

[0063] That is, the screen creation processing unit 33 simultaneously creates individual screen data Di1 for "screen 1" and individual screen data Di2 for "screen 2" based on one common screen data Dc1. Furthermore, the presentation processing unit 34 draws an individual screen G11 for "screen 1" by arranging one or more parts P1 on the frame F1 according to the individual screen data Di1. Similarly, the presentation processing unit 34 draws an individual screen G12 for "screen 2" by arranging one or more parts P1 on the frame F1 according to the individual screen data Di2.

[0064] Here, the individual screen data Di1, Di2 constituting the individual screens G11, G12 are generated collectively from the common screen data Dc1 by the screen data conversion program Pg1, so that the individual screens G11, G12 are simultaneously created from the common screen data Dc1.

[0065] Here, the size of the frame F1 in which the component P1 is arranged is fixed for each screen, as shown in Fig. 7. That is, the size and aspect ratio of the frame F11 of the individual screen G11 for "screen 1" are determined according to the size and aspect ratio of "screen 1". On the other hand, the size and aspect ratio of the frame F12 of the individual screen G12 for "screen 2" are determined according to the size and aspect ratio of "screen 2". Therefore, the shape and arrangement of the multiple sub-frames SF1, SF2, and SF3 are different between the frame F11 of the individual screen G11 and the frame F12 of the individual screen G12.

[0066] Here, when one part P1 is focused on in the common screen data Dc1, it is described as shown in FIG.

[0067] The upper part of FIG. 8 illustrates an example of the description of a part P11 (see FIG. 6) written as "2 in 1." The "Width" item in the description of the common screen data Dc1 is set to "same_as_frame." This means that the width of the part P11 is to be the same as the width of the sub-frame SF3 in which the part P11 is placed. Therefore, if the width of the sub-frame SF3 shown in FIG. 7 is applied, in the example of FIG. 8, the width of the part P11 will be "428" on the individual screen G11 for "Screen 1" (Screen1) and "255" on the individual screen G12 for "Screen 2" (Screen2).

[0068] The lower part of FIG. 8 illustrates an example of the description of a component P13 (see FIG. 6) that is written as "OK." The "ComponentKind" item in that description of the common screen data Dc1 is set to the component name "Button_ok." In that description, the component name (Button_ok) also appears in other items. In such a case, when converting the common screen data Dc1 into the individual screen data Di1, Di2, that is, when creating the individual screens G11, G12, the screen creation processing unit 33 performs dedicated processing for that component P13.

[0069] Then, the screen creation processing unit 33 creates the individual screen data Di1, Di2 according to a screen data conversion program Pg1 as shown in Fig. 9. Specifically, the screen creation processing unit 33 first performs case classification based on the type of screen (size and aspect ratio) according to the screen data conversion program Pg1, and then performs case classification based on the type of part P1 to set parameters. Fig. 9 shows an example of an excerpt from the screen data conversion program Pg1 and a description of the part P13 in the individual screen data Di1, Di2 created thereby.

[0070] The error detection unit 35 checks the presence or absence of errors in the individual screen data Di1, Di2 created in this manner. If there are no errors, the presentation processing unit 34 displays the individual screens G11, G12 drawn in accordance with the individual screen data Di1, Di2 on the operation display unit 41 without processing (see FIG. 6). On the other hand, if there is an error, the error detection unit 35 processes the drawing results of the individual screen data Di1, Di2 so that the location of the error can be identified, and causes the presentation processing unit 34 to display the processed individual screens G11, G12 on the operation display unit 41 (see FIG. 11).

[0071] For example, assume that the screen creation processing unit 33 creates individual screen data Di1 and Di2 according to a screen data conversion program Pg1 as exemplified in Fig. 10. Fig. 10 shows an example of an excerpt from the screen data conversion program Pg1 and a description of a part P13 in the individual screen data Di1 and Di2 created thereby. In the screen data conversion program Pg1 shown in Fig. 10, the height of the part P13 in the individual screen G12 for "screen 2" is set to "40" instead of "30" in the screen data conversion program Pg1 in Fig. 9. In this case, in the individual screen data Di2 created by the screen creation processing unit 33, the height of the part P13 is "40".

[0072] The individual screens G11 and G12 drawn according to the individual screen data Di1 and Di2 thus created are as shown in FIG. 11. That is, in the individual screen G12, the part P13 partially overlaps with the part P12. When such an overlap occurs between the parts P1, the error detection unit 35 determines that an error has occurred at the overlapping portion. Therefore, the error detection unit 35 processes the drawing result of the individual screen data Di2 so that the location where the error has occurred can be identified, and causes the presentation processing unit 34 to display the individual screen G12 after the processing, as shown in the lower part of FIG. 11. In the individual screen G12 after the processing, the part P13, which is the location where the error has occurred, is highlighted by a highlight object Ob1 such as a thick frame or a red frame.

[0073] In short, in this embodiment, each of the multiple individual screens G11, G12 includes two or more parts P1. The error detection unit 35 determines that there is an error when two or more parts P1 at least partially overlap. Therefore, as illustrated in Fig. 11, when a part of the part P12 is hidden due to the overlap of the parts P12, P13, for example, because the part P13 is too large for the margin of the frame F12, it is determined that there is an error. Therefore, it is possible to find a defect in the individual screens G11, G12 where a part of the part P1 is hidden.

[0074] When an error such as that shown in Fig. 11 occurs, the correction processor 36 makes it possible to correct the location where the error occurred. Specifically, as shown in Fig. 12, the correction processor 36 identifies the location in the screen data conversion program Pg1 that is causing the error.

[0075] In the example of Fig. 12, three parts P1 with a height of "50" are arranged in order from the top in sub-frame SF3 of frame F12 with a height of "180". Furthermore, a part P13 with a height of "40" is arranged below these three parts P1, so that a part of the part P13 overlaps with another part P12. Therefore, since the error is caused by the fact that the height of the part P13 is specified as "40" in the screen data conversion program Pg1, the correction processing unit 36 ​​identifies the part where the height of the part P13 is specified as "40" as the cause of the error.

[0076] Furthermore, the correction processing unit 36 ​​proposes a value of "30" as a correction candidate for the height of the part P13 causing the error. In other words, if the height of the part P13 is "30", the four parts P1 will fit within the height (180) of the subframe SF3 (50×3+30=180), and the overlap between the parts P13 and P12 will be eliminated. Therefore, as shown in FIG. 12, for example, the correction processing unit 36 ​​causes the presentation processing unit 34 to display a screen including the part causing the error in the screen data conversion program Pg1 and its correction candidate on the operation display unit 41. The part causing the error is highlighted with, for example, a highlighting object Ob2 such as a marker, and the correction candidate is also highlighted with, for example, a highlighting object Ob3 such as a marker.

[0077] At this time, the presentation processing unit 34 displays a button B1 for receiving a user's approval operation for the correction candidate (here, "height=30") of the screen data conversion program Pg1 on the operation display unit 41. In this state, when the operation display unit 41 receives an operation of the button B1 by the user, the correction processing unit 36 ​​automatically executes a correction to the correction candidate for the screen data conversion program Pg1, assuming that the user's approval operation has been performed. As a result, a screen data conversion program Pg2 is obtained in which the part causing the error has been corrected according to the correction candidate.

[0078] Thereafter, the screen creation processing unit 33 creates the individual screen data Di1, Di2 in accordance with the modified screen data conversion program Pg2. As a result, error-free individual screen data Di1, Di2 are created, as in Fig. 9. In this manner, the correction processing unit 36 ​​corrects the screen data conversion program Pg1, thereby correcting the locations where errors have occurred in the individual screens G11, G12.

[0079] Thus, in this embodiment, the correction processor 36 presents correction candidates for the location where the error occurred, and corrects the location where the error occurred according to the correction candidates upon receiving an approval operation from the user for the correction candidates. In this embodiment, the operation of button B1 by the user is an example of an approval operation by the user. As a result, the user only needs to confirm the presented correction candidates and approve the approval operation, and the location where the error occurred is automatically corrected, which can reduce the user's effort.

[0080] Finally, the screen creation processing unit 33 stores (preserves) the completed individual screen data Di1 and Di2 in the screen data storage unit 37.

[0081] Hereinafter, an example of the operation of the creation support device 3 according to this embodiment will be described with reference to Fig. 13. Here, steps S1, S2, etc. in the flowchart shown in Fig. 13 each indicate the number of a processing procedure (step) executed by the creation support device 3.

[0082] <Steps S1 and S2> In step S1, the acquisition processing unit 32 acquires one common screen data Dc1 from the screen data storage unit 37. In step S2, the screen creation processing unit 33 arranges the part P1 on the frame F1 based on the one common screen data Dc1, and creates individual screen data Di1, Di2. At this time, the screen creation processing unit 33 converts the one common screen data Dc1 according to the screen data conversion program Pg1 for each screen size and aspect ratio, thereby creating multiple individual screens G11, G12 (individual screen data Di1, Di2) at once.

[0083] <Steps S3 and S4> In step S3, the error detection unit 35 detects whether or not there is an error in the individual screen data Di1, Di2 created by the screen creation processing unit 33. If there is an error such as an overlap of the part P1 (S4: Yes), the error detection unit 35 shifts the process to step S4. In step S4, the error detection unit 35 processes the drawing results of the individual screen data Di1, Di2 so that the location of the error can be identified. On the other hand, if there is no error (S3: No), the error detection unit 35 skips steps S4 to S8 and shifts the process to step S9.

[0084] <Steps S5 and S6> In step S5, the correction processing unit 36 ​​proposes correction candidates for the location where the error occurred, and causes the presentation processing unit 34 to display (present) a screen including the correction candidates on the operation display unit 41. In this state, in step S6, the correction processing unit 36 ​​determines whether or not the user has performed an approval operation. If an approval operation is performed by operating button B1 (S6: Yes), the correction processing unit 36 ​​transitions the process to step S7. On the other hand, if an approval operation is not performed (S6: No), the correction processing unit 36 ​​returns to step S5 and continues presenting the correction candidates. At this time, the correction processing unit 36 ​​may change the correction candidates.

[0085] <Steps S7 and S8> In step S7, the correction processing unit 36 ​​automatically corrects the screen data conversion program Pg1 to the correction candidate. In step S8, the screen creation processing unit 33 creates new individual screen data Di1 and Di2 in accordance with the corrected screen data conversion program Pg2.

[0086] <Steps S9 and S10> In step S10, the presentation processing unit 34 renders the individual screen data Di1 and Di2 to display the individual screens G11 and G12 on the operation display unit 41. In step S10, the screen creation processing unit 33 stores (saves) the data of the completed screens (individual screen data Di1 and Di2) in the screen data storage unit 37.

[0087] The above-described procedure is merely an example, and the order of the processes shown in the flowchart of FIG. 13 may be changed as appropriate.

[0088] [5] Variations A plurality of components included in the creation support device 3 may be distributed among a plurality of housings. For example, at least one of the screen designation processing unit 31, the acquisition processing unit 32, the screen creation processing unit 33, the presentation processing unit 34, the error detection unit 35, the correction processing unit 36, and the screen data storage unit 37 may be provided separately.

[0089] Furthermore, the number of individual screens G11, G12 collectively created by the screen creation processing unit 33 is not limited to two, and may be three or more.

[0090] Furthermore, the display unit 15 is not limited to a liquid crystal display, and may include a display such as electronic paper or a projector instead of or in addition to an organic EL display.

[0091] Furthermore, the GUI screen created using the creation support device 3 of this embodiment is not limited to being used for the image processing device 10, and may be used for various devices (including devices, equipment, and systems) other than the image processing device 10.

[0092] [Appendix to the invention] The following will provide an overview of the invention extracted from the above-described embodiment. Note that the configurations and processing functions described in the following supplementary notes can be selected and combined as desired.

[0093] <Appendix 1> an acquisition processing unit that acquires common screen data including information on one or more parts arranged on a frame; a screen creation processing unit that collectively creates a plurality of individual screens, each of which is formed by arranging the one or more components on the frame and which differ from each other in at least one of size and aspect ratio, from one of the common screen data; A GUI application creation support device.

[0094] <Appendix 2> a presentation processing unit that presents the plurality of individual screens created by the screen creation processing unit, 2. A GUI application creation support device according to claim 1.

[0095] <Appendix 3> further comprising an error detection unit that detects the presence or absence of an error for each of the plurality of individual screens and notifies a user of the detection result when at least the error is present; 3. A GUI application creation support device according to claim 1 or 2.

[0096] <Appendix 4> each of the plurality of individual screens includes two or more components; The error detection unit determines that the error exists when at least a portion of the two or more parts overlap. 4. A GUI application creation support device according to claim 3.

[0097] <Appendix 5> Further comprising a correction processing unit that corrects a portion where the error occurs when at least the error is present. 5. A GUI application creation support device according to claim 3 or 4.

[0098] <Appendix 6> the correction processing unit presents a correction candidate for the portion where the error has occurred, and, upon receiving an approval operation by a user for the correction candidate, corrects the portion where the error has occurred in accordance with the correction candidate. 6. A GUI application creation support device according to claim 5. [Explanation of symbols]

[0099] 3. GUI Application Creation Support Device 32 Acquisition processing unit 33 Screen creation processing section 35 Error detection section 36 Correction Processing Section Dc1 Common screen data F1, F11, F12 frames G11,G12 individual screen P1, P10~P19 Parts

Claims

1. an acquisition processing unit that acquires common screen data including information on one or more parts arranged on a frame; a screen creation processing unit that collectively creates a plurality of individual screens, each of which is formed by arranging the one or more components on the frame and which differ from each other in at least one of size and aspect ratio, from one of the common screen data; GUI application creation support device.

2. a presentation processing unit that presents the plurality of individual screens created by the screen creation processing unit, 2. The GUI application creation support device according to claim 1.

3. further comprising an error detection unit that detects the presence or absence of an error for each of the plurality of individual screens and notifies a user of the detection result when at least the error is present; 3. The GUI application creation support device according to claim 1.

4. each of the plurality of individual screens includes two or more components; the error detection unit determines that the error exists when at least a portion of the two or more parts overlap; 4. The GUI application creation support device according to claim 3.

5. Further comprising a correction processing unit that corrects a portion where the error occurs when at least the error is present.

4. The GUI application creation support device according to claim 3.

6. the correction processing unit presents a correction candidate for the portion where the error has occurred, and, upon receiving an approval operation by a user for the correction candidate, corrects the portion where the error has occurred in accordance with the correction candidate.

6. The GUI application creation support device according to claim 5.

7. acquiring common screen data including information regarding one or more components to be placed on a frame; and creating, at a time, a plurality of individual screens, each of which is a screen in which the one or more components are arranged on the frame, from one of the common screen data, and which differ from each other in at least one of size and aspect ratio. A method for supporting the creation of GUI applications.

8. acquiring common screen data including information regarding one or more components to be placed on a frame; creating a plurality of individual screens at once from one of the common screen data, each of which is a screen in which the one or more components are arranged on the frame, and which differ from each other in at least one of size and aspect ratio; A program for executing the above on one or more processors.

Citation Information

Patent Citations

  • Source code generating device

    JP2008269554A