Computer-readable recording medium, terminal operation setting method, terminal operation setting device, and user interface terminal

Abstract

The program causes a setting device (10) connected to a UI terminal (20) to function as a setting section (13). The setting section (13) sets to the UI terminal (20) that the first process is executed when a first contact operation is performed on a component region corresponding to a display component in a display region of a touch screen (23) of the UI terminal (20) and the second process is executed when a second contact operation is performed on the component region, and sets to the UI terminal (20) that the first process and the second process are executed when, in a case where the first contact operation is performed on the component region, the second contact operation is performed outside the component region before the end of the first contact operation is detected.

Description

Technical Field

[0001] This invention relates to computer-readable recording media, terminal operation setting methods, terminal operation setting devices, and user interface terminals. Background Technology

[0002] In a Factory Automation (FA) environment, a control system is built to control various devices, such as sequencers and servo amplifiers. To manage this control system, a user interface terminal, also known as a programmable display, is used. This terminal has a touchscreen and communicates with various devices to display information collected from them and to receive settings for parameters or control commands for those devices.

[0003] However, in consumer-facing smartphones and tablets with touchscreens, the operating methods are pre-installed. In contrast, the user interface terminal used in the FA field has a screen and operating methods created specifically for each field. For example, using software applications called engineering design tools, display components such as lights, numbers, and meters are configured on the display screen of the user interface terminal, and set to display the status read from the device on these display components. In addition, by configuring display components such as switches or input forms, these display components are set to receive information input from field managers (for example, see Patent Document 1).

[0004] Patent Document 1 describes as associating a flick gesture for increasing or decreasing the liquid level in the tank with the tank displayed on a touch panel, and associating a pinch gesture for increasing or decreasing the valve opening with the displayed valve.

[0005] Furthermore, the purpose of a user interface terminal is not limited to communication with external devices; a switch for updating the displayed content can also be configured on the user interface terminal's screen. Thus, a touchscreen is sometimes used to utilize the functions performed internally by the user interface terminal.

[0006] Patent Document 1: Japanese Patent Application Publication No. 2017-168102 Summary of the Invention

[0007] Because display components are associated with touch operations on a one-to-one basis, there is a tendency to configure multiple display components within a single screen, resulting in a greater variety of display types. Consequently, the user interface provided to field managers becomes difficult to understand, and in order for the user interface terminal to perform its intended function, repeated touch operations are often necessary. Therefore, there is a risk of placing a heavy operational burden on managers using the user interface terminal in the FA field.

[0008] The present invention was made in view of the above circumstances, and its purpose is to reduce the operational burden on managers using user interface terminals at the FA site.

[0009] To achieve the above objectives, the terminal operation setting program of the present invention enables a computer to function as a receiving unit and a setting unit. The computer is connected to a user interface terminal for controlling the device. The receiving unit receives a designation for a first contact operation on a display component displayed on the touchscreen of the user interface terminal, a designation for a first process that the user interface terminal should perform when the first contact operation is performed, a designation for a second contact operation on the display component that is different from the first contact operation, and a designation for a second process that the user interface terminal should perform when the second contact operation is performed that is different from the first process. The setting unit sets the user interface terminal to perform the first process when a first contact operation is performed on a component area corresponding to the display component in the display area of ​​the touchscreen, and to perform the second process when a second contact operation is performed on the component area. The user interface terminal is also set to perform the first and second processes when, in the case of a first contact operation on the component area, a second contact operation is performed outside the component area before the end of the first contact operation is detected.

[0010] The effects of the invention

[0011] According to the present invention, the operational burden on managers using user interface terminals at the FA site can be reduced. Attached Figure Description

[0012] Figure 1 This diagram illustrates the relationship between the setting device and the user interface terminal involved in the implementation method.

[0013] Figure 2 This is a diagram illustrating the hardware structure of the FA device involved in the implementation.

[0014] Figure 3 This is a diagram illustrating the functional structure of the setting device and user interface terminal involved in the implementation method.

[0015] Figure 4 This is a diagram illustrating an example of the settings for the user interface involved in the implementation method.

[0016] Figure 5 This is a diagram illustrating an example of the display components and component areas involved in the implementation.

[0017] Figure 6 This is a diagram illustrating a single-point tapping operation on a display component according to an embodiment.

[0018] Figure 7This is a diagram used to illustrate the sliding operation of the display component according to the embodiment.

[0019] Figure 8 This is a diagram illustrating a two-point tapping operation on a display component according to an embodiment.

[0020] Figure 9 This is a diagram illustrating a first example of multiple contact operations on a display component according to an embodiment.

[0021] Figure 10 This is a diagram illustrating a second example of multiple contact operations on the display component according to the embodiment.

[0022] Figure 11 This is a diagram illustrating a third example of multiple contact operations on the display component according to the embodiment.

[0023] Figure 12 This is a diagram illustrating the first example of a contact operation targeting a designated area according to the implementation method.

[0024] Figure 13 This is a diagram illustrating a second example of a contact operation targeting a designated area according to an implementation method.

[0025] Figure 14 This is a diagram illustrating the output of a document representing gesture operations related to an implementation method.

[0026] Figure 15 This is a diagram illustrating the first example of the continuous operations involved in the implementation method.

[0027] Figure 16 This is a diagram illustrating a second example of the continuous operations involved in the implementation method.

[0028] Figure 17 This is a flowchart illustrating the terminal operation setting process involved in the implementation method.

[0029] Figure 18 This is a flowchart illustrating the terminal processing involved in the implementation method.

[0030] Figure 19 This is a diagram used to illustrate the combination of the first contact operation and the second contact operation involved in the implementation.

[0031] Figure 20 This is a diagram illustrating the third example of the continuous operations involved in the implementation method. Detailed Implementation

[0032] Hereinafter, with reference to the accompanying drawings, a user interface terminal and a setting device for setting an operation method for the user interface terminal according to embodiments of the present invention will be described in detail. Hereinafter, the user interface terminal will be appropriately referred to as a UI (User Interface) terminal.

[0033] Implementation

[0034] like Figure 1 As shown, the setting device 10 in this embodiment is an industrial PC (Personal Computer) connected to the UI terminal 20 and used by the operator 31. The operator 31 uses the setting device 10 to set the configuration of the display components that should be displayed on the screen of the UI terminal 20, the types of operations received by each display component, and the processing that the UI terminal 20 should perform when each operation is performed. The setting device 10 is equivalent to an example of a terminal operation setting device.

[0035] UI terminal 20 is a programmable display that connects to control device 40 within the factory and serves as an operating terminal for control device 40. Administrator 32 uses UI terminal 20 to manage control device 40 and devices 42-44 connected to control device 40 via industrial network 41. UI terminal 20 connects to setting device 10, for example, via a communication cable such as a USB (Universal Serial Bus) cable, and to control device 40 via LAN (Local Area Network) or industrial network.

[0036] The control device 40 is a PLC (Programmable Logic Controller), and the devices 42-44 are each devices that become controlled objects, such as sensors, actuators, valves, servo systems, and robots. For example, the control device 40 collects sensing results from the sensors (device 42), controls the servo system (device 43) and the robot (device 44), thereby detecting workpieces conveyed by the belt conveyor, processing them, and removing them. The control performed by the control device 40 is managed by the administrator 32 using the UI terminal 20.

[0037] Furthermore, the following description focuses on an example where a control system including control device 40 and equipment 42-44 is managed using UI terminal 20, but the application of UI terminal 20 is not limited to this. UI terminal 20 serves as a user interface for devices used in the FA field; its operation screen only needs to be designed at that field location. UI terminal 20 is comparable to an example of a user interface terminal used for controlling equipment. Additionally, operator 31 and manager 32 can be the same user or different users.

[0038] Setting device 10 and UI terminal 20 are equipped with Figure 2 A computer with the hardware structure shown. In Figure 2 In this configuration, the FA device 50 corresponds to both the setting device 10 and the UI terminal 20. The FA device 50 includes a processor 51, a main storage unit 52, an auxiliary storage unit 53, an input unit 54, an output unit 55, and a communication unit 56. The main storage unit 52, auxiliary storage unit 53, input unit 54, output unit 55, and communication unit 56 are all connected to the processor 51 via an internal bus 57.

[0039] The processor 51 includes a CPU (Central Processing Unit) as a processing circuit. The processor 51 performs various functions by executing the program P1 stored in the auxiliary storage unit 53, and performs the processing described later.

[0040] The main storage unit 52 contains RAM (Random Access Memory). Program P1 is loaded into the main storage unit 52 from the secondary storage unit 53. Furthermore, the main storage unit 52 is used as the working area of ​​the processor 51.

[0041] The auxiliary storage unit 53 includes non-volatile memory such as EEPROM (Electrically Erasable Programmable Read-Only Memory) and HDD (Hard Disk Drive). The auxiliary storage unit 53 stores various data used by the program P1 and the processor 51. According to the instructions of the processor 51, the auxiliary storage unit 53 supplies data used by the processor 51 to the processor 51 and stores the data supplied from the processor 51. The program P1 of the setting device 10 corresponds to the engineering design tool described above, and is equivalent to an example of a terminal operation setting program.

[0042] The input unit 54 includes input devices such as hardware switches, input keys, keyboards, and pointing devices. The input unit 54 acquires information input by the user from the FA device 50 and notifies the processor 51 of the acquired information.

[0043] The output unit 55 includes display devices such as LED (Light Emitting Diode) and LCD (Liquid Crystal Display), as well as audio devices such as buzzers and speakers. The output unit 55 provides various information prompts to the user according to the instructions of the processor 51. Furthermore, the output unit 55 of the UI terminal 20 includes a display device integrated with the input unit 54, which serves as a pointing device, as a touchscreen.

[0044] The communication unit 56 includes a communication interface circuit for communicating with external devices. The communication unit 56 receives signals from the outside and outputs the data indicated by those signals to the processor 51. Additionally, the communication unit 56 sends signals indicating data output from the processor 51 to the outside. Communication performed by the communication unit 56 can be bidirectional communication with an external computer, or writing to a recording medium removable from the FA device 50.

[0045] Through the collaboration of the aforementioned hardware structure, the device 10 and the UI terminal 20 are configured to perform various functions. Specifically, as... Figure 3 As shown, the setting device 10 includes: a receiving unit 11 that receives a specification of a user interface to be set on the UI terminal 20; a determining unit 12 that determines whether an operation can be set as a user interface specification; a setting unit 13 that sets the specified user interface on the UI terminal 20; and an output unit 14 that outputs data representing the content of the user interface to the outside.

[0046] The receiving unit 11 is mainly implemented by the input unit 54 of the setting device 10. The receiving unit 11 can receive user interface specifications from the operator 31, or it can receive user interface specifications by reading file F1 from the address specified by the operator 31. For example... Figure 4 As shown, the receiving unit 11 receives a combination of the operation object, the contact operation for the operation object, and the processing that the UI terminal 20 should perform when the contact operation is performed, as the content of the user interface.

[0047] In detail, as the object of operation, such as Figure 4 As illustrated in lines 61-63, the receiving unit 11 receives the display component A1 displayed on the touchscreen 23 of the UI terminal 20 and the specification of its configuration. The display component A1 can be a display component that displays the status of devices 42-44 or the status of parameters within the UI terminal 20, such as lights, meters, and strings; or it can be a display component that receives information input by the user 32's hand 321, such as switches and input forms. The display component is essentially an image displayed on the touchscreen 23. This image can be drawn by the operator 31, read from an address specified by the operator 31, or selected by the operator 31 from multiple images included in the engineering design tool. The configuration of the display component A1 is represented by the display screen of the touchscreen 23 as a two-dimensional plane defined by the X-axis and Y-axis, using the coordinate values ​​of the X-axis and Y-axis.

[0048] Additionally, the receiving unit 11 receives a designation for a contact operation on the display component A1 from the operator 31. The contact operation on the display component A1 is initiated by bringing an object into contact with the display component A1 displayed on the touchscreen 23. For example, as... Figure 5As shown, if the fingertip of hand 321 makes a contact point inside the component area A10, which is equal to the area where the display component A1 is displayed, then operation on the display component A1 begins.

[0049] Furthermore, component area A10 is usually equal to the display area of ​​display component A1, but component area A10 can also be smaller or larger than the display area. Component area A10 can overlap with the display area; the greater the overlap ratio, the less likely the administrator 32 will experience any incongruity when operating the UI terminal 20.

[0050] Furthermore, the generation of contact points in component area A10 is simply a detectable physical phenomenon corresponding to the activation of display component A1 due to operation of display component A1 by the administrator 32. Specifically, regardless of whether the pointing device constituting touchscreen 23 is electrostatic capacitive, resistive film, infrared blocking, ultrasonic surface elastic wave, or any other method, if a position is detected where an object contacts touchscreen 23, that position is considered a contact point. The release of contact is also simply a matter of the pointing device detecting the physical phenomenon of the disappearance of the contact point.

[0051] When a surface is created where the touchscreen 23 contacts an object, the center of that surface can be set as the contact point. Here, the center of the surface can be the centroid of the surface, or it can be a point defined by the average of the maximum and minimum values ​​in the X-axis direction and the average of the maximum and minimum values ​​in the Y-axis direction of the surface. Furthermore, the object that creates the contact point is not limited to the hand 321; it can be other parts of the administrator 32 or a stylus used by the administrator 32.

[0052] exist Figure 6 The first example of a contact operation illustrates the process of a tapping operation. For example... Figure 6 As shown, if the fingertip of hand 321 moves directly above the display component A1 and component area A10, and the fingertip releases the contact after creating contact point 322, then a tapping operation is completed by pressing only one point of the touchscreen 23. Figure 6 The diagram also shows that by performing this tapping operation, display component A1 changes from a hollow OFF state to a blacked-out ON state. The state of display component A1 is as follows: Figure 4 As shown in line 61, corresponding to the ON or OFF state of the device parameter, the display component A1 is equivalent to a switch used to switch the state of the parameter.

[0053] exist Figure 7 The second example of a contact operation illustrates the flow of a sliding operation. For example... Figure 7As shown, if the fingertip of hand 321 creates a contact point 322 inside the component area A10, and then releases the contact after moving as indicated by the shaded arrow while maintaining contact, the sliding operation is completed. Figure 7 The document also shows that by performing this sliding operation, the string 71, such as "Device 1," located near the display component A1, changes to the string 72, such as "Device 2." That is, as... Figure 4 As shown in line 62, the device corresponding to display component A1 can be switched by sliding left and right.

[0054] exist Figure 8 The third example of a contact operation illustrates the process of a two-point tapping operation. For example... Figure 8 As shown, inside component area A10, the two fingertips of hand 321 simultaneously generate contact points 322, and then simultaneously release the contact without moving, thus completing the two-point tapping operation. Figure 8 The document also shows that menu 73 is displayed near display component A1 by performing a two-point tapping operation.

[0055] In addition, such as Figure 4 Lines 61-63 and Figures 6-8 As shown, multiple touch operations and the processing that the UI terminal 20 should perform when each touch operation is performed can be specified for a single display component A1.

[0056] For example, such as Figure 9 As shown, after selecting a device by sliding left and right on the display component A2 for inputting values ​​and the component area A20 corresponding to the display component A2, the value can be increased or decreased by sliding up and down on the display component A2 and the component area A20. Additionally, during the left and right sliding operation, a guide 74 indicating the currently selected device and the devices selectable by the sliding operation can be displayed. Similarly, during the up and down sliding operation, guides 75 and 76 indicating the current value and the value input by the sliding operation can be displayed. Furthermore, in the display component A2, as shown... Figure 9 The top section displays the currently selected device, and can also display the selected value for the currently selected device. For example, a value like "150" for device 3 can also be displayed. Figure 9 The upper display component A2.

[0057] In addition, such as Figure 10As shown, after selecting the multiplier of the bit whose value should be changed by sliding the display component A2 and component area A20 in the left and right directions, the value of that bit can be increased or decreased by sliding the display component A2 and component area A20 in the up and down directions. During the left and right sliding operation, a guide 77 indicating the currently selected multiplier and the multipliers selectable through the sliding operation can also be displayed. Similarly, during the up and down sliding operation, guides 78 and 79 indicating the currently selected value and the value input through the sliding operation can also be displayed.

[0058] In addition, such as Figure 11 As shown, after selecting a font by sliding left and right on display component A3 and the corresponding component area A30, a character can be selected by sliding up and down on display component A3 and component area A30. Fonts can include, for example, uppercase and lowercase letters, numbers, and symbols. During the left and right sliding operation, a guide 701 indicating the currently selected font and the fonts selectable by the sliding operation can be displayed. Similarly, during the up and down sliding operation, guides 702 and 703 indicating the currently selected character and the characters selectable by the sliding operation can be displayed.

[0059] Return to Figure 4 The receiving unit 11 receives a specification of the processing that the UI terminal 20 should perform when a specified contact operation is performed. For example, in Figure 9 The actions of determining which device to be the target and determining the values ​​to be set for the determined device are equivalent to the processing that the UI terminal 20 should perform.

[0060] The receiving unit 11 corresponds to an example of a receiving unit that receives a designation for a first touch operation on a display component displayed on a touchscreen of a UI terminal, a designation for a first process that the UI terminal should perform when the first touch operation is performed, a designation for a second touch operation on the display component that is different from the first touch operation, and a designation for a second process that the UI terminal should perform when the second touch operation is performed that is different from the first process.

[0061] Return to Figure 4 As shown in lines 64 and 65, the receiving unit 11 receives a designation of a designated area as an operation object different from the display component, and the range of that designated area. The designated area is a region designated as the entire display screen of the touchscreen 23 or a partial area contained within that display screen, regardless of the presence or absence of a display component. The designated area can be rectangular or have other shapes. The range of the designated area is defined by using XY coordinate values ​​to determine its boundaries.

[0062] exist Figure 12 The diagram illustrates an example where the display screen of the touchscreen 23 is divided into three parts vertically, designated as areas B1, B2, and B3 from top to bottom. For instance, a two-point tap in area B1 selects device 1, a two-point tap in area B2 selects device 2, and a two-point tap in area B3 selects device 2. Figure 4 Select device 3 as shown.

[0063] exist Figure 13 The image shows an example of a left-right swipe operation performed in the designated area B4 at the bottom of the display screen of the touchscreen 23. When this swipe operation is performed, as shown... Figure 4 As shown, the screen displayed on the touchscreen 23 is switched. According to... Figure 12 , 13 It can be seen that the designated areas B1 to B4 are defined in a way that does not correspond to the display components.

[0064] Return to Figure 3 The determination unit 12 is primarily implemented by the processor 51 of the setting device 10. The determination unit 12 corresponds to an example of a determination unit that performs determinations related to the operation received by the receiving unit. The determination unit 12 determines whether a specified contact operation received by the receiving unit 11 is equal to a consecutive operation comprising multiple identically received contact operations. For example, such as... Figure 14 As shown in the upper left corner, this is a gesture operation that allows a specific object to be moved in an L-shaped path, with the contact point moved downwards and then to the right. However, since such a gesture operation is equivalent to a continuous operation that includes a downward swipe and a rightward swipe, it is difficult to determine whether the operation intended by the manager 32 is a gesture operation or a continuous operation. The determination unit 12, as described above, detects two or more operations that are difficult to distinguish.

[0065] Here, continuous operation is achieved by performing the next contact operation before the previous one is completed. Figure 15The diagram illustrates an example where, after a rightward sliding operation is performed following a contact point 322 formed by the fingertip of hand 321 with display component A2 and component area A20, the contact is not released and a vertical sliding operation continues. Here, regarding a separate vertical sliding operation with respect to display component A2, the starting point of the movement of the contact point in the vertical direction must be inside component area A20. Even if the sliding operation is performed outside component area A20, it is not considered an operation with respect to display component A2. Conversely, when a rightward sliding operation with respect to display component A2 does not end due to the release of contact, and a next vertical sliding operation is performed while maintaining contact, this vertical sliding operation becomes an operation with respect to display component A2.

[0066] exist Figure 16 The diagram illustrates an example where, after selecting a font by sliding downwards on display component A3 and component area A30, a character is selected by sliding left or right while maintaining contact. Figure 16 In the example, the second sliding operation is performed outside the component area A30 from its start to its end, but since the first sliding operation does not end due to the release of contact, it is an operation for the display component A3.

[0067] Return to Figure 3 The setting unit 13 is mainly implemented through the cooperation of the processor 51 and the communication unit 56 of the setting device 10. The setting unit 13 sets the content of the user interface received by the receiving unit 11 to the UI terminal 20. However, the setting unit 13 may also set one specific operation as the setting object and exclude the other operations from the setting object if the determination unit 12 determines that there are two operations that are difficult to distinguish. For example, when the receiving unit 11 receives a vertical swipe operation, a horizontal swipe operation, and an L-shaped path gesture operation, since a continuous operation containing two swipe operations is sometimes equal to a gesture operation, the setting unit 13 may also exclude the gesture operation from the setting object.

[0068] Furthermore, in this case, the setting unit 13 can also exclude two sliding operations constituting a continuous operation from the setting objects. The setting unit 13 can set the operation that is more than or equal to the first received operation among two operations that is difficult to determine as the setting object, or it can notify the operator 31 that the operation cannot be set, so that the operator 31 can select the operation that should be set as the setting object.

[0069] The setting unit 13 is equivalent to an example of a setting unit. This setting unit sets the UI terminal to perform a first process when a first contact operation is performed on a component area corresponding to the display component in the display area of ​​the touch screen, and to perform a second process when a second contact operation is performed on the component area. It also sets the UI terminal to perform the first and second processes when a second contact operation is performed outside the component area before the end of the first contact operation is detected, in the case of a first contact operation on the component area.

[0070] The output unit 14 is mainly implemented by the processor 51 and the communication unit 56 of the setting device 10. The output unit 14 outputs a file F2 representing the settings made by the setting unit 13. The output made by the output unit 14 can be writing to a recording medium such as a memory card that is removable from the setting device 10, writing to an external server device, or writing to the main storage unit 52 or the auxiliary storage unit 53 of the setting device 10.

[0071] The output of file F2 by output unit 14, such as Figure 14 As shown, the settings made by the setting device 10 can be easily reflected on multiple UI terminals 20, 20a. Furthermore, the user interface of the UI terminal 20a can be easily set by selecting from files F2 and F3. In particular, since gesture operations specify the movement path of the contact point, resetting the same operation as a specific gesture operation is a cumbersome task, but this task can be omitted by using a file representing the settings of the user interface. The output unit 14 corresponds to an example of an output unit that outputs the data received by the receiving unit indicating the specified path of the contact point movement.

[0072] Return to Figure 3 The UI terminal 20 includes: a receiving unit 21 that receives settings made by the setting device 10; a processing unit 22 that performs processing based on the received settings; and a touch screen 23 used by the administrator 32. The receiving unit 21 is implemented by the aforementioned communication unit 56 of the UI terminal 20, the processing unit 22 is implemented by the aforementioned processor 51 of the UI terminal 20, and the touch screen 23 is implemented through the cooperation of the aforementioned input unit 54 and output unit 55 of the UI terminal 20.

[0073] The receiving unit 21 corresponds to an example of a receiving unit that receives settings related to the operation of the touchscreen. The processing unit 22 corresponds to an example of a processing unit that performs processing according to the settings. Here, the processing unit performs first processing when a first contact operation is performed on a component area corresponding to the display component in the display area of ​​the touchscreen, performs second processing when a second contact operation is performed on the component area, and performs both first and second processing when, in the case of a first contact operation on the component area, a second contact operation is performed outside the component area before the first contact operation is detected to have ended.

[0074] Next, the terminal operation setting process performed by the setting device 10 and the terminal processing performed by the UI terminal 20 will be described in turn. The terminal operation setting process is equivalent to an example of the terminal operation setting method.

[0075] like Figure 17 As shown, in the terminal operation setting process, the receiving unit 11 receives a designation from the display unit or a designated area as the operation object (step S1), and receives a designation for a touch operation for that operation object (step S2). Then, the determination unit 12 determines whether the designated touch operation received in step S2 is equal to an existing operation (step S3). Here, the existing operation includes all combinations of previously received touch operations, i.e., continuous operations. For example, if a designation for a left-right sliding operation or a right-up sliding operation has been received in the past, it is determined whether the newly received touch operation in step S2 can be represented by a combination of more than or equal to two of the four operations: left, right, up, and down.

[0076] If the received contact operation is determined to be equal to an existing operation (step S3; Yes), the process returns to step S2, where the receiving unit 11 prompts the operator 31 to specify a new contact operation, and receives the specification. The above description related to the setting unit 13 explains how to exclude a portion of two operations that are difficult to determine from the setting list, but... Figure 17 As shown, in the stage where an operation that is difficult to determine is specified, the receiving unit 11 can also receive a new operation that can be determined, thereby excluding the operation that is difficult to determine from the setting objects sent to the UI terminal 20.

[0077] If it is determined that the received touch operation is not equal to the existing operation (step S3; No), the receiving unit 11 receives the specification of the process that should be performed on the UI terminal 20 when the touch operation received in step S2 is performed (step S4).

[0078] Next, the receiving unit 11 determines whether to further specify the combination of the operation object, the contact operation, and the processing to be performed (step S5). Specifically, the receiving unit 11 determines whether the specification made by the operator 31 has been completed.

[0079] If it is determined that further additions are needed (step S5; Yes), the setting device 10 repeats step S1 and subsequent processing. On the other hand, if it is determined that there are no further additions needed (step S5; No), the receiving unit 11 receives the designation of the object of the continuous operation (step S6). Specifically, it receives the selection of contact operations that can constitute a continuous operation starting from the already designated contact operation. As a result, it is possible to avoid continuous operations on the UI terminal 20 that deviate from the intentions of the operator 31.

[0080] Next, the setting unit 13 sets the combination of the operation object, the contact operation, and the processing to be performed, as well as the object of continuous operation, to the UI terminal 20 (step S7). Then, the terminal operation setting process ends.

[0081] In terminal processing performed by UI terminal 20, such as Figure 18 As shown, the processing unit 22 determines whether the touch operation registered in the UI terminal 20 is performed on the area of ​​the operation object corresponding to the touch operation (step S11). If it is determined that no touch operation has been performed (step S11; No), the processing unit 22 repeats the determination in step S11 and waits until a registered touch operation has been performed.

[0082] On the other hand, if a touch operation is determined to have occurred (step S11; Yes), the processing unit 22 executes the processing corresponding to the touch operation (step S12). Next, the processing unit 22 determines whether the end of the touch operation has been detected (step S13). Specifically, the processing unit 22 determines whether the contact between the object and the touch screen 23 has been released. If the end of the touch operation is detected (step S13; Yes), the terminal processing ends.

[0083] On the other hand, if it is determined that the end of the touch operation has not been detected (step S12; No), the processing unit 22 determines whether a touch operation different from the previous touch operation has been performed on the touch screen 23 (step S14). For example, after the determination in step S13 is denied, in the initial step S14, it is determined whether a new touch operation has been performed on the operation object registered in step S11, which was determined to have been touched.

[0084] Here, using Figure 19 The combination of contact operations constituting continuous operation is explained. Figure 19The diagram schematically illustrates four combinations between the first contact operation, which is either a tapping or sliding operation, and the subsequent second contact operation, which is also either a tapping or sliding operation. Furthermore, examples of tapping operations include single-point tapping and multi-point tapping operations, examples of sliding operations include single-point sliding and multi-point sliding operations, and include a sweeping operation with a defined endpoint and a flicking operation without a defined endpoint.

[0085] When both the first and second contact operations are tapping operations, such as Figure 19 As shown, for example, a first contact point is created by a single-point tapping operation using the thumb, and in this state, two second contact points different from the first contact point are created by a second contact operation using the index and middle fingers. Alternatively, when the first contact operation is a tapping operation and the second contact operation is a sliding operation, for example, a first contact point is created by a single-point tapping operation using the thumb, and in this state, a second contact point different from the first contact point is created by a second contact operation using the index finger, thus moving the device.

[0086] When the first contact operation is a sliding operation and the second contact operation is a tapping operation, for example, after moving the first contact point with the index finger using the first contact operation, a second contact point different from the first contact point is created by the second contact operation with the thumb. Alternatively, when both the first and second contact operations are sliding operations, for example, after moving the first contact point with the index finger using the first contact operation, a second contact operation is performed by moving the first contact point in a direction different from the first contact operation. In this example, the second contact point used in the second contact operation may be equal to the first contact point, but the first and second contact points may be different, thus performing both the first and second contact operations as sliding operations. That is, a second contact point can be created and moved in a different direction without releasing the contact of the first contact point achieved through the first contact operation.

[0087] In addition, Figure 19 Examples of touch operations, such as tapping and sliding, are given. However, when the touch operation is a gesture, pinch, double-tap, or other operation, such touch operations can also constitute continuous operations.

[0088] Return to Figure 18In step S14, if it is determined that no contact operation different from the previous contact operation has been performed (step S14; No), the processing unit 22 repeats step S13 and subsequent processing, waiting until the contact operation ends or a new contact operation is performed. On the other hand, if it is determined that a contact operation has been performed (step S14; Yes), the processing unit 22 determines whether the contact operation is a continuous operation (step S15).

[0089] If the operation is determined to be a continuous operation (step S15; Yes), the processing unit 22 receives the contact operation and performs the corresponding processing (step S16). Afterwards, the processing unit 22 repeats step S13 and subsequent processing. Conversely, if the operation is determined not to be a continuous operation (step S15; No), the processing unit 22 does not receive the contact operation, and the terminal processing ends.

[0090] As explained above, by assigning multiple touch operations to a single display component, the display component becomes multifunctional, thereby reducing the number of display components that can be configured on the display screen of the touchscreen 23. This increases the freedom of screen design and helps simplify the user interface. Furthermore, continuous operations on the display components are possible, eliminating the need to repeat touch operations that should begin from the component area, thus reducing the operational burden on the administrator 32. For example, as... Figure 20 As shown, by alternately and continuously sliding in the left and right and up and down directions from the component area, the administrator 32 does not need to move his fingertip on the display component for subsequent contact operations.

[0091] Furthermore, since gesture operations that specify the movement path of the contact point can be designated, the operator 31 can freely create individual contact operations. For example, by assigning a gesture operation depicting the first letter of the content to be processed to the object being processed, a user interface that is easy for the manager 32 to understand can be achieved.

[0092] In particular, gesture operation is also used in consumer-facing smartphones and tablets, but since they are consumer-facing, the gesture operation is designed to be simple. In contrast, the UI terminal 20 used in the FA (Factory Automation) field, being used by a professional administrator 32, allows for special operations such as setting up continuous operations that include multiple gesture operations. That is, the first and second contact operations constituting the continuous operation can be gesture operations that move the first contact point corresponding to the first contact operation and the second contact point corresponding to the second contact operation along different paths, or the receiving unit 11 can receive the specified path of the first contact point in the first contact operation and the specified path of the second contact point in the second contact operation. The output unit 14 can also output data representing the respective paths of the first and second contact points. Alternatively, a complex gesture operation can be created, allowing only known users to perform the gesture operation, and then assigned to a hidden function. Gesture operations depicting letters and numbers can also be pre-registered, and the UI terminal 20 can receive continuous operations such as sequentially inputting characters constituting a password.

[0093] Furthermore, the setting device 10 receives a designation of a specified area as the operation target. Specifically, the receiving unit 11 receives a designation of a touch operation performed on a specified area, which is either a partial area included in the display area or the entire display area, and a designation of the processing that the UI terminal 20 should perform when the touch operation is performed. The setting unit 13 sets the UI terminal 20 to perform the designated processing when the touch operation is performed in the specified area. As a result, the operation of the UI terminal 20 can be achieved without configuring display components. Therefore, the number of display components can be reduced. Here, the touch operation on the specified area is equivalent to an example of the third touch operation, and the processing performed when the touch operation is performed is equivalent to an example of the third processing.

[0094] Furthermore, the determination unit 12 determines whether the touch operation is equal to a continuous operation that includes other touch operations. If the touch operation is determined to be equal to a continuous operation, the setting unit 13 excludes that touch operation from the objects set for the UI terminal 20. This enables reliable operation of the UI terminal 20. Here, an example of a touch operation determined to be equal to a continuous operation is the fourth touch operation. The fourth touch operation is an operation different from the first and second touch operations that is performed sequentially on a display component that is the target of the first and second touch operations, which constitute a continuous operation. The designation of this fourth touch operation is received by the receiving unit 11.

[0095] The embodiments of the present invention have been described above, but the present invention is not limited to the above embodiments.

[0096] For example, an example is given where ending a touch operation corresponds to releasing contact with the touchscreen 23, but this is not a limitation. For example, ending a touch operation could also be by pressing a button on a stylus that can communicate with the UI terminal 20.

[0097] The functions of the setting device 100 and UI terminal 20 described in the above embodiments can also be implemented by dedicated hardware or a conventional computer system.

[0098] For example, by distributing the program P1 stored on a computer-readable recording medium such as a floppy disk, CD-ROM (Compact Disk Read-Only Memory), DVD (Digital Versatile Disk), or MO (Magneto-Optical disk), and installing the program P1 into a computer, an apparatus for performing the above-described processing can be constructed.

[0099] Alternatively, the program P1 can be pre-stored on a disk device of a server device on a communication network such as the Internet, and then downloaded to a computer by superimposing it onto a carrier wave.

[0100] Alternatively, the above processing can also be achieved by starting and executing the process simultaneously via a network forwarding program P1, such as the Internet.

[0101] Furthermore, by executing all or part of program P1 on a server device, the computer can also perform the above-mentioned processing while sending and receiving information related to its processing via a communication network.

[0102] Furthermore, in cases where the above functions are implemented by the OS or through the coordinated action of the OS and applications, the portion outside the OS can be stored in a medium for distribution, or it can be downloaded to a computer.

[0103] Furthermore, the means of implementing the functions of the setting device 10 and the UI terminal 20 are not limited to software; some or all of them can also be implemented through dedicated hardware or circuits.

[0104] This invention can be implemented and modified in various ways without departing from its broad spirit and scope. Furthermore, the above-described embodiments are for illustrative purposes only and are not intended to limit the scope of the invention. That is, the scope of the invention is defined not by the embodiments, but by the claims. Moreover, various modifications implemented within the scope of the claims and their equivalents are considered to fall within the scope of this invention.

[0105] Industrial applicability

[0106] This invention relates to the design of user interfaces for terminals used in FA (Field Application Automation) environments.

[0107] Explanation of the label

[0108] 10 Setting device, 11 Receiving unit, 12 Judgment unit, 13 Setting unit, 14 Output unit, 20, 20a UI terminal, 21 Receiving unit, 22 Processing unit, 23 Touch screen, 31 Operator, 32 Manager, 321 Hand, 322 Contact point, 40 Control device, 41 Industrial network, 42-44 Equipment, 50 FA device, 51 Processor, 52 Main storage unit, 53 Auxiliary storage unit, 54 Input unit, 55 Output unit, 56 Communication unit, 57 Internal bus, 61-65 Line, 71, 72 String, 73 Menu, 74-79, 701-703 Guide, A1-A3 Display unit, A10, A20, A30 Unit area, B1-B4 Designated area, F1-F3 File, P1 Program.

Claims

1. A computer-readable recording medium storing a terminal operation setting program for enabling a computer to function as a receiving unit and a setting unit, the computer being connected to a user interface terminal for controlling a device. The receiving unit receives a designation for a first touch operation on a display component displayed on the touchscreen of the user interface terminal, a designation for a first process that the user interface terminal should perform when the first touch operation is performed, a designation for a second touch operation on the display component that is different from the first touch operation, and a designation for a second process that the user interface terminal should perform when the second touch operation is performed that is different from the first process. The setting unit sets the user interface terminal to execute the first process when the first contact operation is performed on the component area corresponding to the display component in the display area of ​​the touch screen, and to execute the second process when the second contact operation is performed on the component area. The user interface terminal is also set to execute the first process and the second process when, in the case of the first contact operation on the component area, the second contact operation starting outside the component area is performed before the end of the first contact operation is detected.

2. The computer-readable recording medium according to claim 1, wherein, The receiving unit receives the specifications of the display component, the specifications of the configuration in the touchscreen of the display component, the first touch operation and the second touch operation, and the specifications of the first process and the second process as the content of the user interface. The setting unit sets the content of the user interface on the user interface terminal.

3. The computer-readable recording medium according to claim 1, wherein, The first contact operation is an operation that creates a first contact point between an object and the touchscreen or moves the first contact point. The first contact operation ends when the contact with the object is released. The second contact operation is an operation that generates a second contact point different from the first contact point or moves the second contact point.

4. The computer-readable recording medium according to claim 1, wherein, The first contact operation is an operation that moves the first contact point of the object that is in contact with the touch screen. The first contact operation ends when the contact with the object is released. The second contact operation is an operation that moves the second contact point, which is equal to the first contact point.

5. The computer-readable recording medium according to claim 3 or 4, wherein, The first contact operation and the second contact operation are operations that move the first contact point and the second contact point in different directions, respectively.

6. The computer-readable recording medium according to claim 3 or 4, wherein, The first contact operation and the second contact operation are gesture operations that cause the first contact point and the second contact point to move along different paths. The receiving unit receives the designation of the path for the movement of the first contact point in the first contact operation and the designation of the path for the movement of the second contact point in the second contact operation.

7. The computer-readable recording medium according to claim 6, which enables the computer to further function as an output unit. The output unit outputs data received by the receiving unit, specifying the paths of movement of the first contact point and the second contact point.

8. The computer-readable recording medium according to claim 1, wherein, The receiving unit receives a designation for a third touch operation targeting a specified area, and a designation for a third process that the user interface terminal should perform upon performing the third touch operation. The specified area is either a partial area contained within the display area or the entire display area. The setting unit sets the user interface terminal to perform the third process when the third contact operation is performed in the designated area.

9. The computer-readable recording medium according to claim 1, wherein, It also includes a determination unit that performs determinations related to the operations received by the receiving unit. The receiving unit receives a designation for a fourth contact operation, different from the first and second contact operations, for the display component. The determination unit determines whether the consecutive operations including the first contact operation and the second contact operation performed in sequence are equal to the fourth contact operation. If the setting unit determines that the continuous operation is equal to the fourth contact operation, it excludes the fourth contact operation from the set objects for the user interface terminal.

10. A terminal operation setting method, comprising: The receiving unit receives a designation for a first contact operation on a display component shown on a touchscreen of a user interface terminal used for controlling the device, a designation for a first process that the user interface terminal should perform when the first contact operation is performed, a designation for a second contact operation on the display component that is different from the first contact operation, and a designation for a second process that the user interface terminal should perform when the second contact operation is performed that is different from the first process. The setting unit sets the user interface terminal to execute the first process when the first contact operation is performed on the component area corresponding to the display component in the display area of ​​the touch screen, and to execute the second process when the second contact operation is performed on the component area. The setting unit sets the user interface terminal to perform the first process and the second process when, in the case of the first contact operation targeting the component area, a second contact operation starting outside the component area is performed before the end of the first contact operation is detected.

11. A terminal operation setting device, connected to a user interface terminal for controlling a device, The terminal operation setting device has the following features: A receiving unit receives a designation for a first contact operation on a display component displayed on a touchscreen of the user interface terminal, a designation for a first process that the user interface terminal should perform upon the first contact operation, a designation for a second contact operation on the display component different from the first contact operation, and a designation for a second process that the user interface terminal should perform upon the second contact operation different from the first process; and The setting unit configures the user interface terminal to execute the first process when the first contact operation is performed on the component area corresponding to the display component in the display area of ​​the touch screen, and to execute the second process when the second contact operation is performed on the component area. The user interface terminal is also configured to execute the first and second processes when, in the case of the first contact operation on the component area, a second contact operation starting outside the component area is performed before the end of the first contact operation is detected.

12. A user interface terminal for controlling a device, This user interface terminal has: touchscreen; A receiving unit that receives settings related to the operation of the touchscreen; and The processing unit executes the processing according to the settings described above. The processing unit performs the first processing when a first contact operation is performed on the component area corresponding to the display component in the display area of ​​the touch screen. When the processing unit performs a second contact operation, different from the first contact operation, on the component area, it executes a second process, different from the first process. When the processing unit performs the first contact operation targeting the component area, it performs the first processing and the second processing when it detects that a second contact operation starting outside the component area has occurred before the end of the first contact operation.

Images