Terminal operation setting program, terminal operation setting method, terminal operation setting device, and user interface terminal

Abstract

A program causes a setting device (10) connected to a UI terminal (20) to function as a setting unit (13). A setting unit (13) sets, to the UI terminal (20), a first process when a first touch operation is performed on a component region corresponding to a display component in a display region of a touch panel (23) of the UI terminal (20), and a second process when a second touch operation is performed on the component region, and sets, to the UI terminal (20), the first process when the first touch operation is performed on the component region, and the second process when the second touch operation is performed on the component region. The first process and the second process are executed when a second contact operation is performed outside the component area before the completion of the first contact operation is detected.

Description

Technical Field

[0001] The invention relates to a terminal operation setting program, a terminal operation setting method, a terminal operation setting device and a user interface terminal. Background Art

[0002] At the FA (Factory Automation) site, a control system is constructed to control various devices represented by sequencers and servo amplifiers. In order to manage such a control system, a user interface terminal also called a programmable display is used. The user interface terminal has a touch screen, and by communicating with various devices, the information collected from these devices is displayed on the touch screen, and the settings of parameters or control instructions for these devices are received from the touch screen.

[0003] However, in general consumer-oriented smartphones and tablet devices with touch screens, their operation methods are pre-installed, whereas the screens and operation methods of the user interface terminals used at FA sites are created for each site. For example, display components such as lights, numerical values, and meters are arranged on the display screen of the user interface terminal using a software application called an engineering design tool, and the status read from the device is displayed on these display components. In addition, by arranging display components such as switches or input forms, these display components are set to receive information input from the manager at the site (for example, refer to Patent Document 1).

[0004] Patent Document 1 describes that a flick gesture for increasing or decreasing the amount of liquid in a tank is associated with a tank displayed on a touch panel, and that a pinch gesture for increasing or decreasing the opening of a valve is associated with the displayed valve.

[0005] In addition, the purpose of the user interface terminal is not limited to the communication with the external device, and the display screen of the user interface terminal may also be provided with a switch for updating the displayed content. Thus, in order to exert the functions completed inside the user interface terminal, a touch screen is sometimes used.

[0006] Patent Document 1: Japanese Patent Application Publication No. 2017-168102 Summary of the invention

[0007] Since the display components are associated with the touch operation one-to-one, there is a tendency to configure multiple display components in the display screen, and the types of such display screens are also increasing. Therefore, the user interface provided to the on-site manager becomes difficult to understand, and on this basis, in order to make the user interface terminal perform the intended function, it is often necessary to repeat the touch operation multiple times. Therefore, there is a risk of a large operational burden on the manager who uses the user interface terminal on the FA site.

[0008] The present invention has been made in view of the above circumstances, and an object of the present invention is to reduce the operational burden on a manager who uses a user interface terminal at a FA site.

[0009] In order to achieve the above-mentioned purpose, the terminal operation setting program of the present invention enables a computer to function as a receiving unit and a setting unit, and the computer is connected to a user interface terminal for controlling a device. The receiving unit receives a designation of a first contact operation on a display component displayed on a touch screen of the user interface terminal, a designation of a first process that the user interface terminal should execute when the first contact operation is performed, a designation of a second contact operation different from the first contact operation on the display component, and a designation of a second process different from the first process that the user interface terminal should execute when the second contact operation is performed. The setting unit sets the user interface terminal to execute the first process when the first contact operation is performed on a component area corresponding to the display component in the display area of ​​the touch screen and to execute the second process when the second contact operation is performed on the component area, and sets the user interface terminal to execute the first process and the second process when the second contact operation is performed outside the component area before the end of the first contact operation is detected when the first contact operation is performed on the component area.

[0010] Effects of the Invention

[0011] According to the present invention, it is possible to reduce the operational burden on a manager who uses a user interface terminal at a FA site. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 It is a diagram showing the relationship between a setting device and a user interface terminal according to an embodiment.

[0013] Figure 2 It is a diagram showing the hardware configuration of the FA device according to the embodiment.

[0014] Figure 3 It is a diagram showing the functional configuration of a setting device and a user interface terminal according to an embodiment.

[0015] Figure 4 This is a diagram showing an example of setting contents of a user interface according to an embodiment.

[0016] Figure 5 It is a diagram showing an example of a display component and a component area according to an embodiment.

[0017] Figure 6 It is a diagram for explaining a single-point tap operation on a display component according to an embodiment.

[0018] Figure 7It is a diagram for explaining a sliding operation on a display component according to an embodiment.

[0019] Figure 8 It is a diagram for explaining a two-point tap operation on a display member according to an embodiment.

[0020] Fig. 9 It is a diagram showing a first example of a plurality of touch operations on a display component according to an embodiment.

[0021] Fig.10 It is a diagram showing a second example of a plurality of touch operations on a display component according to an embodiment.

[0022] Fig.11 It is a diagram showing a third example of multiple touch operations on the display component involved in the embodiment.

[0023] Fig.12 It is a diagram showing a first example of a touch operation on a designated area according to the embodiment.

[0024] Fig.13 It is a diagram showing a second example of a touch operation on a designated area according to the embodiment.

[0025] Fig.14 This is a diagram for explaining output of a file representing a gesture operation according to an embodiment.

[0026] Fig.15 It is a diagram showing a first example of the continuous operation according to the embodiment.

[0027] Fig.16 It is a diagram showing a second example of the continuous operation according to the embodiment.

[0028] Fig.17 It is a flowchart showing the terminal operation setting processing involved in the implementation method.

[0029] Fig.18 It is a flowchart showing the terminal processing involved in the implementation method.

[0030] Fig.19 It is a diagram for explaining a combination of a first touch operation and a second touch operation according to an embodiment.

[0031] Fig. 20 It is a diagram showing a third example of the continuous operation according to the embodiment. DETAILED DESCRIPTION

[0032] Hereinafter, a user interface terminal and a setting device for setting an operation method for the user interface terminal according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings. Hereinafter, the user interface terminal will be appropriately referred to as a UI (User Interface) terminal.

[0033] Implementation

[0034] like Figure 1 As shown, the setting device 10 according to the present embodiment is an industrial PC (Personal Computer) connected to the UI terminal 20 and is used by an operator 31. The operator 31 uses the setting device 10 to set the arrangement of display components to be displayed on the screen of the UI terminal 20 as a user interface, the type of operation received by each display component, and the processing to be performed by the UI terminal 20 when each operation is performed. The setting device 10 corresponds to an example of a terminal operation setting device.

[0035] The UI terminal 20 is a programmable display connected to a control device 40 in a factory and used as an operation terminal of the control device 40. The manager 32 uses the UI terminal 20 to manage the control device 40 and the devices 42 to 44 connected to the control device 40 via the industrial network 41. The UI terminal 20 is connected to the setting device 10 via a communication line such as a USB (Universal Serial Bus) cable, and is connected to the control device 40 via a LAN (Local Area Network) or an industrial network.

[0036] The control device 40 is a PLC (Programmable Logic Controller), and the equipment 42~

[0037] 44 are devices to be controlled, such as sensors, actuators, valves, servo systems, and robots. The control device 40 collects sensing results from the sensor device 42, controls the servo system device 43 and the robot device 44, and thereby detects the workpiece conveyed by the belt conveyor, processes the workpiece, and carries it out. The content of the control performed by the control device 40 is managed by the administrator 32 using the UI terminal 20.

[0038] In addition, the following description will focus on an example in which a control system including a control device 40 and devices 42 to 44 is the object of management using the UI terminal 20, but the use of the UI terminal 20 is not limited to this. The UI terminal 20 is a terminal that becomes a user interface of a device used at the FA site, and its operation screen can be designed at the site. The UI terminal 20 is equivalent to an example of a user interface terminal for controlling the equipment. In addition, the operator 31 and the manager 32 can be the same user or different users.

[0039] The setting device 10 and the UI terminal 20 have Figure 2 A computer with the hardware structure shown in the figure. Figure 2 In the embodiment, the FA device 50 corresponds to each of the setting device 10 and the UI terminal 20. The FA device 50 includes a processor 51, a main storage unit 52, an auxiliary storage unit 53, an input unit 54, an output unit 55, and a communication unit 56. The main storage unit 52, the auxiliary storage unit 53, the input unit 54, the output unit 55, and the communication unit 56 are connected to the processor 51 via an internal bus 57.

[0040] The processor 51 includes a CPU (Central Processing Unit) as a processing circuit. The processor 51 realizes various functions by executing the program P1 stored in the auxiliary storage unit 53, and performs the processing described later.

[0041] The main storage unit 52 includes a RAM (Random Access Memory). The program P1 is loaded from the auxiliary storage unit 53 into the main storage unit 52. The main storage unit 52 is used as a work area for the processor 51.

[0042] The auxiliary storage unit 53 includes a nonvolatile memory represented by an EEPROM (Electrically Erasable Programmable Read-Only Memory) and an HDD (Hard Disk Drive). The auxiliary storage unit 53 stores various data used for processing by the program P1 and the processor 51. The auxiliary storage unit 53 supplies the data used by the processor 51 to the processor 51 according to the instruction of the processor 51, and stores the data supplied from the processor 51. The program P1 of the setting device 10 is equivalent to the above-mentioned engineering design tool, and is equivalent to an example of a terminal operation setting program.

[0043] The input unit 54 includes input devices represented by hardware switches, input keys, a keyboard, and a pointing device. The input unit 54 acquires information input by a user of the FA device 50 and notifies the processor 51 of the acquired information.

[0044] The output unit 55 includes a display device represented by an LED (Light Emitting Diode) and an LCD (Liquid Crystal Display) and an audio device represented by a buzzer and a speaker. The output unit 55 prompts the user with various information according to the instructions of the processor 51. In addition, the output unit 55 of the UI terminal 20 includes a display device that is integrated with the input unit 54 as a pointing device as a touch screen.

[0045] The communication unit 56 includes a communication interface circuit for communicating with an external device. The communication unit 56 receives a signal from the outside and outputs the data indicated by the signal to the processor 51. In addition, the communication unit 56 sends a signal indicating the data output from the processor 51 to the outside. The communication performed by the communication unit 56 may be a two-way communication with an external computer or may be a writing to a recording medium that is detachable from the FA device 50.

[0046] Through the cooperation of the above hardware structures, the setting device 10 and the UI terminal 20 can play various functions. Figure 3 As shown, the setting device 10 includes: a receiving unit 11, which receives the designation of the user interface to be set in the UI terminal 20; a determining unit 12, which determines whether the operation specified as the user interface can be set; a setting unit 13, which sets the designated user interface in the UI terminal 20; and an output unit 14, which outputs data representing the content of the user interface to the outside.

[0047] The receiving unit 11 is mainly implemented by the input unit 51 of the setting device 10. The receiving unit 11 may receive the designation of the user interface from the operator 31, or may receive the designation of the user interface by reading the file F1 from the address designated by the operator 31. Figure 4 As shown, the receiving unit 11 receives, as the content of the user interface, a combination of an operation target, a contact operation on the operation target, and a process to be executed by the UI terminal 20 when the contact operation is performed.

[0048] Specifically, as an operation object, Figure 4As illustrated in rows 61 to 63 of , the receiving unit 11 receives the designation of the display component A1 displayed on the touch screen 23 of the UI terminal 20 and its configuration. The display component A1 may be a display component such as a lamp, a meter, and a character string that displays the status of the devices 42 to 44 or the status of the parameters inside the UI terminal 20, or may be a display component such as a switch and an input form that receives information input by the hand 321 of the user administrator 32. The display component is essentially an image displayed on the touch screen 23, and the image may be drawn by the operator 31, read from an address specified by the operator 31, or selected by the operator 31 from a plurality of images included in the engineering design tool. The configuration of the display component A1 is represented by the coordinate value of the X axis and the coordinate value of the Y axis, with the display screen of the touch screen 23 being a two-dimensional plane defined by the X axis and the Y axis.

[0049] In addition, the receiving unit 11 receives a designation of a contact operation on the display part A1 from the operator 31. The contact operation on the display part A1 is started by bringing an object into contact with the display part A1 displayed on the touch screen 23. For example, Figure 5 As shown, if the fingertip of the hand 321 generates a contact point inside the component area A10 which is equal to the area where the display component A1 is displayed, an operation on the display component A1 is started.

[0050] In addition, the component area A10 is usually equal to the display area where the display component A1 is displayed, but the component area A10 may be smaller or larger than the display area. The component area A10 and the display area may overlap, and the greater the ratio of the overlapping area, the more the administrator 32 can operate the UI terminal 20 without feeling uncomfortable.

[0051] In addition, the generation of the contact point in the component area A10 can be a detectable physical phenomenon corresponding to the activation of the display component A1 due to the administrator 32 operating the display component A1. In detail, no matter whether the pointing device constituting the touch screen 23 is an electrostatic capacitance method, a resistance film method, an infrared blocking method, an ultrasonic surface elastic wave method, or other methods, if the position where the object contacts the touch screen 23 is detected, the position is the contact point. Regarding the release of the contact, it can also be a physical phenomenon that the pointing device can detect as the disappearance of the contact point.

[0052] When a contact surface between the touch screen 23 and an object is generated, the center of the contact surface can be set as the contact point. Here, the center of the contact surface can be the center of gravity of the contact surface, or a point defined by the average value of the maximum and minimum values ​​of the contact surface in the X-axis direction and the average value of the maximum and minimum values ​​of the contact surface in the Y-axis direction. In addition, the object generating the contact point is not limited to the hand 321, and can be other parts of the manager 32, or a stylus used by the manager 32.

[0053] exist Figure 6 In FIG. 1 , the process of the tapping operation is shown as the first example of the contact operation. Figure 6 As shown, if the fingertip of hand 321 moves to the top of display component A1 and component area A10, and the fingertip does not move but releases the contact after generating contact point 322, the tapping operation of pressing only one point of touch screen 23 is completed. Figure 6 It is also shown in FIG. 1 that, by performing the tapping operation, the display component A1 changes from the OFF state shown in hollow to the ON state filled in black. The state of the display component A1 is as shown in FIG. Figure 4 As shown in row 61 of , the display component A1 corresponds to the ON state or OFF state of the parameter of the device, and is equivalent to a switch for switching the state of the parameter.

[0054] exist Figure 7 In FIG. 1 , the flow of the sliding operation is shown as the second example of the contact operation. Figure 7 As shown in FIG. 1 , if the fingertip of the hand 321 generates a contact point 322 inside the component area A10 and moves as indicated by the shaded arrow while maintaining the contact and then releases the contact, the sliding operation is completed. Figure 7 It is also shown in FIG. 1 that, by performing the sliding operation, the character string 71 such as "Device 1" arranged near the display part A1 changes to the character string 72 such as "Device 2". Figure 4 As shown in row 62 of , the device corresponding to the display component A1 is switched by sliding in the left-right direction.

[0055] exist Figure 8 In FIG. 1 , the process of a two-point tapping operation is shown as the third example of a contact operation. Figure 8 As shown, inside the component area A10, the two fingertips of the hand 321 each simultaneously generate contact points 322, and then release the contact simultaneously without moving, and the two-point tapping operation is completed. Figure 8 It is also shown in FIG. 1 that a menu 73 is displayed near the display part A1 by performing a two-point tap operation.

[0056] In addition, if Figure 4 Lines 61 to 63 and Figures 6 to 8As shown, a plurality of touch operations and a process to be executed by the UI terminal 20 when each touch operation is performed can be specified for a single display part A1.

[0057] For example, Fig. 9 As shown, after selecting a device by sliding in the left-right direction on the display component A2 for inputting numerical values ​​and the component area A20 corresponding to the display component A2, the value can be increased or decreased by sliding in the up-down direction on the display component A2 and the component area A20. In addition, during the sliding operation in the left-right direction, a guide 74 indicating the currently selected device and the devices that can be selected by the sliding operation can be displayed. Similarly, during the sliding operation in the up-down direction, guides 75 and 76 indicating the current value and the value that can be input by the sliding operation can be displayed. In addition, in the display component A2, as shown in FIG. Fig. 9 The currently selected device is shown in the upper part, and the selected value can also be displayed for the currently selected device. For example, a value such as "150" for device 3 can also be displayed in Fig. 9 The upper display part A2.

[0058] In addition, if Fig.10 As shown, after selecting the magnification of the digit whose value is to be changed by sliding the display component A2 and the component area A20 in the left-right direction, the value of the digit may be increased or decreased by sliding the display component A2 and the component area A20 in the up-down direction. During the sliding operation in the left-right direction, a guide 77 indicating the magnification currently selected and the magnifications that can be selected by the sliding operation may be displayed. Similarly, during the sliding operation in the up-down direction, guides 78 and 79 indicating the currently selected value and the values ​​that can be input by the sliding operation may be displayed.

[0059] In addition, if Fig.11 As shown, after selecting a font by sliding the display component A3 and the component area A30 corresponding to the display component A3 in the left-right direction, a character can be selected by sliding the display component A3 and the component area A30 in the up-down direction. The fonts are, for example, uppercase letters, lowercase letters, numbers, and symbols. During the sliding operation in the left-right direction, a guide 701 indicating the currently selected font and the fonts that can be selected by the sliding operation can be displayed. Similarly, during the sliding operation in the up-down direction, guides 702 and 703 indicating the currently selected character and the characters that can be selected by the sliding operation can be displayed.

[0060] Back to Figure 4 , the receiving unit 11 receives the designation of the process that the UI terminal 20 should execute when the designated contact operation is performed. Fig. 9 The actions of determining the target device and determining the value to be set for the determined device correspond to the processing to be executed by the UI terminal 20.

[0061] The receiving unit 11 is equivalent to an example of a receiving unit that receives a specification of a first touch operation on a display component displayed on a touch screen of a UI terminal, a specification of a first process that the UI terminal should execute when the first touch operation is performed, a specification of a second touch operation on the display component that is different from the first touch operation, and a specification of a second process that the UI terminal should execute that is different from the first process when the second touch operation is performed.

[0062] Return to Figure 4 As shown in lines 64 and 65, the receiving unit 11 receives the designation of the designated area as an operation object different from the display component and the designation of the range of the designated area. The designated area is an area designated as the entire display screen of the touch screen 23 or a local area included in the display screen regardless of the presence or absence of the display component. The designated area may be a rectangle or may have other shapes. The range of the designated area is defined by determining its boundaries using XY coordinate values.

[0063] exist Fig.12 2 shows an example in which the display screen of the touch screen 23 is divided into three parts in the vertical direction, and the designated areas B1, B2, and B3 are determined in order from the top. For example, if a two-point tap operation is performed in the designated area B1, device 1 is selected, if a two-point tap operation is performed in the designated area B2, device 2 is selected, and if a two-point tap operation is performed in the designated area B3, device 2 is selected. Figure 4 Device 3 is selected as shown.

[0064] exist Fig.13 FIG. 2 shows an example of a left-right sliding operation in the designated area B4 at the bottom of the display screen of the touch screen 23. When the sliding operation is performed, Figure 4 As shown, the screen displayed by the touch screen 23 is switched. Fig.12 , 13 It can be seen that the designated areas B1 to B4 are all defined in a manner not corresponding to the display components.

[0065] Return to Figure 3 The determination unit 12 is mainly implemented by the processor 51 of the setting device 10. The determination unit 12 is equivalent to an example of a determination unit, which performs a determination related to the operation received by the receiving unit. The determination unit 12 determines whether the specified contact operation received by the receiving unit 11 is equal to a continuous operation including a plurality of contact operations received in the same manner. For example, Fig.14As shown in the upper left corner of the figure, a gesture operation can be specified for a specific operation object, such as a contact point moving downward and then moving to the right to move in an L-shaped path. However, since such a gesture operation is equal to a continuous operation including a downward sliding operation and a rightward sliding operation in sequence, it is difficult to determine whether the operation intended by the administrator 32 is a gesture operation or a continuous operation. As described above, the determination unit 12 detects two or more operations that are difficult to determine.

[0066] Here, the continuous operation is to make multiple contact operations continuous by performing the next contact operation before the contact operation is completed. Fig.15 3 shows an example in which, after a contact point 322 is generated by the fingertip of a hand 321 with respect to the display component A2 and the component area A20, a sliding operation is performed to the right, but the contact is not released and the sliding operation in the up-down direction is continued. Here, with respect to the individual sliding operation in the up-down direction with respect to the display component A2, the starting point of the movement of the contact point in the up-down direction needs to be inside the component area A20, and even if the sliding operation is performed outside the component area A20, it is not an operation on the display component A2. In contrast, when the sliding operation to the right with respect to the display component A2 is not terminated by the release of the contact, and the next sliding operation in the up-down direction is performed while the contact is maintained, the sliding operation in the up-down direction becomes an operation on the display component A2.

[0067] exist Fig.16 , after a font is selected by a downward sliding operation on the display component A3 and the component area A30, an example is shown in which a character is selected by a sliding operation in the left and right directions as the next operation while maintaining the contact state. Fig.16 In the example of , the second sliding operation is performed outside the component area A30 from the start to the end, but since the first sliding operation is not ended by the release of contact, it is an operation on the display component A3.

[0068] Back to Figure 3 , the setting unit 13 is mainly implemented by the cooperation of the above-mentioned processor 51 and the communication unit 56 of the setting device 10. The setting unit 13 sets the content of the user interface received by the receiving unit 11 in the UI terminal 20. However, the setting unit 13 can also set a specific one of the two or more operations that are determined by the determination unit 12 to be difficult to distinguish as a setting object, and exclude other operations from the setting objects. For example, in the case where the receiving unit 11 receives a sliding operation in the up and down directions, a sliding operation in the left and right directions, and a gesture operation of an L-shaped path, since a continuous operation including two sliding operations is sometimes equal to a gesture operation, the setting unit 13 can also exclude the gesture operation from the setting object.

[0069] In this case, the setting unit 13 may exclude the two sliding operations that constitute the continuous operation from the setting object. The setting unit 13 may set the first received operation of the two operations that are difficult to distinguish as the setting object, or may notify the operator 31 that the operation cannot be set and allow the operator 31 to select the operation that should be set as the setting object.

[0070] The setting unit 13 is equivalent to an example of a setting unit, which sets the UI terminal to execute the first process when the first touch operation is performed on a component area corresponding to the display component in the display area of ​​the touch screen and to execute the second process when the second touch operation is performed on the component area, and sets the UI terminal to execute the first process and the second process when the second touch operation is performed outside the component area before the end of the first touch operation is detected when the first touch operation is performed on the component area.

[0071] The output unit 14 is mainly implemented by the processor 51 and the communication unit 56 of the setting device 10. The output unit 14 outputs the file F2 indicating the contents of the settings made by the setting unit 13. The output by the output unit 14 may be written to a recording medium such as a memory card that is removable from the setting device 10, may be written to an external server device, or may be written to the main storage unit 52 or the auxiliary storage unit 53 of the setting device 10.

[0072] By outputting the file F2 by the output unit 14, as shown in FIG. Fig.14 As shown, it is easy to reflect the contents of the settings made by the setting device 10 on the multiple UI terminals 20 and 20a. In addition, the user interface of the UI terminal 20a can be easily set by selecting from the files F2 and F3. In particular, since the gesture operation specifies the moving path of the contact point, it is a troublesome task to re-set the same operation as a specific gesture operation, but if a file representing the setting contents of the user interface is used, such a task can be omitted. The output unit 14 corresponds to an example of an output unit, which outputs the data indicating the path of the contact point movement specified by the receiving unit.

[0073] Back to Figure 3 The UI terminal 20 includes: a receiving unit 21 that receives settings made by the setting device 10; a processing unit 22 that performs processing based on the received settings; and a touch screen 23 that is used by the administrator 32. The receiving unit 21 is implemented by the communication unit 56 of the UI terminal 20, the processing unit 22 is implemented by the processor 51 of the UI terminal 20, and the touch screen 23 is implemented by the cooperation of the input unit 54 and the output unit 55 of the UI terminal 20.

[0074] The receiving unit 21 is equivalent to an example of a receiving unit that receives settings related to the operation of the touch screen. The processing unit 22 is equivalent to an example of a processing unit that executes processing in accordance with the settings. Here, the processing unit executes the first processing when the first contact operation is performed on the component area corresponding to the display component in the display area of ​​the touch screen, and executes the second processing when the second contact operation is performed on the component area. In the case of the first contact operation on the component area, when the second contact operation is performed outside the component area before the first contact operation is detected to be completed, the first processing and the second processing are executed.

[0075] Next, the terminal operation setting process executed by the setting device 10 and the terminal process executed by the UI terminal 20 will be described in order. The terminal operation setting process corresponds to an example of a terminal operation setting method.

[0076] like Fig.17 As shown, in the terminal operation setting process, the receiving unit 11 receives the designation of the display component or the designated area as the operation object (step S1), and receives the designation of the contact operation for the operation object (step S2). Then, the determination unit 12 determines whether the designated contact operation received in step S2 is equal to the existing operation (step S3). Here, the existing operation includes a combination of all contact operations received in the past, that is, a continuous operation. For example, in the case where the designation of the sliding operation in the left and right directions and the sliding operation in the up and down directions was received in the past, it is determined whether the newly received contact operation in step S2 can be represented by a combination of greater than or equal to two of the four operations of left, right, up and down.

[0077] If it is determined that the received contact operation is equal to the existing operation (step S3; Yes), the process returns to step S2, and the receiving unit 11 prompts the operator 31 to designate a new contact operation, and the designation is received. In the above description related to the setting unit 13, it is described that a part of two or more operations that are difficult to distinguish are excluded from the setting object, but if Fig.17 As shown, at the stage where an operation that is difficult to distinguish is designated, the receiving unit 11 may receive a new operation that can be distinguished, and as a result, the operation that is difficult to distinguish is excluded from the setting targets in the UI terminal 20.

[0078] When it is determined that the received touch operation is not equal to the existing operation (step S3; No), the receiving unit 11 receives a designation of a process to be executed by the UI terminal 20 when the touch operation received in step S2 is performed (step S4).

[0079] Next, the receiving unit 11 determines whether to further add a designation of a combination of an operation target, a contact operation, and a process to be executed (step S5 ). Specifically, the receiving unit 11 determines whether the designation by the operator 31 is completed.

[0080] If it is determined that there is a further addition (step S5; Yes), the setting device 10 repeats the processing of step S1 and thereafter. On the other hand, if it is determined that there is no further addition (step S5; No), the receiving unit 11 receives the designation of the object of the continuous operation (step S6). Specifically, the selection of the contact operation that can constitute the continuous operation starting from the already designated contact operation is received. In this way, it is possible to avoid continuous operations that deviate from the intention of the operator 31 in the UI terminal 20.

[0081] Next, the setting unit 13 sets the operation target, the combination of the contact operation and the process to be executed, and the target of the continuous operation in the UI terminal 20 (step S7). Then, the terminal operation setting process ends.

[0082] In the terminal processing performed by the UI terminal 20, as Fig.18 As shown, the processing unit 22 determines whether the contact operation registered in the UI terminal 20 is performed on the area of ​​the operation object corresponding to the contact operation (step S11). When it is determined that the contact operation is not performed (step S11; No), the processing unit 22 repeats the determination of step S11 and waits until the registered contact operation is performed.

[0083] On the other hand, when it is determined that a contact operation has been performed (step S11; Yes), the processing unit 22 performs processing corresponding to the contact operation (step S12). Next, the processing unit 22 determines whether the end of the contact operation just performed is detected (step S13). Specifically, the processing unit 22 determines whether the contact of the object with the touch screen 23 is released. When it is determined that the end of the contact operation is detected (step S13; Yes), the terminal processing ends.

[0084] On the other hand, when it is determined that the end of the contact operation is not detected (step S12; No), the processing unit 22 determines whether a contact operation different from the previous contact operation has been performed on the touch screen 23 (step S14). For example, after the determination in step S13 is negative, in the first step S14, it is determined whether a new contact operation has been performed on the operation object determined to have been contacted in step S11.

[0085] Here, use Fig.19 The combination of contact operations that constitute the continuous operation is explained. Fig.19, four combinations of a first contact operation as a tap operation or a slide operation and a second contact operation as a tap operation or a slide operation are schematically shown. In addition, examples of tap operations include single-point tap operations and multi-point tap operations, examples of slide operations include single-point slide operations and multi-point slide operations, and include swipe operations with a specified end point of movement of the contact point and flick operations with no specified end point.

[0086] In the case where both the first contact operation and the second contact operation are tapping operations, such as Fig.19 As shown, for example, a first contact point is generated by a single-point tapping operation performed by the thumb, i.e., a first contact operation, and in this state, two second contact points different from the first contact point are generated by a second contact operation performed by the index finger and the middle finger. In addition, when the first contact operation is a tapping operation and the second contact operation is a sliding operation, for example, a first contact point is generated by a single-point tapping operation performed by the thumb, i.e., a first contact operation, and in this state, a second contact point different from the first contact point is generated by a second contact operation performed by the index finger and moves.

[0087] In the case where the first contact operation is a sliding operation and the second contact operation is a tapping operation, for example, after the first contact point is moved by the first contact operation performed with the index finger, a second contact point different from the first contact point is generated by the second contact operation performed with the thumb. In addition, in the case where both the first contact operation and the second contact operation are sliding operations, for example, after the first contact point is moved by the first contact operation performed with the index finger, the second contact operation is performed by moving the first contact point in a direction different from the first contact operation. In this example, the second contact point used in the second contact operation may be equal to the first contact point, but the first contact point and the second contact point may be different contact points, and the first contact operation and the second contact operation may be performed as sliding operations. That is, without releasing the contact of the first contact point achieved by the first contact operation, a second contact point may be generated and moved in a different direction.

[0088] In addition, Fig.19 In the description, examples are given in which the contact operation is a tap operation and a slide operation, but when the contact operation is a gesture operation, a pinch operation, a double-click operation, or other operations, such contact operations can also constitute continuous operations.

[0089] Return to Fig.18In step S14, if it is determined that a contact operation different from the previous contact operation has not been performed (step S14; No), the processing unit 22 repeats step S13 and subsequent processing, waiting until the contact operation ends or a new contact operation is performed. On the other hand, if it is determined that a contact operation has been performed (step S14; Yes), the processing unit 22 determines whether the contact operation is an object of a continuous operation (step S15).

[0090] If it is determined that the terminal is a target of continuous operation (step S15; Yes), the processing unit 22 receives the contact operation and performs processing corresponding to the contact operation (step S16). After that, the processing unit 22 repeats the processing in step S13 and thereafter. On the other hand, if it is determined that the terminal is not a target of continuous operation (step S15; No), the processing unit 22 does not receive the contact operation and ends the terminal processing.

[0091] As described above, since multiple touch operations are specified for a single display component, the display component is multifunctional, and the number of display components configured on the display screen of the touch screen 23 can be reduced. This increases the freedom of screen design and helps simplify the user interface. In addition, continuous operations can be performed on display components, so there is no need to repeat touch operations that should start from the component area, which can reduce the operation burden on the administrator 32. For example, Fig. 20 As shown, by alternately and continuously performing the sliding operation in the left-right direction and the up-down direction from within the component area, the manager 32 does not need to move the fingertip on the display component for the second and subsequent touch operations.

[0092] In addition, since the gesture operation that specifies the moving path of the contact point can be specified, the operator 31 can arbitrarily create personal contact operations. For example, by assigning a gesture operation that draws the initials of the processing content to the operation object, a user interface that is easy for the manager 32 to understand can be realized.

[0093] In particular, gesture operation is also used in common smart phones and tablet terminals for consumers, but since they are for consumers, the gesture operation is sought to be simple. In contrast, regarding the UI terminal 20 used at the FA site, since it is used by a professional manager 32, it is possible to allow special operations such as setting of continuous operations including multiple gesture operations. That is, the first contact operation and the second contact operation constituting the continuous operation may be gesture operations that move the first contact point corresponding to the first contact operation and the second contact point corresponding to the second contact operation in different paths, or the receiving unit 11 may receive the designation of the path for the first contact point to move in the first contact operation and the designation of the path for the second contact point to move in the second contact operation. The output unit 14 may also output data indicating the paths for the first contact point and the second contact point to move respectively. In addition, it is also possible to create a complex gesture operation and assign the gesture operation to a hidden function in a manner that only the user who knows the gesture operation can perform the gesture operation. It is also possible to pre-register gesture operations that depict letters and numbers respectively, and the UI terminal 20 receives continuous operations such as sequential input of characters constituting a password.

[0094] In addition, the setting device 10 receives the designation of the designated area as the operation object. Specifically, the receiving unit 11 receives the designation of the contact operation made to the designated area as the local area included in the display area or the display area as a whole, and the designation of the processing that the UI terminal 20 should perform when the contact operation is performed, and the setting unit 13 sets the UI terminal 20 to perform the designated processing when the contact operation is performed in the designated area. As a result, the operation of the UI terminal 20 can be implemented without configuring a display component. Therefore, the number of display components can be reduced. Here, the contact operation on the designated area is equivalent to an example of the third contact operation, and the processing performed when the contact operation is performed is equivalent to an example of the third processing.

[0095] In addition, the determination unit 12 determines whether the contact operation is equal to a continuous operation including other contact operations. Moreover, when it is determined that the contact operation is equal to the continuous operation, the setting unit 13 excludes the contact operation from the object set for the UI terminal 20. Thus, reliable operation of the UI terminal 20 can be achieved. Here, the contact operation that is determined to be equal to the continuous operation is equivalent to an example of the fourth contact operation. The fourth contact operation is an operation different from the first contact operation and the second contact operation for a display component that is the object of the first contact operation and the second contact operation that constitute the continuous operation by being performed in sequence, and the designation of the fourth contact operation is received by the receiving unit 11.

[0096] As mentioned above, although embodiment of this invention was described, this invention is not limited to the said embodiment.

[0097] For example, the end of the contact operation corresponds to the release of the contact with the touch screen 23 , but the present invention is not limited thereto. For example, the end of the contact operation may be the pressing of a button of a stylus pen capable of communicating with the UI terminal 20 .

[0098] The functions of the setting device 100 and the UI terminal 20 according to the above-described embodiment can also be realized by dedicated hardware or a general computer system.

[0099] For example, the program P1 may be stored in a computer-readable recording medium such as a floppy disk, a CD-ROM (Compact Disk Read-Only Memory), a DVD (Digital Versatile Disk), or an MO (Magneto-Optical Disk) and distributed, and installed in a computer, thereby forming a device that executes the above-mentioned processing.

[0100] Alternatively, the program P1 may be stored in advance in a disk device of a server device on a communication network such as the Internet, and may be superimposed on a carrier wave and downloaded to a computer, for example.

[0101] Furthermore, the above-described processing can also be realized by starting and executing the program P1 while transferring it via a network represented by the Internet.

[0102] Furthermore, the above-described processing can also be realized by executing all or part of the program P1 on a server device, and by causing a computer to execute the programs P1 and P2 while transmitting and receiving information related to the processing via a communication network.

[0103] Furthermore, when the above functions are realized by sharing the responsibility of the OS or by cooperative operation of the OS and the application, only the portion other than the OS may be stored in a medium and distributed, or may be downloaded to a computer.

[0104] In addition, the means for realizing the functions of the setting device 10 and the UI terminal 20 are not limited to software, and a part or all of them may be realized by dedicated hardware or circuits.

[0105] The present invention can be set to various embodiments and variations without departing from the broad spirit and scope of the present invention. In addition, the above-mentioned embodiments are used to illustrate the present invention and are not intended to limit the scope of the present invention. That is, the scope of the present invention is not represented by the embodiments, but by the claims. Moreover, various variations implemented within the scope of the claims and within the scope of the disclosure equivalent thereto are deemed to fall within the scope of the present invention.

[0106] Industrial Applicability

[0107] The present invention is suitable for designing a user interface of a terminal used at a FA site.

[0108] Description of the label

[0109] 10 setting device, 11 receiving unit, 12 determining unit, 13 setting unit, 14 output unit, 20, 20a UI terminal, 21 receiving unit, 22 processing unit, 23 touch screen, 31 operator, 32 manager, 321 hand, 322 contact point, 40 control device, 41 industrial network, 42-44 equipment, 50 FA device, 51 processor, 52 main storage unit, 53 auxiliary storage unit, 54 input unit, 55 output unit, 56 communication unit, 57 internal bus, 61-65 lines, 71, 72 character string, 73 menu, 74-79, 701-703 boot, A1-A3 display parts, A10, A20, A30 part area, B1-B4 specified area, F1-F3 file, P1 program.

Claims

1. A terminal operation setting program for causing a computer to function as a receiving unit and a setting unit, the computer being connected to a user interface terminal for controlling a device, The receiving unit receives a designation of a first contact operation on a display component displayed on a touch screen of the user interface terminal, a designation of a first process that the user interface terminal should execute when the first contact operation is performed, a designation of a second contact operation on the display component that is different from the first contact operation, and a designation of a second process that the user interface terminal should execute that is different from the first process when the second contact operation is performed. The setting unit sets the user interface terminal to execute the first process when the first contact operation is performed on a component area corresponding to the display component in the display area of ​​the touch screen and to execute the second process when the second contact operation is performed on the component area, and sets the user interface terminal to execute the first process and the second process when the second contact operation is performed outside the component area before the end of the first contact operation is detected when the first contact operation is performed on the component area.

2. The terminal operation setting program according to claim 1, wherein: The first contact operation is an operation of generating a first contact point between the object and the touch screen or moving the first contact point. The first contact operation ends by releasing the contact of the object. The second contact operation is an operation of generating a second contact point different from the first contact point or moving the second contact point.

3. The terminal operation setting program according to claim 1, wherein: The first contact operation is an operation of moving a first contact point where the object contacts the touch screen. The first contact operation ends by releasing the contact of the object. The second contact operation is an operation of moving a second contact point that is equal to the first contact point.

4. The terminal operation setting program according to claim 2 or 3, wherein: The first contact operation and the second contact operation are operations of moving the first contact point and the second contact point in different directions, respectively.

5. The terminal operation setting program according to claim 2 or 3, wherein: The first contact operation and the second contact operation are gesture operations that cause the first contact point and the second contact point to move along different paths. The receiving unit receives a designation of a path along which the first contact point moves in the first contact operation and a designation of a path along which the second contact point moves in the second contact operation.

6. The terminal operation setting program according to claim 5, which is used to make the computer further function as an output unit, The output unit outputs the data indicating the path along which the first contact point moves and the path along which the second contact point moves, which are designated and received by the receiving unit.

7. The terminal operation setting program according to any one of claims 1 to 6, wherein: The receiving unit receives a designation of a third touch operation on a designated area and a designation of a third process that the user interface terminal should execute when the third touch operation is performed, wherein the designated area is a local area included in the display area or the entire display area. The setting unit sets, in the user interface terminal, that the third process is executed when the third contact operation is performed in the designated area.

8. The terminal operation setting program according to any one of claims 1 to 7, wherein: further comprising a determination unit for making a determination related to the operation received by the receiving unit, The receiving unit receives a designation of a fourth contact operation different from the first contact operation and the second contact operation on the display component, The determination unit determines whether a continuous operation including the first touch operation and the second touch operation performed in sequence is equal to the fourth touch operation, The setting unit excludes the fourth touch operation from the objects of setting for the user interface terminal when it is determined that the continuous operation is equal to the fourth touch operation.

9. A terminal operation setting method, comprising: a receiving unit receiving a designation of a first contact operation on a display component displayed on a touch screen of a user interface terminal for controlling a device, a designation of a first process that the user interface terminal should execute when the first contact operation is performed, a designation of a second contact operation on the display component that is different from the first contact operation, and a designation of a second process that the user interface terminal should execute that is different from the first process when the second contact operation is performed, The setting unit sets, in the user interface terminal, that the first process is executed when the first contact operation is performed on a component area corresponding to the display component in the display area of ​​the touch screen, and that the second process is executed when the second contact operation is performed on the component area, The setting unit sets, in the user interface terminal, when the first contact operation is performed on the component area, the first process and the second process are executed when the second contact operation is performed outside the component area before the end of the first contact operation is detected.

10. A terminal operation setting device, connected to a user interface terminal for controlling a device, The terminal operation setting device has: a receiving unit that receives a designation of a first contact operation on a display component displayed on a touch screen of the user interface terminal, a designation of a first process that the user interface terminal should execute when the first contact operation is performed, a designation of a second contact operation on the display component that is different from the first contact operation, and a designation of a second process that the user interface terminal should execute that is different from the first process when the second contact operation is performed; and A setting unit, which sets the user interface terminal to execute the first process when the first contact operation is performed on a component area corresponding to the display component in the display area of ​​the touch screen and to execute the second process when the second contact operation is performed on the component area, and sets the user interface terminal to execute the first process and the second process when the second contact operation is performed outside the component area before the end of the first contact operation is detected when the first contact operation is performed on the component area.

11. A user interface terminal, which is used to control a device. The user interface terminal has: touchscreen; a receiving unit configured to receive settings related to the operation of the touch screen; and a processing unit that performs processing in accordance with the settings, The processing unit executes a first process when a first contact operation is performed on a component area corresponding to a display component in a display area of ​​the touch screen. The processing unit performs a second process different from the first process when a second contact operation different from the first contact operation is performed on the component area. The processing unit executes the first process and the second process when the second contact operation is performed outside the component area before detecting the end of the first contact operation when the first contact operation is performed on the component area.

Images