Terminal operating configuration program, terminal operating configuration procedure, terminal operating configuration device and user interface terminal

Abstract

A program causes a setting device (10) connected to a UI terminal (20) to function as a setter (13). The setter (13) configures the UI terminal (20) to execute a first process when a first contact operation is performed on a component area corresponding to a display component in a display area of ​​a touchscreen (23) in the user interface terminal (20), and to execute a second process when a second contact operation is performed on the component area. The UI terminal (20) is also configured to execute both the first and second processes if the first contact operation is performed on the component area and the second contact operation is performed outside the component area before the end of the first contact operation is detected.

Description

Technical area

[0001] The present disclosure relates to a terminal operation setting program, a terminal operation setting method, a terminal operation setting apparatus, and a user interface terminal.

[0002] At a factory automation (FA) site, a control system controls various devices such as programmable logic controllers and servo amplifiers. A user interface terminal, also known as a programmable display (PDI), is used to manage such a control system. The user interface terminal includes a touchscreen. The user interface terminal displays information collected from various devices via communication on the touchscreen and receives parameter or control command settings for the devices via the touchscreen.

[0003] Unlike typical consumer smartphones and tablet devices with touchscreens that use pre-installed operating methods, user interface terminals deployed at FA sites use screens and operating methods developed for each site. For example, a software application called an engineering tool is used to arrange display components such as lamps, numeric values, and meters on a screen in a user interface terminal to display status information read by devices on these display components. Display components such as switches or input forms are also arranged to receive information entered into these display components by a site manager (see, for example, Patent Literature 1).

[0004] Patent Literature 1 describes a tank displayed on a touch screen and associated with swiping gestures to increase or decrease the amount of liquid in the tank, and a valve displayed on the touch screen and associated with pinching gestures to increase or decrease the degree of valve opening.

[0005] The user interface terminal can be used without communication with an external device, and a switch for updating the displayed information can be placed on the screen of the user interface terminal. The touchscreen can thus be used to perform functions performed within the user interface terminal. Citation listPatent literature

[0006] Patent Literature 1: Disclosure of Unexamined Japanese Patent Application, Publication No. 2017-168102 Overview of the inventionTechnical problem

[0007] A single display component is uniquely associated with a single touch operation. Therefore, it is likely that multiple display components will be placed on the screen and that different screens will be used. This can complicate the user interface for the site manager. The manager will also likely repeat touch operations many times to prompt the user interface terminal to perform the intended functions. This can increase the workload of the manager using the user interface terminal at an FA site.

[0008] Under such circumstances, it is an object of the present disclosure to reduce the workload of an administrator using a user interface terminal at an FA site. Solution to the problem

[0009] To achieve the above-mentioned object, a terminal operation setting program according to one aspect of the present disclosure is executable by a computer connected to a user interface terminal for controlling a device. The program causes the computer to function as receiving means to receive an indication of a first contact operation on a display component displayed on a touch screen in the user interface terminal, an indication of a first process to be executed by the user interface terminal when the first contact operation is executed, an indication of a second contact operation on the display component, and an indication of a second process to be executed by the user interface terminal when the second contact operation is executed. The second contact operation is different from the first contact operation. The second process is different from the first process.The program causes the computer to function as setting means for setting the user interface terminal to execute the first process when the first contact operation is performed on a component area corresponding to the display component in a display area of ​​the touch screen and to execute the second process when the second contact operation is performed on the component area, and for setting the user interface terminal to execute the first process and the second process when the first contact operation is performed on the component area and the second contact operation is performed outside the component area before the end of the first contact operation is detected. Advantageous effects of the invention

[0010] The technique according to the above aspect of the present disclosure can reduce the workload of an administrator using a user interface terminal at an FA site. Short description of the drawings Fig. 1 is a diagram showing the relationship between a setting device and a user interface terminal according to an embodiment; Fig. 2 is a block diagram of an FA device according to the embodiment, the block diagram showing the hardware configuration; Fig. 3 is a functional block diagram of the setting device and the user interface terminal according to the embodiment; Fig. 4 is a table showing examples of settings of a user interface in the embodiment; Fig. 5 is a diagram of an exemplary display component and an exemplary component area in the embodiment; Fig. 6 is a diagram describing a single-point tap operation on the display component in the embodiment; Fig. 7 is a diagram describing a slide operation on the display component in the embodiment; Fig. 8 is a diagram describing a two-point tap operation on the display component in the embodiment; Fig. 9 is a diagram showing a first example of multiple contact operations on a display component in the embodiment; Fig. 10 is a diagram showing a second example of the multiple contact operations on the display component in the embodiment; Fig. 11 is a diagram showing a third example of the multiple contact operations on the display component in the embodiment; Fig. 12 is a diagram showing a first example of contact operation in a specific area in the embodiment; Fig. 13 is a diagram showing a second example of the contact operation in the specific area in the embodiment; Fig. 14 is a diagram showing the output of a file indicating a gesture operation in the embodiment; Fig. 15 is a diagram showing a first example of serial operation in the embodiment; Fig. 16 is a diagram showing a second example of serial operation in the embodiment; Fig. 17 is a flowchart of the terminal operation setting processing according to the embodiment; Fig. 18 is a flowchart of terminal processing in the embodiment; Fig. 19 is a diagram describing combinations of a first contact operation and a second contact operation in the embodiment; and Fig. 20 is a diagram showing a third example of serial operation in the embodiment. Description of the embodiments

[0011] A user interface terminal and a setting device for setting an operation method for the user interface terminal according to one or more embodiments of the present disclosure will be described in detail below with reference to the drawings. The user interface terminal (UI terminal) will be referred to as a UI terminal hereinafter, as appropriate. Embodiment

[0012] As in Fig. 1, a setting device 10 according to the present embodiment is a commercial personal computer (PC) connected to a UI terminal 20 and used by an operator 31. Using the setting device 10, the operator 31 sets, for the UI terminal 20 and as a user interface, the positions of display components to be displayed on a screen in the UI terminal 20, the types of operations to be received by each display component, and processes to be executed by the UI terminal 20 when each operation is performed. The setting device 10 corresponds to an example of a terminal operation setting device.

[0013] The UI terminal 20 is a programmable display connected to a controller 40 in a factory and used as an operation terminal for the controller 40. Using the UI terminal 20, a manager 32 manages the controller 40 and the devices 42 to 44 connected to the controller 40 via a commercial network 41. The UI terminal 20 is connected, for example, to the setting device 10 via a communication line such as a USB (Universal Serial Bus) cable, and to the controller 40 via a LAN (Local Area Network) or a commercial network.

[0014] The controller 40 is a programmable logic controller (PLC). Devices 42 to 44 are target devices to be controlled, such as sensors, actuators, valves, servo systems, and robots. For example, the controller 40 collects the detection results from device 42, which is a sensor, and controls device 43, which is a servo system, and device 44, which is a robot, to detect, process, and unload a workpiece conveyed by a conveyor belt. The details of the control performed by the controller 40 are managed by the manager 32 using the UI terminal 20.

[0015] In the example primarily described below, the UI terminal 20 is used to manage a control system including the controller 40 and the devices 42 to 44. However, the UI terminal 20 may also have other applications. The UI terminal 20 may be any terminal that functions as a user interface of a device used at a factory automation (FA) site, with an operation screen provided in the terminal at the site. The UI terminal 20 corresponds to an example of a user interface terminal for controlling devices. The operator 31 and the manager 32 may be the same user or different users.

[0016] The setting device 10 and the UI terminal 20 are each computers with the Fig. 2 shown hardware configuration. In Fig. 2, an FA device 50 corresponds to the setting device 10 and the UI terminal 20, respectively. The FA device 50 includes a processor 51, a main memory 52, an additional memory 53, an input device 54, an output device 55, and a communicator 56. The main memory 52, the additional memory 53, the input device 54, the output device 55, and the communicator 56 are connected to the processor 51 via an internal bus 57.

[0017] The processor 51 includes a central processing unit (CPU) as processing circuitry. The processor 51 executes a program P1 stored in the auxiliary memory 53 to implement various functions to perform the processes described later.

[0018] Main memory 52 includes random access memory (RAM). Program P1 is loaded from auxiliary memory 53 into main memory 52. ​​Main memory 52 is used as the work area for processor 51.

[0019] The auxiliary memory 53 includes a non-volatile memory such as an electrically erasable programmable read-only memory (EEPROM) or a hard disk drive (HDD). The auxiliary memory 53 stores the program P1 and various data items used for the processes executed by the processor 51. The auxiliary memory 53 provides the processor 51 with data that can be used by the processor 51 according to the instructions of the processor 51 and stores data provided by the processor 51. The program P1 for the setting device 10 corresponds to an example of the engineering tool described above and an example of a terminal operation setting program.

[0020] The input device 54 includes, for example, a hardware switch, an input key, a keyboard, or a pointing device. The input device 54 retrieves the information entered by the user into the FA device 50 and provides the retrieved information to the processor 51.

[0021] The output device 55 includes, for example, a display device, such as a light-emitting diode (LED) or a liquid crystal display (LCD), and an acoustic device, such as a buzzer or a speaker. The output device 55 provides the user with various information elements according to the instructions of the processor 51. The output device 55 in the UI terminal 20 includes a display device in the form of a touchscreen, which is integrated into the input device 54, which is a pointing device.

[0022] Communicator 56 includes a communication interface circuit for communicating with an external device. Communicator 56 receives an external signal and outputs data indicated by the signal to processor 51. Communicator 56 also transmits a signal representing the data output of processor 51 to the external device. The communication performed by communicator 56 can be bidirectional communication with an external computer or writing to a non-volatile recording medium that can be removed from FA device 50.

[0023] When the hardware components described above work together, the setting device 10 and the UI terminal 20 perform various functions. More specifically, the setting device 10 comprises, as shown in Fig. 3, a receiver 11 that receives an indication of the user interface to be set on the UI terminal 20, a determiner 12 that determines whether an operation designated as a user interface can be set, a setter 13 that sets the designated user interface for the UI terminal 20, and an output device 14 that outputs data indicating the settings of the user interface to the external device.

[0024] The receiver 11 is mainly implemented by the input device 51 in the above-described setting device 10. The receiver 11 can receive an indication of the user interface from the operator 31 or receive the indication of the user interface by reading a file F1 from an address specified by the operator 31. As shown in Fig. 4, the receiver 11 receives, as user interface setting combinations of an operation target, contact operations to be performed on the operation target, and processes to be executed by the UI terminal 20 when each contact operation is performed.

[0025] More precisely, as shown in lines 61 to 63 in Fig. 4, the receiver 11 receives an indication of a display component A1 as an operation target to be displayed on a touch screen 23 in the UI terminal 20, and the position of the display component A1. The display component A1 may be, for example, a lamp, a meter, or a character string that indicates the state of each of the devices 42 to 44 or an internal parameter in the UI terminal 20, or it may be, for example, a switch or an input form that receives information input with a hand 321 of the manager 32. A display component is essentially an image displayed on the touch screen 23, which may be drawn by the operator 31, read from an address designated by the operator 31, or selected by the operator 31 from a plurality of images included in the engineering tool.The position of the display component A1 is expressed by an X coordinate value and a Y coordinate value, where a display screen of the touch screen 23 is a two-dimensional plane defined by the X axis and the Y axis.

[0026] The receiver 11 receives an indication of a contact operation on the display component A1 from the operator 31. A contact operation on the display component A1 begins when an object comes into contact with the display component A1 displayed on the touchscreen 23. For example, as shown in Fig. 5, an operation on the display component A1 begins when a fingertip of the hand 321 creates a contact point in a component area A10 corresponding to an area in which the display component A1 is displayed.

[0027] The component area A10 typically corresponds to a display area in which the display component A1 is displayed, but may be smaller or larger than the display area. The component area A10 and the display area overlap each other. A larger overlap area generally allows the manager 32 to operate the UI terminal 20 without inconvenience.

[0028] The contact point is generated in the component area A10 as any detectable physical phenomenon associated with the activation of the display component A1 by the manager 32 to operate the display component A1. Specifically, when the pointing device included in the touchscreen 23 uses a capacitive, resistive, infrared, or ultrasonic surface wave method, or another method, a position detected as the position where the object is in contact with the touchscreen 23 is the contact point. The contact is released as any physical phenomenon detectable by the pointing device as the disappearance of the contact point.

[0029] When an area of ​​the object comes into contact with the touchscreen 23, the center of the contact area may be the contact point. The center of the contact area may be the center of gravity of the contact area or a point defined by the average of the maximum and minimum values ​​of the contact area in the X direction and the average of the maximum and minimum values ​​of the contact area in the Y direction. The object that creates a contact point is not limited to the hand 321 and may be any other part of the manager 32 or a stylus used by the manager 32.

[0030] Fig. 6 shows a method of touch operation as a first example of contact operation. As in Fig. As shown in Figure 6, the fingertip of hand 321 moves directly over display component A1 and component area A10, creates a contact point 322, and then releases the contact without moving. This completes the tap operation in which a single point on touchscreen 23 is pressed. Fig. Figure 6 also shows the tap operation that causes the display component A1 to change from an off state, indicated by a solid white color, to an on state, indicated by a solid black color. The state of the display component A1 corresponds to an on or off state of a device parameter, as shown in line 61 in Fig. 4. The display component A1 corresponds to a switch for switching the state of the parameter.

[0031] Fig. Figure 7 shows a sliding operation as a second example of contact operation. As in Fig. As shown in Figure 7, the fingertip of hand 321 creates the contact point 322 in component area A10, moves as indicated by a hatched arrow while maintaining contact, and then releases the contact. This completes the sliding operation. Fig. Figure 7 also shows the sliding operation that causes a character string 71 from device 1 near the display component A1 to change to a character string 72 from device 2. In other words, as shown in line 62 in Fig. As shown in Fig. 4, the sliding operation in the lateral direction or a lateral sliding operation switches the devices connected to the display component A1.

[0032] Fig. Figure 8 shows a two-point touch operation as a third example of contact operation. As in Fig. As shown in Figure 8, two fingertips of hand 321 simultaneously create two contact points 322 in component area A10 and then simultaneously release contact without moving. This completes the two-point tap operation. Fig. 8 also shows that the two-point tap operation causes a menu 73 to be displayed near the display component A1.

[0033] As in lines 61 to 63 in Fig. 4 and in the Fig. 6 to 8, a plurality of contact operations and processes to be executed by the UI terminal 20 when each contact operation is executed can be determined for the single display component A1.

[0034] For example, as in Fig. 9, a device can be selected by the lateral sliding operation on a display component A2 for entering a numerical value and a component range A20 corresponding to the display component A2. The value can then be increased or decreased by the sliding operation in the vertical direction or a vertical sliding operation on the display component A2 and the component range A20. During the lateral sliding operation, a guide 74 can be displayed to indicate the currently selected device and other devices selectable by the sliding operation. Similarly, during the vertical sliding operation, a guide 75 or 76 can be displayed to indicate the current value and other values ​​that can be entered by the sliding operation. The display component A2 can display the currently selected device, as shown in the upper section of Fig. 9, or display the value selected for the currently selected device. For example, the display component A2 in the upper section of Fig. 9 show a value of 150 for device 3.

[0035] As in Fig. As shown in Figure 10, a multiplication factor for a digit of a value to be changed can be selected by the lateral sliding operation on the display component A2 and the component area A20, and the value in the digit can then be increased or decreased by the vertical sliding operation on the display component A2 and the component area A20. During the lateral sliding operation, a guide 77 may be displayed to indicate the currently selected multiplication factor and other multiplication factors that can be selected by the sliding operation. Similarly, during the vertical sliding operation, a guide 78 or 79 may be displayed to indicate the currently selected value and other values ​​that can be entered by the sliding operation.

[0036] As in Fig. As shown in Figure 11, a character type can be selected by the side-sliding operation on a display component A3 and a component area A30 corresponding to the display component A3, and a character can then be selected by the vertical sliding operation on the display component A3 and the component area A30. The character types can be, for example, uppercase and lowercase alphabetic letters, numbers, and symbols. During the side-sliding operation, a guide 701 can be displayed to indicate the currently selected character type and other character types selectable by the sliding operation. Similarly, during the vertical sliding operation, a guide 702 or 703 can be displayed to indicate the currently selected character and other characters selectable by the sliding operation.

[0037] Related back to Fig. 4, the receiver 11 receives an indication of the processes to be executed by the UI terminal 20 when each particular contact operation is performed. For example, in Fig. 9 the processes to be executed by the UI terminal 20, the selection of a target device and a value to be set for the selected device.

[0038] The receiver 11 corresponds to an example of receiving means for receiving an indication of a first contact operation on a display component displayed on a touch screen in the UI terminal, an indication of a first process to be executed by the UI terminal when the first contact operation is executed, an indication of a second contact operation different from the first contact operation on the display component, and an indication of a second process different from the first process to be executed by the UI terminal when the second contact operation is executed.

[0039] Referring back to the figure shown in lines 64 and 65 Fig. 4, the receiver 11 receives an indication of specific areas as operation targets different from the display components and of the perimeters of the specific areas. A specific area is defined as the entire area of ​​the display screen of the touchscreen 23 or a partial area of ​​the display screen with or without display components. The specific area may be rectangular or have any other shape. The perimeter of the specific area is defined by identifying the boundary of the specific area using XY coordinates.

[0040] Fig. Figure 12 shows an example of a display screen of the touchscreen 23, which is vertically divided into three sections, referred to from top to bottom as specific areas B1, B2, and B3. For example, the two-point tap operation in the specific area B1 selects device 1, the two-point tap operation in the specific area B2 selects device 2, and the two-point tap operation in the specific area B3 selects device 3, as shown in Fig. 4 shown.

[0041] Fig. 13 shows an example of a side sliding operation in a specific area B4 in the lowest part of the display screen of the touch screen 23. As in Fig. 4, the slide control switches the screens displayed on the touchscreen 23. As shown in the Fig. 12 and Fig. 13, the specific areas B1 to B4 are each defined without being connected to a display component.

[0042] Related back to Fig. 3, the determiner 12 is mainly implemented by the processor 51 in the above-described setting device 10. The determiner 12 corresponds to an example of determining means for making a determination regarding the operation received by the receiving means. The determiner 12 determines whether the specific contact operation received by the receiver 11 corresponds to a serial operation comprising a plurality of contact operations received in the same manner as the specific contact operation. For example, as shown in the upper left section of Fig. 14, a gesture operation in which the contact point moves downward and then rightward to move along an L-shaped path can be determined for a specific operation target. However, the gesture operation corresponds to a serial operation including a downward slide operation and a right slide operation in this order. Therefore, it is difficult to determine whether an operation intended by the manager 32 is the gesture operation or the serial operation. The determiner 12 detects such two or more operations that are indistinguishable from each other.

[0043] In serial operation, one contact operation is followed by the next contact operation before the contact operation is completed in order to carry out several contact operations in succession. Fig. In the example shown in Figure 15, after creating the contact point 322 on the display component A2 and the component area A20 and performing the rightward slide operation, the fingertip of the hand 321 then performs the vertical slide operation without releasing the contact point. For the single vertical slide operation on the display component A2, the contact point must have a starting point of vertical movement within the component area A20. Therefore, the same slide operation performed outside the component area A20 is not an operation on the display component A2. On the other hand, if the rightward slide operation on the display component A2 is not completed by releasing the contact and then performing the vertical slide operation while maintaining the contact, the vertical slide operation is an operation on the display component A2.

[0044] In the example in Fig. 16, the vertical slide operation on the display component A3 and the component area A30 to select a character type is followed by the lateral slide operation to select a character, while maintaining contact. In the example in Fig. 16, the second sliding operation is also performed outside the component area A30 from the beginning to the end of the movement, but is an operation on the display component A3, wherein the first sliding operation is not completed by releasing the contact.

[0045] Related back to Fig. 3, the adjuster 13 is mainly implemented by the processor 51 and the communicator 56 in the above-described setting device 10, which cooperate with each other. The adjuster 13 sets the user interface settings received from the receiver 11 on the UI terminal 20. However, if two or more operations are determined by the determiner 12 to be indistinguishable from each other, the adjuster 13 may set a single specific operation among the operations as the setting target and exclude the other operations from the setting targets. For example, if the receiver 11 receives the vertical slide operation, the side slide operation, and the gesture operation along the L-shaped path, a serial operation including the two slide operations may correspond to the gesture operation. The adjuster 13 may therefore exclude the gesture operation from the setting targets.

[0046] In this case, the setter 13 may exclude the two sliding operations included in the serial operation from the setting targets. The setter 13 may set the operation received first among the two or more operations that are indistinguishable from each other, or it may notify the operator 31 that the operations cannot be set and allow the operator 31 to select operations to be the setting targets.

[0047] The adjuster 13 corresponds to an example of setting means for setting the UI terminal to execute the first process when the first contact operation is performed on the component area corresponding to the display component in the display area of ​​the touch screen, to execute the second process when the second contact operation is performed on the component area, and for setting the UI terminal to execute the first process and the second process when the first contact operation is performed on the component area and the second contact operation is performed outside the component area before an end of the first contact operation is detected.

[0048] The output device 14 is primarily implemented by the processor 51 and the communicator 56 in the setting device 10. The output device outputs a file F2 indicating the settings set by the adjuster 13. The output by the output device 14 can be writing to a non-volatile recording medium removable from the setting device 10, such as a memory card, writing to an external server, or writing to the main memory 52 or the auxiliary memory 53 in the setting device 10.

[0049] Since the output device 14 outputs the file F2, the settings set by the setting device 10 can be easily reproduced on multiple UI terminals 20 and 20a, as shown in Fig. 14. The user interface of the UI terminal 20a can also be easily configured by selecting from the files F2 and F3. Specifically, the gesture operation involves specifying a movement path of the contact point, making it difficult to repeatedly set the same gesture operation as a specific gesture operation. Such complicated operation can be eliminated by using the files each specifying a user interface setting. The output device 14 corresponds to an example of output means for outputting data indicating the movement path of the contact point in the information received from the receiving means.

[0050] Related back to Fig. 3, the UI terminal 20 includes a receiver 21 that receives settings from the setting device 10, a processing device 22 that performs processing based on the received settings, and the touchscreen 23 to be used by the manager 32. The receiver 21 is implemented by the communicator 56 in the UI terminal 20 described above. The processing device 22 is implemented by the processor 51 in the UI terminal 20 described above. The touchscreen 23 is implemented by the input device 54 and the output device 55 in the UI terminal 20 described above, which cooperate with each other.

[0051] The receiver 21 corresponds to an example of receiving means for receiving settings via touchscreen operations. The processing device 22 corresponds to an example of processing means for performing processing based on the settings. The processing device executes the first process when the first contact operation is performed on the component area corresponding to the display component in the display area of ​​the touchscreen, executes the second process when the second contact operation is performed on the component area, and executes the first process and the second process when the first contact operation is performed on the component area and the second contact operation is performed outside the component area before the end of the first contact operation is detected.

[0052] The terminal operation setting processing performed by the setting device 10 will now be described. The terminal processing performed by the UI terminal 20 will then be described. The terminal operation setting processing corresponds to an example of a method for setting terminal operations.

[0053] At the Fig. In the terminal operation setting processing shown in Figure 17, the receiver 11 receives the indication of the display component or the designated area as the operation target (step S1) and receives the indication of the contact operation at the operation target (step S2). The determiner 12 then determines whether the designated contact operation received in step S2 corresponds to one of the received operations (step S3). The received operations include all serial operations that are combinations of previously received contact operations. For example, when the indication of the side-sliding operation and the vertical-sliding operation has been previously received, the determiner 12 determines whether the newly received contact operation in step S2 is expressed as a combination of two or more of four operations, or as an operation to the left, right, up, or down.

[0054] If it is determined that the newly received contact operation corresponds to one of the previously received operations (Yes in step S3), processing returns to step S2. The receiver 11 then requests the operator 31 to specify a new contact operation in order to receive the contact operation indication. In the example described above, the setter 13 may exclude some of the two or more operations that are indistinguishable from each other. However, as shown in Fig. As shown in Fig. 17, an operation that is indistinguishable from the other can be excluded from the setting targets for the UI terminal 20 when the receiver 11 receives a new operation that is distinguishable when the indistinguishable operation is determined.

[0055] If it is determined that the received contact operation does not correspond to any of the previously received operations (No in step S3), the receiver 11 receives the indication of the process to be executed by the UI terminal 20 when executing the contact operation received in step S2 (step S4).

[0056] The receiver 11 then determines whether to add the information of another combination of the operation target, the contact operations, and the processes to be executed (step S5). More specifically, the receiver 11 determines whether an information provided by the operator 31 is complete.

[0057] If the receiver 11 determines to add the indication (Yes in step S5), the setting device 10 repeats the processing in step S1 and subsequent steps. If it determines not to add the indication (No in step S5), the receiver 11 receives the indication of the serial operation targets (step S6). Specifically, the receiver 11 receives, from among the contact operations that have been determined, a selection of contact operations that can be included in the serial operations. This prevents the serial operations that are not intended by the operator 31 from being executed on the UI terminal 20.

[0058] The setter 13 then sets the combinations of the operation target, the contact operations, the processes to be executed, and the serial operation targets on the UI terminal 20 (step S7). The terminal operation setting processing then ends.

[0059] At the Fig. In the terminal processing by the UI terminal 20 shown in FIG. 18, the processing device 22 determines whether the contact operation registered in the UI terminal 20 is being executed within a range of the operation target associated with the contact operation (step S11). If it is determined that the contact operation is not being executed (No in step S11), the processing device 22 repeats the determination in step S11 and waits until the registered contact operation is executed.

[0060] If it is determined that the contact operation is being performed (Yes in step S11), the processing device 22 executes the process associated with the contact operation (step S12). The processing device 22 then determines whether the end of the immediately preceding contact operation is detected (step S13). More specifically, the processing device 22 determines whether contact between the object and the touch screen 23 has been released. If the processing device 22 determines that the end of the contact operation is detected (Yes in step S13), the terminal processing ends.

[0061] If it is determined that the end of the contact operation is not detected (No in step S12), the processing device 22 determines whether a contact operation different from the immediately preceding contact operation is being executed on the touch screen 23 (step S14). For example, in step S14, immediately after a negative determination in step S13, the processing device 22 determines whether a new contact operation registered for the operation target with the contact operation determined to be executed in step S11 is being executed.

[0062] The combinations of contact operations included in the serial operations will now be described with reference to Fig. 19 described. Fig. Figure 19 schematically shows four combinations of the first contact operation, which is the tap operation or the slide operation, and the second contact operation, which is the tap operation or the slide operation. Examples of the tap operation are the single-point tap operation and a multi-point tap operation. Examples of the slide operation include a single-point slide operation and a multi-point slide operation, as well as a swipe operation with a defined end point of the contact point movement and a swipe operation without a defined end point.

[0063] If both the first and second contact operations are the tap operations, as in Fig. For example, as shown in Figure 19, a first contact point created by the first contact operation, namely the single-point tap with the thumb, is maintained, and two second contact points different from the first contact point are created by the second contact operation with the index and middle fingers. For example, when the first contact operation is the tap operation and the second contact operation is the slide operation, the first contact point created by the first contact operation, namely the single-point tap with the thumb, is maintained, and the second contact point different from the first contact point is created by the second contact operation with the index finger, and then moves.

[0064] For example, if the first contact operation is the slide operation and the second contact operation is the tap operation, the first contact point moves with the index finger in the first contact operation, and the second contact point, which is different from the first contact point, is then created by the second contact operation with the thumb. If both the first and second contact operations are the slide operations, the first contact point moves with the index finger in the first contact operation, and the first contact point then moves in a different direction from the first contact operation to execute the second contact operation. In this example, the second contact point used in the second contact operation corresponds to the first contact point.However, the first contact operation and the second contact operation, which are each the sliding operation, can be performed using the first contact point and the second contact point that are different from each other. In other words, the second contact point can be created separately and move in a different direction without breaking the contact at the first contact point in the first contact operation.

[0065] Although the contact operations in the examples in Fig. 19 are the tap and slide operations, the contact operations can be the gesture operation, a pinch operation, a double tap operation or other operations that can also be included in the serial operations.

[0066] Related back to Fig. 18, if it is determined that the contact operation different from the immediately preceding contact operation is not being executed in step S14 (No in step S14), the processing device 22 repeats the processing in step S13 and subsequent steps and waits until the contact operation ends or a new contact operation is executed. If it is determined that the contact operation is being executed (Yes in step S14), the processing device 22 determines whether the contact operation is the target of the serial operation (step S15).

[0067] If it is determined that the contact operation is the target of the serial operation (Yes in step S15), the processing device 22 receives the contact operation and executes the process associated with the contact operation (step S16). The processing device 22 then repeats the processing in step S13 and subsequent steps. If it is determined that the contact operation is not the target of the serial operation (No in step S15), the processing device 22 terminates the terminal processing without receiving the contact operation.

[0068] As described above, the multiple contact operations dedicated to a single display component enable the display component to be multifunctional, thereby reducing the number of display components arranged on the display screen of the touchscreen 23. This increases flexibility in screen design and simplifies the user interface. The structure also enables serial operations on the display component and eliminates repeated contact operations that each start in the component area, thereby reducing the workload of the administrator 32. As shown in Fig. 20, for example, the lateral slide operations and the vertical slide operations performed alternately from the component area allow the manager 32 not to move the fingertip back to the display component for the second and subsequent contact operations.

[0069] Furthermore, the operator 31 can specify gesture operations with defined movement paths of the contact points, thus creating unique contact operations as needed. For example, the manager 32 can easily understand the user interface in which the gesture operations, each of which draws the initial letter of a process name, are designated for the operation targets.

[0070] In particular, gesture operations used in typical consumer smartphones and tablet terminals must be simple for consumers. In comparison, the UI terminal 20 used at an FA site is used by the manager 32 with expertise and therefore enables specialized operations such as serial operations, each comprising multiple gesture operations. In other words, the first and second contact operations included in a serial operation may be gesture operations that move the first contact point associated with the first contact operation and the second contact point associated with the second contact operation along different movement paths. The receiver 11 may receive the indication of a movement path of the first contact point in the first contact operation and the indication of a movement path of the second contact point in the second contact operation.The output device 14 can output data indicating the paths along which the first contact point and the second contact point move. Additionally, complex gesture operations for hidden functions can be created and defined to enable users who only know the gesture operations to use the functions. Gesture operations for drawing an alphabet or a number can be registered. The UI terminal 20 can receive the serial operation with which characters included in a password are entered in the spelling order of the password.

[0071] The setting device 10 also receives the indication of the specific area as the operation target. More specifically, the receiver 11 receives the indication that the contact operation in the specific area is a partial area of ​​the display area or the entire area of ​​the display area, and the indication of the process to be executed by the UI terminal 20 when the contact operation is executed. The setter 13 sets the UI terminal 20 to execute the specific process when the contact operation is executed in the specified area. This enables the UI terminal 20 to be operated without display components, thereby reducing the number of display components. The contact operation in the specific area corresponds to an example of a third contact operation. The process to be executed when the contact operation is executed corresponds to an example of a third process.

[0072] The determiner 12 determines whether the contact operation corresponds to the serial operation including other contact operations. If it is determined that the contact operation corresponds to the serial operation, the setter 13 excludes the contact operation from the setting targets for the UI terminal 20. The UI terminal 20 can thus be reliably operated. The contact operation to be subjected to the determination of whether the contact operation corresponds to the serial operation corresponds to an example of a fourth contact operation. The fourth contact operation is different from the first and second contact operations and is executed on the display component that is the target of the first and second contact operations executed sequentially to display the serial operation. The receiver 11 receives the indication of the fourth contact operation.

[0073] Although one or more embodiments of the present disclosure have been described above, the present disclosure is not limited to the above-mentioned embodiments.

[0074] In the example described above, the end of the contact operation corresponds to releasing contact with the touchscreen 23, but the contact operation can also end differently. For example, the end of the contact operation can be pressing a button on a stylus that can communicate with the UI terminal 20.

[0075] The functions of the setting device 10 and the UI terminal 20 according to the above embodiment can be implemented by dedicated hardware or a general-purpose computer system.

[0076] For example, the program P1 can be stored in a non-transitory computer-readable recording medium, such as a flexible disc, a CD-ROM (Compact Disc-ROM), a DVD (Digital Versatile Disc), or a magneto-optical (MO) disc, for distribution. The program P1 can be installed in a computer to provide a device that performs the above processing.

[0077] The program P1 may be stored on a data carrier included in a server in a communications network, such as the Internet, and may, for example, be superimposed on a carrier wave to be downloaded to a computer.

[0078] The above processing can also be performed by the program P1, which is activated and executed while being transmitted over a network such as the Internet.

[0079] The above processing can be performed by executing programs P1 and P2 while program P1 is executed entirely or partially on a server and a computer sends and receives information about the processing via a communication network.

[0080] In the system having the above functions, which are partially implementable by the operating system (OS) or by cooperation between the OS and applications, parts executable by applications other than the OS may be stored in a non-volatile recording medium that can be distributed or downloaded to the computer.

[0081] The means for implementing the functions of the setting device 10 and the UI terminal 20 are not limited to software and may be implemented partially or entirely by dedicated hardware or dedicated circuitry.

[0082] The foregoing describes some exemplary embodiments for illustrative purposes. Although specific embodiments have been presented in the foregoing discussion, it will be appreciated by those skilled in the art that changes may be made in form and detail without departing from the general spirit and scope of the invention. Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense. This detailed description, therefore, is not to be taken in a limiting sense, and the scope of the invention is defined only by the appended claims, along with the full scope of equivalents falling within the scope of such claims. Industrial applicability

[0083] One or more embodiments of the present disclosure are suitable for designing user interfaces for terminals deployed at FA sites. List of reference symbols 10 Adjustment device 11 recipients 12 determiners 13 adjusters 14 Dispensing device 20, 20a UI terminal 21 recipients 22 Processing device 23 touchscreen 31 operators 32 administrators 321 Hand 322 contact point 40 Control 41 Commercial Network 42 to 44 device 50 FA device 51 processor 52 main memory 53 additional storage 54 Input device 55 Dispensing device 56 Communicator 57 Internal Bus 61 to 65 lines 71, 72 character string 73 Menu 74 to 79, 701 to 703 Instructions A1 to A3: Display component A10, A20, A30 component area B1 to B4 specific area F1 to F3 file P1 program QUOTES CONTAINED IN THE DESCRIPTION

[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature

[0000] JP 2017-168102

[0006]

Claims

[1] A terminal operation setting program executable by a computer connected to a user interface terminal to control a device, the program causing the computer to act as: Receiving means for receiving an indication of a first contact operation on a display component displayed on a touchscreen in the user interface terminal, an indication of a first process to be executed by the user interface terminal when the first contact operation is executed, an indication of a second contact operation on the display component, and an indication of a second process to be executed by the user interface terminal when the second contact operation is executed, wherein the second contact operation is different from the first contact operation, wherein the second process is different from the first process; and Setting means for setting the user interface terminal to execute the first process when the first contact operation is performed on a component area corresponding to the display component in a display area of the touch screen, and to execute the second process when the second contact operation is performed on the component area, and for setting the user interface terminal to execute the first process and the second process when the first contact operation is performed on the component area and the second contact operation is performed outside the component area before an end of the first contact operation is detected. [2] Terminal operation setting program according to claim 1, wherein the first contact operation is an operation for creating or moving a first contact point at which an object is in contact with the touchscreen, where the end of the first contact operation is the release of contact with the object and wherein the second contact operation is an operation for creating or moving a second contact point different from the first contact point. [3] Terminal operation setting program according to claim 1, wherein the first contact operation is an operation for moving a first contact point at which an object is in contact with the touch screen, where the end of the first contact operation is the release of contact with the object, and wherein the second contact operation is an operation to move a second contact point equal to the first contact point. [4] The terminal operation setting program according to claim 2 or 3, wherein the first contact operation and the second contact operation are operations to move the first contact point and the second contact point in directions different from each other. [5] Terminal operation setting program according to claim 2 or 3, wherein the first contact operation and the second contact operation are gesture operations to move the first contact point and the second contact point along mutually different movement paths, and wherein the receiving means receives an indication of a movement path of the first contact point in the first contact operation and an indication of a movement path of the second contact point in the second contact operation. [6] The terminal operation setting program according to claim 5, wherein the program further causes the computer to function as output means for outputting data indicating the movement path of the first contact point in the indication received by the receiving means and the movement path of the second contact point in the indication received by the receiving means. [7] Terminal operation setting program according to one of claims 1 to 6, wherein the receiving means receives an indication of a third contact operation in a specific area which is a partial area of the display area or an entire area of the display area, and an indication of a third process to be executed by the user interface terminal when the third contact operation is executed, and wherein the setting means sets the user interface terminal to execute the third process when the third contact operation is performed in the specific area. [8] A terminal operation setting program according to any one of claims 1 to 7, further comprising: Determining means for making a determination about an operation received by the receiving means, wherein the receiving means receives an indication of a fourth contact operation on the display component and the fourth contact operation is different from the first contact operation and the second contact operation, wherein the determining means determines whether a serial operation comprising the first contact operation and the second contact operation executed successively is equal to the fourth contact operation, and wherein the setting means excludes the fourth contact operation from a setting target for the user interface terminal when it is determined that the serial operation is equal to the fourth contact operation. [9] Terminal operation setting method, comprising: Receiving, with receiving means, an indication of a first contact operation on a display component displayed on a touchscreen in a user interface terminal for controlling a device, an indication of a first process to be executed by the user interface terminal when the first contact operation is executed, an indication of a second contact operation on the display component, and an indication of a second process to be executed by the user interface terminal when the second contact operation is executed, wherein the second contact operation is different from the first contact operation and the second process is different from the first process; and Setting the user interface terminal with setting means to execute the first process when the first contact operation is performed on a component area corresponding to the display component in a display area of the touch screen, and to execute the second process when the second contact operation is performed on the component area; and Setting the user interface terminal with setting means to execute the first process and the second process when the first contact operation is executed at the component area and the second contact operation is executed outside the component area before an end of the first contact operation is detected. [10] A terminal operation setting device connectable to a user interface terminal to control a device, the terminal operation setting device comprising: Receiving means for receiving an indication of a first contact operation on a display component displayed on a touchscreen in the user interface terminal, an indication of a first process to be executed by the user interface terminal when the first contact operation is executed, an indication of a second contact operation on the display component, and an indication of a second process to be executed by the user interface terminal when the second contact operation is executed, wherein the second contact operation is different from the first contact operation, wherein the second process is different from the first process; and Setting means for setting the user interface terminal to execute the first process when the first contact operation is performed on a component area corresponding to the display component in a display area of the touch screen, and to execute the second process when the second contact operation is performed on the component area, and for setting the user interface terminal to execute the first process and the second process when the first contact operation is performed on the component area and the second contact operation is performed outside the component area before an end of the first contact operation is detected. [11] A user interface terminal for controlling a device, comprising: a touchscreen; Receiving means for receiving a setting relating to an operation on the touchscreen; and Processing means for carrying out processing on the basis of the setting, wherein the processing means executes a first process when a first contact operation is performed on a component area corresponding to a display component in a display area of the touch screen, wherein the processing means executes a second process different from the first process when a second contact operation different from the first contact operation is executed on the component area, and wherein the processing means executes the first process and the second process when the first contact operation is executed at the component area and the second contact operation is executed outside the component area before an end of the first contact operation is detected.

Images