Numerical control unit

Abstract

A numerical control unit for performing a gesture operation by a key input, the numerical control unit comprising: a display unit for displaying a screen having a plurality of windows, a key input unit including a plurality of first and second keys; an action point determining unit that determines an action point of the gesture operation within the window associated in advance with one of the first buttons in response to an input of the one of the first buttons, the action point referring to a coordinate serving as a reference point of an application operation to be performed in response to the gesture operation; and a virtual gesture input unit that outputs a gesture input signal indicating the gesture operation in response to an input of one or more of the second keys, wherein the virtual gesture input unit outputs the gesture input signal when a continuous input of the one of the second keys lasts for a certain period of time or longer, or when a continuous and simultaneous input of the plurality of the second keys lasts for the certain period of time or longer, or outputs a normal key input signal when an input of the one or more of the second keys lasts for less than the certain period of time.

Description

Background of the invention 1. Field of the invention

[0001] The present invention relates to a numerical control unit. More particularly, the present invention relates to a numerical control unit capable of replacing a gesture function of a touch panel with a keyboard. 2. Description of related technology

[0002] There is a numeric control unit equipped with a display function that can zoom in, zoom out, pan, and scroll documents and numbers. Some of these numeric control units have multi-touch touch panels capable of detecting multiple touch points. A gesture function of an operating system (OS) detects gestures such as sliding, pinching, and rotating performed by users on the touch panels. The application then performs operations such as zooming in, zooming out, panning, and scrolling according to the detected gesture.

[0003] In contrast, a numerical control unit that does not have a multi-touch touch panel cannot detect a user's gesture and therefore cannot utilize the application function corresponding to the gesture function. Many numerical control units are not equipped with a touch panel due to the difficulty of operating a touch panel under harsh working conditions. Therefore, conventional touch panels, as in Fig. 8, operation keys for independently implementing functions such as zooming in, zooming out, moving, and scrolling are implemented by the application and arranged on an application screen, or these functions are assigned to soft keys (function keys) to make an elaboration that enables a numerical control unit that does not have a multi-touch type touch panel to perform an operation.

[0004] However, this elaboration of the application increases the cost of application development. Furthermore, differences in the user interfaces of each application are likely to lead to a decrease in usability. Therefore, a gesture function that does not depend on a multi-touch touch panel is preferably implemented on a platform common to the applications, rather than uniquely for each application. Japanese Patent Application Laid-Open Nos. 2014-164368A and JP 5148547 B2 disclose keyboards that, when a user performs an operation of moving a finger on a key array surface on which a plurality of keys are arranged, similar to a touch panel, recognize this operation as a gesture input.

[0005] However, Japanese Patent Application Laid-Open Nos. 2014-164368 and JP 5148547 B2 have problems in that it is difficult to smoothly track the key alignment surface such as the touch panel. There is also a problem in that it is not easy to determine a touch point on the screen due to the keyboard.

[0006] The American patent application US 2011 / 0 210 917 A1 describes controlling a user interface via a keyboard. In one embodiment, a user interface displayed on a display device is controlled via a computer connected to a keyboard. The keyboard has a plurality of alphanumeric keys that can be used for text input. The computer receives data comprising a sequence of keystrokes on the keyboard and generates a physical position on the keyboard for each keystroke. The relative physical positions of the keystrokes are compared to calculate a movement path across the keyboard. The movement path describes the path of a user's finger across the keyboard. The movement path is mapped to a sequence of coordinates in the user interface, and the movement of an object displayed in the user interface is controlled according to the sequence of coordinates. Overview of the invention

[0007] The present invention has been made to solve the above problems, and an object of the present invention is to provide a numerical control unit capable of replacing a gesture function of a touch panel with a keyboard.

[0008] A numerical control unit according to an embodiment of the present invention is a numerical control unit that performs a gesture operation by a key input, and includes: a key input unit that includes a plurality of first and second keys; an action point determining unit that determines an action point of the gesture operation in response to an input of one of the first keys; and a virtual gesture input unit that outputs a gesture input signal indicating the gesture operation in response to an input of one or more of the second keys.

[0009] The numerical control unit according to the embodiment of the present invention further includes a display unit that displays a screen including a plurality of areas, and the key input unit has a plurality of the first keys, wherein one of the first keys and one of the areas are linked in advance, and the action point determining unit sets the action point in the area linked in advance to the first key.

[0010] In the numerical control unit according to the embodiment, the virtual gesture input unit outputs the gesture input signal when continuous input of the one of the second keys continues for a predetermined period of time or longer, or when continuous and simultaneous input of the plurality of the second keys continues for the predetermined period of time or longer.

[0011] In the numerical control unit according to the embodiment, the virtual gesture input unit outputs a normal key input signal when an input of the one or more of the second keys lasts for less than the specified period of time.

[0012] In the numerical control unit according to the embodiment of the present invention, the virtual gesture input unit may include a first operation for selecting a type of gesture operation and a second operation for determining a type of gesture operation.

[0013] In the numerical control unit according to the embodiment of the present invention, the first operation may be pressing the second key, and the second operation may be continuously pressing the second key for a predetermined period of time.

[0014] The numerical control unit according to the embodiment of the present invention may further include a mode switching unit that activates the action point determining unit and the virtual gesture input unit, and the action point determining unit and the virtual gesture input unit are activated to change an operation of the numerical control unit at a time of inputs of the first and second keys.

[0015] The numerical control unit according to the embodiment of the present invention may further include a display unit that displays a screen including a plurality of areas, and the display unit may display a cursor at the action point in response to the input of the first key.

[0016] The numerical control unit according to the embodiment of the present invention may further include a display unit that displays a screen including a plurality of areas, and the display unit may display a cursor corresponding to the gesture operation in response to the input of the second key.

[0017] A method according to the embodiment of the present invention is a method for performing a gesture operation by a key input to a numerical control unit, and includes: selecting one of the plurality of areas displayed on a screen, to which one of a plurality of first keys is assigned in advance, by an input of the one of the first keys; determining a type of the gesture operation when a continuous input of one of a plurality of second keys continues for a predetermined period of time or when a continuous and simultaneous input of a plurality of the second keys continues for the predetermined period of time; or causing a normal key input of the one or more of the second keys when the input of the one or more of the second keys continues for less than the predetermined period of time.

[0018] According to the present invention, it is possible to provide a numerical control unit capable of replacing the gesture function of the touch panel with the keyboard. Short description of the drawings

[0019] The above and other objects and features of the present invention will become more apparent from the description of the following embodiments taken in conjunction with the accompanying drawings. Of these drawings: Fig. 1 is a block diagram illustrating an embodiment of a numerical control unit; Fig. 2 is a view for explaining the operation of an action point determining unit; Fig. 3 is a view for explaining the operation of the virtual gesture input unit; Fig. 4 is a flowchart illustrating an operation of the numerical control unit; Fig. 5 is a view illustrating an embodiment of the numerical control unit; Fig. 6 is a view illustrating one embodiment of the numerical control unit; Fig. 7 is a flowchart illustrating the operation according to one embodiment of the numerical control unit; and Fig. 8 is a view illustrating a conventional numerical control unit. Detailed description of the preferred embodiments

[0020] An embodiment of the present invention will be described below with reference to the drawings.

[0021] Fig. 1 is a block diagram illustrating a configuration of a numerical control unit 100 according to the embodiment of the present invention. The numerical control unit 100 includes a mode switching unit 110, an action point determination unit 120, a virtual gesture input unit 130, a key input unit 140, and a display unit 150. Typically, the numerical control unit 100 is an information processing device including a central processing unit (CPU), a storage device, and input / output devices such as a keyboard and a display, and implements each unit when the CPU executes a predetermined program.

[0022] A key input device 140 is a user interface for key input and is typically a keyboard with a plurality of physical keys. Alternatively, the key input device 140 may be any other user interface capable of receiving a key input signal.

[0023] The display unit 150 is a user interface that displays screens output by the operating system and applications and is typically various display devices.

[0024] The mode switching unit 110 is a unit that switches between a keyboard mode and a panel mode. Specifically, the mode switching unit 110 switches an output destination of an output signal from the key input unit 140 to a normal keyboard driver or a virtual touch panel driver, which is newly provided in the present embodiment. The mode switching unit 110 performs the above-described switching by, for example, being triggered by pressing any key provided in the key input unit 140, executing a switching command implemented in the application, or selecting any soft key.

[0025] The action point determining unit 120 is a unit that determines an action point of the gesture operation. The action point refers to a coordinate serving as a reference point of an application operation performed in response to the gesture operation. For example, with regard to a general panel operation, the action point is a move starting point of a move operation or a center point of two points of the touch panel touched by a user in a two-finger spread / pinch operation or a rotation operation. Typically, the action point determining unit 120 is implemented as part of the driver of a virtual touch panel and sets an action point in response to a specific key input in the key input unit 140.

[0026] An example of action point setting processing is described with reference to Fig. 2 described. Fig. Figure 2 illustrates an example of a screen of the numerical control unit. In this example, the screen includes five windows (four windows with the window names "NC program", "absolute coordinate", "machining simulation", and "tool data", and a status display window in a bottom section), and each window can operate independently. For example, a 3D model output by a CAD application is displayed in the "machining simulation" window and can be operated according to user input for scrolling, zooming in, zooming out, or rotating. A program list is displayed in the "NC program" window and can be operated according to user input for scrolling, zooming in, and zooming out. Thus, each window represents different operations depending on the content, which are executed according to each gesture operation.

[0027] Each of these windows is assigned a special key based on a one-to-one relationship. Special keys such as "Position," "Program," "Tool Offset," "Graphics," and "Message" can be assigned, which are keys specific to the numerical control unit. In this way, the present invention can also be easily applied to numerical control units with a relatively small number of keys.

[0028] Note that the present invention is not limited to this, and any key can be used as a modifier key. A link between these modifier keys and the windows is stored in advance in the action point determination unit 120. When it detects that the modifier key associated with the window is pressed in the panel mode, the action point determination unit 120 sets the action point, for example, at the center of a display area of ​​the window.

[0029] Although a screen with a plurality of windows has been described here as an example, the present invention is not limited thereto. The action point determining unit 120 can designate any display area among the screens having a plurality of display areas using a special key and set the action point at any position within the area. Here, different applications can operate in each display area, or a single application can use a plurality of display areas. A plurality of display areas need not necessarily be independently operable and may have a linkage or subordination relationship. Furthermore, a plurality of display areas need not be clearly divided so that the user can recognize the display areas.For example, even if the screen output by the application has only a single display area, the action point determination unit 120 internally divides the single screen area into a plurality of sections, and keys can be assigned to each section. Alternatively, the action point determination unit 120 can execute processing to set the respective action points in all display areas as a whole in response to a predetermined key input.

[0030] The virtual gesture input unit 130 is a unit that converts the user's key input into a gesture operation and outputs the user's key input to the application. The gesture operation refers, for example, to various operations such as sliding, pinching, and rotating performed on the touch panel. Typically, the virtual gesture input unit 130 is implemented as part of the virtual touch panel driver, determines a corresponding gesture operation in response to the key input in the key input unit 140, and outputs a gesture input signal indicating that the gesture operation has been performed on the touch panel to the application.Preferably, the virtual gesture input unit 130 returns the gesture operation determined in accordance with the key input to the user by displaying the gesture operation on the screen.

[0031] An example of the operation of the virtual gesture input unit 130 will be described with reference to Fig. 3. The virtual gesture input unit 130 stores the association between key inputs from the key input unit 140 and predetermined gesture operations in advance. For example, a shift operation in a left direction may be associated with a left arrow key input. A shift operation in a right direction may be associated with a right arrow key input. A shift operation in an up direction may be associated with an up arrow key input. A shift operation in a down direction may be associated with a down arrow key input. A rotate operation in the right direction may be associated with a simultaneous press of the right arrow key and the up arrow key. A rotate operation in the left direction may be associated with a simultaneous press of the left arrow key and the down arrow key.A two-finger spread operation may be linked to a simultaneous press of the right arrow key and the left arrow key. A two-finger pinch operation may be linked to a simultaneous press of the up arrow key and the down arrow key. Note that the present invention is not limited to the linkage described here. The linkage between key inputs and gesture operations can be arbitrarily set. The present embodiment will be described assuming the above linkage.

[0032] When no key is input through the key input unit 140, the virtual gesture input unit 130 displays an up, down, left, and right marker cursor on the screen. Preferably, the display position is the above-mentioned action point. As a result, the user can recognize the currently set action point and a ready-to-input status for the key signal corresponding to the gesture operation. When the left arrow key is pressed through the key input unit 140, the virtual gesture input unit 130 displays the left arrow cursor on the screen. Preferably, the display position is the above-mentioned action point. Accordingly, the user can recognize the currently set action point and the input status of the key signal corresponding to the left-direction shift operation.Similarly, the virtual gesture input unit 130 displays a right arrow in response to pressing the right arrow key, an up arrow in response to pressing the up arrow key, and a down arrow in response to pressing the down arrow key on the screen. When the right arrow key and the up arrow key are simultaneously pressed by the key input unit 140, the virtual gesture input unit 130 displays a right-turn cursor on the screen. Preferably, the display position is the above-mentioned action point. Accordingly, the user can recognize the currently set action point and the status that the key signal corresponding to the right-turn operation is input.Similarly, the virtual gesture input unit 130 displays a left-turn cursor on the screen in response to simultaneous pressing of the left arrow key and the down arrow key. When the left arrow key and the right arrow key are simultaneously pressed by the key input unit 140, the virtual gesture input unit 130 displays the left arrow and right arrow cursors on the screen. Preferably, the display position is the aforementioned action point. Accordingly, the user can recognize the currently set action point and the status that the key signal corresponding to the two-finger spread operation is being input.Similarly, the virtual gesture input unit 130 may indicate the status that the key signal corresponding to the two-finger pinch operation is input by displaying the down arrow and up arrow cursors on the screen in response to simultaneous pressing of the down arrow key and the up arrow key.

[0033] Preferably, the virtual gesture input unit 130 determines whether the key input from the key input unit 140 continues for a certain period of time. If the key input continues for a certain period of time, the virtual gesture input unit 130 converts the key input from the key input unit 140 into a signal indicating the gesture operation according to the above linkage. That is, the gesture input signal corresponding to the key input is generated and output to the application.

[0034] For example, if it is detected that the input of the left arrow key continues for a certain period of time or longer, the virtual gesture input unit 130 generates a gesture input signal corresponding to the shift operation in the left direction. Specifically, while the left key is pressed, the virtual gesture input unit 130 continues to output a touch point while shifting coordinates of the touch point by a predetermined distance in the left direction at each time t. Here, the touch point refers to the coordinates output by the panel driver when a touch operation on the touch panel is detected. At coordinates t = 0, the output touch point is an action point. When a movement distance (ie,When the movement speed (a shift speed) of the touch point per unit time is k, an x-coordinate of the touch point at t = 1, 2, ..., and n changes by -k, -2k, ..., and -tk from the action point as the starting point. Here, k can be arbitrarily set. Similarly, when the right arrow key, the up arrow key, and the down arrow key are continuously input for the specified period of time or longer, the virtual gesture input unit 130 can output a gesture input signal corresponding to a shift operation in the right direction, the up direction, and the down direction.When the right arrow key, the up arrow key, the left arrow key, and the down arrow key are continuously input for the specified period of time or longer, the virtual gesture input unit 130 may further output a gesture input signal corresponding to a right-hand and left-hand rotation operation corresponding to these arrow keys. When the left arrow key, the right arrow key, the down arrow key, and the up arrow key are continuously input for the specified period of time or longer, the virtual gesture input unit 130 may further output a gesture input signal corresponding to the two-finger pinch and spread operations corresponding to these arrow keys.

[0035] In this way, by activating the gesture operation when the key input continues for the specified period of time or longer, the virtual gesture input unit 130 can distinguish between a normal key input and a key input for performing the gesture operation. That is, it is possible to output a normal key input signal for a key input that lasts less than the specified period of time and output a gesture input signal for a key input that lasts for the specified period of time or longer. This makes it possible to perform the gesture operation using the keyboard even in numeric control units with a small number of keys.

[0036] An operation of the numerical control unit 100 will be described with reference to a flowchart of Fig. 4 described.

[0037] S1: The mode switching unit 110 switches the keyboard driver from the keyboard mode using the normal keyboard driver to the panel mode using the virtual touch panel driver in response to a predetermined key input.

[0038] S2: The action point determination unit 120 detects a special key input and determines an action point of a gesture operation. For example, the action point determination unit 120 sets the action point at the center of the window associated with the special key. At this time, the display unit 150 displays the cursor at the action point.

[0039] S3: The virtual gesture input unit 130 detects an input of the up, down, left, or right arrow keys and generates and outputs a gesture input signal. At this time, the display unit 150 displays the cursor indicating a type of gesture operation at the action point.

[0040] S4: The gesture input signal output by the virtual gesture input unit 130 is provided to the application. A function or operation corresponding to the gesture input signal output by the virtual gesture input unit 130 is implemented in the application.

[0041] In the following, the embodiment of the numerical control unit 100 will be described with reference to Fig. 5 and Fig. 6. As described in Fig. As illustrated in Figure 4, the numerical control unit 100 according to the present embodiment includes a keyboard as the key input unit 140 and a display device as the display unit 150. A mode switching key provided on the keyboard is used as the mode switching unit 110. In addition, the "Position," "Program," "Tool Offset," "Graphic," and "Message" keys on the keyboard are used by the action point designation unit 120. These five keys are respectively associated with the five windows displayed on the display and are used to designate action points in these windows. In addition, the up, down, left, and right arrow keys on the keyboard are used by the virtual gesture input unit 130.

[0042] As in Fig. As illustrated in Figure 5, the numerical control unit 100 typically includes an operating system, the keyboard driver, the application, and shared RAM. The keyboard driver has integrated functions of the normal keyboard driver and the virtual touch panel driver, and when the mode switching key is input, switches the keyboard mode operating as the normal keyboard driver and the panel mode operating as the virtual touch panel driver. That is, when the panel mode is enabled, the keyboard driver enables the virtual touch panel driver. In this way, the keyboard driver implements the function of the mode switching unit 110.Note that in panel mode, the keyboard driver may provide input from the up, down, left, and right arrow keys exclusively to the virtual touch panel driver without providing the input to the regular keyboard driver. Alternatively, as described above, the driver to which the input is provided can be determined based on the input duration of the up, down, left, and right arrow keys.

[0043] Furthermore, when each key (hereinafter referred to as a screen selection key) for "Position," "Program," "Tool Offset," "Graphics," and "Message" is input in the panel mode, the keyboard driver sets the action point in each window associated with each screen selection key. In this way, the keyboard driver implements the function of the action point designation unit 120. Further, when the up, down, left, and right arrow keys are input in the panel mode, the keyboard driver generates a corresponding gesture input signal and outputs the gesture input signal to the operating system. In this way, the keyboard driver implements the function of the virtual gesture input unit 130.

[0044] The operating system forwards a key input signal or gesture input signal issued by the keyboard driver to the application. This means that the operating system forwards an operation event, such as moving, rotating, or spreading / pinching two fingers, to the application.

[0045] The application performs a predetermined operation according to the key input signal or gesture input signal obtained from the operating system. The function or operation assigned to the gesture input signal can be arbitrarily implemented for each application. For example, if a vertical scroll gesture input signal is detected, the application displaying a program list can perform an operation to scroll the program list vertically. Furthermore, if the horizontal scroll gesture input signal is detected, the application can perform the function of switching a system of the displayed content. If a vertical scroll gesture input signal is detected, the application displaying tool data can perform an operation to increment or decrement a tool number.When the gesture input signal of horizontal movement is detected, the application can further perform the function of switching a tool type.

[0046] Shared RAM is a memory area that can be used to share information between the operating system or application and the keyboard driver. For example, if the window is currently displayed on the display device, the operating system or application writes a window display position (e.g., a set of coordinates specifying two endpoints of a rectangular area) to shared RAM. When multiple windows are displayed, each window display position is written to shared RAM. For example, when setting the action point, the keyboard driver can reference the shared RAM, obtain the window display position associated with the modifier key, and calculate an action point based on the display position.

[0047] An operation of the numerical control unit 100 according to the present embodiment will be described with reference to a flowchart of Fig. 7 described.

[0048] S11: When displaying the screen (window), the operating system or application writes a screen display position to shared RAM.

[0049] S12: The keyboard driver alternately switches the keyboard driver mode between keyboard mode and panel mode each time the mode switch key on the keyboard is pressed. When the mode is switched to panel mode, the virtual touch panel driver is enabled.

[0050] S13: The virtual touch panel driver periodically monitors the status of the screen selection button. When it detects the pressing of the screen selection button, the virtual touch panel driver reads the screen position associated with the pressed screen selection button from the shared RAM. Furthermore, the virtual touch panel driver obtains the screen center point based on the acquired screen position and sets the center point as the action point. Furthermore, the virtual touch panel driver displays a predefined cursor at the center point. In this way, the virtual touch panel driver indicates the position of the action point and the panel mode to the user.

[0051] S14: The virtual touch panel driver periodically monitors the status of the arrow key. If it detects that the arrow key is continuously pressed for a certain period of time, the virtual touch driver generates a gesture input signal associated with the pressed arrow key and repeatedly outputs the gesture input signal to the operating system.

[0052] S15: Upon receiving the gesture input signal, the operating system issues an operation event to the application.

[0053] S16: The application performs a function or operation according to the operation event.

[0054] According to the present embodiment, the virtual touch panel driver detects the action point of the gesture operation and the gesture operation based on the input signal from the keyboard, and converts the action point of the gesture operation and the gesture operation into the input signal indicating the gesture operation. In this way, even numerical control units that do not have a touch panel can easily utilize the touch panel-compatible function of the application. Furthermore, common gesture operations can be performed across all applications through common key inputs, thus improving operability. Furthermore, development costs can be reduced because customization on the application side is unnecessary.

[0055] It should be noted that the present invention is not limited to the above-described embodiment and can be modified as appropriate without departing from the scope of the invention. Within the scope of the invention, the present invention allows modification of any component of the embodiment or omission of any component of the embodiment.

[0056] For example, the present invention includes assigning arbitrary key inputs to various gesture operations not mentioned in the above embodiment. That is, the above-described embodiment described the example in which the up, down, left, and right arrow keys, or combinations of these, are assigned to gesture operations such as sliding, rotating, and spreading / pinching two fingers. However, the gesture operation is not limited to these. Furthermore, keys other than the up, down, left, and right arrow keys, or combinations of these, may be assigned to arbitrary gestures.

[0057] Furthermore, the above-described embodiment described the example in which the action point is set at the center of the display area selected by the action point determination unit 120. However, the position of the action point can be set arbitrarily. For example, text data is often described on the left side of a screen. Therefore, an application that displays text data facilitates visual recognition of content by setting an action point at the left end of the screen, even when performing a zoom operation.

[0058] The embodiment of the present invention has been described above. However, the present invention is not limited to the example of the above embodiment and can be implemented in various ways by adding optional modifications.

Claims

[1] A numerical control unit for performing a gesture operation by a key input, the numerical control unit comprising: a display unit for displaying a screen having a plurality of windows, a key input unit including a plurality of first and second keys; an action point determining unit that determines an action point of the gesture operation within the window associated in advance with one of the first buttons in response to an input of the one of the first buttons, the action point referring to a coordinate serving as a reference point of an application operation to be performed in response to the gesture operation; and a virtual gesture input unit that outputs a gesture input signal indicating the gesture operation in response to an input of one or more of the second keys, wherein the virtual gesture input unit outputs the gesture input signal when a continuous input of the one of the second keys lasts for a certain period of time or longer, or when a continuous and simultaneous input of the plurality of the second keys lasts for the certain period of time or longer, or outputs a normal key input signal when an input of the one or more of the second keys lasts for less than the certain period of time. [2] The numerical control unit according to claim 1, wherein the virtual gesture input unit moves a touch point of the gesture generation and continues the output when the continuous input of the one of the second keys continues for the specified period of time or longer, or when the continuous and simultaneous input of the plurality of the second keys continues for the specified period of time or longer. [3] A numerical control unit according to claim 1, wherein the first keys include one of the "position", "program", "tool offset", "graphic" and "message" keys, and the one or more of the second keys are one or more cursor keys. [4] The numerical control unit according to claim 1, further comprising a mode switching unit that activates the action point determining unit and the virtual gesture input unit, wherein the action point determining unit and the virtual gesture input unit are activated to change an operation of the numerical control unit at a timing of inputs of the first and the one or more second keys while the continuous input of the one of the second keys continues for the specified period of time or longer, or while the continuous and simultaneous input of the plurality of second keys continues for the specified period of time or longer. [5] A method for performing a gesture operation by a key input in a numerical control unit, the method comprising: Selecting one of a plurality of windows displayed on a screen to which one of a plurality of first keys is assigned in advance by inputting the one of the first keys; and Determining a type of gesture operation when continuous input of one of a plurality of second keys continues for a certain period of time or when continuous and simultaneous input of a plurality of the second keys continues for the certain period of time, or causing normal key input of the one or more of the second keys when input of the one or more of the second keys lasts for less than the certain period of time.

Images