Operation input control device

Abstract

The display of an area for enabling or disabling a pointing operation is controlled in conjunction with changes in a display screen. The computer device (1) comprises: an application execution processing unit (31) for controlling the display of at least one application window receiving a pointing operation in a manner capable of changing its position or size; and an area position control unit (62) for generating an operation control area for enabling or disabling a pointing operation in the application window, so that the operation control area is overlapped on the application window and associated with the application window, and controlling the position of the operation control area so that the position of the operation control area changes in conjunction with changes in the corresponding application window.

Description

Technical Field

[0001] The present invention relates to an operation input control device that enables or disables a position input operation on a display screen. Background Art

[0002] An input area for receiving pointing operations is provided in a display screen such as a window provided by an application or a desktop (basic screen) provided by an operating system. Pointing operations can be performed on such an input area by indicating the input area using a pointer represented by an input device such as a mouse or a touch panel.

[0003] For example, Patent Document 1 discloses setting a touch invalid area around the numeric keys on a screen. With such a touch invalid area, even if the touch is mistakenly moved from the numeric key area, as long as it is within the touch invalid area, the cursor in the data setting area can be prevented from moving.

[0004] Prior art literature

[0005] Patent Document 1: Japanese Patent Application Laid-Open No. 9-325859 (published on December 16, 1997) Summary of the Invention

[0006] However, the technology disclosed in Patent Document 1 displays a fixed screen including the numeric keys and the touch-invalid area, and the screen cannot be resized or moved. Therefore, it is impossible to control the touch-invalid area in conjunction with the aforementioned window or desktop that can be resized or moved and displayed on multiple operation display devices.

[0007] An object of one embodiment of the present invention is to control the display of an area for validating or invalidating a position input operation in conjunction with changes in a display screen.

[0008] In order to solve the above-mentioned problems, an operation input control device of one embodiment of the present invention includes: a screen display control unit, which controls so that at least one screen is displayed in a manner that can change its position or size; and an area position control unit, which generates an operation control area that enables or disables the position input operation on the screen, so that the operation control area overlaps on the screen and is associated with the screen, and controls the position of the operation control area so that the position of the operation control area changes in conjunction with the change of the corresponding screen.

[0009] According to one aspect of the present invention, the display of the area for validating or invalidating the position input operation can be controlled in conjunction with changes in the display screen. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1This is a block diagram showing the hardware configuration of a computer device according to Embodiment 1 and Embodiment 2 of the present invention.

[0011] Figure 2 It is a block diagram showing the system structure of the above-mentioned computer device.

[0012] Figure 3 This is a diagram showing the arrangement structure of an operation control area in a window displayed by the above-mentioned computer device.

[0013] Figure 4 This is a diagram showing an example of arrangement of an operation control area in an application window according to the first embodiment of the present invention.

[0014] Figure 5 This is a diagram showing another example of arrangement of the operation control area in the application window according to the first embodiment of the present invention.

[0015] Figure 6 This is a diagram showing an example of arrangement of an operation control area in an application window according to a second embodiment of the present invention.

[0016] Figure 7 This is a diagram showing another example of arrangement of the operation control area in the application window according to the second embodiment of the present invention. DETAILED DESCRIPTION

[0017] (Implementation 1)

[0018] The following will be based on Figures 1 to 5 One embodiment of the present invention will be described.

[0019] Figure 1 This is a block diagram showing the configuration of the computer device 1 according to this embodiment. Figure 2 1 is a block diagram showing the system configuration of the computer device 1 .

[0020] Computer device 1 (operation input control device) is installed with a general-purpose operating system (OS) and has the ability to execute application programs. Computer device 1 can be a personal computer, workstation, industrial computer, or other similar computer. Industrial computers are specialized computers designed to withstand harsh environments such as factories, with enhanced dustproofing, waterproofing, and vibration resistance.

[0021] In this embodiment, computer device 1 is configured to operate as a Human Machine Interface (HMI) device by executing an HMI application, while also executing other applications. Examples of HMI devices include programmable displays that monitor and control controlled objects, and supervisory / control systems such as SCADA (Supervisory Control and Data Acquisition) systems. HMI applications implement various functions performed by the HMI device, such as communicating with external devices, displaying data acquired from these devices, and accepting input from operators.

[0022] In this embodiment, computer resources (hereinafter referred to as "resources") of the computer device 1 refer to hardware resources for executing application programs. In the following description, in particular, a configuration using the main memory 12 described later as a resource will be described.

[0023] First, the hardware structure of the computer device 1 will be described.

[0024] like Figure 1 As shown, the computer device 1 includes a CPU (Central Processing Unit) 11 , a main memory 12 , a ROM (Read Only Memory) 13 , an auxiliary storage device 14 , an input unit 15 , a display unit 16 , and an interface unit 17 .

[0025] The CPU 11 is a processing device that executes application programs. Specifically, when executing application programs, the CPU 11 receives data from the main memory 12, auxiliary storage device 14, input unit 15, etc., performs calculations or processes the data, and then outputs the data to the main memory 12, auxiliary storage device 14, display unit 16, etc.

[0026] The main memory 12 is a memory constituting a main storage device in the computer device 1 and is composed of DRAM (Dynamic Random Access Memory).

[0027] The ROM 13 stores programs essential for the operation of the computer device 1 , such as a BIOS (Basic Input / Output System) that is executed when the computer device 1 is started or reset.

[0028] The auxiliary storage device 14 is a large-capacity storage device that stores an OS, application programs, various data, and the like, and is composed of a HDD (Hard Disc Drive), an SSD (Solid State Drive), or the like.

[0029] The input unit 15 is used for user input operations and includes various input devices such as a touch panel, a mouse, and a keyboard.

[0030] The display unit 16 is used to output image information generated inside the computer device 1 as the OS and application programs are executed.

[0031] The input unit 15 and the display unit 16 may be mounted on the computer device 1 or may be external devices connected to the computer device 1. Such external devices are connected to the computer device 1 via the interface unit 17 described below and thus operate together with the computer device 1.

[0032] The interface unit 17 is a connection unit for connecting external devices to the computer device 1 so that they can communicate. It is equipped with various interfaces such as a serial interface. For example, the serial interface is connected to a control device 2 such as a PLC (Programmable Logic Controller), a temperature controller, and an inverter.

[0033] Next, a description will be given of the system configuration of the computer device 1. In this embodiment, a description will be given of a system configuration for causing the computer device 1 to operate as an HMI device by executing an HMI application program and for executing other application programs in the computer device 1.

[0034] like Figure 2 As shown, computer device 1 has an operating system (hereinafter referred to as "OS") 3 installed and an HMI control unit 4 provided. Furthermore, computer device 1 is provided with a touch panel 15a and a mouse 15b as the aforementioned input unit 15. Display unit 16 is a component of computer device 1 such as a liquid crystal display panel, but may also be a display device provided separately from computer device 1. Touch panel 15a is arranged to overlap the display surface of display unit 16.

[0035] The OS 3 is a program that provides basic functions for managing the main memory 12, ROM 13, auxiliary storage device 14, input unit 15, display unit 16, and interface unit 17, which are commonly used by application programs, and manages the entire system of the computer device 1. The OS 3 also includes an application execution processing unit 31 for executing application programs.

[0036] The application execution processing unit 31 starts and executes an application program instructed to start among a plurality of application programs stored (or saved) in the auxiliary storage device 14. The application execution processing unit 31 also terminates an application program instructed to terminate among the executing application programs.

[0037] As applications are executed, they generate application windows (screens). When executing multiple applications, the application execution processing unit 31 activates (enables operation of) one application. Furthermore, the application execution processing unit 31 displays the application window of the activated application at the forefront of the display surface of the display unit 16. Furthermore, the application execution processing unit 31 (screen display control unit) controls the display of at least one application window that receives a pointing operation (position input operation) so that its position or size can be changed.

[0038] The HMI control unit 4 is a part of an HMI function (human-machine interface function) realized by executing an HMI application program.

[0039] The HMI function includes generating instructions to the control device 2 based on user input operations, acquiring various data from the control device 2, and displaying an HMI screen for displaying the acquired data and receiving the aforementioned input operations. The HMI control unit 4, as part of the HMI function, not only has a communication function for communicating with the control device 2 via the interface unit 17, but also includes an operation control unit 5 for controlling various components based on user inputs and a display control unit 6 for controlling the display of the HMI screen.

[0040] The operation control unit 5 generates an operation instruction corresponding to the user's touch position input operation (touch operation) on the touch panel 15a. The operation instruction includes an instruction to start / stop the control device 2, a change in control data provided to the control device 2, and an instruction to start an application.

[0041] The display control unit 6 processes the data from the control device 2 acquired via the interface unit 17 and displays it on the HMI screen. For example, the display control unit 6 turns on / off an object simulating a light on the HMI screen, or displays a numerical value on an object simulating a numerical display. Furthermore, the display control unit 6 processes changes in the state of the HMI screen based on these operational instructions. For example, the display control unit 6 receives an operational instruction to operate an object simulating a switch and changes the display state (color, shape, etc.) of that object. Furthermore, the display control unit 6 processes changes in the HMI screen based on user operations.

[0042] Furthermore, the display control unit 6 includes an application startup control unit 61 (hereinafter referred to as “AP startup control unit”) and an area position control unit 62 .

[0043] The AP startup control unit 61 controls the startup of applications by operating the HMI screen displayed on the display unit 16. Specifically, an object simulating a startup switch for starting applications (hereinafter referred to as a startup switch) is provided on the HMI screen. Furthermore, when the startup switch on the HMI screen is operated, the AP startup control unit 61 causes the application execution processing unit 31 to start the application pre-set to the startup switch.

[0044] The area position control unit 62 generates an operation control area for enabling or disabling operations on the above-mentioned application window, and controls the position of the operation control area so that the display changes in conjunction with changes in the corresponding application window. The operation control area is a transparent window superimposed on the application window and is associated with a specific application. Figure 3 As shown, for example, operation control areas 301 to 303 are arranged overlappingly on application window 201. Operation control area 301 is arranged on application window 201, and operation control areas 302 and 303 are arranged horizontally with intervals on operation control area 301. Each of operation control areas 301 to 303 is formed in a rectangular shape.

[0045] Note that the arrangement positions, shapes, and settings of the operation control areas 301 to 303 are merely examples and are not limited thereto.

[0046] The operation control areas 301 to 303 are set in the application program as shown in the area setting table shown in Table 1, for example.

[0047] Specifically, the coordinates of the upper left and lower right corners of the operation control areas 301 to 303 are set. Regarding the effectiveness or ineffectiveness of touch operations, the following settings can be selected: 0: Always ineffective, 1: Switching between effective and ineffective with a specified operation (such as a long press), 2: Switching between effective and ineffective with a specified operation (such as a long press) for a specified period of time.

[0048] For operation control areas 301-303, select one of the following two settings as the activation setting: 0: The application is not activated even if an operation is performed; 1: The application is activated if an operation is performed. The group number specifies the operation control areas belonging to the same group. Operation control areas belonging to the same group can be controlled in a coordinated manner.

[0049] [Table 1]

[0050]

[0051] The area position control unit 62 is implemented in the display control unit 6 , but the present invention is not limited to this embodiment. For example, the function of the area position control unit 62 can be realized by executing a resident monitoring application.

[0052] Controlling the operation of the application window by the operation control area of ​​the computer device 1 configured as described above will be described.

[0053] Figure 4 305 is a diagram showing an example of the arrangement of the operation control areas 304 and 305 in the application window 202 . Figure 5 2 is a diagram showing an example of arrangement of the operation control area 306 in the application window 203 .

[0054] First, the display control unit 6 causes the display unit 16 to display an HMI screen (not shown) based on the screen data stored in the auxiliary storage device 14. The HMI screen is provided with a start switch for starting an application. The start switch is set with the application name, and the configuration information in the area setting table is associated with the application name.

[0055] When the activation switch is touched, an activation instruction for activating a designated application is generated and provided to the AP activation control unit 61. The AP activation control unit 61 receives the activation instruction and activates the application having the application name set in the area setting table.

[0056] The AP startup control unit 61 passes the display data of the application window generated by the startup of the application to the area position control unit 62. The area position control unit 62 refers to the area setting table stored in the auxiliary storage device 14 to obtain the setting values ​​including the coordinates (upper left coordinates and lower right coordinates) of the operation control area. Based on this obtained information and the display data of the application window (window display data), the area position control unit 62 creates composite display data in which the operation control area is superimposed on the application window at a predetermined position. Using this composite display data, the display unit 16 displays the application window with the operation control area superimposed on the desktop, which serves as the base screen.

[0057] For example, in Figure 4 In the example shown, application window 202 is displayed on desktop 101. Furthermore, operation control areas 304 and 305 are displayed overlapping application window 202. Operation control area 304 is an area that disables touch operations on application window 202. Operation control area 305 is provided within operation control area 304 and is an area that enables touch operations on application window 202.

[0058] In addition, Figure 5 In the example shown, the application window 203 is displayed on the desktop 101. In addition, an operation control area 306 is displayed superimposed on the application window 203.

[0059] If the application window 203 is opened by the user, Figure 5 If the application window 203 moves in the direction indicated by the arrow, the area position control unit 62 obtains the coordinate value of the application window 203 after the movement (for example, the upper left coordinate value) from the application execution processing unit 31. The area position control unit 62 calculates the difference between the coordinate value of the application window 203 obtained as window display data before the movement and the coordinate value of the application window 203 obtained after the movement to obtain the movement distance of the application window 203.

[0060] Furthermore, the area position control unit 62 adds the distance the application window has moved to the coordinate values ​​of the operation control area 306 in the area setting table to calculate the coordinate values ​​of the operation control area 306 after the movement, and updates the coordinate values ​​in the area setting table to the calculated coordinate values. Furthermore, the area position control unit 62 generates display data for the operation control area 306 based on the coordinate values ​​after the movement, and combines this data with the display data of the moved window received from the application execution processing unit 31 to create composite display data. Based on the composite display data, the display unit 16 displays the operation control area 306, which has moved in conjunction with the moved application window 203, so that it overlaps with the application window 203 while maintaining the same positional relationship as before the movement.

[0061] When the application window changes size (shrinks or expands) in response to a user operation, the area position control unit 62 obtains the length of the diagonal line of the application window 203 after the size change (e.g., the difference between the upper left coordinate value and the lower right coordinate value) from the application execution processing unit 31. The area position control unit 62 obtains the size change rate of the application window by calculating the ratio between the length of the diagonal line of the application window obtained as window display data before the size change and the length of the diagonal line obtained after the size change.

[0062] Furthermore, the area position control unit 62 multiplies the size change rate of the application window by the length of the diagonal of the operation control area that can be specified by the coordinate values ​​in the area setting table (e.g., the difference between the upper left coordinate and the lower right coordinate) to calculate the coordinate values ​​of the operation control area 306 after the size change. The area position control unit 62 updates the coordinate values ​​in the area setting table to the calculated coordinate values. Furthermore, the area position control unit 62 generates display data for the operation control area 306 based on the coordinate values ​​after the size change, and synthesizes this display data with the size-changed window display data received from the application execution processing unit 31 to create synthesized display data. Based on the synthesized display data, the display unit 16 displays the size-changed operation control area in conjunction with the moved application window 203, overlapping it while maintaining the same positional relationship as before the size change.

[0063] As described above, the computer device 1 of this embodiment includes the application startup control unit 61 and the area position control unit 62 .

[0064] By overlaying multiple operation control areas on each application, it is possible to set whether pointing operations are enabled or disabled. This makes it easy to set complex input areas. Furthermore, by moving or resizing the operation control area in response to the movement or resizing of the application window, the operation control area can be displayed superimposed on the moved or resized application window.

[0065] Given the size of the HMI program that implements the functions of the HMI control unit 4, it's difficult for the HMI control unit 4 to incorporate multiple functions. Therefore, to implement functions such as browsers, animation playback, and PDF (Portable Document Format) display, it's sometimes necessary to rely on applications. Therefore, by providing an operation control area within the application window that displays the application's execution results, the scope of operations within the application window can be narrowed to the minimum necessary and associated with the HMI screen. This gives the user the feeling that the application's functions are part of the HMI functionality. This facilitates a sense of integration between the HMI control unit 4 and the application.

[0066] Furthermore, gesture operations (such as pinch-in, pinch-out, and swipe) can be enabled or disabled by setting settings, such as when starting the operation from a valid operation control area (valid area) or when ending the operation within the valid area. For example, even if touch operations are disabled for a certain operation control area, gesture operations can still be enabled. This allows, for example, a PDF viewer application window to enable gesture operations that turn document pages, while disabling scroll bar operations.

[0067] In addition, in this embodiment, the screen overlapping the operation control area is described as an application window. However, the screen overlapping the operation control area is not limited to an application window and can also be the desktop. On the desktop, icons can be listed as areas to be enabled or disabled for touch operations. This also applies to Embodiment 2 described later.

[0068] In this embodiment, a touch operation on the touch panel 15a is used as an example for explaining a pointing operation. However, the object of the pointing operation is not limited to the touch panel 15a, and the mouse 15b may also be used. This also applies to the second embodiment described later.

[0069] (Implementation Method 2)

[0070] The following reference Figure 2 、 Figure 6 and Figure 7 Embodiment 2 of the present invention will be described. In this embodiment, components having the same functions as those in Embodiment 1 are denoted by the same reference numerals, and their description will be omitted.

[0071] Figure 6 1 and 2 are diagrams showing an example of arrangement of the operation control areas 307 and 308 in the application windows 204 and 205 . Figure 7 It is a diagram showing an example of arrangement of the operation control areas 308 and 309 in the application windows 204 to 206 .

[0072] exist Figure 6 In the example shown, application windows 204 and 205 are displayed on the desktop 101. In addition, operation control areas 307 and 308 are displayed superimposed on the application windows 204 and 205, respectively.

[0073] If application window 204 moves from this state to behind application window 205 and is completely hidden, area position control unit 62 deletes operation control area 307. Specifically, area position control unit 62 adds only the display data of operation control area 308 to the window display data of application windows 204 and 205 acquired from application execution processing unit 31 and provides the data to display unit 16. Based on this display data, display unit 16 displays only the image of operation control area 308 superimposed on application window 205.

[0074] This reduces the use of memory resources and eliminates the need for the CPU 11 to monitor the operation control area 307 , thereby reducing the burden on the CPU 11 .

[0075] Even if the operation control area associated with the screen is completely hidden by other operation control areas within the screen, the area position control unit 62 deletes the operation control area. In this case and at least any one of the above cases, the area position control unit 62 may not generate an operation control area.

[0076] Furthermore, the display control unit 6 determines, based on the arrangement order of the application windows starting from the front, whether the pointing position received from the input unit 15 via the operation control unit 5 is within the display range from the frontmost application window to the innermost application window (or desktop). Then, based on the settings in the area setting table for the application windows (applications) whose pointing positions are within the display range, whether the touch operation on the operation control area is valid or invalid is determined.

[0077] exist Figure 7 In the example shown, Figure 6 In the example shown, application window 206 is further displayed on desktop 101, and operation control area 309 is displayed overlapping application window 206. Application window 206 and a portion of operation control area 309 are hidden behind application window 205. However, since operation control area 309 is exposed from application window 205, as described above, it is determined whether the pointed position is within the display range of application window 206. Therefore, unlike operation control area 307, which is completely hidden behind application window 205, it is not deleted.

[0078] Furthermore, if the operation control area 309 is set to active as described above, a touch operation is performed on the exposed portion of the operation control area 309, and the application window 206 is switched to active. During this switching, upon receiving touch detection data on the operation control area 309 from the operation control unit 5, the area position control unit 62 confirms that the active setting in the area setting table is "1." The area position control unit 62 then instructs the application execution processing unit 31 to activate the application that generated the application window 206.

[0079] The application execution processing unit 31 receives this instruction and activates the application. Based on this, the area position control unit 62 obtains from the application execution processing unit 31 the window display data for the application window 206 hidden behind the application window 205. The area position control unit 62 then generates display data for the hidden portion of the operation control area 309 and combines it with the obtained window display data to create composite display data. As a result, the display unit 16 displays the application window 206 in the foreground.

[0080] As described above, in this embodiment, the area position control unit 62 performs the following processing: when an operation control area is set to be activated, even if the operation control area is set to be disabled, the corresponding application is activated without disabling touch operations. This allows an application window that is partially hidden in other application windows to be brought to the front, regardless of whether the operation control area is set to be enabled or disabled.

[0081] If all operation control areas exposed from other application windows are set to disabled, normally, even if the operation control area is touched, the application window overlapped by the operation control area will not be brought to the front. In contrast, the active setting can be said to be a setting that enables only the action of bringing the application window to the front.

[0082] (Variation)

[0083] Modifications of the first and second embodiments will be described below.

[0084] Computer device 1 can be used in a multi-display system connected to multiple displays via a LAN. The multiple displays include clone displays and extended displays. Clone displays display the same image as that displayed on display unit 16 of computer device 1. Extended displays can display images different from those displayed on display unit 16 of computer device 1.

[0085] This allows the clone display to display the same image as the one displayed on display unit 16, with the operation control area provided on the application window. Furthermore, the extended display can display an image with a different operation control area provided on an application window other than the one displayed on display unit 16. This allows operations from other displays to be restricted. Consequently, the multi-display system can have a simple interlocking function.

[0086] The area position control unit 62 can generate an operation control area that disables touch operations on the start menu on the desktop, or disables touch operations on a specific area of ​​the taskbar on the desktop. Furthermore, the area position control unit 62 can generate an operation control area that disables only the "X" button in the title bar of an application window, which is used to terminate the application.

[0087] This makes it possible to restrict the launch of unnecessary applications from the desktop and prevent applications from being accidentally terminated.

[0088] When an application program that monitors the operating status of a device is activated, the computer device 1 may restrict operations on the application window when displaying an application window that lists data collected from the device being monitored. Specifically, the area position control unit 62 may generate an operation control area that only enables operations to scroll the application window.

[0089] Furthermore, the computer device 1 may also display an application window superimposed on the HMI screen. Examples of applications used to display such application windows include PDF readers, spreadsheet applications, SCADA (Supervisory Control and Data Acquisition) programs, and ladder monitoring programs. Ladder monitoring programs monitor the execution status of ladder programs in PLCs.

[0090] In this way, it is possible to set restrictions on the operation of various applications. In addition, if the computer device 1 is a model specifically for industrial use (a model that is dustproof, vibration-proof, waterproof, etc.), it is possible to build a dedicated system by combining it with an application suitable for FA (Factory Automation).

[0091] When a setting application is running, the computer device 1 may also restrict operations on other application windows displayed behind the setting application window. For example, the area position control unit 62 may generate an operation control area that disables operations on other application windows until the setting is completed.

[0092] This prevents operations on other application windows even if the setting is not completed.

[0093] Even for a computer device 1 that is a portable terminal (tablet, portable PC, etc.), input operations on an application window can be restricted. For example, when an application window that accepts pen input is displayed, the area position control unit 62 can generate an operation control area that disables touch operations on areas of the application window other than the area where pen input is possible.

[0094] Thus, even if the hand holding the pen touches an area other than the area where pen input is possible in the application window, it is possible to prevent such touch from being accepted as an input operation.

[0095] The operation control area may also be set to enable or disable the pointing operation according to the user's authority level. In addition, the area position control unit 62 controls the enable or disable of the operation on the operation control area based on the setting of the operation control area.

[0096] Thus, the permitted operation content of the application can be differentiated according to the authority level of the user logged into the computer device 1. For example, for the user with the highest authority level, all areas of the application window can be set to be operable, and the lower the user's authority level, the more areas of the application window can be set to be invalid.

[0097] Such setting can also be performed for each application. In addition, based on such setting, the operation control area that invalidates the operation can be managed for each user, and the user whose operation is invalid can also be managed for each operation control area.

[0098] In the operation control area, an action different from the valid / invalid action for validating or invalidating the pointing operation in the operation control area may be set. In addition, the HMI control unit 4 (action execution unit) may execute the action set in the operation control area.

[0099] Thus, according to the pointing operation, the output of sound, the output of message, the recording of operation records (target application, user of operation, operation time, etc.) can be performed in parallel. Only one of these operations can be performed, or multiple operations can be performed in combination.

[0100] Each operation control area can be set with a visual effect that can distinguish whether the pointing operation is valid or invalid. In addition, the area position control unit 62 can also generate the set visual effect in the operation control area according to whether the pointing operation is valid or invalid.

[0101] This makes it possible to visually notify the user whether the pointing operation on the operation control area is valid or invalid.

[0102] The operation control area may also be set with a visual effect for an event different from the pointing operation. In addition, the area position control unit 62 may also cause the operation control area to produce the set visual effect when the event occurs.

[0103] Thus, when an event other than a pointing operation on the operation control area occurs, a visual effect associated with the event is generated in the operation control area. Thus, visual effects such as a warning color such as red or a message can easily notify the user of an event such as an alarm that should be notified.

[0104] The area position control unit 62 may also change the size or move the operation control area through gesture operations (pinch-in, pinch-out, slide, etc.).

[0105] This allows the operation control area to be resized or moved freely. However, there is a concern that the application's operation restriction effect will be reduced. To avoid reducing the operation restriction effect, it is sufficient to set the touch operation to be valid or invalid according to the user's authority level.

[0106] When the start switch on the HMI screen is operated to start the application, it is also possible to select whether to apply the valid or invalid setting regarding the operation control area in the area setting table.

[0107] In this way, whether to apply the valid or invalid setting can be selected based on an external operation.

[0108] The area position control unit 62 can distinguish between an operation performed by the touch panel 15a (touch operation) and an operation performed by the mouse 15b (mouse operation) in position input operations, thereby controlling whether the operation on the operation control area is valid or invalid. Specifically, the area position control unit 62 receives the result of the operation control unit 5 determining whether the operation was performed by the touch panel 15a or the mouse 15b, and distinguishes between the operation performed by the touch panel 15a and the operation performed by the mouse 15b.

[0109] Thus, for example, the operation through the touch panel 15 a can be controlled to be valid or invalid according to the setting, while the operation through the mouse 15 b can be set to be all valid.

[0110] (Summary of Implementation Methods)

[0111] An operation input control device (computer device 1) of one embodiment of the present invention comprises: a screen display control unit (application execution processing unit 31) for controlling so that at least one screen is displayed in a manner capable of changing position or size; and an area position control unit 62 for generating an operation control area for enabling or disabling a position input operation on the screen, so that the operation control area is overlapped on the screen and associated with the screen, and the position of the operation control area is controlled so that the position of the operation control area changes in conjunction with changes in the corresponding screen.

[0112] According to the above structure, the operation control area superimposed on the screen can enable or disable the position input operation of the screen when it is displayed in the front. In addition, if the screen changes due to the size or movement of the screen, the operation control area also changes in conjunction with the change.

[0113] In the operation input control device, the area position control unit 62 may not generate the operation control area in at least any one of the following situations: the operation control area that is not associated with the screen is completely hidden in the screen, and the operation control area that is associated with the screen is completely hidden in other operation control areas located within the screen.

[0114] According to the above configuration, an operation control area can be generated and resources for control can be released.

[0115] In the operation input control device, the operation control area is a transparent window that enables setting of validity, invalidity, or switching between validity and invalidity of the position input operation.

[0116] According to the above configuration, the operation control area can be set without the user being aware of it.

[0117] In the operation input control device, when the operation control area is partially exposed and hidden on the screen that is not associated with it, if a position input operation is performed on the exposed part of the operation control area, the area position control unit 62 controls the display of the screen according to the setting so that the screen corresponding to the operation control area appears in the front.

[0118] According to the above structure, by performing a pointing operation on the operation control area corresponding to the other screen behind the screen displayed in the front, the other screen can be set to be displayed in the front and activated. If such a setting is not made, the other screen cannot be displayed in the front even if the pointing operation is performed.

[0119] In the operation input control device, the operation control area can set the validity or invalidity of the position input operation according to the user's authority level, and the area position control unit 62 can also control the validity or invalidity of the operation of the operation control area based on the setting of the operation control area.

[0120] According to the above configuration, the validity or invalidity of the operation on the operation control area is controlled according to the user's authority level. This makes it possible to appropriately distinguish the validity or invalidity of the operation on the operation control area.

[0121] In the operation input control device, the operation control area can be set with a visual effect that can determine whether the position input operation is valid or invalid for each operation control area, and the area position control unit 62 can also make the operation control area produce the set visual effect according to the validity or invalidity of the position input operation of the operation control area.

[0122] According to the above configuration, whether the pointing operation on the operation control area is valid or invalid can be easily determined by visual effects.

[0123] In the operation input control device, the area position control section 62 may also distinguish between a touch operation and a mouse operation in the position input operation, thereby controlling the validity or invalidity of the operation on the operation control area.

[0124] According to the above configuration, for example, touch operations can be controlled to be enabled or disabled according to settings, while all mouse operations can be set to be enabled.

[0125] (Software Implementation Example)

[0126] The control module of the computer device 1 (especially, the HMI control unit 4 ) is realized by software.

[0127] Computer device 1 executes commands from a program, which is software that implements various functions. Computer device 1 includes, for example, one or more processors (CPU 11) and a computer-readable storage medium storing the program. In computer device 1, the processor reads and executes the program from the storage medium, thereby achieving the objectives of the present invention.

[0128] As the storage medium, a "non-transitory tangible medium" such as a magnetic tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like, other than ROM (Read Only Memory) can be used. Furthermore, the main memory 12 may be composed of a RAM (Random Access Memory) or the like for storing the program. Furthermore, the program can be supplied to the computer via any transmission medium capable of transmitting the program (such as a communication network or broadcast waves).

[0129] It should be noted that one embodiment of the present invention can also be realized in the form of a data signal embedded in a carrier wave, which is embodied by the above-mentioned program through electronic transmission.

[0130] (Notes)

[0131] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the technical solutions. Embodiments obtained by appropriately combining technical means disclosed in different embodiments are also within the technical scope of the present invention.

[0132] Description of reference numerals:

[0133] 1: Computer equipment (operation input control device)

[0134] 4: HMI control unit (action execution unit)

[0135] 31: Application execution processing unit (screen display control unit)

[0136] 62: Regional Position Control Department

[0137] 201-206: Application window (screen)

[0138] 301-309: Operation control area

Claims

1. An operation input control device, wherein: have: a screen display control unit configured to control the display of at least one screen in a manner capable of changing its position or size; as well as An area position control unit generates an operation control area for enabling or disabling a position input operation on the screen as a window, so that the operation control area overlaps the screen and is associated with the screen, and controls the position of the operation control area by calculating the coordinates of the operation control area corresponding to the changed screen based on the degree of change in the position or size of the screen, so that the position of the operation control area changes in conjunction with the change in the position or size of the corresponding screen.

2. The operation input control device according to claim 1, wherein: The area position control unit adds the moving distance of the screen to the coordinates of the operation control area before the movement to calculate the coordinates of the operation control area after the movement corresponding to the changed screen. The area position control unit multiplies the ratio of the diagonals of the screen before and after the size change by the length of the diagonals of the operation control area before the size change to calculate the coordinates of the operation control area after the size change corresponding to the changed screen, or multiplies the ratio of the difference in coordinates of the diagonal vertices in the screen before and after the size change by the difference in coordinates of the diagonal vertices in the operation control area before the size change to calculate the coordinates of the operation control area after the size change corresponding to the changed screen.

3. The operation input control device according to claim 1, wherein: The area position control unit does not generate the operation control area in at least either one of a case where the operation control area not associated with the screen is completely hidden in the screen and a case where the operation control area associated with the screen is completely hidden in another operation control area within the screen.

4. The operation input control device according to claim 1 or 3, wherein: The operation control area is a transparent window that can be used to set the position input operation to be valid, invalid, or switch between valid and invalid.

5. The operation input control device according to claim 1 or 3, wherein: When the operation control area is partially exposed and hidden on the screen that is not associated with it, if a position input operation is performed on the exposed part of the operation control area, the area position control unit controls the display of the screen so that the screen associated with the operation control area appears in the front according to the setting.

6. The operation input control device according to claim 1 or 3, wherein: The operation control area sets the validity or invalidity of the position input operation according to the user's authority level. The area position control unit controls validity or invalidity of an operation on the operation control area based on the setting of the operation control area.

7. The operation input control device according to claim 1 or 3, wherein: The operation control area is set with a visual effect that can determine whether the position input operation is valid or invalid for each of the operation control areas. The area position control unit causes the operation control area to produce the set visual effect according to whether the position input operation to the operation control area is valid or invalid.

8. The operation input control device according to claim 1 or 3, wherein: The area position control unit distinguishes between a touch operation and a mouse operation in a position input operation, thereby controlling validity or invalidity of an operation on the operation control area.

Images