Input support device, control method and program
The input support device adjusts touch panel sensitivity or orientation based on finger movement prediction, addressing operational errors caused by disturbances and ensuring accurate touch operations.
Patent Information
- Application Number
- JP2021043078
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-03-17
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2041-03-17
AI Technical Summary
Existing touch panel technologies struggle with operational errors due to acceleration or vibration, particularly when users are unable to maintain an appropriate posture for touch operations, leading to insufficient contact and potential misalignment of touch positions.
An input support device that includes a pressure sensor on a support stand to predict the movement direction of a user's finger and adjust the sensitivity or orientation of the touch panel accordingly, ensuring easier and more accurate touch operations by increasing sensitivity or reorienting the panel to facilitate better contact.
Reduces operational errors by enhancing touch panel sensitivity and alignment during disturbances, allowing users to perform accurate touch operations even when in less than ideal postures.
Smart Images

Figure 0007588530000001 
Figure 0007588530000002 
Figure 0007588530000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an input support device, a control method, and a program. [Background technology]
[0002] Nowadays, touch panels, which are input / output devices that display images representing areas that accept input operations, such as images or icon images showing operation buttons (hereinafter collectively referred to as "operation button images") on a screen, and allow a user to perform input operations by touching the display area of the operation button images, have become widespread. When such a touch panel is mounted on a moving object such as a vehicle, the user may not be able to perform the desired touch operation due to acceleration or vibrations that occur with the behavior of the moving object. In this case, an operation error may occur.
[0003] Conventionally, there is a technology that uses a proximity sensor to detect a user's hand approaching a touch panel, and when the hand is detected, increases the sensitivity of the touch panel (for example, see Patent Document 1). This makes it easier for the touch panel to accept input operations when the user performs a touch operation, and makes it less likely that the user's hand will be erroneously detected when the user does not perform a touch operation. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2015-84194 A Summary of the Invention [Problem to be solved by the invention]
[0005] In the above conventional technology, the sensitivity of the touch panel can be increased if the proximity sensor detects the user's hand, but when a disturbance occurs, such as acceleration or vibration caused by the behavior of a moving object, it may be difficult to detect the hand itself. In addition, when a disturbance occurs, the user is not necessarily able to perform a touch operation in an appropriate posture. When the posture is not appropriate, for example, the user may not be able to perform a touch operation with sufficient contact using the pad of the finger, and may be forced to perform a touch operation with insufficient contact using the side part of the fingertip or nail, which has a small contact area. In addition, the touch position may deviate from the desired position. In such a case, the conventional technology may not correctly accept the input operation, which may cause the user to make an operation error.
[0006] The present invention has been made in consideration of the above circumstances, and one of its objects is to provide an input support device, a control method, and a program that can further reduce the occurrence of user operation errors. [Means for solving the problem]
[0007] The input support device, the control method, and the program according to the present invention employ the following configuration. (1): An input support device according to one embodiment of the present invention is an input support device that includes: an acquisition unit that is provided near a touch panel and acquires sensor information from a contact sensor that detects contact with a user's hand performing a touch operation on the touch panel; and a state control unit that changes an input acceptance state of the touch operation on the touch panel based on the sensor information.
[0008] (2): In the above aspect (1), a prediction unit is further provided which predicts a moving direction of a finger used for the touch operation based on the sensor information, and the state control unit controls the input acceptance state to be changed in accordance with the moving direction of the finger predicted by the prediction unit, thereby making it easier to accept the input of the touch operation.
[0009] (3) In the above aspect (2), the state control unit changes the input acceptance state when an angle of the moving direction of the finger with respect to the screen of the touch panel is equal to or smaller than a predetermined angle.
[0010] (4) In the above aspect (3), the state control unit increases the sensitivity of the touch panel when an angle of the moving direction of the finger with respect to the screen is equal to or smaller than a predetermined angle.
[0011] (5) In the above aspect (3), the state control unit changes the orientation of the screen when an angle of the moving direction of the finger with respect to the screen is equal to or smaller than a predetermined angle.
[0012] (6): In any of the above aspects (2) to (5), the contact sensor is a pressure sensor that detects pressure caused by contact with the user's hand, and the prediction unit predicts the movement direction of the finger based on a pressure distribution of the pressure.
[0013] (7) In the above aspect (6), the prediction unit predicts the moving direction of the finger based on the moving direction of the center of gravity of the pressure distribution when there is a change in the pressure distribution.
[0014] (8): In any one of the above aspects (1) to (7), the contact sensor is installed facing upward from the lower end of the touch panel toward the front of the touch panel.
[0015] (9): A control method according to one embodiment of the present invention is a control method in which a computer acquires sensor information from a contact sensor provided near a touch panel and detects contact with a user's hand performing a touch operation on the touch panel, and changes an input acceptance state of the touch operation on the touch panel based on the sensor information.
[0016] (10): A program according to one embodiment of the present invention is a program that causes a computer to acquire sensor information from a contact sensor that is provided near a touch panel and detects contact with a user's hand performing a touch operation on the touch panel, and changes an input acceptance state of the touch operation on the touch panel based on the sensor information. Effect of the Invention
[0017] According to aspects (1) to (10), the occurrence of operational errors by the user can be further reduced. [Brief description of the drawings]
[0018] [Figure 1] 1 is a block diagram showing an overall configuration of an input support system 1 according to a first embodiment of the present invention. [Diagram 2] 1 is a perspective view of a configuration example of a touch panel 100 and a support base 110 according to a first embodiment of the present invention. [Diagram 3] FIG. 1 is a schematic diagram illustrating a state in which a user performs a touch operation on a touch panel 100 according to a first embodiment of the present invention. [Figure 4] 2 is a diagram showing an example of a pressure distribution of a pressure applied to the pressure sensor 111 according to the first embodiment of the present invention. FIG. [Diagram 5] 11A and 11B are schematic diagrams illustrating a state of a touch operation when a user is not in an appropriate posture. [Figure 6] 11A and 11B are schematic diagrams illustrating a state of a touch operation when a user is in an appropriate posture. [Figure 7] 2 is a diagram showing an example of a pressure distribution of a pressure applied to the pressure sensor 111 according to the first embodiment of the present invention. FIG. [Figure 8] 4 is a flowchart showing an operation of the input support device 200 according to the first embodiment of the present invention. [Figure 9] FIG. 11 is a block diagram showing an overall configuration of an input support system 1a according to a second embodiment of the present invention. [Figure 10]FIG. 11 is a schematic diagram illustrating a state in which a user performs a touch operation on a touch panel 100 according to a second embodiment of the present invention. [Figure 11] 13 is a diagram showing an example of changing the orientation of the touch panel 100 by a drive control unit 216a according to the second embodiment of the present invention. FIG. [Figure 12] 13 is a diagram showing an example of changing the orientation of the touch panel 100 by a drive control unit 216a according to the second embodiment of the present invention. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0019] Hereinafter, an input support device, a control method, and a program according to an embodiment of the present invention will be described with reference to the drawings.
[0020] <First embodiment> Hereinafter, an input support device 200 according to a first embodiment of the present invention will be described. The input support device 200 is an information processing device that predicts the moving direction of a user's finger about to touch a touch panel based on the pressure from the user's hand obtained from a pressure sensor provided on a support stand that supports the user's hand operating a touch panel mounted on a moving object, and changes the sensitivity of the touch panel according to the prediction result.
[0021] Generally, when a disturbance occurs, the user is not necessarily able to perform a touch operation in an appropriate posture. When the user is not in an appropriate posture, the user may not be able to perform a touch operation with sufficient contact, and may be forced to perform a touch operation with the side part of the fingertip, which has a small contact area. The disturbance referred to here is, for example, an event that generates a force other than gravity acting on the user who operates the touch panel. The disturbance is, for example, a turning motion of a moving body that generates centrifugal force, a vertical vibration caused by unevenness of the road surface, and a moving body running on a slope that generates a vertical force. The greater the influence of these disturbances, the more difficult it becomes to perform a touch operation with sufficient contact on the touch panel. The input support device 200 in this embodiment controls the touch panel sensitivity to be higher than a reference value when it is predicted that the user will not be able to perform a touch operation with sufficient contact, so that the input of the touch operation is more easily accepted.
[0022] [Configuration of the input support system] The following describes the configuration of an input support system 1 having the above-described input support device 200. Fig. 1 is a block diagram showing the overall configuration of an input support system 1 according to a first embodiment of the present invention.
[0023] The input support system 1 of this embodiment is a system mounted on a vehicle (not shown). The vehicle on which the input support system 1 is mounted is, for example, an electric vehicle, or a vehicle mounted with an internal combustion engine such as a diesel engine or a gasoline engine. The vehicle on which the input support system 1 is mounted may be a hybrid vehicle mounted with an internal combustion engine and a secondary battery that stores electric power for running that is supplied to a drive motor, or a vehicle mounted with a fuel cell that supplies electric power for running to a drive motor. The input support system 1 may be mounted on a moving body other than a vehicle, such as an airplane or a ship.
[0024] The input support system 1 includes a touch panel 100, a support base 110, and an input support device 200. In this embodiment, the touch panel 100, the support base 110, and the input support device 200 are each separate devices or components, but some or all of these components may be configured as an integrated device.
[0025] The touch panel 100 is an input / output unit that displays various information and accepts information input by a user's touch operation. The touch panel 100 can change the sensitivity for detecting an input operation by a touch operation. The touch panel 100 includes an LCD (Liquid Crystal Display) panel 101, a touch sensor 102, and a sensitivity change unit 103.
[0026] The LCD panel 101 displays various information. The touch sensor 102 is disposed on top of the display surface of the LCD panel 101. The touch sensor 102 accepts information input by a user's touch operation. In this embodiment, various types of touch panels, such as a pressure-sensitive touch panel or an electrostatic touch panel, can be used as the touch panel 100. The touch sensor 102 outputs to the control unit 210 signals indicating the touch position (coordinates) and range, identification information for identifying the detection range corresponding to the touch position, and values such as a capacitance change or pressure change at the touch position.
[0027] The touch sensor 102 may be configured to continuously output a signal to the control unit 210 while the detection range is touched. This makes it possible to determine whether the touch operation by the user is a normal tap or a long press. The touch sensor 102 may be configured to continuously output a signal indicating the touched position (coordinates) to the control unit 210 while the detection range is touched. This makes it possible to determine whether the touch operation by the user is a drag or a flick. Furthermore, the touch sensor 102 may be configured to detect that two detection ranges are touched at the same time, and continuously output a signal indicating the two touched positions (coordinates) to the control unit 210 while the detection range is touched. This makes it possible to determine whether the touch operation by the user is a pinch-in or a pinch-out.
[0028] The sensitivity change unit 103 changes the sensitivity when the touch sensor 102 senses a touch. The sensitivity change unit 103 switches between high sensitivity and normal sensitivity, for example. The normal sensitivity is a sensitivity based on a predetermined reference value, and the high sensitivity is a sensitivity relatively higher than the normal sensitivity. The sensitivity change unit 103 may be configured to change the sensitivity in multiple stages, such as three or more stages.
[0029] The touch panel 100 functions as an input / output unit for, for example, a navigation system, an audio system, a personal assistant system, a drive recorder system, a parking assistance system, a driving control system, and various setting screens related to the vehicle that are installed in the vehicle.
[0030] The touch panel 100 is installed, for example, in the center of a dashboard inside the vehicle. The display surface of the touch panel 100 may be installed tilted slightly from the rear of the vehicle toward the driver, for example, to make it easier for the driver to operate.
[0031] The installation position of the touch panel 100 is not limited to the dashboard, and may be, for example, installed behind the driver's seat or the passenger seat. The touch panel 100 may be replaced by a touch panel mounted on a mobile terminal such as a smartphone or a tablet terminal. In this case, for example, a base for the mobile terminal is provided in the vehicle, and the mobile terminal installed on the base functions in the same way as the stationary touch panel 100.
[0032] The support base 110 is a base that supports the hand of a user performing a touch operation on the touch panel 100. The support base 110 supports the hand of the user like an armrest, allowing the user to easily perform a touch operation.
[0033] For example, the support base 110 is a plate-like member arranged to extend from the lower end of the touch panel 100 toward the user (the direction in which the display surface faces). Fig. 2 shows a perspective view of an example of the configuration of the touch panel 100 and the support base 110 according to the first embodiment of the present invention. As shown in Fig. 2, a pressure sensor 111 is arranged facing upward so as to cover the entire upper surface of the support base 110. Note that, in the input support system 1 of this embodiment, the touch panel 100 and the support base 110 are assumed to be integrated, but they may also be separated.
[0034] For example, when a user touches touch panel 100 with an index finger, the user can place other parts of the hand, such as the ring finger or middle finger, on support base 110. Support base 110 is a base that is installed, for example, with a width of about 10 to 15 mm from the bottom end of touch panel 100 toward the front of the screen. Therefore, when a user places a finger on support base 110, the user can place at least the part from the fingertip to the first joint.
[0035] The pressure sensor 111 provided on the support base 110 can measure the pressure received from a hand placed on the support base 110 and the position where the pressure occurred, and generate a pressure distribution. The pressure sensor 111 outputs information indicating the generated pressure distribution to the input support device 200. The pressure sensor 111 measures the pressure at a sampling interval of, for example, 100 [Hz], and outputs a signal indicating the pressure distribution to the input support device 200 each time.
[0036] The input support device 200 includes a control unit 210 and a storage unit 220. The control unit 210 controls the operation of each component of the input support system 1, such as the touch panel 100, the pressure sensor 111, and the storage unit 220. The control unit 210 includes a drawing processing unit 211, a detection range setting unit 212, an operation detection processing unit 213, an operation direction prediction unit 214, and a sensitivity control unit 215.
[0037] These components of the control unit 210 are realized by, for example, a hardware processor such as a CPU (Central Processing Unit) executing a program (software). Some or all of these components may be realized by hardware (including circuitry) such as an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a GPU (Graphics Processing Unit), or may be realized by a combination of software and hardware. The program may be stored in advance in a storage device (a storage device having a non-transient storage medium) such as an HDD (Hard Disk Drive) or a flash memory, or may be stored in a removable storage medium (a non-transient storage medium) such as a DVD or a CD-ROM, and installed by mounting the storage medium in a drive device.
[0038] The storage unit 220 stores various programs such as a control program and an application program that the control unit 210 uses to control the input support system 1. The storage unit 220 also stores various data used by the control programs, application programs, etc. The storage unit 220 is, for example, a storage medium such as an HDD or a flash memory.
[0039] Each component of the control unit will now be described.
[0040] The drawing processor 211 controls the drawing process of an image by the LCD panel 101. The drawing processor 211, for example, causes the LCD panel 101 to display an image showing a screen for accepting touch operation input by a user (hereinafter referred to as a "touch operation input screen"). In addition, the drawing processor 211, for example, causes the LCD panel 101 to display an operation button image at a predetermined position within the touch operation input screen.
[0041] The detection range setting unit 212 controls the detection range of the touch sensor 102 for the user's touch operation. The detection range here means a range for detecting a touch by the user. The detection range setting unit 212 sets the detection range according to the display area of the operation button images on the LCD panel 101. The detection range setting unit 212 may set the detection range to be slightly wider than the display area of the operation button images so as to include the display area. This allows an input operation to be accepted even if the user cannot accurately touch the display area of the desired operation button image, as long as there is a slight deviation.
[0042] The operation detection processing unit 213 acquires a signal output from the touch sensor 102. The signal includes information indicating the touched area. The information indicating the touched area is, for example, the touch position and the indicated coordinates, a coordinate group indicating the contact area, identification information for identifying each detection area, etc. The operation detection processing unit 213 can specify the touched detection area, the position of the detection area, the shape of the detection area, etc. based on the acquired information. In addition, the signal output from the touch sensor 102 includes information indicating a change in capacitance or a change in pressure in the touched area.
[0043] The operation detection processing unit 213 outputs information indicating the detection result of the touch operation by the user to various systems. The various systems referred to here are, for example, a navigation system, an audio system, a personal assistant system, a drive recorder system, a parking assistance system, a driving control system, and various setting screens related to the vehicle, which are installed in the vehicle.
[0044] The operation detection processing unit 213 may determine whether the touch operation by the user is a normal tap or a long press, depending on the time during which the signals are continuously acquired. Furthermore, the operation detection processing unit 213 may detect a change in the touch position (coordinates) based on information included in each of the continuously acquired signals, and determine whether the touch operation by the user is a drag, a flick, a pinch in, or a pinch out.
[0045] The operation direction prediction unit 214 acquires a signal output from the pressure sensor 111. The operation direction prediction unit 214 predicts the moving direction of the user's finger about to touch the touch panel 100 based on the pressure distribution based on the acquired signal and the time series change of the pressure distribution. An example of the movement direction prediction process and the sensitivity change process for changing the sensitivity of the touch panel will be described in detail later. The operation direction prediction unit 214 outputs information indicating the predicted moving direction of the user's finger to the sensitivity control unit 215.
[0046] The sensitivity control unit 215 acquires the information output from the operation direction prediction unit 214. When it is predicted based on the acquired information that the user will not be able to perform a touch operation with sufficient contact, the sensitivity control unit 215 performs control so that the input of the touch operation is more easily accepted. Specifically, when the angle between the display surface of the touch panel 100 and the moving direction of the user's finger based on the acquired information is equal to or smaller than a predetermined angle, the sensitivity control unit 215 controls the sensitivity change unit 103 so as to increase the sensitivity of the touch sensor 102 above a reference value.
[0047] [Movement direction prediction process and sensitivity change process] Hereinafter, the process of predicting the moving direction of the user's finger by the operation direction prediction unit 214 and the sensitivity change process for changing the sensitivity of the touch panel 100 by the sensitivity control unit 215 will be described with specific examples.
[0048] 3 is a schematic diagram showing a state of a user's touch operation. In the example shown in FIG. 3, as shown in a dotted circle, the user places the ring finger of the left hand on the support base 110 and performs a touch operation on the touch panel 100 with the index finger, using the ring finger as support. Even when a disturbance such as acceleration or vibration occurs in a vehicle equipped with the touch panel 100, the user can perform a touch operation more easily by placing the hand on the support base 110. Note that, as an example, a case where the user places the ring finger on the support base 110 and performs a touch operation with the index finger will be described here, but the user can use any finger to perform the operation.
[0049] The pressure sensor 111 provided on the support base 110 measures the pressure applied by the user's ring finger and generates a pressure distribution. The operation direction prediction unit 214 acquires a signal output from the pressure sensor 111, and predicts the moving direction of the user's index finger about to touch the touch panel 100 based on the pressure distribution based on the acquired signal and the time-series change in the pressure distribution.
[0050] 4 is a diagram showing an example of pressure distribution of pressure applied to the pressure sensor 111 by the ring finger of the left hand shown in FIG. 3. The operation direction prediction unit 214 predicts, for example, that the longitudinal direction of the overall shape of the pressure distribution (direction D1 in FIG. 4) is the direction of the ring finger placed on the support base 110. The operation direction prediction unit 214 also assumes that the direction of the ring finger placed on the support base 110 is the same as the direction of the index finger performing a touch operation on the touch panel 100. That is, the operation direction prediction unit 214 predicts that the direction D1 in FIG. 4 is the direction of the index finger of the user who is about to perform a touch operation. In addition, in FIG. 4, the mark x indicates the center of gravity position G1 of the pressure distribution.
[0051] In general, when a user cannot perform a touch operation in an appropriate posture, the user may be forced to perform a touch operation with insufficient contact using the side part of the fingertip or a nail, which has a small contact area, as shown in FIG. 5. In this case, the angle between the screen of the touch panel 100 and the moving direction of the finger is relatively small, the shape of the contact area is elongated, and the contact is difficult to detect. Therefore, in this case, in order to make it easier to accept the input of the touch operation, it is necessary to increase the sensitivity of the touch panel 100. On the other hand, when a user can perform a touch operation in an appropriate posture, the user can perform a touch operation with sufficient contact using the pad of the finger, as shown in FIG. 6, for example. In this case, the angle between the screen of the touch panel 100 and the moving direction of the finger is relatively large, the shape of the contact area is wide, and the contact is easy to detect.
[0052] The sensitivity control unit 215 specifies an angle between the screen of the touch panel 100 and the moving direction of the finger based on the moving direction of the user's finger based on the information acquired from the operation direction prediction unit 214. When the specified angle is equal to or smaller than a predetermined angle, the sensitivity control unit 215 controls the sensitivity change unit 103 to increase the sensitivity of the touch sensor 102 above a reference value by resetting the distribution of detection thresholds based on the direction in which the user is about to touch. That is, the sensitivity control unit 215 sets the angle of a virtual touch panel facing a direction intersecting with the reference direction, based on a direction opposite to the moving direction of the user's finger. The sensitivity control unit 215 performs control to reset the distribution of detection thresholds so as to increase the detection accuracy (sensitivity) in a direction along the reference direction from the virtual touch panel. Therefore, for example, if a user's finger moves at an angle tilted to the right of the actual angle facing touch panel 100, the capacitance required for detection at a position to the left of touch panel 100 will be relatively low, and the capacitance required for detection at a position to the right of touch panel 100 will be relatively high.
[0053] Furthermore, when a change occurs in the pressure distribution of the pressure applied to the pressure sensor 111 by the ring finger of the user placed on the support base 110, the input support system 1 of this embodiment controls the sensitivity of the touch sensor 102 according to the change. The pressure distribution changes, for example, when a user places his / her hand on the support base 110 and then changes the posture of the hand to start a touch operation on the touch panel 100. Alternatively, the pressure distribution changes, for example, when a user places his / her hand on the support base 110 and then changes the posture of the hand by determining the direction in which the touch operation on the touch panel 100 will be performed, and the position of the ring finger moves or rotates on the support base 110. The input support system 1 of this embodiment captures such a user's movement by detecting the change in pressure distribution, and appropriately controls the sensitivity of the touch sensor 102 in advance.
[0054] Fig. 7 is a diagram showing an example of a pressure distribution after a change with respect to the pressure distribution before the change shown in Fig. 4. In Fig. 7, a white x mark indicates a center of gravity position G1 in the pressure distribution before the change shown in Fig. 4. Moreover, a black x mark indicates a center of gravity position G2 in the pressure distribution after the change. The operation direction prediction unit 214 predicts that a direction D2 from the center of gravity position G1 of the pressure distribution before the change to the position G1 of the pressure distribution after the change is the direction of the index finger of the user who is about to perform a touch operation.
[0055] In general, when a user moves a finger, such as an index finger, touching the touch panel 100 in a specific direction to bring the finger closer to the touch panel 100, the position of pressure on the support base 110 by a finger, such as a ring finger, placed on the support base 110 also tends to move in the same direction. The input support system 1 of this embodiment utilizes this characteristic to predict the movement direction of the finger touching the touch panel 100 from the movement direction of the pressure distribution on the support base 110, and changes the sensitivity of the touch sensor 102 according to the prediction result.
[0056] There may also be cases where the user places other parts of the hand (such as a part of a clenched fist) on the support base 110 instead of the fingers. In such cases, for example, it may be difficult for the operation direction prediction unit 214 to predict the moving direction of the user's finger who is trying to operate the touch panel. When it is difficult to predict the moving direction of the finger, for example, the sensitivity control unit 215 may change the sensitivity of the touch panel 100 to be higher than the reference value, as in the case where the angle between the screen of the touch panel 100 and the moving direction of the finger is equal to or smaller than a predetermined angle.
[0057] Alternatively, when it is difficult to predict the moving direction of the finger, for example, the sensitivity control unit 215 may control the sensitivity of the touch panel 100 after a touch operation is performed at least once on the touch panel 100 and the touched area is identified by the operation detection processing unit 213, based on the identified area. In other words, when it is difficult to predict the moving direction of the finger, the input support device 200 may acquire a value of a capacitance change or a pressure change in the touch operation after the touch operation is performed once, and if the acquired value is low (i.e., if the touch operation is not sufficiently in contact), control the sensitivity of the touch panel 100 to be higher than a reference value.
[0058] [Operation of input support device] An example of the operation of the input support device 200 will be described below. Fig. 8 is a flowchart showing the operation of the input support device 200 according to the first embodiment of the present invention. The operation of the input support device 200 shown in this flowchart is started when an operation is performed to turn on the power of the input support system 1 including the input support device 200. The power of the input support system 1 is turned on in conjunction with, for example, turning on the power of the vehicle in which the input support device 200 is mounted.
[0059] The input support system 1 is powered on. As the input support system 1 is powered on, the input support device 200 is powered on (step S101). When the power is turned on, the drawing processing unit 211 displays, for example, a touch operation input screen and operation button images on the LCD panel 101. In addition, the detection range setting unit 212 sets the detection range of the touch sensor 102 according to the display area of the operation button images on the LCD panel 101. As the input support system 1 is powered on, the pressure sensor 111 is powered on. The pressure sensor 111 starts detecting pressure.
[0060] Next, the operation direction prediction unit 214 waits for an input of a signal output from the pressure sensor 111 (step S102). When the operation direction prediction unit 214 acquires the signal output from the pressure sensor 111, the operation direction prediction unit 214 predicts the moving direction of the user's finger about to touch the touch panel 100 based on the pressure distribution based on the signal (step S103). The operation direction prediction unit 214 outputs information indicating the predicted moving direction of the user's finger to the sensitivity control unit 215.
[0061] Next, the sensitivity control unit 215 acquires the information output from the operation direction prediction unit 214. The sensitivity control unit 215 determines whether or not the angle between the display surface of the touch panel 100 and the moving direction of the user's finger based on the acquired information is equal to or smaller than a predetermined angle (step S104). If the angle between the display surface of the touch panel 100 and the moving direction of the user's finger is equal to or smaller than the predetermined angle, the sensitivity control unit 215 controls the sensitivity change unit 103 to change the sensitivity of the touch sensor 102 (step S105).
[0062] Next, the operation direction prediction unit 214 waits for a change in the pressure distribution based on the signal output from the pressure sensor 111 (step S107) until the power supply of the input support device 200 is turned off (step S106). If the pressure distribution has changed, the input support device 200 repeats the processes from step S103 onwards. If the power supply of the input support device 200 is turned off, the operation of the input support device 200 shown in the flowchart of FIG. 8 ends.
[0063] As described above, the input support system 1 and the input support device 200 in the first embodiment of the present invention predict the movement direction of a user's finger about to touch the touch panel 100, based on the pressure from the user's hand obtained from a pressure sensor 111 provided on a support base 110 that supports the user's hand operating a touch panel 100 mounted on a moving object, and adjusts the sensitivity of the touch panel 100 in accordance with the prediction result.
[0064] With such a configuration, the input support system 1 and the input support device 200 of the present embodiment can adjust the sensitivity of the touch panel so that the input of the touch operation by the user can be easily received even in a situation where the user cannot perform the touch operation in an appropriate posture due to, for example, the occurrence of a disturbance. As a result, the input support system 1 and the input support device 200 can further reduce the occurrence of operation errors by the user.
[0065] <Second embodiment> An input support device 200a according to a second embodiment of the present invention will be described below. The input support device 200 according to the first embodiment is configured to predict the moving direction of a user's finger and adjust the sensitivity of the touch panel according to the prediction result, whereas the input support device 200a according to the second embodiment described below is configured to predict the moving direction of a user's finger and adjust the orientation of the touch panel according to the prediction result.
[0066] [Configuration of the input support system] The configuration of the input support system 1a having the above-mentioned input support device 200a will be described below. Fig. 9 is a block diagram showing the overall configuration of the input support system 1a according to the second embodiment of the present invention. Among the functional blocks of the input support system 1a, those having the same configuration as the functional blocks of the input support system 1 according to the first embodiment shown in Fig. 1 are given the same names and symbols, and the description of the configuration of the functional blocks will be omitted.
[0067] 9, the input support system 1a includes a touch panel 100, a support base 110, a drive mechanism 120a, and an input support device 200a. In this embodiment, the touch panel 100, the support base 110, the drive mechanism 120a, and the input support device 200a are each separate devices or members, but some or all of these components may be configured as an integrated device.
[0068] The touch panel 100 is installed, for example, in the center of a dashboard inside a vehicle. The display surface of the touch panel 100 may be installed tilted slightly from the rear of the vehicle toward the driver, for example, to make it easier for the driver to operate. However, as described later, the orientation of the touch panel 100 can be changed by control by the input support device 200.
[0069] The driving mechanism 120a has a mechanism for changing the orientation of the touch panel 100. The driving mechanism 120 includes at least one motor 121. The driving mechanism 120 drives the motor 121 under the control of the input support device 200, and causes the touch panel 100 to face a specified direction.
[0070] The driving mechanism 120 may be a single-axis driving mechanism that changes the orientation of the touch panel 100 left and right along a vertical axis, or a two-axis driving mechanism that changes the orientation of the touch panel 100 left and right and up and down along vertical and horizontal axes, respectively.
[0071] The input support device 200a includes a control unit 210a and a storage unit 220. The control unit 210a controls the operation of each component of the input support system 1a, such as the touch panel 100, the pressure sensor 111, the motor 121, and the storage unit 220. The control unit 210a includes a drawing processing unit 211, a detection range setting unit 212, an operation detection processing unit 213, an operation direction prediction unit 214, a sensitivity control unit 215, and a drive control unit 216a.
[0072] The operation direction prediction unit 214 acquires a signal output from the pressure sensor 111. The operation direction prediction unit 214 predicts the moving direction of the user's finger about to touch the touch panel 100 based on the pressure distribution based on the acquired signal and the time series change in the pressure distribution. An example of the movement direction prediction process and the drive control process for changing the orientation of the touch panel will be described in detail later. The operation direction prediction unit 214 outputs information indicating the predicted moving direction of the user's finger to the drive control unit 216a.
[0073] The drive control unit 216a acquires the information output from the operation direction prediction unit 214. The drive control unit 216a changes the orientation of the display surface of the touch panel 100 when the angle between the display surface of the touch panel 100 and the moving direction of the user's finger based on the acquired information is equal to or smaller than a predetermined angle. In this case, the drive control unit 216 determines the orientation of the display surface of the touch panel 100 based on the moving direction of the user's finger based on the acquired information. For example, the drive control unit 216 determines the orientation of the display surface of the touch panel 100 to be the direction opposite to the moving direction of the user's finger. The drive control unit 216 specifies the drive amount (or drive time) of the motor 121 of the drive mechanism 120 required to set the display surface of the touch panel 100 to the determined orientation. The drive control unit 216 controls the drive mechanism 120 so that the motor 121 is driven by the specified drive amount. As a result, the orientation of the display surface of the touch panel 100 is changed.
[0074] [Prediction of movement direction and drive control processing] Hereinafter, the process of predicting the moving direction of the user's finger by the operation direction predicting unit 214 and the drive control process for changing the orientation of the touch panel 100 by the drive control unit 216a will be described with a specific example.
[0075] Fig. 10 is a schematic diagram showing a state of a user's touch operation. In the example shown in Fig. 3, the user places the ring finger of his left hand on the support base 110 and performs a touch operation on the touch panel 100 with the index finger, using the ring finger as support. A pressure sensor 111 provided on the support base 110 measures the pressure applied by the user's ring finger and generates a pressure distribution. An operation direction prediction unit 214 acquires a signal output from the pressure sensor 111, and predicts the moving direction of the user's index finger about to touch the touch panel 100 based on the pressure distribution based on the acquired signal and the time-series change in the pressure distribution.
[0076] The above-mentioned Fig. 4 is also a diagram showing an example of the pressure distribution of the pressure applied to the pressure sensor 111 by the ring finger of the left hand shown in Fig. 10. The operation direction prediction unit 214, for example, identifies the position of the center of gravity of the pressure distribution. The operation direction prediction unit 214 predicts, for example, that the longitudinal direction of the shape of the pressure distribution (direction D1 in Fig. 4) is the direction of the ring finger placed on the support base 110. Similarly, the operation direction prediction unit 214 predicts that the direction of the index finger of the user who is about to perform a touch operation is also direction D1 in Fig. 4.
[0077] Fig. 11 is a diagram showing an example of a change in the orientation of the touch panel 100 by the drive control unit 216a. When the orientation of the index finger of a user about to perform a touch operation is predicted to be in the direction D1 shown in Fig. 4, the drive control unit 216a changes the orientation of the touch panel 100 so that the direction D1 and the display surface of the touch panel are at a right angle as shown in Fig. 11.
[0078] For example, in a situation where a disturbance occurs and the user is unable to perform a touch operation in an appropriate posture, if the orientation of the touch panel 100 is not changed as described above, the user may be forced to perform a touch operation with insufficient contact using the side part of the fingertip or a nail, which has a small contact area, as shown in FIG. 5. This may result in the input operation not being accepted or an erroneous operation. On the other hand, if the orientation of the touch panel 100 is changed as described above during a disturbance, even if the user is unable to perform a touch operation in an appropriate posture, the user is more likely to be able to perform a touch operation with sufficient contact using the pad of the finger, as shown in FIG. 6 described above.
[0079] Furthermore, when a change occurs in the pressure distribution of the pressure applied to the pressure sensor 111 by the user's ring finger placed on the support base 110, the input support system 1a of this embodiment appropriately changes the orientation of the touch panel 100 in response to the change.
[0080] As described above, Fig. 6 is a diagram showing an example of a pressure distribution after the change with respect to the pressure distribution before the change shown in Fig. 4. The operation direction prediction unit 214 predicts that a direction D2 from a center of gravity position G1 of the pressure distribution before the change to a position G1 of the pressure distribution after the change is the direction of the index finger of the user who is about to perform a touch operation.
[0081] Fig. 12 is a diagram showing an example of changing the orientation of the touch panel 100 by the drive control unit 216a. When the orientation of the finger of a user about to perform a touch operation is predicted to be the direction D2 shown in Fig. 6, the drive control unit 216a changes the orientation of the touch panel 100 in response to the pressure distribution so that the angle between the direction D2 and the display surface of the touch panel is perpendicular as shown in Fig. 12. Note that even while the touch panel 100 is being driven, the angle at which the touch panel 100 is finally driven may be changed according to the detection state of the pressure sensor 111.
[0082] In the present embodiment, the touch panel 100 and the support base 110 are integrated, and the orientation of the support base 110 changes according to the change in the orientation of the touch panel 100. However, this is not limited to the above configuration. In a case where the touch panel 100 and the support base 110 are separated, the orientation of the support base 110 may not be changed, and only the orientation of the touch panel 100 may be changed. In this case, a gap between the touch panel 100 and the support base 110 may be filled by a bellows structure or the like. In a case where the LCD panel 101 and the touch sensor 102 of the touch panel 100 are separated, the orientation of the LCD panel 101 may not be changed, and only the orientation of the touch sensor 102 may be changed.
[0083] The input support device 200 may virtually create an input acceptance state of a touch operation equivalent to when the orientation of a device such as the touch panel 100 or the touch sensor 102 is changed by software control, instead of actually changing the orientation of the device such as the touch panel 100 or the touch sensor 102. For example, the input support device 200 may virtually create an appropriate touch operation acceptance state by varying the sensitivity of the touch sensor 102 depending on the position on the screen, such as by increasing the sensitivity of the touch sensor 102 around a predicted touch position in the moving direction of the finger of a user who is about to perform a touch operation.
[0084] There may be cases where the user places other parts of the hand (such as a part of a clenched fist) on the support base 110 instead of the fingers. In such cases, for example, it may be difficult for the operation direction prediction unit 214 to predict the moving direction of the user's fingers attempting to operate the touch panel. When it is difficult to predict the moving direction of the fingers, for example, the sensitivity control unit 215 may change the sensitivity of the touch panel 100 instead of changing the orientation of the touch panel 100.
[0085] [Operation of input support device] The following describes the operation of the input support device 200. The operation of the input support device 200a according to the second embodiment of the present invention differs from the operation of the input support device 200 according to the first embodiment described above in the operation of step S105 shown in FIG.
[0086] As described above, in the input support device 200 according to the first embodiment, in the operation of step S105, if the angle between the display surface of the touch panel 100 and the moving direction of the user's finger is equal to or smaller than a predetermined angle, the sensitivity control unit 215 controls the sensitivity change unit 103 to change the sensitivity of the touch sensor 102. On the other hand, in the input support device 200 according to the first embodiment, if the angle between the display surface of the touch panel 100 and the moving direction of the user's finger is equal to or smaller than a predetermined angle, the drive control unit 216a controls the motor 121a of the drive mechanism 120a to change the orientation of the touch panel 100.
[0087] As described above, the input support system 1a and the input support device 200a in the second embodiment of the present invention predict the movement direction of a user's finger about to touch the touch panel 100 based on the pressure from the user's hand obtained from a pressure sensor 111 provided on a support base 110 that supports the user's hand operating a touch panel 100 mounted on a moving object, and adjust the orientation of the touch panel 100 in accordance with the prediction result.
[0088] With such a configuration, the input support system 1a and the input support device 200a of the present embodiment can adjust the orientation of the touch panel so that the user can easily perform a touch operation with sufficient contact even in a situation where the user cannot perform a touch operation in an appropriate posture due to, for example, the occurrence of a disturbance. As a result, the input support system 1a and the input support device 200a can further reduce the occurrence of operation errors by the user.
[0089] The above-described embodiment can be expressed as follows. A storage device storing a program; a hardware processor; The hardware processor executes the program stored in the storage device, acquiring sensor information from a contact sensor provided near the touch panel and configured to detect contact of a user's hand with the touch panel; The input acceptance state of the touch operation on the touch panel is changed based on the sensor information. The input support device is configured as follows.
[0090] The above describes the form for carrying out the present invention using an embodiment, but the present invention is not limited to such an embodiment, and various modifications and substitutions can be made within the scope that does not deviate from the gist of the present invention. [Explanation of symbols]
[0091] 1. Input Support System 1a Input support system 100 Touch Panel 101 LCD Panel 102 Touch Sensor 103 Sensitivity change unit 110 Support stand 111 Pressure Sensor 120a Drive mechanism 121a Motor 200 Input support device 210, 210a Control unit 211 Drawing processing unit 212 Detection range setting unit 213 Operation detection processing unit 214 Operation direction prediction unit 215 Sensitivity control section 216a Drive control unit 217a Feedback control section 220 Storage section
Claims
1. an acquisition unit that is provided near the touch panel and acquires sensor information indicating a pressure distribution from a contact sensor that detects contact with a hand of a user performing a touch operation on the touch panel; a prediction unit that predicts a direction of a finger that is about to touch the touch panel based on a longitudinal direction of an overall shape of the pressure distribution; a state control unit that controls the touch panel to change an input acceptance state in accordance with the finger orientation predicted by the prediction unit, thereby making it easier to accept the input of the touch operation; and An input support device comprising:
2. The state control unit changes the input acceptance state when the orientation of the finger with respect to the screen of the touch panel is equal to or smaller than a predetermined angle. The input support device according to claim 1 .
3. The state control unit increases the sensitivity of the touch panel when the orientation of the finger with respect to the screen is equal to or smaller than a predetermined angle. The input support device according to claim 2 .
4. The state control unit changes the orientation of the screen when the orientation of the finger with respect to the screen is equal to or smaller than a predetermined angle. The input support device according to claim 2 .
5. the contact sensor is a pressure sensor that detects pressure caused by contact with the user's hand, The prediction unit predicts the orientation of the finger based on a pressure distribution of the pressure. The input support device according to claim 2 .
6. The prediction unit predicts the orientation of the finger based on a moving direction of a center of gravity of the pressure distribution when the pressure distribution changes. The input support device according to claim 5 .
7. The contact sensor is installed facing upward from the lower end of the touch panel toward the front of the touch panel. The input support device according to claim 1 .
8. The computer acquiring sensor information indicating a pressure distribution from a contact sensor provided near the touch panel and detecting contact of a hand of a user performing a touch operation on the touch panel; predicting a direction of a finger that is about to touch the touch panel based on a longitudinal direction of the overall shape of the pressure distribution; The input acceptance state of the touch panel is changed in accordance with the predicted finger orientation, thereby making it easier to accept the touch operation input. Control methods.
9. On the computer, acquiring sensor information indicating a pressure distribution from a contact sensor provided near the touch panel and configured to detect contact of a user's hand with the touch panel; predicting a direction of a finger that is about to touch the touch panel based on a longitudinal direction of an overall shape of the pressure distribution; By changing an input acceptance state of the touch panel in accordance with the predicted orientation of the finger, control is performed so that the input of the touch operation is easily accepted. program.
Citation Information
Patent Citations
Input device equipped with touch panel and its input reception method
JP2008129689A
Capacitance type touch panel device and touch input position detection method
JP2010262460A
Portable electronic apparatus, method for controlling contact operation, and contact operation control program
JP2012194810A
Methods and systems for adjusting displayed content
JP2013538397A
Electronic apparatus
JP2014085754A
