Information processing apparatus, control method, and storage medium
By adjusting the detection range of the touch panel based on the status information on the moving body, the problem of user operation errors under acceleration and vibration interference is solved, improving the reliability of input operation and design freedom.
Patent Information
- Application Number
- CN202210064880.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2021-03-16
- Filing Date
- 2022-01-20
- Publication Date
- 2026-01-13
- Estimated Expiration
- 2042-01-20
AI Technical Summary
In touch panels used on moving objects such as vehicles, interference from acceleration and vibration can make it difficult for users to accurately touch the operation button images, which may lead to operation errors.
The detection range control system changes the detection range of the touch panel according to the status information of the moving object, including expanding, rotating or translating the detection range to accommodate the user's operation deviations.
It reduces user errors, improves the reliability of input operations, and enhances the design freedom of touch panels.
Smart Images

Figure CN115079855B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to an information processing apparatus, a control method, and a storage medium. BACKGROUND
[0002] Conventionally, a touch panel is widely spread, which is an input / output device that displays an image (hereinafter, collectively referred to as "operation button image") representing an area that accepts an input operation, such as an image or an icon image representing an operation button, on a screen, and performs an input operation by a user touching a display area of the operation button image. In the case where such a touch panel is mounted on a mobile body such as a vehicle, for example, due to acceleration and vibration and the like that occur in association with the behavior of the mobile body, the user sometimes cannot accurately touch the display area of the desired operation button image. Due to this, an operation error can occur.
[0003] In contrast to this, there is a technology that accepts an input operation not only when a display area of an operation button image is touched, but also when an area around the operation button image is touched (for example, refer to Japanese Patent Application Publication No. 2015-94958). That is, this technology sets a range to be detected (hereinafter, referred to as "detection range") that is touched by a user to be wider than the display area of the operation button image by one circle. Therefore, even if the user cannot accurately touch the display area of the desired operation button image, an input operation is accepted if there is a slight deviation. Due to this, convenience is improved. SUMMARY
[0004] As described above, in the related art, the detection range needs to be set for each operation button image in such a way as to include the entire area around the display area of the operation button image. However, there is an upper limit to the width of the screen of a touch panel that can be mounted on a mobile body such as a vehicle. Therefore, sometimes the intervals of a plurality of operation button images displayed on the screen cannot be sufficiently widened. In this case, it can not be possible to set a detection range of sufficient width for the purpose of preventing an operation error by a user.
[0005] One of the objects of the present application is to provide an information processing apparatus, a control method, and a storage medium that can further reduce the occurrence of an operation error by a user.
[0006] The information processing apparatus of the first aspect of the present application includes a display control section that causes an image that accepts an input operation to be displayed on a touch panel mounted on a mobile body, an acquisition section that acquires state information of the mobile body that changes in association with movement of the mobile body, and a detection range control section that sets a range to detect the input operation, that is, a detection range, on the touch panel for each of the images, and changes the detection range based on the state information.
[0007] The second aspect can be the information processing apparatus according to the first aspect, wherein the detection range control section elongates the detection range in a second lateral direction opposite to the first lateral direction when the state information indicates that an acceleration in the first lateral direction is acting.
[0008] The third aspect can be the information processing apparatus according to the first or second aspect, wherein the information processing apparatus further includes a trend analysis section that records positions in the detection range where the input operation is performed when the acceleration indicated by the state information is equal to or less than a predetermined value, analyzes a deviation of a distribution of the positions in the detection range, and the detection range control section changes the detection range based on the deviation.
[0009] The fourth aspect can be the information processing apparatus according to the third aspect, wherein the trend analysis section determines an axis of the distribution of the positions, and the detection range control section rotates the detection range according to a gradient of the axis.
[0010] The fifth aspect can be the information processing apparatus according to any one of the first to fourth aspects, wherein the detection range control section does not change the detection range when the input operation is continuously performed on the same part of the touch panel, or changes the detection range so that the changed detection range includes the un-changed detection range.
[0011] The sixth aspect can be the information processing apparatus according to any one of the first to fifth aspects, wherein the detection range control section does not change the detection range during a period from when the input operation on the touch panel ends until a predetermined time elapses, or changes the detection range so that the changed detection range includes the un-changed detection range.
[0012] The seventh aspect can be the information processing apparatus according to any one of the first to sixth aspects, wherein the information processing apparatus further includes a state prediction section that predicts a future state of the moving body based on a movement path of the moving body, the acquisition section acquires information indicating the movement path, and the detection range control section changes the detection range based on the predicted state.
[0013] An eighth aspect of the present disclosure is a control method in which a computer performs processes of causing an image that receives an input operation to be displayed on a touch panel mounted on a moving body, acquiring state information of the moving body that changes in accordance with movement of the moving body, and setting a detection range that detects the input operation on the touch panel for each of the images, and changing the detection range based on the state information.
[0014] A ninth aspect of the present application is a storage medium storing a program, in which the program causes a computer to execute processing of causing an image of an input operation to be accepted to be displayed on a touch panel mounted on a mobile body, acquiring state information of the mobile body that changes in accordance with movement of the mobile body, and changing a detection range in which the input operation is detected on the touch panel for each of the images based on the state information.
[0015] According to the first aspect to the ninth aspect, the detection range is changed in correspondence with occurrence of interference, so that the input operation is easily accepted, and thus, occurrence of an operation error by a user can be further reduced. BRIEF DESCRIPTION OF DRAWINGS
[0016] Figure 1 is a block diagram showing the overall structure of a detection range control system of a first embodiment of the present application.
[0017] Figure 2 is a schematic view showing a situation of an operation by a user at ordinary times.
[0018] Figure 3 is a schematic view showing a situation of an operation by a user at the time of interference.
[0019] Figure 4 is a view showing an example of detection range control when the vehicle makes a left turn.
[0020] Figure 5 is a view showing an example of detection range control when the vehicle makes a left turn.
[0021] Figure 6 is a view showing an example of detection range control when the vehicle vibrates in the up-and-down direction.
[0022] Figure 7 is a view showing an example of detection range control when the vehicle makes a left turn in a downhill.
[0023] Figure 8 is a flowchart showing the operation of the information processing apparatus of the first embodiment.
[0024] Figure 9 is a block diagram showing the overall structure of a detection range control system of a second embodiment of the present application.
[0025] Figure 10 is a schematic view showing an example of trend analysis processing performed by the information processing apparatus of the second embodiment.
[0026] Figure 11 is a schematic view showing an example of trend analysis processing performed by the information processing apparatus of the second embodiment.
[0027] Figure 12 is a schematic view showing an example of trend analysis processing performed by the information processing apparatus of the second embodiment.
[0028] Figure 13 is a schematic view showing an example of determination processing of a parallel movement amount and a rotation angle of a detection range performed by the information processing apparatus of the second embodiment.
[0029] Figure 14 is a schematic view showing overlapping of distributions of respective touch positions for a plurality of operation button images.
[0030] Figure 15 is a schematic view showing an example of change of respective detection ranges for a plurality of operation button images.
[0031] Figure 16 is a schematic view showing an example of change of respective detection ranges for a plurality of operation button images.
[0032] Figure 17 is a flowchart showing an action of the information processing apparatus of the second embodiment.
[0033] Figure 18 is a block diagram showing an overall structure of a detection range control system of the third embodiment of the present application.
[0034] Figure 19 is a flowchart showing an action of the information processing apparatus of the third embodiment.
[0035] Figure 20 is a block diagram showing an overall structure of a detection range control system of the fourth embodiment of the present application.
[0036] Figure 21 is a flowchart showing an action of the information processing apparatus of the fourth embodiment. DETAILED DESCRIPTION
[0037] Hereinafter, embodiments of an information processing apparatus, a control method, and a program of the present application will be described with reference to the drawings.
[0038] <First Embodiment>
[0039] Hereinafter, a detection range control system 1 of the first embodiment of the present application will be described. The detection range control system 1 is a control system that changes a detection range of a touch panel mounted on a mobile body such as a vehicle in accordance with an influence of a disturbance that has occurred. The detection range referred to here is a range that detects a touch by a user on the touch panel.
[0040] Further, the disturbance herein refers to an event in which a force other than gravity that acts on a passenger operating the touch panel is generated. The disturbance is, for example, a turning motion of a moving body that generates a centrifugal force, a vibration in the up-down direction due to unevenness of a road surface, and running of a moving body on a slope that generates a force in the up-down direction. The greater the influence of these disturbances, the more difficult it is for the passenger to touch the accurate position when the passenger performs a touch operation on the touch panel. The detection range control system 1 of the present embodiment appropriately performs control to expand, move, or deform the detection range depending on the kind or degree of the disturbance, so that an input operation is easily accepted even if the passenger cannot touch the accurate position.
[0041] [Structure of detection range control system]
[0042] Figure 1 is a block diagram showing the overall structure of the detection range control system 1 of the first embodiment of the present application. The detection range control system 1 is a system mounted on a vehicle (not shown). The detection range control system 1 has a state detection portion 100 and an information processing device 200.
[0043] Note that, in the present embodiment, the state detection portion 100 and the information processing device 200 are independent devices, but at least a part of the state detection portion 100 and the information processing device 200 can be an integrated device.
[0044] Note that the vehicle on which the detection range control system 1 is mounted is, for example, an electric vehicle, or a vehicle on which an internal combustion engine such as a diesel engine or a gasoline engine is mounted. Note that the vehicle on which the detection range control system 1 is mounted can be a hybrid vehicle on which an internal combustion engine and a secondary battery that accumulates electric power for running to be supplied to a drive motor are mounted, or a vehicle on which a fuel cell that supplies electric power for running to a drive motor is mounted. Note that the detection range control system 1 can be mounted on a moving body other than a vehicle such as an airplane or a ship, for example.
[0045] The state detection portion 100 detects the behavior of the vehicle on which the detection range control system 1 is mounted. The state detection portion 100 is provided with an acceleration sensor 101 and an angular acceleration sensor 102. Note that, in the present embodiment, the acceleration sensor 101 and the angular acceleration sensor 102 are independently provided with respect to the vehicle, but can be provided in an integrated device provided with the vehicle.
[0046] Accelerometer 101 is a sensor that measures the change in speed, i.e., acceleration, of a vehicle equipped with accelerometer 101. Accelerometer 101 measures acceleration, for example, by measuring the displacement of a weight mounted on a spring. Accelerometer 101 tracks acceleration variations from 0 to several hundred hertz and measures the vehicle's orientation (attitude) relative to the ground based on the acceleration vectors in the X and Y axes. It should be noted that a zero acceleration variation refers to only gravitational acceleration. Accelerometer 101 is, for example, a three-dimensional accelerometer that measures acceleration in three axes (X, Y, and Z axes) at predetermined sampling intervals. Accelerometer 101 can be a piezoelectric, capacitive, or thermal sensor. Accelerometer 101 outputs signals representing the measurement results, such as the measured three-axis acceleration, to information processing device 200. Accelerometer 101 can also be a sensor pre-installed on the vehicle.
[0047] The angular acceleration sensor 102 is a sensor that measures the change in angular velocity, i.e., angular acceleration, when a vehicle equipped with the angular acceleration sensor 102 is performing a rotational movement. The angular acceleration sensor 102 may be, for example, an angular velocity sensor (gyroscope sensor, not shown), and measures angular acceleration based on the measured value output from the angular velocity sensor. In this case, the angular velocity sensor may be, for example, a vibration-type gyroscope sensor, measuring angular velocity based on the Coriolis force applied to the element by causing it to vibrate. Alternatively, the angular velocity sensor may be, for example, an optical gyroscope sensor, measuring angular velocity based on the degree of deviation (Sagnak effect) of the relative rotational speed of light generated when the vehicle is tilted. The angular acceleration sensor 102 outputs a signal representing the measurement result to the information processing device 200. It should be noted that the angular acceleration sensor 102 may also be a sensor pre-installed in the vehicle.
[0048] The information processing device 200 includes a control unit 210, a storage unit 220, and a touch panel 230. It should be noted that in this embodiment, the control unit 210, storage unit 220, and touch panel 230 are integrated into a single device (i.e., the information processing device 200), but this is not a limitation. Any one or the remaining two of the control unit 210, storage unit 220, and touch panel 230 may be housed in separate devices. Alternatively, the control unit 210, storage unit 220, and touch panel 230 may each be housed in separate devices.
[0049] The control unit 210 controls the operation of various functional units of the information processing device 200, such as the storage unit 220 and the touch panel 230. The control unit 210 includes a display control unit 211, a detection range control unit 212, and an operation detection processing unit 213.
[0050] The components of the control unit 210 are implemented, for example, by executing programs (software) through a hardware processor such as a CPU (Central Processing Unit). Some or all of these components can also be implemented using hardware (including circuitry) such as LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array), and GPU (Graphics Processing Unit), or through the coordinated use of software and hardware. The program can be pre-stored in a storage device such as an HDD (Hard Disk Drive) or flash memory (a storage device with a non-transitory storage medium), or it can be stored in a removable storage medium such as a DVD or CD-ROM (a non-transitory storage medium) and installed by assembling the storage medium onto a drive device.
[0051] The storage unit 220 stores various programs, such as control programs and application programs, used by the control unit 210 when controlling the information processing device 200. Furthermore, the storage unit 220 stores various data used by the aforementioned control programs and application programs. The storage unit 220 is, for example, a storage medium such as an HDD or flash memory.
[0052] The touch panel 230 is an input / output unit that displays various information and accepts information input via user touch operations. The touch panel 230 includes an LCD (Liquid Crystal Display) panel 231 and a touch sensor 232. The LCD panel 231 displays various information. The touch sensor 232 is disposed overlapping on the display surface of the LCD panel 231. The touch sensor 232 accepts information input via user touch operations. It should be noted that in this embodiment, various types of touch panels, such as pressure-sensitive touch panels or electrostatic touch panels, can be used as the touch panel 230. The touch sensor 232 outputs information identifying the touched detection range to the control unit 210.
[0053] It should be noted that the touch sensor 232 can also continuously output signals to the control unit 210 during the period when it touches the detection area. This allows it to determine whether the user's touch operation is a normal tap or a long press. Furthermore, the touch sensor 232 can also continuously output signals indicating the touch position (coordinates) to the control unit 210 during the period when it touches the detection area. This allows it to determine whether the user's touch operation is a drag or a flick. Moreover, the touch sensor 232 can simultaneously detect touches on two detection areas, continuously outputting signals indicating the two touch positions (coordinates) to the control unit 210 during the period when it touches the detection areas. This allows it to determine whether the user's touch operation is a pinch-in or a pinch-out.
[0054] The touch panel 230 is, for example, located in the center of the dashboard inside the vehicle. The display surface of the LCD panel 231 is, for example, slightly tilted from the rear of the vehicle toward the driver's side, making it easy for the driver to operate. The touch panel 230 functions as an input / output unit for, for example, the navigation system, audio system, personal assistant system, dashcam system, parking assistance system, driving control system, and various vehicle-related settings screens installed in the vehicle.
[0055] It should be noted that the location of the touch panel 230 is not limited to the dashboard; for example, it can be installed behind the driver's seat or passenger seat, or it can be suspended from the vehicle's roof. It should also be noted that the touch panel 230 can be replaced with a touch panel mounted on a portable terminal such as a smartphone or tablet. In this case, for example, a stand for the portable terminal can be installed inside the vehicle, and the portable terminal mounted on that stand will function in the same way as the fixed touch panel 230.
[0056] The following is a description of the components of the control unit.
[0057] The display control unit 211 controls the display processing of information displayed on the LCD panel 231. For example, the display control unit 211 causes the LCD panel 231 to display a screen (hereinafter referred to as a "touch operation input screen") that receives input from a touch operation performed by the user. The display control unit 211 displays operation button images at predetermined positions within the touch operation input screen.
[0058] The detection range control unit 212 controls the detection range of the user's touch operation in the touch sensor 232. The detection range, as referred to here, is the area detected by the user's touch. The detection range control unit 212 sets the detection range based on the display area of the operation button image on the LCD panel 231. The detection range control unit 212 sets the detection range to be one size wider than the display area of the operation button image, thus including it. Therefore, even if the user cannot accurately touch the desired operation button image display area, input operation is still accepted if there is a slight deviation.
[0059] Furthermore, the detection range control unit 212 acquires at least one of a signal representing the measurement result of acceleration output from the accelerometer 101 and a signal representing the measurement result of angular acceleration output from the angular acceleration sensor 102. The detection range control unit 212 controls the touch sensor 232 based on at least one of the acquired acceleration and angular acceleration signals, thereby changing the size, shape, or position of the detection range. It should be noted that specific examples of the detection range change processing performed by the detection range control unit 212 will be described in detail below.
[0060] The operation detection processing unit 213 acquires a signal output from the touch sensor 232. This signal contains information identifying the detection range of the touch. The operation detection processing unit 213 determines the detection range of the touch based on the acquired information. The operation detection processing unit 213 outputs information representing the detection result of the touch operation performed by the user, such as the determined detection range, to various systems. These various systems include, for example, navigation systems, audio systems, personal assistant systems, dashcam systems, parking assistance systems, driving control systems, and various vehicle-related settings screens.
[0061] It should be noted that the operation detection processing unit 213 can also determine whether the touch operation performed by the user is a normal tap or a long press based on the duration of the continuously acquired signals. It should also be noted that the signal may contain information indicating the location (coordinates) of the touch. The operation detection processing unit 213 can also detect changes in the location (coordinates) of the touch based on the information contained in the continuously acquired signals, and determine whether the touch operation performed by the user is a drag, flick, pinch, or release.
[0062] [Handling of Changes in Detection Scope]
[0063] The following is a specific example illustrating the processing of changes to the detection range performed by the detection range control unit 212. Figure 2 This is a diagram illustrating the normal user operation scenario. "Normal scenario" here refers to when the vehicle is stationary or traveling in a straight line at a constant speed.
[0064] Figure 2 This describes the view when observing the operation button images displayed on the LCD panel 231 from a direction directly opposite the surface of the touch panel 230 (the touched surface). Operation button images b1 and b2 are displayed on the LCD panel 231 under the control of the display control unit 211. Furthermore, under the control of the detection range control unit 212, a detection range a1 is set on the touch sensor 232 in conjunction with the position of operation button image b1, and a detection range a2 is set in conjunction with the position of operation button image b2. It should be noted that, as... Figure 2 As shown, a detection range larger than the operation button image is set, so that even if the user's touch position deviates slightly from the range of the operation button image, the input operation can still be accepted.
[0065] For example, a user might use their left index finger (f) to touch an operation button. For instance, when a user touches button image b2, normally... Figure 2 As shown, the user can easily and accurately touch the display area of the operation button image b2 on the touch panel 230.
[0066] on the other hand, Figure 3 This is a diagram illustrating the user's actions during a disturbance. As an example, Figure 3 This describes the user's actions when interference occurs, such as the vehicle making a U-turn in the direction of travel.
[0067] and Figure 2 same, Figure 3 This describes the view when the operation button images displayed on the LCD panel 231 are viewed from a direction directly opposite the surface of the touch panel 230 (the touched surface). Under the control of the display control unit 211, the images are displayed on the LCD panel 231. Figure 2 The same operation button images b1 and b2 are used. Furthermore, under the control of the detection range control unit 212, positions corresponding to the positions of operation button images b1 and b2 are respectively set on the touch sensor 232. Figure 2 The same detection range a1 and detection range a2.
[0068] For example, a user touches an operation button using their finger f. In the event of a disturbance caused by the vehicle turning left, a centrifugal force is generated on the user in the right direction, opposite to the leftward direction of the turn (i.e., the direction of angular acceleration). As a result, the user's body inside the vehicle leans to the right in the direction of travel, making it difficult for the user to accurately touch the desired operation button image within its display area. For example, when the user touches operation button image b2, they cannot accurately touch the display area of operation button image a2 on the touch panel 230, and the touch may easily shift to the right from that area. Furthermore, as... Figure 3 As shown, there is a possibility that the touch may deviate beyond the detection range b2, resulting in a position outside the detection range b2. In this case, input operations will no longer be accepted.
[0069] In the event of such interference, the detection range control system 1 in this embodiment controls the change of the detection range. Figure 4 and Figure 5 This diagram illustrates an example of detection range control when a vehicle makes a left turn. Normally, the detection range control unit 212 sets the operation buttons b1 and b2 respectively. Figure 2 The detection ranges a1 and a2 are shown. On the other hand, when the vehicle turns to the left, the detection range control unit 212 sets, for example, the operation buttons b1 and b2 respectively. Figure 4 The detection range is changed in the manner shown by detection ranges a11 and a21. That is, when the vehicle turns to the left, the detection range is expanded (extended) by stretching to the right in the opposite direction to the direction of rotation (i.e., the direction in which angular acceleration is applied). As a result, even if the user's body inside the vehicle is tilted to the right in the direction of travel, the user can easily touch the desired detection range.
[0070] It should be noted that the detection range control unit 212 determines the amount by which the detection range is expanded, for example, based on the magnitude of the angular acceleration detected by the angular acceleration sensor 102. The greater the magnitude of the angular acceleration, the more the detection range control unit 212 expands the detection range. However, it is desirable for the detection range control unit 212 to expand the detection range within a range that does not cause multiple detection ranges to overlap due to the expansion of the detection range.
[0071] It should be noted that the detection range control unit 212 can also set, for example, the operation buttons b1 and b2 when the vehicle is turning to the left. Figure 5The detection range is changed in the manner shown by detection ranges a12 and a22. That is, when the vehicle turns to the left, the detection range is moved in a parallel manner to the right in the opposite direction to the direction of rotation (i.e., the direction in which angular acceleration is applied). Thus, even if the user's body inside the vehicle is tilted to the right in the direction of travel, the user can easily touch the desired detection range.
[0072] It should be noted that the detection range control unit 212 determines the amount of parallel movement of the detection range, for example, based on the magnitude of the angular acceleration detected by the angular acceleration sensor 102. The greater the magnitude of the angular acceleration, the greater the parallel movement of the detection range by the detection range control unit 212. However, it is desirable for the detection range control unit 212 to move the detection range parallel within a range in which the parallel movement of the detection range does not result in a situation where a certain detection range becomes closer to the display position of the operation button image corresponding to other detection ranges than to the display position of the operation button image corresponding to its own detection range.
[0073] exist Figure 5 In the example shown, the left edge of each operation button image is detached from the detection range; therefore, if the user touches the left edge of an operation button image, the input operation is not processed. However, since the detection ranges corresponding to each operation button image move in parallel simultaneously, the gap between the detection ranges is adequately maintained. Therefore, the possibility of a user intentionally touching the desired operation button image but accidentally touching the detection range corresponding to an adjacent operation button image, resulting in an incorrect input operation, is reduced. On the other hand, in Figure 4 In the example shown, even if the user touches the left side of the operation button image, the input operation is still accepted, but the possibility of making the aforementioned incorrect input operation is higher.
[0074] Therefore, it is desirable to select whether to expand (extend) or move the detection range based on the actions taken by other systems in response to the input operation. For example, in cases where a user touches the detection range corresponding to an adjacent operation button image and an incorrect input operation is received, potentially leading to a dangerous situation, it is desirable to employ a method such as... Figure 5 That's a structure where the detection range moves in parallel while maintaining its size.
[0075] It should be noted that, as examples of structures for changing the detection range, structures for expanding (elongating) the detection range and structures for moving the detection range in parallel have been described here. However, these structures are not limited to. For example, a structure in which the detection range control unit 212 changes the shape of the detection range based on the magnitude of at least one of acceleration and angular acceleration may also be used. For example, when the vehicle turns to the left, centrifugal force is generated to the right of the direction of travel. Therefore, a structure in which the detection range control unit 212 changes the shape of the detection range in such a way that the area of the right half of the detection range is relatively wider than the area of the left half may also be used.
[0076] Figure 6 This diagram illustrates an example of detection range control when a vehicle vibrates in the vertical direction. Vertical vibration of the vehicle occurs, for example, when the vehicle passes over bumps or uneven surfaces on the road. Normally, the detection range control unit 212 sets the operation buttons b1 and b2 respectively. Figure 2 The detection ranges a1 and a2 are shown. On the other hand, when the vehicle vibrates in the vertical direction, the detection range control unit 212 sets, for example, the operation buttons b1 and b2. Figure 6 The detection range is changed in the manner shown by detection ranges a13 and a23. That is, when the vehicle vibrates in the vertical direction, the detection range control unit 212 expands (extends) the detection range by stretching in the vertical direction.
[0077] Therefore, even if the user's body vibrates vertically inside the vehicle, causing their fingers to tremble, the user can easily touch the desired detection range.
[0078] It should be noted that the detection range control unit 212 determines the amount by which the detection range is expanded, for example, based on the magnitude of the vertical acceleration detected by the accelerometer 101. The greater the magnitude of the acceleration, the more the detection range control unit 212 expands the detection range. However, it is desirable for the detection range control unit 212 to expand the detection range within a range that does not cause multiple detection ranges to overlap due to the expansion of the detection range.
[0079] It should be noted that, in situations where the force applied to the user, such as when the vehicle is traveling on a slope, does not frequently switch in the vertical direction, the detection range control unit 212 can expand (extend) the detection range only in the upward or downward direction. Furthermore, when the detection range control unit 212 extends the detection range a13 of the operation button b1 in the vertical direction when the vehicle vibrates vertically, for example, if other operation buttons are located within a predetermined width near the lower part of the operation button b1, the detection ranges may overlap. In such cases, the detection range control unit 212 can, for example, expand (extend) the detection range a13 only in the direction opposite to the direction of the (or presumed) acceleration experienced during the disturbance. This allows for the division of the detection range areas for adjacent operation buttons.
[0080] Figure 7 This diagram illustrates an example of detection range control when a vehicle makes a left turn while going downhill.
[0081] Normally, the detection range control unit 212 sets the operation buttons b1 and b2 respectively. Figure 2 The detection ranges a1 and a2 are shown. On the other hand, when the vehicle makes a left turn while going downhill, the detection range control unit 212 sets, for example, the operation buttons b1 and b2 respectively. Figure 7 The detection range is changed in the manner shown by detection ranges a14 and a24. That is, when the vehicle makes a left turn while going downhill, the detection range control unit 212 expands (extends) the detection range by stretching it diagonally upward to the right. As a result, even if the user's body inside the vehicle is leaning to the upper right, the user can easily touch the desired detection range.
[0082] It should be noted that the detection range control unit 212 determines the amount and direction of expanding the detection range diagonally upward to the right, for example, based on the magnitude of the downward acceleration detected by the accelerometer 101 and the magnitude of the leftward angular acceleration detected by the angular acceleration sensor 102. The greater the magnitude of the acceleration and angular acceleration, the more the detection range control unit 212 expands the detection range. Furthermore, the greater the magnitude of the downward acceleration compared to the magnitude of the leftward angular acceleration, the more the detection range control unit 212 expands the detection range to the upper right, closer to the upward direction. However, it is desirable for the detection range control unit 212 to expand the detection range within a range that does not cause multiple detection ranges to overlap due to the expansion.
[0083] [Operation of the information processing device]
[0084] The following describes an example of the operation of the information processing device 200. Figure 8This is a flowchart illustrating the operation of the information processing apparatus 200 according to a first embodiment of the present invention. The operation of the information processing apparatus 200 shown in this flowchart begins when the power supply to the detection range control system 1, which includes the information processing apparatus 200, is turned on. The power supply to the detection range control system 1 is, for example, linked to the power supply of the vehicle equipped with the detection range control system 1 being turned on.
[0085] As the power to the detection range control system 1 is turned on, the power to the information processing device 200 is also turned on (step S101).
[0086] Next, the display control unit 211 performs display processing to display the touch operation input screen on the LCD panel 231. The display control unit 211 displays the operation button image at a predetermined position within the touch operation input screen. Meanwhile, the detection range control unit 212 sets the detection range in the touch sensor 232 based on the display area of the operation button image on the LCD panel 231. At this time, the detection range control unit 212 sets the detection range as it is normally. That is, the detection range control unit 212 sets the detection range to be wider than the display area of the operation button image, thus including that display area (step S102).
[0087] It should be noted that, for example, information required for depicting the touch operation input screen and information indicating the display position (coordinates) of the operation button images on the LCD panel 231 are stored in the storage unit 220 in advance.
[0088] The display control unit 211 displays a touch operation input screen and operation buttons on the LCD panel 231 based on the information stored in the storage unit 220.
[0089] It should be noted that, for example, information indicating the width of the detection range under normal conditions is stored in the storage unit 220 in advance. For example, the storage unit 220 may store information indicating the distance from the outline of the operation button image to the outline of the detection range under normal conditions. The detection range control unit 212 sets the detection range to be wider than the display area by setting the outline of the detection range to be located outside the outline of the operation button image by that distance.
[0090] Next, the detection range control unit 212 begins to acquire signals representing the measurement results of acceleration and angular acceleration output from at least one of the acceleration sensor 101 and the angular acceleration sensor 102 (step S103). This signal, for example, is a signal representing the measurement result measured at a sampling frequency of 100 [Hz], and is input to the detection range control unit 212 each time.
[0091] Next, the detection range control unit 212, upon detecting a change in at least one of the acceleration and angular acceleration values of the acquired signal (step S104), resets the detection range in the touch sensor 232 according to the amount of change (step S105). This change, as described above, refers to expansion (elongation), parallel movement, or deformation of the detection range. It should be noted that information correlating the changes in acceleration and angular acceleration with the changes in the detection range in the touch sensor 232 is, for example, pre-recorded in the storage unit 220. The detection range control unit 212 determines the amount of change in the detection range based on the information recorded in the storage unit 220.
[0092] Next, the detection range control unit 212 repeatedly executes the operation of resetting the detection range based on the change in the value of at least one of acceleration and angular acceleration, until, for example, the power supply to the information processing device is switched off (step S106). That concludes the above. Figure 6 The operation of the information processing device 200 shown has ended.
[0093] As explained above, in the first embodiment of the present invention, the detection range control system 1 and the information processing device 200 change the detection range of the touch sensor 232 mounted on the vehicle based on changes in at least one of the acceleration and angular acceleration generated by the vehicle. With this structure, the detection range control system 1 and the information processing device 200 can increase the likelihood of accepting input operations even when the user cannot accurately touch the display area of the desired operation button image due to the influence of acceleration or angular acceleration. Therefore, the detection range control system 1 and the information processing device 200 can further reduce the occurrence of user operation errors.
[0094] Furthermore, according to the first embodiment of the present invention, the detection range control system 1 and the information processing device 200 change the detection range in response to the occurrence of interference, so it is not necessary to pre-widen the detection range beyond what is necessary under normal circumstances. As a result, for example, the setting interval of multiple operation button images in the touch operation input screen can be further narrowed, thus further increasing the degree of freedom in the screen design of the touch operation input screen.
[0095] <Second Implementation>
[0096] The detection range control system 1a according to the second embodiment of the present invention will now be described. In addition to possessing the structure of the detection range control system 1 of the first embodiment described above, the detection range control system 1a also includes a structure that adjusts the detection range in consideration of trends in touch operations performed by the user. Therefore, the detection range control system 1a can further increase the likelihood of accepting input operations based on touch operations performed by the user.
[0097] [Structure of the detection range control system]
[0098] Figure 9 This is a block diagram illustrating the overall structure of the detection range control system 1a according to the second embodiment of the present invention. It should be noted that the structure of the functional blocks within the detection range control system 1a differs from... Figure 1 The function blocks of the detection range control system 1 of the first embodiment shown above are labeled with the same name and number, and the description of the structure of the function blocks is omitted.
[0099] like Figure 9 As shown, the detection range control system 1a includes a status detection unit 100 and an information processing device 200a. The information processing device 200a includes a control unit 210a, a storage unit 220a, and a touch panel 230. It should be noted that, in this embodiment, a pressure-sensitive touch panel is used as the touch panel 230.
[0100] The control unit 210a includes a display control unit 211, a detection range control unit 212a, an operation detection processing unit 213a, and a trend analysis unit 214a. The storage unit 220a stores the detection position data 221a.
[0101] The operation detection processing unit 213a acquires a signal representing the measurement result of acceleration output from the accelerometer 101 and a signal representing the measurement result of angular acceleration output from the angular acceleration sensor 102. When the values of acceleration and angular acceleration based on the acquired signals are below a predetermined value (i.e., under normal circumstances), the operation detection processing unit 213a acquires information representing the touch position (coordinates) from the touch sensor 232 when the user performs a touch operation on the touch panel 230, and records this information as detection position data 221a in the storage unit 220a.
[0102] The trend analysis unit 214a uses the detection position data 221a recorded in the storage unit 220a to analyze the trend (habit) of the user's touch operations. The trend of touch operations referred to here is, for example, the degree of deviation of the touch position within the detection range. For example, the trend analysis unit 214a determines the areas within the detection range corresponding to each operation button image that are frequently touched by the user. For example, the trend analysis unit 214a determines a trend in which the user mostly touches the lower right position of each detection range or mostly touches the upper center position of each detection range. The trend analysis unit 214a outputs information indicating the determined trend of the user's touch operations to the detection range control unit 212a.
[0103] The detection range control unit 212a acquires information representing the trend of the user's touch operation output from the trend analysis unit 214a. Taking into account the trend of the user's touch operation, the detection range control unit 212a sets or resets the detection range in the touch sensor 232.
[0104] [Trend Analysis and Processing]
[0105] The following is a specific example illustrating the trend analysis processing of user touch operations performed by the trend analysis unit 214a (hereinafter referred to as "trend analysis processing"). Figures 10-12 This is a schematic diagram illustrating an example of trend analysis processing performed by the information processing apparatus 200a according to the second embodiment of the present invention.
[0106] exist Figure 10 The image shows the operation button image b3 and the detection range a3. Additionally, in... Figure 10 In the image, multiple touch positions when a user normally touches the operation button image b3 are indicated by an "X". The distribution of these touch positions can be generated based on the detection position data 221a recorded in the storage unit 220a. Figure 10 The example shown illustrates that the user touched the operation button image b3 nine times in the past, seven of which were touches on the lower right position within the detection range a3.
[0107] The trend analysis unit 214a removes deviation values from the aforementioned distribution of touch positions. Figure 10 In the diagram, the two touch positions that represent deviation values are enclosed by a dashed circle. Next, the trend analysis unit 214a calculates the centroid of the distribution of touch positions after removing the deviation values. Figure 11 In the diagram, the center of gravity is marked with a star. Next, the trend analysis unit 214a generates a probability model of the touch position. Figure 12 This is a schematic diagram illustrating an example of the generation process of a probabilistic model of touch positions. For example, the trend analysis unit 214a performs principal component analysis on the distribution of touch positions based on the calculated centroid position to determine the principal component axes. The trend analysis unit 214a assumes that the distribution of touch positions follows a normal distribution relative to each principal component axis, and generates a probabilistic model of the touch positions.
[0108] The detection range control unit 212a determines the amount of parallel movement and rotation angle of the detection range based on the probability model of the touch position generated by the trend analysis unit 214a. Figure 13This is a schematic diagram illustrating an example of the determination process for the parallel movement amount and rotation angle of the detection range performed by the information processing apparatus 200a according to the second embodiment of the present invention. The detection range control unit 212a determines the parallel movement amount and rotation angle of the detection range in a manner that takes into account the positions of other adjacent detection ranges and covers areas that are highly likely to be touched by the user.
[0109] For example, the detection range control unit 212a rotates the detection range so that the first principal component axis of the touch position distribution is parallel to the long side of the rectangle of the detection range, and moves the detection range in parallel to include all touch positions within the distribution (and expands the detection range as needed). Alternatively, for example, the detection range control unit 212a rotates and moves the detection range in parallel to the long side of the rectangle of the detection range so that the first principal component axis of the touch position distribution is parallel to the long side of the rectangle of the detection range and coincides with the straight line dividing the detection range into two parts (and expands the detection range as needed).
[0110] The detection range control unit 212a determines the reset detection range by adding the determined parallel movement amount and rotation angle of the detection range to the change amount of the detection range determined by the influence of interference. The detection range control unit 212a resets the detection range in the touch sensor 232 to the detection range determined above.
[0111] It should be noted that the trend analysis section 214a can, for example, be like... Figure 14 As shown, a probabilistic model of the touch position is generated by overlaying the distributions of the individual touch positions for multiple operation button images.
[0112] It should be noted that when rotating each detection range in the case of multiple adjacent operation button images, if a certain detection range interferes with the display area of the operation button image corresponding to other detection ranges, the detection range control unit 212a may, for example, be as follows: Figure 15 As shown, the detection ranges are moved parallel to each other without being rotated. Furthermore, when multiple operation button images are arranged adjacently, if each detection range is rotated, and each detection range does not interfere with the display area of the operation button image corresponding to other detection ranges, the detection range control unit 212a can, for example, be as follows: Figure 16 Rotate each detection range as shown.
[0113] exist Figure 15 and Figure 16 In the diagram, solid rectangles represent the display area of the operation button image, while dashed rectangles represent the detection range.
[0114] [Operation of the information processing device]
[0115] The following describes an example of the operation of the information processing device 200a. Figure 17 This is a flowchart illustrating the operation of the information processing device 200a according to a second embodiment of the present invention. The operation of the information processing device 200a shown in this flowchart begins when the vehicle is in a normal state (i.e., the vehicle is stopped and the vehicle is traveling in a straight line at a constant speed).
[0116] When the vehicle is in its normal operating state (i.e., when the values of acceleration and angular acceleration are below a predetermined value) (step S201), the operation detection processing unit 213a acquires information from the touch sensor 232 indicating the touch position (coordinates) of the user's touch operation on the touch panel 230. The operation detection processing unit 213a records the acquired touch position information as detection position data 221a in the storage unit 220a (step S202).
[0117] Next, the trend analysis unit 214a generates a distribution of touch positions by referring to the detection position data 221a recorded in the storage unit 220a. The trend analysis unit 214a removes deviation values from the generated touch position distribution (step S203). Next, the trend analysis unit 214a calculates the centroid position of the touch position distribution after removing deviation values (step S204). Next, the trend analysis unit 214a performs principal component analysis on the touch position distribution based on the calculated centroid position to determine the principal component axes (step S205). Next, the trend analysis unit 214a assumes that the touch position distribution follows a normal distribution relative to each principal component axis and generates a probability model of the touch positions (step S206).
[0118] Next, the detection range control unit 212a determines the amount of parallel movement and the rotation angle of the detection range based on the probability model of the touch position generated by the trend analysis unit 214a (step S207). Based on the determined amount of parallel movement and the rotation angle of the detection range, the detection range control unit 212a changes each detection range in the touch sensor 232 (i.e., performs parallel movement, rotation, and expansion, etc.) (step S208).
[0119] Next, when the value of at least one of the acceleration and angular acceleration of the acquired signal changes (step S209), the detection range control unit 212a adds the determined parallel movement and rotation angle of the detection range to the change in the detection range due to interference, thereby determining a reset detection range. The detection range control unit 212a resets the detection range in the touch sensor 232 to the determined detection range (step S210). Figure 17 The operation of the information processing device 200a shown in the flowchart has ended.
[0120] As explained above, in the second embodiment of the present invention, the detection range control system 1a and the information processing device 200a record and store the touch positions during the user's touch operations when the vehicle is in normal operation. The detection range control system 1a and the information processing device 200a analyze the distribution of touch positions to determine the user's touch operation trends (habits). For example, the detection range control system 1a and the information processing device 200a determine the user's tendency to touch specific positions in each detection range (e.g., the lower right position). Furthermore, the detection range control system 1a and the information processing device 200a consider not only the interference generated by the vehicle (e.g., changes in at least one of acceleration and angular acceleration) but also the user's touch operation trends determined above, and adjust the detection range of the touch sensor 232 mounted on the vehicle.
[0121] By employing this structure, the detection range control system 1a and information processing device 200a in the second embodiment can further increase the likelihood of accepting user-based touch input operations. Consequently, the detection range control system 1a and information processing device 200a can further reduce the occurrence of user operational errors. Furthermore, similar to the detection range control system 1 and information processing device 200a in the first embodiment, the detection range is adjusted in response to the occurrence of interference; therefore, it is not necessary to pre-widen the detection range beyond what is necessary under normal circumstances. This allows for, for example, further narrowing of the spacing between multiple operation button images in the touch input screen, thus further increasing the freedom of screen design for the touch input screen.
[0122] <Third Implementation Method>
[0123] The detection range control system 1b according to the third embodiment of the present invention will now be described. In addition to the structure of the detection range control system 1 of the first embodiment described above, the detection range control system 1b also includes a structure that temporarily retains changes in the detection range depending on the type of touch operation performed. Specifically, the detection range control system 1b temporarily retains changes in the detection range during touch operations such as long presses or double-clicks performed by the user until the touch operation is completed. Therefore, the detection range control system 1b can prevent, for example, situations where a tapping position that was within the detection range at the start of the touch operation is no longer within the detection range midway through the touch operation.
[0124] [Structure of the detection range control system]
[0125] Figure 18This is a block diagram illustrating the overall structure of the detection range control system 1b according to the third embodiment of the present invention. It should be noted that the functional blocks and structures of the detection range control system 1b are different from those of the control system. Figure 1 The function blocks of the detection range control system 1 of the first embodiment shown above are labeled with the same name and symbol, and the description of the structure of the function blocks is omitted.
[0126] like Figure 18 As shown, the detection range control system 1b includes a status detection unit 100 and an information processing device 200b. The information processing device 200b includes a control unit 210b, a storage unit 220, and a touch panel 230.
[0127] The control unit 210b includes a display control unit 211, a detection range control unit 212b, an operation detection processing unit 213b, and a change retention control unit 215b.
[0128] The change retention control unit 215b acquires signals output from the touch sensor 232 based on the user's touch operation. These signals may include, for example, information indicating the touch position (coordinates) of the user's touch on the touch sensor 232.
[0129] The change retention control unit 215b controls the detection range control unit 212b to prevent changes in the detection range during continuous touch operations where the user maintains the same touch position on the touch sensor 232. This prevents changes in the detection range, for example, during a long press operation on the touch sensor 232.
[0130] Furthermore, the change retention control unit 215b measures the time from when the user ends touching the touch sensor 232 (e.g., after removing their finger from the touch sensor 232). The change retention control unit 215b controls the detection range control unit 212b to prevent changes to the detection range during the period from when the user ends touching the touch sensor 232 until a predetermined time has elapsed. This prevents changes to the detection range, for example, from occurring midway through a double-touch operation on the touch sensor 232.
[0131] It should be noted that the time specified above can be set to be equal to the time set as an upper limit, which is used to identify a double-click in the touch sensor 232.
[0132] [Operation of the information processing device]
[0133] The following describes an example of the operation of the information processing device 200b. Figure 19This is a flowchart illustrating the operation of the information processing apparatus 200b according to a third embodiment of the present invention. The operation of the information processing apparatus 200b shown in this flowchart begins when the touch sensor 232 detects a user's touch and outputs a signal to the control unit 210b.
[0134] The change retention control unit 215b acquires the signal output from the touch sensor 232 based on the user's touch operation. Therefore, the change retention control unit 215b detects the start of the user's touch on the touch sensor 232 (step S301). Next, the change retention control unit 215b controls the detection range control unit 212b to retain the change in the detection range (step S302).
[0135] Next, the change retention control unit 215b determines whether the touch position has changed based on the signal output from the touch sensor 232 (step S303). If the change retention control unit 215b determines that the touch position has changed, it terminates the control of the detection range control unit 212b that retains the change in the detection range (step S307).
[0136] On the other hand, when the change retention control unit 215b determines that the touch position has not changed, it determines whether the user's touch on the touch sensor 232 has ended (e.g., whether the user has removed his finger from the touch sensor 232) based on the presence or absence of a signal output from the touch sensor 232 (step S304).
[0137] If the change retention control unit 215b determines that the user's touch on the touch sensor 232 has not ended, it continues to wait until the touch position changes or the touch ends. On the other hand, if the change retention control unit 215b determines that the user's touch on the touch sensor 232 has ended, it starts timing (step S305).
[0138] Next, after starting the timer, the change retention control unit 215b waits until a predetermined time has elapsed (step S306). It should be noted that the predetermined time, as described above, refers to, for example, the time limit for recognizing a double-click. After the predetermined time has elapsed, the change retention control unit 215b terminates the control of the detection range control unit 212b on the change retention of the detection range (step S307). That concludes... Figure 19 The operation of the information processing device 200b shown in the flowchart has ended.
[0139] As explained above, the detection range control system 1b and information processing device 200b in the third embodiment of the present invention are controlled to not change the detection range in the touch sensor 232 during the period when the user continuously touches the same position on the touch sensor 232. By having such a structure, the detection range control system 1b and information processing device 200b can prevent changes in the detection range, for example, during a long-press touch operation performed by the user. Therefore, it is less likely that a long-press input operation cannot be accurately recognized due to changes in the detection range, thus further reducing the occurrence of user operation errors.
[0140] It should be noted that in this embodiment, a structure is adopted to control the detection range of the touch sensor 232 so that it does not change during the period when the user continuously touches the same area of the touch sensor 232, but for example, Figure 4 As shown, a structure can also be adopted in which the lengthening is controlled so that the modified detection range includes the original detection range.
[0141] Furthermore, as explained above, the detection range control system 1b and information processing device 200b in the third embodiment of the present invention are controlled to prevent changes in the detection range of the touch sensor 232 during a predetermined period after the user ends touching the touch sensor 232. By having this structure, the detection range control system 1b and information processing device 200b can prevent changes in the detection range, for example, during a double-touch operation performed by the user. Therefore, it is less likely that a double-touch input operation cannot be accurately recognized due to changes in the detection range, thus further reducing the occurrence of user operation errors.
[0142] It should be noted that in this embodiment, the following structure is adopted: the control is such that the detection range of the touch sensor 232 is not changed during the period from when the user ends touching the touch sensor 232 until a predetermined time has elapsed, but for example, Figure 4 As shown, a structure can also be adopted in which the lengthening is controlled so that the modified detection range includes the original detection range.
[0143] Furthermore, according to the detection range control system 1a and information processing device 200a, similar to the detection range control system 1 and information processing device 200 of the first embodiment, the detection range is changed accordingly to the occurrence of interference. Therefore, it is not necessary to pre-widen the detection range beyond what is necessary under normal circumstances. As a result, for example, the setting interval of multiple operation button images in the touch operation input screen can be further narrowed, thus further increasing the freedom of screen design for the touch operation input screen.
[0144] <Fourth Implementation>
[0145] The detection range control system 1c according to the fourth embodiment of the present invention will now be described. The detection range control system 1 of the first embodiment described above is configured to detect disturbances generated by a vehicle, i.e., changes in at least one of acceleration and angular acceleration, and adjust the detection range of the touch sensor 232 mounted on the vehicle according to the degree of such change. In contrast, the detection range control system 1c of the fourth embodiment described below has the following structure: predicting the occurrence of disturbances generated by a vehicle, and adjusting the detection range of the touch sensor 232 mounted on the vehicle according to the prediction result.
[0146] [Structure of the detection range control system]
[0147] Figure 20 This is a block diagram illustrating the overall structure of the detection range control system 1c according to the fourth embodiment of the present invention. It should be noted that the functional blocks and structures of the detection range control system 1c are related to... Figure 1 The function blocks of the detection range control system 1 of the first embodiment shown above are labeled with the same name and number, and the description of the structure of the function blocks is omitted.
[0148] like Figure 20 As shown, the detection range control system 1c includes a status detection unit 100c and an information processing device 200c. The status detection unit 100c includes a navigation system 103c and a camera 104c. It should be noted that the status detection unit 100c may also be configured to include only either the navigation system 103c or the camera 104c.
[0149] The information processing device 200c includes a control unit 210c, a storage unit 220, and a touch panel 230. The control unit 210c includes a display control unit 211, a detection range control unit 212c, an operation detection processing unit 213, and a status prediction unit 216c.
[0150] The navigation system 103c can identify the current location of the vehicle equipped with the information processing device 200c, for example, using a positioning system such as GPS (Global Positioning System). Additionally, the navigation system 103c can acquire map information. The navigation system 103c can, for example, set a destination based on user input. The navigation system 103c can perform a route search up to the set destination and display the driving route on a map. The navigation system 103c outputs information indicating the vehicle's driving route and information indicating the vehicle's current location to the information processing device 200. It should be noted that the navigation system 103c may also output map information instead of information indicating the vehicle's driving route.
[0151] Camera 104c is installed on the vehicle in a manner capable of capturing the vehicle's direction of travel. While the vehicle is in motion, camera 104c captures images of the vehicle's direction of travel at predetermined intervals and outputs each captured image to information processing device 200.
[0152] The state prediction unit 216c acquires information indicating the vehicle's driving path and information indicating the vehicle's current position, output from the navigation system 103c. The information indicating the driving path includes, for example, information such as the radius and length of curves present in the driving path, used to estimate forces such as centrifugal force generated on the vehicle when driving on curves. Additionally, the information indicating the driving path includes, for example, information such as the inclination angle and length of ramps present in the driving path, used to estimate vertical forces generated on the vehicle when driving on ramps. It should be noted that the information indicating the driving path may also include, for example, information such as construction zones present in the driving path, which can be used to estimate other forces generated on the vehicle during driving.
[0153] The state prediction unit 216c predicts the future state of the vehicle based on information representing the vehicle's travel path and information representing the vehicle's current position. The future state of the vehicle referred to here includes, for example, the acceleration and angular acceleration generated by the vehicle traveling on the travel path at each future time.
[0154] Additionally, the state prediction unit 216c acquires images output from the camera 104c. The state prediction unit 216c analyzes the acquired images to detect objects or events that may exert forces on the moving vehicle, such as curves or slopes ahead in the direction of travel. Based on the detected objects or events, the state prediction unit 216c predicts the future state of the vehicle. The future state of the vehicle, as described above, includes, for example, the acceleration and angular acceleration of the vehicle traveling along its path at each future time.
[0155] The state prediction unit 216c outputs information representing the prediction result to the detection range control unit 212c. The detection range control unit 212c acquires the information representing the prediction result output from the state prediction unit 216c. Based on the acquired information representing the prediction result, the detection range control unit 212c controls the touch sensor 232, thereby changing the size, shape, or position of the detection range.
[0156] [Operation of the information processing device]
[0157] The following describes an example of the operation of the information processing device 200c. Figure 21This is a flowchart illustrating the operation of the information processing apparatus 200c according to a fourth embodiment of the present invention. The operation of the information processing apparatus 200c shown in this flowchart begins when the power supply to the detection range control system 1c, which includes the information processing apparatus 200c, is turned on. The power supply to the detection range control system 1c is, for example, linked to the power supply of the vehicle equipped with the detection range control system 1c being turned on.
[0158] As the power to the detection range control system 1c is turned on, the power to the information processing device 200c is also turned on (step S401).
[0159] Next, the display control unit 211 performs display processing to display the touch operation input screen on the LCD panel 231. The display control unit 211 displays the operation button image at a predetermined position within the touch operation input screen. Meanwhile, the detection range control unit 212c sets the detection range in the touch sensor 232 based on the display area of the operation button image on the LCD panel 231. At this time, the detection range control unit 212c sets the detection range as it is normally. That is, the detection range control unit 212c sets the detection range to be wider than the display area of the operation button image, thus including that display area (step S402).
[0160] Next, the state prediction unit 216c begins acquiring signals representing information used to predict the future state of the vehicle (step S403). The information used to predict the future state of the vehicle includes, for example, at least one of the following: information representing the vehicle's travel path and the vehicle's current position output from the navigation system 103c; and an image obtained by capturing the vehicle's direction of travel output from the camera 104c. This signal is, for example, a signal output at a sampling interval of 100 Hz, and is input to the state prediction unit 216c each time.
[0161] Next, the state prediction unit 216c predicts the future state of the vehicle based on the information obtained from each signal (step S404). The future state of the vehicle refers to, for example, the state of acceleration and angular acceleration generated by the vehicle traveling along the path at each future time. The state prediction unit 216c outputs information indicating the prediction result to the detection range control unit 212c.
[0162] The detection range control unit 212c acquires information representing the prediction result output from the state prediction unit 216c. If the prediction result based on the acquired information changes (step S405), the detection range control unit 212c resets the detection range in the touch sensor 232 according to the amount of change (step S406). This change, as described above, refers to expansion (elongation), parallel movement, or deformation of the detection range.
[0163] Next, the detection range control unit 212c repeatedly performs the action of resetting the detection range based on the change in the predicted state of the future vehicle, until, for example, the power supply to the information processing device is switched off (step S407). That concludes the above. Figure 21 The operation of the information processing device 200 shown has ended.
[0164] As explained above, the detection range control system 1c and information processing device 200c in the fourth embodiment of the present invention predict the future state of the vehicle based on information or images obtained from the navigation system 103c or camera 104c, and adjust the detection range in the touch sensor 232 mounted on the vehicle according to the change in the prediction result. With this structure, the detection range control system 1c and information processing device 200c can increase the likelihood of accepting input operations even when the user cannot accurately touch the display area of the desired operation button image due to the influence of acceleration or angular acceleration. Therefore, the detection range control system 1c and information processing device 200c can further reduce the occurrence of user operation errors.
[0165] Furthermore, the detection range control system 1c and information processing device 200c according to the fourth embodiment of the present invention change the detection range when interference is predicted, so it is not necessary to pre-widen the detection range beyond what is necessary under normal circumstances. As a result, for example, the setting interval of multiple operation button images in the touch operation input screen can be further narrowed, thus further increasing the degree of freedom in the screen design of the touch operation input screen.
[0166] The implementation methods described above can be performed as follows.
[0167] An information processing apparatus is configured to include a storage device storing a program and a hardware processor.
[0168] The hardware processor executes the program stored in the storage device.
[0169] The image for receiving input is displayed on a touch panel mounted on the mobile device.
[0170] Obtain the state information of the moving body that changes as the moving body moves.
[0171] For each image, a detection range is set on the touch panel to detect the input operation, and the detection range is changed based on the state information.
[0172] The above describes specific embodiments of the present invention, but the present invention is not limited to such embodiments in any way, and various modifications and substitutions can be made without departing from the spirit of the present invention.
Claims
1. An information processing device, wherein, The information processing device includes: The display control unit displays the image that receives the input operation on a touch panel mounted on the mobile body; The acquisition unit acquires the state information of the moving body that changes as the moving body moves; The detection range control unit sets the detection range, i.e., the detection range, on the touch panel according to each image, and changes the detection range based on the status information; as well as The state prediction unit predicts the future state of the mobile body based on its movement path. The acquiring unit acquires information representing the movement path. The detection range control unit changes the detection range based on the predicted state.
2. The information processing apparatus according to claim 1, wherein, When the status information indicates that there is acceleration acting in the first lateral direction, the detection range control unit extends the detection range in the second lateral direction, which is opposite to the first lateral direction.
3. The information processing apparatus according to claim 1 or 2, wherein, The information processing device further includes a trend analysis unit, which, when the acceleration represented by the state information is below a predetermined value, records the positions within the detection range where the input operation was performed, and analyzes the deviation in the distribution of the positions within the detection range. The detection range control unit changes the detection range based on the deviation.
4. The information processing apparatus according to claim 3, wherein, The trend analysis unit determines the axis of the distribution of the positions. The detection range control unit rotates the detection range according to the tilt of the shaft.
5. The information processing apparatus according to claim 1 or 2, wherein, When the detection range control unit continuously performs input operations on the same part of the touch panel, it either does not change the detection range, or changes the detection range in such a way that the changed detection range includes the original detection range.
6. The information processing apparatus according to claim 1 or 2, wherein, The detection range control unit either does not change the detection range after the input operation to the touch panel ends and until a predetermined time has elapsed, or changes the detection range in such a way that the changed detection range includes the original detection range.
7. A control method, wherein, The computer performs the following processing: The image for accepting input operations is displayed on a touch panel mounted on the mobile device; Obtain the state information of the moving body that changes as the moving body moves; The detection range is set on the touch panel according to each image, and the detection range is changed based on the state information. Predict the future state of the mobile body based on its movement path; Obtain information representing the movement path; as well as The detection range is changed based on the predicted state.
8. A storage medium having a stored program, wherein, The program causes the computer to perform the following processes: The image for accepting input operations is displayed on a touch panel mounted on the mobile device; Obtain the state information of the moving body that changes as the moving body moves; The detection range is set on the touch panel according to each image, and the detection range is changed based on the state information. Predict the future state of the mobile body based on its movement path; Obtain information representing the movement path; as well as The detection range is changed based on the predicted state.
Citation Information
Patent Citations
Information processing apparatus
JP2015094958A
System and method for controlling display of avn
CN104723993A
Personal digital assistant
CN111868674A