Vehicle operation control device and vehicle operation control program

Abstract

To appropriately achieve both relaxation of stress of a driver and securement of safety.SOLUTION: An operation control device 1 for a vehicle controls a driver's operation to a display screen displayed on a display device having a touch panel function. An operation mode setting unit 3a configured to set an operation mode of the driver with respect to the display screen to any one of an operation limitation mode in which the operation of the driver is limited, an operation non-limitation mode in which the operation of the driver is not limited, and an operation assist mode in which the operation of the driver is assisted, an operation detection unit 3b configured to detect the operation of the driver with respect to the display screen, and an operation handling unit 3c configured to handle the operation of the driver in the operation mode set by the operation mode setting unit 3d.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a vehicle operation control device and a vehicle operation control program. [Background technology]

[0002] Conventionally, display devices with touch panel functions have been installed in vehicles. Techniques have been disclosed for performing operations on a display screen displayed on the display device, such as a drag operation in which a finger slides across the touch panel, or a flick operation in which a finger flicks across the touch panel (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-170282 Summary of the Invention [Problem to be solved by the invention]

[0004] While a vehicle is traveling, operations are restricted by, for example, graying out the operation screen to ensure safety, but such restrictions on operations can cause stress for the driver. On the other hand, if restrictions on operations while the vehicle is traveling are completely eliminated, safety cannot be ensured. Under these circumstances, there is a demand for a system that can both alleviate driver stress and ensure safety.

[0005] The present invention has been made in consideration of the above-mentioned circumstances, and its purpose is to provide a vehicle operation control device and a vehicle operation control program that can appropriately achieve both the alleviation of driver stress and the assurance of safety. [Means for solving the problem]

[0006] The vehicle operation control device (1) described in claim 1 controls a driver's operation on a display screen displayed on a display device having a touch panel function. The vehicle operation control device includes a vehicle information acquisition unit (3a) that acquires vehicle information related to a vehicle state indicating a vehicle state, an operation mode setting unit (3b) that sets the driver's operation mode on the display screen to one of an operation restricted mode that restricts the driver's operation, an operation unrestricted mode that does not restrict the driver's operation, and an operation assist mode that assists the driver's operation based on the vehicle information acquired by the vehicle information acquisition unit, an operation detection unit (3c) that detects the driver's operation on the display screen, and an operation handling unit (3d) that handles the driver's operation in the operation mode set by the operation mode setting unit.

[0007] According to the vehicle operation control device recited in claim 1, the driver's operation mode for the display screen is set to one of an operation restriction mode, an operation unlimited mode, and an operation assist mode based on vehicle information. When the driver's operation for the display screen is detected, the driver's operation is handled in the set operation mode. By handling the driver's operation for the display screen in the operation assist mode, some operations are permitted without completely eliminating operation restrictions while the vehicle is traveling, thereby reducing driver stress and restricting operations to a certain extent while the vehicle is traveling, thereby ensuring safety. This makes it possible to appropriately balance reducing driver stress with ensuring safety.

[0008] The vehicle operation control program described in claim 8 causes a control unit (3) of a vehicle operation control device (1) that controls a driver's operation on a display screen displayed on a display device having a touch panel function to execute a vehicle information acquisition procedure for acquiring vehicle information related to a vehicle state indicating a vehicle state, an operation mode setting procedure for setting the driver's operation mode on the display screen to one of an operation restricted mode that restricts the driver's operation, an operation unlimited mode that does not restrict the driver's operation, and an operation assist mode that assists the driver's operation, based on the vehicle information acquired by the vehicle information acquisition procedure, an operation detection procedure for detecting the driver's operation on the display screen, and an operation handling procedure for handling the driver's operation in the operation mode set by the operation mode setting procedure.

[0009] According to the vehicle operation control program recited in claim 8, by handling the driver's operations on the display screen in the operation assist mode, the operation restrictions while the vehicle is traveling are not completely lifted but some operations are permitted, which can relieve the driver's stress and also ensure safety by restricting the operations while the vehicle is traveling to some extent. This makes it possible to appropriately achieve both relief of driver stress and ensuring safety. [Brief explanation of the drawings]

[0010] [Figure 1] Functional block diagram showing the overall configuration of one embodiment [Figure 2] Flowchart showing operation mode setting processing [Figure 3] Flowchart showing operation mode setting processing [Figure 4] Flowchart showing operation handling process [Figure 5] Diagram explaining operation assistance mode [Figure 6] Diagram explaining operation assistance mode [Figure 7] Diagram explaining operation assistance mode [Figure 8] Diagram explaining operation assistance mode [Figure 9] Diagram explaining operation assistance mode [Figure 10] Diagram explaining operation assistance mode [Figure 11] Diagram explaining operation assistance mode [Figure 12] Diagram explaining operation assistance mode [Figure 13] Diagram explaining operation assistance mode [Figure 14] Diagram explaining operation assistance mode [Figure 15] Diagram explaining operation assistance mode [Figure 16] Diagram explaining operation mode transition DETAILED DESCRIPTION OF THE INVENTION

[0011] An embodiment will be described below with reference to the drawings. A vehicle operation control device 1 mounted on a vehicle controls the display of a display device 2 having a touch panel function. The display device 2 is, for example, a center information display (CID) constituting an in-vehicle infotainment (IVI) system, and is disposed in the center of the cockpit so that both the driver and passenger can operate it. When the display device 2 detects an operation by the driver or passenger on the display screen, it transmits an operation detection signal indicating the operation to the vehicle operation control device 1. When the display device 2 receives a display control signal from the vehicle operation control device 1, it controls the display based on the received display control signal. The operations by the driver or passenger on the display screen include, for example, a drag operation in which the driver or passenger slides their finger on the touch panel, a flick operation in which the driver or passenger flicks their finger on the touch panel, a character input operation, and the like.

[0012] The vehicle operation control device 1 may be provided as a dedicated electronic control device (ECU (Electronic Control Unit)), or may be incorporated into an integrated ECU that integrates multiple functions together with other functions. The vehicle operation control device 1 is connected to an in-vehicle network such as a CAN (Controller Area Network) (registered trademark), and is configured to be able to receive various information from various cameras, various sensors, and various ECUs via the in-vehicle network, as will be described later. The vehicle operation control device 1 also turns its power on and off in conjunction with the power on and off of accessories, for example.

[0013] The vehicle operation control device 1 has a control unit 3. The control unit 3 is mainly configured with a microcomputer having a CPU, ROM, RAM, I / O, etc., and controls the operation of the vehicle operation control device 1 by executing software processing by the CPU running a computer program stored in a non-transient physical storage medium and hardware processing by a dedicated electronic circuit.

[0014] The vehicle is equipped with a driver's seat camera 4, a passenger seat camera 5, a meter ECU 6, an adaptive cruise control (hereinafter referred to as ACC) ECU 7, a steering control ECU 8, a periphery monitoring camera 9, an acceleration sensor 10, and a navigation ECU 11. The driver's seat camera 4, passenger seat camera 5, meter ECU 6, ACCECU 7, steering control ECU 8, periphery monitoring camera 9, acceleration sensor 10, and navigation ECU 11 are connected to the vehicle operation control device 1 via an in-vehicle network.

[0015] The driver's seat camera 4 is disposed, for example, in front of the driver's seat and periodically transmits camera images of the driver's seat to the vehicle operation control device 1. That is, the driver's seat camera 4 transmits camera images of the driver's upper body while the driver is seated in the driver's seat to the vehicle operation control device 1. The passenger's seat camera 5 is disposed, for example, in front of the passenger's seat and periodically transmits camera images of the passenger's seat to the vehicle operation control device 1. That is, the passenger's seat camera 5 transmits camera images of the passenger's upper body while the passenger is seated in the passenger's seat to the vehicle operation control device 1. Although the configuration in which the driver's seat camera 4 and the passenger's seat camera 5 are separately disposed has been exemplified, the driver's seat camera 4 and the passenger's seat camera 5 may also be disposed integrally. Alternatively, a single wide-angle camera may be disposed to capture images of both the driver's seat and the passenger's seat.

[0016] The meter ECU 6 transmits vehicle speed information indicating the vehicle speed of the vehicle to the vehicle operation control device 1. The ACCECU 7 determines whether the ACC function is operating or not, and transmits ACC operation information indicating whether the ACC function is operating or not to the vehicle operation control device 1. The steering control ECU 8 determines whether a steering operation is being performed or not, and transmits steering operation information indicating whether a steering operation is being performed or not to the vehicle operation control device 1.

[0017] The perimeter monitoring camera 9 includes, for example, a front camera that captures the area in front of the vehicle, a rear camera that captures the area behind the vehicle, a right-side camera that captures the area to the right of the vehicle, and a left-side camera that captures the area to the left of the vehicle. The angles of view of each camera are set to capture a 360-degree view of the entire surroundings of the vehicle by partially interpolating each other. The perimeter monitoring camera 9 periodically transmits camera images of the area in front of the vehicle captured by the front camera, camera images of the area behind the vehicle captured by the rear camera, camera images of the area to the right of the vehicle captured by the right-side camera, and camera images of the area to the left of the vehicle captured by the left-side camera to the vehicle operation control device 1. Note that, although the configuration in which each of the camera images captured by the front camera, rear camera, right-side camera, and left-side camera is transmitted to the vehicle operation control device 1 has been exemplified, a configuration in which only the camera image captured by the front camera is transmitted to the vehicle operation control device 1 may also be used.

[0018] The acceleration sensor 10 detects acceleration acting on the host vehicle in the forward / backward, left / right, and up / down directions, and transmits acceleration information indicating the detected acceleration to the vehicle operation control device 1. The navigation ECU 11 identifies the vehicle position of the host vehicle, identifies the road corresponding to the identified vehicle position by referring to road data included in the map data, and transmits position information indicating the identified vehicle position and road information indicating the road on which the vehicle is traveling to the vehicle operation control device 1.

[0019] The control unit 3 includes a vehicle information acquisition unit 3a, an operation mode setting unit 3b, an operation detection unit 3c, and an operation handling unit 3d. These units 3a to 3d execute a vehicle operation control program.

[0020] The vehicle information acquisition unit 3a receives and acquires, as vehicle information, a camera image of the driver's seat taken from the driver's seat camera 4, a camera image of the passenger seat taken from the passenger seat camera 5, vehicle speed information from the meter ECU 6, ACC operation information from the ACCECU 7, steering operation information from the steering control ECU 8, a camera image of the vehicle's surroundings taken from the surrounding monitoring camera 9, acceleration information from the acceleration sensor 10, and position information and road information from the navigation ECU 11.

[0021] When vehicle information is acquired by the vehicle information acquisition unit 3a, the operation mode setting unit 3b sets the driver's operation mode for the display screen to one of an operation restricted mode, an operation unlimited mode, and an operation assist mode based on the acquired vehicle information. The operation restricted mode is an operation mode in which the driver's operation is restricted. That is, even if the driver performs a drag operation or a flick operation on the display screen when the operation restricted mode is set, the drag operation or the flick operation is invalidated, and the display screen does not change. Furthermore, even if the driver performs a character input operation on the display screen when the operation restricted mode is set, the character input operation is invalidated, and the input character is not confirmed and is not displayed.

[0022] The unrestricted operation mode is an operation mode that does not restrict the driver's operation. That is, when the unrestricted operation mode is set and the driver performs a drag operation on the display screen, the drag operation is validated, and the display screen is slid according to the amount of the drag operation. Also, when the unrestricted operation mode is set and the driver performs a flick operation on the display screen, the flick operation is validated, and the display screen is transitioned from the current screen to the next screen. Also, when the driver performs a character input operation on the display screen when the unrestricted operation mode is set, the character input operation is validated, and the input character is confirmed and displayed.

[0023] The operation assist mode is an operation mode that assists the driver's operation and is an operation mode with an intermediate concept between the operation restricted mode and the operation unrestricted mode. That is, the operation assist mode is an operation mode that does not restrict the driver's operation as much as the operation restricted mode, but does not allow the driver to operate as much as the operation unrestricted mode. The behavior of the operation assist mode will be described later.

[0024] The operation detection unit 3c detects an operation by the driver on the display screen, such as the above-mentioned drag operation, flick operation, and character input operation.

[0025] When the operation detection unit 3c detects the driver's operation, the operation handling unit 3d handles the detected driver's operation in the operation mode set by the operation mode setting unit 2b. That is, if the operation restriction mode is set, the operation handling unit 3d handles the driver's operation in the operation restriction mode, if the operation unlimited mode is set, the operation handling unit 3d handles the driver's operation in the operation unlimited mode, and if the operation assist mode is set, the operation handling unit 3d handles the driver's operation in the operation assist mode.

[0026] Next, the operation of the above-described configuration will be described with reference to Figures 2 to 16. In this case, an operation mode setting process for setting an operation mode and an operation handling process for handling driver operations will be described.

[0027] (1-1) Operation mode setting process (see Figures 2 and 3) When the control unit 3 starts the operation mode setting process, it determines whether or not an operation is being performed on the display screen of the display device 2 (S1). When the control unit 3 determines that an operation detection signal is not received from the display device 2 and that no operation is being performed on the display screen (S1: NO), it sets the operation unlimited mode (S10, which corresponds to the operation mode setting procedure) and ends the operation mode setting process.

[0028] When the control unit 3 receives an operation detection signal from the display device 2 and determines that an operation is being performed on the display screen (S1: YES), it determines whether the operation is performed by the passenger or the driver based on the camera image received from the passenger seat camera 5 and the camera image received from the driver seat camera 4 (S2, S3, corresponding to the vehicle information acquisition procedure).

[0029] When the control unit 3 determines, for example, that the passenger's arm is extended close to the display device 2 by analyzing the camera image received from the passenger seat camera 5 and determines that the operation is being performed by the passenger (S2: YES), it also sets the operation unlimited mode (S10) and ends the operation mode setting process.When the control unit 3 determines, for example, that the driver's arm is extended close to the display device 2 by analyzing the camera image received from the driver seat camera 4 and determines that the operation is being performed by the driver (S3: YES), it determines whether the vehicle speed is equal to or greater than a predetermined speed based on the vehicle speed information received from the meter ECU 6 (S4, which corresponds to the vehicle information acquisition procedure).

[0030] If the control unit 3 determines that the vehicle speed is less than the predetermined speed (S4: NO), it also sets the operation unlimited mode (S10) and ends the operation mode setting process.If the control unit 3 determines that the vehicle speed is equal to or greater than the predetermined speed (S4: YES), it determines whether the ACC function is operating based on the ACC operation information received from the ACCECU 7 (S5, which corresponds to the vehicle information acquisition procedure).

[0031] If the control unit 3 determines that the ACC function is operating (S5: YES), it also sets the operation unlimited mode (S10) and ends the operation mode setting process. If the control unit 3 determines that the ACC function is not operating (S5: NO), it determines whether or not a steering operation is being performed based on the steering operation information received from the steering control ECU 8 (S6, which corresponds to the vehicle information acquisition procedure).

[0032] When the control unit 3 determines that the steering is being operated (S6: YES), it sets the operation restriction mode (S11, which corresponds to the operation mode setting procedure) and ends the operation mode setting process.When the control unit 3 determines that the steering is not being operated (S6: NO), it determines whether the surrounding environment is dangerous or not based on the camera image received from the surrounding monitoring camera 9 (S7, which corresponds to the vehicle information acquisition procedure).

[0033] When the control unit 3 determines, for example, that the distance between the vehicle and the surrounding vehicles is less than a predetermined distance or that the number of surrounding vehicles is greater than or equal to a predetermined number by analyzing the camera image received from the perimeter monitoring camera 9 and determines that the surrounding environment is dangerous (S7: YES), it also sets the operation restriction mode (S11) and ends the operation mode setting process.When the control unit 3 determines, for example, that the distance between the vehicle and the surrounding vehicles is greater than a predetermined distance or that the number of surrounding vehicles is less than a predetermined number and determines that the surrounding environment is not dangerous (S7: NO), it determines whether the traveling state of the vehicle is stable based on the acceleration information received from the acceleration sensor 10 (S8, which corresponds to the vehicle information acquisition step).

[0034] If the control unit 3 determines that the driving state of the vehicle is unstable (S8: NO), it also sets the operation restriction mode (S11) and ends the operation mode setting process. If the control unit 3 determines that the driving state of the vehicle is stable (S8: YES), it determines whether the vehicle is driving in a section with high driving load based on the position information and road information received from the navigation ECU 11 (S9, which corresponds to the vehicle information acquisition step).

[0035] For example, when the control unit 3 determines that the vehicle is traveling on a road with successive curved sections or a narrow road, and determines that the vehicle is traveling in a section with high driving load (S9: YES), it also sets the operation restriction mode (S11) and ends the operation mode setting process. When the control unit 3 determines that the vehicle is traveling on a road with successive straight sections or a wide road, and determines that the vehicle is traveling in a section with low driving load (S9: NO), it sets the operation assist mode (S12, which corresponds to the operation mode setting procedure), and ends the operation mode setting process.

[0036] That is, the control unit 3 sets the operation assist mode when it determines that the operation on the display screen is an operation by the driver, the vehicle speed is equal to or greater than a predetermined speed, the ACC function is not operating, the steering is not being operated, the surrounding environment is not a dangerous situation, the running state of the host vehicle is stable, and the host vehicle is running in a section with a low driving load. The above has exemplified a configuration that determines whether the operation on the display screen is an operation by the driver, whether the vehicle speed is equal to or greater than a predetermined speed, whether the ACC function is operating, whether the steering is being operated, whether the surrounding environment is a dangerous situation, whether the running state of the host vehicle is stable, and whether the host vehicle is running in a section with a high driving load, but if the operation mode is classified into any of the operation unlimited mode, operation limited mode, and operation assist mode, any of the determinations may be omitted.

[0037] (1-2) Operation handling process (see Figure 4) When the control unit 3 starts the operation handling process, it determines whether or not an operation is being performed on the display screen of the display device 2 (S21, which corresponds to the operation detection step). When the control unit 3 determines that an operation detection signal is not received from the display device 2 and that no operation is being performed on the display screen (S21: NO), it ends the operation handling process.

[0038] When the control unit 3 receives an operation detection signal from the display device 2 and identifies that an operation is being performed on the display screen (S21: YES), it identifies the operation mode currently set (S22), handles the detected driver's operation in the identified operation mode (S23, corresponding to the operation handling procedure), and ends the operation handling process. That is, if the operation restriction mode is set at that time, the control unit 3 handles the driver's operation in the operation restriction mode, if the operation unlimited mode is set, handles the driver's operation in the operation unlimited mode, and if the operation assist mode is set, handles the driver's operation in the operation assist mode.

[0039] The operation assist mode will be described. Here, the case where the driver performs a drag operation and the case where the driver performs a character input operation will be described. Note that in this embodiment, it is assumed that the vehicle is a left-hand drive vehicle, and the case where the driver performs operations on the display screen with the fingers of the right hand will be described. However, if the vehicle is a right-hand drive vehicle, the driver will perform operations on the display screen with the fingers of the left hand.

[0040] (2-1) When the driver performs a drag operation (see Figures 5 to 10) As an example of a case where the driver performs a drag operation, assume that "PS" on the map screen is the starting point and "PE" is the destination point, as shown in FIG. 5. The driver touches the point "PS" and slides his / her finger in the direction from the point "PS" to the point "PE." In this case, if the control unit 3 is set to the operation restriction mode, the map screen will not slide even if the driver slides his / her finger, regardless of whether the sliding direction is up, down, left, or right. On the other hand, if the control unit 3 is set to the operation unlimited mode, when the driver slides his / her finger, the map screen will slide in the sliding direction according to the amount of the slide, regardless of whether the sliding direction is up, down, left, or right.

[0041] In this embodiment, when the operation assist mode is set, the control unit 3 enables a drag operation in the direction in which the driver first slides on the display screen, and disables a drag operation in a direction deviating from the driver's initial sliding direction. Specifically, the control unit 3 temporarily stores the direction in which the driver slides his / her finger from point "PS" to a point, for example, a predetermined distance, as an initial sliding direction. As shown in FIG. 6 , when the driver slides his / her finger from point "PS" to point "P1," for example, a predetermined distance away, the control unit 3 slides the map screen in the sliding direction according to the amount of sliding from point "PS" to point "P1," and stores the sliding direction from point "PS" to point "P1" as the initial sliding direction (initial operation direction).

[0042] Next, as shown in FIG. 7, when the driver slides his / her finger from point "P1" to point "P2," the control unit 3 slides the map screen in the sliding direction according to the amount of sliding from point "P1" to point "P2," since the angle difference indicating the deviation between the sliding direction from point "P1" to point "P2" and the initial sliding direction is less than a predetermined angle.

[0043] Here, let us consider a case where the driver accidentally slides his / her finger in an unintended direction. As shown in Fig. 8, even if the driver accidentally slides his / her finger from point "P2" to point "P3" unintentionally, the control unit 3 does not slide the map screen because the angle difference indicating the deviation between the sliding direction from point "P2" to point "P3" and the initial sliding direction is equal to or greater than a predetermined angle. In other words, the control unit 3 holds the map screen in the state it was in before the driver slid his / her finger in the unintended direction.

[0044] Next, as shown in Figures 9 and 10, when the control unit 3 touches the finger at point "P2" again and slides it from point "P2" to point "PE", the angle difference indicating the deviation between the sliding direction from point "P2" to point "PE" and the initial sliding direction is less than a predetermined angle, so the control unit 3 slides the map screen in the sliding direction according to the sliding amount from point "P2" to point "PE".

[0045] That is, unlike the unrestricted operation mode, which allows drag operations in any direction, including up, down, left, and right, the control unit 3 enables drag operations whose angular difference from the initial slide direction is less than a predetermined angle, but disables drag operations whose angular difference from the initial slide direction is greater than or equal to a predetermined angle. In the unrestricted operation mode, even if the driver accidentally slides his / her finger in an unintended direction, the map screen slides in the direction of the slide according to the amount of the slide. This may cause the driver to lose sight of the target location due to the unintended slide of the map screen, which may require complex operations to find the target location. In contrast, in the operation assist mode, the map screen does not slide even if the driver accidentally slides his / her finger in an unintended direction, thereby preventing the driver from losing sight of the target location. Disabling drag operations in unintended directions in this way assists the driver's drag operations.

[0046] The above has been described with respect to drag operations, but the present invention may also be applied to flick operations. That is, when the operation assist mode is set, the control unit 3 may enable flick operations on the display screen in the direction in which the driver initially flicks the screen, and disable flick operations in directions different from the driver's initial flick direction. When the unlimited operation mode is set, even if the driver accidentally flicks the screen in an unintended direction, the screen transitions to the next display screen in the direction of the flick. This may result in a malfunction when the driver intends to perform multiple screen transitions in the same direction. In contrast, when the operation assist mode is set, even if the driver accidentally flicks the screen in an unintended direction, the screen transitions to the next display screen in the direction of the flick. This may prevent a malfunction when the driver intends to perform multiple screen transitions in the same direction. Disabling flick operations in unintended directions in this way may assist the driver's flick operations.

[0047] (2-2) When the driver performs character input operations (see Figures 11 to 15) As an example of a case where the driver performs a character input operation, it is assumed that the driver sets a destination for the navigation function using, for example, the Japanese syllabary key input unit 21, as shown in FIG. 11 and subsequent figures. The driver touches, for example, the "a" key. In this case, if the control unit 3 is set to the operation restriction mode as shown in FIG. 11, even if the driver touches the "a" key, the "a" is not confirmed and is not displayed in the character input field 22. On the other hand, if the control unit 3 is set to the operation restriction mode as shown in FIG. 12, when the driver touches the "a" key, the control unit 3 confirms the "a" and displays it in the character input field 22.

[0048] In this embodiment, if the operation assistance mode is set, the control unit 3 predicts word candidates related to the input characters. Specifically, as shown in FIG. 13 , the control unit 3 stores, for example, previously used words in a database. When the driver touches the "a" key, the control unit 3 tentatively confirms "a" and tentatively displays it in the character input field 22. In addition, the control unit 3 newly displays the input candidate field 23 and displays the input candidate key corresponding to the touched "a." FIG. 13 illustrates an example in which "Ai XX Town," "Ao XX Town," "Aka XX Town," "Aki XX Town," "Aki XX Town," and "Asa XX Town" are shown as input candidates corresponding to the "a" key, and a first candidate key 24a, a second candidate key 24b, a third candidate key 24c, a fourth candidate key 24d, and a fifth candidate key 24e corresponding to each of the input candidates are displayed. In this case, when the driver touches the up scroll key 25a or the down scroll key 25b, the control unit 3 displays other input candidates.

[0049] As shown in FIG. 14, when the driver touches the fifth candidate key 24e corresponding to "Asa XX-cho," the control unit 3 confirms "Asa XX-cho" and displays it in the character input field 22. The same process is carried out thereafter. As shown in FIG. 15, when the driver touches the "sa" key, the control unit 3 provisionally confirms "sa" after "Asa XX-cho" and provisionally displays it in the character input field 22. In addition, the control unit 3 newly displays the input candidate field 23 and displays the input candidate key corresponding to the touched "sa" key. FIG. 15 illustrates examples of input candidates corresponding to the "sa" key, such as "Saka XX 1-chome," "Saka XX 2-chome," "Saka XX 3-chome," "Saka XX 1-chome," and "Saka XX 2-chome," and displays the corresponding first candidate key 24a, second candidate key 24b, third candidate key 24c, fourth candidate key 24d, and fifth candidate key 24e. In this case, the control unit 3 also displays other input candidates when the driver touches the up scroll key 25a or the down scroll key 25b.

[0050] That is, when the operation assist mode is set, the control unit 3 displays input candidates, unlike the unlimited operation mode in which input candidates are not displayed, and when a key corresponding to the input candidate is touched, the input candidate is confirmed and displayed. When the unlimited operation mode is set, the effort of touching each character is required, and the time required for character input operation is increased. In contrast, when the operation assist mode is set, the input candidates are displayed, and when a key corresponding to the input candidate is touched, the input candidate is confirmed and displayed, eliminating the effort of touching each character and shortening the time required for character input operation. By simplifying character input operation in this way, it is possible to assist the driver in character input operation.

[0051] Next, the transition of the operation mode will be described. When the transition condition of the operation mode in the direction of strengthening the degree of operation restriction is satisfied, the control unit 3 sets the simple continuation mode to simply continue the current operation mode, and transitions from the current operation mode to the next operation mode via the simple continuation mode rather than directly from the current operation mode to the next operation mode. The simple continuation mode is an operation mode that avoids the current operation mode being forcibly terminated midway through operation when the transition condition from the current operation mode to the next operation mode is satisfied. In the simple continuation mode, the control unit 3 employs technology such as an operation to select an affirmative or negative response, a one-touch operation, or voice recognition, to simply terminate the current operation mode with an operation that does not impose a burden on the driver.

[0052] As shown in Fig. 16, when a transition condition from the unrestricted operation mode to the restricted operation mode is met, the control unit 3 sets a first simplified continuation mode for continuing the unrestricted operation mode in a simplified manner, and transitions from the unrestricted operation mode to the restricted operation mode via the first simplified continuation mode rather than directly transitioning from the unrestricted operation mode to the restricted operation mode. Similarly, when a transition condition from the unrestricted operation mode to the assist operation mode is met, the control unit 3 sets a second simplified continuation mode for continuing the unrestricted operation mode in a simplified manner, and transitions from the unrestricted operation mode to the assist operation mode via the second simplified continuation mode rather than directly transitioning from the unrestricted operation mode to the assist operation mode. Furthermore, when a transition condition from the assist operation mode to the restricted operation mode is met, the control unit 3 sets a third simplified continuation mode for continuing the assist operation mode in a simplified manner, and transitions from the assist operation mode to the restricted operation mode via the third simplified continuation mode rather than directly transitioning from the assist operation mode to the restricted operation mode. Note that when a transition condition for an operation mode that relaxes the operation restrictions is met, the control unit 3 directly transitions from the current operation mode to the next operation mode.

[0053] As described above, according to the embodiment, the following advantageous effects can be obtained. In the vehicle operation control device 1, the driver's operation mode for the display screen is set to one of an operation restriction mode, an operation unlimited mode, and an operation assist mode based on vehicle information. When the driver's operation for the display screen is detected, the driver's operation is handled in the set operation mode. By handling the driver's operation for the display screen in the operation assist mode, some operations are permitted without completely eliminating operation restrictions while the vehicle is traveling, thereby reducing driver stress and restricting operations to a certain extent while the vehicle is traveling, thereby ensuring safety. This makes it possible to appropriately achieve both reducing driver stress and ensuring safety.

[0054] The vehicle information acquired includes information on whether the person operating the display screen is the driver or passenger, vehicle speed information, ACC operation information, steering operation information, information on whether the surrounding environment is dangerous, information on whether the vehicle's driving condition is stable, and information on whether the vehicle's driving position is a position where driving stress is high. Based on the multifaceted vehicle information, the system can be set to one of operation restriction mode, operation unlimited mode, and operation assist mode.

[0055] In addition to the claims, the present disclosure also includes the following disclosure. [1] A vehicle operation control device (1) that controls a driver's operation on a display screen displayed on a display device having a touch panel function, a vehicle information acquisition unit (3a) for acquiring vehicle information relating to a vehicle state that indicates a state of the vehicle; an operation mode setting unit (3b) that sets the driver's operation mode for the display screen to one of an operation restriction mode that restricts the operation of the driver, an operation unlimited mode that does not restrict the operation of the driver, and an operation assist mode that assists the operation of the driver, based on the vehicle information acquired by the vehicle information acquisition unit; an operation detection unit (3c) that detects an operation of the driver on the display screen; and an operation handling unit (3d) that handles the driver's operation in accordance with the operation mode set by the operation mode setting unit.

[0056] [2] The vehicle information acquisition unit acquires, as the vehicle information, at least one of information indicating the person operating the display screen, information indicating the vehicle speed, information regarding whether the driving is being performed automatically, information regarding whether the steering operation is being performed, information regarding surrounding vehicles, information indicating the acceleration acting on the vehicle, and information regarding the vehicle position and the road on which the vehicle is traveling. [1] A vehicle operation control device as described in.

[0057] [3] The operation handling unit, when receiving a drag operation or a flick operation as the driver's operation on the display screen in the operation assist mode, validates the operation in the driver's initial operation direction on the display screen and invalidates the operation in an operation direction deviating from the driver's initial operation direction. [1] A vehicle operation control device as described in [2] or [3].

[0058] [4] The operation handling unit is configured to predict word candidates related to the input characters when it receives a character input operation as a driver's operation on the display screen in the operation assist mode. [1] or [2] A vehicle operation control device as described in [1] or [2].

[0059] [5] The vehicle operation control device according to any one of claims [1] to [4], wherein the operation mode setting unit sets a simple continuation mode that simply continues the unlimited operation mode when a condition for transitioning from the unlimited operation mode to the limited operation mode is met, and transitions from the unlimited operation mode to the limited operation mode via the simple continuation mode.

[0060] [6] The vehicle operation control device according to any one of claims [1] to [5], wherein the operation mode setting unit sets a simplified continuation mode that simply continues the unrestricted operation mode when a transition condition from the unrestricted operation mode to the operation assist mode is met, and transitions from the unrestricted operation mode to the operation assist mode via the simplified continuation mode.

[0061] [7] The operation mode setting unit sets a simple continuation mode that simply continues the operation assist mode when a transition condition from the operation assist mode to the operation restriction mode is met, and transitions from the operation assist mode to the operation restriction mode via the simple continuation mode.

[0023] A vehicle operation control device as described in any one of [1] to [6].

[0062] Although the present disclosure has been described with reference to the embodiments, it is understood that the present disclosure is not limited to the embodiments or structures. The present disclosure also encompasses various modifications and modifications within the scope of equivalents. In addition, various combinations and forms, as well as other combinations and forms including only one element, more than one element, or less than one element, are also within the scope and spirit of the present disclosure.

[0063] The control unit and the method described herein may be implemented by a special-purpose computer configured by configuring a processor and memory programmed to perform one or more functions embodied in a computer program. Alternatively, the control unit and the method described herein may be implemented by a special-purpose computer configured by configuring a processor with one or more dedicated hardware logic circuits. Alternatively, the control unit and the method described herein may be implemented by one or more special-purpose computers configured by combining a processor and memory programmed to perform one or more functions with a processor configured with one or more hardware logic circuits. Furthermore, the computer program may be stored as instructions executed by a computer on a computer-readable non-transitory tangible storage medium. [Explanation of symbols]

[0064] In the drawing, 1 is a vehicle operation control device, 3 is a control unit, 3a is a vehicle information acquisition unit, 3b is an operation mode setting unit, 3c is an operation detection unit, and 3d is an operation handling unit.

Claims

1. A vehicle operation control device (1) that controls a driver's operation on a display screen displayed on a display device having a touch panel function, a vehicle information acquisition unit (3a) for acquiring vehicle information relating to a vehicle state indicating a state of the vehicle; an operation mode setting unit (3b) that sets the driver's operation mode for the display screen to one of an operation restriction mode that restricts the operation of the driver, an operation restriction mode that does not restrict the operation of the driver, and an operation assist mode that assists the operation of the driver, based on the vehicle information acquired by the vehicle information acquisition unit; an operation detection unit (3c) that detects an operation of the driver on the display screen; an operation handling unit (3d) that handles the driver's operation in accordance with the operation mode set by the operation mode setting unit.

2. 2. A vehicle operation control device as described in claim 1, wherein the vehicle information acquisition unit acquires at least one of the following vehicle information: information indicating the person operating the display screen, information indicating the vehicle speed, information regarding whether the driving is being performed automatically, information regarding whether the steering operation is being performed, information regarding surrounding vehicles, information indicating the acceleration acting on the vehicle, and information regarding the vehicle position and the road on which the vehicle is traveling.

3. 2. The vehicle operation control device according to claim 1, wherein when a drag operation or a flick operation is accepted as the driver's operation on the display screen in the operation assist mode, the operation handling unit validates the operation in the driver's initial operation direction on the display screen and invalidates the operation in an operation direction deviating from the driver's initial operation direction.

4. 2. The vehicle operation control device according to claim 1, wherein the operation handling unit, when receiving a character input operation as the driver's operation on the display screen in the operation assist mode, predicts word candidates related to the input characters.

5. 2. The vehicle operation control device according to claim 1, wherein the operation mode setting unit sets a simplified continuation mode that simply continues the unlimited operation mode when a transition condition from the unlimited operation mode to the limited operation mode is met, and transitions from the unlimited operation mode to the limited operation mode via the simplified continuation mode.

6. 2. The vehicle operation control device according to claim 1, wherein the operation mode setting unit sets a simplified continuation mode that simply continues the unrestricted operation mode when a transition condition from the unrestricted operation mode to the operation assist mode is met, and transitions from the unrestricted operation mode to the operation assist mode via the simplified continuation mode.

7. 2. The vehicle operation control device according to claim 1, wherein the operation mode setting unit sets a simple continuation mode that simply continues the operation assist mode when a transition condition from the operation assist mode to the operation restriction mode is met, and transitions from the operation assist mode to the operation restriction mode via the simple continuation mode.

8. A control unit (3) of a vehicle operation control device (1) that controls a driver's operation on a display screen displayed on a display device having a touch panel function, a vehicle information acquisition step of acquiring vehicle information relating to a vehicle state indicating a state of the vehicle; an operation mode setting procedure for setting the driver's operation mode for the display screen to one of an operation restriction mode that restricts the operation of the driver, an operation unlimited mode that does not restrict the operation of the driver, and an operation assist mode that assists the operation of the driver, based on the vehicle information acquired by the vehicle information acquisition procedure; an operation detection step of detecting an operation of the driver on the display screen; an operation handling procedure for handling the driver's operation in accordance with the operation mode set by the operation mode setting procedure; and a vehicle operation control program for executing the operation handling procedure.

Images