User interface system, control device, and computer program
The user interface system minimizes driver distractions by using an input device separate from the display to confirm function states without activating the device, reducing eye movement and enhancing safety.
Patent Information
- Application Number
- JP2023079977
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-15
- Publication Date
- 2024-11-27
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing user interface systems require drivers to move their line of sight and fingers to interact with touch-sensitive screens, leading to unnecessary eye movement and potential distraction.
A user interface system with an input device positioned away from the display, allowing operations to transition images without activating the controlled device, using distinct states to confirm functions without visual confirmation.
Reduces unnecessary eye movement and potential distractions by allowing drivers to confirm function states without activating the device, enhancing safety and reducing visual interaction.
Smart Images

Figure 2024164477000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a user interface system installed in a vehicle equipped with a driver's seat. The present disclosure also relates to a control device that can be installed in the system and a computer program executable by a processor installed in the control device. [Background technology]
[0002] Patent Document 1 discloses a display device mounted on a vehicle as an example of a moving object. The display device displays information related to a controlled device mounted on the vehicle. The display device includes a touch panel device capable of receiving touch operations by an occupant of the vehicle. The occupant can control the operation of the controlled device or change settings through touch operations. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2016-126556 A Summary of the Invention [Problem to be solved by the invention]
[0004] There is a demand for providing a user interface system that can suppress line-of-sight movement of a person driving a mobile vehicle. [Means for solving the problem]
[0005] One aspect of the present disclosure is a user interface system installed in a vehicle having a driver's seat, comprising: An input device that is disposed away from a display device that can display a screen including an image associated with an operation of a controlled device mounted on the moving body in front of the driver's seat and that accepts a first operation to operate the controlled device; a control device that transitions the image from a first state to a second state when the input device receives the first operation; It is equipped with When the input device receives a second operation different from the first operation, the control device transitions the image to a third state different from the first state and the second state without operating the controlled device.
[0006] One example of an aspect provided by the present disclosure is a control device mounted on a vehicle having a driver's seat, an interface that receives a first operation signal indicating that an input device disposed away from a display device capable of displaying a screen including an image associated with an operation of a controlled device mounted on the moving body in front of the driver's seat has received a first operation for operating the controlled device; a processor for transitioning the image from a first state to a second state based on the first operation signal; It is equipped with When the interface receives a second operation signal indicating that the input device has received a second operation different from the first operation, the processor transitions the image to a third state different from the first state and the second state without operating the controlled device.
[0007] One example of an aspect provided by the present disclosure is a computer program executable by a processor of a control device mounted on a vehicle having a driver's seat, the computer program comprising: By being executed, the control device receiving a first operation signal indicating that an input device disposed away from a display device capable of displaying a screen including an image associated with an operation of a controlled device mounted on the moving body in front of the driver's seat has received a first operation for operating the controlled device; transitioning the image from a first state to a second state based on the first operation signal; When the input device receives a second operation signal indicating that a second operation different from the first operation has been received, the image is transitioned to a third state different from the first state and the second state without operating the controlled device.
[0008] In the configuration described in Patent Document 1, a screen including an image associated with the operation of a controlled device mounted on a moving body is displayed on a display device, and the operation of the controlled device is controlled through a touch operation on the screen by the driver's finger. In such a configuration, the driver's line of sight movement is unavoidable in order to check the information displayed on the screen and move the finger to a position for performing a touch operation.
[0009] In the configurations according to the above-mentioned embodiments, a screen including an image associated with the operation of the controlled device is displayed in front of the driver's seat, thereby suppressing the driver's line of sight movement required to confirm the information displayed on the screen. In addition, an input device that accepts a first operation for operating the controlled device is disposed at a position away from the screen, making it possible to eliminate the need for line of sight movement required to perform at least a touch operation.
[0010] Furthermore, when a second operation different from the first operation is performed on the input device, the image associated with the operation of the controlled device transitions to a state different from that when the first operation is performed. This allows the driver to check information related to the operation associated with the first operation without having the controlled device perform the operation and without taking his / her eyes off the front of the driver's seat. As a result, unnecessary operation of the controlled device can be avoided and the driver's line of sight movement can be further suppressed. [Brief description of the drawings]
[0011] [Figure 1] 1 illustrates an example of a configuration of a user interface system according to an embodiment. [Diagram 2] 2 illustrates a vehicle in which the user interface system of FIG. 1 is installed. [Diagram 3] 2 shows an example of a screen displayed on the display device of FIG. 1. [Figure 4] 2 shows another example of the screen displayed on the display device of FIG. 1. [Diagram 5] 2 shows another example of the screen displayed on the display device of FIG. 1. [Figure 6] 2 shows another example of the screen displayed on the display device of FIG. 1. [Figure 7] 2 shows another example of the screen displayed on the display device of FIG. 1. [Figure 8] 2 shows another example of the screen displayed on the display device of FIG. 1. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0012] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment will be described in detail below with reference to the accompanying drawings. In each of the drawings used in the following description, the scale is appropriately changed so that each element can be clearly seen.
[0013] Fig. 1 illustrates a functional configuration of a user interface system 10 according to an embodiment. The user interface system 10 according to this example is configured to be mounted on a vehicle 20 illustrated in Fig. 2. The user interface system 10 is used to operate a controlled device mounted on the vehicle 20. The vehicle 20 is an example of a moving body.
[0014] A display device 22 is installed in the passenger compartment 21 of the vehicle 20. The display device 22 is disposed in front of the driver's seat of the vehicle 20. The display device 22 according to this embodiment constitutes a part of a so-called meter panel. The display device 22 is configured to display a screen including an image associated with the operation of the controlled device. The details of the screen will be described later.
[0015] As illustrated in Fig. 1, a user interface system 10 includes an input device 11. As illustrated in Fig. 2, the input device 11 is disposed away from a display device 22. The input device 11 according to this example is installed on a steering wheel 23 of a vehicle 20. The steering wheel 23 is an example of a steering device for a moving body.
[0016] The input device 11 according to this embodiment is used to control the operation of a device associated with a driving assistance function of the vehicle 20. The device is an example of a controlled device. An example of the driving assistance function is a cruise control function that keeps the driving speed constant.
[0017] An example of activating the cruise control function will be described with reference to Figures 3 and 4. Figure 3 illustrates an example of an initial screen 221 displayed by the display device 22. The initial screen 221 includes an image simulating a road ahead of the vehicle 20. The state in which the initial screen 221 is displayed is an example of a first state.
[0018] On the other hand, as illustrated in Fig. 2, the input device 11 includes a push switch 111. When the driver of the vehicle 20 presses the push switch 111, the screen displayed by the display device 22 is changed to a cruise control screen 222 illustrated in Fig. 4. In the cruise control screen 222, the color of one lane is changed, and an icon indicating that the cruise control function is enabled and a set speed are displayed. The state in which the cruise control screen 222 is displayed is an example of the second state.
[0019] 1, the input device 11 is configured to output a first operation signal S1 when a push switch 111 is pressed by a driver of the vehicle 20. The first operation signal S1 may be an analog signal or a digital signal depending on the specifications of the input device 11. The operation of pressing the push switch 111 is an example of a first operation.
[0020] The user interface system 10 includes a controller 12. The controller 12 includes an input interface 121, a processor 122, and an output interface 123.
[0021] The input interface 121 is configured as a hardware interface that accepts the first operation signal S1. When the first operation signal S1 is an analog signal, the input interface 121 includes an appropriate conversion circuit including an A / D converter. This description is similarly applied to other signals that can be accepted by the input interface 121, which will be described later.
[0022] The processor 122 is configured to output a display control signal DC, which causes the display device 22 to display an initial screen 221, from an output interface 123 configured as a hardware interface. The display control signal DC may be an analog signal or a digital signal depending on the specifications of the display device 22.
[0023] When the display control signal DC is an analog signal, the output interface 123 includes an appropriate conversion circuit including a D / A converter. This description is similarly applied to other signals that can be output from the output interface 123, which will be described later.
[0024] When the first operation signal S1 is received by the input interface 121, the processor 122 is configured to output, from the output interface 123, a display control signal DC that transitions the image displayed by the display device 22 from the initial screen 221 to the cruise control screen 222.
[0025] The input device 11 according to this embodiment includes a detection device that detects a change in capacitance caused by the driver's touching the push switch 111 with his / her finger. The operation of touching the push switch 111 with a finger is an example of a second operation. The input device 11 is configured to output a second operation signal S2 corresponding to the change in capacitance caused by the touch of the finger. The second operation signal S2 may be an analog signal or a digital signal depending on the specifications of the detection device.
[0026] The processor 122 is configured to, when the second operation signal S2 is accepted by the input interface 121, output, from the output interface 123, a display control signal DC for transitioning the image displayed by the display device 22 to a function notification screen 223 exemplified in Fig. 5. The state in which the function notification screen 223 is displayed is an example of the third state.
[0027] In the function notification screen 223, one lane has been changed to a color different from that of the cruise control screen 222. The icon indicating that the cruise control function is enabled and the set speed are not displayed. That is, in the function notification screen 223, the image associated with the cruise control function has an appearance different from both the initial screen 221 and the cruise control screen 222. Note that a different appearance may be presented by making one lane flash in the same color as the cruise control screen 222.
[0028] In other words, the function notification screen 223 is configured to make the driver aware that the push switch 111 touched by the driver's finger is the switch that activates the cruise control function, and that the function has not yet been activated.
[0029] When the driver releases his / her finger from the push switch 111, the output of the second operation signal S2 from the input device 11 is stopped. The processor 122 of the control device 12 is configured to output, from the output interface 123, a display control signal DC for returning the image displayed by the display device 22 to the initial screen 221 when the input of the second operation signal S2 to the input interface 121 is stopped.
[0030] In the configuration described in Patent Document 1, a screen including an image associated with the operation of a controlled device mounted on a vehicle is displayed on a display device, and the operation of the controlled device is controlled through a touch operation on the screen by the driver's finger. In such a configuration, the driver's line of sight movement is unavoidable in order to check the information displayed on the screen and move the finger to a position for performing a touch operation.
[0031] In the configuration according to this embodiment, a screen including an image associated with the cruise control function is displayed in front of the driver's seat, thereby reducing the amount of eye movement required by the driver to confirm the information displayed on the screen. In addition, a push switch 111 that accepts a push operation to activate the cruise control function is located away from the screen, making it possible to at least eliminate the need to move the driver's eyes to perform a touch operation.
[0032] Furthermore, by touching the push switch 111 with a finger, a function notification screen 223 is displayed in which an image associated with the cruise control function has a different appearance before and after the function is activated. This allows the driver to check information related to the function associated with the push operation of the push switch 111 without activating the function and without taking his / her eyes off the front of the driver's seat. As a result, unnecessary function activation can be avoided while the driver's line of sight movement can be further suppressed.
[0033] The operation of touching the push switch 111 with a finger is a preliminary operation for pressing the push switch 111. In this case, a smooth transition from the operation related to the function check to the operation related to the function activation can be realized. It is also easy to cancel the pressing operation when it is determined that the function activation is unnecessary as a result of the function check.
[0034] 1, the user interface system 10 may include a notification device 13. The notification device 13 is installed at an appropriate position in the cabin 21 of the vehicle 20, and is configured to be capable of performing at least one of an auditory notification and a tactile notification. In this case, the processor 122 of the control device 12 outputs a notification control signal NC, which causes the notification device 13 to perform at least one of an auditory notification and a tactile notification, from the output interface 123 while the display device 22 displays the function notification screen 223. The notification control signal NC may be an analog signal or a digital signal depending on the specifications of the notification device 13.
[0035] According to this configuration, it is possible to give a strong impression to the driver that the cruise control function is not in operation while the function notification screen 223 is displayed. This makes it possible to suppress the driver's line of sight movement while making it difficult for the input device 11 to be operated erroneously.
[0036] The processor 122 of the control device 12 having the various functions described above can be realized by a dedicated integrated circuit such as a microcontroller, ASIC, FPGA, etc., including a storage element in which a computer program for implementing the functions is preinstalled. In this case, the storage element is an example of a non-transitory computer-readable medium in which a computer program is stored.
[0037] Alternatively, the processor 122 may be realized by a general-purpose microprocessor that operates in cooperation with a general-purpose memory. Examples of the general-purpose microprocessor include a CPU, an MPU, and a GPU. Examples of the general-purpose memory include a ROM and a RAM. In this case, a computer program for realizing the function may be stored in the ROM. The general-purpose microprocessor specifies at least a part of the program stored in the ROM, expands it on the RAM, and executes the above-mentioned process in cooperation with the RAM. In this case, the general-purpose memory is an example of a non-transitory computer-readable medium in which a computer program is stored.
[0038] The processor 122 may be implemented by a combination of a general purpose microprocessor and a dedicated integrated circuit.
[0039] The configurations described above are merely examples for facilitating understanding of the present disclosure. Each configuration example may be appropriately modified and combined with other configuration examples without departing from the spirit of the present disclosure.
[0040] 2, the input device 11 may include a push switch 112. The push switch 112 is configured to be pressed to activate an autopilot function that keeps a constant distance from a vehicle ahead while traveling in the same lane. The autopilot function is an example of a driving assistance function.
[0041] An example of activating the autopilot function will be described with reference to Fig. 6 to Fig. 8. Fig. 6 illustrates the initial screen 221, as in Fig. 3. When the driver presses the push switch 112, the screen displayed by the display device 22 is changed to an autopilot screen 224. On the autopilot screen 224, an icon image indicating that the autopilot function is enabled, an image indicating the vehicle ahead, and an image indicating that the vehicle distance from the vehicle ahead is being maintained are displayed. The state in which the autopilot screen 224 is displayed is an example of the second state.
[0042] When the driver touches the push switch 112 with his / her finger, the screen displayed by the display device 22 is changed to a function notification screen 225. In the function notification screen 225, only an image representing the vehicle ahead is additionally displayed. An icon image representing that the autopilot function is enabled, and an image representing that the distance from the vehicle ahead is being maintained are not displayed. In other words, the function notification screen 225 has an appearance different from both the initial screen 221 and the autopilot screen 224. The state in which the function notification screen 225 is displayed is an example of the third state.
[0043] As the number of switches included in the input device 11 increases, the advantage of the above embodiment, in that the function associated with the switch can be confirmed without visually checking the switch, becomes more prominent.
[0044] The functions provided for notification by the function notification screen are not limited to the driving assistance functions of the vehicle 20. Functions related to appropriate controlled devices mounted on the vehicle 20 may be subject to control by the input device 11 and subject to notification by the function notification screen. Examples of such controlled devices include lighting devices, air conditioning devices, audiovisual devices, and seat devices.
[0045] In the above embodiment, the operation of displaying the function notification screen is detected based on a change in capacitance caused by the driver's finger touching the push switch. However, the operation may be detected based on a change in pressure or temperature caused by the touch of the driver's finger. Alternatively, the touch of the finger on the push switch may be detected by an imaging device.
[0046] In the above embodiment, a push switch accepts an operation to activate a controlled device. However, the configuration of the input device 11 for accepting the operation may be changed as appropriate. For example, a lever switch, a slide switch, a dial switch, or the like may be adopted. The manner of operation for checking a function may be determined as appropriate according to the type of switch adopted, so long as it is different from the operation for activating the function. For example, in the case of a configuration in which a specific function is activated by displacing a switch in a specific direction, the function may be confirmed by displacing the switch in the opposite direction.
[0047] In the above embodiment, the input device 11 is installed on the steering wheel 23 of the vehicle 20. With this configuration, the input device 11 is located in front of the driver's seat, similar to the display device 22, so that the amount of eye movement of the driver can be further reduced. However, the input device 11 may be disposed in an appropriate location in the vehicle interior 21 away from the display device 22. Examples of such a location include the armrest of the driver's seat, near the shift lever, etc.
[0048] In the above embodiment, the display device 22 constitutes a part of the meter panel of the vehicle 20. However, the display device 22 may be configured as a head-up display device that projects the above-mentioned various screens in front of the driver's seat on a windshield 24 of the vehicle 20, as illustrated in FIG.
[0049] The user interface system 10 may be mounted on a moving object other than the vehicle 20. Examples of such moving objects include trains, airplanes, ships, and the like.
[0050] Each of the configurations listed below also constitutes part of this disclosure. Item 1: A user interface system mounted on a vehicle having a driver's seat, An input device that is disposed away from a display device that can display a screen including an image associated with an operation of a controlled device mounted on the moving body in front of the driver's seat and that accepts a first operation to operate the controlled device; a control device that transitions the image from a first state to a second state when the input device receives the first operation; It is equipped with When the input device receives a second operation different from the first operation, the control device transitions the image to a third state different from the first state and the second state without operating the controlled device. User interface system. Item 2: The second operation is a preliminary operation of the first operation. Item 1. A user interface system according to item 1. Item 3: The device is provided with a notification device capable of performing at least one of an audio notification and a tactile notification, the control device causes the notification device to perform at least one of the audible notification and the tactile notification while the screen is in the third state; 3. A user interface system according to item 1 or 2. Item 4: The input device is installed in a steering device of the moving body. 4. A user interface system according to any one of items 1 to 3. [Explanation of symbols]
[0051] 10: user interface system, 11: input device, 12: control device, 121: input interface, 122: processor, 13: notification device, 20: vehicle, 22: display device, 221: initial screen, 222: cruise control screen, 223: function notification screen, 224: autopilot screen, 225: function notification screen, 23: steering wheel, S1: first operation signal, S2: second operation signal
Claims
1. A user interface system mounted on a vehicle having a driver's seat, An input device that is disposed away from a display device that can display a screen including an image associated with an operation of a controlled device mounted on the moving body in front of the driver's seat and that accepts a first operation to operate the controlled device; a control device that transitions the image from a first state to a second state when the input device receives the first operation; It is equipped with When the input device receives a second operation different from the first operation, the control device transitions the image to a third state different from the first state and the second state without operating the controlled device. User interface system.
2. The second operation is a preliminary operation of the first operation. The user interface system of claim 1 .
3. The device is provided with a notification device capable of performing at least one of an audio notification and a tactile notification, the control device causes the notification device to perform at least one of the audible notification and the tactile notification while the screen is in the third state; The user interface system of claim 1 .
4. The input device is installed in a steering device of the moving body. The user interface system of claim 1 .
5. A control device mounted on a moving body having a driver's seat, an interface that receives a first operation signal indicating that an input device disposed away from a display device capable of displaying a screen including an image associated with an operation of a controlled device mounted on the moving body in front of the driver's seat has received a first operation for operating the controlled device; a processor for transitioning the image from a first state to a second state based on the first operation signal; It is equipped with When the interface receives a second operation signal indicating that the input device has received a second operation different from the first operation, the processor transitions the image to a third state different from the first state and the second state without operating the controlled device. Control device.
6. A computer program executable by a processor of a control device mounted on a vehicle having a driver's seat, By being executed, the control device receiving a first operation signal indicating that an input device disposed away from a display device capable of displaying a screen including an image associated with an operation of a controlled device mounted on the moving body in front of the driver's seat has received a first operation for operating the controlled device; transitioning the image from a first state to a second state based on the first operation signal; When the input device receives a second operation signal indicating that a second operation different from the first operation has been received, the image is transitioned to a third state different from the first state and the second state without operating the controlled device. Computer program.
Citation Information
Patent Citations
On-vehicle touch panel device
JP2016126556A
