User interface system, control apparatus, and computer program

The user interface system addresses the issue of unnecessary eye movement by using a non-touch input device for image switching, improving safety and convenience by enabling image confirmation without direct sight adjustments.

JP2024163655AInactive Publication Date: 2024-11-22KK TOKAI RIKA DENKI SEISAKUSHO
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023079456
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-12
Publication Date
2024-11-22
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing user interface systems require drivers to move their line of sight and fingers to perform touch operations on a display device, necessitating unnecessary eye movement and disrupting the driving experience.

Method used

A user interface system with an input device, such as a push switch, positioned away from the display device, allows for image switching via non-touch operations, displaying multiple images and a third image that partially includes the second image, reducing eye movement and enabling confirmation without looking away.

Benefits of technology

The system minimizes driver eye movement by allowing image switching and confirmation without direct touch, enhancing safety and convenience by reducing the need for line of sight adjustments during driving.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024163655000001_ABST
    Figure 2024163655000001_ABST
Patent Text Reader

Abstract

To provide a user interface system configured to prevent a person who drives a mobile body from moving a direction of gaze.SOLUTION: An input device 11 is separated from a display device 22 which can display an image ahead of a driver's seat of a mobile body. When the input device 11 receives a first operation, a control device 12 switches the displayed image from a first image to a second image. When the input device 11 receives a second operation different from the first operation, the control device 12 causes the display device 22 to display a third image at least partially including the second image and showing the appearance different from that of the second image.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a user interface system installed in a vehicle equipped with a driver's seat. The present disclosure also relates to a control device that can be installed in the system and a computer program executable by a processor installed in the control device. [Background technology]

[0002] Patent Document 1 discloses a display device mounted on a vehicle as an example of a moving object. The display device displays information related to a controlled device mounted on the vehicle. The display device includes a touch panel device capable of receiving touch operations by an occupant of the vehicle. The occupant can control the operation of the controlled device or change settings through touch operations. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2016-126556 A Summary of the Invention [Problem to be solved by the invention]

[0004] There is a demand for providing a user interface system that can suppress line-of-sight movement of a person driving a mobile vehicle. [Means for solving the problem]

[0005] One aspect of the present disclosure is a user interface system installed in a vehicle having a driver's seat, comprising: an input device disposed in front of the driver's seat and away from a display device capable of displaying an image; a control device that switches the image to be displayed from a first image to a second image when the input device receives a first operation; It is equipped with When the input device receives a second operation different from the first operation, the control device causes the display device to display a third image that includes at least a portion of the second image and has a different appearance from the second image.

[0006] One example of an aspect provided by the present disclosure is a control device mounted on a vehicle having a driver's seat, an interface that receives a first operation signal indicating that an input device that is disposed in front of the driver's seat and away from a display device capable of displaying an image has received a first operation for switching the image; a processor for switching the displayed image from a first image to a second image based on the first operation signal; Equipped with When the interface receives a second operation signal indicating that the input device has received a second operation different from the first operation, the processor causes the display device to display a third image that includes at least a portion of the second image and has a different appearance from the second image.

[0007] One example of an aspect provided by the present disclosure is a computer program executable by a processor of a control device mounted on a vehicle having a driver's seat, the computer program comprising: By being executed, the control device receiving a first operation signal indicating that an input device disposed away from a display device capable of displaying an image in front of the driver's seat has received a first operation for switching the image; switching the image to be displayed from a first image to a second image based on the first operation signal; When the input device receives a second operation signal indicating that a second operation different from the first operation has been received, a third image that includes at least a part of the second image and has an appearance different from that of the second image is displayed on the display device.

[0008] In the configuration described in Patent Document 1, the image displayed on the screen of the display device is switched by the driver's touch operation on the screen with his / her finger. In such a configuration, the driver cannot avoid moving his / her line of sight in order to check the information displayed on the screen and move his / her finger to the position where the touch operation is performed.

[0009] In the configurations according to the above-mentioned embodiments, the amount of eye movement of the driver to confirm the information displayed on the screen is suppressed by displaying a plurality of types of images to be switched in front of the driver's seat. In addition, since an input device that accepts a first operation to switch the displayed image is disposed at a position away from the screen, eye movement for at least performing a touch operation is not required.

[0010] Furthermore, when a second operation different from the first operation is performed on the input device, the display device displays a third image including the second image as a part thereof. This allows the driver to check the content of the second image that is displayed next by the first operation without taking his / her eyes off the front of the driver's seat. As a result, the driver's line of sight movement can be further suppressed. [Brief description of the drawings]

[0011] [Figure 1] 1 illustrates an example of a configuration of a user interface system according to an embodiment. [Diagram 2] 2 illustrates a vehicle in which the user interface system of FIG. 1 is installed. [Diagram 3] 2 shows an example of a screen displayed on the display device of FIG. 1. [Figure 4] 2 shows another example of the screen displayed on the display device of FIG. 1. [Diagram 5] 2 shows another example of the screen displayed on the display device of FIG. 1. [Figure 6] 2 shows another example of the screen displayed on the display device of FIG. 1. [Figure 7] 2 shows another example of the screen displayed on the display device of FIG. 1. [Figure 8]2 shows another example of the screen displayed on the display device of FIG. 1. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment will be described in detail below with reference to the accompanying drawings. In each of the drawings used in the following description, the scale is appropriately changed so that each element can be clearly seen.

[0013] Fig. 1 illustrates a functional configuration of a user interface system 10 according to an embodiment. The user interface system 10 according to this example is configured to be mounted on a vehicle 20 illustrated in Fig. 2. The user interface system 10 is used to operate a controlled device mounted on the vehicle 20. The vehicle 20 is an example of a moving body.

[0014] A display device 22 is installed in a passenger compartment 21 of the vehicle 20. The display device 22 is disposed in front of the driver's seat of the vehicle 20. The display device 22 according to this embodiment constitutes a part of a so-called meter panel. The display device 22 is configured to be able to display a plurality of types of images. Each of the plurality of types of images is associated with the operation of at least one controlled device mounted on the vehicle 20.

[0015] As illustrated in Fig. 1, the user interface system 10 includes an input device 11. As illustrated in Fig. 2, the input device 11 is disposed away from a display device 22. The input device 11 includes a push switch 111. The push switch 111 is installed on a steering wheel 23 of a vehicle 20. The steering wheel 23 is an example of a steering device for a moving body.

[0016] The function of the push switch 111 will be described with reference to Figures 3 and 4. Figure 3 illustrates a first image 221 displayed by the display device 22. The first image 221 provides information related to a driving assistance function of the vehicle 20. Examples of the driving assistance function include a cruise control function that keeps the driving speed constant, and an autopilot function that keeps the vehicle in the same lane as the vehicle ahead while maintaining a constant distance between the vehicle and the vehicle ahead.

[0017] When the driver of the vehicle 20 presses the push switch 111, the image displayed by the display device 22 is changed to a second image 222. The second image 222 provides information related to the navigation function of the vehicle 20. The navigation function provides map information, traffic information, route information to a destination, and the like.

[0018] 1, the input device 11 is configured to output a first operation signal S1 when a push switch 111 is pressed by a driver of the vehicle 20. The first operation signal S1 may be an analog signal or a digital signal depending on the specifications of the input device 11. The operation of pressing the push switch 111 is an example of a first operation.

[0019] The user interface system 10 includes a controller 12. The controller 12 includes an input interface 121, a processor 122, and an output interface 123.

[0020] The input interface 121 is configured as a hardware interface that accepts the first operation signal S1. When the first operation signal S1 is an analog signal, the input interface 121 includes an appropriate conversion circuit including an A / D converter. This description is similarly applied to other signals that can be accepted by the input interface 121, which will be described later.

[0021] The processor 122 is configured to output a display control signal DC, which causes a predetermined image to be displayed on the display device 22, from an output interface 123 configured as a hardware interface. The display control signal DC may be an analog signal or a digital signal depending on the specifications of the display device 22.

[0022] When the display control signal DC is an analog signal, the output interface 123 includes an appropriate conversion circuit including a D / A converter. This description is similarly applied to other signals that can be output from the output interface 123, which will be described later.

[0023] The processor 122 is configured to output, when the first operation signal S1 is received by the input interface 121, a display control signal DC from the output interface 123 to switch the image displayed by the display device 22 from the first image 221 to the second image 222.

[0024] When the driver presses the push switch 111 again, the image displayed by the display device 22 is switched from the second image 222 to the first image 221. That is, the processor 122 is configured to switch the image displayed by the display device 22 between the first image 221 and the second image 222 every time the first operation signal S1 is accepted by the input interface 121.

[0025] The input device 11 according to this embodiment includes a detection device that detects a change in capacitance caused by the driver's touching the push switch 111 with his / her finger. The operation of touching the push switch 111 with a finger is an example of a second operation. The input device 11 is configured to output a second operation signal S2 corresponding to the change in capacitance caused by the touch of the finger. The second operation signal S2 may be an analog signal or a digital signal depending on the specifications of the detection device.

[0026] The processor 122 is configured to output, when the second operation signal S2 is received by the input interface 121, from the output interface 123, a display control signal DC for causing the display device 22 to display a third image 223 exemplified in FIG.

[0027] The third image 223 has an appearance in which the reduced second image 222 is superimposed on the first image 221. In other words, the third image 223 has an appearance different from that of the second image 222 while including a part of the second image 222.

[0028] When the driver releases his / her finger from the push switch 111, the output of the second operation signal S2 from the input device 11 is stopped. The processor 122 of the control device 12 is configured to output, from the output interface 123, a display control signal DC that returns the image displayed by the display device 22 to the first image 221 when the input of the second operation signal S2 to the input interface 121 is stopped.

[0029] In the configuration described in Patent Document 1, the image displayed on the screen of the display device is switched by the driver's touch operation on the screen with his / her finger. In such a configuration, the driver cannot avoid moving his / her line of sight in order to check the information displayed on the screen and move his / her finger to the position where the touch operation is performed.

[0030] In the configuration according to this embodiment, the amount of eye movement of the driver to confirm the information displayed on the screen is suppressed by displaying a plurality of types of images to be switched in front of the driver's seat. In addition, a push switch 111 that accepts a pressing operation to switch the displayed image is disposed at a position away from the screen, so that eye movement for at least performing a touch operation is not required.

[0031] Furthermore, when a finger is touched to the push switch 111, the display device 22 displays a third image 223 that includes a part of the second image 222. This allows the driver to check the content of the second image 222 that is displayed next by pressing the push switch 111 without taking his / her eyes off the front of the driver's seat. As a result, the driver's line of sight movement can be further suppressed.

[0032] In particular, the third image 223 according to this example has an appearance in which the reduced second image 222 is superimposed on the first image 221, so that the information provided by the first image 221 continues. Therefore, it is suitable for temporarily checking the contents of the second image 222.

[0033] 6, a third image 223 having the same area as the second image 222 may be displayed. However, the appearance of the third image 223 is different from that of the second image 222. For example, the difference in appearance can be realized by changing the color of at least a part of the background or by making at least a part of the background blink. With this configuration, it is possible to enhance the visibility of the content of the second image 222 that is displayed next by pressing the push switch 111, while emphasizing that the third image 223 is for temporary confirmation.

[0034] 1, the user interface system 10 may include a user interface 13. The user interface 13 is disposed at an appropriate location in the vehicle interior 21. The user interface 13 is configured to receive an instruction specifying the size of the reduced second image 222 included in the third image 223. The user interface 13 outputs an instruction signal IS corresponding to the instruction. The instruction signal IS may be an analog signal or a digital signal depending on the specifications of the user interface 13.

[0035] The instruction signal IS is received by the input interface 121 of the control device 12. The processor 122 is configured to output, from the output interface 123, a display control signal DC that changes the size of the reduced second image 222 included in the third image 223, based on the instruction signal IS.

[0036] According to such a configuration, the contents of second image 222 that will be displayed next by pressing push switch 111 can be confirmed in a size preferred by each driver, so that the convenience of user interface system 10 can be improved.

[0037] The operation of touching push switch 111 with a finger is a preliminary operation for pressing push switch 111. In this case, it is possible to achieve a smooth transition from the operation for checking the content of second image 222, which will be displayed next by pressing push switch 111, to the operation for actually displaying second image 222. It is also easy to cancel the pressing operation when it is determined that switching of the display is not necessary as a result of checking the content.

[0038] 1, the user interface system 10 may include a notification device 14. The notification device 14 is installed at an appropriate position in the cabin 21 of the vehicle 20, and is configured to be capable of performing at least one of an auditory notification and a tactile notification. In this case, the processor 122 of the control device 12 outputs, from the output interface 123, a notification control signal NC that causes the notification device 14 to perform at least one of an auditory notification and a tactile notification while the display device 22 displays the third image 223. The notification control signal NC may be an analog signal or a digital signal depending on the specifications of the notification device 14.

[0039] According to such a configuration, it is possible to give a stronger impression to the driver that switching to the second image 222 has not been executed while the third image 223 is being displayed. This makes it possible to suppress the driver's line of sight movement while making it difficult for erroneous operations of the input device 11 to occur.

[0040] 2, the push switch 111 is disposed to the left of the rotation axis A of the steering wheel 23. The input device 11 may further include a push switch 112. The push switch 112 is disposed to the right of the rotation axis A of the steering wheel 23.

[0041] When the driver presses the push switch 112, the display device 22 displays a second image 222' that is different from the second image 222 that is displayed by pressing the push switch 111, as illustrated in FIG.

[0042] Similar to the push switch 111, when an operation of touching the push switch 112 with a finger is detected, a third image 223' as shown in Fig. 8 is displayed. The third image 223' includes a reduced version of the second image 222' as a part thereof.

[0043] Specifically, the processor 122 of the control device 12 outputs the display control signal DC from the output interface 123 so that the reduced second image 222' is positioned to the right of the center in the horizontal direction of the third image 223'.

[0044] On the other hand, as illustrated in FIG. 5, the processor 122 of the control device 12 outputs a display control signal DC from the output interface 123 so that the reduced second image 222, which is displayed based on the driver's finger touching the push switch 111, is positioned to the left of the center in the left-right direction of the third image 223.

[0045] According to such a configuration, particularly in a case where push switches for switching the image displayed by the display device 22 are provided on the left and right of the rotation axis A of the steering wheel 23, it becomes easier for the driver to understand the relationship between the push switch to be pressed and the image that is next displayed as a result of that pressing operation.

[0046] The processor 122 of the control device 12 having the various functions described above can be realized by a dedicated integrated circuit such as a microcontroller, ASIC, FPGA, etc., including a storage element in which a computer program for implementing the functions is preinstalled. In this case, the storage element is an example of a non-transitory computer-readable medium in which a computer program is stored.

[0047] Alternatively, the processor 122 may be realized by a general-purpose microprocessor that operates in cooperation with a general-purpose memory. Examples of the general-purpose microprocessor include a CPU, an MPU, and a GPU. Examples of the general-purpose memory include a ROM and a RAM. In this case, a computer program for realizing the function may be stored in the ROM. The general-purpose microprocessor specifies at least a part of the program stored in the ROM, expands it on the RAM, and executes the above-mentioned process in cooperation with the RAM. In this case, the general-purpose memory is an example of a non-transitory computer-readable medium in which a computer program is stored.

[0048] The processor 122 may be implemented by a combination of a general purpose microprocessor and a dedicated integrated circuit.

[0049] The configurations described above are merely examples for facilitating understanding of the present disclosure. Each configuration example may be appropriately modified and combined with other configuration examples without departing from the spirit of the present disclosure.

[0050] In the above embodiment, each time the push switch 111 is pressed, the image displayed by the display device 22 is switched between the first image 221 and the second image 222. However, the number of images switched and displayed by pressing the push switch 111 may be three or more. In that case, the third image 223 displayed by the display device 22 in response to the operation of touching the push switch 111 with a finger includes, as the second image 222, the image to be displayed next by pressing the push switch 111.

[0051] In the above embodiment, the operation of displaying the third image 223 on the display device 22 is detected based on a change in capacitance caused by the driver's finger touching the push switch. However, the operation may be detected based on a change in pressure or temperature caused by the touch of the driver's finger. Alternatively, the touch of the driver's finger on the push switch may be detected by an imaging device.

[0052] In the above embodiment, a push switch receives an operation to switch the image displayed by the display device 22. However, the configuration of the input device 11 for receiving the operation may be changed as appropriate. For example, a lever switch, a slide switch, a dial switch, or the like may be adopted. The mode of the operation for displaying the third image 223 may be determined as appropriate according to the mode of the switch adopted, so long as it is different from the operation for displaying the second image 222. For example, in a configuration in which the second image 222 is displayed by displacing the switch in a specific direction, the third image 223 may be displayed by displacing the switch in the opposite direction.

[0053] In the above embodiment, the input device 11 is installed on the steering wheel 23 of the vehicle 20. With this configuration, the input device 11 is located in front of the driver's seat, similar to the display device 22, so that the amount of eye movement of the driver can be further reduced. However, the input device 11 may be disposed in an appropriate location in the vehicle interior 21 away from the display device 22. Examples of such a location include the armrest of the driver's seat, near the shift lever, etc.

[0054] In the above embodiment, the display device 22 constitutes a part of the meter panel of the vehicle 20. However, the display device 22 may be configured as a head-up display device that projects the above-mentioned various screens in front of the driver's seat on a windshield 24 of the vehicle 20, as illustrated in FIG.

[0055] The user interface system 10 may be mounted on a moving object other than the vehicle 20. Examples of such moving objects include trains, airplanes, ships, and the like.

[0056] Each of the configurations listed below also constitutes part of this disclosure. Item 1: A user interface system mounted on a vehicle having a driver's seat, an input device disposed in front of the driver's seat and away from a display device capable of displaying an image; a control device that switches the image to be displayed from a first image to a second image when the input device receives a first operation; Equipped with When the input device receives a second operation different from the first operation, the control device causes the display device to display a third image that includes at least a part of the second image and has an appearance different from that of the second image. User interface system. Item 2: The third image has an appearance in which the reduced second image is superimposed on the first image. Item 1. A user interface system according to item 1. Item 3: The control device is capable of accepting an instruction to specify a size of the reduced second image included in the third image. Item 2. A user interface system according to item 2. Item 4: the input device is installed in a steering device of the moving body that is rotatable around an axis, When the input device is installed to the left of the axis, the control device disposes the reduced second image to the left of the center in the left-right direction of the third image, When the input device is installed to the right of the axis, the control device disposes the reduced second image to the right of the center in the left-right direction of the third image. Item 2. A user interface system according to item 2 or 3. Item 5: The second operation is a preliminary operation of the first operation. 5. A user interface system according to any one of items 1 to 4. Item 6: The device is provided with a notification device capable of performing at least one of an audio notification and a tactile notification, The control device causes the notification device to perform at least one of the audible notification and the tactile notification while the third image is being displayed. 6. A user interface system according to any one of items 1 to 5. [Explanation of symbols]

[0057] 10: user interface system, 11: input device, 12: control device, 121: input interface, 122: processor, 14: notification device, 20: vehicle, 22: display device, 221: first image, 222, 222': second image, 223, 223': third image, 23: steering wheel, S1: first operation signal, S2: second operation signal

Claims

1. A user interface system mounted on a vehicle having a driver's seat, an input device disposed in front of the driver's seat and away from a display device capable of displaying an image; a control device that switches the image to be displayed from a first image to a second image when the input device receives a first operation; Equipped with When the input device receives a second operation different from the first operation, the control device causes the display device to display a third image that includes at least a part of the second image and has an appearance different from that of the second image. User interface system.

2. The third image has an appearance in which the reduced second image is superimposed on the first image. The user interface system of claim 1 .

3. The control device is capable of accepting an instruction to specify a size of the reduced second image included in the third image. The user interface system of claim 2 .

4. the input device is installed in a steering device of the moving body that is rotatable around an axis, When the input device is installed to the left of the axis, the control device disposes the reduced second image to the left of the center in the left-right direction of the third image, When the input device is installed to the right of the axis, the control device disposes the reduced second image to the right of the center in the left-right direction of the third image. The user interface system of claim 2 .

5. The second operation is a preliminary operation of the first operation. The user interface system of claim 1 .

6. A notification device capable of performing at least one of an audio notification and a tactile notification is provided, The control device causes the notification device to perform at least one of the audible notification and the tactile notification while the third image is being displayed. The user interface system of claim 1 .

7. A control device mounted on a moving body having a driver's seat, an interface that receives a first operation signal indicating that an input device that is disposed in front of the driver's seat and away from a display device capable of displaying an image has received a first operation for switching the image; a processor for switching the displayed image from a first image to a second image based on the first operation signal; Equipped with When the interface receives a second operation signal indicating that the input device has received a second operation different from the first operation, the processor causes the display device to display a third image that includes at least a part of the second image and has an appearance different from that of the second image. Control device.

8. A computer program executable by a processor of a control device mounted on a vehicle having a driver's seat, By being executed, the control device receiving a first operation signal indicating that an input device disposed away from a display device capable of displaying an image in front of the driver's seat has received a first operation for switching the image; switching the image to be displayed from a first image to a second image based on the first operation signal; when the input device receives a second operation signal indicating that a second operation different from the first operation has been received, a third image including at least a part of the second image and having an appearance different from that of the second image is displayed on the display device; Computer program.

Citation Information

Patent Citations

  • On-vehicle touch panel device

    JP2016126556A