User interface system, control apparatus, and computer program
The user interface system improves convenience by allowing operation settings to be confirmed and changed through separate input devices, eliminating the need for direct device operation and utilizing a general-purpose display for multiple device information.
Patent Information
- Application Number
- JP2023080789
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-16
- Publication Date
- 2024-11-28
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing user interface systems that display information related to multiple types of controlled devices lack convenience in confirming and changing operation settings without requiring direct operation of the controlled devices.
A user interface system with a display device and a control device that allows operation settings to be confirmed and changed through separate input devices, displaying images indicating settings based on different operations, thereby eliminating the need for direct device operation and utilizing a general-purpose display for multiple device information.
Enhances user convenience by allowing operation settings to be confirmed and changed without operating the controlled devices, reducing unnecessary operations and providing a dedicated device-free interface for multiple device information display.
Smart Images

Figure 2024164995000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a user interface system using a display device capable of displaying information related to a plurality of types of controlled devices. The present disclosure also relates to a control device that can be installed in the system, and a computer program executable by a processor installed in the control device. [Background technology]
[0002] Patent Document 1 discloses a display device mounted on a vehicle as an example of a moving object. The display device displays information related to a plurality of types of controlled devices mounted on the vehicle. The display device includes a touch panel device capable of receiving touch operations by an occupant of the vehicle. The occupant can control the operation of each controlled device or change settings through touch operations. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2016-126556 A Summary of the Invention [Problem to be solved by the invention]
[0004] There is a demand for improving the convenience of a user interface system that uses a display device capable of displaying information related to a plurality of types of controlled devices. [Means for solving the problem]
[0005] One example aspect provided by the present disclosure is a user interface system, comprising: An input device that is disposed apart from a display device capable of displaying information related to a plurality of types of controlled devices and that receives a first operation for controlling an operation of a first controlled device included in the plurality of types of controlled devices; a control device that, when the input device receives a second operation different from the first operation, causes the display device to display a first image indicating an operation setting of the first controlled device; It is equipped with:
[0006] One example aspect provided by the present disclosure is a control device, comprising: an interface that is disposed away from a display device capable of displaying information related to a plurality of types of controlled devices, and receives an operation signal based on a second operation different from a first operation from an input device that receives a first operation for controlling an operation of a first controlled device included in the plurality of types of controlled devices; A processor that displays a first image indicating an operation setting of the first controlled device on the display device based on the operation signal; It is equipped with:
[0007] One example aspect provided by the present disclosure is a computer program executable by a processor of a control device, the computer program comprising: By being executed, the control device receiving an operation signal based on a second operation different from a first operation from an input device that is disposed away from a display device capable of displaying information related to a plurality of types of controlled devices and that receives a first operation for controlling an operation of a first controlled device included in the plurality of types of controlled devices; A first image indicating an operation setting of the first controlled device is displayed on the display device based on the operation signal.
[0008] According to the configurations of the above-mentioned embodiments, the operation settings of the first controlled device can be confirmed through the first image displayed on the display device by performing a second operation on an input device located away from the display device. Since the second operation is different from the first operation for controlling the operation of the first controlled device, it is not necessary to operate the first controlled device to confirm the operation settings. In addition, since the first image is displayed on a general-purpose display device that can also display information related to other controlled devices, it is not necessary to provide a dedicated device for notifying the operation settings. Therefore, it is possible to improve the convenience of a user interface system that uses a display device that can display information related to multiple types of controlled devices. [Brief description of the drawings]
[0009] [Figure 1] 1 illustrates an example of a configuration of a user interface system according to an embodiment. [Diagram 2] 2 illustrates a vehicle in which the user interface system of FIG. 1 is installed. [Diagram 3] 2 shows an example of a screen displayed on the display device of FIG. 1. [Figure 4] 10 shows another example of the screen displayed on the display device of FIG. [Diagram 5] 10 shows another example of the screen displayed on the display device of FIG. [Figure 6] 2 shows another example of the screen displayed on the display device of FIG. 1. [Figure 7] 2 shows another example of the screen displayed on the display device of FIG. 1. [Figure 8] 10 shows another example of the screen displayed on the display device of FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment will be described in detail below with reference to the accompanying drawings. In each of the drawings used in the following description, the scale is appropriately changed so that each element can be clearly seen.
[0011] Fig. 1 illustrates a functional configuration of a user interface system 10 according to an embodiment. The user interface system 10 according to this example is configured to be mounted on a vehicle 20 illustrated in Fig. 2. The vehicle 20 is an example of a moving object.
[0012] A display device 22 is installed in a passenger compartment 21 of the vehicle 20. The display device 22 is disposed in a center cluster 23 of the vehicle 20. The display device 22 is configured to be able to display information related to a plurality of types of controlled devices mounted on the vehicle 20.
[0013] As illustrated in FIG. 1, the user interface system 10 includes an input device 11. The input device 11 includes a wiper switch 111. As illustrated in FIG. 2, the wiper switch 111 is disposed away from the display device 22. The wiper switch 111 has the form of a lever switch. The wiper switch 111 is configured to control the operation of a wiper mounted on the vehicle 20 by being displaced in the vertical direction of the vehicle 20. The wiper is an example of a first controlled device. The operation of displacing the wiper switch 111 is an example of a first operation.
[0014] 1, the input device 11 is configured to output a first operation signal S1 when the wiper switch 111 is displaced by the driver of the vehicle 20. The first operation signal S1 may be an analog signal or a digital signal depending on the specifications of the wiper switch 111.
[0015] The user interface system 10 includes a controller 12. The controller 12 includes an input interface 121, a processor 122, and an output interface 123.
[0016] The input interface 121 is configured as a hardware interface that accepts the first operation signal S1. When the first operation signal S1 is an analog signal, the input interface 121 includes an appropriate conversion circuit including an A / D converter. This description is similarly applied to other signals that can be accepted by the input interface 121, which will be described later.
[0017] The processor 122 is configured to output a control signal CT, which causes a controlled device (here, the wiper 24) mounted on the vehicle 20 to perform an operation based on the first operation signal S1, from an output interface 123 configured as a hardware interface. The control signal CT may be an analog signal or a digital signal depending on the specifications of the controlled device.
[0018] When the control signal CT is an analog signal, the output interface 123 includes an appropriate conversion circuit including a D / A converter. This description is similarly applied to other signals that can be output from the output interface 123, which will be described later.
[0019] The input device 11 according to this example includes a detection device that detects a change in capacitance caused by the driver's finger touching the wiper switch 111. The operation of touching the wiper switch 111 with a finger is an example of a second operation. The input device 11 is configured to output a second operation signal S2 corresponding to the change in capacitance caused by the touch of the finger. The second operation signal S2 may be an analog signal or a digital signal depending on the specifications of the detection device.
[0020] The processor 122 is configured to output, when the second operation signal S2 is accepted by the input interface 121, from the output interface 123, a display control signal DC for causing the display device 22 to display a setting notification image SN as exemplified in FIG.
[0021] The setting notification image SN is configured to notify the driver of the operation setting of the wiper 24. In this example, the driver is notified that the wiper 24 is set to automatic operation. The automatic operation is a setting in which the operation interval of the wiper 24 is automatically adjusted according to the vehicle speed of the vehicle 20, etc. The setting notification image is an example of a first image.
[0022] In this example, an image M providing information related to the music playback device is also displayed on the display device 22. In other words, the setting notification image SN shares the display device 22 with images providing information related to other controlled devices mounted on the vehicle 20. The music playback device is an example of a second controlled device.
[0023] According to this configuration, by touching the wiper switch 111 located away from the display device 22, the operation setting of the wiper 24 can be confirmed through the setting notification image SN displayed on the display device 22. This operation is different from the operation of controlling the operation of the wiper 24, so there is no need to operate the wiper 24 to confirm the operation setting. In addition, since the setting notification image SN is displayed on the general-purpose display device 22 that can also display information related to other controlled devices, there is no need to provide a dedicated device for notifying the operation setting. Therefore, the convenience of the user interface system 10 that uses the display device 22 that can display information related to a plurality of types of controlled devices can be improved.
[0024] 1, the display device 22 is configured to include a touch panel device 221. The touch panel device 221 is configured to output a detection signal DT corresponding to a change in capacitance caused by a finger of an occupant of the vehicle 20 touching or approaching a detection surface. The detection signal DT may be an analog signal or a digital signal depending on the specifications of the touch panel device 221.
[0025] The processor 122 is configured to output, from the output interface 123, a display control signal DC that changes the screen displayed on the display device 22 in response to a touch operation corresponding to the detection signal DT.
[0026] In the example shown in Fig. 3, the setting notification image SN is put into a selected state by a touch operation on the setting notification image SN. The operation of putting the setting notification image SN into a selected state is an example of a third operation. Based on a detection signal DT indicating that the setting notification image SN has been selected, the processor 122 outputs a display control signal DC, which causes the display device 22 to display a wiper setting screen WS exemplified in Fig. 4, from the output interface 123.
[0027] The wiper setting screen WS includes a plurality of button images for accepting an operation to change the operation setting of the wiper 24. As described with reference to Fig. 3, in this example, the wiper 24 is set to perform automatic operation, so the button image for enabling the automatic operation is in a selected state. For example, if the occupant desires to set the wiper 24 to perform continuous operation at a low speed, a push operation is performed on the button image marked "LO" as shown in Fig. 4. The wiper setting screen WS is an example of a first setting screen.
[0028] The operation for selecting a specific image displayed on the display device 22 is not limited to a touch operation on the touch panel device 221. The detection signal DT described above may be output through an appropriate input device installed in the vehicle interior 21 independently of the display device 22. Examples of such an input device include a mechanical button switch, lever switch, and a touch pad device.
[0029] According to the configuration of this embodiment, the current operation settings of the wiper 24 can be confirmed by touching the wiper switch 111 before displaying the wiper setting screen WS on which the operation settings of the wiper 24 can be changed. Since the wiper setting screen WS needs to be displayed only when it is determined that a setting change is necessary, unnecessary operations can be reduced. Therefore, the convenience of the user interface system 10 can be improved.
[0030] The operation of touching the wiper switch 111 is a preliminary operation for the operation of displacing the wiper switch 111. In this case, it is possible to achieve a smooth transition from the operation for checking the operation settings of the wiper 24 to the operation for controlling the operation of the wiper 24. It is also easy to stop the displacing operation when it is determined that the operation control of the wiper 24 is unnecessary as a result of checking the operation settings.
[0031] The processor 122 of the control device 12 can output, from the output interface 123, a display control signal DC that causes the display device 22 to display the portal icon image P illustrated in FIG.
[0032] In this case, when the input interface 121 receives a detection signal DT corresponding to the portal icon image P being in a selected state, the processor 122 outputs a display control signal DC for causing the display device 22 to display a general-purpose setting screen GS exemplified in Fig. 6 from the output interface 123. The portal icon image P is an example of a second image. The operation of putting the portal icon image P in a selected state is an example of a fourth operation.
[0033] The general setting screen GS is configured to allow operation settings of other controlled devices in addition to the wiper 24. FIG. 6 shows an example of a screen for setting the operation of a locking / unlocking device of the vehicle 20. The general setting screen GS includes a button image for selecting a controlled device to be the target of operation setting. FIG. 6 shows an example of a button image for selecting the wiper 24 and a button image for selecting a position adjustment device of the center console. The general setting screen GS is an example of a second setting screen. Each of the locking / unlocking device and the position adjustment device is an example of a second controlled device.
[0034] When an operation to select the wiper 24 as the target of the operation setting is performed on the general setting screen GS, a setting screen similar to the example shown in FIG. 4 is displayed, and the operation setting can be changed.
[0035] When the driver touches the wiper switch 111 while the portal icon image P is displayed, the second operation signal S2 is received by the input interface 121, and the processor 122 outputs a display control signal DC from the output interface 123 to change the portal icon image P to a setting notification image SN.
[0036] When the driver removes his / her finger from the wiper switch 111, the output of the second operation signal S2 from the input device 11 is stopped. When a predetermined time has elapsed since the input of the second operation signal S2 to the input interface 121 was stopped, the processor 122 outputs, from the output interface 123, a display control signal DC that returns the setting notification image SN to the portal icon image P.
[0037] That is, there are two ways to reach a state in which the operation setting of the wiper 24 can be performed. One is a method in which the portal icon image P displayed on the display device 22 is set to a selected state as described above, transitioning to the general setting screen GS, and then selecting the wiper 24 as a target for operation setting. The other is a method in which the wiper switch 111 is touched to cause the setting notification image SN to be displayed on the display device 22, and then the setting notification image SN is set to a selected state, as described with reference to FIG.
[0038] The latter allows a user to more quickly reach a state in which he or she can set the operation of the wiper 24. In other words, the setting notification image SN provides a shortcut path for setting the operation of the wiper 24.
[0039] 3 and 5, the setting notification image SN has a larger area than the portal icon image P. This makes it possible to emphasize that the operation settings are being notified while increasing the amount of information related to the operation settings provided for notification.
[0040] The processor 122 of the control device 12 having the various functions described above can be realized by a dedicated integrated circuit such as a microcontroller, ASIC, FPGA, etc., including a storage element in which a computer program for implementing the functions is preinstalled. In this case, the storage element is an example of a non-transitory computer-readable medium in which a computer program is stored.
[0041] Alternatively, the processor 122 may be realized by a general-purpose microprocessor that operates in cooperation with a general-purpose memory. Examples of the general-purpose microprocessor include a CPU, an MPU, and a GPU. Examples of the general-purpose memory include a ROM and a RAM. In this case, a computer program for realizing the function may be stored in the ROM. The general-purpose microprocessor specifies at least a part of the program stored in the ROM, expands it on the RAM, and executes the above-mentioned process in cooperation with the RAM. In this case, the general-purpose memory is an example of a non-transitory computer-readable medium in which a computer program is stored.
[0042] The processor 122 may be implemented by a combination of a general purpose microprocessor and a dedicated integrated circuit.
[0043] The configurations described above are merely examples for facilitating understanding of the present disclosure. Each configuration example may be appropriately modified and combined with other configuration examples without departing from the spirit of the present disclosure.
[0044] In the above embodiment, the setting notification image SN is displayed on the display device 22 so as to avoid the area in which information related to other controlled devices is displayed. With this configuration, the setting notification image SN, which is temporarily displayed based on the operation of touching the wiper switch 111, can be prevented from impairing the visibility of information related to other controlled devices displayed on the general-purpose display device 22. However, in consideration of the transience of the display, the display position of the setting notification image SN within the screen of the display device 22 can be appropriately determined. For example, it may be displayed in the central area of the display device 22 so as to overlap with information related to other controlled devices.
[0045] The controlled device for which the operation setting is notified by the setting notification image SN is not limited to the wiper 24. For example, a position adjustment device of the center console can be an example of the first controlled device.
[0046] 2, the input device 11 may further include a push switch 112. The push switch 112 may be installed on the steering wheel 25 of the vehicle 20.
[0047] The push switch 112 can be configured to be displaceable to indicate an upward, downward, leftward, or rightward direction. As illustrated in Fig. 1, the input device 11 is configured to output a third operation signal S3 when the push switch 112 is displaced by the driver of the vehicle 20. The third operation signal S3 may be an analog signal or a digital signal depending on the specifications of the push switch 112. The operation of displacing the push switch 112 is an example of a first operation.
[0048] The processor 122 of the control device 12 outputs, from the output interface 123, a control signal CT that causes the center console position adjustment device to perform an operation based on the third operation signal S3 received by the input interface 121. Specifically, when an operation that brings about a displacement indicating an upward, downward, leftward, or rightward direction is performed on the push switch 112, the control signal CT that causes the position adjustment device to displace the center console in the upward, downward, forward, or backward direction, respectively, is output from the output interface 123.
[0049] The input device 11 may also include a detection device that detects a change in capacitance caused by the driver's finger touching the push switch 112. The operation of touching the push switch 112 with a finger is an example of a second operation. The input device 11 is configured to output a fourth operation signal S4 corresponding to the change in capacitance caused by the touch of the finger. The fourth operation signal S4 may be an analog signal or a digital signal depending on the specifications of the detection device.
[0050] When the fourth operation signal S4 is received by the input interface 121, the processor 122 outputs, from the output interface 123, a display control signal DC for causing the display device 22 to display a setting notification image SN as exemplified in FIG.
[0051] In this example, the setting notification image SN notifies that the position of the center console is set to "personal setting 1." When an occupant of the vehicle 20 performs an operation to select the setting notification image SN, the processor 122 outputs, from the output interface 123, a display control signal DC for causing the display device 22 to display a console setting screen CS exemplified in FIG.
[0052] The console setting screen CS according to this example includes a plurality of button images for accepting an operation to change the position of the center console, a button image for enabling an automatic position adjustment function, and a button image for registering personal settings. The console setting screen CS is an example of a first setting screen.
[0053] In the above embodiment, the operation of displaying the setting notification image SN on the display device 22 is detected based on a change in capacitance caused by the driver's finger touching the switch. However, the operation may be detected based on a change in pressure or temperature caused by the touch of the driver's finger. Alternatively, the touch of the finger on the switch may be detected by an imaging device.
[0054] The operation of displaying the setting notification image SN on the display device 22 is not limited to the operation of touching a switch. The operation of displaying the setting notification image SN on the display device 22 can be appropriately determined according to the type of the switch employed, as long as it is different from the operation for controlling the operation of the controlled device associated with the switch. For example, in a configuration in which the operation of the controlled device is controlled by displacing the switch in a specific direction, the setting notification image SN can be displayed by displacing the switch in the opposite direction to the specific direction.
[0055] In the above embodiment, the display device 22 is disposed in the center cluster 23 of the vehicle 20. That is, the setting notification image SN is displayed between the driver's seat and the passenger seat in the left-right direction of the vehicle 20. According to such a configuration, not only the driver but also a passenger sitting in the passenger seat can change the operation settings of the controlled device by selecting the setting notification image SN, so that the convenience of the user interface system 10 can be further improved.
[0056] The user interface system 10 may be installed in a moving object other than the vehicle 20. Examples of such moving objects include trains, airplanes, and ships. The moving object may not require a driver. The moving object may have only one seat for passengers to sit on.
[0057] The user interface system 10 does not necessarily have to be mounted on a mobile object. The user interface system 10 can be configured as a system that allows operation control and change of operation settings of appropriate controlled devices installed in a home or facility.
[0058] Each of the configurations listed below also constitutes part of this disclosure. Item 1: An input device that is disposed apart from a display device capable of displaying information related to a plurality of types of controlled devices and that receives a first operation for controlling an operation of a first controlled device included in the plurality of types of controlled devices; a control device that, when the input device receives a second operation different from the first operation, causes the display device to display a first image indicating an operation setting of the first controlled device; Equipped with User interface system. Item 2: the control device causes the display device to display a first setting screen for changing the operation setting based on a third operation of selecting the first image. Item 1. A user interface system according to item 1. Item 3: The control device changes the second image displayed on the display device to the first image based on the second operation, and displays on the display device a second setting screen that can change settings of a second controlled device included in the plurality of controlled devices in addition to the first controlled device based on a fourth operation of selecting the second image. Item 2. A user interface system according to item 2. Item 4: The first image has a larger area than the second image. Item 3. A user interface system according to item 3. Item 5: The control device displays the first image on the display device so as to avoid an area in which information related to a second controlled device included in the plurality of types of controlled devices is displayed. 5. A user interface system according to any one of items 1 to 4. Item 6: The second operation is a preliminary operation of the first operation. 6. A user interface system according to any one of items 1 to 5. Item 7: Configured to be mounted on a moving object, 7. A user interface system according to any one of items 1 to 6. Item 8: The moving body is a vehicle equipped with a driver's seat and a passenger seat, The first image is displayed between a driver's seat and a passenger seat in the left-right direction of the vehicle. 8. The user interface system according to item 7. [Explanation of symbols]
[0059] 10: user interface system, 11: input device, 12: control device, 121: input interface, 122: processor, 20: vehicle, 22: display device, 23: center cluster, 24: wiper, CS: console setting screen, GS: general setting screen, P: portal icon image, S2: second operation signal, S4: fourth operation signal, SN: setting notification image, WS: wiper setting screen
Claims
1. An input device that is disposed apart from a display device capable of displaying information related to a plurality of types of controlled devices and that receives a first operation for controlling an operation of a first controlled device included in the plurality of types of controlled devices; a control device that, when the input device receives a second operation different from the first operation, causes the display device to display a first image indicating an operation setting of the first controlled device; Equipped with User interface system.
2. the control device causes the display device to display a first setting screen for changing the operation setting, based on a third operation of selecting the first image. The user interface system of claim 1 .
3. The control device changes the second image displayed on the display device to the first image based on the second operation, and displays on the display device a second setting screen that can change settings of a second controlled device included in the plurality of controlled devices in addition to the first controlled device based on a fourth operation of selecting the second image. The user interface system of claim 2 .
4. The first image has a larger area than the second image. The user interface system of claim 3 .
5. The control device displays the first image on the display device so as to avoid an area in which information related to a second controlled device included in the plurality of types of controlled devices is displayed. The user interface system of claim 1 .
6. The second operation is a preliminary operation of the first operation. The user interface system of claim 1 .
7. Configured to be mounted on a moving object, The user interface system of claim 1 .
8. The moving body is a vehicle equipped with a driver's seat and a passenger seat, The first image is displayed between a driver's seat and a passenger seat in the left-right direction of the vehicle. The user interface system of claim 7.
9. an interface that is disposed away from a display device capable of displaying information related to a plurality of types of controlled devices, and receives an operation signal based on a second operation different from a first operation from an input device that receives a first operation for controlling an operation of a first controlled device included in the plurality of types of controlled devices; A processor that displays a first image indicating an operation setting of the first controlled device on the display device based on the operation signal; Equipped with Control device.
10. A computer program executable by a processor of a control device, By being executed, the control device receiving an operation signal based on a second operation different from a first operation from an input device that is disposed away from a display device capable of displaying information related to a plurality of types of controlled devices and that receives a first operation for controlling an operation of a first controlled device included in the plurality of types of controlled devices; displaying a first image indicating an operation setting of the first controlled device on the display device based on the operation signal; Computer program.
Citation Information
Patent Citations
On-vehicle touch panel device
JP2016126556A
