Steering device, control device, and computer program
The control device and processor system in the steering device manage GUI presentation to ensure earlier inquiries are responded to before displaying subsequent ones, reducing confusion and improving convenience by prioritizing and simplifying GUIs for quick decision-making.
Patent Information
- Application Number
- JP2022191680
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-11-30
- Publication Date
- 2025-11-06
- Estimated Expiration
- 2042-11-30
AI Technical Summary
Existing steering devices with display devices for user input lack convenience due to potential user confusion when multiple inquiries are made simultaneously, as they do not effectively manage the presentation of GUIs related to subsequent inquiries until earlier inquiries are responded to.
A control device and processor system that manages the display of GUIs on a steering member by ensuring that a response to a first inquiry is made before displaying a GUI for a second inquiry, preventing user confusion by prioritizing earlier inquiries and optionally using simpler GUIs for quick decision-making.
This approach reduces user confusion and facilitates reliable responses by ensuring earlier inquiries are addressed before subsequent GUIs are presented, enhancing the convenience of the steering device with limited display space.
Smart Images

Figure 0007765374000001 
Figure 0007765374000002 
Figure 0007765374000003
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to a steering device mounted on a moving body. The present disclosure also relates to a control device mounted on the moving body and a computer program executable by a processor mounted on the control device. [Background technology]
[0002] Patent Document 1 discloses a steering device mounted on a vehicle, which is an example of a moving body. In this steering device, a display device is installed on a steering member that changes the traveling direction of the vehicle. The display device displays a GUI (Graphical User Interface) for receiving instructions from a user. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] International Publication No. 2020 / 179361 Summary of the Invention [Problem to be solved by the invention]
[0004] There is a demand for improving the convenience of a steering device that is equipped with a display device that displays a GUI for receiving instructions from a user. [Means for solving the problem]
[0005] One aspect provided by the present disclosure is a steering device mounted on a moving body, comprising: a steering member for changing the direction of travel of the moving body; a display device installed on the steering member; a control device that causes the display device to display a first GUI that accepts a first response to a first inquiry that occurs in accordance with a state of the moving object; It is equipped with If a second inquiry occurs in response to the state of the moving body while the first GUI is being displayed, the control device causes the display device to display a second GUI that accepts a second response to the second inquiry after the first GUI accepts the first response.
[0006] One aspect provided by the present disclosure is a control device mounted on a moving body, comprising: an interface that receives a first signal indicating that a first inquiry has occurred in response to a state of the moving object; a processor that, in response to the first signal, displays a first GUI that accepts a first response to the first inquiry on a display device that is installed on a steering member that changes the traveling direction of the moving object; It is equipped with If the interface receives a second signal indicating that a second query has occurred in response to the state of the moving body while the first GUI is being displayed, the processor causes the display device to display a second GUI that accepts a second response to the second query after the first GUI accepts the first response.
[0007] One aspect provided by the present disclosure is a computer program executable by a processor installed in a control device, By being executed, the control device receiving a first signal indicating that a first inquiry has occurred in response to a state of a moving body in which the control device is installed; displaying a first GUI for receiving a first response to the first inquiry on a display device provided on a steering member for changing a traveling direction of the moving body in response to the first signal; If a second signal indicating that a second inquiry has occurred in accordance with the state of the moving body is received while the first GUI is being displayed, after the first GUI has received the first response, a second GUI for accepting a second response to the second inquiry is displayed on the display device.
[0008] According to the configurations of the above aspects, when multiple conflicting inquiries are made to a user, it is possible to prevent a GUI related to a subsequently made inquiry from being presented to the user until a response is made to an earlier made inquiry. This makes it possible to suppress user confusion and facilitate the acquisition of a reliable response to an inquiry, even when using a display device that is installed on a steering member and therefore has a limited space for presenting information. Therefore, it is possible to improve the convenience of a steering device equipped with a display device that displays a GUI for receiving instructions from a user. [Brief explanation of the drawings]
[0009] [Figure 1] 1 illustrates a vehicle equipped with a steering device according to an embodiment. [Figure 2] 2 illustrates an example of a functional configuration of the steering device of FIG. 1; [Figure 3] 3 illustrates an example of a flow of processing executed by the control device of FIG. 2. [Figure 4] 2 shows an example of a GUI displayed on the display device of FIG. 1. [Figure 5] FIG. 1 shows another example of a GUI displayed on a display device. DETAILED DESCRIPTION OF THE INVENTION
[0010] The following detailed description of exemplary embodiments will be given with reference to the accompanying drawings. In the drawings used in the following description, the scale has been changed appropriately so that each element can be clearly seen.
[0011] 1 illustrates an example of a cabin of a vehicle 20 equipped with a steering device 10 according to one embodiment. The steering device 10 includes a steering member 11 for changing the traveling direction of the vehicle 20. The vehicle 20 is an example of a moving body.
[0012] The steering device 10 is equipped with a display device 12. The display device 12 is installed on the steering member 11. In this embodiment, the display device 12 is a general-purpose display device that can display various images.
[0013] As illustrated in FIG. 2, the display device 12 includes a user interface 121. In this embodiment, the display device 12 is configured as an electrostatic or pressure-sensitive touch panel display. In this case, the user interface 121 is realized as a GUI displayed on the display device 12. A user can input instructions by bringing their fingers close to or in contact with the GUI. Therefore, the display device 12 is disposed in a position that allows instructions to be input by the fingers of a user holding the steering member 11.
[0014] The display device 12 is configured to output a response signal RS corresponding to an instruction input to the user interface 121. The response signal RS may be an analog signal or a digital signal depending on the specifications of the display device 12.
[0015] The steering device 10 includes a control device 13. The control device 13 includes an input interface 131. The input interface 131 is configured as a hardware interface that receives the response signal RS. When the response signal RS is an analog signal, the input interface 131 includes an appropriate conversion circuit including an A / D converter.
[0016] The input interface 131 is configured to be able to receive a status signal ST from at least one vehicle control device 21 mounted on the vehicle 20. The vehicle control device 21 is a device that controls the driving state of the vehicle 20, the driving environment of the vehicle 20, the interior environment of the vehicle 20, and communication between the vehicle 20 and external devices. The status signal ST includes information corresponding to the state of the controlled object grasped by the vehicle control device 21. Note that the status signal ST may be input from a sensor mounted on the vehicle 20 to detect specific information without passing through the vehicle control device 21. In this case, the status signal ST includes the specific information detected by the sensor.
[0017] The status signal ST may be an analog signal or a digital signal depending on the specifications of the vehicle control device 21 and the sensor. When the status signal ST is an analog signal, the input interface 131 includes an appropriate conversion circuit including an A / D converter.
[0018] The control device 13 includes a processor 132. The processor 132 is configured to generate a query based on the status signal ST. The query includes a question or a suggestion that requests a user to make a decision on a specific matter. Examples of queries include confirmation of whether to enable or disable a driving assistance function, confirmation of whether to change lanes based on the driving assistance function, confirmation of whether to answer an incoming phone call, a suggestion to change the air conditioning conditions, a suggestion of audiovisual content to be played, etc.
[0019] The control device 13 includes an output interface 133. The processor 132 is configured to output an inquiry signal IQ from the output interface 133 for presenting the generated inquiry to the user. The inquiry can be presented to the user by a combination of a sound output through a speaker (not shown) and a GUI displayed on the display device 12. The GUI includes at least an image for receiving an input of a response to the inquiry.
[0020] For example, when an inquiry is made to confirm whether or not the driving assistance function needs to be enabled, the inquiry signal IQ includes data for outputting a voice message from the speaker saying, "Do you want to enable the assist function?" and data for displaying on the display device 12 a GUI (user interface 121) for accepting the need for a change as a response.
[0021] The inquiry signal IQ may be an analog signal or a digital signal depending on the specifications of the speaker and the display device 12. The output interface 133 is configured as a hardware interface. When the inquiry signal IQ is an analog signal, the output interface 133 includes an appropriate conversion circuit including a D / A converter.
[0022] Depending on the situation in which the vehicle 20 is placed or the state of the vehicle 20, a second query may occur based on another status signal ST before a response to a first query generated based on another status signal ST is completed. When a second query occurs while a GUI (first GUI) for accepting a response to the first query (first response) is being displayed, the processor 132 is configured to cause the display device 12 to display a GUI (second GUI) for accepting a response to the second query (second response) after the first GUI accepts the first response.
[0023] The flow of processing executed by the processor 132 configured as above will be specifically described with reference to FIG.
[0024] Processor 132 determines whether a first inquiry to the occupant has occurred (STEP 1) based on status signal ST received by input interface 131. This process is repeated until it is determined that the first inquiry has occurred (NO in STEP 1).
[0025] An example of the first inquiry is a case where it becomes necessary to confirm whether or not a lane change is necessary in vehicle 20 in which the driving assistance function is enabled. When it is determined that the first inquiry has occurred (YES in STEP 1), processor 132 outputs an inquiry signal IQ from output interface 133, which causes display device 12 to display a first GUI for receiving a response to the first inquiry (STEP 2).
[0026] This inquiry signal IQ includes data for outputting the voice "Do you want to change lanes?" from the speaker and data for displaying a first GUI on the display device 12 to receive a response as to whether or not a change is required.
[0027] 4 illustrates an example of a first GUI (user interface 121) displayed on the display device 12. The first GUI includes a button image B1 for accepting a positive response and a button image B2 for accepting a negative response.
[0028] The user responds to the first inquiry by touching or bringing a finger close to either button image B1 or button image B2, and display device 12 outputs a response signal RS in response to the response.
[0029] 3, the processor 132 determines whether a second inquiry to the occupant has occurred based on the status signal ST received by the input interface 131 (STEP 3). This process is repeated until it is determined that a second inquiry has occurred (NO in STEP 3).
[0030] An example of the second inquiry is when it becomes necessary to confirm whether or not to answer an incoming call. When it is determined that the second inquiry has occurred (YES in STEP 3), processor 132 determines whether a response to the first inquiry has been received (STEP 4).
[0031] The processor 132 makes this determination based on whether the input interface 131 receives a response signal RS corresponding to the response made to the first GUI after an inquiry signal IQ that causes the first GUI to be displayed on the display device 12 is output from the output interface 133.
[0032] This process is repeated until it is determined that a response to the first inquiry has been received (NO in STEP 4).
[0033] When it is determined that a response to the first inquiry has been received (YES in STEP 4), the processor 132 outputs an inquiry signal IQ from the output interface 133, which causes the display device 12 to display a second GUI for receiving a response to the second inquiry (STEP 5).
[0034] This inquiry signal IQ includes data for outputting the voice "Incoming call. Would you like to answer the call?" from the speaker, and data for displaying a second GUI on the display device 12 to accept as a response whether or not to answer the call.
[0035] 5 illustrates a second GUI (user interface 121) displayed on the display device 12. The second GUI includes a button image B3 for receiving a response indicating an intention to allow the call, a button image B4 for receiving a response indicating an intention to reject the call, and a slider image B5 for adjusting the call volume.
[0036] The user responds to the second inquiry by touching or approaching either button image B3 or button image B4 with their finger. The display device 12 outputs a response signal RS in response to the response. The user can adjust the call volume by displacing the slider image B5 with their finger as needed.
[0037] In this embodiment, no priority is set among the various items that are the subject of inquiries. For example, if an inquiry about whether to answer an incoming call occurs before an inquiry about whether to change lanes, a GUI for receiving a response to the inquiry about whether to answer the call is displayed on the display device 12 as the first GUI, regardless of the content of the inquiry.
[0038] According to this configuration, when multiple conflicting inquiries are made to the user, it is possible to prevent the GUI related to the subsequently made inquiry from being presented to the user until a response is made to the earlier made inquiry. This makes it possible to suppress confusion among the user and facilitate the acquisition of a reliable response to the inquiry, even when using the display device 12, which is installed on the steering member 11 and therefore has a limited space for presenting information. Therefore, it is possible to improve the convenience of the steering device 10, which is equipped with the display device 12 that displays a GUI for receiving instructions from the user.
[0039] The processor 132 of the control device 13 can be configured to be able to display a GUI in a plurality of modes with different degrees of simplicity for a specific inquiry on the display device 12. For example, in the case of an inquiry to confirm whether or not to answer an incoming phone call, the processor 132 can cause the display device 12 to display either the GUI exemplified in Fig. 4 or the GUI exemplified in Fig. 5.
[0040] The GUI illustrated in Fig. 5 includes not only GUI elements relating to options for whether or not to make a call, but also GUI elements for adjusting the call volume. On the other hand, the GUI illustrated in Fig. 4 includes only GUI elements relating to options for whether or not to make a call. In other words, the GUI illustrated in Fig. 4 is simpler than the GUI illustrated in Fig. 5.
[0041] When the display of the second GUI related to the second inquiry that has occurred subsequently is forced to wait due to waiting for a response to the first inquiry that has occurred earlier, the processor 132 selects a simpler GUI and causes it to be displayed as the second GUI on the display device 12. That is, when an inquiry related to the need for a phone call occurs following the inquiry related to the need for a lane change described above, the processor causes the display device 12 to display the simpler GUI exemplified in FIG.
[0042] When a GUI related to a certain query is displayed as the second GUI, it means that there are multiple competing queries and the user has relatively little time to make a decision. In such a situation, presenting a simpler GUI can encourage the user to make a quick decision.
[0043] Another example of multiple GUIs with different levels of simplicity is a combination of a GUI that shows a proposal with many options and a GUI that asks whether or not to select one of the options.Another example of a GUI with higher simplicity that only asks whether or not it is necessary or possible is a GUI that includes multiple arrow images with two to four selectable directions.
[0044] The processor 132 of the control device 13 having the various functions described above can be realized by a dedicated integrated circuit such as a microcontroller, ASIC, or FPGA, which has a storage element in which a computer program for realizing the function is pre-installed. In this case, the storage element is an example of a non-transitory computer-readable medium in which a computer program is stored.
[0045] Alternatively, the processor 132 may be implemented by a general-purpose microprocessor operating in cooperation with general-purpose memory. Examples of general-purpose microprocessors include a CPU, an MPU, and a GPU. Examples of general-purpose memory include a ROM and a RAM. In this case, a computer program for implementing the function may be stored in the ROM. The general-purpose microprocessor specifies at least a portion of the computer program stored in the ROM, deploys it in the RAM, and executes the above-described processing in cooperation with the RAM. In this case, the general-purpose memory is an example of a non-transitory computer-readable medium storing a computer program. The computer program may be pre-installed in the general-purpose memory, or may be downloaded from an external server device via a wireless communication network to which the control device 13 can connect and then installed in the general-purpose memory. In this case, the external server device is an example of a non-transitory computer-readable medium storing a computer program.
[0046] The processor 132 may be implemented by a combination of a general-purpose microprocessor and a dedicated integrated circuit.
[0047] The configurations described above are merely examples to facilitate understanding of the present disclosure. The configurations illustrated may be appropriately modified or combined with other configurations without departing from the spirit of the present disclosure.
[0048] In the above embodiment, the display device 12 is placed in a position that can be reached by the fingers of the right hand of a user holding the steering member 11. The GUI displayed on the display device 12 includes images corresponding to a plurality of options. On the other hand, as illustrated in FIG. 1, the display device 12 can also be placed in a position that can be reached by the fingers of the left hand of a user holding the steering member 11.
[0049] In this case, one of the plurality of options may be included in the GUI displayed on the right display device 12, and another of the plurality of options may be included in the GUI displayed on the left display device 12. For example, a configuration may be made in which button image B1 included in the GUI illustrated in Fig. 4 is displayed on the left display device 12, and button image B2 is displayed on the right display device 12. This configuration can prevent unintended input of instructions to the GUI displayed on the display device 12 on the steering member 11, which has a relatively small display area.
[0050] In the above embodiment, the display device 12 also serves as a user interface that accepts user instructions. However, the user interface 121 may include a mechanical switch provided on the steering device 10. In addition to or instead of these, responses to inquiries may be made by voice input or gesture input. In this case, the user interface 121 has a well-known configuration that can accept voice input or gesture input.
[0051] The steering device 10 can also be mounted on a moving body other than the vehicle 20. Examples of such moving bodies include trains, airplanes, and ships. [Explanation of symbols]
[0052] 10: Steering device, 11: Steering member, 12: Display device, 121: User interface, 13: Control device, 131: Input interface, 132: Processor, 20: Vehicle
Claims
1. A steering device mounted on a moving body, a steering member for changing the direction of travel of the moving body; a display device installed on the steering member; a control device that causes the display device to display a first GUI that accepts a first response to a first inquiry that occurs in accordance with a state of the moving object; It is equipped with When a second inquiry occurs in response to a state of the moving object while the first GUI is being displayed, the control device causes the display device to display a second GUI for accepting a second response to the second inquiry after the first GUI accepts the first response. Steering gear.
2. the control device is capable of displaying a GUI on a display device in a plurality of modes with different degrees of simplicity for the second inquiry; the control device causes the display device to display the GUI with higher simplicity as the second GUI; The steering device according to claim 1 .
3. the display device also serves as an interface for receiving the first response and the second response; A steering device according to claim 1 or 2.
4. A control device mounted on a moving body, an interface that receives a first signal indicating that a first inquiry has occurred in response to a state of the moving object; a processor that, in response to the first signal, displays a first GUI that accepts a first response to the first inquiry on a display device that is installed on a steering member that changes the traveling direction of the moving object; It is equipped with When the interface receives a second signal indicating that a second inquiry has occurred in accordance with the state of the moving object while the first GUI is being displayed, the processor causes the display device to display a second GUI for accepting a second response to the second inquiry after the first GUI accepts the first response. Control device.
5. A computer program executable by a processor mounted on the control device, By being executed, the control device receiving a first signal indicating that a first inquiry has occurred in response to a state of a moving body in which the control device is installed; displaying a first GUI for receiving a first response to the first inquiry on a display device provided on a steering member for changing a traveling direction of the moving body in response to the first signal; when a second signal indicating that a second inquiry has occurred in accordance with the state of the moving object is received while the first GUI is being displayed, after the first GUI has received the first response, a second GUI for receiving a second response to the second inquiry is displayed on the display device; Computer program.
Citation Information
Patent Citations
Method and system for communicatively coupling a wearable computer with one or more non-wearable computers
US20160198319A1
Driving assistance method and driving assistance device, driving control device, vehicle, and driving assistance program using such method
WO2016170764A1
Electronic control system for vehicle, method for determining authorization of program update, and program for determining authorization of program update
WO2020022265A1
Steering switching device and steering switch system
WO2020179361A1