Information notification system, control device, and control method
The information notification system uses a steering wheel actuator and light-emitting unit to provide tactile and visual cues, addressing the limitations of conventional systems by enhancing operator perception of indicator lights through combined stimuli.
Patent Information
- Application Number
- JP2024119317
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-07-25
- Publication Date
- 2026-02-05
AI Technical Summary
Conventional information notification systems in moving objects, such as vehicles, face challenges in providing appropriate notifications due to limitations in the operator's line of sight and difficulty in perceiving visual displays on steering wheels, which can be obstructed by the steering angle and require visual focus adjustment.
An information notification system that combines tactile and visual stimuli using a steering wheel actuator for vibration and a light-emitting unit to provide notifications, with a control device determining control modes for vibration intensity, light emission intensity, and color changes to alert the operator.
Enhances the operator's perception of indicator lights by combining tactile and visual cues, allowing for appropriate notification even under visual limitations, facilitating quicker response to displayed information.
Smart Images

Figure 2026018169000001_ABST
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to an information notification system, a control device, and a control method. [Background technology]
[0002] Conventionally, systems have been proposed for notifying an operator of various types of information when operating a moving object. For example, Patent Document 1 discloses a system in which a display is provided on a steering wheel of a vehicle, and an image is displayed on the display to notify the operator. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] International Publication No. 2009 / 155550 Summary of the Invention [Problem to be solved by the invention]
[0004] In a moving object, an operator often needs to visually confirm the destination of the moving object (for example, ahead of the vehicle), and there are often limitations on the movement of the operator's line of sight. Therefore, conventional systems may not be able to provide appropriate notifications to the operator. Therefore, the present disclosure provides an information notification system etc. that can provide appropriate notifications to the operator. [Means for solving the problem]
[0005] An information notification system according to one aspect of the present disclosure includes an actuator that vibrates the main body of a steering wheel for operating a mobile body and is capable of outputting audio through the vibration; a light-emitting unit that is provided on the steering wheel and is capable of illuminating light; and a control device that is electrically connected to the actuator and the light-emitting unit, controls the actuator and the light-emitting unit, and receives display information related to an indicator light that is displayed toward an operator operating the mobile body.When the control device receives the display information, it determines a control mode that indicates at least one of the following: a time change in vibration intensity, a maximum vibration intensity, a time change in light-emitting intensity, and a light-emitting color; and, in the determined control mode, it vibrates the main body using the actuator and causes the light-emitting unit to emit light, and then outputs audio related to the display information received using the actuator.
[0006] Furthermore, a control device according to one aspect of the present disclosure is a control device comprising: a first control unit that vibrates a main body of a steering wheel for operating a mobile body and is electrically connected to an actuator capable of outputting sound through vibration and controls the actuator; a second control unit that is provided on the steering wheel and electrically connected to a light-emitting unit that is capable of turning on light and controls the light-emitting unit; and a receiving unit that receives display information related to an indicator light that is displayed toward an operator operating the mobile body, wherein when the control device receives the display information, the control device determines a control mode that indicates at least one of the following: a time change in vibration intensity, a maximum vibration intensity, a time change in light-emitting intensity, and a light-emitting color; and in the determined control mode, the control device vibrates the main body using the actuator and causes the light-emitting unit to emit light, and then outputs sound related to the display information received using the actuator.
[0007] Furthermore, a control method according to one aspect of the present disclosure includes a first control step of vibrating a main body of a steering wheel for operating a mobile body, electrically connected to an actuator capable of outputting sound through vibration and controlling the actuator; a second control step of electrically connected to a light-emitting unit provided on the steering wheel and capable of illuminating light and controlling the light-emitting unit; and a receiving step of receiving display information related to an indicator light to be displayed toward an operator operating the mobile body, wherein, when the display information is received in the receiving step, a control mode indicating at least one of a time change in vibration intensity, a maximum vibration intensity, a time change in light-emitting intensity, and a light-emitting color is determined, and in the determined control mode, the first control step is executed to vibrate the main body, and the second control step is executed to cause the light-emitting unit to emit light, and then the first control step is executed to output sound related to the received display information. [Effects of the Invention]
[0008] According to the information notification system etc. of the present disclosure, it is possible to provide an appropriate notification to the operator. [Brief explanation of the drawings]
[0009] [Figure 1] FIG. 1 is a schematic diagram showing an example of a mobile object equipped with an information notification system according to an embodiment. [Figure 2] FIG. 2 is a block diagram showing a part of the functional configuration of a mobile object equipped with an information notification system according to an embodiment. [Figure 3] FIG. 3 is a perspective view showing the steering and surrounding area of a moving object equipped with an information notification system according to an embodiment. [Figure 4] FIG. 4 is a diagram for explaining the function of the steering actuator of a moving object equipped with an information notification system according to an embodiment. [Figure 5] FIG. 5 is a diagram for explaining the function of the steering actuator of a moving object equipped with an information notification system according to an embodiment. [Figure 6]FIG. 6 is a diagram for explaining the function of the light emitting unit on the steering wheel of a moving object equipped with an information notification system according to an embodiment. [Figure 7] FIG. 7 is a diagram for explaining the function of the light emitting unit on the steering wheel of a moving object equipped with an information notification system according to an embodiment. [Figure 8] FIG. 8 is a diagram for explaining the function of the light emitting unit on the steering wheel of a moving object equipped with an information notification system according to an embodiment. [Figure 9] FIG. 9 is a diagram for explaining the function of the light emitting unit on the steering wheel of a moving object equipped with an information notification system according to an embodiment. [Figure 10] FIG. 10 is a diagram for explaining the function of the light emitting unit on the steering wheel of a moving object equipped with the information notification system according to the embodiment. [Figure 11] FIG. 11 is a diagram for explaining the function of the light emitting unit on the steering wheel of a moving object equipped with an information notification system according to an embodiment. [Figure 12] FIG. 12 is a diagram illustrating the lighting position and the change over time of the vibration intensity in the information notification system according to the embodiment. [Figure 13] FIG. 13 is a diagram illustrating another example of the lighting position and the time change of the vibration intensity in the information notification system according to the embodiment. [Figure 14] FIG. 14 is a diagram illustrating the maximum strength of vibration in the information notification system according to the embodiment. [Figure 15] FIG. 15 is a diagram illustrating the lighting position and the change in light emission intensity over time in the information notification system according to the embodiment. [Figure 16] FIG. 16 is a diagram illustrating another example of the lighting position and the change over time in the light emission intensity in the information notification system according to the embodiment. [Figure 17] FIG. 17 is a diagram illustrating the emitted light color in the information notification system according to the embodiment. [Figure 18]FIG. 18 is a flowchart showing an example of the operation of a moving object equipped with the information notification system according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0010] (Background to this disclosure) The operation of a moving object may impose restrictions on the actions of the operator. For example, a vehicle, which is an example of a moving object, is driven by a driver who acts as the operator. At that time, the driver needs to keep an eye on the destination of the vehicle (e.g., ahead of the vehicle). As a result, the movement of the driver's gaze may be limited to a certain range centered on the destination (e.g., ahead of the vehicle). Even if a display is provided on the steering wheel rim that is gripped while driving the vehicle, viewing such a display often involves difficulties, such as the display rotating with the steering angle of the steering wheel and becoming difficult to see, since the position of the display changes depending on the steering situation, or the driver's gaze shifts from the scenery ahead to a distance closer to the driver, making it difficult to adjust the focus. For this reason, it may not be appropriate to notify the driver by displaying information on a display provided on the steering wheel.
[0011] On the other hand, when operating a mobile object, it is necessary to grasp various information, such as the situation surrounding the mobile object and the state of the mobile object itself. Therefore, the mobile object is equipped with a function to notify the operator of the situation surrounding the mobile object and the state of the mobile object itself by displaying the information. For example, information regarding the situation surrounding the mobile object and the state of the mobile object itself is sometimes displayed on a display device as an indicator light or a warning light. However, such indicator lights and warning lights are often displayed in the form of icons or symbols whose meanings are abstracted, and the operator may not be able to instantly grasp their meaning. Furthermore, the limited display area of the indicator light poses a problem, as the indicator light is small and difficult to notice. Therefore, a proposal has been made to notify the operator that an indicator light is displayed, while also providing additional information on its meaning.
[0012] As mentioned above, there are cases where it is not appropriate to display additional information on a display provided on the steering wheel. Therefore, in the present disclosure, additional information or a method for dealing with the notification information is notified by outputting audio. Audio can be perceived by hearing even when operating a moving object that is subject to visual limitations.
[0013] Furthermore, to notify the operator that an indicator light or warning light is on, a cue is provided to make it easier for the operator to notice the display of the indicator light or warning light. This cue can be provided by a combination of tactile and visual stimuli. However, the visual stimuli need not be stimuli that require time to grasp, such as stimuli that display the information itself as an image, but rather a stimuli that simply allows the operator to visually recognize the presence or absence of the visual stimuli. The presence or absence of such visual stimuli can be recognized by simply capturing them inside the edge of the field of vision, using a visual recognition function known as peripheral vision, without moving the eyes. Furthermore, because tactile stimuli are also combined, the combined visual and tactile stimuli can more effectively notify the operator that an indicator light is on. In this way, the so-called three-sensory stimuli of vision, tactile, and audio can provide the operator with appropriate notifications regarding indicator lights, warning lights, etc., allowing them to take appropriate action in response to the notification content.
[0014] (Disclosure Summary) In view of the above, an information notification system according to a first aspect of the present disclosure includes an actuator that vibrates the main body of a steering wheel for operating a mobile body and is capable of outputting audio through the vibration; a light-emitting unit that is provided on the steering wheel and is capable of illuminating light; and a control device that is electrically connected to the actuator and the light-emitting unit, controls the actuator and the light-emitting unit, and receives display information related to an indicator light that is displayed toward an operator operating the mobile body; when the control device receives the display information, it determines a control mode that indicates at least one of the modes of the change in vibration intensity over time, the maximum intensity of vibration, the change in light-emitting intensity over time, and the light-emitting color, and uses the actuator to vibrate the main body in the determined control mode and to cause the light-emitting unit to emit light, and then outputs audio related to the display information received using the actuator.
[0015] In such an information notification system, the vibration of the steering body by the actuator and the light emission of the steering wheel by the light-emitting unit can alert the operator to the presence of an indicator light. The operator can then understand (and take action on) the meaning of the indicator light from the audio information displayed on the indicator light. Furthermore, the vibration of the body by the actuator and the light emission of the light-emitting unit are performed in accordance with a predetermined control mode for at least one of the time change in vibration intensity, maximum vibration intensity, time change in light emission intensity, and light emission color, making it easier for the operator to perceive. Therefore, the operator can be appropriately notified about the display of the indicator light.
[0016] An information notification system according to a second aspect is the information notification system according to the first aspect, wherein the control device determines the control mode that indicates a mode of time change in which vibration intensity gradually increases.
[0017] In such an information notification system, the vibration intensity is changed over time in a manner that gradually increases over time in accordance with the determined control manner, making it easier for the operator to perceive the vibration.
[0018] Furthermore, an information notification system according to a third aspect is the information notification system according to the second aspect, wherein the light-emitting unit includes a first light-emitting unit that is elongated in a first direction and can emit light at multiple locations in the first direction, and the control device causes the first light-emitting unit to emit light so that the emitted light moves in the first direction toward the area where the indicator light is displayed, and changes the vibration intensity over time based on the control aspect so that the vibration intensity gradually increases as it approaches the area where the indicator light is displayed.
[0019] In such an information notification system, the light-emitting unit is illuminated so that the illuminated light moves toward the area where the indicator light is displayed, and the actuator vibrates the main body in a time-varying manner such that the vibration intensity gradually increases as the light moves in that direction (the closer it gets to the area where the indicator light is displayed).Therefore, the operator can be notified of the area where the indicator light is displayed by the vibration intensity, which increases as the illuminated light moves.
[0020] Further, an information notification system according to a fourth aspect is an information notification system according to any one of the first to third aspects, wherein the control mode determines a control mode that indicates a mode of maximum vibration intensity according to the display information.
[0021] In such an information notification system, the maximum strength of vibration is set in a manner that corresponds to the display information according to the determined control manner, so that the vibration can be made more easily perceived by the operator.
[0022] Further, an information notification system according to a fifth aspect is the information notification system according to the fourth aspect, and based on the control aspect, the control device vibrates the main body so that the vibration intensity corresponding to the display information related to the first type is at its maximum when the display information relates to the first type, and vibrates the main body so that the vibration intensity corresponding to the display information related to the second type is at its maximum when the display information relates to a second type different from the first type.
[0023] In such an information notification system, it is possible to notify the operator whether the displayed information is of the first type or the second type, based on the difference in maximum vibration intensity.
[0024] In addition, an information notification system according to a sixth aspect is an information notification system according to any one of the first to fifth aspects, wherein the control device determines the control mode that indicates the mode of time change in which the light emission intensity gradually increases.
[0025] In such an information notification system, the change in the light emission intensity over time is carried out in a manner of gradually increasing over time in accordance with the determined control manner, so that the change can be made more easily perceptible by the operator.
[0026] Furthermore, the information notification system according to the seventh aspect is the information notification system according to the sixth aspect, wherein the light-emitting unit includes a first light-emitting unit that is elongated in a first direction and can emit light at multiple locations in the first direction, and the control device causes the first light-emitting unit to emit light so that the emitted light moves in the first direction toward the area where the indicator light is displayed, and changes the emission intensity over time based on the control aspect so that the emission intensity gradually increases as the light approaches the area where the indicator light is displayed.
[0027] In such an information notification system, the light-emitting unit is illuminated so that the light moves toward the area where the indicator light is displayed, and the light emitted by the light-emitting unit changes over time so that the light intensity gradually increases as the light moves in that direction (the closer it gets to the area where the indicator light is displayed).Therefore, the area where the indicator light is displayed can be notified to the operator by the light intensity, which increases as the light moves.
[0028] An information notification system according to an eighth aspect is an information notification system according to any one of the first to seventh aspects, wherein the control mode determines the control mode indicating the mode of the emitted color according to the display information.
[0029] In such an information notification system, the emitted light color is displayed in a manner corresponding to the display information according to the determined control manner, so that the color can be made more easily perceived by the operator.
[0030] Furthermore, an information notification system according to a ninth aspect is the information notification system according to the eighth aspect, wherein, based on the control aspect, the control device causes the light-emitting unit to emit light in a color corresponding to the display information related to a first type when the display information relates to the first type, and causes the light-emitting unit to emit light in a color corresponding to the display information related to the second type when the display information relates to a second type different from the first type.
[0031] In such an information notification system, the operator can be notified whether the display information is of the first type or the second type by the difference in the light emission color. If the light emission color corresponding to the display information is set to the same color as the display color of the indicator light displayed by the display information, the operator can be notified of the color of the indicator light being displayed by simply viewing the light emission color peripherally, using only the light-emitting unit.
[0032] Furthermore, the information notification system according to a tenth aspect is the information notification system according to any one of the first to ninth aspects, further comprising a camera that captures an image of the operator and outputs the captured image to a control device, and when the control device receives display information, it vibrates the main body using an actuator and causes the light-emitting unit to emit light.If the control device determines that the line of sight of the operator shown in the output image is directed toward the area where the indicator light is displayed, it outputs sound related to the received display information using the actuator.
[0033] In such an information notification system, the camera can be used to grasp the operator's line of sight, and after making the operator aware of the presence of an indicator light or warning light, if the operator turns their line of sight toward the area where the indicator light or warning light is displayed and is deemed to have visually recognized the indicator light, the system can output display information related to the indicator light or warning light, or audio regarding how to deal with the notification information.
[0034] Furthermore, an information notification system according to an eleventh aspect is an information notification system according to any one of the first to ninth aspects, in which, when the control device receives display information, it vibrates the main body using an actuator, and after causing the light-emitting unit to emit light, if it determines that a predetermined period of time has elapsed, it outputs sound related to the received display information using the actuator.
[0035] In such an information notification system, after the operator is made aware of the presence of an indicator light or warning light, a predetermined period of time has passed and it is determined that a sufficient period of time has passed for the operator to be able to see the indicator light or warning light, and then display information related to the indicator light or audio regarding how to deal with the notification information can be output.
[0036] Furthermore, an information notification system according to a twelfth aspect is an information notification system according to any one of the first to eleventh aspects, wherein the light-emitting unit includes a first light-emitting unit that is elongated in a first direction and capable of emitting light at multiple locations in the first direction, and the control device causes the first light-emitting unit to emit light so that the lit light moves in the first direction toward the area where the indicator light is displayed.
[0037] In such an information notification system, the movement of light in the first direction can notify the operator of the area where the indicator light or warning light is displayed.
[0038] In addition, the information notification system according to the 13th aspect is the information notification system according to the 12th aspect, wherein the light-emitting unit includes a second light-emitting unit that is elongated in a second direction that intersects with the first direction and is capable of emitting light at multiple locations in the second direction, and the control device causes the second light-emitting unit to emit light so that the lit light moves in the second direction toward the area where the indicator light is displayed.
[0039] In such an information notification system, the movement of the light in the second direction can notify the operator of the area where the indicator light or warning light is displayed.
[0040] Furthermore, an information notification system according to a fourteenth aspect is an information notification system according to any one of the first to eleventh aspects, wherein the light-emitting unit includes a first light-emitting unit that is elongated in a first direction and capable of emitting light at multiple locations in the first direction, and the control device causes the first light-emitting unit to emit light so as to move toward a steering rotation direction recommended based on the display information.
[0041] In such an information notification system, the movement of the light in the first direction can notify the operator of the recommended steering rotation direction.
[0042] Furthermore, an information notification system according to a 15th aspect is an information notification system according to any one of the 12th to 14th aspects, in which the control device determines the speed at which the lit light moves and causes the light-emitting unit to emit light so that the lit light moves at the determined speed.
[0043] In such an information notification system, the speed of the light movement can be varied to provide a variety of visual stimuli. For example, the distance to the area where the indicator light is displayed (for example, whether the display is on the meter 17 or the side mirror) or the recommended steering speed can be assigned to the light movement speed and notified to the operator.
[0044] An information notification system according to a sixteenth aspect is the information notification system according to any one of the first to fifteenth aspects, wherein the actuator is built into a support that supports the main body.
[0045] In such an information notification system, an actuator built into the support unit can provide a tactile stimulus to the operator.
[0046] Furthermore, an information notification system according to a 17th aspect is an information notification system according to any one of the 1st to 16th aspects, wherein the actuator comprises a plurality of vibrators provided at one end and the other end in the first direction, and the control device vibrates the main body using a vibrator that is close to the area where the indicator light is displayed in the first direction.
[0047] In such an information notification system, the operator can be notified of the area where the indicator light is displayed (for example, whether the display is on the meter 17 or on the side mirror) by the vibration biased in the first direction.
[0048] Furthermore, an information notification system according to an 18th aspect is an information notification system according to any one of the 1st to 17th aspects, wherein the actuator comprises a plurality of vibrators provided at one end and the other end in a first direction, and the control device vibrates the main body using the vibrator at the tip end in the direction of rotation of the steering wheel recommended based on the display information.
[0049] In such an information notification system, the operator can be notified of the recommended steering rotation direction by vibration biased in the first direction.
[0050] In addition, a control device according to a 19th aspect is a control device comprising: a first control unit that vibrates the main body of a steering wheel for operating a mobile body and is electrically connected to an actuator that can output sound through vibration and controls the actuator; a second control unit that is provided on the steering wheel and electrically connected to a light-emitting unit that can turn on light and controls the light-emitting unit; and a receiving unit that receives display information regarding an indicator light that is displayed toward an operator operating the mobile body; when the control device receives the display information, it determines a control mode that indicates at least one of the following: a time change in vibration intensity, a maximum vibration intensity, a time change in light-emitting intensity, and a light-emitting color; and in the determined control mode, it vibrates the main body using the actuator and causes the light-emitting unit to emit light, and then outputs sound regarding the display information received using the actuator.
[0051] Such a control device can achieve the same effects as the information notification system described above.
[0052] In addition, a control method according to a 20th aspect includes a first control step of vibrating the main body of a steering wheel for operating a mobile body, and electrically connected to an actuator capable of outputting sound through vibration, and controlling the actuator; a second control step of electrically connected to a light-emitting unit provided on the steering wheel and capable of illuminating light, and controlling the light-emitting unit; and a receiving step of receiving display information regarding an indicator light to be displayed toward an operator operating the mobile body, wherein when the display information is received in the receiving step, a control mode indicating at least one of the modes of the change in vibration intensity over time, the maximum intensity of vibration, the change in light-emitting intensity over time, and the light-emitting color is determined, and in the determined control mode, the first control step is executed to vibrate the main body, and the second control step is executed to cause the light-emitting unit to emit light, and then the first control step is executed to output sound regarding the received display information.
[0053] Such a control method can achieve the same effects as the information notification system described above.
[0054] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. Note that each of the embodiments described below represents a comprehensive or specific example of the present disclosure. Therefore, the numerical values, components, the arrangement and connection of the components, steps, and the order of steps shown in the following embodiments are merely examples and are not intended to limit the present disclosure. Therefore, among the components in the following embodiments, components that are not described in the independent claims of the present disclosure will be described as optional components.
[0055] Furthermore, each figure is a schematic diagram and is not necessarily an exact illustration. Therefore, the scales and the like do not necessarily match in each figure. In each figure, substantially identical components are assigned the same reference numerals, and redundant explanations are omitted or simplified. Furthermore, in the following explanation, components may be described with ordinal numbers such as "first" and "second." These ordinal numbers are assigned to distinguish one component from another, and the numerical values indicated by the ordinal numbers do not have any numerical order or other significance. Therefore, a different identifying name may be assigned instead of the ordinal number, or the ordinal number may be omitted as long as the components can be distinguished from each other. Furthermore, ordinal numbers may be interchanged, such as changing "first" to "second" and "second" to "first."
[0056] (Embodiment) [composition] FIG. 1 is a schematic diagram showing an example of a mobile body equipped with an information notification system according to an embodiment. Here, a vehicle is shown as an example of the mobile body. Other examples of mobile bodies include ships and aircraft. FIG. 1 also shows a driver driving the vehicle. Indicator lights in a vehicle include warning lights, indicators indicating the vehicle's status, and other indicators intended to notify the driver of the vehicle's status or the circumstances surrounding the vehicle. Such warning lights and other indicators are displayed on the vehicle's instrument panel (meter 17, see FIG. 2 described later). In other words, the instrument panel is an example of a display device for displaying indicator lights. In this embodiment, the information notification system 10 is mainly composed of a steering wheel 20 used to steer the vehicle. The steering wheel 20 is located in front of the driver, which provides a visual stimulus, and since the driver holds it, it provides a vibration, i.e., a tactile stimulus, to the driver's hands.
[0057] The information notification system 10 and some of the configuration related to the information notification system 10 will be described below with reference to Fig. 2 and Fig. 3. Fig. 2 is a block diagram showing some of the functional configuration of a mobile body equipped with an information notification system according to an embodiment. Fig. 3 is a perspective view showing the periphery of the steering wheel of a mobile body equipped with an information notification system according to an embodiment. In Fig. 2, in addition to the information notification system 10, a control unit 16 and a meter 17 are shown. Furthermore, Fig. 3 shows only the configuration of the information notification system 10 that is mounted on the steering wheel 20. Note that dashed lines in Fig. 3 indicate that the internal configuration is visible through the view.
[0058] 2, the information notification system 10 includes a control device 30, an actuator 14, a light-emitting unit 13, and a camera 12. The control device 30 is connected to each of the control unit 16, the actuator 14, the light-emitting unit 13, and the camera 12. The control device 30 includes a receiving unit 31, a first control unit 32, a second control unit 33, and an image acquiring unit 34.
[0059] The receiving unit 31 is communicatively connected to the control unit 16. The control unit 16 is a so-called ECU that controls the information displayed on the meter 17. The control unit 16 outputs an image to be displayed on the meter 17, thereby displaying the image on the display unit of the meter 17. The meter 17 is an electronic instrument panel, and functions as an instrument panel by receiving an image showing instrument information from the control unit 16 and displaying the image. The image displayed on the meter 17 is visually recognized by the driver.
[0060] Here, the control unit 16 can include an indicator light in the image to be displayed on the meter 17. The image including the indicator light is also displayed by the meter 17 in the same manner as above. At this time, the control unit 16 generates display information including information that the indicator light has been displayed and information regarding the content of the indicator light. The control unit 16 transmits the generated display information to the receiving unit 31.
[0061] The receiving unit 31 receives the display information transmitted from the control unit 16. Then, the reception of the display information is used as a trigger to output a control signal for controlling the first control unit 32 and the second control unit 33. Note that the combination of the control unit 16 and the meter 17 here is just an example. Indicator lights may be displayed on an in-vehicle device mounted on the center console or the like other than the meter 17, or may be displayed on the side mirrors (such as a rear vehicle approaching indicator). Therefore, the receiving unit 31 may receive display information including information about the display of an indicator light and the content of the indicator light from another configuration instead of the control unit 16.
[0062] The first control unit 32 is electrically connected to the actuator 14. The first control unit 32 controls the operation of the actuator 14 by an electrical signal. Here, FIGS. 4 and 5 are diagrams for explaining the function of the actuator of the steering of a mobile object equipped with the information notification system according to the embodiment. The actuator 14 is a device that can vibrate the steering wheel 20 as shown in FIG. 4 or output sound from the steering wheel 20 as shown in FIG. 5 by changing the frequency range of vibration. How the actuator 14 operates is determined by the electrical signal output by the first control unit 32.
[0063] As shown in FIG. 3 , the actuator 14 is built into the support portion 18 of the steering wheel 20, which includes a main body 19 and a support portion 18 that supports the main body 19. The actuator 14 may also be built into a steering switch (not shown) provided in the support portion 18. When the actuator 14 built into the support portion 18 vibrates, it can vibrate the main body 19 via the support portion 18. The actuator 14 includes two or more vibrators provided at one end and the other end in the extension direction (first direction) of the support portion 18 that extends across the main body 19. The actuator 14 may also include two or more vibrators built into each of the left and right steering switches. These vibrators can be vibrated independently of each other. As a result, the tactile stimulation provided to the driver in the first direction can be biased by vibrating the vibrator at one end or the vibrator at the other end. Which of the two or more vibrators is to vibrate is determined by an electrical signal output by the first control unit 32. The number of vibrators here is an example, and the actuator 14 may consist of one vibrator at either one end or the other end, or one vibrator in the middle (center) between the one end and the other end. The actuator 14 may be dedicated to the information notification system 10, or an actuator 14 mounted on a steering wheel capable of reproducing audio may be used.
[0064] The main body 19 of the steering wheel 20 is a so-called steering rim, and the support portion 18 of the steering wheel 20 is a so-called steering spoke. The support portion 18 also functions to transmit the rotation of the main body 19 to the steering shaft.
[0065] The second control unit 33 is electrically connected to the light-emitting unit 13. The second control unit 33 controls the light emission of the light-emitting unit 13 using an electrical signal. The light-emitting unit 13 includes a first light-emitting unit 13a that is elongated in the extension direction (first direction) of the support unit 18 and can emit light at multiple locations in the first direction, and a second light-emitting unit 13b that is elongated in a second direction intersecting the first direction and can emit light at multiple locations in the second direction. Note that the extension direction of the support unit 18 may be defined as the second direction, and the direction intersecting the second direction may be defined as the first direction. In other words, the extension direction of one of the first light-emitting unit 13a and the second light-emitting unit 13b of the light-emitting unit 13 is defined as the first direction, and the extension direction of the other is defined as the second direction. The second light-emitting units 13b are provided at both one end and the other end of the light-emitting unit 13. The numbers of first light-emitting portions 13a and second light-emitting portions 13b shown here are merely examples, and the first light-emitting portions 13a may be composed of a plurality of first light-emitting portions 13a at one end and at the other end. The second light-emitting portion 13b may be composed of one of the second light-emitting portions 13b at either one end or the other end. Alternatively, the second light-emitting portion 13b may be composed of one of the second light-emitting portions 13b located midway (at the center) between one end and the other end. Either the first light-emitting portion 13a or the second light-emitting portion 13b may not be provided.
[0066] 6 to 11 are diagrams for explaining the function of the light-emitting units of the steering wheel of a vehicle equipped with an information notification system according to an embodiment. In the following explanation, the light-emitting modes of the first light-emitting unit 13a and the second light-emitting unit 13b will be explained. Here, the light-emitting units are indicated by dot hatching, and the non-emitting units are indicated by white. For ease of distinction, only the first light-emitting unit 13a and the second light-emitting unit 13b are shown when the steering wheel 20 is viewed from above. As shown in FIG. 6, when the light-emitting unit 13 is turned off, neither the first light-emitting unit 13a nor the second light-emitting unit 13b is emitting light.
[0067] For example, if the indicator light is displayed on the right side of the meter 17 or on the right side mirror instead of the meter 17, the light can be turned on only on the right side of the first light-emitting unit 13a, as shown in FIG. 7. The first direction corresponds to the left-right direction of the vehicle when the steering wheel 20 is in the zero o'clock position (neutral position), so the area where the indicator light is displayed can be notified to the driver by lighting up the light of the first light-emitting unit 13a in the first direction. More precisely, a driver who knows that the direction of the area where the indicator light is displayed is indicated by the lighting up of the light of the first light-emitting unit 13a can perceive the area where the indicator light is displayed by the lighting up of the light as described above. Furthermore, as shown in FIG. 8, the area where the indicator light is displayed may be lit up on the right side of the first light-emitting unit 13a and only one of the two second light-emitting units 13b corresponding to the right side.
[0068] Also, for example, when an indicator light is displayed on the meter 17 on the far side (front side of the vehicle) relative to the steering wheel 20, all of the first light-emitting parts 13a can be turned on, and only the light on the upper side of the second light-emitting part 13b can be turned on, as shown in Fig. 9. The second direction corresponds to the front-to-rear direction of the vehicle when the steering wheel 20 is in the zero o'clock position, so the area where the indicator light is displayed can be notified to the driver by turning on the light of the second light-emitting part 13b in the second direction.
[0069] So far, we have explained an example in which the first light-emitting unit 13a and the second light-emitting unit 13b are lit in a fixed manner, but for example, in a light-emitting unit 13 that can be lit in multiple locations, by changing the locations that are lit in a time series, it is possible to make the light-emitting unit 13 emit light so that the lit light moves. The moving light has the advantage that it is easy to see even in peripheral vision, and it is easy to notify the driver of the area where the indicator light is displayed without having to move their line of sight significantly.
[0070] The movement of the lit light may be such that the lit position gradually moves upward from the lower end of the second light-emitting unit 13b, as shown by the arrows in Figure 10, and finally the first light-emitting unit 13a is lit, or such that the left side of the second light-emitting unit 13b is lit and then turned off, and then the lit position gradually moves toward the right from the left end of the first light-emitting unit 13a, and finally the right side of the second light-emitting unit 13b is lit, as shown by the arrows in Figure 11.
[0071] Here, the control of the operation of actuator 14 by first control unit 32 and the control of the light emission of light-emitting unit 13 by second control unit may be performed in accordance with the movement of the illuminated light. Specifically, the control of the operation of actuator 14 by first control unit 32 includes control of changing the vibration intensity over time based on a predetermined control mode. Therefore, the determined control mode may include information indicating the change in vibration intensity over time.
[0072] The vibration intensity changes over time, for example, as shown in FIG. 12. FIG. 12 is a diagram illustrating the change over time of the lighting position and the vibration intensity in the information notification system according to the embodiment. In FIG. 12, (a) shows the change over time of the position of the lighting light in the first direction (i.e., the left-right position), (b) shows the change over time of the vibration intensity of the actuator 14 (right vibrator), and (c) shows the change over time of the vibration intensity of the actuator 14 (left vibrator). As shown in the figure, by controlling the actuator 14 based on the control mode, the vibration intensity of the right vibrator gradually increases and the vibration intensity of the left vibrator gradually decreases in synchronization with (in synchronization with) the movement of the lighting light from the left end to the right end. More precisely, the timings at which the movement of the lighting light from the left end to the right end starts and stops coincide with the timings at which the gradual increase in the vibration intensity of the right vibrator starts and stops. Furthermore, the timings at which the movement of the lighting light from the left end to the right end starts and stops coincide with the timings at which the gradual decrease in the vibration intensity of the left vibrator starts and stops.
[0073] In this way, the driver feels as if the vibration is gradually moving from the left side to the right side. In other words, the vibration allows the driver to perceive the direction from left to right. In combination with the movement of the illuminated light from the left end to the right end, it is possible to increase the ease with which the driver perceives the direction from left to right. Therefore, it is possible to more appropriately notify the driver of the area in which the indicator light is displayed. Note that since the direction of the movement of the light and the direction perceived by the vibration need to match, when the illuminated light moves from the right end to the left end, the vibration intensity of the left vibrator is controlled to gradually increase and the vibration intensity of the right vibrator to gradually decrease.
[0074] Furthermore, even if the illuminated light does not move from the left end to the right end, by simply controlling the vibration intensity of the left vibrator and the right vibrator to gradually increase and decrease, it is possible to notify the driver of the area in which the indicator light is displayed by vibration.
[0075] Here, the control for changing the vibration intensity of both the right-side vibrator and the left-side vibrator serving as the actuator 14 over time based on the control mode has been described, but, for example, only the right-side vibrator may be controlled. Specifically, as shown in FIG. 12(b), by controlling only the right-side vibrator serving as the actuator 14 so that the vibration intensity gradually increases, the driver feels as if the vibration on the right side of the main body 19 is gradually increasing. At this time, if the left-side vibrator serving as the actuator 14 is not vibrated, it is possible to make the driver relatively more aware of the right side, where the vibration is stronger, compared to the left side, where there is no vibration. Similarly, it is possible to make the left side relatively more aware of the left side by controlling only the left-side vibrator. In other words, even when controlling so that the vibration intensity of only one vibrator serving as the actuator 14 gradually increases, it is possible to notify the driver of the area where the indicator light is displayed by vibration.
[0076] The control mode is determined, for example, by the control device 30 reading out preset information on whether or not to control the actuator 14. Alternatively, the control device 30 may dynamically determine whether or not to control the actuator 14 depending on the driver's level of alertness, the direction of the driver's line of sight, etc.
[0077] Furthermore, the notification of direction by vibration as described above may be not only a linear change in vibration over time, but also a change in vibration over time as shown in FIG. 13, for example. FIG. 13 is a diagram for explaining another example of the change in the illumination position and the vibration intensity over time in the information notification system according to the embodiment. FIG. 13 shows a diagram similar to FIG. 12. However, FIG. 13 differs from the graph shown in FIG. 12 in that an inflection point exists in the change in the vibration intensity over time. As shown in FIG. 13, when there is an inflection point where the movement speed of the illuminated light changes, the inflection point may be set at the same timing to change the vibration intensity of the actuator 14 (right vibrator and left vibrator). This can enhance the sense of synchronization between the movement of the illuminated light and the change in the vibration intensity over time. In other words, the driver can feel more synchronized.
[0078] The control mode may include information specifying the maximum vibration intensity. By doing so, the maximum vibration intensity can be varied to provide a message-like notification to the driver using only vibration, depending on the maximum vibration intensity. Specifically, based on information about the content of the indicator light included in the display information, the type of content of the indicator light can be notified to the driver by varying the maximum vibration intensity. For example, FIG. 14 is a diagram illustrating the maximum vibration intensity in the information notification system according to the embodiment. Similar to FIG. 12(b), FIG. 14 illustrates an example of control of the right vibrator of the actuator 14. As shown in FIG. 14, when the type of content of the indicator light is a first type (i.e., when the display information is of the first type), the control device 30 determines the control mode so as to specify a first intensity, which is preset as the maximum vibration intensity corresponding to the first type. When the type of content of the indicator light is a second type different from the first type (i.e., when the display information is of the second type), the control device 30 determines the control mode so as to specify a second intensity, which is preset as the maximum vibration intensity corresponding to the second type.
[0079] As shown in Figure 14, in the change over time of the vibration intensity, the vibration intensity finally reached in the case of the first type of display information is greater than the vibration intensity finally reached in the case of the second type of display information. As a result, when the driver feels a stronger vibration, he or she can perceive, from the vibration alone, that the indicator light based on the first type of display information is turned on, and when the driver feels a medium level of vibration, he or she can perceive, from the vibration alone, that the indicator light based on the second type of display information is turned on. In this way, the driver can perceive the type of display information, i.e., the type of content of the indicator light displayed based on the display information, using the maximum vibration intensity.
[0080] The type of display information may correspond to the level of urgency or importance of the content of the indicator light, or may correspond to whether the content of the indicator light is of a specific type. Specifically, the type of display information may correspond to the color of the indicator light (red, yellow, etc.). Furthermore, third and subsequent types different from the first and second types, and third and subsequent maximum vibration intensities corresponding to each of the third and subsequent types, may be provided.
[0081] 14 shows an example in which the maximum vibration strength is changed in conjunction with the change in vibration strength over time, but the maximum vibration strength may be changed while the vibration strength remains constant without changing the vibration strength over time. In other words, whether to vibrate at the first strength or the second strength from the beginning may be specified by the control mode.
[0082] Furthermore, the control of light emission by light-emitting unit 13 by second control unit 33 includes control of changing the light emission intensity over time based on a predetermined control mode. Therefore, the determined control mode may include information indicating the change in light emission intensity over time.
[0083] The change in light emission intensity over time is performed, for example, as shown in Fig. 15. Fig. 15 is a diagram for explaining the change in the lighting position and the light emission intensity over time in the information notification system according to the embodiment. In Fig. 15, (a) shows the change in the position of the light that is turned on in the first direction (i.e., the left-right position), and (b) shows the change in the light emission intensity of the light-emitting unit 13 over time. As shown in the figure, the light emission intensity gradually increases as the light that is turned on moves from the left end to the right end due to the light emission of the light-emitting unit 13 based on the control mode. More precisely, the timing at which the movement of the light that is turned on from the left end to the right end starts and stops coincides with the timing at which the gradual increase in the light emission intensity of the light-emitting unit 13 starts and stops.
[0084] This allows the driver to sense that the light intensity is gradually increasing. Here, as the light intensity increases, the stronger the light intensity, the more likely it is to be noticed by the driver (it is more likely to be caught by the peripheral vision) than when the light intensity is weaker. Therefore, the position of the light that is illuminated when the light intensity is stronger is more easily visible than the position of the light that is illuminated when the light intensity is weaker.
[0085] As described above, the illuminated light moves from the left end to the right end in accordance with the change in light emission intensity over time. In this example, the illuminated light is more easily visible when it is at the right end than when it is at the left end. This makes it possible to enhance the effect of the illuminated light in making the driver perceive the direction from left to right. Therefore, it is possible to more appropriately notify the driver of the area in which the indicator light is displayed. Note that the graph in Figure 15(b) has the same shape when the illuminated light moves from the right end to the left end.
[0086] The control mode is determined, for example, by the control device 30 reading out preset information on whether or not to change the light emission intensity over time. Alternatively, the control device 30 may dynamically determine whether or not to change the light emission intensity over time depending on the driver's level of alertness, the direction of the driver's line of sight, etc.
[0087] Furthermore, the change in light emission intensity over time as described above may not be linear, but may be, for example, a change in light emission intensity over time as shown in FIG. 16 . FIG. 16 is a diagram illustrating another example of the lighting position and the change in light emission intensity over time in the information notification system according to the embodiment. FIG. 16 shows a diagram similar to FIG. 15 . However, FIG. 16 differs from the graph shown in FIG. 15 in that an inflection point exists in the change in light emission intensity over time. As shown in FIG. 16 , when there is an inflection point at which the moving speed of the illuminated light changes, the light emission intensity of the light-emitting unit 13 may be changed at the same inflection point. This can enhance the sense of synchronization between the movement of the illuminated light and the change in light emission intensity over time. In other words, the driver can feel more synchronized.
[0088] The control mode may include information specifying the maximum intensity of light emission. By doing so, the maximum intensity of light emission can be changed to impart a message-like nature to the notification to the driver using only the intensity of light emission depending on the level of the maximum intensity of light emission. Specifically, the type of content of the indicator light can be notified to the driver by changing the maximum intensity of light emission based on information about the content of the indicator light included in the display information. Furthermore, the color of light emission can be used as a light emission mode that is easier for the driver to understand than the intensity of light emission. In other words, the control mode may include information specifying the color of light emission. By doing so, the color of light emission can be changed to impart a message-like nature to the notification to the driver using only the color of light emission depending on the color of light emission. Specifically, the type of content of the indicator light can be notified to the driver by changing the color of light emission based on information about the content of the indicator light included in the display information.
[0089] For example, Fig. 17 is a diagram illustrating luminous colors in an information notification system according to an embodiment. As shown in Fig. 17, when the type of content of the indicator light is a first type (i.e., when the display information is of a first type), the control device 30 determines the control mode so as to specify a first color that is preset as a luminous color corresponding to the first type as the luminous color. When the type of content of the indicator light is a second type different from the first type (i.e., when the display information is of a second type), the control device 30 determines the control mode so as to specify a second color that is preset as a luminous color corresponding to the second type as the luminous color.
[0090] When the driver sees the light emitted in the first color, the driver can perceive that the indicator light according to the first type of display information is on, and when the driver sees the light emitted in the second color, the driver can perceive that the indicator light according to the second type of display information is on. In this way, the driver can perceive the type of display information, i.e., the type of content of the indicator light displayed based on the display information, using the light emission color.
[0091] The type of display information here may correspond to the level of urgency or importance of the content of the indicator light, as described above, or may correspond to whether the content of the indicator light is of a specific type. Furthermore, third and subsequent types different from the first and second types may be provided, and third and subsequent luminous colors corresponding to each of the third and subsequent types may be provided. The type of display information may also correspond to the type of color displayed by the indicator light related to that display information. For example, the first color corresponding to the first type and the second color corresponding to the second type may be set to the same color as the type of color displayed by the indicator light. Specifically, the first type is red, which is used for indicator lights that indicate warnings, and the first color is the same red. The second type is yellow, which is used for indicator lights that indicate caution, and the second color is the same yellow. Although the above examples have been given of the first and second types and first and second colors for red and yellow indicator lights, the luminous colors may be orange, white, green, blue, or any other color as long as the luminous colors are set to the same colors as the types of colors displayed by the indicator lights.
[0092] The control of the actuator 14 and the light-emitting unit 13 based on the control modes described above, which involve the change in vibration intensity over time, the maximum vibration intensity, the change in light emission intensity over time, the maximum light emission intensity, and the light emission color, may be performed either alone or in combination.
[0093] The movement of the illuminated light can be changed over time not only in terms of direction but also in terms of the speed of movement. In other words, by associating the speed of movement of the illuminated light with some kind of index, the speed of movement corresponding to the index can be determined, and the illuminated light can move at that speed, thereby notifying the driver of the index. The index can be the distance to the area where the indicator light is displayed (for example, whether the display is on the meter 17 or a side mirror, etc.). How the light-emitting unit 13 emits light, as described above, is determined by the electrical signal output by the second control unit 33.
[0094] Returning to Figures 2 and 3, the image acquisition unit 34 is communicatively connected to the camera 12. The image acquisition unit 34 acquires an image output by the camera 12. The image acquired by the image acquisition unit 34 is used to detect the driver's line of sight. The line of sight detection here is performed with a resolution that allows identification of whether the driver is looking at the meter. Therefore, an expensive configuration for high-resolution line of sight detection is not required, which is advantageous in terms of cost. Note that any existing method may be used as a method for detecting the line of sight from an image. The camera 12 is attached to the center of the support portion 18 of the steering wheel 20 as shown in Figure 3, and can capture an image of the face of the driver holding the steering wheel 20. The captured image is output to the image acquisition unit 34, which acquires the output image.
[0095] [Operation] Next, an example of the operation of the information notification system 10 configured as above will be described with reference to Fig. 18. Fig. 18 is a flowchart showing an example of the operation of a mobile object equipped with the information notification system according to the embodiment.
[0096] The operation of the information notification system 10 starts when the vehicle is started. As the driver drives the vehicle, the control unit 16 reaches a state where it wants to display an indicator light on the meter 17. Then, as shown in FIG. 18, the control unit 16 transmits the generated display information to the receiving unit 31. The receiving unit 31 receives the transmitted display information (step S11). Step S11 is an example of a receiving step.
[0097] Next, the camera 12 starts capturing images of the driver. The captured images are sequentially output to the image capturing unit 34, and the image capturing unit 34 starts capturing the images (step S12). Step S12 is subsequently performed continuously.
[0098] Next, the control device 30 determines a control mode that indicates at least one of the modes of the time change in vibration intensity, the maximum vibration intensity, the time change in light emission intensity, the maximum light emission intensity, and the light emission color (step S13). The control device 30 determines the control mode based on the control device 30 reading out preset information on whether or not to control the actuator 14 and whether or not to change the light emission intensity over time, and on the type of display information received.
[0099] When the receiver 31 receives the display information, the first controller 32 outputs an electric signal to vibrate the support 18 of the steering wheel 20. The first controller 32 controls which vibrator of the actuator 14 to use based on the received display information and the determined control mode, thereby enabling vibration to be caused, including an expression of a direction, such as one end side or the other end side in the first direction. The vibration of the support 18 also causes the main body 19 to vibrate. As a result, the first controller 32 vibrates the main body 19 of the steering wheel 20 (step S14). Step S14 is an example of a first control step. Step S14 is subsequently performed continuously until the actuator 14 is turned OFF.
[0100] Furthermore, when the receiver 31 receives the display information, the second controller 33 outputs an electrical signal to turn on (light up) the light-emitting unit 13 (step S15). Step S15 is an example of a second control step. The second controller 33 controls which part of the light-emitting unit 13 to light up based on the received display information and the determined control mode, thereby enabling light to be emitted to indicate directions such as one end side or the other end side in the first direction and the second direction. Step S15 is thereafter performed continuously until the light-emitting unit 13 is turned off.
[0101] Meanwhile, an indicator light is displayed on the display device (meter 17) based on the image output from the control unit 16 (step S16). Note that steps S14 to S16 described up to this point are performed substantially simultaneously.
[0102] Next, the control device 30 determines whether a predetermined period of time has elapsed (step S17). The predetermined period here is a period of time that allows the tactile stimulus due to vibration and the visual stimulus due to light emission to be fully perceived and is sufficient for the driver to move their line of sight, and may be set according to the driver's reaction speed, etc. The predetermined period is, for example, several seconds to several tens of seconds, and is set, for example, to 1 to 10 seconds, and more preferably 3 to 5 seconds. If it is determined that the predetermined period of time has not elapsed (No in step S17), it determines whether the driver's line of sight, detected based on the acquired image, is directed toward the area where the indicator light is displayed (step S18). If it is determined that the driver's line of sight is not directed toward the area where the indicator light is displayed (No in step S18), the process returns to step S17, and the determination is repeated.
[0103] If it is determined that the predetermined period has elapsed (Yes in step S17), a sufficient period has elapsed for the driver to react even though their line of sight has not been directed, so the process proceeds to outputting a sound (steps S19 and onward). Alternatively, if it is determined that the driver has been directed toward the area where the indicator light is displayed (Yes in step S18), it is estimated that the driver has become able to understand the meaning of the indicator light by viewing the indicator light and hearing the sound, so the process proceeds to outputting a sound (steps S19 and onward).
[0104] If step S17 or step S18 results in Yes, the first control unit 32 turns off the actuator 14 (step S19). Also, the second control unit 33 turns off the light-emitting unit 13 (step S20. Note that steps S19 and S20 are performed substantially simultaneously. Then, the first control unit 32 outputs sound using the actuator 14 (step S21). Step S21 is an example of a first control step.
[0105] The control device 30 determines whether or not the driver has responded to the audio output by operating a driving operation or a switch based on an indicator light (step S22). If the driver has not responded (No in step S22), step S22 is repeated until the driver has responded. If the driver has responded (Yes in step S22), the first control unit 32 turns off the actuator 14 (step S23). Furthermore, since the situation no longer requires the display of the indicator light, the control unit 16 generates and outputs an image that does not include the indicator light, and displays it on the display device (meter 17). This ends the display of the indicator light (step S24). Note that steps S23 and S24 are performed substantially simultaneously. Thereafter, the operations from step S11 onwards are repeated.
[0106] [Variation 1] A modified example of the embodiment will be described below. In the modified example described below, differences from the above embodiment will be mainly described, and similarities to the above embodiment will not be described. This modified example differs in that images are not acquired by the camera 12, and the driver's line of sight and determination based on the direction of the line of sight are not performed. That is, in this modified example, step S16 is not performed, and after step S17 returns No, step S18 is not performed and the determination of step S17 is repeated again. This makes it possible to realize the information notification system 10 without including the camera 12 and the image acquisition unit 34.
[0107] [Variation 2] This modification is identical in configuration and operation to the embodiment, but differs in that it is premised on the premise that the tactile stimulus by vibration and the visual stimulus by light emission require an action by the driver. Specifically, in this modification, there are cases in which the tactile stimulus by vibration and the visual stimulus by light emission require the driver to operate the steering wheel 20 of the vehicle, such as (1) an indicator light indicating that a vehicle is predicted to approach from the rear, (2) an indicator light indicating that the vehicle is deviating from its lane, or (3) an indicator light indicating that the vehicle is reversing away from the recommended path. In these cases, the driver is required to operate the steering wheel 20 immediately, rather than waiting for a shift of the driver's line of sight or the passage of a predetermined period of time before receiving voice guidance.
[0108] The case of the indicator light (1) will be described. For example, when the receiver 31 receives the display information, it executes steps S12 to S14 to provide the driver with a tactile stimulus by vibration and a visual stimulus by light emission. At this time, the rotation direction and rotation speed of the steering wheel 20 that are considered to be able to avoid an approaching vehicle from the rear side are calculated, and these are reflected in the electrical signals of the first controller 32 and the second controller 33. As a result, the vibrator of the actuator 14 vibrates on the side corresponding to the rotation direction of the steering wheel 20 that is considered to be able to avoid an approaching vehicle from the rear side in the first direction, and the light emitter 13 moves the illuminated light in a direction and at a speed corresponding to the rotation direction and rotation speed of the steering wheel 20 that are considered to be able to avoid an approaching vehicle from the rear side in the first direction. The driver may be able to avoid an approaching vehicle from the rear side by operating the steering wheel 20 in accordance with the tactile stimulus and visual stimulus without even visually recognizing the indicator light.
[0109] Similarly, in the case of the indicator light (2), when the receiver 31 receives the display information, it executes steps S12 to S14 to provide the driver with a tactile stimulus in the form of vibration and a visual stimulus in the form of light emission. At this time, it calculates the rotation direction and rotation speed of the steering wheel 20 that are considered to be able to return the stray vehicle to its original lane, and reflects these in the electrical signals of the first control unit 32 and the second control unit 33. This allows the driver to potentially return the stray vehicle to its original lane by operating the steering wheel 20 in accordance with the tactile stimulus and visual stimulus, without even having to visually recognize the indicator light.
[0110] Similarly, in the case of the indicator light (3), when the receiver 31 receives the display information, it executes steps S12 to S14 to provide the driver with a tactile stimulus by vibration and a visual stimulus by light emission. At this time, it calculates the rotation direction and rotation speed of the steering wheel 20 that are considered to enable the vehicle to reverse along the recommended course, and reflects these in the electrical signals of the first control unit 32 and the second control unit 33. This allows the driver to operate the steering wheel 20 in accordance with the tactile stimulus and visual stimulus, potentially enabling the vehicle to reverse along the recommended course, without even having to visually recognize the indicator light.
[0111] (Other embodiments) Although the embodiments have been described above, the present disclosure is not limited to the above-described embodiments.
[0112] For example, in the above embodiment, a process executed by a specific processing unit may be executed by another processing unit. Also, the order of multiple processes may be changed, or multiple processes may be executed in parallel.
[0113] Furthermore, the information notification system of the present disclosure may be realized by multiple devices each having some of the multiple components, or may be realized by a single device having all of the multiple components. Also, some of the functions of a component may be realized as the functions of another component, and the functions may be distributed in any manner among the components. Any form having a configuration that substantially provides all of the functions that can realize the information notification system of the present disclosure is included in the present disclosure.
[0114] In the above-described embodiments, each component may be realized by executing a software program suitable for that component, or by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory.
[0115] Furthermore, each component may be realized by hardware. For example, each component may be a circuit (or integrated circuit). These circuits may form a single circuit as a whole, or each may be a separate circuit. Furthermore, each of these circuits may be a general-purpose circuit or a dedicated circuit.
[0116] Furthermore, the general or specific aspects of the present disclosure may be realized as a system, an apparatus, a method, an integrated circuit, a computer program, or a computer-readable recording medium such as a CD-ROM, or as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium.
[0117] The present disclosure may also be realized as a control method executed by an information notification system, as a program for causing a computer to execute such a control method, or as a computer-readable non-transitory recording medium on which such a program is recorded.
[0118] In addition, this disclosure also includes forms obtained by applying various modifications to the embodiments that a person skilled in the art would think of, or forms realized by arbitrarily combining the components and functions of each embodiment within the scope that does not deviate from the intent of this disclosure. [Industrial Applicability]
[0119] The present disclosure is useful, for example, as an information notification system mounted on a moving body such as a vehicle. [Explanation of symbols]
[0120] 10 Information Notification System 12 Camera 13 Light-emitting part 13a First light-emitting part 13b Second light-emitting part 14 Actuators 16 Control Unit 17 meters 18 Support part 19 Main Unit 20 Steering 30 Control device 31 Receiving unit 32 First Control Section 33 Second Control Section 34 Image acquisition unit
Claims
1. an actuator that vibrates a steering body for operating a moving object and is capable of outputting sound by the vibration; a light emitting unit provided on the steering wheel and capable of emitting light; a control device electrically connected to the actuator and the light-emitting unit, for controlling the actuator and the light-emitting unit, and for receiving display information related to an indicator light that is displayed toward an operator who operates the moving body; When the control device receives the display information, determining a control mode that indicates at least one of a time change in vibration intensity, a maximum vibration intensity, a time change in light emission intensity, and a light emission color; After vibrating the main body using the actuator and illuminating the light-emitting unit in the determined control mode, outputting a sound related to the received display information using the actuator; Information notification system.
2. The control device determines the control mode that indicates the mode of time change in which the vibration intensity gradually increases. The information notification system according to claim 1 .
3. the light-emitting unit includes a first light-emitting unit that is elongated in a first direction and can emit light at a plurality of locations in the first direction, The control device causes the first light-emitting unit to emit light so that the light moves in the first direction toward the area where the indicator light is displayed, and changes vibration intensity over time based on the control mode so that the vibration intensity gradually increases as the indicator light approaches the area where the indicator light is displayed. The information notification system according to claim 2 .
4. The control mode determines the control mode that indicates the mode of maximum intensity of vibration according to the display information. The information notification system according to any one of claims 1 to 3.
5. Based on the control mode, the control device: vibrating the main body at a maximum vibration intensity corresponding to the display information relating to the first type when the display information relates to the first type; When the display information relates to a second type different from the first type, the main body is vibrated to a maximum vibration intensity according to the display information relating to the second type. The information notification system according to claim 4.
6. The control device determines the control mode that indicates the mode of time change in which the light emission intensity gradually increases. The information notification system according to claim 1 .
7. the light-emitting unit includes a first light-emitting unit that is elongated in a first direction and can emit light at a plurality of locations in the first direction, The control device causes the first light-emitting unit to emit light so that the light moves in the first direction toward the area where the indicator light is displayed, and changes the light emission intensity over time based on the control mode so that the light gradually increases as the light approaches the area where the indicator light is displayed. The information notification system according to claim 6.
8. The control mode determines the control mode indicating the mode of the luminescent color according to the display information. The information notification system according to any one of claims 1 to 3, 6 and 7.
9. Based on the control mode, the control device: When the display information relates to a first type, the light emitting unit emits light in a color corresponding to the display information relating to the first type; When the display information relates to a second type different from the first type, the light emitting unit emits light in a color corresponding to the display information relating to the second type. The information notification system according to claim 8.
10. A control device, a first control unit that vibrates a steering body for operating a moving object and is electrically connected to an actuator that can output sound by vibration, and controls the actuator; a second control unit provided on the steering wheel, electrically connected to a light emitting unit capable of emitting light, and controlling the light emitting unit; a receiving unit that receives display information related to an indicator light that is displayed toward an operator who operates the moving body, When the control device receives the display information, determining a control mode that indicates at least one of a time change in vibration intensity, a maximum vibration intensity, a time change in light emission intensity, and a light emission color; After vibrating the main body using the actuator and illuminating the light-emitting unit in the determined control mode, outputting a sound related to the received display information using the actuator; Control device.
11. a first control step of vibrating a steering body for operating a moving object, electrically connected to an actuator capable of outputting sound by vibration, and controlling the actuator; a second control step of electrically connecting to a light-emitting unit provided on the steering wheel and capable of emitting light, and controlling the light-emitting unit; a receiving step of receiving display information related to an indicator light that is displayed toward an operator who operates the moving object, When the display information is received in the receiving step, determining a control mode that indicates at least one of a time change in vibration intensity, a maximum vibration intensity, a time change in light emission intensity, and a light emission color; In the determined control mode, the first control step is executed to vibrate the main body, and the second control step is executed to cause the light emitting unit to emit light, The first control step is executed to output a sound related to the received display information. Control method.
Citation Information
Patent Citations
Vehicle driver messaging system and method
WO2009155550A1