Information notification system, control device, and control method

Abstract

To provide an information notification system and the like that can provide an appropriate notification to an operator.SOLUTION: An information notification system 10 vibrates a main body 19 of a steering used for operating a movable body, and includes: an actuator 14 that can output sound by vibration; a lighting unit 13 that is provided on a steering 20 and can emit light; and a control device 30 that is electrically connected to the actuator 14 and the lighting unit 13 to control the actuator 14 and the lighting unit 13 and receives display information regarding display lights displayed to an operator controlling the movable body. When receiving the display information, the control device 30 allows the main body 19 to vibrate using the actuator 14, turns on the lighting unit 13, and then outputs sound regarding the display information received using the actuator 14.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present disclosure relates to an information notification system, a control device, and a control method.

Background Art

[0002] Conventionally, in the operation of a moving body, a system for notifying an operator of various types of information has been proposed. For example, in Patent Document 1, a display is provided on a vehicle steering wheel, and a system is disclosed in which an image is displayed on such a display to notify the operator.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In a moving body, there are many cases where an operator needs to visually recognize the moving destination of the moving body (for example, in front of a vehicle), and there are also many restrictions on the movement of the operator's line of sight. Therefore, in a conventional system, there are cases where an appropriate notification cannot be made to the operator. Thus, the present disclosure provides an information notification system or the like that can appropriately notify an operator.

Means for Solving the Problems

[0005] An information notification system according to one aspect of the present disclosure includes an actuator that vibrates the main body of a steering for operating a moving body and can output sound by vibration, a light emitting unit provided on the steering and capable of lighting up light, and a control device that is electrically connected to the actuator and the light emitting unit, controls the actuator and the light emitting unit, and receives display information regarding a display lamp displayed toward an operator who operates the moving body. When the control device receives the display information, the control device vibrates the main body using the actuator, causes the light emitting unit to emit light, and then outputs a sound regarding the display information received using the actuator.

[0006] Further, a control device according to one aspect of the present disclosure is a control device that is electrically connected to an actuator that vibrates the main body of a steering for operating a moving body and can output sound by vibration, and controls the actuator; a second control unit that is electrically connected to a light emitting unit provided on the steering and capable of lighting up light, and controls the light emitting unit; and a receiving unit that receives display information regarding a display lamp displayed toward an operator who operates the moving body. When the control device receives the display information, the control device vibrates the main body using the actuator, causes the light emitting unit to emit light, and then outputs a sound regarding the display information received using the actuator.

[0007] Also, a control method according to an aspect of the present disclosure vibrates the main body of the steering for operating a moving body, and is electrically connected to an actuator capable of outputting sound by vibration, and a first control step of controlling the actuator; a second control step of controlling a light emitting unit provided on the steering and capable of lighting up light, which is electrically connected to the light emitting unit; and a receiving step of receiving display information regarding an indicator lamp displayed toward an operator who operates the moving body. When the display information is received in the receiving step, the first control step is executed to vibrate the main body, and after the second control step is executed to cause the light emitting unit to emit light, the first control step is executed to output a sound regarding the received display information.

Advantages of the Invention

[0008] According to the information notification system and the like of the present disclosure, appropriate notification to the operator can be performed.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

MODE FOR CARRYING OUT THE INVENTION

[0010] (Background Leading to the Present Disclosure) There are cases where the operation of a moving body is restricted by the actions of an operator. For example, in the case of a vehicle, which is an example of a moving body, a driver as an operator drives it. At that time, it is necessary for the driver to visually recognize the moving destination of the vehicle (for example, in front of the vehicle). Then, the movement of the driver's line of sight may be restricted within a certain range centered on the moving destination (for example, in front of the vehicle). Even if a display is provided on the rim of the steering wheel that is gripped during vehicle driving, visually recognizing such a display is difficult because the position of the display changes depending on the steering situation. The display may rotate depending on the steering angle of the steering wheel, making it difficult to see, or the line of sight may move to a distance closer to the driver from the forward view, making it difficult to adjust the focus. Therefore, it may not be appropriate to notify the driver by displaying information on the display provided on the steering wheel.

[0011] On the one hand, in the operation of a moving body, it is necessary to grasp various kinds of information such as the situation surrounding the moving body and the state of the moving body itself. Therefore, the moving body is equipped with a function of notifying the operator by displaying the situation surrounding the moving body and the state of the moving body itself as information. For example, information regarding the situation surrounding the moving body and the state of the moving body itself may be displayed on a display device as indicator lights or warning lights. However, such indicator lights and warning lights are often displayed in the form of icons and symbols whose meanings are abstracted, and there are cases where the operator cannot immediately grasp their meanings. Furthermore, there is also a problem that the area where the indicator lights are displayed is limited, making the indicator lights small and difficult to notice. Therefore, it is proposed to notify the operator of the meaning with additional information while notifying that the indicator lights are displayed.

[0012] As described above, it may not be appropriate to display additional information on the display provided on the steering. Therefore, in the present disclosure, by outputting sound, additional information or a method for dealing with notification information is notified. In the case of sound, it can be perceived by hearing even during the operation of a moving body that is subject to visual restrictions.

[0013] In addition, in order to notify that an indicator light or a warning light is being displayed, a trigger is provided to make it easier for the operator to notice the display of the indicator light or the warning light. This trigger may be provided by a combined stimulus of touch and vision. However, with regard to the visual stimulus, it is not necessary to use a stimulus that requires time to understand the content, such as displaying the information itself as an image, but simply a stimulus that allows the presence or absence of the visual stimulus to be visually recognized. The presence or absence of such a visual stimulus can be recognized by a visual recognition function called peripheral vision, which can capture changes based on displays or warnings from within the edge of the field of vision without moving the line of sight. Moreover, since a tactile stimulus is combined, a combined visual + tactile stimulus can more effectively notify the operator that the indicator light is being displayed. In this way, by means of a so-called three-sense linked stimulus of vision + touch + voice, it is possible to appropriately notify the operator about indicator lights, warning lights, etc., and enable the operator to respond to the notified content.

[0014] (Summary of the Disclosure) In view of the above, an information notification system according to a first aspect of the present disclosure includes an actuator that vibrates the main body of a steering for operating a moving body and can output sound by vibration, a light emitting unit provided on the steering that can turn on light, and a control device that is electrically connected to the actuator and the light emitting unit, controls the actuator and the light emitting unit, and receives display information regarding an indicator light displayed toward an operator who operates the moving body. When the control device receives the display information, the control device vibrates the main body using the actuator, causes the light emitting unit to emit light, and then outputs a sound regarding the received display information using the actuator.

[0015] In such an information notification system, the vibration of the steering main body by the actuator and the lighting of the steering by the light emitting unit can make the operator notice the display of the indicator light. Then, from the sound regarding the display information related to the indicator light, the operator can understand (and respond to) what the indicator light means. Therefore, appropriate notification to the operator regarding the display of the indicator light can be made.

[0016] Further, the information notification system according to the second aspect is the information notification system described in the first aspect, and further includes a camera that images an operator and outputs the captured image to a control device. When the control device receives display information, it vibrates the main body using an actuator and causes the light emitting unit to emit light. Then, when it is determined that the line of sight of the operator captured in the output image is directed toward the area where the display lamp is displayed after the light emitting unit has emitted light, the control device outputs a voice regarding the display information received using the actuator.

[0017] In such an information notification system, the line of sight of the operator can be grasped by the camera. After making the operator aware of the display of the display lamp or warning lamp, when it is considered that the line of sight of the operator is directed toward the area where the display lamp or warning lamp is displayed and the display lamp has been visually recognized, it is possible to output display information related to the display lamp or warning lamp, or voice regarding the countermeasure method for the notification information.

[0018] Further, the information notification system according to the third aspect is the information notification system described in the first aspect. When the control device receives display information, it vibrates the main body using an actuator and causes the light emitting unit to emit light. Then, when it is determined that a predetermined period has elapsed, the control device outputs a voice regarding the display information received using the actuator.

[0019] In such an information notification system, after making the operator aware of the display of the display lamp or warning lamp, when it is considered that a predetermined period has elapsed and a sufficient period for visually recognizing the display lamp or warning lamp has elapsed, it is possible to output display information related to the display lamp, or voice regarding the countermeasure method for the notification information.

[0020] Further, the information notification system according to the fourth aspect is the information notification system described in any one of the first to third aspects. The light emitting unit includes a first light emitting unit that is long in the first direction and can light up at a plurality of locations in the first direction. The control device causes the first light emitting unit to emit light so that the light to be lit moves toward the area where the display lamp is displayed in the first direction.

[0021] In such an information notification system, by the movement of light in the first direction, the area where the display lamp or warning lamp is displayed can be notified to the operator.

[0022] Further, the information notification system according to the fifth aspect is the information notification system described in the fourth aspect, wherein the light emitting unit includes a second light emitting unit that is long in the second direction intersecting the first direction and can light up light at a plurality of locations in the second direction, and the control device causes the second light emitting unit to emit light so that the light to be lit moves toward the area where the display lamp is displayed in the second direction.

[0023] In such an information notification system, by the movement of light in the second direction, the area where the display lamp or warning lamp is displayed can be notified to the operator.

[0024] Further, the information notification system according to the sixth aspect is the information notification system described in any one of the first to third aspects, wherein the light emitting unit includes a first light emitting unit that is long in the first direction and can light up light at a plurality of locations in the first direction, and the control device causes the first light emitting unit to emit light so that it moves in the rotation direction of the steering recommended based on the display information.

[0025] In such an information notification system, by the movement of light in the first direction, the recommended rotation direction of the steering can be notified to the operator.

[0026] Further, the information notification system according to the seventh aspect is the information notification system described in any one of the fourth to sixth aspects, wherein the control device determines the moving speed of the light to be lit, and causes the light emitting unit to emit light so that the light to be lit moves at the determined moving speed.

[0027] In such an information notification system, in the movement of light, variations in visual stimuli can be provided by the speed. For example, the distance to the area where the display lamp is displayed (e.g., whether the display is on meter 17 or a side mirror, etc.) or the recommended rotation speed of the steering can be assigned to the moving speed of the light and notified to the operator.

[0028] Also, the information notification system according to the eighth aspect is the information notification system described in any one of the first to seventh aspects, and the actuator is built in a support portion that supports the main body.

[0029] In such an information notification system, a tactile stimulus can be applied to the operator by the actuator built in the support portion.

[0030] Also, the information notification system according to the ninth aspect is the information notification system described in any one of the first to eighth aspects, and the actuator is composed of a plurality of vibrators provided on each of one end side and the other end side in the first direction, and the control device vibrates the main body using the vibrator close to the area where the display lamp is displayed in the first direction.

[0031] In such an information notification system, the area where the display lamp is displayed (for example, whether the display is the meter 17 or the side mirror, etc.) can be notified to the operator by the biased vibration in the first direction.

[0032] Also, the information notification system according to the tenth aspect is the information notification system described in any one of the first to ninth aspects, and the actuator is composed of a plurality of vibrators provided on each of one end side and the other end side in the first direction, and the control device vibrates the main body using the vibrator at the tip side in the rotation direction of the steering recommended based on the display information.

[0033] In such an information notification system, the recommended rotation direction of the steering can be notified to the operator by the biased vibration in the first direction.

[0034] Further, the control device according to the 11th aspect is a control device that vibrates the main body of the steering for operating the moving body, and is electrically connected to an actuator capable of outputting sound by vibration, and a first control unit that controls the actuator; a second control unit that is provided on the steering and is electrically connected to a light-emitting unit capable of lighting up light, and controls the light-emitting unit; and a receiving unit that receives display information regarding an indicator lamp displayed toward an operator who operates the moving body. When the control device receives the display information, it vibrates the main body using the actuator, causes the light-emitting unit to emit light, and then outputs a sound regarding the received display information using the actuator.

[0035] Such a control device can achieve the same effects as the information notification system described above.

[0036] Further, the control method according to the 12th aspect includes: a first control step of vibrating the main body of the steering for operating the moving body, and being electrically connected to an actuator capable of outputting sound by vibration, and controlling the actuator; a second control step of being provided on the steering and being electrically connected to a light-emitting unit capable of lighting up light, and controlling the light-emitting unit; and a receiving step of receiving display information regarding an indicator lamp displayed toward an operator who operates the moving body. When the display information is received in the receiving step, the first control step is executed to vibrate the main body, the second control step is executed to cause the light-emitting unit to emit light, and then the first control step is executed to output a sound regarding the received display information.

[0037] Such a control method can achieve the same effects as the information notification system described above.

[0038] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. Note that each of the embodiments described below shows a comprehensive or specific example of the present disclosure. Therefore, the numerical values, components, arrangement positions and connection forms of the components, as well as the steps and the order of the steps shown in the following embodiments are merely examples and are not intended to limit the present disclosure. Thus, among the components in the following embodiments, the components not described in the independent claims of the present disclosure are described as optional components.

[0039] Also, each figure is a schematic diagram and is not necessarily drawn precisely. Therefore, the scales etc. in each figure do not necessarily match. In each figure, the same reference numerals are given to substantially the same configurations, and duplicate explanations are omitted or simplified.

[0040] (Embodiment) [Configuration] FIG. 1 is a schematic diagram showing an example of a moving body equipped with an information notification system according to an embodiment. Here, an example of a vehicle is shown as an example of the moving body. Other examples of the moving body include ships and aircraft. In FIG. 1, a driver driving a vehicle is shown. The indicator lights in the vehicle include indicators for notifying the driver regarding the state of the vehicle or the situation surrounding the vehicle, such as warning lights and displays indicating the status of the vehicle. Such warning lights etc. are displayed on the instrument panel of the vehicle (see meter 17 described later in FIG. 2). That is, the instrument panel is an example of a display device for displaying indicator lights. In the present embodiment, the information notification system 10 is configured around a steering 20 used for steering the vehicle. Since the steering 20 is in front of the driver's eyes, it is easy to give a visual stimulus, and since it is a part that the driver grips, it is easy to give vibration, that is, a tactile stimulus, to the driver's hand.

[0041] Hereinafter, with reference to FIGS. 2 and 3, the information notification system 10 and some configurations related to the information notification system 10 will be described. FIG. 2 is a block diagram showing a part of the functional configuration of a mobile body equipped with the information notification system according to the embodiment. FIG. 3 is a perspective view showing the steering periphery of a mobile body equipped with the information notification system according to the embodiment. In FIG. 2, in addition to the information notification system 10, a control unit 16 and a meter 17 are shown. Further, in FIG. 3, only the configuration mounted on the steering 20 of the information notification system 10 is shown. Note that the dashed line in FIG. 3 indicates that the internal configuration is transparent.

[0042] As shown in FIG. 2, the information notification system 10 includes a control device 30, an actuator 14, a light emitting unit 13, and a camera 12. The control device 30 is connected to each of the control unit 16, the actuator 14, the light emitting unit 13, and the camera 12. The control device 30 has a receiving unit 31, a first control unit 32, a second control unit 33, and an image acquisition unit 34.

[0043] The receiving unit 31 is communicably connected to the control unit 16. The control unit 16 is a so-called ECU that controls the information to be displayed on the meter 17. The control unit 16 outputs an image for display on the meter 17, thereby displaying the image on the display unit of the meter 17. The meter 17 is an electronic instrument panel, and functions as an instrument panel by receiving an image indicating instrument information from the control unit 16 and displaying the image. The image displayed on the meter 17 is visually recognized by the driver.

[0044] Here, the control unit 16 can include an indicator light in the image to be displayed on the meter 17. The image including the indicator light is also displayed by the meter 17 in the same manner as described above. At this time, the control unit 16 generates display information including information on the fact that the indicator light is displayed and the content of the indicator light. The control unit 16 transmits the generated display information to the receiving unit 31.

[0045] The receiving unit 31 receives the display information transmitted from the control unit 16. Then, triggered by receiving the display information, it outputs a control signal for controlling the first control unit 32 and the second control unit 33. Note that the combination of the control unit 16 and the meter 17 here is an example. The display lamp may be displayed on in-vehicle devices mounted on the center console or the like in addition to the meter 17, or may be displayed on the side mirror (such as the indication of the approach of a vehicle behind). Therefore, the receiving unit 31 may receive display information including information regarding the display of the display lamp and the content of the display lamp from another configuration instead of the control unit 16.

[0046] The first control unit 32 is electrically connected to the actuator 14. The first control unit 32 controls the operation of the actuator 14 by an electric signal. Here, FIGS. 4 and 5 are diagrams for explaining the function of the actuator of the steering of a moving body equipped with the information notification system according to the embodiment. The actuator 14 is a device capable of vibrating the steering 20 as shown in FIG. 4 or outputting sound from the steering 20 as shown in FIG. 5 by changing the frequency range to be vibrated. How the actuator 14 operates is determined by the electric signal output by the first control unit 32.

[0047] As shown in FIG. 3, the actuator 14 is built into the support portion 18 among the main body 19 of the steering 20 and the support portion 18 that supports the main body 19. Note that the actuator 14 may be built into a steering switch (not shown) provided in the support portion 18. When the actuator 14 built into the support portion 18 vibrates, it can vibrate the main body 19 via the support portion 18. Further, the actuator 14 is composed of two or more vibrators respectively provided on one end side and the other end side in the extending direction (first direction) of the support portion 18 that extends across the main body 19. Note that the actuator 14 may be composed of two or more vibrators respectively built into the left and right steering switches. Each of these vibrators can vibrate independently of each other. As a result, in the first direction, a bias in the first direction can be given to the tactile stimulus applied to the driver depending on whether the vibrator on one end side or the vibrator on the other end side is vibrated. Which of the two or more vibrators is vibrated is determined by an electrical signal output from the first control unit 32. The number of vibrators here is an example, and the actuator 14 may be composed of one vibrator on either one end side or the other end side, or may be composed of one vibrator in the middle (center) between the one end side and the other end side. The actuator 14 may be provided as a dedicated one for the information notification system 10, or the actuator 14 mounted on the voice-reproducible steering may be diverted.

[0048] Note that the main body 19 of the steering 20 is a so-called steering rim, and the support portion 18 of the steering 20 is a so-called steering spoke. The support portion 18 also has a function of transmitting the rotation of the main body portion 19 to the steering shaft.

[0049] The second control unit 33 is electrically connected to the light emitting unit 13. The second control unit 33 controls the light emission of the light emitting unit 13 by an electrical signal. The light emitting unit 13 includes a first light emitting unit 13a that is long in the extending direction (first direction) of the support unit 18 and can light up at a plurality of locations in the first direction, and a second light emitting unit 13b that is long in a second direction intersecting the first direction and can light up at a plurality of locations in the second direction. Further, the second light emitting unit 13b is provided at one end side and the other end side, respectively. The numbers of the first light emitting unit 13a and the second light emitting unit 13b here are examples, and the first light emitting unit 13a may be composed of a plurality of units at one end side and the other end side. Also, the second light emitting unit 13b may be composed of any one of the units at one end side and the other end side. Alternatively, the second light emitting unit 13b may be composed of one unit in the middle (center) between the one end side and the other end side. Also, either one of the first light emitting unit 13a and the second light emitting unit 13b may not be provided.

[0050] Here, FIGS. 6 to 11 are diagrams for explaining the functions of the light emitting units of the steering of the moving body equipped with the information notification system according to the embodiment. In the following description, the respective light emission modes of the first light emitting unit 13a and the second light emitting unit 13b will be described. Here, the state of emitting light is shown with dot hatching, and the state of not emitting light is shown in white. Also, here, only the first light emitting unit 13a and the second light emitting unit 13b when the steering 20 is viewed in plan view for discrimination are shown. As shown in FIG. 6, when the light emitting unit 13 is OFF, both the first light emitting unit 13a and the second light emitting unit 13b are in a state of not emitting light.

[0051] For example, when the indicator light is displayed on the right side of the meter 17 or is displayed on the right side mirror instead of the meter 17, as shown in FIG. 7, only the right side of the first light emitting portion 13a can be lit. Since the first direction corresponds to the left - right direction of the vehicle when the steering wheel 20 is in the zero - time position (neutral position), the driver can be notified of the area where the indicator light is displayed by the lighting of the light of the first light emitting portion 13a in the first direction. More precisely, an operator who knows that the direction of the area where the indicator light is displayed is indicated by the lighting of the light of the first light emitting portion 13a can perceive the area where the indicator light is displayed by the lighting of the light as described above. Also, as shown in FIG. 8, only one of the right side of the first light emitting portion 13a and one of the two second light emitting portions 13b corresponding to the right side may be lit to indicate the area where the indicator light is displayed.

[0052] Also, for example, when the indicator light is displayed on the meter 17 on the back side (front side of the vehicle) with respect to the steering wheel 20, as shown in FIG. 9, all of the first light emitting portion 13a can be lit, and only the upper side of the second light emitting portion 13b can be lit. Since the second direction corresponds to the front - rear direction of the vehicle when the steering wheel 20 is in the zero - time position, the operator can be notified of the area where the indicator light is displayed by the lighting of the light of the second light emitting portion 13b in the second direction.

[0053] So far, an example of fixedly lighting the first light emitting portion 13a and the second light emitting portion 13b has been described. However, for example, in the light emitting portion 13 capable of lighting at a plurality of locations, by changing the lighting locations in time series, the light emitting portion 13 can be made to emit light so that the lit light moves. The movement of the light has the merit that it is easy to visually recognize even in peripheral vision and it is easy to notify the driver of the area where the indicator light is displayed without greatly moving the line of sight.

[0054] As shown in FIG. 10, the movement of the illuminated light may be such that the position where the light gradually turns on moves upward from the lower end of the second light emitting unit 13b, and finally the first light emitting unit 13a is turned on. Alternatively, as shown in FIG. 11, the left side of the second light emitting unit 13b is turned on, and after being turned off, the position where the light gradually turns on moves rightward from the left end of the first light emitting unit 13a, and finally the right side of the second light emitting unit 13b is turned on.

[0055] The movement of the illuminated light can be changed over time not only in terms of direction but also in terms of the speed of movement. That is, by associating the moving speed of the illuminated light with some index, the moving speed corresponding to the index is determined, and the illuminated light moves at that moving speed, so that the driver can be notified of the index. As the index, the distance to the area where the indicator light is displayed (for example, whether the display is on the meter 17 or the side mirror, etc.) can be used. How the light emitting unit 13 emits light as described above is determined by the electrical signal output by the second control unit 33.

[0056] Returning to FIGS. 2 and 3, the image acquisition unit 34 is communicably connected to the camera 12. The image acquisition unit 34 acquires the image output by the camera 12. The image acquired by the image acquisition unit 34 is used to detect the driver's line of sight. The detection of the line of sight here is performed with a resolution that can identify whether the driver is looking at the meter. Therefore, an expensive configuration for highly resolving the line of sight is not required, which is advantageous in terms of cost. Any existing method for detecting the line of sight from the image may be used. As shown in FIG. 3, the camera 12 is attached to the center of the support portion 18 of the steering wheel 20 and can image the face of the driver holding the steering wheel 20. The captured image is output to the image acquisition unit 34, and the image acquisition unit 34 acquires this output image.

[0057] [Operation] Next, an example of the operation of the information notification system 10 configured as described above will be described with reference to FIG. 12. FIG. 12 is a flowchart showing an example of the operation of a moving body equipped with the information notification system according to the embodiment.

[0058] The operation of the information notification system 10 starts with the start of the vehicle. Suppose that while the driver is driving the vehicle, the control unit 16 reaches a situation where it causes the display lamp to be displayed on the meter 17. Then, as shown in FIG. 12, the control unit 16 transmits the display information generated to the receiving unit 31. The receiving unit 31 receives the transmitted display information (step S11). Step S11 is an example of a receiving step. When the receiving unit 31 receives the display information, the first control unit 32 outputs an electric signal to vibrate the support portion 18 of the steering 20. The first control unit 32 can vibrate including expressions of directions such as one end side or the other end side in the first direction by controlling which vibrator of the actuator 14 to use based on the received display information. When the support portion 18 vibrates, the main body 19 also vibrates. As a result, the first control unit 32 vibrates the main body 19 of the steering 20 (step S12). Step S12 is an example of a first control step. Step S12 is continuously performed until the actuator 14 is turned off hereafter.

[0059] Also, when the receiving unit 31 receives the display information, the second control unit 33 outputs an electric signal to turn on (emit light) the light emitting unit 13 (step S13). Step S13 is an example of a second control step. The second control unit 33 can emit light including expressions of directions such as one end side or the other end side in the first direction and the second direction by controlling which part of the light emitting unit 13 to turn on based on the received display information. Step S13 is continuously performed until the light emitting unit 13 is turned off hereafter.

[0060] On the one hand, a display lamp is displayed on the display device (meter 17) by the image output from the control unit 16 (step S14). Then, the camera 12 starts capturing an image of the driver. The captured image is sequentially output to the image acquisition unit 34, and acquisition starts in the image acquisition unit 34. Step S15 is also continuously performed hereafter. Also, steps S12 to S15 described so far are performed substantially simultaneously.

[0061] Next, the control device 30 determines whether or not a predetermined period has elapsed (step S16). The predetermined period here is a period in which the tactile stimulus due to vibration and the visual stimulus due to light emission can be sufficiently perceived, and is a sufficient period when the line of sight moves, and may be set according to the reaction speed of the driver or the like. The predetermined period is, for example, several seconds to more than ten seconds, and as an example, it is set to 1 second to 10 seconds, more preferably 3 seconds to 5 seconds. If it is determined that the predetermined period has not elapsed (No in step S16), it is determined whether or not the line of sight of the driver detected based on the acquired image is directed to the area where the display lamp is displayed (step S17). If it is determined that the line of sight is not directed to the area where the display lamp is displayed (No in step S17), the process returns to step S16 and the determination is repeated.

[0062] If it is determined that the predetermined period has elapsed (Yes in step S16), since a sufficient period has elapsed for the driver to react although the line of sight is not directed, the process proceeds to the output of voice (step S18 and subsequent steps). Alternatively, if it is determined that the line of sight is directed to the area where the display lamp is displayed (Yes in step S17), it is presumed that the driver has visually recognized the display lamp and can understand the meaning of the display lamp by listening to the voice, so the process proceeds to the output of voice (step S18 and subsequent steps).

[0063] When Yes is obtained in step S16 or step S17, the first control unit 32 turns off the actuator 14 (step S18). Also, the second control unit 33 turns off the light emitting unit 13 (step S19). Then, the first control unit 32 outputs voice using the actuator 14 (step S20). Step S20 is an example of the first control step.

[0064] The control device 30 determines whether there is a response based on the driver's driving operation, switch operation, etc. for the output of the voice, such as an indicator light (step S21). If there is no response from the driver (No in step S21), step S21 is repeated until there is a response. If there is a response from the driver (Yes in step S21), the first control unit 32 turns off the actuator 14 (step S22). Also, since the situation where the display of the indicator light is required no longer exists, the control unit 16 generates and outputs an image not including the indicator light and displays it on the display device (meter 17). Thereby, the display of the indicator light is terminated (step S23).

[0065] [Modification Example 1] Hereinafter, a modification example according to the embodiment will be described. In the modification example described below, the description will focus on the points different from the above embodiment, and the description of the same points as the above embodiment will be omitted. In this modification example, it is different in that the acquisition of the image by the camera 12, the detection of the driver's line of sight, and the determination based on the direction of the line of sight are not performed. That is, in this modification example, step S15 is not performed, and after becoming No in step S16, step S17 is not performed, and the determination of step S16 is repeated again. Thereby, the information notification system 10 can be realized without including the camera 12 and the image acquisition unit 34.

[0066] [Modification Example 2] In this modification example, in terms of configuration and operation, it is not different from the embodiment, but it is different in that there is a premise that the driver's operation is required for the tactile stimulus by vibration and the visual stimulus by light emission. Specifically, in this modification example, when the driver must operate the steering wheel 20 of the vehicle by the tactile stimulus by vibration and the visual stimulus by light emission, for example, (1) an indicator light indicating the approach of a vehicle from the side rear is predicted, (2) an indicator light indicating lane departure, (3) an indicator light indicating that the backward position of the vehicle is out of the recommended route, etc. can be cited. In these cases, rather than waiting for the movement of the line of sight or the elapse of a predetermined period and then giving voice guidance, an immediate operation of the steering wheel 20 is required.

[0067] (1) The case of the indicator light will be described. For example, when the receiving unit 31 receives display information, steps S12 to S13 are executed to apply a tactile stimulus by vibration and a visual stimulus by light emission to the driver. At this time, the rotation direction and rotation speed of the steering wheel 20, which are considered to be able to avoid the approach of a vehicle from the side rear, are calculated and reflected in the electrical signals of the first control unit 32 and the second control unit 33. As a result, the actuator 14 causes the vibrator on the side corresponding to the rotation direction of the steering wheel 20, which is considered to be able to avoid the approach of a vehicle from the side rear in the first direction, to vibrate, and the light emitting unit 13 causes the light that lights up in the direction and at the moving speed corresponding to the rotation direction and rotation speed of the steering wheel 20, which is considered to be able to avoid the approach of a vehicle from the side rear in the first direction, to move. The driver may be able to avoid the approach of a vehicle from the side rear by operating the steering wheel 20 according to the tactile and visual stimuli without even visually recognizing the indicator light.

[0068] (2) Similarly, in the case of the indicator light, when the receiving unit 31 receives display information, steps S12 to S13 are executed to apply a tactile stimulus by vibration and a visual stimulus by light emission to the driver. At this time, the rotation direction and rotation speed of the steering wheel 20, which are considered to be able to return the deviated vehicle to the original lane, are calculated and reflected in the electrical signals of the first control unit 32 and the second control unit 33. Thereby, the driver may be able to return the deviated vehicle to the original lane by operating the steering wheel 20 according to the tactile and visual stimuli without even visually recognizing the indicator light.

[0069] Similarly, in the case of the indicator light of (3), when the receiving unit 31 receives the display information, steps S12 to S13 are executed to apply a tactile stimulus by vibration and a visual stimulus by light emission to the driver. At this time, the rotation direction and rotation speed of the steering wheel 20, which are considered to be able to align the reverse destination of the vehicle along the recommended route, are calculated and reflected in the electrical signals of the first control unit 32 and the second control unit 33. Thereby, even before the driver visually recognizes the indicator light, there is a possibility that the reverse destination of the vehicle can be made to follow the recommended route by operating the steering wheel 20 according to the tactile and visual stimuli.

[0070] (Other Embodiments) As described above, the embodiments have been described, but the present disclosure is not limited to the above embodiments.

[0071] For example, in the above embodiments, the processing executed by a specific processing unit may be executed by another processing unit. Also, the order of a plurality of processes may be changed, or a plurality of processes may be executed in parallel.

[0072] Further, the information notification system in the present disclosure may be realized by a plurality of devices each having a part of a plurality of components, or may be realized by a single device having all of the plurality of components. Also, a part of the function of a component may be realized as the function of another component, and how each function is distributed to each component may be arbitrary. Any form having a configuration that includes all functions capable of substantially realizing the information notification system of the present disclosure is included in the present disclosure.

[0073] Also, in the above embodiments, each component may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

[0074] In addition, each component may be implemented by hardware. For example, each component may be a circuit (or an integrated circuit). These circuits may form one circuit as a whole, or may be separate circuits respectively. Further, these circuits may be general-purpose circuits or dedicated circuits respectively.

[0075] Moreover, the general or specific aspects of the present disclosure may be implemented by a system, an apparatus, a method, an integrated circuit, a computer program, or a recording medium such as a computer-readable CD-ROM. Further, it may be implemented by any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium.

[0076] Also, the present disclosure may be implemented as a control method executed by an information notification system. The present disclosure may be implemented as a program for causing a computer to execute such a control method, or may be implemented as a computer-readable non-transitory recording medium on which such a program is recorded.

[0077] In addition, forms obtained by applying various modifications that can be conceived by those skilled in the art to the embodiments, or forms realized by arbitrarily combining the components and functions in each embodiment without departing from the spirit of the present disclosure are also included in the present disclosure.

Industrial Applicability

[0078] The present disclosure is useful, for example, as an information notification system mounted on a moving body such as a vehicle.

Description of Reference Numerals

[0079] 10 Information notification system 12 Camera 13 Light-emitting unit 13a First light-emitting unit 13b Second light-emitting unit 14 Actuator 16 Control unit 17 Meter 18 Support unit 19 Body 20 Steering 30 Control device 31 Receiver 32 First control unit 33 Second control unit 34 Image acquisition unit

Claims

1. A steering body for operating a moving body is vibrated, and an actuator capable of outputting sound by vibration, A light emitting unit provided on the steering and capable of lighting light, The actuator and the light emitting unit are electrically connected, and a control device that controls the actuator and the light emitting unit and receives display information regarding a display lamp displayed toward an operator who operates the moving body, When the control device receives the display information, After vibrating the main body using the actuator and causing the light emitting unit to emit light, Outputs sound regarding the display information received using the actuator Information notification system.

2. Further, a camera that images the operator and outputs the captured image to the control device is provided, When the control device receives the display information, After vibrating the main body using the actuator and causing the light emitting unit to emit light, When it is determined that the line of sight of the operator shown in the output image is directed to the area where the display lamp is displayed, sound regarding the display information received using the actuator is output The information notification system according to claim 1.

3. When the control device receives the display information, After vibrating the main body using the actuator and causing the light emitting unit to emit light, When it is determined that a predetermined period has elapsed, sound regarding the display information received using the actuator is output The information notification system according to claim 1.

4. The light emitting unit includes a first light emitting unit that is long in a first direction and can light light at a plurality of locations in the first direction, The control device causes the first light-emitting unit to emit light such that the light to be lit moves toward the area where the display lamp is displayed in the first direction. The information notification system according to claim 1.

5. The light-emitting unit includes a second light-emitting unit that is elongated in a second direction intersecting the first direction and can light up at a plurality of locations in the second direction. The control device causes the second light-emitting unit to emit light such that the light to be lit moves toward the area where the display lamp is displayed in the second direction. The information notification system according to claim 4.

6. The light-emitting unit includes a first light-emitting unit that is elongated in the first direction and can light up at a plurality of locations in the first direction. The control device causes the first light-emitting unit to emit light so as to move toward the rotation direction of the steering recommended based on the display information. The information notification system according to claim 1.

7. The control device determines the moving speed of the light to be lit, and causes the light-emitting unit to emit light so that the light to be lit moves at the determined moving speed. The information notification system according to any one of claims 4 to 6.

8. The actuator is built in a support portion that supports the main body. The information notification system according to claim 1.

9. The actuator is composed of a plurality of vibrators provided at each of one end side and the other end side in the first direction. The control device vibrates the main body using the vibrator closer to the area where the display lamp is displayed in the first direction. The information notification system according to claim 1.

10. The actuator is composed of a plurality of vibrators provided on each of one end side and the other end side in the first direction, The control device vibrates the main body using the vibrator on the tip side in the rotation direction of the steering recommended based on the display information. The information notification system according to claim 1.

11. A control device, A first control unit that is electrically connected to an actuator that vibrates the main body of the steering for operating the moving body and can output sound by vibration, and controls the actuator; A second control unit that is electrically connected to a light emitting unit provided on the steering and capable of lighting light, and controls the light emitting unit; A receiving unit that receives display information regarding a display lamp displayed toward an operator who operates the moving body, and When the control device receives the display information, After vibrating the main body using the actuator and causing the light emitting unit to emit light, Outputs sound regarding the display information received using the actuator. Control device.

12. A first control step of vibrating the main body of the steering for operating the moving body and being electrically connected to an actuator that can output sound by vibration, and controlling the actuator; A second control step of being electrically connected to a light emitting unit provided on the steering and capable of lighting light, and controlling the light emitting unit; A receiving step of receiving display information regarding a display lamp displayed toward an operator who operates the moving body, and including: When the display information is received in the receiving step, After executing the first control step to vibrate the main body and executing the second control step to cause the light emitting unit to emit light, Executes the first control step to output sound regarding the display information received. Control method.

Images