Driving assistance devices

Abstract

To provide a drive support device that enables a vehicle user to easily notice an attention-seeking state.SOLUTION: A drive support device includes: a hand information acquisition unit 1 for acquiring information on a hand including a position of the hand of a vehicle user; and a control unit 2 for controlling a projection device D for projecting display light toward a predetermined position in a vehicle. The control unit 2 inputs vehicle information to perform alarm state determination processing of determining an alarm state from the vehicle information. In a case of the alarm state, the control unit projects the display light at a position of the hand or near the position of the hand of the vehicle user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a driving assistance device, and is suitable as an in-vehicle device that provides driving assistance by projecting and displaying, for example. [Background technology]

[0002] A driving assistance device is disclosed, for example, in Patent Document 1. This driving assistance device displays an image on a display device to call the attention of the driver (vehicle user) of the vehicle. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2007-286706 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the driving assistance device described in Patent Document 1 displays the warning image in an area within a display device pre-installed in the vehicle, and if the driver is distracted by something other than the display device, the warning image may not be visible, which could result in a delayed response to the warning, leaving room for improvement.

[0005] Therefore, an object of the present invention is to solve the above problems and make it easier to notice warnings. [Means for solving the problem]

[0006] The driving assistance device of the present invention comprises: a hand information acquisition unit that acquires information about the vehicle user's hands, including the positions of the hands; a control unit that controls a projection device that projects display light toward a predetermined position inside the vehicle; Equipped with The control unit Vehicle information is input, and an alarm state determination process is performed to determine whether an alarm state exists based on the vehicle information. If an alarm state exists, the display light is projected onto the position of the hand of the vehicle user or in the vicinity of the hand position. 、 The control unit performs a projection area determination process to determine whether a projection area for projecting the display light is narrow based on information from the hand information acquisition unit, and when it is determined that the projection area is narrow, performs a second projection process to control the projection device to project and output the display light toward the periphery of the hand of the vehicle user. .

[0007] The driving assistance device of the present invention comprises: a hand information acquisition unit that acquires information about the vehicle user's hands, including the positions of the hands; a control unit that controls a projection device that projects display light toward a predetermined position inside the vehicle; Equipped with The control unit inputting vehicle information, performing an alarm state determination process to determine whether an alarm state is present based on the vehicle information, and if the alarm state is present, projecting the display light onto or near the position of the hand of the vehicle user; The control unit performs a distance determination process to determine whether the hand of the vehicle user is close to a vehicle part based on information from the hand information acquisition unit, and when it is determined that the hand is close to the vehicle part, performs a third projection process to control the projection device to project and output the display light toward a surface of the vehicle part near the hand. .

[0008] The driving assistance device of the present invention comprises: a hand information acquisition unit that acquires information about the vehicle user's hands, including the positions of the hands; a control unit that controls a projection device that projects display light toward a predetermined position inside the vehicle; Equipped with The control unit inputting vehicle information, performing an alarm state determination process to determine whether an alarm state is present based on the vehicle information, and if the alarm state is present, projecting the display light onto or near the position of the hand of the vehicle user; As the warning state determination process, the control unit determines from the vehicle information that the traveling speed of the vehicle is faster than a predetermined value, that a preceding vehicle located in front of the vehicle has moved forward from a stopped state, that an instruction from a traffic light has changed to a driving-enabled state, or that the vehicle has shifted from an automatic driving mode to a manual driving mode. .

[0009] The driving assistance device of the present invention comprises: a hand information acquisition unit that acquires information about the vehicle user's hands, including the positions of the hands; a control unit that controls a projection device that projects display light toward a predetermined position inside the vehicle; Equipped with The control unit inputting vehicle information, performing an alarm state determination process to determine whether an alarm state is present based on the vehicle information, and if the alarm state is present, projecting the display light onto or near the position of the hand of the vehicle user; the control unit performs a grip determination process to determine whether the vehicle user is gripping an object based on information from the hand information acquisition unit, and when it is determined that the vehicle user is gripping the object, performs a first projection process to control the projection device to project and output the display light toward the object; The control unit performs the grip determination process while the display light is being projected, and when it is determined that the vehicle user has released the object, performs a projection stop process of controlling the projection device to stop projecting the display light. .

[0010] The driving assistance device of the present invention comprises: a hand information acquisition unit that acquires information about the vehicle user's hands, including the positions of the hands; a control unit that controls a projection device that projects display light toward a predetermined position inside the vehicle; Equipped with The control unit inputting vehicle information, performing an alarm state determination process to determine whether an alarm state is present based on the vehicle information, and if the alarm state is present, projecting the display light onto or near the position of the hand of the vehicle user; the control unit performs a grip determination process to determine whether the vehicle user is gripping an object based on information from the hand information acquisition unit, and when it is determined that the vehicle user is gripping the object, performs a first projection process to control the projection device to project and output the display light toward the object; the control unit controllably connects a speaker mounted in the vehicle; The display light is projected and a sound generation process is performed in which the speaker generates a predetermined sound. Furthermore, the grip determination process is performed while the display light is projected, and when it is determined that the vehicle user has released the object, a sound generation stop process is performed in which the sound generation process by the speaker is stopped. . [Effects of the Invention]

[0015] According to the present invention, a driving assistance device that makes it easy for a vehicle user to notice warnings is provided. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a block diagram showing a system configuration related to a driving assistance device according to an embodiment of the present invention; [Figure 2] FIG. 10 is a diagram showing how display light is projected when a vehicle user is holding an object. [Figure 3] FIG. 10 is a diagram showing a state when display light is projected onto an object. [Figure 4] 10A and 10B are diagrams showing how display light is projected when a hand is close to a vehicle part; [Figure 5] This diagram shows what happens when the steering wheel is illuminated as well as the hands and surrounding area to alert drivers. [Figure 6] A diagram showing what happens when a warning message is displayed not only on the hands and the area around the hands but also on the head-up display. DETAILED DESCRIPTION OF THE INVENTION

[0017] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below with reference to the accompanying drawings, taking as an example an application to a vehicle display device mounted on an automobile.

[0018] As shown in FIG. 1, the driving assistance device A is communicatively connected to a camera B that photographs the inside of the vehicle, particularly the driver (vehicle user), an on-board electronic control unit (on-board ECU) C that detects various vehicle conditions and outputs signals as vehicle information, a projection device D that partially and selectively projects display light toward a desired position in or around the driver's seat inside the vehicle, a speaker E that sounds an alarm or the like that can be recognized by the vehicle user, and a display device F that is provided on the upper side of the instrument panel in front of the vehicle user (driver) seated in the driver's seat, for example, like a head-up display.

[0019] The driving assistance device A is configured to include a hand information acquisition unit 1 that analyzes the hand position, grip shape, etc. based on image information from a camera B and acquires this as hand information, and inputs the hand information and vehicle information from each on-board electronic control unit C, performs calculation processing based on this information (described later), and outputs control signals corresponding to the calculation results to a projection device D, a speaker E, and a display device F.

[0020] The vehicle information includes information that can determine whether the vehicle is in an alarm state or information that alerts the driver to a change in vehicle mode, such as the vehicle's traveling speed, information about a preceding vehicle moving forward from a stopped state, information about a traffic light indicating that the vehicle is ready to drive, information about the vehicle transitioning from an automatic driving mode to a manual driving mode, etc. The control unit 2 uses this vehicle information to perform an alarm state determination process that determines whether the vehicle is in an alarm state, and controls the projection device D based on the determination result.

[0021] The control unit 2 controls the projection device D, speaker E, and display device F depending on various situations so that the vehicle user can easily notice the output. For example, as shown in Fig. 2, while the vehicle is stopped or in automatic driving, the control unit 2 performs a grasping determination process to determine whether the hand 21 of the vehicle user 20 is grasping some object (in this case, a mobile terminal) 22 based on vehicle information and hand information.

[0022] When the control unit 2 determines through this grip determination process that the vehicle user 20 is gripping some kind of object 22, it presumes that the vehicle user 20 is concentrating on operating or displaying the object 22, and performs projection processing to output a control signal to the projection device D to project display light onto the hand 21 of the vehicle user 20 gripping the object 22 that is thought to be the object of concentration, and onto the surrounding area. This makes it possible to notify the vehicle user 20, who is not paying attention to the outside of the vehicle, of an alarm or caution state.

[0023] Furthermore, by mounting the projection device D on the top of the vehicle (inner surface of the roof), and more preferably near the head of the vehicle user 20, it is possible to reduce blind spots by assuming the position of the vehicle user's 20's hands 21, and also to project the image illuminated by the display light at an angle that is easy for the vehicle user 20 to see.

[0024] Furthermore, when the control unit 2 can recognize the object shape obtained by analyzing the image from the camera B, it can control the projection device D to project the display light 33 along the outer contour (frame) of the object 32 held in the hand 31 of the vehicle user 30 (first projection process), as shown in Fig. 3. In this case, the display visibility of the object (portable terminal) 32 and the operation input are less likely to be obstructed.

[0025] Furthermore, as mentioned above, the inventors have discovered that when an image is projected as display light, if the area of ​​the projection target is small, the content is difficult to see. To solve this problem, the control unit 2 determines the size of the projection target, and if it is small, can perform a second projection process to project the display light not only onto the hand 21 but also onto a wider area around the hand 21, or to project the display light onto a part of the body such as the arm, as shown in Figure 2.

[0026] The control unit 2 also performs a distance determination process to determine whether the position of the vehicle user's hand is close to the surface of a vehicle component such as the instrument panel, pillar, or steering wheel, and can project an image 44 as display light from the hand 41 (or object 42) onto a nearby component surface (in this case, the instrument panel surface) 43 (third projection process), as shown in FIG. 4. This makes it easy to secure a wide projection display surface, making it easy to convey the display content to the vehicle user. The projection device D projects images such as symbols and letters as display light in response to a control signal from the control unit 2, thereby adding meaning and making it easier for the vehicle user to judge the situation.

[0027] 5, when projecting a frame-shaped display light 53 or a symbolic display light 54 toward the vehicle user's hand 51 or object 52, the control unit 2 can urge the vehicle user to turn his / her gaze further forward toward the vehicle by illuminating a display light 56 ​​that illuminates the surface of the steering wheel 55 simultaneously or sequentially with the display lights 53 and 54. This also makes it easier for the vehicle user to notice that the information is from the vehicle.

[0028] 6, it is possible to guide the line of sight of the vehicle user 60 to the front of the vehicle and encourage the user's attention to look outside the vehicle by projecting a display light 63 onto the surface of an object 62 held in the hand 61 of the vehicle user 60, or by projecting a display image 65 onto a windshield 64 by a head-up display (display device F) in addition to the projection onto the hand 61 and object 62. Note that instead of a head-up display, a display provided on the top of the vehicle's instrument panel can be used as the display device F, and the line of sight can be guided by changing the display or color.

[0029] Such a driving assistance device A includes a hand information acquisition unit 1 that acquires information about the hands 21 of the vehicle user 20, including the position of the hands 21, and a control unit 2 that controls a projection device D that projects display light toward a predetermined position within the vehicle.The control unit 2 inputs vehicle information and performs an alarm state determination process that determines whether an alarm state is present from the vehicle information, and if the alarm state is present, projects the display light at the position of the hands 21 of the vehicle user 20 or near the position of the hands 21.

[0030] This projection output makes it easier for a vehicle user who is performing a task other than driving to notice the warning.

[0031] Furthermore, the control unit 2 performs a grasping determination process to determine whether or not the vehicle user 30 is grasping some kind of object 32 based on information from the hand information acquisition unit 1, and if it determines that the object 32 is being grasped, it performs a first projection process to control the projection device D to project and output display light 33 toward the object 32, thereby changing the lighting of the object 32 that is presumed to be the object of operation or viewing by the vehicle user 30, making it easier for the vehicle user 30 to notice the warning.

[0032] In addition, the control unit 2 performs a projection area determination process to determine whether the projection area for projecting the display light is narrow or not based on information from the hand information acquisition unit 1, and if it determines that the projection area is narrow, it performs a second projection process to control the projection device D to project and output the display light toward the periphery of the hand 21 of the vehicle user 20, thereby making it easier for the vehicle user to notice the attention-warning state.

[0033] In addition, the control unit 2 performs a distance determination process to determine whether the vehicle user's hand 41 is close to the vehicle part 43 based on information from the hand information acquisition unit 1, and if it determines that the hand 41 is close to the vehicle part 43, it performs a third projection process to control the projection device D to project and output display light 44 toward the surface of the vehicle part 43 near the hand 41, thereby making it easier for the vehicle user to notice the warning state.

[0034] In addition, as part of the warning state determination process, the control unit 2 determines from the vehicle information that the vehicle's traveling speed is faster than a predetermined value, or that a preceding vehicle located in front of the vehicle has moved forward from a stopped state, or that the traffic light indication has changed to a driving state, or that the vehicle has transitioned from automatic driving mode to manual driving mode, making it easier for vehicle users to notice any of these warning states.

[0035] The control unit 2 also controllably connects the speaker E mounted on the vehicle, projects the display light, and performs sound processing to make the speaker E emit a predetermined sound, thereby making it easier for the vehicle user to notice the alert state. The predetermined sound may be a pattern sound or a voice guide that explains the content of the warning.

[0036] In addition, the control unit 2 performs the grasping determination process while the display light is being projected, and if it determines that the vehicle user has released the object, it performs a projection stop process that controls the projection device to stop projecting the display light.In addition, the control unit 2 performs the grasping determination process while the display light is being projected, and if it determines that the vehicle user has released the object, it performs a ringing stop process that stops the ringing process by speaker E.

[0037] In addition, in a projection state in which display light 53, 54, 63 is projected toward the position of the vehicle user's 60's hands 51, 61 or near the position of the hands 51, 61, the control unit 3 can guide the vehicle user's 60's line of sight by prompting the head-up display or steering wheel 55 to simultaneously display a warning message.

[0038] Although the present embodiment has been described above, the present invention is not limited to the above embodiment and can be applied to various embodiments without departing from the spirit of the present invention. For example, by determining the operation state of a mobile terminal or the like by the control unit 2 based on not only hand information of the vehicle user but also line of sight detection, the state of the vehicle user can be determined more accurately and output by the projection device D at the optimal timing.

[0039] In addition, based on the information from the hand information acquisition unit 1, the fingertip direction and position (including the direction and range of change in position) can be used as an operation input means for the vehicle user, and can also be used as a system configuration with a so-called gesture operation function.

[0040] Furthermore, the above-mentioned display lights can be changed to attract the attention of vehicle users by flashing, changing brightness, changing color, moving the projection area, etc. Furthermore, the degree of change can be increased stepwise or continuously depending on time, status changes, priority, etc.

[0041] The present invention is also suitable as a driving assistance device mounted on a mobile body including, for example, an automobile, an agricultural machine, or a construction machine. [Explanation of symbols]

[0042] 1 Hand information acquisition part 2. Control section 20 Vehicle users (drivers) 21 moves 22 objects A. Driving assistance device D Projection device

Claims

1. a hand information acquisition unit that acquires information about the vehicle user's hands, including the positions of the hands; a control unit that controls a projection device that projects display light toward a predetermined position inside the vehicle; Equipped with The control unit inputting vehicle information, performing an alarm state determination process to determine whether an alarm state is present based on the vehicle information, and if the alarm state is present, projecting the display light onto or near the position of the hand of the vehicle user; The control unit performs a projection area determination process to determine whether a projection area for projecting the display light is narrow based on information from the hand information acquisition unit, and when it is determined that the projection area is narrow, performs a second projection process to control the projection device to project and output the display light toward the periphery of the hand of the vehicle user. A driving assistance device characterized by:

2. A hand information acquisition unit that acquires information about the vehicle user's hands, including the positions of their hands; a control unit that controls a projection device that projects display light toward a predetermined position inside the vehicle; Equipped with The control unit inputting vehicle information, performing an alarm state determination process to determine whether an alarm state is present based on the vehicle information, and if the alarm state is present, projecting the display light onto or near the position of the hand of the vehicle user; The control unit performs a distance determination process to determine whether the hand of the vehicle user is close to a vehicle part based on information from the hand information acquisition unit, and when it is determined that the hand is close to the vehicle part, performs a third projection process to control the projection device to project and output the display light toward a surface of the vehicle part near the hand. A driving assistance device characterized by:

3. A hand information acquisition unit that acquires information about the vehicle user's hands, including the positions of their hands; a control unit that controls a projection device that projects display light toward a predetermined position inside the vehicle; Equipped with The control unit inputting vehicle information, performing an alarm state determination process to determine whether an alarm state is present based on the vehicle information, and if the alarm state is present, projecting the display light onto or near the position of the hand of the vehicle user; As the warning state determination process, the control unit determines from the vehicle information that the traveling speed of the vehicle is faster than a predetermined value, that a preceding vehicle located in front of the vehicle has moved forward from a stopped state, that an instruction from a traffic light has changed to a driving-enabled state, or that the vehicle has shifted from an automatic driving mode to a manual driving mode. A driving assistance device characterized by:

4. A hand information acquisition unit that acquires information about the vehicle user's hands, including the positions of their hands; a control unit that controls a projection device that projects display light toward a predetermined position inside the vehicle; Equipped with The control unit inputting vehicle information, performing an alarm state determination process to determine whether an alarm state is present based on the vehicle information, and if the alarm state is present, projecting the display light onto or near the position of the hand of the vehicle user; the control unit performs a grip determination process to determine whether the vehicle user is gripping an object based on information from the hand information acquisition unit, and when it is determined that the vehicle user is gripping the object, performs a first projection process to control the projection device to project and output the display light toward the object; The control unit performs the grip determination process while the display light is being projected, and when it is determined that the vehicle user has released the object, performs a projection stop process of controlling the projection device to stop projecting the display light. A driving assistance device characterized by:

5. A hand information acquisition unit that acquires information about the vehicle user's hands, including the positions of their hands; a control unit that controls a projection device that projects display light toward a predetermined position inside the vehicle; Equipped with The control unit inputting vehicle information, performing an alarm state determination process to determine whether an alarm state is present based on the vehicle information, and if the alarm state is present, projecting the display light onto or near the position of the hand of the vehicle user; the control unit performs a grip determination process to determine whether the vehicle user is gripping an object based on information from the hand information acquisition unit, and when it is determined that the vehicle user is gripping the object, performs a first projection process to control the projection device to project and output the display light toward the object; the control unit controllably connects a speaker mounted in the vehicle; The display light is projected and a sound generation process is performed in which the speaker generates a predetermined sound. Furthermore, the grip determination process is performed while the display light is projected, and when it is determined that the vehicle user has released the object, a sound generation stop process is performed in which the sound generation process by the speaker is stopped. A driving assistance device characterized by:

Images