In-vehicle notification system
The vehicle notification system addresses the issue of multiple terminal identification by using dedicated installation sections and alertness monitoring to ensure safe and targeted notifications during automatic driving.
Patent Information
- Application Number
- JP2023075846
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-01
- Publication Date
- 2024-11-14
- Estimated Expiration
- 2043-05-01
AI Technical Summary
Existing driver monitoring systems fail to identify specific mobile terminals in vehicles with multiple devices, leading to unnecessary warnings during automatic driving.
A vehicle notification system with dedicated terminal installation sections around the driver's seat, allowing only the installed mobile terminal to receive notifications, and using a control unit to enable automatic driving when the terminal is detected, with alertness monitoring via the mobile terminal's camera.
Ensures targeted notifications to the correct mobile terminal and enables safe automatic driving by preventing warnings to undetected terminals, improving alertness monitoring and design integration.
Smart Images

Figure 2024160628000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a notification system for a vehicle. [Background technology]
[0002] Patent Document 1 discloses a driver monitoring system that monitors the driver by communicating between a mobile terminal and a vehicle control device. The driver monitoring system in Patent Document 1 determines whether the driver is looking at the display screen of the mobile terminal while the vehicle is traveling based on an image captured by the camera of the mobile terminal, and issues an alarm if it is determined that the driver is looking at the display screen of the mobile terminal. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2020-102252 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, in the driver monitoring system described in Patent Document 1, if there are multiple mobile terminals in the vehicle, the driver's mobile terminal cannot be identified, and a warning must be sent to all mobile terminals, which is inconvenient.
[0005] The present invention aims to provide a vehicle notification system capable of sending specified notifications only to specific mobile terminals in a vehicle capable of autonomous driving at level 3 or higher, where all driving operations are possible under certain conditions. [Means for solving the problem]
[0006] The vehicle notification system of claim 1 comprises a terminal installation unit provided near the driver's seat in a vehicle capable of autonomous driving where all driving operations are performed under certain conditions, and configured to be able to install a mobile terminal thereon, and a control unit that, when it detects a mobile terminal installed in the terminal installation unit, permits the autonomous driving and notifies the mobile terminal when certain conditions are satisfied in the autonomous driving state.
[0007] In the vehicle notification system according to claim 1, a terminal installation unit is provided around the driver's seat in a vehicle in which all driving operations are possible under certain conditions, and the terminal installation unit is configured to allow a mobile terminal to be installed therein. In addition, when the control unit detects a mobile terminal installed in the terminal installation unit, the control unit permits automatic driving and notifies the mobile terminal when a predetermined condition is satisfied in the automatic driving state. This makes it possible to notify only the mobile terminal installed in the terminal installation unit, even if there are multiple mobile terminals in the vehicle cabin. In addition, by not allowing automatic driving until a mobile terminal is installed in the terminal installation unit, it is possible to avoid a situation in which there is no mobile terminal to be notified in the automatic driving state.
[0008] The vehicle notification system of claim 2 is in claim 1, wherein the control unit acquires an image taken by a camera mounted on the mobile terminal, and allows the continuation of the autonomous driving state if the occupant's alertness is at or above a predetermined level based on the acquired image.
[0009] In the vehicle notification system according to claim 2, the occupant's wakefulness is determined based on an image captured by a camera mounted on a mobile device, so that the occupant's face can be photographed even if the occupant is looking down while operating the mobile device in an autonomous driving state. In other words, the occupant's face can be photographed more effectively than in a configuration using a camera installed on the vehicle's instrument panel or the like.
[0010] The vehicle notification system of claim 3 is the same as claim 1, in which the control unit warns the occupant when the occupant's alertness is below a predetermined level based on the image, or when the occupant's alertness cannot be determined.
[0011] In the vehicle notification system according to claim 3, when the occupant's wakefulness is below a predetermined level, that is, when the occupant is in a state where he or she cannot drive normally, a warning is issued, thereby making it possible to prepare for switching to manual driving. Also, when the occupant's wakefulness cannot be determined, a warning is issued in the same manner, thereby making it possible for the occupant to understand that the wakefulness could not be determined.
[0012] The notification system for a vehicle according to claim 4 is the same as claim 1, wherein the terminal installation unit is provided on at least one of an instrument panel and a steering wheel at a front part of a vehicle interior.
[0013] In the vehicle notification system according to claim 4, the mobile terminal can be installed on the instrument panel or steering wheel. This eliminates the need to prepare a separate part for installing the mobile terminal. In addition, the design can be improved compared to a structure using a separate holder or the like.
[0014] A fifth aspect of the present invention provides a vehicular notification system according to any one of the first to fourth aspects, wherein the control unit issues a warning when the detected mobile terminal moves away from the driver's seat by a predetermined distance or more.
[0015] In the vehicle notification system of claim 5, a warning is issued if the mobile terminal moves away from the driver's seat by a predetermined distance or more, so that the mobile terminal for sending notifications to the driver from the vehicle can always be located near the driver's seat. Effect of the Invention
[0016] As described above, the vehicle notification system of the present invention makes it possible to send specified notifications only to specific mobile terminals in a vehicle capable of autonomous driving at level 3 or higher, where all driving operations are possible under certain conditions. [Brief description of the drawings]
[0017] [Figure 1] 1 is a diagram showing a front passenger compartment of a vehicle to which a vehicle notification system according to an embodiment is applied. [Diagram 2] 1 is a schematic diagram illustrating a notification system for a vehicle according to an embodiment; [Diagram 3] 1 is a block diagram showing an example of a hardware configuration of a vehicle according to an embodiment. [Figure 4] FIG. 2 is a block diagram showing an example of a hardware configuration of a mobile terminal according to an embodiment. [Diagram 5] 2 is a block diagram showing an example of a functional configuration of a control unit in the embodiment. FIG. [Figure 6] 11 is a flowchart showing an example of the flow of a notification process in the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0018] A notification system 10 for a vehicle according to an embodiment will be described with reference to the drawings. Note that the arrow UP in Fig. 1 indicates the upper side in the vertical direction of the vehicle, and the arrow RH indicates the right side in the width direction of the vehicle. The vertical direction and the left-right direction in the following description respectively mean the up-down direction in the vertical direction of the vehicle and the left-right direction in the width direction of the vehicle.
[0019] As shown in Fig. 1, an instrument panel 13 is provided at the front of the passenger compartment of a vehicle V. The instrument panel 13 extends in the vehicle width direction, and a steering wheel 15 is provided on the right side of the instrument panel 13. That is, in this embodiment, as an example, a right-hand drive vehicle in which the steering wheel 15 is provided on the right side, and the driver's seat is set on the right side of the vehicle. However, the present invention is not limited to this, and may be applied to a vehicle in which the driver's seat is set on the left side of the vehicle.
[0020] The steering wheel 15 has a substantially annular rim portion 15A. A hub portion 15B constituting the center is provided on the inner periphery of the rim portion 15A, and the rim portion 15A and the hub portion 15B are connected by a plurality of spokes 15C (three in this embodiment).
[0021] Here, a first terminal installation section 17 is provided on the hub section 15B of the steering wheel 15. The first terminal installation section 17 is formed in a shape in which a part of the hub section 15B is recessed into a substantially rectangular shape to correspond to the shape of the mobile terminal, and is configured so that the mobile terminal can be set on the first terminal installation section 17. Also, as an example, in this embodiment, a first connection terminal 19 is provided on the first terminal installation section 17, and is configured so that the vehicle V and the mobile terminal can be electrically connected by inserting the first connection terminal 19 into a connection hole (not shown) formed in the mobile terminal.
[0022] The second terminal installation section 21 is provided at the center of the instrument panel 13 in the vehicle width direction. The second terminal installation section 21 is formed in a shape in which a part of the instrument panel 13 is recessed into a substantially rectangular shape so as to correspond to the shape of the mobile terminal, and is configured so that the mobile terminal can be set on the second terminal installation section 21. It is more preferable that the second terminal installation section 21 faces in a direction tilted upward from the horizontal direction so that the camera of the mobile terminal faces the face of the driver when the mobile terminal is installed. Specifically, the bottom surface of the recessed recess of the second terminal installation section 21 may be formed so as to gradually tilt upward from the rear side of the vehicle to the front side of the vehicle. Also, as an example, in this embodiment, the second terminal installation section 21 is provided with a second connection terminal 23, and is configured so that the vehicle V and the mobile terminal can be electrically connected by inserting the second connection terminal 23 into a connection hole (not shown) formed in the mobile terminal. Also, the second terminal installation section 21 may be configured so as to sandwich the mobile terminal to be installed from the side. The second terminal installation section 21 has an elastic clamping function, so that it can install a mobile terminal regardless of the type and size of the mobile terminal.
[0023] It is also possible to adopt a configuration that allows electrical connection to a mobile terminal in a non-contact manner without providing the first connection terminal 19 and the second connection terminal 23. For example, electrical connection to a mobile terminal may be achieved by providing a coil for non-contact charging inside the hub unit 15 or the instrument panel 13. Also, an NFC (Near field communication) tag or the like may be provided inside the hub unit 15 or the instrument panel 13.
[0024] The first terminal installation section 19 and the second terminal installation section 23 are configured so that a cover (not shown) can be attached when not in use. When a cover is attached to the steering wheel 15, the hub section 15B and the cover are flush with each other, preventing a decrease in design. Similarly, when a cover is attached to the instrument panel 13, the instrument panel 13 and the cover are flush with each other, preventing a decrease in design.
[0025] Here, a control unit 11 constituting a vehicle display control system 10 is provided in the vehicle V. The control unit 11 in this embodiment is, for example, an ECU (Electronic Control Unit) that performs various controls.
[0026] Fig. 2 is a schematic diagram showing a notification system for a vehicle according to an embodiment. As shown in Fig. 2, the notification system for a vehicle 10 according to the present embodiment includes a control unit 11 and a server 12. The control unit 11 and the server 12 are connected via a network N and are capable of communicating with each other. In addition, a plurality of mobile terminals 14 are capable of communicating with the control unit 11 via the network N.
[0027] The control unit 11 is configured to perform information processing between the server 12 and the mobile terminal 14. The control unit 11 may be provided outside the vehicle V. In this case, the control unit 11 is configured to be able to communicate with an on-board device or the like mounted on the vehicle V via the network N.
[0028] The vehicle V is configured to be switchable between automatic driving and manual driving. In particular, in this embodiment, the vehicle V is capable of automatic driving of level 3 or higher, which allows all driving operations under certain conditions.
[0029] Various data are stored in the server 12. In the present embodiment, as an example, the server 12 is configured to include a terminal database 16 and an occupant database 18. The terminal database 16 stores information about a plurality of mobile terminals 14 that may be brought into the vehicle V. For example, the terminal database 16 stores information such as the identification number and notification application of each mobile terminal 14.
[0030] The occupant database 18 stores information about multiple occupants who may possibly get in the vehicle V. For example, the occupant database 18 stores the identification number of each occupant, information about a mobile device held by the occupant, information about whether the occupant has a driver's license, and biometric information. The biometric information includes at least one of a fingerprint, a voiceprint, an iris, and a face, but is not limited thereto, and may also include vein information.
[0031] The mobile terminal 14 is a terminal that a passenger of the vehicle V can bring into the vehicle V, and includes a mobile phone, a smartphone, a tablet, a laptop-type personal computer, and the like. Although three mobile terminals 14 are illustrated in FIG. 1, the present invention is not limited to this, and four or more mobile terminals 14 may be connected to the network N. Conversely, two or less mobile terminals 14 may be connected to the network N.
[0032] The vehicle notification system 10 of this embodiment is configured as described above, and the control unit 11 is configured to permit autonomous driving when it detects a portable terminal 14 installed in the first terminal installation unit 17 or the second terminal installation unit 21 provided in the vehicle V, and to notify the portable terminal 14 when certain conditions are satisfied in the autonomous driving state.
[0033] (Hardware configuration of vehicle V) Fig. 3 is a block diagram showing an example of a hardware configuration of a vehicle V in an embodiment. As shown in Fig. 3, the vehicle V includes a communication bus 11, to which a control unit 11, an authentication device 32, a vehicle driving state detection sensor group 34, an automatic driving ECU 42, a surrounding situation acquisition device (not shown), and the like are electrically connected.
[0034] The control unit 11 includes a CPU (Central Processing Unit: processor) 20, a ROM (Read Only Memory) 22, a RAM (Random Access Memory) 24, a storage 26, and a communication interface (communication I / F) 28. Each component is connected to each other via an internal bus 30 so as to be able to communicate with each other.
[0035] The CPU 20 is a central processing unit that executes various programs and controls each part. That is, the CPU 20 reads the programs from the ROM 22 or the storage 26, and executes the programs using the RAM 24 as a working area. The CPU 20 also controls each of the above components and performs various arithmetic processing according to the programs recorded in the ROM 22 or the storage 26.
[0036] The ROM 22 stores various programs and various data. The RAM 24 temporarily stores programs or data as a working area. The storage 26 is a non-temporary recording medium configured with an HDD (Hard Disk Drive) or an SSD (Solid State Drive) and stores various programs including an operating system and various data. In this embodiment, the ROM 22 or the storage 26 stores programs for performing various processes.
[0037] The communication I / F 28 is an interface for the control unit 11 to communicate with the server 12, the mobile terminal 14, etc., and uses standards such as CAN (Controller Area Network), Ethernet (registered trademark), LTE (Long Term Evolution), FDDI (Fiber Distributed Data Interface), and Wi-Fi (registered trademark).
[0038] The authentication device 32 is connected to the first terminal installation unit 17 and the second terminal installation unit 21, and performs authentication of the mobile terminal 14 installed in the first terminal installation unit 17 or the second terminal installation unit 21. Authentication information authenticated by the authentication device 32 is transmitted to the control unit 11.
[0039] The vehicle driving condition detection sensor group 34 includes, as sensors for acquiring the driving condition of the vehicle V, a steering angle sensor 36 that detects the steering angle of the vehicle V, a vehicle speed sensor 38 that detects the driving speed of the vehicle V, and an acceleration sensor 40 that detects the acceleration applied to the vehicle V.
[0040] The autonomous driving ECU 42 is electrically connected to a throttle ACT 44 that changes the throttle opening of the vehicle V, a brake ACT 46 that changes the braking force, and a steering ACT 48 that changes the steering amount by the steering device. The autonomous driving ECU 42 is an ECU that performs autonomous driving processing to automatically drive the vehicle V without the driver of the vehicle V performing driving operations. In particular, in this embodiment, the autonomous driving ECU 42 is configured to be capable of autonomous driving processing of level 3 or higher. During autonomous driving of level 3 or higher, the driver is released from driving operations and does not need to pay attention to the area ahead of the vehicle. Therefore, during autonomous driving of level 3 or higher, the driver can operate the mobile terminal 14.
[0041] The autonomous driving ECU 42 includes a CPU (Central Processing Unit), memories such as ROM (Read Only Memory) and RAM (Random Access Memory), non-volatile storage units such as HDD (Hard Disk Drive) and SSD (Solid State Drive), and a communication I / F (Interface). The memory unit stores autonomous driving software.
[0042] Although not shown, the vehicle V is equipped with a surrounding condition acquisition device, which is electrically connected to the communication bus 11. The surrounding condition acquisition device is a group of sensors for acquiring surrounding information of the vehicle V when the vehicle V performs an autonomous driving process, and includes, for example, a GNSS (Global Navigation Satellite System) device, an in-vehicle communication device, a navigation system, a radar device, and a surrounding camera.
[0043] The GNSS device receives GNSS signals from multiple GNSS satellites to determine the position of the vehicle V. The in-vehicle communication device is a communication device that performs at least one of vehicle-to-vehicle communication with other vehicles and road-to-vehicle communication with roadside devices. The navigation system includes a map information storage unit that stores map information, and displays the position of the vehicle V on a map based on the position information obtained from the GNSS device and the map information stored in the map information storage unit. The radar device detects objects such as pedestrians and other vehicles present around the vehicle V as point cloud information, and obtains the relative positions and relative speeds of the detected objects and the vehicle V. In addition, the radar device excludes roadside objects such as noise and guardrails from monitoring targets based on changes in the relative positions and relative speeds of individual objects included in the most recent multiple detection results, and tracks and monitors specific objects such as pedestrians and other vehicles as monitoring targets. The peripheral cameras capture the surroundings of the vehicle V with multiple cameras and output the captured images.
[0044] (Hardware configuration of mobile terminal 14) Fig. 4 is a block diagram showing an example of a hardware configuration of a mobile terminal in an embodiment. As shown in Fig. 4, each mobile terminal 14 includes a CPU 52, a ROM 54, a RAM 56, a storage 58, a communication interface (communication I / F) 60, and an input / output interface (input / output I / F) 62. Each component is connected to each other via an internal bus 64 so as to be able to communicate with each other.
[0045] The CPU 52 is a central processing unit that executes various programs and controls each part. That is, the CPU 52 reads a program from the ROM 54 or the storage 58, and executes the program using the RAM 56 as a working area. The CPU 52 also controls each of the above components and performs various arithmetic processing according to the program recorded in the ROM 54 or the storage 58.
[0046] The ROM 54 stores various programs and various data. The RAM 56 temporarily stores programs or data as a working area. The storage 58 is a non-temporary recording medium configured with an HDD (Hard Disk Drive) or an SSD (Solid State Drive) and stores various programs including an operating system and various data. In this embodiment, the ROM 54 or the storage 58 stores programs for performing various processes.
[0047] The communication I / F 60 is an interface through which the mobile terminal 14 communicates with the control unit 11 and the like, and uses standards such as Ethernet (registered trademark), LTE (Long Term Evolution), FDDI (Fiber Distributed Data Interface), Wi-Fi (registered trademark), Bluetooth (registered trademark), and NFC (Near field communication).
[0048] A display panel 66, a speaker 68, a vibrator 70, a GPS device 72, and a camera 74 are electrically connected to the input / output I / F 62. The display panel 66 displays predetermined information. The speaker 68 is configured to be capable of outputting sound. The vibrator 70 vibrates when a predetermined signal is received. The GPS device 72 receives GPS signals from GPS satellites and determines the position of the mobile terminal 14. The camera 74 is configured to be capable of capturing images of the surroundings of the mobile terminal 14.
[0049] (Functional configuration of control unit 11) The control unit 11 in the vehicle notification system 10 realizes various functions using the above hardware resources. The functional configuration realized by the vehicle notification system 10 will be described with reference to FIG.
[0050] 5, the control unit 11 includes, as functional components, a terminal detection unit 80, an autonomous driving permission unit 82, an alertness determination unit 84, a warning unit 86, a vehicle information acquisition unit 88, and a notification unit 90. Each functional component is realized by the CPU 20 reading and executing a program stored in the ROM 22 or the storage 26.
[0051] The terminal detection unit 80 detects the mobile terminal 14 installed on the first terminal installation unit 17 or the second terminal installation unit 21. When mobile terminals 14 are installed on both the first terminal installation unit 17 and the second terminal installation unit 21, the terminal detection unit 80 preferentially detects the mobile terminal 14 installed on the first terminal installation unit 17.
[0052] In this embodiment, as an example, the detection of the portable terminal 14 by the terminal detection unit 80 is performed by receiving a signal indicating that the portable terminal 14 is connected to the first connection terminal 19 or the second connection terminal 23. Specifically, the terminal detection unit 80 detects the portable terminal 14 when the first connection terminal 19 and the portable terminal 14 are connected. Furthermore, the terminal detection unit 80 detects the portable terminal 14 when the first connection terminal 19 and the portable terminal 14 are not connected and the second connection terminal 21 and the portable terminal 14 are connected. Data related to the detected portable terminal 14 is stored in the terminal database 16. Furthermore, the occupant database 18 may be consulted to obtain data on the occupant who owns the detected portable terminal 14. The detection of the portable terminal by the terminal detection unit 80 is performed as follows:
[0053] Furthermore, as an example of the present embodiment, after the terminal detection unit 80 has completed detection of the portable terminal 14, even if the occupant removes the portable terminal 14 from the terminal installation unit, the control unit 11 and the portable terminal 14 are maintained in an electrically connected state. For example, even if the occupant removes the portable terminal 14 from the first terminal installation unit 17, the control unit 11 is configured to be able to send a predetermined notification to the portable terminal 14.
[0054] When the mobile terminal 14 is detected by the terminal detection unit 80, the autonomous driving permission unit 82 permits autonomous driving of the vehicle V. Specifically, the autonomous driving permission unit 82 permits the autonomous driving ECU 42 to perform autonomous driving processing of level 3 or higher.
[0055] The awakening level determination unit 84 determines the awakening level of an occupant (driver) seated in the driver's seat. Specifically, the awakening level determination unit 84 obtains an image captured by the camera 74 mounted on the mobile terminal 14, and determines the awakening level of the occupant based on the obtained image. In this embodiment, as an example, the cameras 74 are provided on both sides of the mobile terminal 14, and when the awakening level determination unit 84 cannot detect the face of the occupant based on the image captured by the camera 74 provided on one side, it detects the face of the occupant based on the image captured by the camera 74 provided on the other side.
[0056] The warning unit 86 warns the occupant when the occupant's wakefulness determined by the wakefulness determination unit 84 is below a predetermined level or when the occupant's wakefulness cannot be determined. The "predetermined level" here refers to a level that interferes with driving the vehicle V. The warning to the occupant may be, for example, by activating the vibrator 70 mounted on the mobile terminal 14 and emitting a warning sound from the speaker 68. As another method, the warning to the occupant may be issued using a speaker mounted on the vehicle V. Note that, when the occupant's wakefulness determined by the wakefulness determination unit 84 is equal to or higher than the predetermined level, the automatic driving state is permitted to continue and no warning is issued.
[0057] In addition, as an example in this embodiment, the warning unit 86 is configured to issue a warning when the detected mobile terminal 14 is away from the driver's seat by a predetermined distance or more. Specifically, when the mobile terminal 14 is located in the back seat based on a signal from the GPS device 72 mounted on the mobile terminal 14, the warning unit 86 issues a warning to the occupant. In addition, when the mobile terminal 14 and the vehicle V are connected by Bluetooth, the detailed position of the mobile terminal 14 can be grasped, so that when it is detected that the mobile terminal 14 is away from the driver's seat, the warning unit 86 may issue a warning to the occupant.
[0058] The vehicle information acquisition unit 88 acquires information such as the driving state of the vehicle V. For example, the vehicle information acquisition unit 88 acquires that the vehicle V is in an autonomous driving state of level 3 or higher (an autonomous driving state in which all driving operations are performed by the vehicle).
[0059] The notification unit 90 notifies the driver's terminal when the state of the vehicle V acquired by the vehicle information acquisition unit 88 satisfies a predetermined condition. For example, the notification unit 90 notifies the driver's terminal when the distance or time until the vehicle V transitions from a level 3 autonomous driving state to a level 2 autonomous driving state becomes less than a predetermined value. Also, for example, the notification unit 90 notifies the driver's terminal when the distance or time until the vehicle V transitions from a level 3 autonomous driving state to manual driving becomes less than a predetermined value.
[0060] Furthermore, the notification unit 90 may notify the driver's terminal when the vehicle V is in a level 3 autonomous driving state and suggestions such as lane changes, route changes, and overtaking are made. Additionally, the notification unit 90 may notify the driver's terminal when the vehicle V is low on fuel or the remaining battery charge is low. Furthermore, the notification unit 90 may notify the driver's terminal when the system transitions to a Minimum Risk Maneuver (MRM) state, which is motion control of the vehicle V up to Minimum Risk Condition (MRC).
[0061] (action) Next, the operation of this embodiment will be described.
[0062] An example of the notification process by the vehicular notification system 10 of this embodiment will be described with reference to the flowchart shown in Fig. 6. These display processes are executed by the CPU 20 reading out a display program from the ROM 22 or the storage 26, and expanding and executing the program in the RAM 24. Note that, as an example, the following notification process is started when the vehicle V is started.
[0063] (An example of notification processing) The CPU 20 determines whether or not a mobile terminal has been detected in step S102. Specifically, when the mobile terminal 14 is connected to the first connection terminal 19 of the first terminal installation unit 17 by the function of the terminal detection unit 80, the CPU 20 determines that the mobile terminal 14 has been detected. Also, when the mobile terminal 14 is connected to the second connection terminal 23 of the second terminal installation unit 21 by the function of the terminal detection unit 80, the CPU 20 determines that the mobile terminal 14 has been detected. Note that, when the mobile terminals 14 are installed in both the first terminal installation unit 17 and the second terminal installation unit 21, the terminal detection unit 80 preferentially detects the mobile terminal 14 installed in the first terminal installation unit 17. When the CPU 20 determines that the mobile terminal 14 has been detected, the CPU 20 proceeds to processing in step S104. Also, when the CPU 20 determines that the mobile terminal 14 has not been detected, the CPU 20 ends this notification processing without permitting automatic driving.
[0064] In step S104, the CPU 20 permits the autonomous driving of the vehicle V. Specifically, the CPU 20, through the function of the autonomous driving permission unit 82, permits the autonomous driving ECU 42 to perform autonomous driving processing of level 3 or higher.
[0065] The CPU 20 determines whether or not the vehicle is in an autonomous driving state in step S106. Specifically, when the vehicle V starts autonomous driving of level 3 or higher, the CPU 20 determines that the vehicle is in an autonomous driving state based on a signal from the autonomous driving ECU 42, and proceeds to processing in step S108. On the other hand, when the CPU 20 determines that the vehicle is not in an autonomous driving state in step S106, there is no need to notify the occupant, and therefore the notification processing ends.
[0066] The CPU 20 determines whether or not notification is necessary in step S108. Specifically, the CPU 20 acquires the state of the vehicle V, and determines whether or not a notification to the occupant is necessary, such as when the distance or time until the vehicle V transitions from a level 3 autonomous driving state to a level 2 autonomous driving state becomes less than a predetermined value. If it is determined that notification to the occupant is necessary, the CPU 20 proceeds to processing in step S110, and performs a predetermined notification to the occupant using the function of the notification unit 90.
[0067] On the other hand, if the CPU 20 determines in step S108 that notification is not necessary, the process proceeds to step S112 without performing the process in step S110.
[0068] In step S112, the CPU 20 determines whether the occupant's alertness is high. Specifically, the CPU 20 acquires an image captured by the camera 74 mounted on the mobile terminal 14 using the function of the alertness determination unit 84, and determines the alertness of the occupant based on the acquired image. If the CPU 20 determines in step S112 that the alertness of the occupant is equal to or higher than a predetermined level, there is no need to warn the occupant, and therefore the notification process ends while maintaining the automatic driving state.
[0069] On the other hand, when the CPU 20 determines in step S112 that the wakefulness of the occupant is less than the predetermined level, the process proceeds to step S114, where the CPU 20 issues a warning to the occupant. Specifically, the CPU 20 issues a warning to the occupant in a predetermined manner using the function of the warning unit 86. For example, the CPU 20 may use a method of activating the vibrator 70 mounted on the mobile terminal 14 and emitting a warning sound from the speaker 68. Alternatively, the CPU 20 may issue a warning to the occupant using a speaker mounted on the vehicle V.
[0070] As described above, according to the vehicle notification system 10 of this embodiment, as shown in FIG. 1, the first terminal installation unit 17 and the second terminal installation unit 21 are provided around the driver's seat of the vehicle V in which all driving operations are possible under certain conditions, and these terminal installation units are configured to allow a mobile terminal to be installed. In addition, when the control unit 11 detects the mobile terminal 14 installed in at least one of the first terminal installation unit 17 and the second terminal installation unit 21, it permits automatic driving and notifies the mobile terminal 14 when a predetermined condition is satisfied in the automatic driving state. As a result, even if there are multiple mobile terminals in the vehicle cabin, it is possible to notify only the mobile terminal 14 installed in at least one of the first terminal installation unit 17 and the second terminal installation unit 21. In addition, by not allowing automatic driving until the mobile terminal 14 is installed in the first terminal installation unit 17 or the second terminal installation unit 21, a situation in which there is no mobile terminal to be notified in the automatic driving state can be avoided.
[0071] In addition, in this embodiment, the wakefulness of the occupant is determined based on an image captured by the camera 74 mounted on the mobile terminal 14, so that the occupant's face can be captured even when the occupant is looking down while operating the mobile terminal 14 in an autonomous driving state. That is, the occupant's face can be captured more effectively than in a configuration using a camera installed on the instrument panel 13 of the vehicle V or the like.
[0072] Furthermore, in this embodiment, if the occupant's wakefulness is below a predetermined level, that is, if the occupant is in a state where he or she cannot drive normally, a warning is issued, thereby making it possible to prepare for switching to manual driving. Also, if the occupant's wakefulness cannot be determined, a warning is issued in a similar manner, so that the occupant can understand that the wakefulness cannot be determined.
[0073] Furthermore, in this embodiment, the mobile terminal can be installed on at least one of the instrument panel 13 and the steering wheel 15. This eliminates the need to prepare a separate part for installing the mobile terminal 14. Also, the first terminal installation portion 17 is integrally provided on the steering wheel 15, and the second terminal installation portion 21 is integrally provided on the instrument panel 13. This improves the design compared to a structure using a separate holder or the like.
[0074] In addition, in this embodiment, by issuing a warning when the mobile terminal 14 moves away from the driver's seat by a predetermined distance or more, the mobile terminal for notifying the driver from the vehicle side can be always located near the driver's seat.
[0075] Although the notification system 10 for a vehicle according to the embodiment has been described above, it is needless to say that the present invention can be embodied in various forms without departing from the scope of the present invention. In the above embodiment, as shown in FIG. 1, the first terminal installation section 17 is formed in a horizontally elongated substantially rectangular shape, but the present invention is not limited thereto and may be formed in a vertically elongated substantially rectangular shape. The angle of the first terminal installation section 17 may be changed by the operation of the occupant. For example, if the mounting seat of the first terminal installation section 17 is configured to be rotatable with respect to the main body of the steering wheel 15, the occupant can change the angle to any angle with the mobile terminal 14 installed on the first terminal installation section 17.
[0076] In addition, in the present embodiment, the structure in which the first terminal installation section 17 is provided on the steering wheel 15 and the second terminal installation section 21 is provided on the instrument panel 13 has been described, but the present invention is not limited to this, and the terminal installation section may be provided in another location. For example, the terminal installation section may be provided on the armrest of the driver's seat or on the center console between the driver's seat and the passenger seat. Also, in a structure in which a foldable sun visor is provided above the driver's seat, the terminal installation section may be provided on the sun visor. This allows the mobile terminal 14 to be installed at eye level of the occupant.
[0077] 5 is configured to issue a warning when the detected mobile terminal 14 is moved away from the driver's seat by a predetermined distance or more, but is not limited thereto. For example, the warning may be issued when the mobile terminal 14 is removed from the terminal installation part. In this case, the occupant needs to operate the mobile terminal 14 while the mobile terminal 14 is installed in the terminal installation part, and the mobile terminal 14 can be reliably prevented from moving away from the driver's seat.
[0078] Furthermore, in the above embodiment, the CPU 20 starts the process shown in FIG. 6 when the vehicle V is started, but the timing when the CPU 20 starts the process is not limited to this. For example, when the vehicle V starts from a stopped state, the CPU 20 may set the driver's terminal by performing a series of processes shown in FIG. 6. More specifically, when the shift position of the vehicle V is switched from PARKING to DRIVE or REVERSE, the CPU 20 may perform a series of processes shown in FIG. 6. Furthermore, when transitioning to an automatic driving state, the CPU 20 may detect the mobile terminal 14 by performing a series of processes shown in FIG. 6.
[0079] In addition, the processing executed by the CPU 20 by reading the program in the above embodiment may be executed by various processors other than the CPU 20. Examples of the processor in this case include a PLD (Programmable Logic Device) whose circuit configuration can be changed after manufacture such as an FPGA (Field-Programmable Gate Array), and a dedicated electric circuit which is a processor having a circuit configuration designed exclusively for executing a specific processing such as an ASIC (Application Spec Integrated Circuit). The above processing may be executed by one of these various processors, or may be executed by a combination of two or more processors of the same or different types, for example, by a plurality of FPGAs, or a combination of a CPU and an FPGA. The hardware structure of these various processors is, more specifically, an electric circuit that combines circuit elements such as semiconductor elements.
[0080] Furthermore, in the above embodiment, various data is stored in the storage 26, but the present invention is not limited to this. For example, a non-transitory recording medium such as a CD (Compact Disk), a DVD (Digital Versatile Disk), or a USB (Universal Serial Bus) memory may be used as the storage unit. In this case, various programs and data are stored in these recording media.
[0081] Furthermore, the process flow described in the above embodiment is an example, and unnecessary steps may be deleted, new steps may be added, or the order of processes may be changed without departing from the scope of the present invention. For example, in the notification process shown in Fig. 6, the CPU 20 may perform the process of step S102 after the process of step S106. In this case, when the mobile terminal 14 cannot be detected and notification is required, the CPU 20 may notify a display mounted on the vehicle V, without notifying the driver's terminal.
[0082] Regarding the above embodiment, the following supplementary notes are further disclosed.
[0083] (Appendix 1) A terminal installation unit is provided near a driver's seat in a vehicle capable of automatic driving and performing all driving operations under certain conditions, and is configured to be able to install a mobile terminal therein; a control unit that permits the autonomous driving when a portable terminal installed in the terminal installation unit is detected, and notifies the portable terminal when a predetermined condition is satisfied in the autonomous driving state; A notification system for a vehicle comprising: (Appendix 2) The control unit of the vehicle notification system described in Appendix 1 acquires an image taken by a camera mounted on the mobile terminal, and allows the continuation of the autonomous driving state if the occupant's alertness is at or above a predetermined level based on the acquired image. (Appendix 3) The control unit of the vehicle notification system of claim 2 issues a warning to the occupant when the occupant's level of alertness is below a predetermined level based on the image, or when the occupant's level of alertness cannot be determined. (Appendix 4) 4. The notification system for a vehicle according to claim 1, wherein the terminal installation unit is provided on at least one of an instrument panel at a front part of a vehicle interior and a steering wheel. (Appendix 5) 5. The notification system for a vehicle according to claim 1, wherein the control unit issues a warning when the detected mobile terminal is away from the driver's seat by a predetermined distance or more. [Explanation of symbols]
[0084] 10 Vehicle Notification System 11 Control section 13. Instrument Panel 15 Steering wheel (steering) 17 First Terminal Installation Section 21 Second Terminal Installation Section 74 Camera 92 Notification Department V Vehicle
Claims
1. A terminal installation unit is provided near a driver's seat in a vehicle capable of automatic driving and performing all driving operations under certain conditions, and is configured to be able to install a mobile terminal therein; a control unit that permits the autonomous driving when a portable terminal installed in the terminal installation unit is detected, and notifies the portable terminal when a predetermined condition is satisfied in the autonomous driving state; A notification system for a vehicle comprising:
2. The vehicle notification system of claim 1, wherein the control unit acquires an image taken by a camera mounted on the mobile terminal, and allows the continuation of the autonomous driving state if the occupant's level of alertness is determined to be at or above a predetermined level based on the acquired image.
3. The vehicle notification system according to claim 2, wherein the control unit issues a warning to the occupant when the occupant's level of alertness is below a predetermined level based on the image and / or when the occupant's level of alertness cannot be determined.
4. The notification system for a vehicle according to claim 1 , wherein the terminal installation unit is provided on at least one of an instrument panel and a steering wheel at a front portion of a vehicle interior.
5. The notification system for a vehicle according to any one of claims 1 to 4, wherein the control unit issues a warning when the detected mobile terminal is away from the driver's seat by a predetermined distance or more.
Citation Information
Patent Citations
In-vehicle cellular phone system, in-vehicle cellular phone communication method, mobile terminal, and in-vehicle unit
JP2010239283A
Vehicle control system
JP2014204242A
Driver monitoring system
JP2017157196A
Drive support device, drive support method, and program
JP2017167091A
Dangerous driving prevention device
JP2020052482A
