Automatic operation system, automatic operation system control method, and automatic operation system terminal case
The automatic driving system with a terminal case that shields the mobile device screen addresses the issue of drivers not noticing warnings, effectively redirecting their attention to driving, enhancing safety.
Patent Information
- Application Number
- JP2023078410
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-11
- Publication Date
- 2024-11-21
AI Technical Summary
Drivers wearing earphones may not notice warnings when using a mobile device during automatic driving, making it difficult to focus on vehicle operation.
An automatic driving system with a terminal case that can switch a mobile device screen between visible and shielded states, using a mechanical opening/closing mechanism or variable transmittance screen, to ensure the driver's attention is directed to driving.
The system quickly redirects the driver's attention to vehicle operation by shielding the mobile device screen, reducing the time to respond to driving changes and ensuring safety.
Smart Images

Figure 2024162670000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an automated driving system, a control method for an automated driving system, and a terminal case for an automated driving system. [Background technology]
[0002] Conventionally, a known technical document related to an autonomous driving system is Japanese Patent No. 6917708. This publication describes a system that determines whether the driver is looking at the screen of a mobile device while the vehicle is under autonomous driving control, based on an image captured by a camera device, and issues a warning with content according to the level of autonomous driving control if it is determined that the driver is looking at the screen. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Patent No. 6917708 Summary of the Invention [Problem to be solved by the invention]
[0004] However, even if a warning is issued to a driver who is concentrating on viewing or operating a mobile device, the driver may not notice the warning if they are wearing earphones, etc. For this reason, there is a demand for technology that makes it easier for drivers to focus their attention on driving the vehicle. [Means for solving the problem]
[0005] One aspect of the present invention is an autonomous driving system that is connected to a terminal case for the autonomous driving system or a portable terminal attached to a vehicle driver's portable terminal and controls the autonomous driving of the vehicle, in which the terminal case for the autonomous driving system has a lid portion that can switch the screen of the portable terminal between a visible state and a hidden state, and when the driver is requested to operate the vehicle during autonomous driving control, the screen of the portable terminal is switched from a visible state to a hidden state by controlling the portable terminal or the terminal case for the autonomous driving system.
[0006] According to an autonomous driving system of one aspect of the present invention, when the driver is requested to drive the vehicle during autonomous driving control, the screen of the mobile device is switched from a visible state to an obscured state. Therefore, compared to a case where only an alarm is output, the driver's attention can be quickly directed to taking over driving of the vehicle even if the driver is engrossed in viewing or operating the mobile device.
[0007] In an autonomous driving system according to one embodiment of the present invention, autonomous driving control does not need to be started unless communication is established with a terminal case for the autonomous driving system and the terminal case for the autonomous driving system is attached to a mobile terminal. According to this autonomous driving system, the driver can attach a terminal case for the autonomous driving system to a mobile terminal in order to start autonomous driving control.
[0008] In an autonomous driving system according to one embodiment of the present invention, the lid portion of the terminal case for the autonomous driving system has an opening and closing mechanism capable of covering the screen of the mobile terminal, and the screen may be switched from a visible state to a covered state by covering the screen with the opening and closing mechanism. According to this autonomous driving system, the screen of the driver's mobile device can be mechanically switched from a visible state to a hidden state by the opening and closing mechanism of the terminal case for the autonomous driving system.
[0009] In an autonomous driving system according to one embodiment of the present invention, the lid portion of the terminal case for the autonomous driving system has a variable transmittance screen that covers the screen of the mobile terminal, and the screen can be switched from a visible state to a hidden state by changing the transmittance of the variable transmittance screen. According to this autonomous driving system, the screen can be switched from a visible state to a blocked state with a simple configuration by changing the transmittance of the variable transmittance screen of the terminal case for the autonomous driving system.
[0010] In an autonomous driving system according to one embodiment of the present invention, after the screen of a mobile device is switched from a visible state to an obscured state, if a driving behavior of the driver is detected, the screen of the mobile device may be returned from the obscured state to a visible state. According to this autonomous driving system, when the driver's driving behavior is detected, the screen of the mobile device is returned from an obscured state to a visible state, thereby shortening the time during which the driver is unable to judge the urgency of the notification content because they are unable to see the screen when a notification arrives on the mobile device.
[0011] Another aspect of the present invention is a control method for an autonomous driving system that is connected to a terminal case for the autonomous driving system or a portable terminal attached to a vehicle driver's portable terminal and performs autonomous driving control of the vehicle, wherein the terminal case for the autonomous driving system has a lid portion that can switch the screen of the portable terminal between a visible state and a hidden state, and when the driver is requested to operate the vehicle during autonomous driving control, the screen of the portable terminal is switched from the visible state to the hidden state by controlling the portable terminal or the terminal case for the autonomous driving system.
[0012] According to a control method for an autonomous driving system relating to another aspect of the present invention, when the driver is requested to drive the vehicle during autonomous driving control, the screen of the mobile device is switched from a visible state to an obscured state. Therefore, compared to a case where only an alarm is output, the driver's attention can be quickly directed to taking over driving of the vehicle even if the driver is engrossed in viewing or operating the mobile device.
[0013] Yet another aspect of the present invention is a terminal case for an autonomous driving system that is connected to communicate with a vehicle's autonomous driving system and is attached to a mobile device of a driver of the vehicle, the terminal case having a lid that is placed against the screen of the mobile device and can switch the screen between a visible state and a hidden state, and when the autonomous driving system requests the driver to operate the vehicle during autonomous driving control of the vehicle, the screen of the mobile device is switched from the visible state to the hidden state.
[0014] According to a terminal case for an autonomous driving system relating to yet another aspect of the present invention, when the driver is requested to operate the vehicle during autonomous driving control, the screen of the mobile device is switched from a visible state to an obscured state. Therefore, compared to a case in which only an alarm is output, the driver's attention can be quickly directed to taking over driving of the vehicle even if the driver is engrossed in viewing or operating the mobile device.
[0015] In a terminal case for an autonomous driving system according to yet another aspect of the present invention, autonomous driving control does not have to be initiated by the autonomous driving system unless the terminal case is attached to a mobile terminal. According to this terminal case for an autonomous driving system, the driver can attach the terminal case for an autonomous driving system to a mobile terminal in order to start autonomous driving control.
[0016] In yet another aspect of the present invention, a terminal case for an autonomous driving system has an opening and closing mechanism capable of shielding the screen of a mobile terminal, and the screen can be switched from a visible state to a shielded state by shielding the screen with the opening and closing mechanism. This terminal case for an autonomous driving system allows the screen of the driver's mobile device to be switched from a visible state to a hidden state using an opening and closing mechanism.
[0017] In yet another aspect of the present invention, a terminal case for an autonomous driving system has a variable transmittance screen that covers the screen of the mobile terminal, and the screen can be switched from a visible state to a hidden state by changing the transmittance of the variable transmittance screen. With this terminal case for an autonomous driving system, the screen of the driver's mobile device can be switched from a visible state to a blocked state by changing the transmittance of the variable transmittance screen.
[0018] In a terminal case for an autonomous driving system relating to yet another aspect of the present invention, after the screen of the portable terminal is switched from a visible state to a hidden state, when the autonomous driving system detects the driving behavior of the driver, the screen of the portable terminal may be returned from the hidden state to a visible state. This terminal case for an autonomous driving system returns the mobile device screen from a hidden state to a visible state when the driver's driving behavior is detected, thereby shortening the time when the driver is unable to judge the urgency of the notification content because they cannot see the screen when a notification arrives on the mobile device. Effect of the Invention
[0019] According to each aspect of the present invention, when the driver is requested to operate the vehicle during automatic driving control, the driver's attention can be quickly directed to taking over driving of the vehicle. [Brief description of the drawings]
[0020] [Figure 1] FIG. 1 is a diagram illustrating an autonomous driving system according to an embodiment. [Diagram 2] 1A is a diagram showing an example of a lid portion of a terminal case for an autonomous driving system, and FIG. 1B is a diagram showing an example of a main body portion of a terminal case for an autonomous driving system as viewed from the front. [Diagram 3] 1A is a diagram showing an example of a main body of a terminal case for an autonomous driving system as viewed from the back, and FIG. 1B is a diagram showing an example of a configuration of an IC box. [Figure 4] FIG. 13 is a diagram showing a lid portion of a terminal case for an autonomous driving system in a modified example. [Diagram 5] 1 is a flowchart showing an example of an autonomous driving control start process of an autonomous driving system. [Figure 6] 11 is a flowchart illustrating an example of a driving change request process of the autonomous driving system. [Figure 7] 13 is a flowchart illustrating another example of a driving change request process of the autonomous driving system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0021] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
[0022] FIG. 1 is a diagram showing an automatic driving system according to an embodiment. The automatic driving system 100 shown in FIG. 1 is a system that is installed in a vehicle such as a passenger car and controls automatic driving of the vehicle. Automatic driving control is vehicle control that automatically drives the vehicle along a preset route. With automatic driving control, the driver does not need to perform driving operations, and the vehicle drives automatically.
[0023] The autonomous driving system 100 includes an autonomous driving ECU [Electronic Control Unit] 10 that manages the system in an integrated manner. The autonomous driving ECU 10 is an electronic control unit having a central processing unit [CPU] and a storage unit such as a read only memory [ROM] or a random access memory [RAM]. In the autonomous driving ECU 10, for example, various functions are realized by the CPU executing a program stored in the storage unit. The autonomous driving ECU 10 may be composed of multiple electronic units. Details of the autonomous driving ECU 10 will be described later.
[0024] The autonomous driving system 100 has a terminal case 1 for the autonomous driving system that is attached to a mobile terminal 50 of a driver of a vehicle. The mobile terminal 50 is a mobile information terminal owned by the driver. The mobile terminal 50 is, for example, a smartphone. The mobile terminal 50 is, for example, configured by a computer including a processor such as a CPU [Central Processing Unit], a memory such as a ROM [Read Only Memory] or a RAM [Random Access Memory], a communication device, and an interface including a display / touch panel screen. The mobile terminal 50 does not necessarily have to have a telephone function. The mobile terminal 50 may be connected to the autonomous driving system 100 by wireless communication and registered in the autonomous driving system 100 as the driver's mobile terminal.
[0025] The terminal case 1 for the autonomous driving system is a terminal case attached to the mobile terminal 50. The terminal case 1 for the autonomous driving system is formed as a rectangular case attached to the mobile terminal 50, which is, for example, a rectangular plate-shaped smartphone. The terminal case 1 for the autonomous driving system is configured to be able to switch the screen of the mobile terminal 50 from a visible state to a blocked state. The visible state is a state in which the driver can view the screen of the mobile terminal 50. The blocked state is a state in which the driver cannot view the screen of the mobile terminal 50.
[0026] The terminal case 1 for an autonomous driving system switches the screen of the mobile terminal 50 from a visible state to a shielded state, for example, by shielding the screen with a mechanical opening and closing mechanism. The opening and closing mechanism is a mechanism that can shield the screen of the mobile terminal 50. The terminal case 1 for an autonomous driving system may switch the screen of the mobile terminal 50 from a visible state to a shielded state by changing the transmittance of a variable transmittance screen that covers the screen of the mobile terminal 50. Details will be described later.
[0027] The terminal case 1 for the autonomous driving system is connected to the autonomous driving system 100 by a communication cable. There are no particular limitations on the standard, type, or length of the communication cable. The terminal case 1 for the autonomous driving system may be connected to the autonomous driving system 100 by wireless communication instead of by wire. When the autonomous driving system 100 requests the driver to operate the vehicle during autonomous driving control, the terminal case 1 for the autonomous driving system switches the screen of the mobile terminal 50 from a visible state to a blocked state in response to a signal from the autonomous driving system.
[0028] [Configuration of terminal case for autonomous driving system] Hereinafter, an example of the configuration of the terminal case 1 for an autonomous driving system will be described. Fig. 2(a) is a diagram showing an example of a lid portion 1a of the terminal case 1 for an autonomous driving system. Fig. 2(b) is a diagram showing an example of a main body portion 1b of the terminal case 1 for an autonomous driving system as viewed from the front.
[0029] 2(a) and 2(b), the terminal case 1 for an autonomous driving system has a lid portion 1a and a main body portion 1b. The lid portion 1a and the main body portion 1b are assembled so as to sandwich the mobile terminal 50, thereby forming a box-shaped case that covers the mobile terminal 50. The lid portion 1a and the main body portion 1b do not need to be independent members, and may be partially connected.
[0030] The cover 1a is disposed with respect to the screen of the mobile terminal 50, and is configured to be able to switch the screen of the mobile terminal 50 from a visible state to a shielded state. As shown in FIG. 2(a), the cover 1a has an opening / closing mechanism 2. The opening / closing mechanism 2 is a mechanism for mechanically switching the screen of the mobile terminal 50 between a visible state and a shielded state. The opening / closing mechanism 2 may be of a sliding type or a rotating hinge type as long as it is possible to shield the screen of the mobile terminal 50. The opening / closing mechanism 2 does not necessarily need to shield the entire screen of the mobile terminal 50, and may be of a type that shields a part of the screen. The opening / closing mechanism 2 is automatically opened and closed by the drive of a small motor described later. The terminal case 1 for the autonomous driving system may be of a type that transmits a signal to the autonomous driving system 100 every time the opening / closing mechanism 2 is opened and closed.
[0031] 2(b), the main body 1b has a camera opening 3 for exposing a camera unit on the back surface of the mobile terminal 50, and a mobile terminal connection terminal 4 to be inserted into a charging port of the mobile terminal 50. The main body 1b does not necessarily have to cover the back surface of the mobile terminal 50, and may be a frame-shaped member. In addition, the main body 1b does not necessarily have to have the camera opening 3.
[0032] The mobile terminal connection terminal 4 is provided to protrude from the inside of the main body 1b, and is fixed in position so as to be inserted into a charging port of the mobile terminal 50 when the case is attached. The shape of the mobile terminal connection terminal 4 is not limited as long as it can be mechanically connected to the mobile terminal 50.
[0033] Fig. 3(a) is a diagram showing an example of the main body 1b of the terminal case 1 for an autonomous driving system as viewed from the back. As shown in Fig. 3(a), an IC [Integrated Circuit] box 5 is provided at the bottom of the back surface of the main body 1b. The IC box 5 is a portion for storing an IC for detecting that the terminal case 1 for an autonomous driving system is attached to a mobile terminal 50. The IC box 5 may be embedded in the main body 1b.
[0034] Fig. 3(b) is a diagram showing an example of the configuration of the IC box 5. As shown in Fig. 3(b), the IC box 5 has an IC 20, an external cord connection port 21, and a small motor 22. In addition, the IC box 5 is connected to the mobile terminal connection terminal 4.
[0035] The IC20 detects that the main body part 1b of the terminal case 1 for an autonomous driving system has been attached to the mobile terminal 50 via the mobile terminal connection terminal 4. The IC20 detects the attachment of the main body part 1b to the mobile terminal 50, for example, by detecting a voltage change caused by connecting the mobile terminal connection terminal 4 to a charging port of the mobile terminal 50. The IC20 may detect the attachment of the main body part 1b by having the mobile terminal 50 recognize the connection of the mobile terminal connection terminal 4 via a contact switch of the charging port or the like, and acquiring a connection signal from the mobile terminal 50.
[0036] The IC 20 detects the attachment of the terminal case 1 for an autonomous driving system to the mobile terminal 50 by assembling the lid 1a to the main body 1b attached to the mobile terminal 50. The IC 20 detects the attachment of the lid 1a to the main body 1b by, for example, pressing a contact switch provided on the main body 1b by assembling the lid 1a. The IC 20 may detect the attachment of the lid 1a to the main body 1b by energizing current paths formed in the lid 1a and the main body 1b, respectively.
[0037] The external cord connection port 21 is a portion to which a communication cable from the autonomous driving system 100 is connected. Since the autonomous driving system terminal case 1 is considered to be basically connected to the autonomous driving system 100, the terminal case 1 may have a structure in which the communication cable will not come off from the external cord connection port 21 simply by pulling it. The end of the communication cable may be screwed to the external cord connection port 21, or may have a latch mechanism to prevent it from coming off.
[0038] The small motor 22 is an actuator for opening and closing the opening / closing mechanism 2. The small motor 22 is driven by a control signal from the IC 20. The IC 20 transmits a control signal to the small motor 22 based on a signal from the automatic driving system 100, for example. The small motor 22 switches the opening / closing mechanism 2 between an open state and a closed state by transmitting a driving force to the opening / closing mechanism 2 via a gear unit (not shown). The power source of the opening / closing mechanism 2 is not limited to a motor, and various actuators can be used.
[0039] Here, Fig. 4 is a diagram showing a lid part 6a of the terminal case 6 for an autonomous driving system in the modified example. As shown in Fig. 4, the lid part 6a of the terminal case 6 for an autonomous driving system in the modified example is different from the lid part 1a in Fig. 2(a) in that it has a variable transmittance screen 7 instead of the opening / closing mechanism 2.
[0040] The lid portion 6a has a frame-shaped member that surrounds the outer edge of the mobile terminal 50 attached to the terminal case 6 for the autonomous driving system, and a variable transmittance screen 7 is provided to cover the screen of the mobile terminal 50 that is visible through the opening.
[0041] The variable transmittance screen 7 is a screen configured to be able to change the transmittance of visible light. The variable transmittance screen 7 is made of, for example, liquid crystal or an electromagnetic dielectric, and changes the transmittance by applying a voltage. The variable transmittance screen 7 switches the screen of the mobile terminal 50 from a visible state to a blocked state by lowering the transmittance. The transmittance may be changed in only two stages, transmission and non-transmission, or may be changeable in multiple stages.
[0042] [Autonomous Driving System Configuration] Next, a description will be given of the configuration of the autonomous driving system 100. Description will be omitted of the well-known configuration of the autonomous driving system 100. The autonomous driving system 100 may have a personal authentication function for the driver, and may have a function for linking with the mobile terminal 50 of the driver.
[0043] As shown in FIG. 1, an autonomous driving ECU 10 of an autonomous driving system 100 is connected to a vehicle's HMI [Human Machine Interface] 12. The HMI 15 is an interface for inputting and outputting information between the driver and the autonomous driving ECU 10. The HMI 15 includes a display, a speaker, and the like provided in the vehicle cabin. The HMI 15 outputs images from the display and sounds from the speaker in response to a control signal from the autonomous driving ECU 10. The display may be a HUD [Head Up Display].
[0044] Next, a description will be given of the functional configuration of the autonomous driving ECU 10. As shown in Fig. 1, the autonomous driving ECU 10 has a mounting determination unit 11, a driving change determination unit 12, a driving behavior detection unit 13, and a mobile screen state switching unit 14.
[0045] The attachment determination unit 11 determines whether or not the terminal case 1 for an autonomous driving system is attached to the mobile terminal 50. For example, when the IC 20 detects that the terminal case 1 for an autonomous driving system is attached to the mobile terminal 50, the attachment determination unit 11 determines that the terminal case 1 for an autonomous driving system is attached to the mobile terminal 50 based on a signal transmitted from the IC 20.
[0046] The wearing determination unit 11 may recognize in advance that the mobile terminal 50 is a mobile terminal owned by the driver through communication with the mobile terminal 50. In this case, the wearing determination unit 11 may determine that the terminal case 1 for an autonomous driving system is worn on the mobile terminal 50 through a signal from the mobile terminal 50.
[0047] The driving changeover determination unit 12 determines whether or not a situation has arisen in which the driver is requested to take over driving while the automatic driving control of the vehicle is being executed. The driving changeover determination unit 12 determines that a situation has arisen in which the driver is requested to take over driving when the driving environment ahead of the vehicle is outside the operational design domain [ODD: Operational Design Domain] of the automatic driving control.
[0048] For example, when the vehicle enters an area not assumed in the operation design area, such as a general road, from an area assumed in the operation design area, such as a motorway, the driving change determination unit 12 determines that a situation has arisen in which the driver is required to take over driving. The driving change determination unit 12 may determine that a situation has arisen in which the driver is required to take over driving when the lane width in the construction section ahead of the vehicle is narrower than is assumed in the operation design area. The driving change determination unit 12 may determine that a situation has arisen in which the driver is required to take over driving when the congestion situation around the vehicle is not assumed in the operation design area when a lane change is approaching in order to arrive at the destination. In addition, the driving change determination unit 12 may use well-known conditions related to driving change during automatic driving control for the above determination.
[0049] When the driving change determination unit 12 determines that a situation has arisen in which the driver is required to take over driving, it requests the driver to take over driving via the HMI 15. The driving change determination unit 12 requests the driver to take over driving using at least one of an image output from a display and an audio output from a speaker. For example, the driving change determination unit 12 outputs a voice message saying, "Automatic driving control will be terminated, so please take over driving," as a request for a driving change.
[0050] The driving behavior detection unit 13 detects the driving behavior of the driver after the driving changeover determination unit 12 requests the driver to take over driving. The driving behavior detection unit 13 detects that the driver has performed a driving behavior based on detection signals from, for example, the vehicle's steering sensor, accelerator pedal sensor, and brake pedal sensor. The driving behavior is, for example, an operation of turning the steering wheel of the vehicle by a certain angle or more, an operation of depressing the accelerator pedal by a certain amount or more, and an operation of depressing the brake pedal by a certain amount or more.
[0051] The driving behavior detection unit 13 may detect the driving behavior based on the image captured by the driver monitor camera or the detection result of the operation of the release button for the automatic driving control. The driving behavior may include the driver's visual confirmation of the front of the vehicle and holding the steering wheel with both hands. The driving behavior may also include the driver's proactive switching to manual driving by operating a button or pedal.
[0052] When the driving changeover determination unit 12 requests the driver to take over driving, the mobile screen state switching unit 14 controls the terminal case 1 for the autonomous driving system to switch the screen of the mobile terminal 50 from a visible state to a blocked state.
[0053] The mobile screen state switching unit 14 switches the screen of the mobile terminal 50 from a visible state to a hidden state by driving the opening / closing mechanism 2 (small motor 22) of the terminal case 1 for an autonomous driving system to switch from an open state to a closed state. The mobile screen state switching unit 14 may switch the screen of the mobile terminal 50 from a visible state to a hidden state by changing the transmittance of the variable transmittance screen 7 of the terminal case 6 for an autonomous driving system shown in FIG.
[0054] In addition, the mobile screen state switching unit 14 may maintain the screen of the mobile terminal 50 in a visible state when the driver's driving behavior is detected before a certain time has elapsed since the request for a driving changeover. In this case, the mobile screen state switching unit 14 switches the screen of the mobile terminal 50 from the visible state to the hidden state when the driver's driving behavior is not detected even after a certain time has elapsed since the request for a driving changeover. The certain time is not particularly limited, and may be 30 seconds, 1 minute, or 2 minutes.
[0055] After switching the screen of the mobile terminal 50 from a visible state to a hidden state, if the driving behavior of the driver is detected by the driving behavior detection unit 13, the mobile screen state switching unit 14 returns the screen of the mobile terminal 50 from the hidden state to the visible state. The mobile screen state switching unit 14 may be configured to return the screen of the mobile terminal 50 from the hidden state to the visible state after a certain time has elapsed since the driving behavior of the driver was detected. The mobile screen state switching unit 14 returns the screen of the mobile terminal 50 from the hidden state to the visible state by transmitting a control signal to the terminal case 1 for the autonomous driving system.
[0056] The mobile screen state switching unit 14 may add the end of the automatic driving control as a return condition for the screen of the mobile terminal 50. For example, when the driving behavior of the driver is detected and the automatic driving control is ended, the mobile screen state switching unit 14 returns the screen of the mobile terminal 50 from the blocked state to the visible state. The mobile screen state switching unit 14 may be configured to return the screen of the mobile terminal 50 from the blocked state to the visible state after a certain time has elapsed since the driving behavior of the driver was detected and the automatic driving control was ended.
[0057] [Control method of autonomous driving system] Next, a control method of the autonomous driving system 100 according to this embodiment will be described with reference to the drawings. Fig. 5 is a flowchart showing an example of autonomous driving control start processing of the autonomous driving system 100. The autonomous driving control start processing is performed, for example, when the driver performs an operation to start the autonomous driving control and the requirements for starting the autonomous driving control other than the case attachment are satisfied.
[0058] As shown in Fig. 5, the automatic driving ECU 10 of the automatic driving system 100 determines, in S10, by the mounting determination unit 11, whether or not the terminal case 1 for the automatic driving system is mounted on the mobile terminal 50 of the driver. The mounting determination unit 11 determines that the terminal case 1 for the automatic driving system is mounted on the mobile terminal 50, for example, based on a signal transmitted from the IC 20. If it is determined that the terminal case 1 for the automatic driving system is mounted on the mobile terminal 50 (S10: YES), the automatic driving ECU 10 proceeds to S11. If it is not determined that the terminal case 1 for the automatic driving system is mounted on the mobile terminal 50 (S10: NO), the automatic driving ECU 10 proceeds to S12.
[0059] In S11, the automatic driving ECU 10 starts automatic driving control of the vehicle. The automatic driving ECU 10 executes the automatic driving control by controlling the steering actuator, the drive actuator, and the brake actuator of the vehicle based on a driving plan generated in advance, for example. After that, the automatic driving ECU 10 ends the automatic driving control start process.
[0060] In S12, the autonomous driving ECU 10 notifies the driver of a request to attach the case. The autonomous driving ECU 10 informs the driver that the terminal case 1 for the autonomous driving system needs to be attached to the mobile terminal 50 by a text display or a voice output on the HMI 15. After that, the autonomous driving ECU 10 ends this processing, and repeats the processing from S10 after a certain time.
[0061] 6 is a flowchart showing an example of a driver changeover request process of the automatic driving system. The driver changeover request process is performed while automatic driving control of the vehicle is being executed.
[0062] As shown in Fig. 6, the automatic driving ECU 10 determines in S20 whether or not the driver has been requested to take over driving using the driving change determination unit 12. If it is determined that the driver has been requested to take over driving (S20: YES), the automatic driving ECU 10 proceeds to S21. If it is determined that the driver has not been requested to take over driving (S20: NO), the automatic driving ECU 10 ends the driving change request process. If automatic driving control is continuing, the automatic driving ECU 10 repeats the process from S20 after a certain period of time.
[0063] In S21, the autonomous driving ECU 10 switches the screen of the portable terminal 50 from a visible state to a blocked state by the portable screen state switching unit 14. The portable screen state switching unit 14 switches the screen of the portable terminal 50 from a visible state to a blocked state by the opening and closing mechanism 2 of the terminal case 1 for the autonomous driving system. The portable screen state switching unit 14 may switch the screen of the portable terminal 50 from a visible state to a blocked state by the variable transmittance screen 7 of the terminal case 6 for the autonomous driving system shown in FIG. 4. Thereafter, the autonomous driving ECU 10 proceeds to S22.
[0064] In S22, the autonomous driving ECU 10 judges whether or not the driver's driving behavior has been detected by the driving behavior detection unit 13. If the autonomous driving ECU 10 judges that the driver's driving behavior has been detected (S22: YES), it proceeds to S23. If the autonomous driving ECU 10 judges that the driver's driving behavior has not been detected (S22: NO), it repeats the judgment of S22. Note that if the driver's driving behavior has not been detected even after a predetermined period has elapsed, the autonomous driving ECU 10 may end the driving change request process and enter an emergency support mode. In the emergency support mode, the autonomous driving is ended, and an emergency evacuation is performed by stopping the vehicle on the roadside or in a space on the road without returning the mobile terminal screen to a visible state.
[0065] In S23, the autonomous driving ECU 10 ends the autonomous driving control of the vehicle. The autonomous driving ECU 10 notifies the driver that the autonomous driving control has ended via the HMI 15. After that, the autonomous driving ECU 10 proceeds to S24.
[0066] In S24, the autonomous driving ECU 10 causes the mobile screen state switching unit 14 to return the screen of the mobile terminal 50 from the hidden state to the visible state. The mobile screen state switching unit 14 controls the opening / closing mechanism 2 or the variable transmittance screen 7 to return the screen of the mobile terminal 50 from the hidden state to the visible state. After that, the autonomous driving ECU 10 ends the driving change request processing. If the autonomous driving control is continuing, the autonomous driving ECU 10 repeats the processing from S20 after a certain period of time.
[0067] In the flowchart of FIG. 6, a process of returning to the visual recognition state in S24 may be performed before the end of the automatic driving control in S23.
[0068] Fig. 7 is a flowchart showing another example of the driver change request process of the automatic driving system. As shown in Fig. 7, the automatic driving ECU 10 determines whether or not the driver has been requested to change drivers by the driver change determination unit 12 in S30. If it is determined that the driver has been requested to change drivers (S30: YES), the automatic driving ECU 10 proceeds to S31. If it is determined that the driver has not been requested to change drivers (S30: NO), the automatic driving ECU 10 ends the driver change request process. If the automatic driving control is continued, the automatic driving ECU 10 repeats the process from S30 after a certain time.
[0069] In S31, the autonomous driving ECU 10 determines whether or not the driver's driving behavior has been detected by the driving behavior detection unit 13. If it is determined that the driver's driving behavior has been detected (S31: YES), the autonomous driving ECU 10 proceeds to S36. If it is determined that the driver's driving behavior has not been detected (S31: NO), the autonomous driving ECU 10 proceeds to S32.
[0070] In S32, the automatic driving ECU 10 judges whether a certain time has passed since the driver change request. If the automatic driving ECU 10 judges that a certain time has passed since the driver change request (S32: YES), the automatic driving ECU 10 proceeds to S33. If the automatic driving ECU 10 does not judge that a certain time has passed since the driver change request (S32: NO), the automatic driving ECU 10 returns to S31 and repeats the judgment.
[0071] In S33, the automatic driving ECU 10 switches the screen of the portable terminal 50 from a visible state to a blocked state by the portable screen state switching unit 14. After that, the automatic driving ECU 10 proceeds to S34.
[0072] In S34, the autonomous driving ECU 10 determines whether or not the driving behavior of the driver has been detected by the driving behavior detection unit 13. If it is determined that the driving behavior of the driver has been detected (S34: YES), the autonomous driving ECU 10 proceeds to S35. If it is determined that the driving behavior of the driver has not been detected (S34: NO), the autonomous driving ECU 10 repeats the determination of S34.
[0073] If the driver's driving behavior is not detected after a predetermined period of time has elapsed, the autonomous driving ECU 10 may end the driving change request process and enter an emergency support mode. In the emergency support mode, autonomous driving is terminated, and an emergency evacuation is performed by stopping the vehicle on the roadside or in a space on the road without restoring the screen of the mobile device to a visible state.
[0074] In S35, the automatic driving ECU 10 causes the mobile screen state switching unit 14 to return the screen of the mobile terminal 50 from the blocked state to the visible state. After that, the automatic driving ECU 10 proceeds to S36.
[0075] In S36, the autonomous driving control of the vehicle is terminated. The autonomous driving ECU 10 notifies the driver that the autonomous driving control has been terminated via the HMI 15. If the autonomous driving control is continued, the autonomous driving ECU 10 repeats the process from S30 after a certain period of time.
[0076] In the flowchart of FIG. 7, the process of ending the automatic driving control may be performed after S34 and before S35.
[0077] According to the autonomous driving system 100 (the control method for the autonomous driving system 100 and the terminal case 1 for the autonomous driving system) of this embodiment described above, when the driver is requested to drive the vehicle during autonomous driving control, the screen of the mobile terminal 50 is switched from a visible state to an obscured state. Therefore, compared to the case where only an alarm is output, even if the driver is engrossed in viewing or operating the mobile terminal, the driver's attention can be quickly directed to taking over driving of the vehicle,
[0078] In addition, according to the autonomous driving system 100, autonomous driving control will not start unless the terminal case for the autonomous driving system is attached to the mobile terminal, thereby making it possible to have the driver attach the terminal case for the autonomous driving system to the mobile terminal in order to start autonomous driving control.
[0079] Furthermore, in the autonomous driving system 100, the screen of the driver's mobile terminal 50 can be mechanically switched from a visible state to a hidden state by the opening / closing mechanism 2 of the terminal case 1 for the autonomous driving system. Alternatively, in the autonomous driving system 100, the screen of the mobile terminal 50 may be switched from a visible state to a hidden state with a simple configuration by changing the transmittance of the variable transmittance screen 7 of the terminal case 6 for the autonomous driving system.
[0080] In addition, according to the autonomous driving system 100, after the screen of the mobile device 50 is switched from a visible state to a hidden state, if the driver's driving behavior is detected, the screen of the mobile device 50 is returned from the hidden state to the visible state, thereby shortening the time during which the driver is unable to judge the urgency of the notification content because he or she cannot see the screen when a notification arrives on the mobile device.
[0081] Although the embodiment of the present invention has been described above, the present invention is not limited to the above-mentioned embodiment. The present invention can be embodied in various forms including the above-mentioned embodiment and various modifications and improvements based on the knowledge of those skilled in the art.
[0082] The terminal case 1 for the autonomous driving system is not limited to the configuration shown in the drawings. The terminal case 1 for the autonomous driving system may be in a form in which a mobile terminal connection terminal 4 and an IC box 5 are provided on the lid portion 1a shown in Fig. 2(a) or the lid portion 6a shown in Fig. 4. In addition, the terminal case 1 for the autonomous driving system is not limited to a box-shaped or frame-shaped case, and may have a configuration including a variable transmittance screen 7, a mobile terminal connection terminal 4, and an IC box 5 shown in Fig. 4.
[0083] In addition, the autonomous driving ECU 10 does not need to determine whether the terminal case 1 for the autonomous driving system is attached to the mobile terminal 50, and may treat the signal transmitted from the IC 20 when the case is attached as an authorization signal for starting autonomous driving control.
[0084] The autonomous driving system 100 does not necessarily have to have a terminal case 1 for the autonomous driving system. The autonomous driving system 100 may switch the screen of the portable terminal 50 from a visible state to a hidden state by connecting communication with the portable terminal 50 of the driver and controlling the portable terminal 50. The autonomous driving system 100 may put the screen into a hidden state by display control that locks the screen of the portable terminal 50. The autonomous driving system 100 may be connected to the portable terminal 50 by wireless communication or by wire.
[0085] The terminal case 1 for the automatic driving system may be configured to transmit a signal to the automatic driving system 100 when it is removed from the mobile terminal 50 during automatic driving control. The automatic driving system 100 may notify the driver that the terminal case 1 for the automatic driving system has been removed from the mobile terminal 50. The automatic driving system 100 may stop the vehicle under automatic driving control by emergency evacuating it to the roadside or the like a certain time after the notification. Alternatively, the terminal case 1 for the automatic driving system may have an electric lock function. The terminal case 1 for the automatic driving system may be locked by a signal from the automatic driving system 100 so that it cannot be removed from the mobile terminal 50 while the vehicle is traveling.
[0086] The autonomous driving system 100 may be configured such that, after switching the screen of the mobile device 50 from a visible state to a blocked state, the screen of the mobile device 50 is not returned from the blocked state to a visible state while the driver is driving manually. Manual driving also includes driving during execution of driving assistance control that requires the driver to monitor the surroundings. The autonomous driving system 100 may return the screen of the mobile device 50 from the blocked state to the visible state when autonomous driving control is started again. [Explanation of symbols]
[0087] 1,6...Terminal case for automatic driving system, 1a,6a...Cover portion, 2...Opening and closing mechanism, 7...Variable transmittance screen, 50...Mobile terminal, 100...Automatic driving system.
Claims
1. An autonomous driving system that is connected to a terminal case for an autonomous driving system attached to a mobile terminal of a driver of a vehicle or the mobile terminal and performs autonomous driving control of the vehicle, The terminal case for the autonomous driving system has a lid portion that can switch the screen of the mobile terminal between a visible state and a hidden state, An autonomous driving system that switches the screen of the mobile terminal from a visible state to an obscured state by controlling the mobile terminal or a terminal case for the autonomous driving system when the driver is requested to operate the vehicle during the autonomous driving control.
2. A communication is connected to the terminal case for the autonomous driving system, The autonomous driving system according to claim 1 , wherein the autonomous driving control is not started unless the terminal case for the autonomous driving system is attached to the mobile terminal.
3. The autonomous driving system according to claim 2, wherein the lid portion has an opening / closing mechanism capable of covering the screen of the mobile terminal, and the screen is switched from the visible state to the covered state by covering the screen with the opening / closing mechanism.
4. The autonomous driving system according to claim 2, wherein the cover portion has a variable transmittance screen that covers the screen of the mobile terminal, and the screen is switched from the visible state to the hidden state by changing the transmittance of the variable transmittance screen.
5. The autonomous driving system according to claim 1 or 2, further comprising: a display unit configured to display a display image of the mobile device that displays a display image of the mobile device; a display unit configured to display a display image of the mobile device that displays a display image of the mobile device;
6. A method for controlling an autonomous driving system in which a terminal case for the autonomous driving system is attached to a mobile terminal of a driver of a vehicle or the mobile terminal is connected for communication and controls autonomous driving of the vehicle, comprising: The terminal case for the autonomous driving system has a lid portion that can switch the screen of the mobile terminal between a visible state and a hidden state, A control method for an autonomous driving system, which switches the screen of the mobile terminal from a visible state to an obscured state by controlling the mobile terminal or a terminal case for the autonomous driving system when the driver is requested to operate the vehicle during the autonomous driving control.
7. A terminal case for an autonomous driving system that is connected to a vehicle's autonomous driving system and is attached to a mobile terminal of a driver of the vehicle, a cover portion that is disposed over a screen of the mobile terminal and is capable of switching the screen between a visible state and a shielded state; A terminal case for an autonomous driving system that switches the screen of the mobile device from the visible state to the obscured state when the autonomous driving system requests the driver to operate the vehicle during autonomous driving control of the vehicle.
8. The terminal case for an autonomous driving system according to claim 7, wherein the autonomous driving system does not start the autonomous driving control unless the terminal case is attached to the mobile terminal.
9. A terminal case for an autonomous driving system as described in claim 7 or 8, which has an opening and closing mechanism capable of shielding the screen of the mobile terminal, and switches the screen from the visible state to the shielded state by shielding the screen with the opening and closing mechanism.
10. A terminal case for an autonomous driving system as described in claim 7 or 8, which has a variable transmittance screen that covers the screen of the mobile terminal, and switches the screen from the visible state to the hidden state by changing the transmittance of the variable transmittance screen.
11. A terminal case for an autonomous driving system as described in claim 7 or 8, wherein after the screen of the portable terminal is switched from the visible state to the hidden state, when the autonomous driving system detects the driving behavior of the driver, the screen of the portable terminal is returned from the hidden state to the visible state in response to a control signal from the autonomous driving system.
Citation Information
Patent Citations
Information presentation device and information presentation method
JP2015210660A
Electronically switchable privacy device
JP2016512348A
On-vehicle system
JP2019161407A
Automatic operation vehicle, automatic operation vehicle control method and program
JP2022113014A
Management device for automatic driving vehicle
JP2022138773A
