Autonomous vehicles and programs for autonomous vehicles

Abstract

To provide an automatic driving vehicle that can be prevented from causing a traffic accident due to use of a mobile device by a driver during driving.SOLUTION: An automatic driving vehicle comprises a manual driving mode and an automatic driving mode in which the vehicle runs autonomously, which comprises: input-operation detecting means that detects input operation by a driver who is preparing a mail or preparing a message using a function of a mobile device; and mode switching means that when the input-operation detecting means detects the input operation by the driver who is preparing a mail or preparing a message using a function of a mobile device, in a running state in the manual driving mode, switches the manual driving mode to the automatic driving mode.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] This invention relates to an autonomous driving vehicle capable of autonomous driving and a program for an autonomous driving vehicle.

Background Art

[0002] When a driver driving a vehicle uses a mobile phone terminal to make a call or conduct e-mail communication, it is dangerous because it distracts attention, so it is stipulated as an obligation for the driver not to perform such an act under the Road Traffic Law, and penalties are also defined. The same applies when a driver driving a vehicle tries to use a mobile terminal such as a game machine or a notebook personal computer that requires gazing at a display screen, not limited to a mobile phone terminal.

[0003] From such a background, inventions of mobile terminals such as mobile phone terminals whose use is restricted inside a vehicle, and inventions of communication systems that restrict the use of mobile devices by a driver inside the vehicle have been conventionally provided (see, for example, Patent Document 1 (Japanese Patent Laid-Open No. 10-322440) and Patent Document 2 (Japanese Patent Laid-Open No. 2007-258988), etc.).

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, not all mobile phones and other portable devices have features that restrict their use inside a car, nor are systems with such features standard equipment in cars. Furthermore, mobile phones and systems with such usage restriction features are costly and unnecessary for those who do not have a driver's license.

[0006] Therefore, currently, portable devices without the aforementioned usage restrictions are often brought into vehicles, and in order to ensure strict adherence to the Road Traffic Act, we can only rely on the morality of drivers.

[0007] However, when a call comes in on a mobile phone while driving, there are times when you feel tempted to answer it. This is especially true if you are waiting for an urgent call. In such cases, if you are driving on a regular road, you can pull over to the shoulder of the road to answer the call, but if you are driving on a highway, pulling over to the shoulder of the road can be dangerous.

[0008] To address the above-mentioned problems and prevent traffic accidents caused by drivers using mobile devices while driving, we propose an autonomous vehicle. This paper aims to provide the functions that such an autonomous vehicle should possess. [Means for solving the problem]

[0009] To solve the above problems, the invention of claim 1 is: In an autonomous vehicle equipped with a manual driving mode in which the vehicle is driven based on the driver's actions and an autonomous driving mode in which the vehicle is driven autonomously, An input operation detection means for detecting the driver's input operation for creating an email or message using the functions of a mobile device, In the manual driving mode, when the input operation detection means detects an input operation by the driver to create an email or message using the functions of the portable device, a mode switching means switches from the manual driving mode to the automatic driving mode, The present invention provides an autonomous vehicle characterized by being equipped with the following features.

[0010] According to the autonomous vehicle of claim 1 with the above configuration, when the input operation detection means detects an input operation by the driver to compose an email or message using the functions of a mobile device while driving in manual driving mode, the mode switching means switches from manual driving mode to autonomous driving mode. This allows the driver to compose an email or message with peace of mind. [Effects of the Invention]

[0011] According to the autonomous vehicle of this invention, when the driver performs an input operation, such as creating an email or message using a mobile device, using the input operation detection means while driving in manual driving mode, the vehicle switches from manual driving mode to autonomous driving mode. This allows the driver to perform the input operation of creating an email or message with peace of mind. [Brief explanation of the drawing]

[0012] [Figure 1] This is a block diagram showing an example of the configuration of the electronic control circuit section of the first embodiment of the autonomous vehicle according to this invention. [Figure 2] This figure is used to illustrate an example of the processing operation of a first embodiment of an autonomous vehicle according to this invention. [Figure 3] This figure shows a flowchart illustrating an example of the processing operation of the electronic control circuit section of the first embodiment of the autonomous vehicle according to this invention. [Figure 4] This figure shows a flowchart illustrating an example of the processing operation of the electronic control circuit section of the first embodiment of the autonomous vehicle according to this invention. [Figure 5] This figure shows a flowchart illustrating another example of the processing operation of the electronic control circuit section of the first embodiment of the autonomous vehicle according to this invention. [Figure 6]It is a diagram showing a flowchart for explaining a modification example of the processing operation example of the electronic control circuit unit of the first embodiment of the self-driving vehicle according to the present invention. [Figure 7] It is a block diagram showing a configuration example of the electronic control circuit unit of the second embodiment of the self-driving vehicle according to the present invention. [Figure 8] It is a diagram used to explain an example of the processing operation of the second embodiment of the self-driving vehicle according to the present invention. [Figure 9] It is a diagram showing a flowchart for explaining an example of the processing operation of the electronic control circuit unit of the second embodiment of the self-driving vehicle according to the present invention. [Figure 10] It is a block diagram showing a configuration example of the electronic control circuit unit of the third embodiment of the self-driving vehicle according to the present invention.

Embodiments for Carrying Out the Invention

[0013] [First Embodiment] FIG. 1 is a block diagram showing a hardware configuration example of the electronic control circuit unit 10 of the self-driving vehicle 1 of the first embodiment. Note that the self-driving vehicle 1 of this embodiment is an example in the case of an electric vehicle. However, the battery is not shown in FIG. 1.

[0014] Further, the self-driving vehicle 1 of this embodiment is provided with an automatic driving mode and a manual driving mode. The manual driving mode is a mode in which the vehicle can run according to the driver's operations of the accelerator pedal, brake pedal, shift lever, and steering operation (steering wheel operation), similar to a normal automobile that is not a self-driving vehicle. Also, the automatic driving mode is a driving mode in which the self-driving vehicle 1 itself can automatically (autonomously) change the route while avoiding obstacles without the driver operating the accelerator pedal, brake pedal, shift lever, and steering operation.

[0015] Normally, the driver of the self-driving vehicle 1 can switch the self-driving vehicle 1 running in the manual driving mode to the automatic driving mode by performing a predetermined operation through, for example, a touch panel. During running in the automatic driving mode, when the driver operates the accelerator pedal, brake pedal, shift lever, or steering wheel, the vehicle is configured to automatically return to the manual driving mode. However, as will be described later, when the self-driving vehicle 1 of this embodiment is forcibly switched from the manual driving mode to the automatic driving mode, the operation to return to the above manual driving mode is invalid and the vehicle is controlled to maintain running in the automatic driving mode unless a predetermined condition described later is satisfied.

[0016] As shown in FIG. 1, an electronic control circuit unit 10 is connected to a control unit 101 equipped with a computer through a system bus 100. The connected components include a motor drive control unit 102, a steering drive control unit 103, a manual / automatic driving mode switching control unit 104, a manual driving operation detection unit 105, a radar 106, a camera group 107, various sensor groups 108, a surrounding moving body grasping unit 109, a current position detection unit 110, a display unit 111, a touch panel 112, a car navigation (hereinafter abbreviated as car navi) function unit 113, a driver behavior analysis detection unit 114, a forced automatic driving mode switching determination unit 115, an incoming call notification detection unit 116, a clock unit 117, and an audio output unit 118.

[0017] A motor drive unit 121 is connected to the motor drive control unit 102. A steering drive unit 122 is connected to the steering drive control unit 103. A car navi database 123 is connected to the car navi function unit 113. A microphone 124 is connected to the incoming call notification detection unit 116, and a speaker 125 is connected to the audio output unit 118.

[0018] Under the control of the control unit 101, the motor drive control unit 102 controls the supply of a drive signal to the motor drive unit 121 of the self-driving vehicle 1 configured as an electric vehicle in this embodiment, so as to control the start of running, running speed control, running stop, etc. of the self-driving vehicle 1.

[0019] The steering drive control unit 103 controls the supply of drive control signals to the steering drive unit 122 of the autonomous vehicle 1 in this embodiment, under the control of the control unit 101, thereby controlling the changing of the autonomous vehicle 1's course.

[0020] The manual / automatic driving mode switching control unit 104 controls the driving mode of the autonomous vehicle 1 to switch between manual driving mode, automatic driving mode, and the forced automatic driving mode described later, in response to a selection operation input via the touch panel 112.

[0021] The manual driving operation detection unit 105 receives information on the driver's operation of the accelerator pedal, brake pedal, shift lever, and steering wheel, and supplies this manual driving operation information to the manual / automatic driving mode switching control unit 104.

[0022] When the autonomous vehicle 1 is in manual driving mode, the manual / automatic driving mode switching control unit 104 supplies manual driving operation information from the manual driving operation detection unit 105 to the motor drive control unit 102 and the steering drive control unit 103, and controls the motor drive unit 121 and the steering drive unit 122 in accordance with the driver's pedal operations, shift lever operations, and steering operations.

[0023] Furthermore, when the autonomous vehicle 1 is in autonomous driving mode (including forced autonomous driving mode), the manual / autonomous driving mode switching control unit 104 supplies autonomous driving operation information generated by the control unit 101 based on the outputs of the radar 106, camera group 107, various sensor groups 108, and surrounding moving object detection unit 109 to the motor drive control unit 102 and steering drive control unit 103, as described later, to drive control the motor drive unit 121 and steering drive unit 122 according to the autonomous driving operation information. In autonomous driving mode (including forced autonomous driving mode), the car navigation function unit 113 searches for a route from the current location to a destination set by the driver or the like, and controls the vehicle to drive along the searched route.

[0024] In this embodiment, the manual / automatic driving mode switching control unit 104, upon receiving the decision result from the forced automatic driving mode switching determination unit 115 (described later), also performs control to automatically switch from manual driving mode to automatic driving mode against the driver's will—that is, against the driver's selection and setting of the driving mode.

[0025] In order to distinguish it from the normal automatic driving mode that the user selects and sets via the touch panel 112 or the like, this automatically driving mode after being forcibly switched will be referred to in this specification as the forced automatic driving mode.

[0026] In a normal autonomous driving mode, not a forced autonomous driving mode, if the driver operates the accelerator pedal, brake pedal, shift lever, or steering wheel while the vehicle is driving in autonomous driving mode, the manual / autonomous driving mode switching control unit 104 performs mode switching control to automatically return the driving mode of the autonomous vehicle 1 to manual driving mode based on the detection information of the manual driving operation.

[0027] However, when the driving mode of the autonomous vehicle 1 is in forced autonomous driving mode, even if the driver operates the accelerator pedal, brake pedal, shift lever, or steering wheel, the manual / autonomous driving mode switching control unit 104 will invalidate the manual driving operation information and maintain the forced autonomous driving mode.

[0028] The radar 106 is used to measure the distance to objects in the vicinity of the autonomous vehicle 1, and consists of a laser radar and a millimeter-wave radar, for example. The laser radar is embedded, for example, in the roof or near the bumper, and the millimeter-wave radar is installed, for example, at the front and rear of the vehicle. The vehicle may be equipped with both laser radar and millimeter-wave radar, or with only one of them.

[0029] The camera group 107 includes one or more cameras for capturing images inside the autonomous vehicle 1 and one or more cameras for capturing images of the surrounding area outside the autonomous vehicle 1. The cameras for capturing images inside the vehicle include, for example, cameras mounted on the rearview mirror (rearview mirror, room mirror) installed between the driver's seat and the passenger seat, or on the upper part of the front windshield, to capture the actions of the person (driver) sitting in the driver's seat, as well as cameras for capturing the actions of passengers sitting in the passenger seat or the rear seats. The cameras for capturing images of the surrounding area of ​​the autonomous vehicle 1 include, for example, two cameras (stereo cameras) mounted on the left and right sides of the rearview mirror to mainly capture the left front and right front of the autonomous vehicle 1, cameras mounted on, for example, the door mirrors or fender mirrors of the autonomous vehicle 1 to capture the left and right sides, and a camera to capture the rear of the autonomous vehicle 1.

[0030] The various sensor group 108 includes open / close detection sensors that detect the opening and closing of doors and windows, sensors that detect the wearing of seat belts, seat occupancy sensors that detect when an occupant is seated in a seat such as the driver's seat or passenger seat, and various sensors that acquire information to assist in autonomous driving. Examples of sensors that acquire information to assist in autonomous driving include vibration sensors to detect vibrations of the vehicle and tires, rotation speed sensors to detect the rotation speed of the tires, geomagnetic sensors to detect direction, acceleration sensors to detect acceleration, and gyro sensors (gyroscopes) to detect angles and angular velocity.

[0031] The surrounding moving object detection unit 109 uses the radar 106 and images captured by the camera group 107 to detect moving objects around the vehicle. The surrounding moving object detection unit 109 detects surrounding obstacles and moving objects by performing processing based on, for example, Bayesian theory.

[0032] The current position detection unit 110 detects the vehicle's current position by receiving radio waves from GPS satellites. Because the accuracy of the position detected by radio waves from GPS satellites is poor, the current position detection unit 110 uses not only the current position information detected by GPS radio waves, but also one or more sensors included in the various sensor group 108, as well as radar 106, images captured by the camera group 107, and performs processing based on Bayesian theory, for example, to detect and confirm the current position with higher accuracy.

[0033] In autonomous driving mode, the autonomous vehicle 1 processes various information, such as location information obtained from the radar 106, camera group 107, various sensor group 108, and GPS radio waves, using Bayesian theory in the current position detection unit 110 and the surrounding moving object recognition unit 109. Based on this, the control unit 101 performs intelligent information processing (artificial intelligence) and control (artificial intelligence) such as changing the vehicle's course and avoiding obstacles to generate autonomous driving operation information.

[0034] The display unit 111 consists of, for example, an LCD (Liquid Crystal Display). The touch panel 112 is configured by superimposing a touch sensor that allows touch input by a finger on the display screen of the LCD display unit 111. The display screen of the display unit 111 displays an image including software buttons (including keyboard character input buttons) based on the control of the control unit 101. When the touch panel 112 detects a touch by a finger on a software button displayed on the display screen, it transmits that touch to the control unit 101. The control unit 101, upon receiving this, is configured to execute control processing corresponding to the software button.

[0035] The car navigation function unit 113 is a function unit that guides the autonomous vehicle 1 to a designated destination based on maps and route guidance data stored in the car navigation database 123. In this embodiment, the car navigation function unit 113 is configured to perform slightly different processing in manual driving mode and autonomous driving mode.

[0036] In other words, in manual driving mode, the car navigation function unit 113 displays an image on the display screen of the display unit 111 that overlays the vehicle's current position, as detected by the current position detection unit 110, onto a map that explicitly displays the route to the destination. Furthermore, as the vehicle moves, the vehicle's position (current position) on the map moves, and voice guidance is provided at intersections, junctions, and other points along the route where route guidance is needed. This is the same as a normal car navigation function.

[0037] On the other hand, in autonomous driving mode, the car navigation function unit 113 notifies the control unit 101 of the direction and distance of the vehicle's current position when it is off the route to the destination, and when the vehicle is on the route to the destination, it notifies the control unit 101 of instructions to change the direction of travel along the route before intersections and junctions along the route as the vehicle moves. Based on the information notified from the car navigation function unit 113, the current position confirmation result from the current position detection unit 110, and the detection result from the surrounding moving object recognition unit 109, the control unit 101 controls the motor drive unit 121 via the motor drive control unit 102 and generates autonomous driving operation information to control the steering drive unit 122 via the steering drive control unit 103 so that the vehicle moves along the route as instructed.Therefore, with the route guidance to the destination by the car navigation function unit 113 and the control unit 101 in autonomous driving mode, the autonomous vehicle 1 can move to the destination even when there are no passengers.

[0038] The driver action analysis and detection unit 114 analyzes the image information captured by the camera that photographs the driver among the camera group 107, and in this example, specifically detects whether or not the driver has picked up a portable device, in this example, a mobile phone terminal. The detection result of the driver's action is then supplied to the forced automatic driving mode switching determination unit 115.

[0039] In this embodiment, the forced automatic driving mode switching determination unit 115 determines whether or not to switch the automatic driving vehicle 1 to forced automatic driving mode, and also determines whether or not to deactivate the forced automatic driving mode, based on the detection output of an incoming call notification from the incoming call notification detection unit 116, which is a notification from a mobile phone terminal (mobile phone terminal 2 in Figure 1) brought into the automatic driving vehicle 1, and the detection result of the driver's actions from the driver action analysis detection unit 114.

[0040] The microphone 124 connected to the incoming call notification detection unit 116 is for picking up sounds (voices and vibrations) inside the vehicle. The incoming call notification detection unit 116 detects incoming call notifications from the mobile phone terminal 2, such as ringtones, ringtone melodies, and vibrations, from the audio signals picked up by the microphone 124, and notifies the control unit 101 of the detection result.

[0041] The clock unit 117 provides time information (year, month, day, hour, minute, second) and also functions as a timer for measuring time.

[0042] The audio output unit 118, although not shown in the diagram, incorporates a memory for storing voice message data to be broadcast externally, as well as a voice synthesizer and DA converter that convert the voice message data read from the memory into an analog voice signal. The audio output unit 118 then supplies the voice message selected by the control unit 101 to the speaker 125, broadcasting it externally as voice. The voice messages to be stored include, as will be described later, notification messages for switching driving modes such as "Switched to automatic driving mode." and "Switched to manual driving mode," as well as notification messages prompting the user to set a destination when switching to automatic driving mode.

[0043] As described above, the electronic control circuit section 10 of the autonomous vehicle 1 is configured as such, but of the blocks shown in Figure 1, the motor drive control section 102, steering drive control section 103, manual / autonomous driving mode switching control section 104, surrounding moving object detection section 109, current position detection section 110, car navigation function section 113, driver action analysis detection section 114, forced autonomous driving mode switching determination section 115, incoming call notification detection section 116, and voice output section 118 can be implemented by the control section 101 as software processing.

[0044] [Example of the operation of switching the driving mode in the autonomous vehicle 1 of the first embodiment] In an autonomous vehicle 1 equipped with the electronic control circuit unit 10 described above, if the driver uses a portable device brought into the vehicle while driving in manual driving mode, the system will automatically switch from manual driving mode to forced autonomous driving mode.

[0045] Several examples of situations in which the vehicle can be switched from manual driving mode to forced automatic driving mode, and the processing operations of the electronic control circuit unit 10 of this embodiment of the autonomous vehicle in those situations, will be described below.

[0046] <Example 1: When the mobile device is a mobile phone terminal and a notification of an incoming call is received> Figure 2(A) shows a situation in which driver 3 has brought a mobile phone terminal 2 (e.g., a mobile phone, a smartphone) into the autonomous vehicle 1 and is driving the autonomous vehicle 1 in manual driving mode, for example, with the mobile phone terminal 2 placed on the dashboard 4. In Figure 2(A), 5 is the steering wheel, and 107a is a camera from the camera group 107 that is mounted on the upper part of the front windshield, to the side of the rearview mirror 6, in order to capture the driver's actions.

[0047] In the state shown in Figure 2(A), when a call (including a video call) is received on the mobile phone terminal 2, in this example, the ringtone is emitted, and the driver 3 is notified of the incoming call. In this example, the autonomous vehicle 1 immediately switches from manual driving mode to forced autonomous driving mode, and the driver is notified of this. The driver 3 can then confidently pick up the mobile phone terminal 2 on the dashboard 4, take both hands off the steering wheel 5, and answer the call, as shown in Figure 2(B).

[0048] Next, an example of the processing flow in the electronic control circuit unit 10 at this time will be described. Figure 3 is a flowchart illustrating an example of the processing flow in the electronic control circuit unit 10 of the autonomous vehicle 1 of this embodiment when an incoming call notification is received from the mobile phone terminal 2. In the following explanation, the processing at each step in the flowchart of Figure 3 will be described assuming that the control unit 101 implements the following processing functions as software processing: motor drive control unit 102, steering drive control unit 103, manual / autonomous driving mode switching control unit 104, surrounding moving object detection unit 109, current position detection unit 110, car navigation function unit 113, driver action analysis detection unit 114, forced autonomous driving mode switching determination unit 115, incoming call notification detection unit 116, and voice output unit 118. The same applies to the flowcharts describing other examples below.

[0049] First, the control unit 101 monitors the audio information picked up by the microphone 124 to determine whether or not it has detected an incoming call notification from the mobile phone terminal 2 (step S1). In this case, the detection of an incoming call notification from the mobile phone terminal 2 is performed by detecting the ringtone, ring melody, or vibration of the incoming call, as described above. The ringtone and ring melody are registered in advance in the electronic control circuit unit 10, and the function unit of the incoming call notification detection unit 116 of the control unit 101 can detect the match between the registered audio data and the audio data picked up by the microphone 124. Similarly, the vibration of the incoming call is also registered and can be detected by similar match detection.

[0050] If step S1 determines that no incoming call notification has been detected, the control unit 101 performs other processing (step S2), and after performing that processing, returns to step S1.

[0051] Furthermore, when step S1 determines that an incoming call notification has been detected, the control unit 101 determines whether the driving mode of the autonomous vehicle 1 is manual driving mode or not (step S3). If step S3 determines that the driving mode is autonomous driving mode and not manual driving mode, the control unit 101 returns to step S1 because it is possible to answer the incoming call and have a safe conversation.

[0052] In step S3, if the control unit 101 determines that the driving mode is manual driving mode, it switches the driving mode to forced automatic driving mode and notifies the driver of this by, for example, emitting a message through the speaker 125 (step S4).

[0053] Next, the control unit 101 monitors the image information captured by the camera 107a and analyzes the captured image information to determine whether or not the driver picked up the mobile phone terminal 2 and made an action to answer an incoming call (step S5).

[0054] In step S5, if the control unit 101 determines that the driver has not taken any action to answer the incoming call, it determines whether the incoming call notification from the mobile phone terminal 2 has disappeared (step S6). If it determines that the incoming call notification has not disappeared, it returns to step S5.

[0055] When the control unit 101 determines in step S6 that the incoming notification has disappeared, it switches from forced automatic driving mode to normal automatic driving mode (step S7), waits for detection of manual driving operations such as the accelerator pedal, brake pedal, shift lever, and steering wheel (step S8), and when it detects manual driving operations in step S8, it switches from automatic driving mode to manual driving mode and notifies the driver of this by emitting a message to that effect, for example, through the speaker 125 (step S9). After step S9, the control unit 101 returns to step S1 and repeats the processing from step S1 onward.

[0056] In step S5, when the control unit 101 determines that the driver has taken an action to answer an incoming call, it executes the car navigation function start process, sets the destination, and starts the car navigation function (step S10). Details of the car navigation function start process in step S10 will be described later.

[0057] Next, the control unit 101 controls the system to maintain the forced automatic driving mode even if it detects manual driving operation (step S11). Then, the control unit 101 monitors the image information captured by the camera 107a, analyzes the captured image information, and determines whether the driver has ended a call using the mobile phone terminal 2, placed the mobile phone terminal 2 somewhere, and placed their hands on the steering wheel, thereby enabling manual driving (step S12).

[0058] The determination process in step S12 is an example of termination detection means for detecting the event of the driver ending the use of the functions of a portable device. In the determination in step S12, in addition to determining whether the driver places their hands on the steering wheel, it may also be possible to determine whether the driver ends a call using the mobile phone terminal 2 and places the mobile phone terminal 2 somewhere.

[0059] If step S12 determines that the system is not in a state where manual operation is possible, step S12 is continued, and the system waits for the system to become capable of manual operation. If step S12 determines that the system is capable of manual operation, the control unit 101 moves the process to step S7, executes the processes from step S7 onward, and returns the system to manual operation mode.

[0060] Next, an example of the car navigation function startup process in step S10 of the flowchart in Figure 3 will be explained with reference to Figure 4.

[0061] The control unit 101 displays a screen for setting the destination in automatic driving mode on the display screen of the display unit 111, and also emits an audio message from the speaker 125 prompting the driver to set the destination (step S21). At this time, if a destination in automatic driving mode has been set in advance, the display screen of the display unit 111 displays a message to that effect and asks if that destination is acceptable, and the driver inputs whether that destination is acceptable via the touch panel 112. If no destination has been set in advance, the driver sets the destination by specifying the destination on the map displayed on the display screen via the touch panel 112, or by inputting the name of the destination location.

[0062] The control unit 101 waits for the destination to be set (step S22), and when it determines that the destination has been set, it displays route candidates from the current location to the set destination on the display screen (step S23). Next, the control unit 101 monitors the operation input of the touch panel 112 and determines whether or not the selection of a route to be used has been completed from the route candidates to the destination displayed on the display screen (step S24). Then, when it determines in step S24 that the selection of a route to be used has been completed, the control unit 101 starts navigation for route guidance in automatic driving mode (step S25).

[0063] As described above, according to this embodiment, as shown in Figure 2, when a call comes in on the mobile phone terminal 2 while the driver 3 is in the autonomous vehicle 1 with the mobile phone terminal 2 and driving in manual driving mode, the autonomous vehicle 1 automatically switches from manual driving mode to forced autonomous driving mode, and the autonomous vehicle 1 enters a state where it can safely drive in forced autonomous driving mode. Therefore, the driver can confidently take their hands off the steering wheel 5, pick up the mobile phone terminal 2, answer the call, and make a call.

[0064] Furthermore, in the above-described embodiment, if the driver does not respond to the incoming call notification and the notification ends, the system is configured to return to manual driving mode by detecting a manual driving operation. Therefore, if the driver does not intend to answer the incoming call, they can easily return to manual driving mode by performing a manual driving operation.

[0065] Furthermore, in the above-described embodiment, when the system switches to forced automatic driving mode, a screen prompting the driver to set a destination in the car navigation function is automatically displayed, the destination is accepted, and the car navigation function is started. Therefore, even if the driver answers an incoming call on the mobile phone terminal 2 and makes a call, the autonomous vehicle 1 will reliably move to the destination desired by the driver.

[0066] <Second example; when the portable device is a mobile phone terminal and you are making a phone call> As shown in Figure 2(A), even when driver 3 brings a mobile phone terminal 2 into the autonomous vehicle 1 and places it, for example, on the dashboard 4, and is driving the autonomous vehicle 1 in manual driving mode, if driver 3 attempts to make a call using the mobile phone terminal 2, the autonomous vehicle 1 in this embodiment is configured to allow for safe communication based on the call.

[0067] In other words, in this embodiment, when driver 3 picks up the mobile phone terminal 2 on the dashboard 4 and takes both hands off the steering wheel 5 to attempt to make a call, as shown in Figure 2(B), the system detects such an operation by analyzing the image information of driver 3 captured by camera 107a. Based on this detection, the autonomous vehicle 1 switches from manual driving mode to forced autonomous driving mode, and this is communicated to driver 3. As a result, driver 3 can confidently pick up the mobile phone terminal 2 on the dashboard 4, take both hands off the steering wheel 5, and make a call to make a conversation, as shown in Figure 2(B).

[0068] The flow of an example of the processing operation in the electronic control circuit unit 10 at this time will be explained with reference to the flowchart in Figure 5.

[0069] First, the control unit 101 determines whether the driving mode of the autonomous vehicle 1 is manual driving mode or not (step S31). If, in step S31, it determines that the driving mode is not manual driving mode but autonomous driving mode, it proceeds to the processing routine for autonomous driving mode (step S32).

[0070] In step S31, if it is determined that the driving mode is manual driving mode, the control unit 101 monitors the image information captured by the camera 107a and analyzes the captured image information to determine whether or not the driver 3 has taken the action of picking up the mobile phone terminal 2 in order to make a call (step S33).

[0071] If, in step S33, the control unit 101 determines that the driver 3 has not taken the mobile phone terminal 2, the control unit 101 performs other processing (step S34), and once that processing is completed, it returns to step S33.

[0072] In step S33, if the control unit 101 determines that driver 3 has picked up the mobile phone terminal 2, it switches the driving mode to forced automatic driving mode and notifies driver 3 of this by, for example, emitting a message through speaker 125 (step S35).

[0073] Next, the control unit 101 executes the process to start the car navigation function, sets the destination, and starts the car navigation function (step S36). This process to start the car navigation function in step S36 is the same as the process described using Figure 4.

[0074] Next, the control unit 101 controls the system to maintain the forced automatic driving mode even if it detects manual driving operation (step S37). The control unit 101 then monitors the image information captured by the camera 107a and analyzes the captured image information to determine whether the driver 3 has ended a call using the mobile phone terminal 2, placed the mobile phone terminal 2 somewhere, and placed their hands on the steering wheel 5, thereby enabling manual driving (step S38). If it is determined in step S38 that the driver is not yet in a state where manual driving is possible, step S38 is continued until the driver becomes ready for manual driving.

[0075] Then, in step S38, when the control unit 101 determines that manual driving is possible, it switches from forced automatic driving mode to normal automatic driving mode (step S39), waits to detect manual driving operations such as the accelerator pedal, brake pedal, shift lever, and steering wheel (step S40), and when it detects manual driving operations in step S40, it switches from automatic driving mode to manual driving mode and notifies the driver 3 of this by, for example, emitting a message through the speaker 125 (step S41). After step S41, the control unit 101 returns to step S33 and repeats the processing from step S33 onward.

[0076] As described above, according to this embodiment, when driver 3 gets into the autonomous vehicle 1 with a mobile phone terminal 2 and is driving in manual driving mode, and it becomes necessary to make a call using the mobile phone terminal 2, when driver 3 picks up the mobile phone terminal 2 to make a call, the autonomous vehicle 1 automatically switches from manual driving mode to forced autonomous driving mode, and the autonomous vehicle 1 drives safely in forced autonomous driving mode in accordance with traffic laws regarding the handling of mobile devices inside the vehicle. Therefore, driver 3 can confidently take their hands off the steering wheel 5, pick up the mobile phone terminal 2, make a call, and make a conversation.

[0077] In the first embodiment, the vibration upon receiving a call was detected by a microphone, but it may be detected by a vibration sensor or pressure sensor, not just a microphone.

[0078] <Modified form of the first embodiment> <Variation of the first example> In the first example described above, upon detecting an incoming call notification on a mobile phone terminal, the driving mode of the autonomous vehicle 1 is immediately switched to forced autonomous driving mode, taking into consideration the assumption that the driver will answer the call and the need to safely pick up the mobile phone terminal. In other words, in the first example, the incoming call notification is an event that triggers the start of using the functions of the mobile device, and detecting this triggers the switch to forced autonomous driving mode.

[0079] Therefore, if the driver does not answer an incoming call, the system will temporarily enter forced automatic driving mode, and the driver's manual driving operations will be disabled until the incoming call notification disappears. As a result, although rare, if the driver attempts to perform manual driving operations such as operating the accelerator pedal, brake pedal, or steering wheel to make a turn or change lanes while an incoming call notification is displayed on the mobile phone, these manual driving operations will be disabled, which may actually create a dangerous situation.

[0080] The following modification of the first example avoids the above problem by, in addition to the incoming call notification, making the driver picking up the mobile device a trigger event for initiating the use of the mobile device's functions.

[0081] Figure 6 is an example of a flowchart illustrating the flow of operations in a modified version of this first example.

[0082] In other words, in the example shown in Figure 6, first, the control unit 101 monitors the audio information picked up by the microphone 124 in the same manner as in the first example described above, and determines whether or not it has detected an incoming call notification from the mobile phone terminal 2 (step S51).

[0083] If step S51 determines that no incoming call notification has been detected, the control unit 101 performs other processing (step S52), and after performing that processing, returns to step S51.

[0084] Furthermore, if the control unit 101 determines in step S51 that an incoming call notification has been detected, it determines whether the driving mode of the autonomous vehicle 1 is manual driving mode or not (step S53). If, in step S53, it determines that the driving mode is autonomous driving mode and not manual driving mode, the control unit 101 determines that it is possible to answer the incoming call and have a safe conversation, and therefore returns the process to step S51.

[0085] In step S53, if it is determined that the driving mode is manual driving mode, the control unit 101 monitors the image information captured by the camera 107a and analyzes the captured image information to determine whether the driver picked up the mobile phone terminal 2 and performed the action of picking up the mobile phone terminal 2 to answer an incoming call (step S54).

[0086] In step S54, if the control unit 101 determines that the driver has not taken the mobile phone terminal 2 to answer an incoming call, it determines whether the incoming call notification from the mobile phone terminal 2 has disappeared (step S55). If it determines that the incoming call notification has not disappeared, it returns to step S54. If it determines in step S55 that the incoming call notification has disappeared, the control unit 101 returns to step S51.

[0087] Then, in step S54, if the control unit 101 determines that the driver has taken the action of picking up the mobile phone terminal 2 to answer an incoming call, it switches the driving mode to forced automatic driving mode and notifies the driver of this by, for example, emitting a message through the speaker 125 (step S56).

[0088] Next, the control unit 101 executes the car navigation function start process described using Figure 4 to set the destination and start the car navigation function (step S57). Next, the control unit 101 controls the vehicle to maintain the forced automatic driving mode even if manual driving operation is detected (step S58).

[0089] The control unit 101 then monitors the image information captured by the camera 107a and analyzes the captured image information to determine whether the driver has ended a call using the mobile phone terminal 2, placed the mobile phone terminal 2 somewhere, and placed their hands on the steering wheel, thereby enabling manual driving (step S59). If step S59 determines that the driver is not yet in a state where manual driving is possible, step S59 is continued, and the system waits for the driver to become ready for manual driving.

[0090] Then, in step S59, when the control unit 101 determines that manual driving is possible, it switches from forced automatic driving mode to normal automatic driving mode (step S60), waits to detect manual driving operations such as the accelerator pedal, brake pedal, shift lever, and steering wheel (step S61), and when it detects manual driving operations in step S61, it switches from automatic driving mode to manual driving mode and notifies the driver of this by emitting a message, for example, through the speaker 125 (step S62). After step S62, the control unit 101 returns to step S51 and repeats the process from step S51 onwards.

[0091] As described above, according to this modified version of the first example, the system not only detects an incoming call notification but also confirms that the driver picks up the mobile phone to answer the call before switching to forced automatic driving mode. Therefore, even while an incoming call notification is displayed, the driver's manual driving operations are not invalidated. Consequently, if the driver performs manual driving operations such as turning left or right or changing lanes while an incoming call notification is displayed on the mobile phone, these operations are considered valid. After performing the necessary manual driving operations, if the driver picks up the mobile phone to answer the call, the driving mode switches to forced automatic driving mode, allowing the driver to answer the call and talk with peace of mind.

[0092] <Other variations of the first example> In the first example and its modifications described above, the mobile device was a mobile phone terminal, and the function described was the incoming telephone call. However, it is not limited to the incoming telephone call; it can also be applied to the incoming (receiving) of emails (including SMS and message receiving functions) provided by the mobile phone terminal. Furthermore, this invention is also applicable to the incoming (receiving) of information via other communication functions provided by mobile devices such as mobile phone terminals, such as internet telephones, microblogs such as Twitter®, instant messengers such as LINE, SNS (Social Networking Service), electronic bulletin boards, and other communication services via the internet. Moreover, the mobile device is not limited to a mobile phone terminal. Regarding emails and other communication services, the autonomous vehicle 1 detects the received notification corresponding to the incoming notification.

[0093] In the second example described above, the mobile device was a mobile phone terminal, and the function described was the outgoing telephone call. However, this invention is not limited to outgoing telephone calls; it can also be applied to sending emails (including the short message sending function) provided by the mobile phone terminal. Furthermore, this invention is applicable to other communication functions provided by mobile devices such as mobile phone terminals, such as sending information via internet communication services, including internet telephones, microblogs such as Twitter®, instant messengers such as LINE, social networking services (SNS), and electronic bulletin boards. In addition, in the case of email and message communication, this invention is applicable not only to receiving and sending, but also during input operations such as composing emails or messages, where attention may be distracted, potentially leading to dangerous driving, such as staring at the display screen or deep in thought. Of course, this invention is also applicable during browsing operations such as checking emails or messages. Moreover, the mobile device is not limited to a mobile phone terminal.

[0094] Furthermore, in this second example, the portable device may not have communication capabilities but may have a display screen that the driver might focus on for input or viewing, such as a game console, e-book reader, viewer, DVD (Digital Versatile Disc) player, memory player, or portable television. Alternatively, the portable device may be a tablet, PDA (Personal Digital Assistant), or laptop computer with a display screen. Even in these cases, the driver's action of picking up the portable device triggers the use of the device's functions, so the processing flow shown in Figure 6 can be applied directly.

[0095] [Second Embodiment] In the first embodiment described above, the mobile phone terminal 2, as an example of a portable device, had no electrical connection to the electronic control circuit unit 10 of the autonomous vehicle 1, and the functions of the mobile phone terminal 2 were performed by the user (driver) interacting with the mobile phone terminal 2.

[0096] In the second embodiment, the autonomous vehicle 1A has an electronic control circuit unit 10A that includes a mobile phone interface unit that electrically connects to a mobile phone terminal 2 brought into the vehicle. The telephone communication function of the mobile phone terminal 2 is realized through display on the display screen of the display unit 111 of the electronic control circuit unit 10A and through the operation reception function via the touch panel 112.

[0097] Figure 7 is a block diagram showing an example of the configuration of the electronic control circuit section 10A of the autonomous vehicle 1A of this second embodiment. The same reference numerals are used for parts that are the same as those of the electronic control circuit section 10 of the autonomous vehicle 1 of the first embodiment described above, and their detailed descriptions are omitted.

[0098] As is clear from comparing Figure 1 and Figure 7, the electronic control circuit unit 10A of the autonomous vehicle 1A in the second embodiment does not include the incoming call notification detection unit 116 of the electronic control circuit unit 10 in the first embodiment. Instead, it includes a mobile phone interface unit 116A. Furthermore, the electronic control circuit unit 10A does not include the voice output unit 118 of the electronic control circuit unit 10 in the first embodiment, but instead includes a voice interface unit 118A. The other configurations of the electronic control circuit unit 10A of the autonomous vehicle 1A in the second embodiment are the same as those of the electronic control circuit unit 10 in the first embodiment.

[0099] As shown in Figure 8(A), the dashboard 4 of the autonomous vehicle 1A in the second embodiment is provided with a storage pocket 116Ap for storing a mobile phone terminal 2 in a predetermined location within reach of the driver. The driver can secure the mobile phone terminal 2 that they have brought into the vehicle by inserting it into the storage pocket 116Ap.

[0100] In this example, the electrical connection between the mobile phone terminal 2 and the mobile phone interface unit 116A of the electronic control circuit unit 10A is made wirelessly, for example, by a short-range wireless standard such as Bluetooth (registered trademark). Of course, instead of a wireless connection, the mobile phone terminal 2 and the electronic control circuit unit 10A may also be electrically connected by connecting the USB (Universal Serial Bus) terminal on the mobile phone terminal 2 and the USB terminal on the mobile phone interface unit 116A using a USB cable.

[0101] Furthermore, the electronic control circuit unit 10A of this second embodiment is configured to receive control signals from the mobile phone terminal 2 and perform processing when an incoming call is received or when an outgoing call is made, through the mobile phone interface unit 116A and the control unit 101.

[0102] In other words, the electronic control circuit unit 10A has the function of an incoming call detection circuit that receives a control signal from the mobile phone terminal 2 and detects an incoming call. Based on the incoming call detection result, it has the function of displaying an incoming call (incoming call notification) on the display screen 111D of the display unit 111, as shown in Figure 8(B), or supplying a ringtone to the speaker 125A via the voice interface unit 118A and emitting the sound to notify the user of an incoming call.

[0103] Then, as shown in Figure 8(B), the control unit 101 displays a software button 112a for answering an incoming call and a software button 112b for ending a call on the incoming call notification display screen 111D. When a user (driver, etc.) touches these buttons 112a or 112b, the control unit 101 detects the operation through the touch panel 112 and performs processing corresponding to the pressed button 112a or 112b.

[0104] When a user (such as a driver) presses the call answer button 112a, the control unit 101 generates a call path with the caller via the mobile phone terminal 2, enabling hands-free calling using the microphone 124A connected to the voice interface unit 118A as the transmitter and the speaker 125A connected to the voice interface unit 118A as the receiver. When a user (such as a driver) presses the end button 112b, the control unit 101 controls the mobile phone terminal 2 to disconnect the call path and end the call.

[0105] Furthermore, as shown in Figure 8(C), when the device is in standby mode and not in call notification mode, the control unit 101 displays a software button 112c for making a call and a software button 112d for accessing a predetermined site via the internet on the display screen 111D. When a user (driver, etc.) touches these buttons 112c or 112d, the touch panel 112 detects the operation and notifies the control unit 101. Upon receiving this notification, the control unit 101 performs processing corresponding to the operated button 112c or 112d.

[0106] When a user (driver, etc.) operates the call button 112c, the control unit 101 displays a call screen on the display screen 111D, accepts the user's selection of the recipient, and controls the mobile phone terminal 2 to make a call to the specified recipient. After confirming the recipient's response, it generates a call path with the recipient and is configured to enable hands-free calling using the microphone 124A and speaker 125A connected to the voice interface unit 118A.

[0107] Furthermore, when a user (driver, etc.) operates the end button 112c, the control unit 101 controls the display screen 111D to display a browser screen so that the user can access a designated website on the internet via the mobile phone terminal 2 and receive services from that website.

[0108] In this second embodiment, although making a phone call hands-free is permitted under the Road Traffic Act, the driver's attention is somewhat distracted during calls. Furthermore, when making a phone call, sending an email, or accessing the internet, it is necessary to operate the system through the touch panel 112 while looking at the display screen 111D. Therefore, the system switches from manual driving mode to forced automatic driving mode to further enhance safety.

[0109] In this second embodiment, the detection of an event that triggers the driver to start using the functions of the portable device is determined by whether or not the driver touches the software buttons 112a to 112d displayed on the display screen 111D of the display unit 111. That is, in this second embodiment, the control unit 101 analyzes the image information captured by the camera 107a to determine whether or not the driver has made an action to touch the software buttons 112a to 112d displayed on the display screen 111D, and also determines through the touch panel 112 whether or not any of those software buttons 112a to 112d have actually been touched. When the control unit 101 determines that the driver has made an action to touch the software buttons 112a to 112d displayed on the display screen 111D, and that any of the software buttons 112a to 112d have actually been touched, it automatically switches from manual driving mode to forced automatic driving mode.

[0110] Furthermore, the reason why the detection of events that trigger the driver to start using the functions of the mobile device is not limited to the detection of touch operation of any of the software buttons 112a to 112d, but also detects the driver's actions, is that, for example, even if a passenger in the front passenger seat operates those buttons and uses the functions of the mobile phone terminal 2, it is thought that this would not significantly affect the driver's manual driving.

[0111] [Example of the operation of switching the driving mode in the autonomous vehicle 1A of the second embodiment] An example of the processing flow in the electronic control circuit unit 10A of the autonomous vehicle 1A of the second embodiment will be explained with reference to the flowchart in Figure 9.

[0112] First, the control unit 101 determines whether the driving mode of the autonomous vehicle 1 is manual driving mode or not (step S71). If, in step S71, it determines that the driving mode is not manual driving mode but autonomous driving mode, it proceeds to the processing routine for autonomous driving mode (step S72).

[0113] In step S71, if it is determined that the driving mode is manual driving mode, the control unit 101 monitors the image information captured by the camera 107a and analyzes the captured image information to determine whether the driver made an attempt to touch the software button 112c or 112d in order to make a call, and whether it detected a touch operation of either the software button 112c or 112d through the touch panel 112 (step S73).

[0114] In step S73, if the driver touches either the software button 112c or 112d to initiate a call, and the control unit 101 detects through the touch panel 112 that either the software button 112c or 112d has been touched, the control unit 101 switches the driving mode to forced automatic driving mode and notifies the driver of this by, for example, emitting a message through the speaker 125A (step S74).

[0115] Next, the control unit 101 executes the process to start the car navigation function, sets the destination, and starts the car navigation function (step S75). This process to start the car navigation function in step S75 is the same as the process described using Figure 4.

[0116] Next, the control unit 101 controls the system to maintain the forced automatic driving mode even if it detects a manual driving operation (step S76). The control unit 101 then detects that the driver has performed an operation to terminate a function (such as a call, email, or internet connection) on the display screen 111D via the touch panel 112, and monitors the image information captured by the camera 107a. By analyzing the captured image information, the control unit 101 determines whether the driver has performed such a termination operation and subsequently placed their hands on the steering wheel, thereby enabling manual driving (step S77). If it is determined in step S77 that the system is not yet in a state where manual driving is possible, the control unit 101 continues to execute step S77 and waits for the system to become capable of manual driving.

[0117] Then, in step S77, if the control unit 101 determines that manual driving is possible, it switches from forced automatic driving mode to normal automatic driving mode (step S78), waits to detect manual driving operations such as the accelerator pedal, brake pedal, shift lever, and steering wheel (step S79), and when it detects manual driving operations in step S79, it switches from automatic driving mode to manual driving mode and notifies the driver of this by emitting a message to that effect, for example, through speaker 125A (step S80). After step S80, the control unit 101 returns to step S73 and repeats the processing from step S73 onward.

[0118] In step S73, if the control unit 101 determines that the driver has not touched the software button 112c or 112d to make a call, or that it has not detected that either the software button 112c or 112d has been touched, the control unit 101 determines whether or not an incoming call has been detected (step S81). If it determines that no incoming call has been detected, the process returns to step S73.

[0119] Then, in step S81, when it is determined that an incoming call has been detected, the control unit 101 monitors the image information captured by the camera 107a and analyzes the captured image information to determine whether the driver made an action to touch the software button 112a in order to answer the incoming call, and whether the touch operation of the software button 112a was detected through the touch panel 112 (step S82).

[0120] In step S82, if the control unit 101 determines that the driver is attempting to touch the software button 112a to answer an incoming call and has detected the touch operation of the software button 112a through the touch panel 112, the control unit 101 proceeds to step S74 and repeats the process from step S74 onward.

[0121] Furthermore, if in step S82 the control unit 101 determines that the driver has not attempted to touch the software button 112a to answer an incoming call, or that it has not detected a touch operation of the software button 112a through the touch panel 112, the control unit 101 returns to step S73 and repeats the process from step S73 onward.

[0122] As described above, according to this embodiment, when the driver is operating in manual driving mode and takes action to make a phone call, send an email, or make a call to an internet site, or takes action to respond to an incoming phone call or email, the autonomous vehicle 1A automatically switches from manual driving mode to forced autonomous driving mode, and the autonomous vehicle 1A enters a state of safe driving in forced autonomous driving mode. Therefore, the driver can confidently take their hands off the steering wheel and make phone calls, send and receive emails, and even receive various services via the internet by focusing on the display screen.

[0123] [Modified version of the second embodiment] Furthermore, in this second embodiment, the detection of an event that triggers the driver to start using the functions of the portable device may not be limited to detecting the driver's operation of the software buttons 112a to 112d on the display screen 111D, but may also include detecting whether the driver's hands are off the steering wheel. For example, if the driver operates the software buttons 112a to 112d on the display screen 111D and takes both hands off the steering wheel, the system may switch to forced automatic driving mode. However, if the driver operates the software buttons 112a to 112d but does not take at least one hand off the steering wheel, the system may maintain manual driving mode and not switch to forced automatic driving mode.

[0124] [Third Embodiment] This third embodiment is a case in which the electronic control circuit unit of the autonomous vehicle itself has the functionality of a mobile phone terminal. In other words, in this third embodiment, the autonomous vehicle 1B has the functionality of a mobile phone as its own function, in which the electronic control circuit unit 10B has the functionality of a mobile phone.

[0125] Figure 10 is a block diagram showing an example of the configuration of the electronic control circuit unit 10B of the autonomous vehicle 1B of this third embodiment. The same reference numerals are used for parts identical to those of the electronic control circuit unit 10 of the autonomous vehicle 1 of the first embodiment described above, and their detailed descriptions are omitted.

[0126] As is evident from comparing Figure 1 and Figure 10, the electronic control circuit unit 10B of the autonomous vehicle 1B in the third embodiment does not include the incoming call notification detection unit 116 of the electronic control circuit unit 10 in the first embodiment, but instead includes a mobile phone function unit 116B. A microphone 124B and a speaker 125B for hands-free calling are connected to the mobile phone function unit 116B. The other configurations of the electronic control circuit unit 10B of the autonomous vehicle 1B in the third embodiment are the same as those of the electronic control circuit unit 10 in the first embodiment.

[0127] The mobile phone function unit 116B provides the functions of the mobile phone terminal 2. This third embodiment differs only in that the functions of the mobile phone terminal 2 are provided within the electronic control circuit unit 10B, and it operates in exactly the same way as the second embodiment described above, and can achieve the same effects and advantages.

[0128] Furthermore, a modified example of the third embodiment can be constructed in the same manner as a modified example of the second embodiment, and similar effects and advantages can be obtained.

[0129] Note that a car phone may also be used instead of a mobile phone.

[0130] [Other embodiments or modifications] In the above embodiment, the system switches from forced automatic driving mode to normal automatic driving mode before switching to manual driving mode. However, it is also possible to configure the system to switch directly from forced automatic driving mode to manual driving mode once the driver has finished using the functions of their portable device.

[0131] This invention can be applied not only to regular automobiles and light automobiles, but also to trucks, buses, taxis, tractors, dump trucks, excavators, forklifts, and even to single-person automobiles and motorcycles.

[0132] Furthermore, although the autonomous vehicle in the above-described embodiment is an electric vehicle, this invention is also applicable to gasoline vehicles, hybrid vehicles, and other types of vehicles. [Explanation of Symbols]

[0133] 1,1A,1B...Autonomous vehicle, 10,10A,10B...Electronic control circuit unit, 104...Manual / automatic driving mode switching control unit, 107...Camera group, 111...Display unit, 112...Touch panel, 113...Car navigation function unit, 114...Driver action analysis detection unit, 115...Forced automatic driving mode switching determination unit, 116...Incoming call notification detection unit

Claims

1. In an autonomous vehicle equipped with a manual driving mode in which the vehicle is driven based on the driver's actions and an autonomous driving mode in which the vehicle is driven autonomously, An input operation detection means for detecting the driver's input operation for creating an email or message using the functions of a mobile device, In the manual driving mode, when the input operation detection means detects an input operation by the driver to create an email or message using the functions of the portable device, a mode switching means switches from the manual driving mode to the automatic driving mode, An autonomous vehicle characterized by being equipped with the following features.

2. The functions of the aforementioned portable device are incorporated as functions of the vehicle itself. The autonomous vehicle according to feature 1.

3. The aforementioned creation of emails or messages includes cases of email, short messages, X (formerly Twitter®), LINE, SNS, and electronic bulletin boards. An autonomous vehicle according to claim 1 or 2.

4. The aforementioned portable device is a mobile phone terminal, smartphone, tablet, PDA (Personal Digital Assistant), or laptop computer. An autonomous vehicle according to any one of claims 1 to 3.

5. The aforementioned automatic driving modes include a normal automatic driving mode that can be switched to the manual driving mode by a predetermined operation by the driver, and a forced automatic driving mode in which switching to the manual driving mode is not possible. The mode switching means switches from the manual operation mode to the forced automatic operation mode. An autonomous vehicle according to any one of claims 1 to 4.

6. The system includes termination detection means for detecting the end of the driver's input operation for creating an email or message using the functions of the aforementioned mobile device, When the termination detection means detects the end of the input operation, the forced automatic operation mode is switched to the normal automatic operation mode or the manual operation mode. The autonomous vehicle according to feature 5.

7. The system includes termination detection means for detecting the end of the driver's input operation for creating an email or message using the functions of the aforementioned mobile device, When the termination detection means detects the end of the input operation, the automatic operation mode is switched to the manual operation mode. An autonomous vehicle according to any one of claims 1 to 6.

8. It is equipped with a navigation system that guides the vehicle toward a set destination, When the mode switching means switches from the manual driving mode to the automatic driving mode, the system includes a designation means that inquires about the destination from the driver or passenger and accepts the destination specified in response to the inquiry. The navigation means guides the vehicle toward the destination specified by the designation means. An autonomous vehicle according to any one of claims 1 to 7.

9. It is equipped with a navigation system that guides the vehicle toward a set destination, When the mode switching means switches from the manual driving mode to the automatic driving mode, the navigation means guides the vehicle toward a pre-set destination. An autonomous vehicle according to any one of claims 1 to 7.

10. When the mode switching means switches from the manual driving mode to the automatic driving mode, the system includes an inquiry means for asking the driver or passenger whether the pre-set destination is acceptable. If the inquiry means indicates that the pre-set destination is acceptable, the navigation means guides the vehicle toward the pre-set destination. The autonomous vehicle according to feature 9.

11. The aforementioned inquiry means, if the aforementioned pre-set destination is unsuitable, includes a designation means that inquires about the destination from the driver or passenger and accepts the designation of a destination in response to that inquiry. The navigation means guides the vehicle toward the destination specified by the designation means. The autonomous vehicle according to feature 10.

12. The navigation means includes a presentation means for presenting route candidates, When the mode switching means switches from the manual driving mode to the automatic driving mode, the selection means presents route candidates to the driver or passenger using the presentation means and accepts the selection of one route from among the route candidates. The navigation means uses the route selected by the selection means to guide the vehicle toward the destination specified by the designation means. The autonomous vehicle according to claim 8 or 11.

13. The navigation means includes a presentation means for presenting route candidates, When the mode switching means switches from the manual driving mode to the automatic driving mode, the selection means presents route candidates to the driver or passenger using the presentation means and accepts the selection of one route from among the route candidates. The navigation means uses the route selected by the selection means to guide the vehicle toward the pre-set destination. The autonomous vehicle according to claim 9 or 10.

14. The mode switching means notifies the driver by voice that the mode has been switched from manual driving mode to automatic driving mode. An autonomous vehicle according to any one of claims 1 to 13.

15. The vehicle is equipped with the communication functions of the aforementioned portable device as a function of the vehicle itself, The system comprises a shooting means and an image analysis means having a function to analyze the actions taken by the driver to make a call using the communication function or actions to respond to an incoming call or reception received by the communication function, based on the image captured by the shooting means. The mode switching means also switches from the manual driving mode to the automatic driving mode when the captured image analysis means detects an action by the driver to make a call using the communication function or an action to respond to an incoming call or reception received by the communication function while the vehicle is in the manual driving mode. An autonomous vehicle according to any one of claims 1 to 14.

16. The system comprises a shooting means and an image analysis means that analyzes whether the driver has taken both hands off the steering wheel based on the image captured by the shooting means. The mode switching means switches from the manual driving mode to the automatic driving mode when the captured image analysis means detects that the driver has taken both hands off the steering wheel while driving in the manual driving mode. An autonomous vehicle according to any one of claims 1 to 15.

17. Equipped with a means of filming, The input operation detection means detects the driver's input operation for creating an email or message using the functions of the mobile device, based on the captured image taken by the shooting means. An autonomous vehicle according to any one of claims 1 to 16.

18. A computer in an autonomous vehicle equipped with a means of taking pictures, and equipped with a manual driving mode in which the vehicle is driven based on the driver's actions, and an autonomous driving mode in which the vehicle is driven autonomously, Input operation detection means for detecting the driver's input operation for creating an email or message using the functions of a mobile device. In the driving state in the manual driving mode, when the input operation detection means detects an input operation by the driver to create an email or message using the functions of the portable device, a mode switching means switches from the manual driving mode to the automatic driving mode. A program for autonomous vehicles to function as such.

Images