System and method for autonomous vehicle notification

Abstract

To provide a system and a method for autonomous vehicle notification that controls a messaging system that provides the autonomous vehicle with messages related to control by a remote manager that occurs based on conditions detected outside the autonomous vehicle.SOLUTION: A system for autonomous vehicle notification includes a sensor mounted on the autonomous vehicle, a messaging system mounted on the autonomous vehicle, and a controller. The sensor is configured to detect conditions external to the autonomous vehicle. The controller is configured to control communication with a remote manager to enable the remote manager to control the autonomous vehicle based on the conditions, and to control the messaging system to provide messages to the autonomous vehicle related to control by the remote manager.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates generally to a system and method for autonomous vehicle notification. Relates to control by a remote manager occurring based on conditions sensed external to the autonomous vehicle An autonomous vehicle notification system that controls a messaging system that provides messages to an autonomous vehicle. The present invention relates to a system and method. [Background technology]

[0002] The autonomous vehicle may be autonomously controlled to navigate a route without direct human intervention. The autonomous vehicle generates and maintains a travel route and controls the autonomous vehicle to move along the travel route. The autonomous vehicle may include a control system that can control the vehicle remotely while operating without a driver. In the operation system, a remote manager may communicate with the autonomous vehicle via, for example, a network link. That is, the remote manager can communicate with the autonomous vehicle to detect obstacles on the road surface, for example. Controlling the movement of an autonomous vehicle in a given situation, such as when it is not possible to navigate through an object It can also be controlled remotely, even when a driver is present in the autonomous vehicle. The manager can then automate the process to assist the driver in certain situations, such as different driving conditions. The movement of the vehicle can be controlled. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] US Patent Application Publication No. 2017 / 0136842(A1) Summary of the Invention

[0004] In some teleoperation situations, the autonomous vehicle waits for intervention by a telemanager. In this situation, other drivers have been found to slow down or even stop moving while Vehicle occupants and people outside the autonomous vehicle, such as pedestrians, may be unable to determine why the autonomous vehicle is slowing or stopping. This can cause serious injury to vehicle occupants and people outside the vehicle. may become uncertain as to whether the autonomous vehicle is functioning properly.

[0005] To address these issues, the disclosed embodiments provide a method for detecting and detecting hazards associated with autonomous vehicles using sensors and A communication system for an autonomous vehicle including a messaging system mounted on the autonomous vehicle and a controller. The sensor is configured to detect a state outside the autonomous vehicle. The controller enables a remote manager to control the autonomous vehicle based on that state. The control unit is configured to control communication with the remote manager as described above, and is related to the control by the remote manager. and configured to control the messaging system to provide a message to the autonomous vehicle. can be. [Brief description of the drawings]

[0006] Reference is now made to the accompanying drawings, which form a part of this original disclosure.

[0007] [Figure 1] FIG. 1 is a schematic diagram of a communication system in which an autonomous vehicle operates that includes a system for autonomous vehicle notification according to an embodiment of the disclosure. [Diagram 2] FIG. 2 is a schematic diagram of an example of components of the autonomous vehicle shown in FIG. [Diagram 3] FIG. 1 is a schematic diagram of an example passenger compartment of an autonomous vehicle. [Figure 4]FIG. 1 is a perspective view of a front driver's side of an autonomous vehicle including an external messaging device for issuing messages, where the front passenger side is a substantial mirror image of the front driver's side. [Diagram 5] FIG. 1 is a perspective view of a front driver's side of an autonomous vehicle including an external messaging device issuing updated messages, where the front passenger side is a substantial mirror image of the front driver's side. [Figure 6] FIG. 1 is a perspective view of the rear driver's side of an autonomous vehicle including an external messaging device issuing messages, with the rear passenger side being a mirror image of the rear driver's side. [Figure 7] FIG. 1 is a perspective view of the rear driver's side of an autonomous vehicle including an external messaging device issuing updated messages, with the rear passenger side being a mirror image of the rear driver's side. [Figure 8] 2 is a block diagram illustrating an example of components of a vehicle manager in the autonomous vehicle communication system shown in FIG. [Figure 9-1] 1 is a flowchart illustrating an example of operations performed by a system for autonomous vehicle notification according to disclosed embodiments. [Figure 9-2] 1 is a flowchart illustrating an example of operations performed by a system for autonomous vehicle notification according to disclosed embodiments. [Figure 10] 1 is an example of a map displayed on a display screen in a passenger compartment of an autonomous vehicle. [Figure 11] 1 is an example of information displayed on a display in an autonomous vehicle passenger compartment, indicating that the autonomous vehicle has predicted a problem and is requesting assistance from a vehicle manager. [Figure 12] 1 is an example of information displayed on a display in an autonomous vehicle passenger compartment, indicating that the autonomous vehicle has requested assistance from a vehicle manager. [Figure 13] 1 is an example of information displayed on a display in the passenger compartment of an autonomous vehicle indicating that the autonomous vehicle has stopped and is waiting for assistance from a vehicle manager. [Figure 14]1 is an example of information displayed on a display in the passenger compartment of an autonomous vehicle, indicating that a vehicle manager has been requested to assist the autonomous vehicle in attempting to resolve a problem. [Figure 15] 1 is an example of information displayed on a display in the passenger compartment of an autonomous vehicle, indicating that a vehicle manager has generated a solved route for the autonomous vehicle. [Figure 16] 1 is an example of information displayed on a display in the passenger compartment of an autonomous vehicle, indicating that the autonomous vehicle has completed clearing a problem area and will resume autonomous operation. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Selected embodiments are described below with reference to the drawings. It should be understood that the following description of several embodiments is provided by way of example only and is intended to be illustrative and not restrictive of the principles of the present invention. The present invention is provided for the purpose of limiting the scope of the present invention, which is defined by the claims and equivalents thereof. There is none.

[0009] FIG. 1 illustrates an example of an autonomous vehicle communication system 10. The autonomous vehicle communication system 10 includes a plurality of Each of the autonomous vehicles 12 may be configured to operate in accordance with any of the methods disclosed herein. For example, the system 14 for autonomous vehicle notification according to the embodiment shown in FIG. The communication system 10 may be implemented using communication links as understood in the art, for example, a communication network 10. 8. The vehicle includes at least one vehicle manager 16 that can communicate with each other via a single I / O interface 16 . The vehicle manager 16 serves as a remote vehicle manager that remotely controls the autonomous vehicle 12. The vehicle manager 16 can be a human or computer entity that can fulfill the role. Also, the remote manager, vehicle supervisor, remote operator, or other suitable device known in the art may be used. The vehicle manager 16 may be referred to by various terms, such as, for example, the controller 16, as described in more detail below. 20, a display 22, and a user input 2 including, for example, a keyboard 26 and a mouse 28. 4, communication device 30, and data storage 32, or having access to these. .

[0010] As shown in FIG. 2, the autonomous vehicle notification system 14 includes a controller 40, a forward vehicle Both sensors 42 and 44, rear vehicle sensors 46 and 48, a communication device 50, a navigation device 52, GPS device 54, data storage 56, user input 58, vehicle components 60, messaging system 62, and other related systems typical of an autonomous vehicle 12 as understood in the art. Two forward vehicle sensors 42 and 44, two forward vehicle sensors 43 and 44, two forward vehicle sensors 44 and 44, two forward vehicle sensors 45 and 46, two forward vehicle sensors 46 and 47, two forward vehicle sensors 47 and 48, two forward vehicle sensors 49 and 49 ... Only rear vehicle sensors 46 and 48, and user input 58 are shown for exemplary purposes. Nevertheless, autonomous vehicle 12 may include any suitable number of these components. It can include.

[0011] Data storage 56 may be any suitable type of memory or storage device, Data can be stored in and retrieved from these. User Input Unit 58 For example, touch panels on displays, gesture detection devices, steering wheels, on the vehicle 12 or in any other suitable location inside or outside the autonomous vehicle 12 described herein. The user input unit 58 may be a mechanical or virtual button, etc. A laptop computer, a notebook computer, or a mobile device such as a communication device 50 may be used. or any other suitable device that can communicate with the controller 40 in any other suitable manner. The device may be a separate device, such as a device of the same type.

[0012] The vehicle components 60 may include, for example, turn signals, windshield wipers, lights, Door latches, trunk latches, tailgate latches, vehicle entertainment systems , and other systems necessary or desirable for vehicle operation (autonomous or otherwise) such as braking and steering control systems. Any desired system or device, and any other suitable system or device as understood in the art. Vehicle components may include electrical and mechanical systems in autonomous vehicle 12, such as: The component 60 also includes, for example, at least one microphone, a speaker, a camera, an RF Externally-located viewing with ID reader and video screen that can also act as a touch panel Vehicle components 60 may also include sensing links. At least one PIN pad, fingerprint reader, biometric device, or external device that may be present in one or more locations. This may include physical ID devices, and facial recognition devices.

[0013] The messaging system 62 may be used by occupants of the autonomous vehicle 12 and by occupants of other vehicles or pedestrians. Such an autonomous vehicle can send messages to multiple discos that can be received by people outside the vehicle. For example, the messaging system 62 may include a display, a speaker, a haptic device, etc. As shown in FIG. 3, the instrument panel 68 in the passenger compartment 70 of the autonomous vehicle 12 The display 64 and the speaker 66 may be included or may be operable with the display 64 and the speaker 66. These provide visual and audio information to the occupants of autonomous vehicle 12 as described below. The messaging system 62 may also include additional data, as shown in FIGS. The vehicle may also include a display 72 and a speaker 74. These may be used in conjunction with the autonomous vehicle as described below. The displays 64 and 72 can provide visual and audio information to the outside of the display 12. Industry-recognized LCD screens, touch panels, flat screen displays, heads-up Any suitable type of display, such as a display, window display, etc. That is, the display 72 may be displayed in an external location facing forward of the autonomous vehicle 12, The exterior locations facing the side of the vehicle 12, the exterior locations facing the rear of the autonomous vehicle 12, and the In addition, the messaging system 62 may provide a visual indication of the message being sent. In particular, a haptic device capable of providing haptic information to an occupant of an autonomous vehicle 12 as understood in the art. The messaging system 62 may further include a device 76 for enabling an occupant of the autonomous vehicle 12 to Or, smartphones, notebooks, tablets, etc. used by people outside the autonomous vehicle 12 Communications equipment to transmit information, such as text messages, for reception by such devices. It can work with 50.

[0014] Controller 40 implements a control program that controls autonomous vehicle 12 as described herein. The processor includes a microcomputer having a The controller 40 may also include an input interface circuit, an output interface circuit, and Interface circuits, as well as ROM (Read Only Memory) devices and RAM (Random Access Memory) Other conventional components such as storage devices, such as memory access devices The internal RAM of the controller 40 stores the state of the operating flags, various control data, The internal ROM of the controller 40 can store any of the following functions as understood in the art: It is possible to store control programs and arbitrary information for various operations described above. The roller 40 is coupled to front vehicle sensors 42 and 44, rear vehicle sensors 46, and a vehicle speed sensor 48 in any suitable manner understood in the art. Vehicle sensors 46 and 48, communication device 50, navigation device 52, GPS device 54, Data storage 56, user input 58, vehicle components 60, messaging system operably coupled to the system 62, as well as other types of equipment of the autonomous vehicle 12, as described herein. The data processor is programmed to monitor and control these components so as to The storage 56 also stores the front vehicle sensors 42 and 44, the rear vehicle sensors 46 and 48, and Device 50, navigation device 52, GPS device 54, display 58, user input section 58, vehicle components 60, messaging system 62, and any other suitable information The controller 40 may execute a process and control program, such as a process and control program for the information. The data storage 56 can also store the control programs described herein. Received from other autonomous vehicles 12, the vehicle manager 16, and any other entity, such as Information can also be stored.

[0015] As understood in the art, the vehicle sensors 42, 44, 46 and 48 are used to monitor the autonomous vehicle 12. The autonomous vehicle 12 is configured to monitor and sense the surrounding environment and detect objects in proximity to the autonomous vehicle 12. As shown in FIG. 2, vehicle sensors 42, 44, 46 and 48 detect the forward quarter of the autonomous vehicle 12. Externally attached to the rear quarter panels 80 and 82 and to the rear quarter panels 84 and 86. However, the vehicle sensors 42, 44, 46 and 48 may be mounted on the front Autonomous vehicles including front and rear bumpers, exterior mirrors, or any combination of suitable areas The vehicle sensors 42, 44, 46 may be mounted on any suitable exterior portion of the vehicle 12. and 48 communicate with the controller 40. The controller 40 then controls the autonomous vehicle 12. To control the operation described herein, vehicle sensors 42, 44, 46 and 48 provide: The information can be used.

[0016] Vehicle sensors 42, 44, 46 and 48 may be any type of desired sensor. For example, , forward vehicle sensors 42 and 44 are long-range radars for object detection in front of the autonomous vehicle 12. The forward vehicle sensors 42 and 44 may include a device for detecting the vehicle's position at a predetermined distance (e.g., up to 200 m). The present invention can be configured to detect objects at a distance (distance or further distance if desired), As will be appreciated, the viewing angle may be any practical viewing angle (e.g., around 15°). The sensors 42 and 44 also have large apertures to assist in monitoring the area in front of the autonomous vehicle 12. Rear Vehicle Sensor 4 6 and 48 also include short-range radar devices and, optionally, long-range radar devices. In addition, the vehicle sensors 42, 44, 46 and 48 may include cameras, radar sensors, The present invention may include a photo sensor, a photo sensor, or any combination and number of these devices as understood in the art. The vehicle sensors 42, 44, 46 and 48 are typically electronic detection devices that transmit electromagnetic waves (e.g., The vehicle sensors 42, 44, 46 and 48 may include, for example, sensors known in the art. For example, a digital camera captures a computer-processed image and analyzes the image or uses a laser. The sensor may include any suitable sensor that emits radiation.

[0017] In addition, the vehicle sensors 42, 44, 46 and 48 detect at least the speed, It can be configured to detect orientation, yaw, acceleration and distance. 42, 44, 46 and 48 rely on the measurement of effects such as the Doppler effect to detect the presence of a forward object. FM-CW (Frequency Modulated Continuous Wave) radar to identify location, pulse and FSK (Frequency Shift Keying) (softkeying) radar, sonar and LIDAR (light detection and ranging) devices, RFI D (Radio Frequency Identification) sensors, as well as other types of object location detection including ultrasonic devices The object location device may include a charge-coupled device (CCD) or a complementary metal-oxide semiconductor (CCD) based optical fiber. Complementary metal oxide semiconductor (CMOS) video image sensors and digital photography are used to Other known camera / video image processors for "seeing" objects ahead, including remote vehicles. may include.

[0018] Vehicle sensors 42, 44, 46 and 48 also detect arrivals ahead, to the sides and behind the autonomous vehicle 12. The controller 40 may also monitor oncoming traffic. Vehicle sensors to monitor traffic flow to maintain lane position or perform lane change maneuvers The controller 40 may also be used to control the vehicle Determine whether the remote object detected by the sensors 42, 44, 46, and 48 is a pedestrian or a remote vehicle. The controller 14 also receives signals from the vehicle sensors 42, 44, 46 and 48. Vehicular and pedestrian traffic volumes can also be determined based on the information.

[0019] The communication device 50 may be configured, for example, as separate components or as a transceiver. This includes receivers and transmitters, as well as any other type of equipment for wireless communication. The receiving device 50 is configured to wirelessly communicate via one or more paths. Examples of communication paths are , cellular telephone networks, wireless networks (WiFi or WiMAX®) ), DSRC (dedicated short range communications) networks, power line networks, etc. 50 for receiving information from an external source and transmitting such information to the controller 40. For example, the communication device 50 may be configured to receive, for example, , and communicates with the vehicle manager 16 via direct communication or in any suitable manner understood in the art. The communication device 50 may also communicate with other autonomous vehicles 12, or any other suitable entity. and, for example, via communications network 18, by direct communication, or by any other method known in the art. The communication device 50 may be, for example, a microphone, Includes or interacts with speakers, displays, and any other type of equipment. , e.g. auditory interaction, audiovisual interaction, menu interface interaction, visual personal assistant It is possible to enable types of interaction modalities such as assistant interaction.

[0020] Furthermore, the communication device 50 may, for example, be configured to receive scheduled Information about events from subscribed local knowledge sources via service providers For example, the communication device 50 may be a software device connected to the autonomous vehicle 12. Receive information from mobile applications, such as social media applications , and may be configured to transmit such information to the controller 40. The device 50 may store Facebook and / or Facebook-related information for various locations within a given area. may share information about Twitter check-ins with Facebook and / or When a mobile phone having a Twitter application is connected to the autonomous vehicle 12, The signal can be configured to be received at

[0021] The navigation device 52 may provide, for example, navigational information about a recommended driving route for the autonomous vehicle 12. The recommended driving route is, for example, Information received by the controller 40 from a mobile application connected to the vehicle 12 or by any method, device or system described herein or known in the art. The determination may be based on the driving mode of the autonomous vehicle 12 determined using the navigation system. Navigation device 52 also communicates with GPS device 54 to determine recommended driving routes. Controller 40 may be configured to control the navigation of autonomous vehicle 12 as understood in the art. It is possible to use information received from the navigation device 52 and the GPS device 54. Navigation device 52 may also provide a recommended driving route to a driver within autonomous vehicle 12, e.g. For example, the information may be configured to be displayed on display 64 or in any other suitable manner. The navigation device 52 may also use the communication device 50 to communicate with the navigation system 50, directly or in any other suitable manner. In a similar manner, the vehicle manager 16 may also communicate with the vehicle manager 16, for example.

[0022] As shown in FIGS. 1 and 8, the vehicle manager 16 includes a controller 20, a display 2 2, a user input section 24, a communication device 30, and a data storage 32, or access to these. The controller 20 controls the components of the vehicle manager 16. It includes a processor, such as a microcomputer, having a control program, and is The processor controls the autonomous vehicle 12 when performing remote control of the autonomous vehicle 12. The controller 20 may also include an input interface. device circuit, output interface circuit, and ROM (read-only memory) device and and other storage devices such as RAM (random access memory) devices. The internal RAM of the controller 20 stores the state of the operation flags. The internal ROM of the controller 20 can store various control data, etc. It will be understood that the control programs for the various operations described herein and any information may be stored in the device. This can be done.

[0023] The controller 20 receives information related to the operation of the vehicle manager 16, and any other appropriate information as understood in the art. The display 22 may be, for example, an LCD display, a touch panel, or a flash The display may be a flat screen display, or any other suitable type of display known in the art. The user input unit 24 may be, for example, a keyboard 26 and a mouse 28 shown in FIG. A touch panel, a gesture detection device, a machine or a virtual The user input unit 24 may also include a button for inputting a user's input, such as a smartphone or tablet computer. computer, notebook computer, or any other suitable device, such as a communication device 30 or any Any other suitable type of device capable of communicating with the controller 20 in any other suitable manner. The input / output port may be a separate device, such as a

[0024] The communication device 30 may be configured, for example, as separate components or as a transceiver. This includes receivers and transmitters, as well as any other type of equipment for wireless communication. The communication device 30 is adapted to wirelessly communicate with the communication network 16 via one or more communication paths. , and thus autonomous vehicles 12, other vehicle managers 14, and other types of content providers. or service providers, and any other type of suitable entity described herein. Examples of communication paths include cellular telephone networks, wireless networks (W iFi or WiMAX), DSRC (dedicated short-range communication) networks, power line networks The communication device 30 is for receiving information from an external source and transmitting such information. The communication device 30 is configured to transmit the communication signal to the controller 20. The communication may be autonomous via network 18, by direct communication, or in any suitable manner as understood in the art. The communication device 66 can also communicate with other vehicle managers 16 or any and with any other suitable entity, for example, via communications network 18, in direct communication, or through industry The communication device 30 may communicate in any suitable manner as understood in the art. , microphones, speakers, displays, and any other type of equipment. Interact with them, for example, through auditory interaction, audiovisual interaction, menu interface Enables types of interaction modalities such as interactive, visual personal assistant interaction, etc. It is possible.

[0025] The data storage 32 may be any suitable type of memory or storage device. Data can be stored in and retrieved from these. Data Storage 32 includes the display 22, the user input 24 and the communication device 30, as well as any other suitable The processing results and control programs for the information executed by the controller 20 The data storage 32 can also store the results and control programs of the autonomous vehicle. information received from the vehicle manager 12, other vehicle managers 16, and any other entities described herein. Information can be stored.

[0026] An example of the operation of the autonomous vehicle notification system 14 is now described with reference to the flow chart shown in FIG. In step 1000, the autonomous vehicle 12 is operating autonomously. During this time, the controller 40 may, for example, display the vehicle on the instrument panel 68. Any information may be sent via a display and a speaker in the passenger compartment such as the display 64 and the speaker 66. Controlling the messaging system 62 to refrain from giving certain messages of The controller 40 at this time may also transmit any particular messages to the autonomous vehicle. Additional displays 72 on the autonomous vehicle 12 to avoid exposure to the exterior of the 12 and display 74. That is, these additional displays can be controlled. 72 may remain off or dark and speaker 74 may be off or muted. The controller 40 also receives messages via the haptic device 76, messages via text, and Messaging to refrain from giving any other specific messages such as The controller 40 may also control the system 62. A typical navigation map shown in FIG. 10 is based on the navigation and GPS information obtained. The display 64 of the instrument panel 68 may be controlled to display the screen 90. The map 90 may include a map of the location of the autonomous vehicle 12 with respect to roads within a specified distance of the autonomous vehicle 12. Places along with other landmarks such as gas stations, restaurants, points of interest, etc. can be displayed in.

[0027] In step 1010, the controller 40 starts monitoring conditions external to the autonomous vehicle 12. The vehicle manager 16 then determines whether assistance from the vehicle manager 16 is necessary or desired. If assistance by the sensor 16 is not required or desired, the process proceeds to step 1000, where the autonomous The vehicle 12 continues to operate autonomously as understood in the industry.

[0028] However, if the controller 40 in step 1010 detects Determine that a condition results in a need for the fleet manager 16 to provide assistance to the autonomous vehicle 12. If so, processing proceeds to step 1020. For example, vehicle sensors 42, 44, 46, and 48 may include construction, traffic accidents, etc. that may prevent the autonomous vehicle 12 from proceeding along its normal route on the road R. , or any other situation. In the event, the controller 40 controls the communication device 50 to communicate with the autonomous vehicle 12 and the vehicle master. For example, the controller 40 may establish communication with the vehicle manager 16. 6. That is, the vehicle manager 16 can automatically request assistance from the autonomous vehicle Controlling the vehicle 12 to navigate around the trouble area T as understood in autonomous vehicle technology. It can be done.

[0029] In this situation, the vehicle occupant may be concerned that the autonomous vehicle 12 is approaching a problem area P and that the vehicle manager Sometimes, the vehicle may not realize that it needs assistance from the Vehicle 16. may become uncertain as to whether the autonomous vehicle 12 is functioning properly. People outside the autonomous vehicle 12, such as other drivers and pedestrians, may also be unable to understand why the autonomous vehicle 12 is operating normally. You may be uncertain as to whether something is not running as expected.

[0030] Thus, the controller 40 receives messages related to control by the vehicle manager 16. The messaging system 62 may be controlled to provide a message to the autonomous vehicle 12. For example, as shown in FIG. 11, the controller 40 controls a messaging system 62. , and a display 64 in the passenger compartment 70 to display a display D1 indicative of the state of the autonomous vehicle 12. For example, display D1 may indicate that autonomous vehicle 12 is anticipating a problem and is attempting to stop the vehicle. The display D1 may indicate that assistance is being requested from the manager 16. A representation of the road R along which the autonomous vehicle 12 is traveling, with a representation of the occupant of the autonomous vehicle 12. 4 and 6, and other informational messages 92 and 94 that provide information to the As shown, the controller 40 controls the messaging system 62 to communicate with the autonomous vehicle 12. and controlling the additional display 72 to display an information message 96 indicating the status of the For example, the message 96 may be sent to the autonomous vehicle 12 to request assistance from the vehicle manager 16. The controller 40 also controls the messaging system 62. 3 and 4, and controls the speakers 66 and 7 to issue appropriate messages indicating the status of the autonomous vehicle 12. 4, and any tactile device 76, character input device, etc. As described herein, a display 64, a speaker 66, a haptic device, The information provided by the character input is displayed on an additional display 72 external to the autonomous vehicle 12. and the message given by the speaker 74 may be different in content, so the controller 40 First information in the passenger compartment 70 of the autonomous vehicle 12 and information on the autonomous vehicle 12 different from the first information. and controlling a messaging system 62 to provide a message including the second information. It is possible.

[0031] The controller 40 further monitors progress in the control of the autonomous vehicle 12 by the vehicle manager 16. Update messages provided to vehicle occupants and to the outside of the autonomous vehicle 12 according to progress. For example, as shown in FIG. The controller 40 then controls the messaging system 62 to notify the autonomous vehicle 12 of the vehicle In the crew cabin 70, a display D2 is displayed indicating that assistance from the manager 16 has been requested. The display D2 can control the display 64 for the trouble area T. The location of the autonomous vehicle 12 can be illustrated, as shown, with information messages 92 and 94 Similarly, the controller 40 may update the messaging system 62. 5. Control an additional display to update information messages 96 indicating the status of the autonomous vehicle 12. The controller 40 can also control the messaging system 6. 2 to issue appropriate messages that update the state of the autonomous vehicle 12. 66 and 74, any tactile device 76, character input device, etc. You can control it.

[0032] As shown in FIGS. 13 to 16, the controller 40 controls the messaging system 62. Then, the message can continue to be updated to update the vehicle’s status. For example, As shown in FIG. 3, the controller 40 controls the messaging system 62 to communicate with the autonomous vehicle. Car 12 is near trouble area T while waiting for a solution from vehicle manager 16. Control the display 64 in the passenger compartment 70 to display a display D3 indicating that the vehicle has stopped. Similarly, the controller 40 may control the message transmission, for example as shown in FIGS. 5. Control the saging system 62 to update the information messages 96 indicating the status of the autonomous vehicle 12. The controller 40 can also control the additional display 72 to update the Controls messaging system 62 to send appropriate messages to update the state of autonomous vehicle 12. Speakers 66 and 74, as well as an optional tactile device 76, a character input device, and The device may be capable of controlling any or all of the devices, chairs, etc.

[0033] In step 1030, the controller 40 executes Control of the messaging system 62 can then continue. For example, as shown in FIG. The controller 40 controls the messaging system 62 so that the vehicle manager 16 An indication D4 indicating that a request for assistance has been received and a solution is being created for the autonomous vehicle 12. The display 64 in the passenger compartment 70 can be controlled to display the The controller 40 controls the messaging system 62 to indicate the status of the autonomous vehicle 12. The additional display 72 can be controlled to update the information message 96. The controller 40 also controls a messaging system 62 to communicate the status of the autonomous vehicle 12. Speakers 66 and 74, as well as any haptic devices, are used to issue appropriate messages to update the The controller 72 may control any or all of the keyboard 76, the character input device, and the like.

[0034] In step 1040, the vehicle manager 16 has completed generating the solution and is now autonomous. The vehicle 12 is controlled by the vehicle manager 16 based on the sensed conditions described above. For example, as shown in FIG. 15, the controller 40 controls a messaging system 62. Then, the vehicle manager 12 can bypass the trouble area T and proceed around the trouble area T. display an indication D5 indicating that the monitor 16 has created an alternative path P for the autonomous vehicle 12. The display 64 in the passenger compartment 70 can be controlled to display the The controller 40 controls the messaging system 62 to transmit information messages indicating the status of the autonomous vehicle 12. The controller 74 may control the additional display 72 to update the message 96. The controller 40 also controls a messaging system 62 to update the state of the autonomous vehicle 12. Speakers 66 and 74, and an optional tactile device 76, for issuing appropriate messages. , character input device, etc. The visual and audible messages indicate an estimated time period when the autonomous vehicle 12 will resume movement. It can give you a down.

[0035] In step 1050, the controller 40 receives the following command from the vehicle manager 16: If so, the process continues to step 10. 40. However, assistance from the vehicle manager 16 is no longer available. If not, the process proceeds to step 1060. 0 controls the messaging system 62 to notify the autonomous vehicle 12 of its passage through the trouble area T. The display 64 in the passenger compartment 70 is controlled to display a display D6 indicating that the Similarly, the controller 40 can control the messaging system 62. and an additional display to update the informational messages 96 indicating the status of the autonomous vehicle 12. For example, the controller 40 may control the messaging system 6 2 to send a message indicating that the autonomous vehicle 12 has completed passing through the trouble area T. The speaker 66 present in the instrument panel 68 can be controlled to provide The controller 40 at this time also configures an additional display to provide a similar message. The touch panel 72, the speaker 74, the tactile device 76, the character input device, etc. can be controlled. The process then returns to step 1000, where the controller 40 performs any of the above-described steps. While controlling the messaging system 62 to refrain from delivering a particular message to the An instrument panel may be configured to display a typical navigation map 90 as shown in FIG. 68 displays 64 can be controlled.

[0036] As will be appreciated from the description herein, the system 14 for autonomous vehicle notifications according to the disclosed embodiments. provides messages and updates to the occupants of the autonomous vehicle 12 and to people outside the autonomous vehicle 12, and thus The purpose of this is to inform the occupants and other road users that the autonomous vehicle 12 may be operating in an uncertain manner when remote control is occurring. This can lead to frustration among occupants and other road users. As a result, attempts to take undesirable actions, such as exiting the autonomous vehicle 12, This reduces the possibility of overtaking attempts, etc., and therefore promotes orderly traffic. In addition, the occupant of the autonomous vehicle 12 can determine whether the autonomous vehicle 12 is operating properly. You don’t need to worry about the state of the autonomous vehicle 12 because you know it’s working. Other tasks, such as reading, can be resumed.

[0037] General Interpretation of Terms

[0038] In understanding the scope of the present invention, the term "comprises" and its derivatives as used herein are intended to Identify the presence of specified features, elements, components, groups, integers and / or steps. It is intended to be an open-ended term that includes any other unstated features, elements, components, or components. This does not exclude the presence of components, groups, integers and / or steps. This also applies to words such as "including," "having," "comprising," and their derivatives. The same also applies to words having similar meanings. can have a dual meaning with one part or with multiple parts. Thus, these terms are As used to describe the present invention, for a vehicle equipped with an autonomous vehicle communication system should be interpreted as follows.

[0039] Terms used herein to describe components, sections or parts of a device "Configured" refers to hardware that is configured and / or programmed to perform a desired function. As used herein, "substantially," "about," "approximately," and "software" include, but are not limited to, the following terms: and "approximately" are used to indicate that the final result is modified without significantly changing it. It means a reasonable deviation of the word.

[0040] While only selected embodiments have been chosen to illustrate the invention, the scope of the appended claims is not to be construed as limiting the present invention. Various changes and modifications may be made herein without departing from the scope of the present invention, which is defined in the appended claims. It will be apparent to one skilled in the art from this disclosure that various components may be The size, shape, location or orientation can be changed as needed and / or desired. Components shown directly connected or in contact with The functions of one element can be performed by two and vice versa. It is possible. The structure and function of one embodiment may be adapted to another embodiment. Not all benefits need to be present simultaneously in a particular embodiment. Features that distinguish the present invention from the prior art are All structural and functional properties embodied by such features, either alone or in combination with other features, and / or a separate description of the applicant's further invention, including a functional concept. That is, the foregoing description of embodiments of the present invention is provided by way of example only and is not intended to be limiting of the invention. It is not intended to limit the invention as defined by the appended claims and equivalents thereto. isn't it.

Claims

1. 1. A system for autonomous vehicle notifications, comprising: a sensor mounted on the autonomous vehicle and configured to sense conditions external to the autonomous vehicle; 、 a messaging system onboard the autonomous vehicle; Controlling communication with a remote manager and instructing the remote manager to execute the autonomous process based on the state. a controller configured to enable control of a vehicle; Including, The controller transmits messages related to control by the remote manager to the autonomous vehicle. and controlling the messaging system to provide a communication method for an autonomous vehicle to both the A system of knowledge.

2. The messaging system provides the message in a passenger compartment of the autonomous vehicle.

2. The autonomous vehicle notification system of claim 1, configured to:

3. The messaging system is configured to provide the message external to the autonomous vehicle.

2. The autonomous vehicle notification system of claim 1 .

4. The controller further monitors the progress of the control of the autonomous vehicle by the remote manager. and updating information in a message provided by the messaging system.

2. The autonomous vehicle notification system of claim 1 .

5. the messaging system includes a display; The controller controls the display to present the message as a visual representation.

10. The autonomous vehicle notification system of claim 1 configured to control a vehicle notification system for detecting a vehicle failure.

6. The controller monitors the progress of the control of the autonomous vehicle by the remote manager. The autonomous vehicle notification system of claim 5 configured to update a visual display.

7. The display is configured to provide the visual representation in a passenger compartment of the autonomous vehicle.

6. The autonomous vehicle notification system of claim 5 .

8. the display is configured to provide the visual indication on an exterior of the autonomous vehicle.

6. The autonomous vehicle notification system of claim 5.

9. The display may be located at an exterior location facing forward of the autonomous vehicle, at an exterior location facing to the side of the autonomous vehicle, and at least one of an external location facing rearward of the autonomous vehicle.

6. The autonomous vehicle notification system of claim 5 configured to provide a visual indication.

10. The controller generates a visual display including information related to a location of the autonomous vehicle according to the state.

6. The autonomous vehicle of claim 5, configured to control the display to provide System of notifications.

11. The controller communicates information related to the location of the autonomous vehicle with respect to the state to the remote master.

11. The method of claim 10, further comprising: updating the control information of the autonomous vehicle according to a progress of the manager in controlling the autonomous vehicle.

2. A system for autonomous vehicle notification as described in claim 1.

12. The controller controls the display to provide a visual display including a path of travel. It is configured as follows: The remote manager attempts to control the autonomous vehicle to move along the travel path.

6. The autonomous vehicle notification system of claim 5,

13. The controller communicates the location of the autonomous vehicle along the travel path to the remote manager.

13. The method of claim 12, further configured to update the control of the autonomous vehicle according to a progress of the control of the autonomous vehicle by the System for autonomous vehicle notifications.

14. the messaging system includes a speaker; The controller controls the speaker to present the message as an audible message.

13. The autonomous vehicle notification system of claim 1 configured to control.

15. The controller controls the message to provide the message as a text message.

10. The system of claim 1 , configured to control a navigation system. 。

16. The controller receives first information from a passenger compartment of the autonomous vehicle and a first information from an external device of the autonomous vehicle. and controlling the messaging system to provide a message including the first and second pieces of information.

2. The autonomous vehicle notification system of claim 1 .

17. The controller instructs the remote manager to control the autonomous vehicle. and controlling said messaging system to provide said messages when requested by said user.

2. The autonomous vehicle notification system of claim 1, configured to:

18. The controller is configured to receive the message when the remote manager begins control of the autonomous vehicle. and controlling the messaging system to update the message.

20. The autonomous vehicle notification system of claim 17.

19. The controller transmits the message to the autonomous system under control of the remote manager. and configured to control the messaging system to discontinue providing the messaging to the vehicle.

2. The autonomous vehicle notification system of claim 1 .

20. 1. A method of autonomous vehicle notification, comprising: Sensing a condition external to the autonomous vehicle; The controller communicates with a remote manager, and the remote manager determines a previous state based on the state. enabling control of the autonomous vehicle; The controller transmits messages related to control by the remote manager to the autonomous vehicle. and controlling a messaging system on board the autonomous vehicle to provide the A method for autonomous vehicle notification, comprising:

Images