Method for evacuating passengers from an autonomous means of transport using an evacuation control system

Abstract

A method is proposed for evacuating passengers from an autonomously driving shuttle for passengers who, in order to use the shuttle, have a mobile terminal with a software application for the shuttle, wherein a map of the interior of the shuttle used is stored in the software application or can be retrieved by the software application, and wherein each software application has a communication interface to a control unit which can communicate at least the current status of the shuttle to the software application, wherein in the event that a situation is detected by the control unit in which the shuttle is to be evacuated, communication is made to the software applications of the passengers' mobile terminals, wherein each mobile terminal then carries out localization and orientation and the software application determines a nearest possible emergency exit based on this and directs the passenger there.

Description

[0001] The present invention relates to the field of passenger transport using an autonomous means of transport, also referred to as an (autonomous) shuttle. In particular, the invention relates to the evacuation of passengers from the shuttle using an evacuation guidance system.

[0002] Currently, public transport always has a driver on hand, who is responsible for transporting passengers safely to their destination. The driver is also responsible for establishing a safe environment in an emergency, finding a safe location for passengers, and organizing external assistance. In a vehicle capable of autonomous driving, such a person no longer exists, and the system itself must fulfill these tasks to ensure the safety of passengers in a situation where an evacuation is necessary.

[0003] Currently, public transportation systems have emergency exit lights and / or signs and / or loudspeakers for announcements to guide passengers to evacuate from the vehicle if necessary. These systems could be automated, but they require improvement, especially in the case of autonomous shuttles, where there is no driver available as backup.

[0004] The invention is therefore based on the object of providing a method for evacuating passengers from an autonomous means of transport.

[0005] This object is achieved by the features of the independent claims. Advantageous embodiments are the subject of the dependent claims.

[0006] A method is proposed for evacuating passengers from an autonomously driving shuttle for passengers who, in order to use the shuttle, have a mobile terminal with a software application for the shuttle, wherein a map of the interior of the shuttle used is stored in the software application or can be retrieved by the software application, and wherein each software application has a communication interface to a control unit which can communicate at least the current status of the shuttle to the software application, wherein in the event that a situation is detected by the control unit in which the shuttle is to be evacuated, communication is made to the software applications of the passengers' mobile terminals, wherein each mobile terminal then carries out localization and orientation and the software application determines a nearest possible emergency exit based on this and directs the passenger there.

[0007] In one embodiment, the control unit transmits an emergency exit to be used to the software application, which then guides the passenger there.

[0008] In one embodiment, the guidance is provided by means of a display on the mobile device and / or an augmented reality displayed in a camera stream and / or an acoustic output of the mobile device and / or a haptic output of the mobile device.

[0009] In one embodiment, localization and orientation are carried out by the passenger pointing their mobile device with a camera at the interior of the shuttle in such a way that optical markings provided on the interior of the shuttle are recognized and compared with reference markings stored in the map of the interior, and the position and orientation of the mobile device are determined from this. Alternatively or additionally, it is provided that the passenger points their mobile device with a camera at the interior of the shuttle in such a way that provided reference points in the interior of the shuttle are recognized and compared with stored reference points, and the position and orientation of the mobile device are determined from this.Alternatively or additionally, it is planned that the localization and orientation will be carried out by using interior cameras of the shuttle to record the position of as many of the passengers as possible in relation to the interior of the shuttle and to transmit this information to the software applications of the passengers' mobile devices.

[0010] In one embodiment, in the event of a situation in which the shuttle is to be evacuated, the software application is automatically activated, or the software application is automatically activated as soon as the passenger is in the shuttle.

[0011] In one embodiment, if a situation arises in which the shuttle is to be evacuated, the software application queries the passenger to determine their status and saves it as status information.

[0012] In one version, the status information is queried via push message or by accessing monitored vital data.

[0013] In one embodiment, in the event of a situation in which the shuttle is to be evacuated, each software application outputs the passenger status information to the control unit, which transmits the passenger status information along with the total number of passengers to an emergency response center.

[0014] Furthermore, a computer program product is provided which carries out the method when implemented on one or more computing units.

[0015] Furthermore, an autonomously driving shuttle is provided, comprising optical markings which are formed and provided on devices of the interior of the shuttle in such a way that localization and orientation can be carried out by means of a camera of a passenger's mobile terminal and a software application located thereon in order to carry out the method, and / or comprising distinctive features which are present in the interior of the shuttle in such a way that localization and orientation can be carried out by means of a camera of a passenger's mobile terminal and a software application located thereon in order to carry out the method.

[0016] Further features and advantages of the invention will become apparent from the following description of exemplary embodiments of the invention, with reference to the figures of the drawing, which illustrate details of the invention, and from the claims. The individual features can be implemented individually or in combination in a variant of the invention.

[0017] Preferred embodiments of the invention are explained in more detail below with reference to the accompanying drawings. Fig. 1 shows localization and orientation using optical markings in the interior of the shuttle according to an embodiment of the present invention. Fig. 2 shows an example of guiding a passenger to an emergency exit using augmented reality executed on his mobile device according to an embodiment of the present invention. Fig. 3 shows an example of a method sequence according to an embodiment of the present invention.

[0018] In the following descriptions of the figures, the same elements or functions are provided with the same reference symbols.

[0019] As already mentioned at the beginning, one aim of the invention is to provide a method for evacuating passengers from a means of transport that can drive autonomously, hereinafter also referred to simply as shuttle 1. This method is useful in situations in which passengers need to be evacuated from shuttle 1, e.g., in an emergency situation such as an accident. Each passenger is guided by their mobile device 2 to a suitable emergency exit (EXIT) of shuttle 1, as described below.

[0020] The basic requirement for implementing the method is that the passenger to be directed to the emergency exit EXIT has a mobile device 2 with a special software application with a communication interface for communicating with an external unit. Since a mobile device 2, preferably with a corresponding software application, is generally required to use the shuttle 1, at least for check-in and check-out, it can be assumed that every passenger has a mobile device 2, so that the proposed function for individually evacuating a passenger can be implemented not only in a separate software application, but also in the software application provided for check-in and check-out. Even if not every passenger has a mobile device 2, the method can be applied to passengers who do.

[0021] The software application intended for evacuation contains a map of the interior of at least the shuttle 1 currently being used by the passenger. The map can be downloaded either upon boarding shuttle 1 or upon booking a ticket, or it can be already stored in the software application along with maps of other shuttles 1, whereby the correct map for the shuttle 1 being used is identified upon boarding shuttle 1 or upon booking a ticket.

[0022] Autonomous shuttles 1 generally have a communication unit with a communication interface for communicating with a control unit 3, wherein the control unit 3 serves as the control center for the shuttle 1. Due to the required computing power, the control unit 3 is usually an external control unit 3 that coordinates several shuttles 1, so that not every shuttle 1 needs to have its own control unit. In the event of a situation in which the shuttle 1 is to be evacuated, e.g. in the event of an accident or breakdown, the situation is detected by the control unit 3, which is in communication connection with corresponding sensors of the shuttle 1, for example, and evaluated (step S1 of the method). For example, the severity of an accident can be determined and, based on this, a decision can be made as to whether the passengers from the shuttle 1 need to be evacuated.As soon as a situation is identified in which an evacuation of the passengers from the shuttle 1 must take place, the control unit 3 communicates to the software applications of the mobile terminals 2 of each passenger via the corresponding communication interface that the passenger must be evacuated (step S2 of the method). The software application then localizes and orients the mobile terminal 2 (step S3 of the method) in order to determine where the mobile terminal 2 (and thus the passenger if they are holding the terminal 2 in their hand) is located in the interior of the shuttle 1 and what its orientation is. Based on the localization and orientation, a suitable emergency exit EXIT is selected for the passenger and the passenger is directed there (step S4 of the method). The schematic sequence of the method is shown in . Fig. 3 shown.

[0023] The appropriate emergency exit EXIT can be determined in real time for each shuttle 1 by the software application based on the interior map with the emergency exits stored there. Alternatively, depending on the determined location of the mobile device 2, a predefined emergency exit EXIT can be stored through localization and orientation, to which the passenger must be guided. Alternatively, the control unit 3 can specify an emergency exit EXIT based on the detection of the current situation, e.g., an accident.

[0024] Rapid orientation and localization within a shuttle 1 is essential, particularly in emergency situations, in order to find the nearest possible exit. From daily experience with navigation software on current mobile devices 2, it is known that correct localization and orientation on a map can take some time. Nevertheless, the result can still be incorrect, e.g. due to an uncalibrated compass within the mobile device 2, or due to too few satellites being detected, etc. In order to overcome this problem, in one embodiment the shuttle 1 is provided with specially coded optical markings 4, which are arranged on devices in the interior of the shuttle 1. Devices such as benches, grab handles and poles as well as walls, the ceiling, the floor, stairs and windows of the shuttle 1 are understood to include, for example, benches, grab handles and poles as well as walls, the ceiling, the floor, stairs and windows of the shuttle 1.By capturing the optical markings 4 with a camera of the mobile device 2, the position and orientation of the mobile device 2 in the shuttle 1 can be evaluated using the software application. For this purpose, the passenger holds their mobile device 2 with a camera thereof directed into the interior of the shuttle 1 in such a way that optical markings 4 provided on devices in the interior of the shuttle 1 are recognized and compared with reference markings stored in the map of the interior, and from this, the position and orientation of the mobile device 2 are determined, as shown in FIG. Fig. 1. For this reason, the markings 4 are formed differently depending on the position in the shuttle 1. The type of optical marking 4 must be selected by a specialist depending on the application. The optical markings 4 can form a specific pattern depending on the viewing angle, so that clear location is possible. The optical markings 4 are, for example, markings applied to the device, e.g. stickers in the form of dots / circles. Shapes and / or colored and / or reflective markings and / or codes, e.g. QR codes, can also be used as optical markings 4.

[0025] The localization and orientation of the mobile terminal 2 can also be carried out with a very small number of detected optical markers 4, so that the method can also be applied in the case of smoke development or visual obstacles.

[0026] Alternatively, a so-called reference point comparison (feature matching) can also be performed. In this (known) method, a match of distinctive features between two images of the same scene is determined. It is important that several distinctive features are present so that the comparison can be carried out. The specific size and angle of the features are mainly used as a reference, and a distance is calculated. The more closely the images match, the more accurate the positioning. In the described application, for example, handrails, seats, steps, etc. in the interior of the shuttle 1 can be used to apply this method. The more closely the images match, the more accurate the positioning of the passenger. If there are not enough distinguishable features, the optical markings 4 described above can also be used in addition.

[0027] In both cases, interior cameras of Shuttle 1 can also be used to support localization.

[0028] Alternatively, interior cameras of the shuttle 1 may be used alone, even if no procedure as described above is performed, to locate the passengers inside the shuttle 1.

[0029] When using interior cameras, it can be provided that the software application and one or more nearby interior cameras communicate with each other, e.g., via near-field communication. This alone can determine the approximate position of the passenger (their mobile device 2) in the shuttle 1, allowing a suitable emergency exit (EXIT) to be determined.

[0030] In one embodiment, the software application can send the passenger a status query at the same time as or before localization and orientation. This status query can be a simple query as to whether the passenger is still responsive, e.g., through a push notification that the passenger must confirm. Furthermore, their condition can be queried, i.e., whether they are injured and what injuries they believe they have. Since more and more people are monitoring their vital functions, such as their heart rate, with a software application on a mobile device 2, which can be either the mobile device used to purchase the ticket for the shuttle 1 or a connected wearable, this information can also be used by an emergency services center via a corresponding interface (with appropriate authorization) to obtain the current (health) status of the respective passenger.With appropriate authorization, this status information about the passenger's condition can be transmitted to a central emergency services center so that they can better coordinate an emergency response. In one version, a query can also be made as to whether the passenger is able and willing to help other passengers. Based on status information from other passengers, the passenger can then be directed to a passenger for assistance. The emergency services center can provide appropriate instructions on how to assist the passenger, or the assisting passenger can help the emergency services center interact with the passenger in need of assistance.

[0031] Furthermore, in addition to status information on the passenger's condition, the number of passengers in shuttle 1 can be transmitted to an emergency response center. The number is known to control unit 3 based at least on the tickets purchased and, if applicable, automatically registered upon boarding. Additionally, the number can be verified by determining the number of software applications communicating with control unit 3. Existing interior cameras of shuttle 1 can also be used for (automatic) counting.

[0032] If the passenger to be evacuated is responsive, the software application guides them to a suitable emergency exit EXIT. Different methods are possible, whereby the passenger always uses their mobile device 2 as a guidance system. One method is that arrows 5 are used as a guidance system on the display of the mobile device 2. In this case, only directional arrows 5 or points with or without a two-dimensional / three-dimensional map of the interior of the shuttle 1 can be displayed. However, guidance can also be provided in the form of so-called augmented reality, in which a recording stream (real time) from a camera of the mobile device 2 is used, into which a display, e.g. in the form of directional arrows 5 (as in Fig.2), or a chain of dots or another suitable display is displayed to guide the passenger. Alternatively or additionally, haptic and / or acoustic guidance of the passenger can be provided by means of sounds or speech via corresponding output means of the mobile terminal 2. In one embodiment, the passenger can set on their mobile terminal 2 which guidance method they wish to use in an evacuation situation.

[0033] In one embodiment, the software application is activated automatically, e.g., via a push message from the control unit 3, when it receives an evacuation signal, e.g., when an emergency situation such as an accident has been detected. Alternatively, the software application can be automatically activated as soon as the passenger is in the shuttle 1. This can be detected, for example, when the passenger checks in to a shuttle 1 via the software application.

[0034] The proposed method improves the evacuation of passengers from an autonomous shuttle 1 , as each passenger is individually guided to a suitable emergency exit by a suitable evacuation guidance system. List of reference symbols 1 shuttle 2 mobile devices 3 Control unit 4 optical markings 5 Arrow EXIT Emergency Exit

Claims

[1] Method for evacuating passengers from an autonomously driving shuttle (1) for passengers who, for the use of the shuttle (1), have a mobile terminal (2) with a software application for the shuttle (1), wherein a map of the interior of the shuttle (1) used is stored in the software application or can be retrieved by the software application, and wherein each software application has a communication interface to a control unit (3) which can communicate at least the current status of the shuttle (1) to the software application, wherein, in the event that a situation is detected by the control unit (3) (S1) in which the shuttle (1) is to be evacuated, communication is made to the software applications of the passengers' mobile terminals (2) (S2), each mobile terminal (2) then carrying out a localization and orientation (S3) and the software application, based thereon, determines a nearest possible emergency exit (EXIT) and guides the passenger there (S4). [2] Method according to claim 1, wherein the control unit (3) transmits an emergency exit (EXIT) to be used to the software application and the software application directs the passenger there. [3] Method according to claim 1 or 2, wherein the guidance is carried out by means of a display on a display of the mobile terminal (2) and / or an augmented reality displayed in a camera stream and / or an acoustic output of the mobile terminal (2) and / or a haptic output of the mobile terminal (2). [4] Method according to one of the preceding claims, wherein the localization and orientation is carried out by - the passenger holds his mobile device (2) with a camera thereof directed into the interior of the shuttle (1) in such a way that optical markings (4) provided on devices in the interior of the shuttle (1) are recognized and compared with reference markings stored in the map of the interior and the position and orientation of the mobile device (2) are determined therefrom, and / or - the passenger holds his mobile device (2) with a camera thereof directed into the interior of the shuttle (1) in such a way that intended reference points in the interior of the shuttle (1) are recognized and compared with stored reference points and the position and orientation of the mobile device (2) are determined therefrom, and / or - the localization and orientation is carried out by interior cameras of the shuttle (1) recording the position of as many of the passengers as possible in relation to the interior of the shuttle (1) and transmitting this information to the software applications of the passengers' mobile devices (2). [5] Method according to one of the preceding claims, wherein in the event that a situation exists in which the shuttle (1) is to be evacuated, the software application is automatically activated, or wherein the software application is automatically activated as soon as the passenger is in the shuttle (1). [6] Method according to one of the preceding claims, wherein in the event that a situation exists in which the shuttle (1) is to be evacuated, the software application queries the passenger in order to determine his status and to store it as status information. [7] Method according to claim 6, wherein the query of the status information is carried out by means of push message or by access to monitored vital data [8] Method according to one of the preceding claims, wherein in the event that a situation exists in which the shuttle (1) is to be evacuated, each software application outputs the information on the status of the passenger to the control unit (3), which transmits the status information on the passengers together with the total number of passengers to an emergency service center. [9] Computer program product which carries out the method according to one of the preceding claims when it is implemented on one or more computing units. [10] Autonomously driving shuttle (1), comprising optical markings (4) which are formed and provided on devices of the interior of the shuttle (1) in such a way that localization and orientation can be carried out by means of a camera of a passenger's mobile terminal (2) and a software application located thereon in order to carry out the method according to one of claims 1 to 8, and / or comprising distinctive features which are present in the interior of the shuttle (1) in such a way that localization and orientation can be carried out by means of a camera of a passenger's mobile terminal (2) and a software application located thereon in order to carry out the method according to one of claims 1 to 8.

Images