Control of traffic objects

Abstract

Method for controlling at least one traffic object (2) of a traffic infrastructure, characterized by: Capturing a gesture performed by a person (30, 31) in a vehicle (1); Sending a signal based on the detected gesture to a control unit (3, 5); and Control of the traffic object (2) by or via the control unit (3, 5), wherein the control unit (3, 5) takes into account the signal and thus the gesture when controlling the at least one traffic object (2).

Description

[0001] The invention relates to a method for controlling at least one traffic object of the traffic infrastructure, a computer program product for carrying out such a method, a system for controlling at least one traffic object of the traffic infrastructure, and a vehicle for use in such a system.

[0002] For the purposes of the invention, a "traffic object of the traffic infrastructure" refers to objects that can directly or indirectly influence traffic flow or passage in road traffic and that form part of the traffic infrastructure. Therefore, for the purposes of the invention, vehicles are not considered traffic objects of the traffic infrastructure.

[0003] For the purposes of the invention, a "controllable traffic object of the traffic infrastructure" refers in particular to those traffic objects of the traffic infrastructure that can directly or indirectly influence traffic flow or passage in road traffic and that can be modified externally. The present invention relates to the control of such controllable traffic objects of the traffic infrastructure. These include, among others: traffic lights, digital traffic signs, barriers (e.g., retractable bollards), gates, tunnels, or bridges.

[0004] For the sake of simplicity, the terms "controllable traffic object" or "traffic object" are used below instead of the term "controllable traffic object of the transport infrastructure." Unless expressly stated otherwise below, these terms are intended to be synonymous.

[0005] Many controllable traffic objects (e.g. traffic lights) are controlled automatically, e.g.: - cyclical (e.g. traffic lights with a fixed sequence of traffic light phases) - event-based (e.g. traffic lights that take into account whether a vehicle is approaching from a certain direction) - depending on the time of day (e.g. bollards lowered at night, extended during the day)

[0006] Systems for controlling traffic objects are already known in which the automatic control outlined above can be changed under certain conditions, for example to facilitate the passage of a certain type of vehicle.

[0007] DE 10 2018 123 153 A1 discloses a method for influencing a plurality of alternating traffic light systems in a traffic network with autonomous alternating traffic light systems controlled by local control units. This involves identifying autonomous alternating traffic light systems located along the predicted route, and creating an alternating traffic light system encounter plan for the emergency vehicle along the predicted route.

[0008] US 10 355 875 B1 discloses a system for utilizing motion-based control data. The system may include a control device configured to generate a control signal corresponding to at least one movement associated with the control device. The system may also include a target device. The target device may be configured to receive the control signal corresponding to the movements associated with the control device.

[0009] WO2019 / 193615 A2 discloses a traffic light control system for use with emergency vehicles, such as ambulances. In this system, a navigation system determines a route to an emergency vehicle's location, with the location being entered as a destination into the emergency vehicle's navigation system. Traffic lights along this route are then controlled by a control center so that the emergency vehicle can reach the location as quickly as possible.

[0010] It is an object of the invention to provide an alternative, in particular improved, control of traffic objects.

[0011] This object is achieved according to the invention by a method for controlling at least one traffic object of a traffic infrastructure, a computer program product for implementing such a method, a system for controlling at least one traffic object of a traffic infrastructure, and a vehicle for use in such a system having the features according to the respective independent patent claims. Advantageous embodiments of the invention are the subject of the dependent patent claims, the description, and the figures.

[0012] A first aspect of the invention relates to a method for controlling at least one traffic object of a traffic infrastructure. The method comprises the following steps: Detecting a gesture performed by a person in a vehicle; sending a signal based on the detected gesture to a control unit; and controlling the traffic object by or via the control unit, wherein the control unit takes the gesture into account when controlling the at least one traffic object.

[0013] Although embodiments of the invention are particularly applicable in connection with emergency vehicles (ambulances, fire departments, police, rescue services, etc.), the invention can also be used in relation to other (emergency) vehicles, such as public (local) transport vehicles (e.g. buses, trams), taxis, street cleaning vehicles, vehicles for maintaining green spaces, towing services, breakdown services, logistics vehicles, military vehicles, winter service vehicles (snow plows), and vehicles for road construction work, to name just a few. In principle, embodiments of the invention could also be applied to other vehicles, provided that they have the appropriate authorization or authority (to be explained later) with regard to the control of a traffic object. For this reason, the more general term "vehicle" is mostly used here.

[0014] Methods and devices for automatically capturing or recognizing a gesture are known in principle and will therefore not be explained in detail. At this point, it should simply be mentioned that various sensors, in particular combinations of sensors, can be used to detect a gesture, in particular motion sensors and / or one or more cameras. These may be cameras that can detect visible light and / or electromagnetic radiation in other wavelength ranges (e.g., infrared). Cameras that can generate a two-dimensional image as well as cameras that can generate a three-dimensional representation, such as so-called time-of-flight (TOF) cameras, are also possible.

[0015] The data generated by detecting a gesture can be stored and / or processed, particularly by the system or vehicle to be explained in more detail below, in order to "recognize" the gesture. For this purpose, the data can be compared with previously known data so that the detected data can be assigned to a specific (type of) gesture. The result of the assignment can then be used, particularly by the system or vehicle, to control the at least one traffic object or to request control of the at least one traffic object depending on the result.

[0016] Embodiments of the invention are not limited to a specific gesture. In principle, any gesture could be used within the scope of the present invention, as long as it can be recognized and assigned. Thus, a "gesture" within the meaning of the invention is understood to mean, in particular, a movement of a body part, a sequence of movements of a body part, or even the holding of a body part in a specific position, or combinations thereof. A gesture performed with one hand and / or one arm (or with both hands / arms) is particularly easy to perform (especially for a person in a vehicle).

[0017] A gesture to be detected within the scope of the invention may, for example, comprise pointing at a traffic object, in particular with one hand, in particular with an outstretched hand or a single finger, for example the index finger (or correspondingly with both hands or both (index) fingers.

[0018] In the following, some advantages of the present invention will be explained using an emergency vehicle as an example, because the advantages of the present invention are particularly readily apparent here. However, it should be emphasized again that the invention is not limited in this respect and that corresponding or similar advantages also arise, at least in part, in connection with other vehicles.

[0019] Let's assume the vehicle is an ambulance en route to an emergency scene or a hospital. The ambulance must reach its destination as quickly as possible. The ambulance is now approaching an intersection where traffic flow is controlled by traffic lights. While the aforementioned prior art system would switch the traffic light for the road leading to the intersection where the ambulance is located to green and all other traffic lights to red, the present invention enables the ambulance driver or passenger (hereinafter referred to simply as "driver" or "person") to make a decision adapted to the traffic situation.For example, it is possible that the driver, while still some distance from the intersection, realizes that there is a relatively high volume of traffic at the intersection and possibly also on the ambulance's planned route after the intersection, but that the driver also realizes that they can overtake the vehicles in front of the ambulance (between the ambulance and the intersection), for example by using the oncoming lane. In this situation, it is possible that the driver realizes that the ambulance can pass the intersection more quickly and, in particular, can make faster progress on the rest of its route after passing the intersection if all traffic lights at the intersection are switched to red. This reduces the volume of traffic further along the ambulance's route (i.e. after the intersection) because vehicles in front of the ambulance that have not yet entered the intersection are held up by the red light.

[0020] To allow the ambulance driver to influence the traffic lights according to their decision, adapted to the traffic situation, the driver can, for example, point at the traffic light, i.e., perform a gesture. In a manner to be described below, the system, the vehicle, or a detection device of the system or vehicle detects that the driver has pointed at the traffic light. In a manner to be described below, the driver (additionally) tells the system or vehicle how the traffic light should be controlled, for example, either by turning all traffic lights at the intersection red, or by turning the light relevant to the ambulance green and all other traffic lights red.

[0021] Compared to a system in which the driver identifies the traffic light purely verbally, for example by speaking the words "intersection Hafenstraße / Nordseestraße" into a microphone located in the vehicle, embodiments of the present invention can have the further advantage that the gesture can be recognized, in particular reliably, regardless of (or even in the presence of) disturbing noises (engine noise, street noise, construction site noise or noises caused by other people in the ambulance).

[0022] In another example, the vehicle is a police vehicle in a chase, i.e., the police vehicle is following the vehicle of a suspected criminal at increased speed. Because the destination of the chase is generally initially unknown to the driver of the police vehicle, the system cannot calculate a route and control traffic objects along this calculated route, as provided for in the aforementioned WO2019 / 193615.

[0023] For example, if the driver of the police vehicle notices that the criminal's vehicle is driving towards a movable bridge (e.g. a drawbridge, bascule bridge, lift bridge or swing bridge), the driver of the police vehicle can use a gesture to control the movable bridge in such a way that driving over the bridge becomes physically impossible, thus preventing the criminal from continuing his journey.

[0024] However, if the police vehicle is on a different mission where it must cross the bridge as quickly as possible to reach an emergency location, the driver of the police vehicle can, if necessary, control the movable bridge by means of a gesture so that it becomes or remains passable. Embodiments of the present invention can thus enable flexible control of a traffic object in a manner that depends on the respective situation.

[0025] In one embodiment, the method further comprises checking whether the person and / or the vehicle has authorization that causes the control unit to consider the gesture when controlling the at least one traffic object. This can ensure that only appropriately authorized persons / vehicles or gestures made by appropriately authorized persons or by persons in an appropriately authorized vehicle are considered when controlling the traffic object.

[0026] Verification can be performed in various ways. For example, a digital certificate, password, or similar (hereinafter collectively referred to as "authorization") can be stored in the vehicle, which the vehicle transmits to the traffic object or to other entities in the system as part of the (intended) control of the traffic object. The authorizations of the authorized vehicles or persons, or appropriate information regarding these authorizations, are also stored in a memory of the traffic object, in particular in a control unit of the traffic object or in an external memory accessible to the traffic object or its control unit. If a vehicle transmits an authorization to the traffic object, the traffic object can determine whether the vehicle or person is authorized or not by comparing the received authorization with the stored authorizations.If appropriate authorization is present, the gesture is taken into account when controlling the traffic object. If no authorization is present, the gesture is ignored.

[0027] The transmission of an authorization to the road vehicle can be carried out wirelessly in a conventional manner, for example via the mobile phone network. The transmission of an authorization can be triggered by the execution of a gesture or by the recognition of the gesture and transmitted together with information that identifies the executed gesture or the control request expressed by the gesture. The authorization can also be transmitted only after this information has been transmitted. However, it is also possible for the authorization to be transmitted in advance, i.e. before a gesture is executed or recognized, for example to all road vehicles within a specified radius of the vehicle, so that these road vehicles can check in advance whether the corresponding authorization exists.

[0028] A vehicle's authority can also be temporary, location-based, or dependent on the vehicle's condition. For example, the authority for certain types of vehicles could be limited to certain times of day, days of the week, or seasons. A location-based restriction could, for example, mean that a taxi based in a particular city has the authority to control traffic objects in that city, but not in other cities. A condition-dependent restriction could, for example, mean that an emergency vehicle only has the authority to control traffic objects when it is actually in use.

[0029] In one embodiment of the method, (at least) one central authorization device checks whether the person and / or the vehicle has this authorization, and / or the central authorization device provides or transmits an authorization that causes the control unit to take the gesture into account when controlling the at least one traffic object.

[0030] Where appropriate, the task of (at least one) central authorization device may be not only to verify the vehicle's authority to control the road vehicle, but also to manage this authority and, if necessary, to communicate accordingly with the vehicle and / or the control unit or road vehicle, in particular to issue authorization, particularly in the form of a corresponding certificate. The actual control of the road vehicle, however, is carried out by the control unit.

[0031] In one embodiment of the method, information regarding the traffic object is sent to the person and / or the vehicle and / or information regarding the traffic object is made available to the person and / or the vehicle, wherein the information in particular: a) have an identification of the traffic object and / or b) indicate a, in particular current, condition of the traffic object and / or c) indicate whether and / or how the condition of the transport object can be changed or maintained.

[0032] This information can, for example, be transmitted from the road object to the vehicle and output via the vehicle's output devices. It can be displayed on a vehicle display, such as a central information display (CID) or a head-up display, or output via a vehicle loudspeaker.

[0033] For example, in the example above, identifying the traffic object might display / output "Intersection of Hafenstraße / Nordseestraße" or "Traffic light at the intersection of Hafenstraße / Nordseestraße." This allows the person to recognize that the correct traffic object has been identified.

[0034] An indication of the, in particular current, status of the traffic object can, for example, include information such as “traffic light red”, “bridge impassable”, “barrier down” or the like.

[0035] An indication of whether and / or how the state of the traffic object can be changed or maintained can, for example, include information such as “traffic light can be switched to green”, “bridge can be made passable”, “barrier can be opened”, “traffic light can remain green”, “bridge can be kept in the passable state”, “barrier can remain open” or the like.

[0036] Other factors can also be taken into account (or the system can also take other factors into account). For example, it can be taken into account whether other vehicles or people in other vehicles want to influence the control of the road object (regardless of whether control is requested via a gesture or in some other way). If a conflict is identified in this regard, in particular by the system, this can be resolved, if necessary, in particular by the system. For example, different vehicles or types of vehicle can have different priority levels (e.g. ambulances: high priority; street cleaners: low priority). If the priority is the same, priority can be given to the vehicle that is closer to the road object or that is expected to reach or pass the road object first.

[0037] Furthermore, the system can consider whether there are other reasons why the control request expressed by the gesture should not be complied with. In particular, the system can consider whether executing the desired control action could endanger life or property. For example, if the desired control action involves opening a railway barrier to allow an ambulance to pass through, this request can be denied if a train is approaching the barrier and cannot brake in time.Similarly, a request to make a drawbridge passable for the passage of a road vehicle may be refused if there is a vessel at the location of that drawbridge for whose passage the drawbridge was opened (or if the vessel is approaching the drawbridge and cannot slow down in time).

[0038] In one embodiment, the method further comprises requesting and / or receiving a response from the person after the information has been sent or made available. For this purpose, one or more options may be available to the person in the vehicle (or the vehicle may provide one or more options) for expressing such a response. For example, the vehicle may have one or more switches, buttons, knobs, or the like, either on a touchscreen or otherwise installed in the vehicle, via which the person can enter the response. The vehicle may also have a microphone with appropriate speech recognition, so that the person can express the response acoustically, in particular in spoken form, for example by confirmation ("Yes") or rejection ("No") or by an instruction ("Open barrier") or the like.The reaction can also be expressed by another gesture that the vehicle can recognize in a similar way to that described above. For example, a hand or arm movement in a vertical direction could be assigned a first meaning, and a hand or arm movement in a horizontal direction could be assigned a second meaning. The vertical movement could, for example, mean that the traffic object should make it as easy as possible for the vehicle to continue its journey (e.g., traffic light turns green, bridge can be crossed, barrier opens). The horizontal movement, on the other hand, could mean that the traffic object should make it as difficult as possible for the vehicle (and thus also for other vehicles) to continue its journey (e.g., traffic light turns red, bridge cannot be crossed, barrier closed).

[0039] For the purpose of requesting or receiving the response, the information sent or provided, for example, via a loudspeaker or display device, may include a relevant question, such as "Barrier - Hafenstrasse - Open?" instead of simply "Barrier - Hafenstrasse" or "Barrier - Hafenstrasse - currently closed." This may simplify and / or expedite the interaction between the person and the system.

[0040] A response from the person can also be requested and / or entered via another device, for example via a mobile device such as a smartphone, tablet or similar that is in communication with the vehicle or the system, e.g. via the mobile network or other means of wireless communication such as Bluetooth®.

[0041] In one embodiment, it is provided that the control unit controls the at least one traffic object based on the gesture and / or the reaction, in particular to change or maintain its state, in particular for a predetermined period of time or a period determined by an event. Depending on the implementation, the traffic object can therefore be controlled based on the (first) gesture or only based on the reaction. For example, if the vehicle is an ambulance and the traffic object is a movable bridge, it could be provided that the bridge is controlled based on the (first) gesture in such a way that the bridge becomes passable.If, on the other hand, the vehicle is a police vehicle and the traffic object is a movable bridge, it could be provided that the bridge is only controlled based on the reaction, because depending on the type of operation of the police vehicle (see above examples of an operation on the other side of the bridge and a chase), it could be in the interest of the police car or its driver to control the bridge in such a way that it is / remains passable or that it is / remains impassable.

[0042] According to this embodiment, maintaining a (possibly changed) state of the traffic object for a predetermined period of time can be achieved, for example, by calculating how long it is expected to take until the vehicle has reached or passed the traffic object. Within the scope of this calculation, position data and / or speed data of the vehicle and the traffic object can be used in a conventional manner. Additionally or alternatively, maintaining the state of the traffic object can be achieved in a manner determined by an event, for example by checking whether the vehicle has already reached or passed the traffic object. Position data of the vehicle and the traffic object can also be used for this purpose. Suitable sensors that are installed in the vehicle or are part of the road infrastructure can also be used.

[0043] In one embodiment, the control unit has a central control device for controlling the at least one traffic object. In this embodiment, the system therefore comprises not only the traffic object and, if applicable, the vehicle or certain components of the vehicle, but also (at least) one central control device. The central control device can be designed to control the traffic object and, if applicable, other traffic objects.

[0044] Communication between the vehicle, the traffic object, and the central control device can take place in various ways. In a first embodiment, which is referred to herein as "central communication," the vehicle, in order to control the traffic object, does not communicate directly with the traffic object (or with a control unit provided in or on the traffic object, which is provided, in particular, only for controlling this one traffic object or a small number of connected (i.e., interdependent) traffic objects, such as all traffic lights at a specific intersection), but rather with (at least) one central control device that controls multiple traffic objects, in particular multiple traffic objects that are not connected or interdependent with one another.The central control unit can process the request to control the traffic object and, if necessary (particularly if the vehicle has the appropriate authorization), control the traffic object accordingly. Further information exchange can also take place between the central control unit and the vehicle.

[0045] In a second embodiment, referred to herein as "decentralized communication," the vehicle communicates directly with the road object (or with a control unit provided in or on the road object) to control it. The vehicle also communicates with the central control device, for example, to verify whether the vehicle or person is authorized to control the road object. Following successful verification, the central control device can either send corresponding information directly to the road object to prompt the road object to comply with the vehicle's control request, or the central control device can send corresponding information to the vehicle (for example, in the form of a certificate).This information or certificate or information derived therefrom can then be forwarded by the vehicle to the traffic object, and on the basis of the forwarded information or certificate, the traffic object is prompted to comply with the vehicle's control request.

[0046] A third embodiment, referred to herein as “indirect communication,” is very similar to decentralized communication. However, there is no direct communication between the vehicle and the central control device. Instead, the vehicle transmits not only the control request to the traffic object, but also additional data, in particular an identification of the vehicle. The traffic object then forwards this additional data to the central control device (or to a connected central authorization device as described above) so that the central control device (or the central authorization device) can use this additional data to check whether the vehicle is authorized to control the traffic object.The central authorization facility then transmits the result of this check to the traffic object so that it can comply with the control request.

[0047] If necessary, mixed forms of these three versions are also possible.

[0048] A second aspect of the invention relates to a computer program product having a program code stored on a computer-readable medium for carrying out a method described above.

[0049] A third aspect of the invention relates to a system for controlling at least one traffic object of a traffic infrastructure, in particular for carrying out a method described above. The system comprises detection means for detecting the gesture performed by the person in the vehicle, wherein the system comprises the control unit and is configured to send a signal based on the detected gesture to the control unit; and wherein the control unit is configured to control the traffic object taking into account the signal and thus the detected gesture.

[0050] Most of the system's features have already been described previously in connection with the method according to the invention. In the interest of a concise presentation, a detailed description of some of these features will be omitted.

[0051] The system according to the invention comprises at least the control unit and the detection means. The control unit can be provided in or on the traffic object and, in particular, can be provided only for controlling this one traffic object or a small number of connected (i.e., interdependent) traffic objects, such as all traffic lights at a specific intersection, or can be a (or part of) central control device that controls multiple traffic objects, in particular multiple traffic objects that are not connected or interdependent with each other. However, it is not absolutely necessary for the entire vehicle to form part of the system according to the invention. Thus, in some embodiments (with regard to the vehicle), essentially only the detection means and a transmission unit for transmitting the signal can be considered part of the system according to the invention, but not other components of the vehicle. Similarly, for example,The traffic object does not necessarily form part of the system according to the invention. For example, the system can exchange information with a traffic object that is not part of the system. Such information can, in particular, include control signals for controlling the traffic object.

[0052] In one embodiment, the system consists (essentially) only of a detection means, a transmitting unit for transmitting the signal and a control unit or a (central) control device.

[0053] In one embodiment, the system comprises the or a central authorization device, wherein the central authorization device is configured to check whether the person and / or the vehicle has the or an authorization that causes the control unit to take the gesture into account when controlling the at least one traffic object, and / or wherein the central authorization device is configured to provide the or an authorization or to transmit it, in particular directly or indirectly, in particular to the control unit, which causes the control unit to take the gesture into account when controlling the at least one traffic object.

[0054] A fourth aspect of the invention relates to a vehicle for use in one of the systems described above. The vehicle comprises the detection means, in particular at least one sensor and / or at least one camera, for detecting the gesture performed by the person in the vehicle. The vehicle is configured to send a signal based on the performed gesture to the control unit and / or to a central authorization device.

[0055] The individual features of the vehicle have already been described above in connection with the system and method according to the invention. In the interest of a concise presentation, a detailed description of some of these features will be omitted.

[0056] In one embodiment, the vehicle is configured to provide information to the person, the information being: a) have an identification of the traffic object and / or b) indicate a, in particular current, condition of the traffic object and / or c) indicate whether and / or how the condition of the transport object can be changed or maintained.

[0057] In this version, the output devices described above, such as a display and a loudspeaker, are again considered.

[0058] In one embodiment, the vehicle is configured to receive information from the control unit and / or from the central authorization device and / or from the traffic object. For this purpose, the vehicle may have appropriate interfaces, in particular wireless interfaces, for example, interfaces for communication via the mobile network.

[0059] In one embodiment, the vehicle is configured to request and / or receive a response from the person to the provided information. Suitable devices for this purpose, such as switches, buttons, knobs, touchscreen, and / or microphone, have already been explained above.

[0060] In one version the vehicle is equipped: a) to control the at least one traffic object on the basis of the gesture and / or the reaction, in particular to change or maintain its state, in particular for a predetermined period of time or a period determined by an event, and / or b) to initiate control of the at least one traffic object on the basis of the gesture and / or the reaction, in particular to initiate a change or maintenance of its state, in particular for a predetermined period of time or a period determined by an event.

[0061] In case a), the vehicle itself controls the traffic object (essentially directly, possibly via the control unit, which may be provided in or on the traffic object), possibly after appropriate authorization. This can essentially correspond to the "decentralized communication" and "indirect communication" embodiments explained above.

[0062] In case b), the vehicle itself does not (directly) control the road object. Instead, the road object is controlled by another device, for example, the central control device explained above. This can essentially correspond to the "central communication" embodiment explained above.

[0063] A means within the meaning of the present invention can be designed in hardware and / or software, in particular a processing unit, in particular a microprocessor unit (CPU), graphics card (GPU) or the like, which is preferably connected to a memory and / or bus system in terms of data or signals, and / or can have one or more programs or program modules. The processing unit can be designed to execute instructions implemented as a program stored in a memory system, to detect input signals from a data bus, and / or to output signals to a data bus. A memory system can have one or more, in particular different, storage media, in particular optical, magnetic, solid-state, and / or other non-volatile media. The program can be designed in such a way that it embodies the methods described here orcapable of executing, so that the processing unit can execute the steps of such methods. In one embodiment, a computer program product can comprise, in particular be, a storage medium, in particular a non-volatile one, for storing a program or having a program stored thereon, wherein executing this program causes a system or a controller, in particular a computer, to execute a method described here or one or more of its steps.

[0064] The embodiments presented with reference to the method according to the invention and their advantages apply accordingly to the vehicle according to the invention, to the system according to the invention and to the computer program product according to the invention and vice versa.

[0065] Further features of the invention emerge from the claims, the figures, and the description of the figures. All features and combinations of features mentioned above in the description, as well as the features and combinations of features mentioned below in the description of the figures and / or shown alone in the figures, can be used not only in the respective specified combination, but also in other combinations or even on their own.

[0066] The invention will now be explained in more detail using one or more preferred embodiments and with reference to the accompanying drawings.

[0067] They show: Fig. 1 is a schematic representation of a system according to at least one embodiment of the present invention; Fig. 2 is a schematic representation of a view from the interior of a vehicle according to an embodiment of the present invention; and Fig.3 a flowchart of a method according to an embodiment of the present invention.

[0068] One in Fig. The system 10 shown in Figure 1 comprises a vehicle 1, a traffic object 2, a central control device 3, and a central authorization device 4. In the present example, vehicle 1 is shown as a representative of other vehicles besides ambulance 1, and traffic object 2 is shown as a representative of other traffic objects besides traffic light 2.

[0069] In addition, Fig.1 Arrows 11 to 22, which are intended to represent the (bidirectional) communication between vehicle 1, traffic object 2, central control device 3, and central authorization device 4. Other entities that may be involved in the communication and may be part of the system according to the invention, such as the infrastructure of a mobile network, are not shown. Arrows 21 and 22, which are intended to indicate the communication between traffic object 2 and authorization device 4, are shown interrupted only due to the overlap with arrows 13 and 14. This interruption has no further significance.

[0070] According to Fig.1, each of the entities (vehicle 1, traffic object 2, central control device 3 and central authorization device 4) can communicate with any other entity, as shown by arrows 11 to 22. However, in various embodiments of the invention, not every entity needs to (be able to) communicate with every other entity. A system according to the invention also does not need to implement all of the Fig. 1, but can, for example, only be controlled by the central control device 3 and a detection means for detecting a gesture (e.g. camera 50 or a suitable sensor, see Fig. 2) and a transmitting unit.

[0071] Traffic object 2 can have a control unit 5 or be connected to such a control unit 5. The control unit 5 can, for example, have a communication interface for receiving control signals. Such a communication interface can, in particular, have a wireless communication interface for receiving wirelessly transmitted signals from the vehicle (e.g., via the mobile network). The communication interface of the control unit 5 can, additionally or alternatively, also be used for communication with other Fig. 1 shown entities (central control device 3 and / or central authorization device 4) and be designed for wireless and / or wired communication.

[0072] In embodiments in which the traffic object 2 has a control unit 5, the control unit 5 can control the traffic object 2 (optionally in cooperation with the central control device 3 and / or the central authorization device 4).

[0073] However, embodiments are also possible in which the traffic object 2 does not have its own control unit 5. In such embodiments, the traffic object 2 can, for example, be connected to the central control device 3 (in particular by wire), so that the central control device 3 can control the traffic object 2.

[0074] In the further course of the description, “control of the traffic object 2” or “communication with the traffic object 2” or similar expressions are to be understood as meaning that this control or communication can take place via a control unit 5 of the traffic object 2, but that this does not necessarily have to be the case.

[0075] Various embodiments of the Fig. The entities presented in Figure 1 and their interactions are explained in more detail below. However, first, reference is also made to Fig. 2 is referred to.

[0076] Fig. Figure 2 shows a schematic representation of a view from the interior of a vehicle 1 according to an embodiment of the present invention. Two people are present in the vehicle, namely a driver 30 and a passenger 31. An arm and an outstretched hand 32 of the passenger 31 are also shown.

[0077] Fig.2 further shows the view through the windshield 40, through which a traffic object 2 (a traffic light 2) can be seen. Vehicle 1 is further equipped with a sensor 50 (in the present example, a camera 50), a display (CID) 51, which can be designed as a touchscreen, a loudspeaker 53, and a microphone 54. A head-up display 52 on the windshield 40 can also serve as the display device of the vehicle 1. An on-board computer connected to the camera 50, the display 51, the head-up display 52 (or the projection device that generates the head-up display 52), the loudspeaker 53, and the microphone 54 is not shown. Likewise, communication interfaces that are also connected to the on-board computer and via which communication with other entities of the system can take place are not shown. Variant 1: Central communication without central authorization facility

[0078] In this variant, the central authorization device 4 and the communication arrows 17 to 22 are omitted, which are Fig. 1 for communication with the central authorization device 4. Furthermore, the communication arrows 11 and 12 for direct communication between vehicle 1 and traffic object 2 are omitted.

[0079] When describing variant 1, reference is also made to Fig. 3, which shows a flowchart of a method according to an embodiment of the present invention.

[0080] First (start: 60), a person 31 (here the passenger 31) in the vehicle 1 performs a gesture by pointing at the traffic object 2. This is captured by the camera 50 (61) and analyzed with the help of the on-board computer or recognized as a specific gesture (namely a pointing gesture) (62). To do this, the on-board computer can compare the image data captured by the camera 50 with previously stored data regarding a gesture. If there is sufficient correlation between the image data captured by the camera 50 and the previously stored data representing a specific gesture (here a pointing gesture), the on-board computer determines that the gesture performed by the person 31 is a pointing gesture.

[0081] In addition, the on-board computer can use position, speed and compass data of the vehicle 1 as well as previously known position data of the traffic object 2 to determine which traffic object 2 the person 31 is pointing at.

[0082] After the on-board computer has recognized the executed gesture and identified traffic object 2, corresponding information (e.g., "Turn traffic light at the Hafenstraße / Nordseestraße intersection to green") is displayed on the display 51 and / or the head-up display 52 and / or output via the loudspeaker 53 (63). This simultaneously represents a request (64) to the person 31 to confirm the proposed action.

[0083] After the person 31 has confirmed the action suggested by the on-board computer, for example by touching a button on the display 51 or by a specific verbal utterance recorded by the microphone 54 (e.g., "Yes"), the vehicle 1 transmits (65) the control request (the confirmed action) to the central control device 3, as shown by arrow 13. In this context, an identification of the vehicle 1 is also transmitted to the central control device 3.

[0084] The central control device 3 then checks (66) whether the vehicle 1 is authorized to control the traffic object 2. If this is the case, the central control device 3 controls (67) the traffic object 2 according to the control request, as shown by arrow 16.

[0085] In principle, the method could end at this point (69) because the control request has been complied with, i.e. it has been carried out (traffic light 2 turns green). However, further communication can still take place. For example, traffic object 2 can report to the central control device 3 (arrow 15) when the traffic object 2 has reached the state according to the control request, and the central control device 3 can forward this information to the vehicle 1 (68), as shown by arrow 14. The vehicle 1 can make this information available to the person 31. The method can then end (69). After the vehicle 1 has passed the traffic object 2, or after a certain period of time has elapsed, the traffic object 2 can be controlled again in the usual way, for example automatically. Variant 2: Central communication with central authorization facility

[0086] This variant can be viewed as a further development of variant 1. In variant 2, the central authorization device 4 is additionally present, which can communicate with the central control device 3 (arrows 17 and 18). The procedure can be carried out analogously to variant 1. However, the check as to whether vehicle 1 is authorized to control the traffic object 2 is carried out by the central authorization device 4 and not by the central control device 3. Corresponding authorization information can be stored, managed, and updated centrally in the central authorization device 4.

[0087] After the central control device 3 has received a control request from vehicle 1 (arrow 13), the central control device 3 sends a corresponding request (arrow 17), i.e., a request to check the authorization of vehicle 1, to the central authorization device 4 and receives a corresponding response from it (arrow 18). Based on this response, the traffic object 2 can be controlled according to variant 1. Variant 3: Variation a) of variant 2

[0088] This modification can be implemented essentially analogously to variant 2. However, the central control device 3 does not communicate with the central authorization device 4. Instead, vehicle 1 (arrow 19) requests authorization to control the traffic object 2 from the central authorization device 4 and receives it (arrow 20), for example, in the form of a digital certificate. Vehicle 1 can forward this authorization to the central control device 3 (arrow 13). This completes the authorization check. Variant 4: Variation b) of variant 2

[0089] This modification can be implemented essentially analogously to variant 3. Vehicle 1 (arrow 19) again requests authorization from the central authorization device 4. However, the central authorization device 4 sends the corresponding authorization directly to the traffic object 2 (arrow 22) or to the central control device 3 (arrow 18). This completes the authorization check. Variant 5: Decentralized communication

[0090] In this variant, the central control device 3 and the communication arrows 13 to 18 are omitted, which are Fig. 1 for communication with the central control device 3. Furthermore, the communication arrows 19 and 20 for communication between vehicle 1 and central authorization device 4 are omitted.

[0091] The recognition of the gesture performed by person 31 and, if necessary, a confirmation can be performed analogously to variant 1. Vehicle 1 then sends a control request corresponding to the gesture to traffic object 2 (arrow 11). An identification of vehicle 1 is also transmitted.

[0092] Traffic object 2 (arrow 21) then requests a check of vehicle 1's authorization to control traffic object 2 from the central authorization device 4 and, if applicable, receives confirmation of the authorization (arrow 22). This completes the authorization check. Traffic object 2 then executes the control request.

[0093] If necessary, the traffic object 2 can send a corresponding feedback (arrow 12) to the vehicle 1 after executing the control request. Variant 6: Variation a) of variant 5

[0094] This modification can be implemented essentially analogously to variant 5. However, vehicle 1 (arrow 19) requests authorization directly from the central authorization device 4 and receives it (arrow 20), for example, in the form of a digital certificate. Vehicle 1 can forward this authorization to traffic object 2 (arrow 11). Based on the existence of this authorization, traffic object 2 executes the control request. Variant 7: Variation b) of variant 5

[0095] This modification can be implemented essentially analogously to variant 6. Again, vehicle 1 (arrow 19) requests authorization directly from the central authorization device 4. However, the authorization is not sent to vehicle 1, but directly to traffic object 2 (arrow 22). Based on the presence of this authorization, traffic object 2 executes the control request. Variant 8: Variation c) of variant 5

[0096] This modification can be implemented essentially analogously to variant 5. However, the central authorization device 4 and the communication arrows 21 and 22 are also omitted. This means that only direct communication between vehicle 1 and traffic object 2 can take place.

[0097] In this variation, an identification of vehicle 1 can be stored in advance in a memory of traffic object 2. After traffic object 2 receives a control request along with an identification of vehicle 1 (arrow 11), traffic object 2 can compare the received identification with the previously stored identification. Because these match, traffic object 2 executes the control request. Variant 9: Indirect communication

[0098] This variant is similar to variant 1. The central authorization device 4 and the communication arrows 17 to 22, which are shown in Fig.1 for communication with the central authorization device 4. However, in variant 5, the communication arrows 13 and 15 for communication between vehicle 1 and central control device 3 are also omitted. However, direct communication can take place between vehicle 1 and traffic object 2 (arrows 11 and 12).

[0099] According to variant 9, vehicle 1 sends a control request directly to traffic object 2 (arrow 11). This sends a corresponding message (arrow 15) to the central control device 3. The central control device 3 then checks whether vehicle 1 is authorized to control traffic object 2. If this is the case, the central control device 3 informs traffic object 2 or controls traffic object 2 according to the control request (arrow 16). Traffic object 2 can, if necessary, communicate its updated status directly to vehicle 1 (arrow 12). Variant 10: Indirect communication with central authorization facility

[0100] This variant is similar to variant 9. However, according to variant 10, as in variants 2 to 4, the central authorization device 4 is present. The central authorization device 4 can, in turn, be requested to verify the authorization of vehicle 1 and send a corresponding authorization (possibly in the form of a certificate). Communication with the central authorization device 4 can be carried out by the central control device 3 (arrows 17 and 18), by the traffic object 2 (arrows 21 and 22), or by the vehicle 1 (arrows 19 and 20). Different communication paths for requesting authorization and transmitting the corresponding authorization are also possible, for example: Authorization requested by Arrow Authorization sent to Arrow Vehicle 1 19 Traffic object 2 22 Vehicle 1 19 central control device 3 18 Traffic object 2 21 Vehicle 1 20 Traffic object 2 21 central control device 3 18 central control device 3 17 Vehicle 1 20 central control device 3 17 Traffic object 2 22 Further embodimentsA) Continuous identification of traffic objects

[0101] While according to the embodiments described above it is provided that the system 10 or the vehicle 1 determines which traffic object is involved after executing or recognizing a (pointing) gesture, i.e. which traffic object was pointed at or which traffic object is to be controlled, according to this alternative embodiment the system 10 or the vehicle 1 can continuously determine which traffic objects are in the vicinity of the vehicle 1, for example within a certain radius around the vehicle 1. This can optionally be done taking into account the direction of travel of the vehicle 1, so that (predominantly) those traffic objects are identified which are in an area (with a fixed or definable radius) in front of the vehicle 1 in the direction of travel.By detecting a gesture performed by a person 31 in the vehicle 1, the system can then only consider those traffic objects that were previously detected or identified (as being in the vicinity of the vehicle 1). This can limit the number of traffic objects that may be controlled by a gesture from the person 31 in the vehicle 1. This can potentially accelerate the process flow. B) Route-based identification of traffic objects

[0102] Similarly to alternative embodiment A), the system 10 or the vehicle 1 can determine, based on a route entered (into a navigation system), those traffic objects located near this route. This can also limit the number of traffic objects that may be controlled by a gesture from the person in the vehicle, which may potentially lead to an acceleration of the process flow. C) Modified order

[0103] It has already been mentioned above that the request or obtaining of authorization (66) for controlling a traffic object can be carried out in advance, i.e., before the execution or detection (61) or recognition (62) of a gesture. Similarly, the sequence of the method steps described above can also be changed in other respects. For example, the control request and / or the request for verification of the authorization can be transmitted (65, 66) (immediately) after the recognition of a gesture (62) and the identification of the traffic object 2 targeted by the gesture, even before or while the information is made available to the person 31 for confirmation (63, 64). In this way, the authorization can be verified early (66), i.e., not only after the person 31 has confirmed the provided information (64).Likewise, system 10 can check whether other factors prevent the execution of the control request, for example, whether executing the control request could result in danger to life or property damage. However, the control request is preferably only actually executed after confirmation (64) by person 31. D) Refusal of the control request

[0104] If, for any reason, it is not possible to execute the control request, for example, because executing the control request could endanger life or property damage, or because vehicle 1 or person 31 is not authorized to control the road vehicle, system 10 can transmit or provide a corresponding message to vehicle 1 or person 31. If necessary, system 10 can also search for alternatives that most closely approximate the control request and can transmit or provide corresponding information to vehicle 1 or person 31. List of reference symbols 1 vehicle, emergency vehicle 2 traffic object 3 Control device 4 Authorization device 5 Control unit 10 System, control system 11 - 22 Signals / Communication channels 30, 31 people 32 hands 40 Windshield 50 Sensor, Camera 51 Display device, touchscreen, CID 52 Head-Up Display 53 speakers 54 Microphone 60 - 69 process steps

Claims

[1] Method for controlling at least one traffic object (2) of a traffic infrastructure, characterized by : Detecting a gesture performed by a person (30, 31) in a vehicle (1); Sending a signal based on the detected gesture to a control unit (3, 5); and Controlling the traffic object (2) by or via the control unit (3, 5), wherein the control unit (3, 5) takes the signal and thus the gesture into account when controlling the at least one traffic object (2). [2] Method according to claim 1, characterized by : Checking whether the person (30, 31) and / or the vehicle (1) has an authority that causes the control unit (3, 5) to take the gesture into account when controlling the at least one traffic object (2). [3] Method according to claim 2, characterized bythat a central authorization device (4) checks whether the person (30, 31) and / or the vehicle (1) has this authority, and / or that the central authorization device (4) provides or transmits an authorization which causes the control unit (3, 5) to take the gesture into account when controlling the at least one traffic object (2). [4] Method according to one of the preceding claims, characterized by that information regarding the traffic object (2) is sent to the person (30, 31) and / or the vehicle (1) and / or made available to the person (30, 31) and / or the vehicle (1), the information in particular: a) have an identification of the traffic object (2) and / or b) indicate a, in particular current, condition of the traffic object (2) and / or (c) indicate whether and / or how the condition of the traffic object (2) can be changed or maintained. [5] Method according to claim 4, characterized by that after sending or making available the information, a response from the person (30, 31) is requested and / or received. [6] Method according to one of the preceding claims, characterized by that the control unit (3, 5) controls the at least one traffic object (2) on the basis of the gesture and / or the reaction, in particular in order to change or maintain its state, in particular for a predetermined period of time or a period determined by an event. [7] Method according to one of the preceding claims, characterized by that the control unit (3, 5) has a central control device (3) for controlling the at least one traffic object (2) and optionally further traffic objects (2) of the traffic infrastructure. [8] Computer program product comprising a program code stored on a computer-readable medium for carrying out a method according to any one of the preceding claims. [9] System (10) for controlling at least one traffic object (2) of a traffic infrastructure, in particular for carrying out a method according to one of claims 1 to 7, characterized by that the system (10) comprises detection means (50) for detecting the or a gesture performed by the or a person (30, 31) in the or a vehicle (1), wherein the system (10) comprises the or a control unit (3, 5) and is configured to send a or the signal based on the detected gesture to the control unit (3, 5); and wherein the control unit (3, 5) is configured to control the traffic object (2) taking into account the signal and thus taking into account the detected gesture. [10] System (10) according to claim 9, characterized by in that the system (10) has the or a central authorization device (4), wherein the central authorization device (4) is set up to check whether the person (30, 31) and / or the vehicle (1) has the or an authorization that causes the control unit (3, 5) to take the gesture into account when controlling the at least one traffic object (2), and / or wherein the central authorization device (4) is set up to provide the or an authorization or to transmit it, in particular directly or indirectly, in particular to the control unit (3, 5), which causes the control unit (3, 5) to take the gesture into account when controlling the at least one traffic object (2). [11] Vehicle (1) for use in a system (10) according to one of the preceding claims, characterized bythat the vehicle (1) has the detection means (50) for detecting the gesture performed by the person (30, 31) in the vehicle (1), wherein the vehicle (1) is configured to send the signal based on the gesture performed to the control unit (3, 5) and / or to a central authorization device (4). [12] Vehicle (1) according to claim 11, characterized by that the vehicle (1) is arranged to provide the person (30, 31) with information, the information being: a) have an identification of the traffic object (2) and / or b) indicate a, in particular current, condition of the traffic object (2) and / or (c) indicate whether and / or how the condition of the traffic object (2) can be changed or maintained. [13] Vehicle (1) according to claim 12, characterized bythat the vehicle (1) is configured to receive the information from the control unit (3, 5) and / or from the central authorization device (4) and / or from the traffic object (2). [14] Vehicle (1) according to claim 12 or 13, characterized by that the vehicle (1) is arranged to request and / or receive a reaction from the person (30, 31) to the information provided. [15] Vehicle (1) according to one of claims 11 to 14, characterized by that the vehicle (1) is equipped: a) to control the at least one traffic object (2) on the basis of the gesture and / or the reaction, in particular to change or maintain its state, in particular for a predetermined period of time or a period determined by an event, and / or b) to initiate a control of the at least one traffic object (2) on the basis of the gesture and / or the reaction, in particular to initiate a change or maintenance of its state, in particular for a predetermined period of time or a period determined by an event.

Images