Method for transmitting information by means of light signals and motor vehicle

Abstract

Method for transmitting information by means of light signals which are sent from a light transmitting device (15, 17) of a transmitting vehicle (10) to a light receiving device (11, 17) of a receiving vehicle (20), and wherein the information is encoded by means of a modulation of the emitted light signals, wherein the information comprises an image data stream, and the image data stream comprises individual image recordings and location information associated with these individual image recordings, and wherein the light transmitting device (15, 17) is a vehicle light of the transmitting vehicle (10), characterized in that the information comprises a count value which is increased by a fixed value when transmitted from the transmitter vehicle (10) to the receiver vehicle (20), and wherein information whose count value exceeds a predetermined threshold value is not transmitted.

Description

[0001] The invention relates to a method for transmitting information by means of light signals, and to a motor vehicle.

[0002] While a vehicle is driving, sensors such as cameras collect a lot of information that can help make automated decisions such as emergency braking of a vehicle based on detected objects or people.

[0003] In addition, it may be useful to communicate information about detected objects and / or obstacles to a following vehicle. For example, if a first vehicle detects an obstacle or a person, it is possible to transmit this information to a following vehicle. There are many options available today for wirelessly transmitting such information. The most common methods are radio communication, such as wireless communication via cellular networks or Wi-Fi.

[0004] A major limitation of this choice of data transmission, however, is the density of available transmitters or transmission towers, via which data can be transmitted from vehicle to vehicle. Therefore, there are always areas where mobile phone coverage is patchy, and data transmission is limited (so-called dead zones).

[0005] Publication KR 2022 0 088 175 A describes a method for using headlights to transmit information in vehicle-to-vehicle communication using light-based data transmission (so-called "Light Fidelity", Li-Fi). Information is converted into an exchange format, which is subsequently transmitted via a Li-Fi interface and received in one or more following vehicles via a camera or a dedicated Li-Fi sensor.

[0006] Furthermore, US 2018 / 0 227 053 A1 describes a method for transmitting information in vehicle-to-vehicle communication using Li-Fi. The transmitted information includes information generated and recorded by the vehicle itself, such as speed or lane data, and the transmission of media data, such as a video stream. The information is converted into an exchange format, which is subsequently transmitted via the Li-Fi interface and received by one or more following vehicles via a camera or Li-Fi sensor.

[0007] Furthermore, the media file “Fraunhofer HHI: Vehicle-to-Vehicle LiFi” (URL: https: / / www.hhi.fraunhofer.de / abteilungen / pn / forschungsgruppen / optik-metro-zugangs-und-inhausnetze / vehicle-to-vehicle-lifi.html / (https: / / www.youtube.com / watch?v=i4-z0xETiUM) discloses a Li-Fi communication method, the document WO 2020 / 053 716 A1 discloses an adaptive headlight system for motor vehicles, and the document US 2019 / 0 306 396 A1 discloses a communication device of a motor vehicle, a motor vehicle lighting device for the communication device of a motor vehicle and a Car2Car or Car2X communication method for a motor vehicle.

[0008] The invention is based on the object of creating an improved method for transmitting information by means of light signals and generally improving vehicle-to-vehicle communication by means of light signals.

[0009] The invention solves this problem by providing a method for transmitting information using light signals according to claim 1. Furthermore, the invention provides a motor vehicle according to another independent claim. Further advantageous embodiments of this are defined in the dependent claims.

[0010] The invention is based on the idea that vehicle lights such as a vehicle's headlights or additional transmitter / receiver devices (so-called transceivers) are used as transmitters and receivers. A vehicle that has recorded or received these images can transmit such image data or an image data stream or video stream or video data stream as the information by means of light signals to another vehicle, such as a following vehicle (following vehicle) or an oncoming vehicle. This image data is thus available to this vehicle to make decisions based on it or to make the image data available to the driver, for example. The image data preferably includes further data such as a geoposition, a speed, and / or lane data, whereby this data is linked to the image data.This link makes it possible to better assess the relevance of the information and thus of the images.

[0011] For example, a following vehicle can use the information it receives to recognize a scene that was captured by a front camera of the vehicle in front, can use the information to determine where the images were taken, and can make automated decisions based on this.

[0012] According to a first embodiment of the invention, a method is provided for transmitting information using light signals that are sent from a light transmitting device of a transmitting vehicle to a light receiving device of a receiving vehicle. The information is encoded by modulating the transmitted light signals, with the information comprising an image data stream. The image data stream comprises individual image recordings and location information or GPS coordinates linked to these individual image recordings. The light transmitting device, or a Li-Fi transceiver, is a vehicle light of the transmitting vehicle.

[0013] In other words, information can be transmitted by means of light signals from a light transmitting device of a transmitting vehicle to a light receiving device of, for example, a following receiving vehicle. The information can be encoded by modulating the transmitted light signals. The information can comprise an image data stream, i.e., video data, which was recorded, for example, by a camera of the transmitting vehicle or received from another vehicle. An image data stream comprises a sequence of individual image recordings, and location information or GPS coordinates can be linked to these individual image recordings.The light transmitting device or the Li-Fi transceiver may be a dedicated light transmitting device, or may be, for example, a vehicle light of the vehicle, such as a tail light, a turn signal, a reversing light, a brake light, a fog light, and / or a rear fog light.

[0014] Various control units and sensors in the vehicle are used to capture the data to be sent. This data is then converted into an exchange format in a processing step, which is then transmitted via the Li-Fi interface and received in one or more following vehicles via a camera or Li-Fi sensor. Linking the image data with the location information can also be called sensor data fusion, i.e., combining the image data with additional captured information, an environment model, and / or object lists.

[0015] By transmitting the information, it can be transmitted along a line of sight. Transmission can occur with or without establishing a connection and can, for example, be sent to several vehicles simultaneously with which a direct line of sight is currently established, which can be a significant advantage on a multi-lane road.

[0016] The invention also offers the advantage that, for example, image data from a vehicle ahead can be evaluated and processed in following vehicles, allowing obstacles and / or dangerous situations to be detected earlier. In general, this provides the advantage that a vehicle has more perspectives available than if the vehicle only had its own image data available. This allows a more comprehensive picture of the situation to be created, making it possible to react to specific traffic situations earlier and more appropriately.

[0017] Furthermore, it is provided that recorded and forwarded information include a count value that is incremented by a fixed value, such as 1, upon transmission from the sender vehicle. In addition, information whose count value exceeds a predetermined threshold is not transmitted. This makes it possible to count how often information has been forwarded, and it is possible to abort a forwarding if information has been forwarded more than a certain threshold. A count value can, for example, also describe a vehicle length in order to obtain an estimate of the distance of the forwarded image information in a convoy. Furthermore, it is possible to define a speed-dependent or location-dependent value so that a forwarding only covers a certain distance and the information is only forwarded over a predetermined route.For example, a truck is longer than a passenger car, and forwarding image information from one truck to another corresponds to a greater forwarded distance than forwarding it for a passenger car. This further development has the advantage of making it possible to determine how far information is forwarded, and it makes it possible to avoid forwarding information for an arbitrary number of times and for an arbitrary length of time.

[0018] The invention also includes further developments which may result in additional advantages.

[0019] According to an advantageous development, the light-emitting device is one of various vehicle lights or headlights of the respective transmitting vehicle. The light-emitting device or the Li-Fi transceiver can be a dedicated light-emitting device or can be, for example, a vehicle light of the vehicle, such as a tail light, a turn signal, a reversing light, a brake light, a fog light, and / or a rear fog light. This also means that the light-emitting device can use visible light that can be emitted by one or more existing vehicle lights of the transmitting vehicle. Alternatively, it is possible for the light-emitting device to emit infrared light using dedicated light-emitting devices. This development enables the method according to the invention to be implemented particularly easily.

[0020] According to an advantageous development, the light transmitting device is a matrix light of the transmitting vehicle, which has individual matrix elements that can be controlled individually. The modulation of the light signals can comprise an individual modulation of the individual matrix elements of the matrix light. In this case, a matrix light is understood to be a light of the transmitting vehicle that comprises several individual light elements that are optically distinguishable. For example, a brake light can have many different red light-emitting diodes (LEDs) that can be controlled individually or jointly. By individually controlling the individual matrix elements or light elements of the matrix light of the transmitting vehicle, it is possible to increase the information density of the matrix light with regard to the light fidelity method.Furthermore, a group of individual matrix elements can be controlled jointly, for example, to reduce the resolution of the matrix light. This development has the advantage that the matrix light can increase information density and increase data transmission rates using the Li-Fi method.

[0021] A further advantageous development of the invention provides that a light receiving device of the receiving vehicle is configured to decode the modulation of the emitted light signals and to forward the information contained in the decoded light signals to an electronic control unit of the receiving vehicle. This means that a common coding method can be provided by means of which vehicles from different manufacturers can communicate with one another. By decoding the information contained in the light signals, this information can be made usable by an electronic control unit in the receiving vehicle and forwarded to this control unit. Optionally, decoding of the light signals can be carried out in the electronic control unit. This development has the advantage that several vehicles from different manufacturers can communicate with one another in a simple manner.

[0022] A further advantageous embodiment of the method provides for the use of multiple vehicle lights to encode the information. This means that multiple vehicle lights can be used together to jointly provide a light-emitting device configured to transmit the information. This refinement provides the advantage of increasing the amount of information and the amount of data transmitted. Furthermore, this refinement allows for a reduction in resolution, enabling reliable information transmission, for example, in poor weather conditions.

[0023] A further advantageous development provides that the light receiving device is a camera configured to record the traffic situation. In other words, the light receiving device is a camera located in the receiving vehicle to record the traffic situation, and this camera is additionally configured to receive and decode light signals emitted by a vehicle ahead. This development has the advantage of allowing a reduction in the costs associated with the method.

[0024] A further advantageous embodiment of the method provides that the information is information generated by the transmitting vehicle and, in particular, the image data stream is recorded by a camera of the transmitting vehicle, and the location information designates a respective location at which the transmitting vehicle was located at the time of an image recording of the respective individual image recording, and / or the information is information recorded by the transmitting vehicle that is forwarded by the transmitting vehicle. This has the advantage that information that has been received can also be forwarded in order to make it available to other vehicles. This means that the information that is sent backwards to a following vehicle, for example, can be information received by the transmitting vehicle that is simply forwarded to the following vehicle.This allows for a forwarding process involving multiple vehicles, for example, in a convoy situation. This further development offers the advantage of further improving information transfer and making it possible to forward information to a following vehicle even earlier, enabling appropriate reactions.

[0025] A further advantageous embodiment of the method provides that a modulation speed and a modulation resolution of the matrix light of the transmitting vehicle are adjusted depending on a driving situation, current weather conditions, and / or the distance between the transmitting vehicle and the receiving vehicle. In other words, a modulation speed and a modulation resolution can be adjusted depending on a driving situation and thus also on the information content of the message to be transmitted.If, for example, visibility from the receiving vehicle to the transmitting vehicle is restricted due to rain, snow, or fog, and the transmitting vehicle detects this accordingly, a modulation speed and modulation resolution can be adjusted such that the modulation speed is slowed down depending on the weather conditions, for example, and a modulation resolution of the vehicle's matrix light is reduced by combining multiple matrix elements into a larger matrix field that is switched together. This means that multiple matrix elements of the matrix light can be switched together to form a larger matrix field or larger matrix element of the matrix light. This reduces the resolution, and reliable detection of the modulated signal by the transmitting vehicle can be improved, even at a greater distance or when exposed to weather conditions.Depending on the driving situation or the urgency of the message, the modulation speed can be accelerated to enable faster data transmission. Alternatively, the modulation resolution of the matrix light can be increased to increase the data transmission rate.

[0026] The invention also includes a motor vehicle with a light transmitting device, a light receiving device and a control device, which is designed to participate in a method according to one of the preceding claims as a transmitter vehicle or receiver vehicle.

[0027] For use cases or application situations that may arise during the method and which are not explicitly described here, it may be provided that, in accordance with the method, an error message and / or a request to enter user feedback is issued and / or a default setting and / or a predetermined initial state is set.

[0028] The invention also includes the control device for the motor vehicle. The control device can have a data processing device or a processor device that is configured to carry out an embodiment of the method according to the invention. For this purpose, the processor device can have at least one microprocessor and / or at least one microcontroller and / or at least one FPGA (Field Programmable Gate Array) and / or at least one DSP (Digital Signal Processor). In particular, a CPU (Central Processing Unit), a GPU (Graphical Processing Unit), or an NPU (Neural Processing Unit) can be used as the microprocessor. Furthermore, the processor device can have program code that is configured to carry out the embodiment of the method according to the invention when executed by the processor device. The program code can be stored in a data memory of the processor device.The processor device can, for example, be based on at least one circuit board and / or on at least one SoC (System on Chip).

[0029] The invention also includes further developments of the method according to the invention that have features already described in connection with the further developments of the motor vehicle according to the invention. For this reason, the corresponding further developments of the method according to the invention are not described again here.

[0030] The motor vehicle according to the invention is preferably designed as a motor vehicle, in particular as a passenger car or truck, or as a passenger bus or motorcycle.

[0031] As a further solution, the invention also encompasses a computer-readable storage medium comprising program code which, when executed by a computer or computer network, causes the computer or computer network to carry out an embodiment of the method according to the invention. The storage medium can be provided at least partially as a non-volatile data memory (for example, as a flash memory and / or as an SSD - solid state drive) and / or at least partially as a volatile data memory (for example, as a RAM - random access memory). The storage medium can be arranged in the computer or computer network. However, the storage medium can also be operated on the Internet, for example, as a so-called app store server and / or cloud server. The computer or computer network can provide a processor circuit with, for example, at least one microprocessor.The program code may be provided as binary code and / or as assembly code and / or as source code of a programming language (for example C) and / or as a program script (for example Python).

[0032] The invention also encompasses combinations of the features of the described embodiments. The invention therefore also encompasses implementations that each comprise a combination of the features of several of the described embodiments, unless the embodiments are described as mutually exclusive.

[0033] Exemplary embodiments of the invention are described below. Shown are: Fig. 1 a schematic representation of a transmitter vehicle and a follower vehicle in a side view; Fig. 2 a schematic flow diagram of a method according to the invention;

[0034] In the figures, the same reference symbols designate elements with the same function.

[0035] The exemplary embodiments explained below are preferred embodiments of the invention. In the exemplary embodiments, the described components of the embodiments each represent individual features of the invention that can be considered independently of one another, each of which also develops the invention independently of one another. Therefore, the disclosure is intended to encompass combinations of the features of the embodiments other than those shown. Furthermore, the described embodiments can also be supplemented by further features of the invention already described.

[0036] Fig. 1 shows a transmitter vehicle 10 comprising a front light receiving device 11, a light receiving device 11, an electronic control unit 12, a GPS receiver 13, an infotainment system 14, a light transmitting device 15, and a Li-Fi transceiver 17. The transmitter vehicle 10 is configured to transmit information 16 to a receiver vehicle 20 by modulating the emitted light signals in which information is encoded. The information comprises an image data stream recorded by a camera of the transmitter vehicle 10, and the image data stream comprises individual image recordings and location information or GPS coordinates linked to these individual image recordings. The GPS coordinates indicate a respective location, recorded by the GPS receiver, at which the transmitter vehicle 10 was located at the time the respective individual image recording was taken.The light transmitting device 15 can be a light transmitting / receiving device 17 or a Li-Fi transceiver, which can be, for example, a vehicle light of the transmitting vehicle 10. In this case, the light transmitting device 15 can be a matrix light or a vehicle light or a headlight of the transmitting vehicle. It is also possible for the light transmitting device 15 to be a matrix light of the transmitting vehicle, wherein the modulation of the light signals comprises an individual modulation of various matrix elements of the matrix light. In this case, the light receiving device 11 of the receiving vehicle 20 can be configured to decode the modulation of the light signals emitted by the transmitting vehicle 10 and to forward the information contained in the decoded light signals to an electronic control unit (ECU) 12 of the receiving vehicle 20.The infotainment system may include a display device and may be configured to display the received information, in particular the image data stream. Camera 11 may also be a camera that observes, records, or evaluates traffic events and forwards the evaluated information to electronic control unit 12.

[0037] The vehicle's headlights can be used as both transmitters and receivers. The transmitter vehicle 10 can encode its own generated and recorded information, such as geoposition, speed, and lane data, into the light, as well as transmit media data, such as a video stream representing, for example, the information captured by the front camera of the vehicle in front.

[0038] In a particularly preferred embodiment, multiple vehicle lights are used to encode the information. This can be adjusted, for example, depending on a driving situation, a current weather influence, and / or a distance between the transmitter vehicle 10 and the receiver vehicle 20, or a modulation speed and modulation resolution of the matrix light of the transmitter vehicle can be adjusted. For example, in an emergency braking situation, it may be advantageous to use several or all of the transmitter vehicle's vehicle lights to transmit information related to the emergency braking situation to the rear. This allows a following vehicle to be informed early on of the presence of an emergency braking situation.

[0039] Furthermore, it is also possible for information to be transmitted from the transmitting vehicle 10, which in turn is information acquired by the transmitting vehicle 10. Upon such forwarding, a count is incremented. This count can be incremented, for example, by a fixed value such as 1, or by, for example, a length of the car, a distance traveled during the forwarding, or a speed-dependent value. If the count exceeds a certain threshold, forwarding is aborted, thus preventing information from being forwarded indefinitely.

[0040] Fig. 2 shows a method according to an embodiment of the invention.

[0041] In a first step S1, a camera captures an image data stream comprising individual images and location information associated with these individual images. Alternatively, the image data stream can be encoded in received information by the transmitting vehicle itself. Optionally, the information can include a count value that is incremented by a fixed value, such as 1, with each forwarding.

[0042] In a second step S2, the information is transmitted by means of a light transmitting device 15 of the transmitting vehicle 10. If a receiving vehicle 20 is within range of the light transmitting device 15 and there is a line of sight between the light transmitting device 15 of the transmitting vehicle 10 and the light receiving device 11 of the receiving vehicle 20, the information can be received by the receiving vehicle 20.

[0043] In a step S3, the information from the received light signals is decoded and provided to the electronic control unit 12 of the receiver vehicle 20.

[0044] Overall, the examples show how a method for transmitting information by means of light signals and a motor vehicle can be provided. List of reference symbols: 10 transmitter vehicle 11 Light receiving device 12 Electronic control unit 13 GPS receivers 14 Infotainment system 15 Light transmitting device 16 Transmission 17 Transmitting / receiving device 20 recipient vehicles

Claims

[1] Method for transmitting information by means of light signals which are sent from a light transmitting device (15, 17) of a transmitting vehicle (10) to a light receiving device (11, 17) of a receiving vehicle (20), and wherein the information is encoded by means of a modulation of the emitted light signals, wherein the information comprises an image data stream, and the image data stream comprises individual image recordings and location information associated with these individual image recordings, and wherein the light transmitting device (15, 17) is a vehicle light of the transmitting vehicle (10), characterized by that the information comprises a count value which is increased by a fixed value when transmitted from the transmitter vehicle (10) to the receiver vehicle (20), and wherein information is not transmitted whose count value exceeds a predetermined threshold value. [2] Method according to one of the preceding claims, wherein the light transmitting device is one of various vehicle lights of the transmitter vehicle (10). [3] Method according to one of the preceding claims, wherein the light transmitting device (15, 17) is a matrix light of the transmitter vehicle (10), and the modulation of the light signals comprises an individual modulation of different matrix elements of the matrix light. [4] Method according to one of the preceding claims, wherein the light receiving device (11, 17) of the receiver vehicle (20) is designed to decode the modulation of the emitted light signals and to forward the information contained in the decoded light signals to an electronic control unit of the receiver vehicle (20). [5] A method according to any preceding claim, wherein the method uses a plurality of vehicle lights to encode the information. [6] Method according to one of the preceding claims, wherein the light receiving device (11, 17) is a camera which is designed to record the traffic situation. [7] Method according to one of the preceding claims, wherein the information is information generated by the transmitter vehicle (10) and in particular the image data stream is recorded by a camera of the transmitter vehicle (10), and the location information designates a respective location at which the transmitter vehicle (10) was located at a time of an image recording of the respective individual image recording, and / or the information is information acquired by the transmitter vehicle (10) which is forwarded by the transmitter vehicle (10). [8] Method according to one of the preceding claims, wherein a modulation speed and a modulation resolution of the matrix light of the transmitter vehicle are determined as a function of a driving situation, a current weather influence and / or a distance of the transmitter vehicle to the receiver vehicle. [9] Motor vehicle with a light transmitting device (15, 17), a light receiving device (11, 17) and a control device, which is designed to participate in a method according to one of the preceding claims as a transmitter vehicle (10) or receiver vehicle (20).

Images