Information exchange using an event camera

Abstract

Provide fast and robust information transmission between an information source and an information transmission destination. 【Solution means】The present invention relates to a method for transmitting a binary data sequence (7) consisting of at least two binary values from an information source (1) to an information transmission destination (4). This method comprises the following steps. 1) Step (8) of determining a line code representation based on the binary data sequence. Here, the line code representation is such that the clock used for determining the line code representation based on the binary data sequence (7) can be restored from the line code representation. 2) Step (9) of optically transmitting the line code representation using a light source (2). Here, the intensity of the emitted light of the light source is modulated based on the line code representation. 3) Step (10) of capturing the optically transmitted line code representation using an event camera (3). Here, the event camera (3) is adapted to generate an event based on the intensity change of the captured optically transmitted line code representation. 4) Step (11) of determining a restored binary data sequence (12) based on the generated events. Here, the determination of the restored binary data sequence (12) comprises restoring a clock based on the generated events and measuring at least one time difference between the generated events using the restored clock. The present invention further relates to an assembly and a computer for executing the aforementioned method.

Description

Technical Field

[0001] The present invention relates to a method for transmitting a binary data sequence composed of at least two binary values from an information source to an information transmission destination. Further, the present invention relates to an assembly including an information source, a light source, an event camera, and an information transmission destination, and a computer program product.

Background Art

[0002] Event cameras such as dynamic vision sensors (DVS) are known, for example, in the fields of robotics and autonomous driving. Different from conventional camera sensors, event camera sensors provide an output only when there is some change in the observed scene. In other words, if there is no change, the event camera does not provide an output, while a conventional camera continuously samples (periodically) an unchanging scene. Therefore, many event cameras are designed to operate based on the logarithm of the input light intensity and may provide a sparse output with low latency and high dynamic range. Furthermore, since each pixel of an event camera is usually independent of other pixels, only the pixels where changes occur generate events, and the output of the event camera becomes even sparser. Therefore, event cameras would be suitable for high-speed control applications or survey applications. For example, because event cameras react only when changes occur. A potential disadvantage of event cameras is that a large number of events occur during rapid changes such as changes in background illumination due to changes in lighting conditions. Therefore, in some cases, event cameras may generate a larger amount of data than conventional camera sensors.

[0003] In control and survey applications where conventional camera sensors are used, a large amount of computing power is often required for image processing, and when there is no change or little change in the observed scene, the computations are often wasted.

[0004] More abstractly, there may be cases where an information source wants to transmit some information to an information destination. Examples of what can be an information source include, for example, traffic signal control software that controls traffic signals, and examples of what can be an information destination include, for example, an algorithm used as part of autonomous driving software that determines whether a vehicle should accelerate. When a conventional camera mounted on a vehicle monitors a traffic signal, most of the acquired data may be irrelevant to a specific task, which may result in waste.

[0005] Patent Document 1 discloses optical communication technologies. As an example of such technologies, reception of an event stream including displays of independent events detected by pixels of an event camera may be included. An event may be a change in luminance detected by a pixel of a pixel array, and the pixel may independently generate a display of the event in response to detecting the event. The event stream can be demultiplexed into a plurality of communication streams including related events related to a plurality of communication sources. Events included in the communication stream can be partially aggregated based on event proximity and event time that associate the event with other events included in the event stream. The plurality of communication streams can be demodulated to extract optical transmission information from the plurality of communication streams, and the information can be transmitted to a data consumer.

[0006] Non-Patent Document 1 discloses transmission of an optical signal for an event camera using a propeller-type rotating LED transmitter under development in event camera-based visible light communication (VLC). This transmitter rotates a blinking LED in a circular shape and uses the afterimage of the LED light to transmit a signal. The event camera detects the afterimage and outputs it constantly as an event stream. Noise events are filtered to restore data using signal events. In this paper, the operation of the proposed system is verified by a demonstration experiment. Communication in the proposed system is realized, and a basic evaluation of communication quality is provided.

[0007] Patent Document 2 discloses a wireless communication method between mobile terminals using visible light and a mobile terminal. The method includes periodically transmitting a device search signal for searching for a visible light communication device when there is a request for visible light communication; transmitting only a reference clock signal during the device search signal; connecting a link to the receiving terminal to transmit data when a response signal to the device search signal is received from the receiving terminal and comprises.

Prior Art Documents

Patent Documents

[0008]

Patent Document 1

Patent Document 2

Non-Patent Documents

[0009]

Non-Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0010] It is an object of the present invention to at least somewhat reduce the disadvantages associated with information transmission between an information source and an information transmission destination. In particular, the present invention provides high-speed and robust information transmission between an information source and an information transmission destination.

Means for Solving the Problems

[0011] In a first aspect of the present invention, there is provided a method for transmitting at least two binary values from an information source to an information transmission destination, the method including the steps recited in claim 1. Further features and embodiments of the method of the present invention are recited in the dependent patent claims.

[0012] The present invention relates to a method for transmitting a binary data sequence including at least two binary values from an information source to an information transmission destination. The method includes the following steps. 1) A step of determining a line code representation based on the binary data sequence. Here, the clock used when determining the line code representation based on the binary data sequence is recoverable from the line code representation. 2) Transmitting the line code representation using a light source. At this time, modulating the emission intensity of the light source based on the line code representation. 3) Capturing the line code representation transmitted by light using an event camera. Here, the event camera is configured to generate an event (event) based on the intensity change of the captured line code representation transmitted by light. 4) Determining a binary data sequence restored based on the generated event. Here, the determination of the restored binary data sequence includes restoring a clock based on the generated event and measuring at least one time difference between the generated events using the restored clock.

[0013] The term "binary data sequence" may refer to a sequence of all temporally discretized and quantized data. And those data sequences can be converted without information loss into a binary data sequence with "1" and "0" entries. The term "line code representation" may refer to a representation transmitted through a physical channel, particularly an optical channel. In such a case, the term "line code representation" may refer to a representation whose amplitude is quantized but is temporally continuous, for example. The line code representation may be adapted to the physical channel through which it is transmitted. For example, in a noisy channel, a line code representation with fine amplitude quantization may not be more noise-resistant (lower robustness) than a line code representation with coarse amplitude quantization. The line code representation may further be adapted to the available bandwidth of the physical channel. For example, when the bandwidth is limited, the information of the line code representation may not be encoded in a too-steep gradient of the line code representation.

[0014] The information source and the information transmission destination may not be actively synchronized with each other. The line code representation used is such that the clock used when encoding a binary data sequence (or a processed form of the binary data sequence) into the line code representation based on the line code representation can be faithfully restored even when the interval during which the same binary value is transmitted on the physical channel becomes long. By observing the line code representation (each appropriately sampled version of the line code representation), the information transmission destination may synchronize its clock with the clock of the information source, for example, using a phase-locked loop, and thereby measure time in the same way as the information source does.

[0015] The line code representation is transmitted, for example, via an optical channel embodied as a broadcast or dedicated cable. The line code representation may be transmitted, for example, by a blinking LED. If the line code representation has, for example, only two possible magnitude values, the LED may turn on for one of the two possible magnitude values and turn off for the other of the two possible magnitude values. Thus, the information present in the original binary data sequence may be temporarily encoded in the sequence of LED blinks.

[0016] The transmitted line code representation is captured by an event camera. The event camera may comprise an array of pixels that operate independently of each other. Each pixel typically generates an event when the intensity of the light hitting its photosensitive area changes. The event may represent either or both an increase and a decrease in intensity. In addition to the desired optical transmission line code representation hitting the event camera, changes in background light or other light sources may also lead to events generated by the event camera. Therefore, it can be assumed that the information transmission destination knows which encoding method the information source is using when deriving the line code representation from the binary data sequence. In this way, the information transmission destination can implement appropriate (frequency) filtering to separate events corresponding to the desired optical transmission line code representation from generally undesirable events caused by other light changes. Events corresponding to the line code representation are used for the information receiver to synchronize with the clock of the information source. When the line code representation has, for example, a binary data sequence encoded in periodically spaced rising or falling edges (gradients), the rising or falling events are also usually generated by an event camera. The clock of the information receiver can be synchronized to such periodically occurring events. Subsequently, the binary data sequence may be restored by the information receiver. For this purpose, at least one time difference between events may be determined, and at least one time difference may be determined between events of opposite polarities (corresponding to an increase or decrease in intensity).

[0017] In one embodiment of the method according to the invention, the binary data sequence is corrected using an error correction code before determining the line code representation based on the binary data sequence (binary data string).

[0018] The information source may apply error correction techniques to the binary data sequence before determining the line code representation so that the information receiver can at least partially remove potential errors in the restored binary data sequence, thereby bringing the restored binary data sequence closer to the binary data sequence. Possible error correction techniques include, for example, checksums. However, other error correction techniques are also possible.

[0019] In yet another embodiment of the method according to the invention, the line code representation determined based on the binary data sequence is a Manchester code representation.

[0020] In Manchester coding, information is encoded in the edges of the line code representation located at the center of the underlying clock period. Therefore, the recipient of the information can recover (recover) the binary data sequence based on these events (measuring the intensity with polarity, i.e., an increase or decrease in intensity) that are periodically spaced at the center of the underlying clock period.

[0021] In yet another embodiment of the method according to the invention, the determined line code representation based on the binary data sequence associates (maps) at least one group of binary values of the binary data sequence to at least one group of transmission binary values respectively.

[0022] In addition to Manchester coding or its modifications, more general line coding schemes may be used, for example, associating m data bits of a binary data sequence with n line bits, and then using it, for example, to define a control signal for a light source that optically transmits the line code representation.

[0023] In yet another embodiment of the method according to the invention, a prefix binary data sequence is appended before the binary data sequence.

[0024] To notify the information recipient that data transmission will start soon, the information source may append a prefix binary data sequence to the beginning of the binary data sequence. If the prefix binary data sequence is also known to the information recipient, the information recipient can know when the actual data transmission will start by such a prefix binary data sequence.

[0025] In yet another embodiment of the method according to the invention, the line code representation comprises at least one fundamental frequency at which information related to the binary data sequence is transmitted, and the determination of the restored binary data sequence comprises frequency filtering the generated events to determine events temporally separated from each other in at least one fundamental period corresponding to the at least one fundamental frequency.

[0026] If the information is transmitted at periodic points in time (e.g., halfway through the basic clock period in the case of Manchester encoding), each of the at least one fundamental periods corresponds to the at least one fundamental frequency. Frequency filtering may be performed to separate such periodically occurring events from false events, for example due to changes in background light. The frequency filtering may proceed as follows. That is, the information destination may know the fundamental frequency f at which the information is transmitted by the information source. Also, the information destination may set a Gaussian distribution centered on the corresponding fundamental period, having a variance determined by the known characteristics of the particular event camera being used. The probability of the time difference between the generated events based on the set Gaussian distribution may be evaluated, thereby determining the likelihood that a particular pair of events corresponds to the information transmitted by the information source.

[0027] In yet another embodiment of the method according to the invention, the binary data sequence is an identifier sequence that encodes identity information about the information source.

[0028] The detected identifier sequence may affect the operation of the information destination, for example, in an authentication application. The information destination may also start further processing, i.e., "activate", after detection of the identifier sequence.

[0029] In a further embodiment of the method according to the invention, a second binary data sequence is transmitted from the information source to the information destination at least partly in parallel with the transmission of the binary data sequence.

[0030] While transmitting a binary data sequence, the information source may transmit a second binary data sequence independent of the binary data sequence to the information transmission destination. The information source may further transmit an independent binary data sequence to the information transmission destination. The second (and potentially further) binary data sequences may be transmitted to the information transmission destination in the same way as the binary data sequence.

[0031] Furthermore, in an embodiment of the method according to the present invention, a second line code representation based on the binary data sequence is determined, and the second line code representation is such that the second clock used to determine the second line code representation based on the second binary data sequence is recoverable from the second line code representation, and the second line code representation is optically transmitted using a light source or a second light source, and the optically transmitted second line code representation is captured by an event camera.

[0032] To transmit the second line code representation, a second light source different from the light source used to transmit the line code representation may be used. The second light source may be physically separated from the light source. For the separated second light source, events generated by the event camera may be clustered into a group corresponding to the light source and a group corresponding to the second light source based on a spatial or temporal reference. If the light source can emit light independently at multiple wavelengths, for example, the same light source may be used to emit both the line code representation and the second line code representation at different wavelengths. By using a color filter (e.g., one embodied as a Bayer pattern) in the event camera, the line code representation and the second line code representation may be separated. If multiple light sources are available, the information source may transmit information to the information destination using spatial encoding. Different data may be transmitted to the information destination depending on which light source is on or off at a particular instant. The second clock may be the same as the clock used when encoding the binary data sequence into the line code representation. Alternatively, it may be a different clock or a clock derived from the clock encoding the binary data sequence.

[0033] In a further embodiment of the method according to the invention, the second line code representation comprises at least one fundamental frequency and at least one second fundamental frequency that is at least partially different.

[0034] Therefore, the information in the second binary data sequence may be transmitted at a different rate compared to the information transmitted in the binary data sequence. Such knowledge may be used by the information destination to separate events corresponding to the binary data sequence from events corresponding to the second binary data sequence.

[0035] Furthermore, in one aspect of the invention, an assembly is provided that comprises an information source, a light source, an event camera, and an information destination, and the assembly is made to implement the method according to the invention.

[0036] The information source and the light source may be embodied as separate physical entities or provided as a single physical object. The information source may correspond to software operating on a computing device (computer device) of the information source, and the information destination may correspond to software operating on a computing device. Alternatively, one or both of the information source and the information transmission destination may be embodied as dedicated hardware, such as, for example, an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA). In addition to optical transmission of the line code representation (or an additional line code representation, such as a second line code representation), no further information exchange needs to take place between the information source and the information transmission destination.

[0037] In an embodiment of the assembly according to the invention, the information transmission destination is embodied as a computing device, in particular as a microprocessor, and the information source is embodied as one of the following: 1) A traffic signal control unit, or 2) An automotive lighting control unit, or 3) A control unit for an active marker for robot tracking, or 4) A docking station control unit for at least one of space applications, logistics applications, and robot applications, or 5) A landing control unit for one or both of an aircraft and a drone, or 6) A survey calibration system, in particular one using a total station, or 7) A wearable device or a portable device worn by a human or an animal.

[0038] However, the method according to the invention may also be applied to other use cases and applications. As a logistics application, instead of using QR codes at known positions in a warehouse to locate robots in the warehouse, the method according to the invention may be used.

[0039] Furthermore, in an embodiment of the assembly according to the invention, the light source is embodied as a light emitting diode (LED), the light source is at least one of infrared (IR), visible light, and ultraviolet light, a color filter or a polarization filter is attached to one or both of the light source and the event camera, and the assembly is adapted to perform multispectral sensing. is at least any one of (any one, any combination, or all may be possible) among them.

[0040] Furthermore, in an embodiment of the assembly according to the present invention, the light source has a shape such that the direction of the light source with respect to the event camera can be estimated based on an event that occurs while the optical transmission of the distance and direction of the line code representation of the light source is being performed while the event camera is capturing the light source.

[0041] In yet another aspect of the present invention, a computer program product comprising program code is provided. The computer program product is adapted to receive input events generated by an event camera that captures a light source for optical transmission of a line code representation. When this program code is executed on a computing device, it causes the computing device to perform the following processes. Determine a binary data sequence restored based on the received events. Here, the determination of the restored binary data sequence includes restoring a clock based on the received events and measuring at least one time difference between the received events using the restored clock.

[0042] Exemplary embodiments of the present invention are disclosed in the description and illustrated in the drawings.

Brief Description of the Drawings

[0043]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

DETAILED DESCRIPTION OF THE INVENTION

[0044] FIG. 1 schematically shows the operation of an event camera observing a blinking light-emitting diode (LED). In the illustrated example, the LED periodically switches between on and off. The event camera of this embodiment is configured to generate events with polarity. When the LED emits light and the event camera captures it, if the intensity is increasing, it corresponds to an event with polarity "1", and when the LED emits light and the event camera captures it, if the intensity is decreasing, it corresponds to an event with polarity "-1". Generally, a blinking LED emits light in all directions. Therefore, a plurality of pixels of the event camera can each independently generate an event, and each generated event may be tagged with the pixel that generated it, the time it was generated, and an identifier explaining the polarity.

[0045] FIG. 2 schematically shows the assembly according to the present invention. In FIG. 2, an information source 1, a light source 2, an event camera 3, and an information transmission destination 4 are shown. The light source 2 is adapted to transmit a line code representation to the event camera 3. The light source 2 transmits via a physical channel 5 affected by noise 6. The currently understood noise 6 may refer to light emitted from other light sources that collide with the photosensitive area of the event camera 3. However, noise may also occur within the event camera itself. The light source 2 is controlled by the information source 1 and is instructed to transmit a line code representation corresponding to a binary data sequence to the light source 2.

[0046] FIGS. 3 to 7 schematically show different embodiments of the assembly according to the present invention. Figure 3 shows an embodiment in which the information source 1 controls the traffic signal 2. The information source 1 may be separate from the traffic signal 2 or may be a part of the traffic signal 2. The event camera 3 is configured to observe the flashing traffic signal 2 and provide events to the information transmission destination 4. Figure 4 shows another embodiment in which the light source 2 is embodied as the vehicle light 2 of a vehicle. The information source 1 may again be a part of the vehicle equipped with the vehicle light 2, or the information source 1 may be separate from the vehicle. The event camera 3 may be a part of another vehicle or may be attached to another object within the environment in which the vehicle travels. Figure 5 shows another embodiment in which the light source 2 is embodied as an active marker 2 configured to flash based on an input provided from the information source 1. Figure 6 shows another embodiment in which the light source 2 is a part of the docking station 2. The docking station 2 may emit a light flash, for example, to support a robot during docking. Figure 7 shows a total station 2 (such as a surveying instrument) that emits light for environmental survey. The light flash emitted by the total station 2 may be observed by the event camera 3.

[0047] Therefore, the information source may be embodied as any of the following. 1) A traffic signal control unit (corresponding to the light source) that controls the operation of the traffic signal, or 2) A vehicle lighting control unit (corresponding to the light source) that controls the operation of the vehicle lighting, or 3) An active marker control unit for robot tracking (where the active marker corresponds to the light source and emits a line code representation), or 4) A docking station control unit (for at least one of space applications, logistics applications, and robot applications) where the docking station is equipped with a light source, or 5) A landing control unit for one or both of an aircraft and a drone (connected to a light source in the air or on the ground), or 6) A survey calibration system (especially one using a total station), or 7) A wearable device or a portable device attachable to a human or an animal.

[0048] Figure 8 schematically shows the method according to the present invention. This method starts with having a binary data sequence 7. In the first step, based on the binary data sequence 7, a line code representation is determined 8. In the second step, using a light source, the line code representation is optically transmitted 9. In the third step, using an event camera, the optically transmitted line code representation is captured 10. The event camera generates events. In the fourth step, based on the generated events, a restored binary data sequence 12 is determined 11. The present application provides, for example, the following viewpoints. [Viewpoint 1] A method for transmitting a binary data sequence (7) having at least two binary values from an information source (1) to an information transmission destination (4), the method comprising 1) A step (8) of determining a line code representation based on a binary data sequence (7), wherein the line code representation is such that a clock used for determining the line code representation based on the binary data sequence (7) is recoverable from the line code representation, the step (8) of determining the line code representation; 2) A step (9) of optically transmitting the line code representation using the light source (2) by adjusting the emission intensity of the light source (2) based on the line code representation; 3) A step (10) of capturing the optically transmitted line code representation using an event camera (3), wherein the event camera (3) is configured to generate an event based on an intensity change when capturing the optically transmitted line code representation, the step (10) of capturing the line code representation; 4) A step (11) of determining a restored binary data sequence (12) based on the generated event; The step of determining the restored binary data sequence (12) comprises the steps of restoring a clock based on the generated event and measuring at least one time difference between the generated events using the restored clock; The step (11) of determining the restored binary data sequence (12), wherein at least one time difference is used for restoring the binary data sequence (7); A method for transmitting the binary data sequence (7), comprising the above steps. [Aspect 2] The method according to Aspect 1, wherein the binary data sequence (7) is corrected using an error correction code before determining the line code representation based on the binary data sequence (7). [Aspect 3] The method according to Aspect 1 or 2, wherein the determined line code representation based on the binary data sequence (7) is a Manchester code representation. [Aspect 4] The method according to Aspect 1 or 2, wherein the determined line code representation based on the binary data sequence (7) associates at least one binary value group of the binary data sequence (7) with at least one transmission binary value group respectively. [Aspect 5] The method according to any one of Aspects 1 to 4, wherein a prefix binary data sequence is added to the beginning of the binary data sequence (7). [Aspect 6] The line code representation includes at least one fundamental frequency for transmitting information related to the binary data sequence (7), and determining the restored binary data sequence (12) comprises frequency filtering the generated events to determine events temporally separated from each other by at least one fundamental period corresponding to at least one fundamental frequency. The method according to any one of aspects 1 to 5. [Aspect 7] The method according to any one of aspects 1 to 6, wherein the binary data sequence (7) is an identifier sequence encoding identity information of the information source (1). [Aspect 8] The method according to any one of aspects 1 to 7, wherein a second binary data sequence is transmitted from the information source to the information transmission destination (4) at least partly in parallel with the transmission of the binary data sequence (7). [Aspect 9] A second line code representation is determined based on the binary data sequence (7), the second line code representation is such that a second clock used for determining the second line code representation based on the second binary data sequence is recoverable from the second line code representation, the second line code representation is optically transmitted using the light source (2) or a second light source as the light source, the optically transmitted second line code representation is captured by the event camera (3). The method according to aspect 8. [Aspect 10] The method according to aspect 8 or 9, wherein the second line code representation includes at least one second fundamental frequency, and at least a part of the at least one second fundamental frequency is different from the at least one fundamental frequency. [Aspect 11] An assembly comprising an information source (1), a light source (2), an event camera (3), and an information transmission destination (4), the assembly being made to execute the method according to any one of aspects 1 to 10. [Aspect 12] The information transmission destination (4) is embodied as a computing device, in particular a microprocessor, The information source (1) is as follows 1) a traffic signal control unit, or 2) an automotive lighting control unit, or 3) an active marker control unit for robot tracking, or 4) a docking station control unit for at least any one of space applications, logistics applications, and robot applications, or 5) a landing control unit for both or one of an aircraft and a drone, or 6) A calibration system for measurement, in particular one using a total station, or 7) A wearable device or a portable device to be worn by a human or an animal The assembly according to aspect 11, embodied as either of the above. [Aspect 13] The light source (2) is embodied as a light-emitting diode (LED), and The light source (2) is at least one of a light source for infrared (IR), visible light, and ultraviolet light, and A color filter or a polarizing filter is attached to both or one of the light source (2) and the event camera (3), and The assembly is adapted to perform multispectral sensing The assembly according to aspect 11 or 12, being at least one of the above. [Aspect 14] Based on an event generated when the event camera (3) captures the light source (2) while the light source (2) is performing optical transmission in line code representation, the distance of the light source (2) and the direction of the light source (2) with respect to the event camera (3) are estimable, the assembly according to any one of aspects 11 to 13. [Aspect 15] A computer program product is adapted to receive, as an input, an event generated by the event camera (3) capturing the light source (2) while the light source (2) is performing optical transmission in line code representation, and Program code executed on a computing device causes the computing device to Determine a binary data sequence restored based on the received event, and determining the restored binary data sequence (12) includes restoring a clock based on the received event and measuring at least one time difference between the received events using the restored clock, and The at least one time difference is used for restoring the binary data sequence (7), determining the restored binary data sequence (12) The computer program product comprising the program code is caused to perform the above.

Claims

1. A method for transmitting a binary data sequence (7) having at least two binary values from an information source (1) to an information transmission destination (4), the method comprising: 1) a step (8) of determining a line code representation based on the binary data sequence (7), wherein the line code representation is such that a clock used for determining the line code representation based on the binary data sequence (7) is recoverable from the line code representation, the step (8) of determining the line code representation; 2) a step (9) of optically transmitting the line code representation using the light source (2) by adjusting the emission intensity of the light source (2) based on the line code representation; 3) a step (10) of capturing the optically transmitted line code representation using an event camera (3), wherein the event camera (3) is configured to generate an event based on an intensity change when capturing the optically transmitted line code representation, the step (10) of capturing the line code representation; 4) a step (11) of determining a restored binary data sequence (12) based on the generated event, The step of determining the restored binary data sequence (12) includes a step of restoring a clock based on the generated event and measuring at least one time difference between the generated events using the restored clock, The step (11) of determining the restored binary data sequence (12), wherein at least one time difference is used for restoring the binary data sequence (7); The method for transmitting the binary data sequence (7).

2. The method according to claim 1, wherein the binary data sequence (7) is corrected using an error correction code before determining the line code representation based on the binary data sequence (7).

3. The method according to claim 1 or 2, wherein the determined line code representation based on the binary data sequence (7) is a Manchester code representation.

4. The method according to claim 1 or 2, wherein the determined line code representation based on the binary data sequence (7) associates at least one binary value group of the binary data sequence (7) with at least one transmission binary value group respectively.

5. The method according to any one of claims 1 to 4, wherein a prefix binary data sequence is added to the beginning of the binary data sequence (7).

6. The line code representation comprises at least one fundamental frequency at which information related to the binary data sequence (7) is transmitted, and determining the restored binary data sequence (12) comprises frequency filtering the generated events to determine events temporally separated from each other by at least one fundamental period corresponding to the at least one fundamental frequency. The method according to any one of claims 1 to 5.

7. The method according to any one of claims 1 to 6, wherein the binary data sequence (7) is an identifier sequence encoding identity information of the information source (1).

8. The method according to any one of claims 1 to 7, wherein a second binary data sequence is transmitted from the information source to the information transmission destination (4) at least partly in parallel with the transmission of the binary data sequence (7).

9. A second line code representation is determined based on the binary data sequence (7), the second line code representation is such that a second clock used for determining the second line code representation based on the second binary data sequence is recoverable from the second line code representation, the second line code representation is optically transmitted using the light source (2) or a second light source as the light source, the optically transmitted second line code representation is captured by the event camera (3). The method according to claim 8.

10. The method according to claim 8 or 9, wherein the second line code representation comprises at least one second fundamental frequency, and at least part of the at least one second fundamental frequency is different from the at least one fundamental frequency.

11. An assembly comprising an information source (1), a light source (2), an event camera (3), and an information transmission destination (4), the assembly being configured to perform the method according to any one of claims 1 to 10.

12. The information transmission destination (4) is embodied as a computing device, in particular a microprocessor, and the information source (1) is as follows 1) a traffic signal control unit, or 2) an automotive lighting control unit, or 3) An active marker control unit for robot tracking, or 4) A docking station control unit for at least one of space applications, logistics applications, and robot applications, or 5) A landing control unit for both or either of an aircraft and a drone, or 6) A calibration system for surveying, particularly one using a total station, or 7) A wearable device or a portable device worn by a human or an animal The assembly according to claim 11, embodied as any one of the above.

13. The light source (2) is embodied as a light-emitting diode (LED), and The light source (2) is at least one of a light source for infrared (IR), visible light, and ultraviolet light, and A color filter or a polarizing filter is attached to both or either of the light source (2) and the event camera (3), and The assembly is adapted to perform multispectral sensing The assembly according to claim 11 or 12, which is at least one of the above.

14. The light source (2) is made to be able to estimate the distance of the light source (2) and the direction of the light source (2) with respect to the event camera (3) based on events generated when the event camera (3) captures the light source (2) while the light source (2) is performing optical transmission in line code representation. The assembly according to any one of claims 11 to 13.

15. A computer program product is made to receive, as an input, events generated by an event camera (3) capturing a light source (2) while the light source (2) is performing optical transmission in line code representation, and Program code executed on a computing device causes the computing device to perform the following: Determining a binary data sequence restored based on the received events, where determining the restored binary data sequence (12) includes restoring a clock based on the received events and measuring at least one time difference between the received events using the restored clock, and Using the at least one time difference for restoring the binary data sequence (7). The computer program product comprising the program code that causes the above to be performed.

Images