METHOD FOR IMPLEMENTING OPTICAL COMMUNICATION USING A LIDA FIELD SYSTEM

The lidar field system integrates scanning and optical communication using an array of lasers for secure, high-speed data transmission, addressing the lack of communication capabilities in existing lidar systems.

DE102016108415B4Active Publication Date: 2024-12-05GM GLOBAL TECHNOLOGY OPERATIONS LLC
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
DE102016108415
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Priority Date
2016-05-04
Filing Date
2016-05-06
Publication Date
2024-12-05
Estimated Expiration
2036-05-06

AI Technical Summary

Technical Problem

Existing lidar systems primarily focus on scanning and target tracking, lacking effective methods for integrated optical communication.

Method used

A lidar field system utilizing an array of lasers for both scanning and communication, enabling point-to-point optical communication with secure, high-data-rate transmission through modulated optical signals.

Benefits of technology

Enables secure, high-speed optical communication between platforms, supporting applications like vehicle-to-vehicle communication, pedestrian safety, and integrated scanning, with data rates up to 40 gigabits per second and low latency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Method for performing optical communication using a lidar field system (100) comprising several illumination devices in the form of lasers (111) on a platform (400), wherein the method comprises: Rays (210) are emitted from a first set of several lighting devices; Reflections resulting from the beams are received to perform target detection; modulated optical signals (310) are emitted from a second set of several lighting devices; and the modulated optical signals (310) are received in order to perform optical communication; characterized by , that the first set of multiple lighting devices and the second set of multiple lighting devices are an identical set of multiple lighting devices, wherein the emission of the beams (210) is carried out during a first time interval and the emission of the modulated optical signals (310) is carried out during a second time interval that differs from the first time interval, wherein the first time interval comprises a first temporal instance in which the beams (210) are emitted by at least one laser (111) and a second temporal instance in which the beams (210) are emitted by at least one other laser (111), and wherein the second time interval comprises a first temporal instance in which the modulated optical signals (310) are emitted by at least one laser (111) and a second temporal instance,in which the modulated optical signals (310) are emitted by at least one other laser (111), or , that the first set of multiple lighting devices is a different set of multiple lighting devices than the second set of multiple lighting devices, the emission of the beams (210) and the emission of the modulated optical signals (310) are carried out simultaneously, wherein during a first temporal instance the beams (210) are emitted by a first laser (111) and the modulated optical signals (310) are emitted by a second laser (111), and during a second temporal instance the beams (210) are emitted by a third laser (111) and the modulated optical signals (310) are emitted by the second laser (111), and the emission of the beams (210) is carried out with a different wavelength than the emission of the modulated optical signals (310).
Need to check novelty before this filing date? Find Prior Art

Description

AREA OF INVENTION

[0001] The present invention relates to a method according to the preamble of claim 1 for performing optical communication using a lidar field system, as is known essentially from US 2015 / 0 088 373 A1. A method of an essentially comparable nature is disclosed in US 2008 / 0 208 472 A1. BACKGROUND

[0002] Lidar, which can be described as light radar or light detection and distance measurement using a laser field, generally refers to the emission of light onto an object and the reception and processing of the resulting reflection. In a lidar field system, a field of lasers can be used to obtain reflections from a larger field of view than is possible with a single laser. The lidar field system enables the scanning and tracking of a target. Furthermore, it is desirable to provide communication capabilities with the lidar field system. SUMMARY OF THE INVENTION

[0003] According to the invention, a method for performing optical communication using a lidar field system is presented, characterized by the features of claim 1.

[0004] The foregoing features and advantages and other features and advantages of the invention will become readily apparent from the following detailed description of the invention when read in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0005] Other features, advantages and details are only shown as examples in the following detailed description of embodiments, the detailed description referring to the drawings in which: Fig. 1 a block diagram of an exemplary lidar field system in accordance with embodiments; Fig. 2 shows an exemplary pulse pulse emitted by a laser of the lidar field of the lidar field system in accordance with embodiments; Fig. 3 exemplary optical signals are shown that are used for communication by a laser of the lidar field of the lidar field system in accordance with embodiments; Fig. 4 shows a platform of the lidar field system in accordance with an embodiment; Fig. 5 shows an exemplary scenario in which, in accordance with embodiments, detection and communication are carried out by the lidar field system; and Fig. Six exemplary emissions from a lidar field in accordance with embodiments are shown. DESCRIPTION OF THE EXECUTION FORMS

[0006] As mentioned above, the lidar field system enables scanning, target tracking, and other detection and monitoring activities. Embodiments of the systems and methods described herein relate to the additional use of the lidar field system for communication. In an exemplary automotive application, communication can occur between a vehicle equipped with a lidar field system and another vehicle, a pedestrian, a mast, or anything else that also contains a lidar field or an optical communication system. The scanning and communication functions can be performed sequentially or simultaneously. According to one embodiment, some of the lasers in the field can perform the scanning functions while other lasers in the field perform communication functions simultaneously.In accordance with another embodiment, all lasers can be engaged in scanning functions for a period of time, and then all lasers can be engaged in communication functions for a further period of time. The wireless communication enabled by the lidar field system is more secure than communication via a cellular network or other conventional wireless networks because the communication is point-to-point. The lidar field system can be used, for example, to transmit audio, video, and images at rates of 40 gigabits per second (GBPS). The low latency enables security communication applications. In accordance with alternative embodiments, communication via the lidar field system can be stand-alone or occur in conjunction with another system.This means, for example, that a mobile network or other communication network can be used to establish communication, which is then transmitted to the lidar field system. A communication device can be used to coordinate communication between lidar field systems. The communication device can, for example, coordinate identity information, timing information, and protocol information.

[0007] Fig. Figure 1 is a block diagram of an exemplary lidar field system 100 in accordance with embodiments. It should be clear that none of the figures herein are to scale and are not intended to convey any limitation of size or relative size. Although for illustrative purposes lasers 111 are specifically discussed as part of the lidar field system 100, other illumination devices (e.g., light-emitting diodes (LEDs)) may also be used. The lidar field 110 refers to an arrangement of two or more lasers 111 in a field such that their emissions form a field of view 135. The Fig. Figure 1 shows an exemplary lidar field system 110 containing two rows of five lasers 111 each. The perspective top view, which illustrates the emission from the lidar field 110, shows the five emitted signals 126 (laser beams) resulting from one row of lasers 111. The in Fig. The exemplary lidar field system 100 shown in Figure 1 includes a semipermeable mirror 115 that focuses light from each laser 111 of the lidar field 110 through a lens 125. The lens 125 spreads the laser beam emitted by each of the lasers 111 of the lidar field 110 across the field of view 135. The exemplary lidar field system 100 can include additional known components (e.g., laser diodes) that are well known and can be used to control the output of one or more of the lasers 111. An array 120 of optical detectors receives reflections resulting from the signals 126 emitted by the lidar field 110. In accordance with alternative embodiments, the field 120 of optical detectors may contain a single detector or two or more detectors, and it may or may not contain the same number of detectors as laser 111 in the lidar field 110.Each of the one or more detectors of the field 120 from optical detectors receives the reflections that result from an emission by any of the lasers 111.

[0008] A controller or processing system 130 can include one or more processors 131 and one or more storage devices 132 together with other known components to control the emission of each of the lasers 111 of the lidar field 110 and the processing of reflections received by the field 120 from optical detectors in accordance with embodiments. The processing system 130 can control typical lidar operation as well as communication with the lidar field 110. In alternative embodiments, the processing system 130 can be part of the control system of a platform (e.g., a vehicle, a ship, a construction device) on which the lidar field system 100 is installed. Fig. As shown in Figure 1, the lidar field 110 can be used to scan the field of view 135 in both azimuth 112 and elevation 113. Furthermore, each laser 111 provides a distance to a target 410 ( Fig. 4) in the field of view 135. Therefore, the lidar field 110 can provide a three-dimensional image in which every reflection resulting from every emission of an impulse pulse 210 ( Fig. 2) by a laser 111 in the emitted signal 126, which can be interpreted as pixels in the image. The embodiments described in detail below relate to controlling the lidar field 110 to detect and track targets 410, as well as to perform communication in accordance with various scenarios.

[0009] Fig. Figure 2 shows an exemplary pulse 210 emitted by a laser 111 of the lidar field 110 of the lidar field system 100 in accordance with embodiments. The emission power 205 is shown as either switched on (a value of 1) or switched off (a value of 0). The time 215 is shown, for example, in milliseconds. The duration of the pulse 210 determines the distance resolution for detecting a target 510 ( Fig. 5).

[0010] For target detection purposes, the emitted pulse pulses 210 are reflected back, and the round-trip time for the pulse pulses 210 is used to determine the distance, velocity, and direction of the target 510. Since each detector in the field 120 receives reflections from optical detectors that are associated with all lasers 111, a beam pattern can be chosen to distinguish the reflections associated with each of the lasers 111 in the lidar field 110. For example, a time-division multiple access (TDMA) pattern can be used, such that each laser 111 emits at a time shifted from the time of emission by another laser 111. Because all lasers 111 in the lidar field 110 emit sequentially, the entire field of view 135 can be scanned over a period of time.In alternative embodiments, two or more lasers 111 can be controlled to emit simultaneously, and the reflections resulting from the emissions of the two or more lasers 111 can be processed together. Emissions can be controlled as needed by other patterns of lasers 111 to scan or track targets 510.

[0011] Fig. Figure 3 shows exemplary optical signals 310 that are used for communication by means of a laser 111 of the lidar field 110 of the lidar field system 100 in accordance with embodiments. In accordance with embodiments herein, an emission from one or more of the illumination devices (e.g. the laser 111) can be received by an optical detector or a field 120 of detectors, instead of simply being emitted by a target 510 ( Fig. 5) is reflected. The field 120 of optical detectors, which receives a communication from a laser 111, can be part of another lidar field system 100 on another platform 400 ( Fig. 4) be, or it can be a purely receiving system. As further discussed below, a receiving array 130 consisting of optical detectors can also be a target 510 ( Fig. 5) whether or not it is detected or tracked by the lidar field system 100. Since the lasers 111 have a unidirectional emission (rather than a multidirectional or omnidirectional emission), communication between a lidar field system 100 and a field 120 of optical detectors (on another platform 400) is point-to-point communication via direct optical coupling. Consequently, the communication is more secure than multidirectional or omnidirectional communication because another receiver not targeted by the emitting radar field system 100 cannot simply intercept the pulse 210 by also receiving the emission. The types of information that can be emitted by the lasers 111 include audio, video, and still images, as the data rate is on the order of 40 gigabits per second (GBPS).The communication involves the use of modulated optical signals, and known modulation schemes, such as those used in radar systems, can be used on an optical carrier signal.

[0012] Fig. Figure 3 shows exemplary optical signals 310a to 310d (generally referred to as 310). The modulated optical signals 310b to 310d are obtained by known modulation techniques, and one or more parameters (e.g., amplitude, frequency, phase) can be modulated as needed in a manner similar to radio frequency signals. For example, a known laser diode can be coupled to the lidar array 110 to modulate the current that drives the illumination device (e.g., laser 111). Optical signal 310a is not modulated, while optical signal 310b is obtained by an on-off switch (OOK). An amplitude shift keying (ASK) operation is performed on the unmodulated optical (carrier) signal 310a to obtain the optical signal 310c, and a phase shift keying (PSK) operation is performed on the carrier signal to obtain the optical signal 310d.In the case of the modulated optical signals 310b, 310c, 310d, the code 320, which corresponds to each section of the optical signals 310b to 310d, is in . Fig. 3 is displayed. The section of optical signals 310b to 310d corresponding to code 320a displays a “0”, and the section corresponding to code 320b displays a “1”. The optical signals 310, used for communication, may have different wavelengths than the pulse bursts 210, used for target detection and tracking 510 ( Fig. 5) can be used.

[0013] Fig. Figure 4 shows a platform 400 of the lidar field system 100 in accordance with one embodiment. The exemplary platform 400 is a vehicle 410. As mentioned above, in alternative embodiments, the platform 400 can be construction equipment, agricultural equipment, equipment in an automated manufacturing plant, or equipment in water or air. The vehicle 410 is shown with a lidar field 110 at both ends, but in additional or alternative embodiments, other arrangements of the lidar field 110 and additional lidar fields 110 are considered. The lidar field 110 can be controlled by the same or by different processing systems 130. The vehicle's controller 420 can manage systems of the vehicle 410, such as collision avoidance and steering control.In accordance with other embodiments, the controller 420 can additionally perform the functions of the processing system(s) 130 of the lidar field system 100, or it can be coupled to exchange information with the processing system(s) 130 that control the lidar fields 110. This means that the lidar field systems 100 can be integrated into or separate from the other processors of the platform 400. The vehicle 410 is shown with additional systems 430. Examples of the additional systems 430 include other sensors such as a camera or a radar system and other communication systems such as a mobile communication system. The camera can, for example, be used to identify targets 510 (. Fig. 5) can be used. The additional systems 430 (e.g. the mobile communication system) can help to establish communication between lidar fields 110 on different platforms 400.

[0014] Fig. Figure 5 shows an exemplary scenario in which detection and communication are carried out by the lidar field system 100 in accordance with embodiments. In the exemplary scenario, the platform 400 for the lidar field system 100 is a vehicle 410. As mentioned above, other platforms 400 are possible. As in Fig. Figure 4 shows two lidar arrays 110 at both ends of vehicle 410. As mentioned above, other or additional arrangements of lidar arrays 110 on platform 400 are being considered. Four targets 510a to 510d are shown (collectively designated 510). Fig. As indicated in Figure 5, targets 510a and 510d are vehicles 410 on the same road 505 as platform 400 and may also contain lidar field systems 100. Target 510b is a pedestrian who may be carrying or wearing a device with a lidar field system 100 or an optical detector 120 and a processor 130. Target 510c is a mast or tower and may also contain a lidar field system 100. Each of the targets 510 can be detected by the lidar field 110 of vehicle 410. Alternatively or additionally, each of the targets 510 can communicate with vehicle 410. Some exemplary scenarios in which detection or communication, or both, are performed by vehicle 410 are given with reference to Figure 5. Fig. 6 discussed. As mentioned above, an additional system 430 (e.g., a camera) can be used to identify a receiving lidar field system 100 (e.g., the target 510a with a lidar field system 100), and another additional system 430 (e.g., a cellular system) can be used to establish communication. Establishing communication can involve synchronizing the timing between the transmitting and receiving sides and coordinating a protocol and code to be used. Exemplary protocols include well-known communication protocols such as carrier sense multiple access with collision detection (CSMA-CD) or ALOHA. In accordance with a simple communication scheme, certain optical signals 310 can be associated with specific messages via a lookup table or other mapping.Speed ​​and security may make communication via the lidar field system 100 preferable after communication has been established using the mobile communication system.

[0015] The type of communication can depend on the target 510 with which the platform 400 communicates. For example, if a vehicle 410 communicates with another vehicle 510a or 510d, the communication can be linked to autosteering systems, collision avoidance systems, or other systems, and messages can be exchanged to ensure that the movement of each vehicle 410, 510a, 510d is expected by the others. As another example, if a vehicle communicates with a mast or tower 510c, the vehicle 410 can identify itself or provide information for tracking purposes in other ways. This also applies if the vehicle 410 communicates with a pedestrian 510b, cyclist, or other moving target 410 that is not necessarily on the road 505.As mentioned above, the pedestrian 510b (or cyclist) may not have a complete lidar field system 100, but instead only the field 120 consisting of optical detectors (which may be a single detector) and the processor 130. The vehicle 410 can communicate with the pedestrian 510b (e.g., a blind pedestrian) to provide information about the presence of the vehicle 410 on the road 505. This can, for example, assist the pedestrian 510b when crossing the road 505.

[0016] Fig.Figure 6 shows exemplary emission from a lidar array 110 in accordance with embodiments. The exemplary lidar array 110 is shown with sixteen lasers 111. Each of the exemplary sets of emission 600, 610 shows four temporal instances. Lasers 111 (or other types of illumination devices) operated for detection purposes are indicated by dots, and lasers 111 operated for communication purposes are indicated by stripes. In the set of emission 600, as shown, at each time a laser 111 is used to scan the field of view 135 for detection purposes. The scanning is shown across the top line of the lidar array 110, but it can be continued as shown. Simultaneously with the scanning, another laser 111 in the emission 600 is shown being operated for communication purposes.The laser 111 used for detection can emit at a different wavelength than the laser 111 used for communication, as mentioned above. In the set of emission patterns 610, detection or tracking and communication are not performed simultaneously. In the first two instances shown, communication is performed by a group of four lasers 111 in each instance. In the second two instances shown, detection is performed by a different row of lasers 111 in each instance. As the exemplary emission patterns 600 and 610 indicate, the detection or tracking of a target 510, which includes emitting a pulse pulse 210 and processing a resulting reflection, can be performed serially or simultaneously with communication via the emission of optical signals 310 using one or more lasers 111 of the lidar array 110.

Claims

[1] A method for performing optical communication using a lidar field system (100) comprising a plurality of illumination devices in the form of lasers (111) on a platform (400), the method comprising: beams (210) are emitted from a first set of said plurality of illumination devices; reflections resulting from the beams are received to perform target detection; modulated optical signals (310) are emitted from a second set of said plurality of illumination devices; and the modulated optical signals (310) are received to carry out the optical communication; characterized by , that the first set of the plurality of illumination devices and the second set of the plurality of illumination devices are a same set of the plurality of illumination devices, wherein the emission of the beams (210) is carried out during a first time period and the emission of the modulated optical signals (310) is carried out during a second time period that differs from the first time period, wherein the first time period comprises a first temporal instance in which the beams (210) are emitted by at least one laser (111) and a second temporal instance in which the beams (210) are emitted by at least one other laser (111), and wherein the second time period comprises a first temporal instance in which the modulated optical signals (310) are emitted by at least one laser (111) and a second temporal instance,in which the modulated optical signals (310) are emitted by at least one other laser (111), or, that the first set of the plurality of illumination devices is a different set of the plurality of illumination devices than the second set of the plurality of illumination devices, the emission of the beams (210) and the emission of the modulated optical signals (310) are carried out simultaneously, wherein during a first temporal instance the beams (210) are emitted by a first laser (111) and the modulated optical signals (310) are emitted by a second laser (111), and during a second temporal instance the beams (210) are emitted by a third laser (111) and the modulated optical signals (310) are emitted by the second laser (111), and the emission of the beams (210) is carried out at a different wavelength than the emission of the modulated optical signals (310). [2] The method of claim 1, further comprising coordinating a protocol for the modulated optical signals (310) based on an auxiliary device on the platform (400).

Citation Information

Patent Citations

  • Traffic Safety System

    US20080208472A1

  • Optical communications and obstacle sensing for autonomous vehicles

    US20150088373A1