Vehicle synchronization system and method, synchronization control panel, synchronization computer and vehicle

By using the signals provided by the GPS receiver and bus, the synchronization control panel triggers the vehicle sensor to acquire data, solving the problem of vehicle sensor synchronization, improving the accuracy and efficiency of data capture, and realizing the construction of high-definition maps.

CN118981202APending Publication Date: 2024-11-19BEIJING DIDI INFINITY TECH & DEV CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411026548.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2018-12-03
Publication Date
2024-11-19

AI Technical Summary

Technical Problem

The prior art is difficult to synchronize vehicle sensors and devices, especially when data acquisition, synchronization accuracy and efficiency are low, and hardware configuration is inflexible and difficult to scale.

Method used

The GPS receiver is used to provide reference timing signals and the bus provides vehicle speed signals. The trigger signal is determined through the synchronization control panel, and the trigger sensor acquires image and point cloud data to ensure that the data is captured at the same time.

Benefits of technology

It realizes efficient synchronization between vehicle sensors, improves the accuracy and aggregation efficiency of high-definition map data, and solves the problem that synchronization is difficult to achieve.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118981202A_ABST
    Figure CN118981202A_ABST
Patent Text Reader

Abstract

The embodiment of the invention discloses a vehicle synchronization system and method, a synchronization control panel, a synchronization computer and a vehicle. A vehicle synchronization system may include a bus configured to receive a vehicle speed signal and a synchronization control panel configured to receive a reference timing signal and determine a trigger signal for triggering at least one sensor based on the reference timing signal and the vehicle speed signal, the frequency of the trigger signal of each sensor is determined and adjusted based on the vehicle speed signal. Therefore, the embodiment of the invention can accurately synchronize the vehicle sensor.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application is a divisional application of a Chinese patent application filed on December 3, 2018, with application number 201880092869X, and invention name “System and method for synchronizing vehicle sensors and devices”. Technical Field

[0002] The present invention relates to the technical field of vehicles, and more particularly to a vehicle synchronization system, method, synchronization control panel, synchronization computer and vehicle. Background Art

[0003] Autonomous driving technology relies heavily on high-definition maps. For example, the accuracy of navigation maps is critical to the functions of autonomous vehicles, such as positioning, environmental recognition, decision-making, and control. High-definition maps can be obtained by gathering images and information acquired by various sensors, detectors, and other devices on the vehicle while the vehicle is driving. For example, a vehicle can be equipped with light detection and ranging (LiDAR) radars, cameras, global positioning systems (GPS), and inertial measurement units (IMUs), etc., to capture the location and characteristics of the road on which the vehicle is traveling or surrounding objects. The captured data can include, for example, the centerline coordinates or extended sideline coordinates of the lane, coordinates and images of targets such as landmarks or traffic signs.

[0004] In order to aggregate data captured by different sensors and devices, the data needs to be synchronized. For example, GPS coordinate data at a specific point in time must be registered with LiDAR images of surrounding objects taken at the same point in time in order to accurately locate the object on the map using GPS coordinates. Synchronization can be performed in two stages: the acquisition stage when the data is acquired, and the post-processing stage when the acquired data is processed and aggregated. Full synchronization in the post-processing stage is often less accurate and inefficient. Synchronization of sensors and devices during acquisition is often difficult to achieve. One existing approach uses custom-designed cameras, such as high-end models of panoramic cameras or binocular cameras with synchronization capabilities. However, due to the limited selection of such cameras, the hardware configuration is inflexible and difficult to expand. Another approach uses a trigger server to trigger sensors and devices through "soft" signals. This solution lacks accuracy or security. Therefore, there is a need for improved systems and methods for synchronizing vehicle sensors and devices in order to acquire synchronized data that can be aggregated later to create high-definition maps.

[0005] Embodiments of the present application solve the above-mentioned problems through systems and methods for synchronizing vehicle sensors and devices. Summary of the invention

[0006] In view of this, embodiments of the present invention provide a vehicle synchronization system, method, synchronization control panel, synchronization computer and vehicle to achieve synchronization between vehicle sensors.

[0007] An embodiment of the present application provides a vehicle synchronization system. The vehicle synchronization system may include a GPS receiver configured to provide a reference timing signal and a bus configured to provide a vehicle speed signal. The vehicle synchronization system may also include at least one sensor. The vehicle synchronization system may also include a synchronization control panel configured to determine a trigger signal based on the reference timing signal and the vehicle speed signal, and use the trigger signal to trigger at least one sensor to acquire at least two images.

[0008] The embodiment of the present application also discloses a method for synchronizing vehicle sensors. The method may include receiving a reference timing signal from a GPS receiver and receiving a vehicle speed signal from a bus. The method may also include: using a synchronization control panel, determining a trigger signal based on the reference timing signal and the vehicle speed signal, and using the trigger signal to trigger at least one sensor to obtain at least two images.

[0009] Embodiments of the present application also disclose a synchronization control panel. The synchronization control panel may include at least one input pin configured to receive a reference timing signal and a vehicle speed signal. The synchronization control panel may also include at least one output pin configured to provide a trigger signal to at least one sensor. The trigger signal may be determined based on the reference timing signal and the vehicle speed signal. The synchronization control panel may also include a feedback pin configured to provide a reference timing signal to a processor.

[0010] It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The above and other objects, features and advantages of the present invention will become more apparent through the following description of the embodiments of the present invention with reference to the accompanying drawings, in which:

[0012] Figure 1 According to an embodiment of the present application, a schematic diagram of an exemplary vehicle equipped with sensors is shown.

[0013] Figure 2 According to an embodiment of the present application, a schematic diagram of an exemplary vehicle synchronization system for synchronizing vehicle sensors is shown.

[0014] Figure 3 According to an embodiment of the present application, a schematic diagram of an exemplary synchronization control panel is shown.

[0015] Figure 4 According to an embodiment of the present application, an exemplary trigger signal synchronized using a reference timing signal is shown.

[0016] Figure 5According to an embodiment of the present application, a schematic diagram of an exemplary synchronization computer for synchronizing data acquired by vehicle sensors is shown.

[0017] Figure 6 According to an embodiment of the present application, a flow chart of an exemplary method for synchronizing vehicle sensors is shown. DETAILED DESCRIPTION

[0018] Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numerals will be used throughout the drawings to refer to the same or like parts.

[0019] Figure 1 According to an embodiment of the present application, a schematic diagram of an exemplary vehicle 100 having at least two sensors 141, 142 and 150 is shown. Consistent with some embodiments, vehicle 100 may be a survey vehicle configured to acquire data for building a high-definition map or data for three-dimensional (3-D) city modeling. It is contemplated that vehicle 100 may be an electric vehicle, a fuel cell vehicle, a hybrid vehicle, or a conventional internal combustion engine vehicle. Vehicle 100 may have a body 110 and at least one wheel 120. Body 110 may be any body type, such as a sports vehicle, a coupe, a sedan, a pickup truck, a station wagon, a sport utility vehicle (SUV), a minivan, or a convertible. In some embodiments, vehicle 100 may include a pair of front wheels and a pair of rear wheels, such as Figure 1 As shown. However, it is contemplated that the vehicle 100 may have more or fewer wheels or equivalent structures to enable the vehicle 100 to move around. The vehicle 100 may be configured as all-wheel drive (AWD), front-wheel drive (FWR), or rear-wheel drive (RWD). In some embodiments, the vehicle 100 may be configured to be operated by an operator occupying the vehicle, remotely controlled by an operator, and / or autonomously operated.

[0020] like Figure 1 As shown, vehicle 100 may be equipped with sensors 141 and 142 mounted to vehicle body 110 via mounting structure 130. Mounting structure 130 may be an electromechanical device mounted or otherwise attached to vehicle body 110 of vehicle 100. In some embodiments, mounting structure 130 may use screws, adhesives, or other mounting mechanisms. Vehicle 100 may be additionally equipped with sensor 150 inside or outside vehicle body 110 using any suitable mounting mechanism. It is contemplated that the manner in which sensors 141, 142, or 150 may be mounted on vehicle 100 is not limited to the embodiment of the present invention. Figure 1 The examples shown are limited and may be modified depending on the type of sensors 141 , 142 , or 150 and / or vehicle 100 to achieve desired sensing performance.

[0021] In some embodiments, sensors 141, 142, and 150 may be configured to capture data as vehicle 100 moves along the track. Consistent with the present application, sensor 141 may be a camera that takes photos or otherwise collects image data. For example, sensor 141 may include a monocular, binocular, or panoramic camera. As vehicle 100 moves along the track, sensor 141 may acquire at least two images (each image being an image frame). Each image frame is acquired at a time point when a trigger signal is triggered.

[0022] Consistent with the present application, sensor 142 may be a LiDAR scanner configured to scan the surroundings and acquire a point cloud. LiDAR measures the distance to a target by illuminating the target with a pulsed laser and measuring the reflected pulses with a sensor. The difference in laser return time and wavelength may then be used to make a digital t3-D representation of the target. The light used for LiDAR scanning may be ultraviolet, visible, or near infrared. Since the narrow laser beam can map physical features at very high resolution, LiDAR scanners are particularly suitable for high-definition map measurements. In some embodiments, a LiDAR scanner may capture a point cloud. Similar to sensor 141, sensor 142 may also acquire at least two point clouds (each of which is referred to as a point cloud frame) as vehicle 100 moves along a track. Each point cloud frame is acquired at a point in time when a trigger signal is triggered. Signal trigger sensor 142 may be the same as or different from signal trigger sensor 141.

[0023] As vehicle 100 travels along the track, sensors 141 and 142 may continuously capture data. Each set of scene data captured at a particular point in time is referred to as a data frame. For example, sensor 141 may record a video consisting of multiple image frames captured at multiple points in time. At the same time, sensor 142 may capture a series of point cloud data at multiple points in time.

[0024] like Figure 1 As shown, the vehicle 100 may be additionally equipped with sensors 150, which may include sensors used in a navigation unit, such as a GPS receiver and one or more IMU sensors. GPS is a global navigation satellite system that provides geographic positioning and time information to a GPS receiver. An IMU is an electronic device that uses various inertial sensors (such as accelerometers and gyroscopes, and sometimes magnetometers) to measure and provide the vehicle's specific force, angular rate, and sometimes the magnetic field around the vehicle. By combining a GPS receiver and an IMU sensor, the sensor 150 can provide real-time posture information of the vehicle 100 as the vehicle 100 moves, including the position and orientation (e.g., Euler angles) of the vehicle 100 at each point in time.

[0025] GPS / IMU sensors use a precise pulse per second (PPS) signal to calculate their acquisition time. A PPS signal is an electrical signal that repeats exactly once per second, has a width of less than one second, and has a sharp rising edge or a sudden falling edge. In some embodiments, the PPS pulse may include a rising edge corresponding to the beginning of each Coordinated Universal Time (UTC) second. The corresponding accuracy can be within nanoseconds. Therefore, the PPS signal can be used for precise timing and time measurement.

[0026] Consistent with the present application, the vehicle 100 may include a synchronization system to synchronize the sensors 141, 142, and 150, so that the image frames captured by the sensor 141, the point clouds captured by the sensor 142, and the pose information captured by the sensor 150 are all captured at the same time point. The synchronized image frames, point clouds, and related pose information can be used together to locate the vehicle 100. Consistent with the present application, the PPS signal provided by the GPS / IMU sensor can be used to synchronize the acquisition of the sensors 141, 142, and 150.

[0027] Figure 2 According to an embodiment of the present application, a schematic diagram of an exemplary vehicle synchronization system 200 for synchronizing vehicle sensors is shown. The vehicle synchronization system 200 may include a synchronization control panel 210, a controller area network (CAN) bus 220, and a synchronization computer 230. Consistent with the present application, the system 200 is configured to synchronize sensors 141, 142, and 150. It is contemplated that the system 200 may include additional components.

[0028] The synchronous control panel 210 may be a circuit board configured to receive various input signals and provide various output signals. In some embodiments, the synchronous control panel 210 may be a printed circuit board (PCB), which is composed of an insulator (e.g., fiberglass) in which lines of conductive material act as conductors on a board-based basis. In some embodiments, the synchronous control panel 210 may be an integrated circuit (also referred to as an IC, chip, or microchip), which includes a large number of electronic components (e.g., transistors, resistors, capacitors, inductors, etc.) on a small piece of flat semiconductor material (e.g., silicon).

[0029] For example, Figure 3 According to an embodiment of the present application, a schematic diagram of an exemplary synchronization control panel 210 is shown. The synchronization control panel 210 may be a chip having several input pins, such as pins 311-313, and several output pins, such as pins 314-317. Figure 3 The synchronization control panel 210 is shown as an STM32 IC chip, but it is contemplated that other suitable chips or circuits may be used. It is also contemplated that the synchronization control panel 210 may include a plurality of Figure 3 More or fewer pins may be shown.

[0030] In some embodiments, the synchronization control panel 210 can receive a PPS signal from the sensor 150 via pin 311. For example, the PPS signal can be a 1 Hz square wave, so that each rising edge of the pulse corresponds to the beginning of the UTC second (hereinafter referred to as "GPS full second time"). Because GPS is considered a 0-layer source, a low-latency, low-jitter wired connection can be used to provide the PPS signal to the PC.2 pin (pin 311). In some embodiments, the synchronization control panel 210 can additionally receive a vehicle speed signal via the RxD pin (pin 312) from the CAN bus 220. The CAN bus 220 can be a controller area network bus that is configured to allow microcontrollers and devices in the vehicle to communicate with each other in applications without a host computer. Various sensor inputs from around the vehicle 100 can be collected and sorted via the CAN bus 220. For example, the CAN bus 220 can collect vehicle speed information measured by a speed sensor. The synchronization control panel 210 can be grounded via the GND pin (pin 313).

[0031] Consistent with the present application, the synchronization control panel 210 can use the PPS signal provided by the GPS / IMU sensor 150 as a reference timing signal. In some embodiments, based on the reference timing signal and the vehicle speed signal provided by the CAN bus 220, the synchronization control panel 210 determines a trigger signal for triggering sensors 141 and 142. In some embodiments, the synchronization control panel 210 can first convert the reference timing signal to a higher frequency. For example, the synchronization control panel 210 can convert a 1Hz PPS signal into a 10-20Hz signal. The converted signal can be used to trigger sensors 141 and 142 to acquire each data frame (ie, an image frame or a point cloud frame). For example, acquisition can be triggered by the rising edge of a pulse in the signal.

[0032] In some embodiments, the frequency of the trigger signal can be determined and adjusted based on the vehicle speed signal provided by the CAN bus 220. For example, when the vehicle 100 moves at a relatively low speed, the trigger frequency can be set low; when the vehicle 100 moves at a relatively high speed, the trigger frequency can be set high to capture enough data frames to cover a specific area. In some embodiments, the ratio between the frequency of the trigger signal and the frequency of the reference timing signal can be proportional to the vehicle speed. For example, the ratio can be linearly related to the vehicle speed. In some embodiments, the frequency of the trigger signal of sensor 142 can be different from the frequency of the trigger signal of sensor 141. For example, a 1Hz trigger signal may be sufficient for LiDAR acquisition, while a 10-20Hz trigger signal can be used for camera acquisition.

[0033] In some embodiments, the synchronization control panel 210 can use the reference timing signal to correct the trigger signal and ensure that the trigger signal is synchronized with UTC. Because the generation of the trigger signal is based in part on the synchronization control panel 210's own clock, it may contain accumulated errors caused by the board clock. For example, Figure 4 According to an embodiment of the present application, an exemplary trigger signal 400 synchronized using a reference timing signal is shown. For example, the trigger signal 400 includes pulses 401-405 having rising edges at time points t0-t4, respectively. At time point t5, the synchronization control panel 210 can detect a rising edge in the reference timing signal, indicating a GPS full-second time. The synchronization control panel 210 can phase-shift the trigger signal accordingly so that the next pulse 410 has a rising edge that matches the rising edge of the reference timing signal. The subsequent pulse 411 will be shifted accordingly to have its rising edge at time point t6. The time interval between t5 and t6 will remain the same as the time interval between t0 and t1 to keep the trigger signal at the same frequency. In some embodiments, the trigger signal correction can be triggered by each rising edge in the reference timing signal.

[0034] like Figure 3 As shown, the synchronization control panel 210 can provide trigger signals to the sensor 141 (e.g., including cameras 141-1 and 141-2) and the sensor 142 (e.g., LiDAR) through PA pins 315-317, respectively. In some embodiments, the trigger signal can be pulse width modulated (PWM). In addition, the synchronization control panel 210 can provide a reference timing signal (e.g., a PPS signal) and / or a trigger signal as a serial output signal to the synchronization computer 230 through the feedback pin 314. The reference timing signal can be used by the synchronization computer 230 to obtain post-synchronization.

[0035] Back to Figure 2 In addition to the synchronization control panel 210 configured to synchronize sensors during acquisition, the system 200 may also include a synchronization computer 230 configured to synchronize sensor measurements after acquisition. The synchronization computer 230 may be a general purpose computer, or a proprietary device specifically designed for sensor synchronization. It is contemplated that the synchronization computer 230 may be a separate system or an integrated component of a vehicle controller, such as an engine control unit (ECU). In some embodiments, the synchronization computer 230 may include subsystems, some of which may be remote.

[0036] Figure 5According to an embodiment of the present application, a schematic diagram of an exemplary synchronization computer 230 for synchronizing data acquired by vehicle sensors is shown. In some embodiments, the synchronization computer 230 may include a communication interface 502, a processor 504, a memory 512, and a storage 514. In some embodiments, the synchronization computer 230 may have different modules in a single device, such as an integrated circuit (IC) chip (implemented as an application-specific integrated circuit (ASIC) or a field programmable gate array (FPGA)), or a separate device with dedicated functions. In some embodiments, one or more components of the synchronization computer 230 may be located in the vehicle 100, or remotely, such as in the cloud, a mobile device, or other distributed locations. The components of the synchronization computer 230 may be in an integrated device, or distributed in different locations, but communicate with each other through a network (not shown).

[0037] The communication interface 502 may be connected via a communication cable, a wireless local area network (WLAN), a wide area network (WAN), a wireless network (e.g., radio waves), a cellular network, and / or a local or short-range wireless network (e.g., Bluetooth TM ), or other communication methods, to send and receive data to and from components such as the sensor 150 and the CAN bus 220. In some embodiments, the communication interface 502 can be an integrated services digital network (ISDN) card, a cable modem, a satellite modem, or a modem that provides a data communication connection. For another example, the communication interface 502 can be a local area network (LAN) card to provide a data communication connection with a compatible LAN. A wireless link can also be implemented by the communication interface 502. In such an implementation, the communication interface 502 can send and receive electrical signals, electromagnetic signals, or optical signals that carry digital data streams representing various types of information through the network.

[0038] Consistent with some embodiments, the communication interface 502 may receive a reference timing signal provided by the sensor 150 and a trigger signal provided by the synchronization control panel 210. The communication interface 502 may also receive image frames captured by the sensor 141, point cloud data captured by the sensor 142, and pose information captured by the sensor 150. The communication interface 502 may also provide the received data, signals, and information to the memory 512 / storage 514 for storage or to the processor 504 for processing.

[0039] Processor 504 may include any suitable type of general or special purpose microprocessor, digital signal processor, or microcontroller. Processor 504 may be configured as a separate processor module dedicated to synchronizing acquired sensor data. Alternatively, processor 504 may be configured as a shared processor module for performing other functions unrelated to sensor synchronization.

[0040] like Figure 5 As shown, the processor 504 may include multiple modules, such as a reference image trigger time judgment unit 506, a reference image determination unit 508, and an image acquisition time determination unit 510. These modules (and any corresponding sub-modules or sub-units) may be hardware units of the processor 504 (e.g., parts of an integrated circuit), which are designed to be used together with other components or software units implemented by the processor 504 by executing at least a portion of a program. The program may be stored on a computer-readable medium, and when executed by the processor 504, it may perform one or more functions. Although Figure 5 All of the units 506 - 510 are shown within one processor 504 , but it is contemplated that these units may be distributed among multiple processors that are close to or remote from each other.

[0041] The reference image trigger time determination unit 506 may be configured to determine a time point T corresponding to the GPS full second time, i.e., the rising edge of the PPS signal pulse. In some embodiments, the reference image trigger time determination unit 506 may query the GPS time in the GTIMU message. Since the GPS time usually lags behind the start of the GPS full second time, the reference image trigger time determination unit 506 may round down the GPS time as the reference image trigger time T.

[0042] In the sequence of images received by the sensor 141, the reference image determination unit 508 can identify the reference image captured by the sensor 141 when triggered at the reference image trigger time T. In some embodiments, in order to identify the reference image, the synchronization control panel 210 can specify the time interval between two trigger pulses as Ti. Assuming that there are N pulses in a full second, the time interval between the reference image and the image just before it will be Tr=1000ms-(N-1)*Ti. Therefore, the reference image determination unit 508 can identify a pair of images separated by Tr that are captured separately, and determine the latter image in the pair as the reference image. For example, if N=10 (i.e., 10Hz trigger signal) and Ti=105ms, then Tr=1000ms-(10-1)*105ms=55ms. The reference image determination unit 508 can identify the second image in the pair of images captured 55ms apart as the reference image.

[0043] There is a time delay of Ts0 between the reference image trigger time T when the sensor 141 is triggered and the acquisition time T0 when the reference image is actually captured, which corresponds to the shutter speed (or exposure time) of the sensor 141. Therefore, the GPS time of the reference image is T0=T+Ts0. The exposure time is the length of time that the film or digital sensor in the camera is exposed, as well as when the shutter of the camera is open when the image is captured. In some embodiments, the timestamp Ts0 can be a camera parameter predetermined for the sensor 141 or automatically calculated by the sensor 141.

[0044] Once the reference image is identified and its GPS time T0 is determined, the image acquisition time determination unit 510 can determine the GPS time of the remaining images. For example, Tn can be the acquisition time of the nth image following the reference image. In some embodiments, Tn can be determined as Tn=T0+(Trn-Tr0)+Tsn, where T0 is the GPS time of the reference image determined by the reference image determination unit 508, Trn is the original time of the nth image, and Tsn is the shutter time of the nth image. Both the original time Trn and the shutter time Tsn are timestamps created by the sensor 141.

[0045] In some embodiments, by synchronizing the reference image trigger time with the GPS full second time, GPS time errors will not be accumulated. As a result, even if the reference image is lost, such as during transmission from sensor 141, the GPS time of the image sequence can be calculated using the reference image determined for the previous second.

[0046] Memory 512 and storage 514 may include any suitable type of mass storage that is provided with any type of information that processor 504 may need to operate. Memory 512 and storage 514 may be volatile or non-volatile, magnetic, semiconductor, tape, optical, removable, non-removable, or other types of storage devices or tangible (i.e., non-transitory) computer-readable media, including but not limited to ROM, flash memory, dynamic RAM, and static RAM. Memory 512 and / or storage 514 may be configured to store one or more computer programs executed by processor 504 to perform the sensor synchronization functions disclosed herein. For example, memory 512 and / or storage 514 may be configured to store programs executed by processor 504 to synchronize information acquired by sensors.

[0047] The memory 512 and / or storage 514 may be further configured to store information and store data used by the processor 504. For example, the memory 512 and / or storage 514 may be configured to store various types of signals provided by the sensor 150 and the CAN bus 220 (e.g., reference timing signals, vehicle speed signals, etc.), and various types of data captured by the sensors 141, 142, and 150 (e.g., image frames, point cloud data, pose information, etc.). The memory 512 and / or storage 514 may also store intermediate signals and data, such as trigger signals, camera parameters, etc. After processing a portion of the data, various types of data may be permanently stored, periodically removed, or immediately ignored.

[0048] Figure 6 According to an embodiment of the present application, a flowchart of an exemplary method 600 for synchronizing vehicle sensors is shown. In some embodiments, the method 600 can be implemented by a vehicle synchronization system 200, which includes a synchronization control panel 210 and a synchronization computer 230. For example, steps S602-S610 of the method 600 can be performed by the synchronization control panel 210, and steps S612-S618 can be performed by the synchronization computer 230. It should be understood that some steps may be optional to perform the present application provided herein. In addition, some steps may be performed simultaneously or in combination with the synchronization control panel 210. Figure 6 The different orders are shown in .

[0049] In step S602, the synchronization control panel 210 may receive a reference timing signal. In some embodiments, the reference timing signal may be a PPS signal provided by the GPS / IMU sensor 150. For example, in a 1 Hz PPS signal, the rising edge of each pulse corresponds to the beginning of a UTC second. In step S604, the synchronization control panel 210 may receive a vehicle speed signal. For example, the vehicle speed signal may be provided by the CAN bus 220, which acquires information through a speed sensor of the vehicle 100.

[0050] In step S606, the synchronization control panel 210 can generate a trigger signal based on the reference timing signal and the vehicle speed signal received in steps S602 and S604, respectively. The trigger signal can be a pulse wave signal similar to the reference timing signal, but with a higher frequency. In some embodiments, the frequency of the trigger signal can be determined based on the vehicle speed signal. In some embodiments, the ratio between the frequency of the trigger signal and the frequency of the reference timing signal can be linearly related to the vehicle speed. For example, when the vehicle 100 moves at a relatively low speed, the trigger frequency can be set low, and when the vehicle 100 moves at a relatively high speed, the trigger frequency can be set high to capture enough data frames to cover a specific area.

[0051] In some embodiments, as part of step S606, synchronization control panel 210 may generate one trigger signal for sensor 141 and another trigger signal for sensor 142. The frequency of the trigger signal for sensor 141 may be different from the frequency of the trigger signal for sensor 142. For example, the trigger signal for LiDAR acquisition may be 1 Hz, while the trigger signal for camera acquisition may be 10-20 Hz.

[0052] In step S608, the synchronization control panel 210 can correct the trigger signal using the reference timing signal and ensure that the trigger signal is synchronized at the beginning of each second. For example, the synchronization control panel 210 can detect a rising edge in the reference timing signal, indicating a GPS full second time, and phase-shift the trigger signal accordingly so that the next pulse in the trigger signal has a rising edge that matches the rising edge in the reference timing signal. In some embodiments, the correction of the trigger signal can be triggered by each rising edge in the reference timing signal.

[0053] In step S610, the trigger signal generated by the synchronization control panel 210 can be provided to each sensor 141 and 142 to trigger the information acquired by the sensor. For example, the sensors 141 and 142 can be triggered to capture a data frame at the rising edge of each pulse in the trigger signal. In step S612, the synchronization computer 230 can receive these captured data frames. For example, the synchronization computer 230 can receive an image sequence (image frame) from the sensor 141 and a point cloud frame from the sensor 142.

[0054] During steps S614-S618, the synchronization computer 230 may perform post-acquisition synchronization on the acquired data. In step S614, the reference image trigger time determination unit 506 may determine the reference image trigger time T corresponding to the GPS full second time, i.e., the rising edge of the pulse in the PPS signal. In some embodiments, the time T may be determined by applying a floor operation to the GPS time in the GTIMU message.

[0055] In step S616, the reference image determination unit 508 may identify a reference image captured by the trigger sensor 141 at a reference image trigger time T. In some embodiments, the reference image may be identified as the second image of a pair of images acquired at a time interval Tr apart. Tr may be determined as Tr=1000ms-(N-1)*Ti, where Ti is the time interval between two trigger pulses and N is the number of pulses in a full second. As part of step S616, the reference image determination unit 508 may also determine an acquisition time T0 corresponding to the GPS time when the reference image was captured. In some embodiments, T0 may be determined as T0=T+Ts0, where Ts0 is a time delay corresponding to a shutter speed (or exposure time) of the sensor 141. The timestamp Ts0 may be a camera parameter predetermined for the sensor 141 or automatically calculated by the sensor 141.

[0056] In step S618, the image acquisition time determination unit 510 may determine an acquisition time corresponding to the GPS time of capturing the remaining images. For example, Tn may be the acquisition time of the nth image following the reference image. In some embodiments, Tn may be determined as Tn=T0+(Trn-Tr0)+Tsn, where T0 is the GPS time of the reference image determined in step S616, Trn is the raw time of the nth image, and Tsn is the shutter time of the nth image. Both the raw time Trn and the shutter time Tsn are timestamps created by the sensor 141.

[0057] Another aspect of the present application relates to a non-transitory computer-readable medium storing instructions, which, when executed, cause one or more processors to perform the method as described above. The computer-readable medium includes a volatile or non-volatile, magnetic, semiconductor, tape, optical, removable, non-removable or other type of computer-readable medium or computer-readable storage device. For example, a computer-readable medium as used herein can be a storage device or a memory module having computer instructions stored thereon. In some embodiments, the computer-readable medium can be a disk or flash drive having computer instructions stored thereon.

[0058] It is obvious that a person skilled in the art can make various modifications and changes to the system and related methods of the present application. Other embodiments are obvious to a person skilled in the art in view of the description and practice of the system and related methods of the present application.

[0059] It is intended that the specification and examples in the present application be considered as exemplary only, with a true scope being defined by the following claims and their equivalents.

Claims

1. A vehicle synchronization system, characterized in that: The vehicle synchronization system comprises: A bus configured to receive a vehicle speed signal; and The synchronous control panel is configured to receive a reference timing signal and determine a trigger signal for triggering at least one sensor based on the reference timing signal and the vehicle speed signal, wherein the frequency of the trigger signal of each sensor is determined and adjusted based on the vehicle speed signal.

2. The vehicle synchronization system according to claim 1, characterized in that: The reference timing signal is a PPT signal acquired by a sensor used for navigation.

3. The vehicle synchronization system according to claim 1, characterized in that: A ratio between the frequency of the trigger signal and the frequency of the reference timing signal is proportional to the vehicle speed signal.

4. The vehicle synchronization system according to claim 3, characterized in that: The ratio between the frequency of the trigger signal and the frequency of the reference timing signal is linearly related to the vehicle speed signal.

5. The vehicle synchronization system according to claim 1, characterized in that: The frequencies of the trigger signals of different sensors are different.

6. The vehicle synchronization system according to claim 1, characterized in that: The synchronization control panel is configured to use a pulse rising edge of the reference timing signal as a reference for synchronizing the trigger signal.

7. The vehicle synchronization system according to claim 1, characterized in that: The vehicle synchronization system further includes: The synchronization computer is configured to synchronize the measurement data of the at least one sensor.

8. The vehicle synchronization system according to claim 7, characterized in that: The at least one sensor includes a camera and / or a radar, and the measurement data is an image sequence or a point cloud sequence.

9. The vehicle synchronization system according to claim 8, characterized in that: The synchronization computer comprises a processor configured to: receiving the reference timing signal via a corresponding communication interface; Determine a reference image trigger time according to the reference timing signal; identifying reference data from measurement data acquired by the at least one sensor within the reference image triggering time; The acquisition time of each measurement data corresponding to the at least one sensor is determined according to the acquisition time of the reference data.

10. The vehicle synchronization system according to claim 9, characterized in that: The processor is further configured to round down the reference timing signal to obtain the reference image trigger time.

11. The vehicle synchronization system according to claim 9, characterized in that: The processor is further configured to determine an acquisition time of the reference data according to the reference image trigger time and shutter time.

12. The vehicle synchronization system according to claim 9, characterized in that: The processor is further configured to determine an acquisition time of each measurement data according to an original time, a shutter time and an acquisition time of the reference data corresponding to each measurement data.

13. A vehicle, characterized in that: The vehicle comprises: a sensor for navigation, configured to acquire a reference timing signal; a vehicle synchronization system configured to determine a trigger signal for triggering at least one sensor based on the reference timing signal and a vehicle speed signal, wherein a frequency of the trigger signal of each of the sensors is determined and adjusted based on the vehicle speed signal; At least one sensor to be synchronized is configured to be triggered by the corresponding trigger signal to acquire measurement data.

14. A synchronous control panel, characterized in that: The synchronization control panel comprises: at least one input pin configured to receive a reference timing signal and a vehicle speed signal; at least one output pin configured to provide a trigger signal to at least one sensor, wherein the trigger signal is determined based on the reference timing signal and the vehicle speed signal, and a frequency of the trigger signal is determined and adjusted based on the vehicle speed signal; and The feedback pin is configured to provide the reference timing signal to the synchronization computer.

15. A synchronous computer, characterized in that: The synchronization computer comprises: a communication interface configured to receive a reference timing signal; The processor is configured as: Determine a reference image trigger time according to the reference timing signal; identifying reference data from measurement data acquired by at least one sensor within the reference image triggering time; Determining an acquisition time of each measurement data corresponding to the at least one sensor according to an acquisition time of the reference data; The sensor is controlled by a trigger signal to trigger the acquisition of the measurement data, the trigger signal is determined based on the reference timing signal and a vehicle speed signal, and the frequency of the trigger signal is determined and adjusted based on the vehicle speed signal.

16. A vehicle synchronization method, characterized in that: The method comprises: receiving a reference timing signal; receiving a vehicle speed signal; determining a trigger signal based on the reference timing signal and the vehicle speed signal, wherein a frequency of the trigger signal is determined and adjusted based on the vehicle speed signal; and Using the trigger signal, at least one sensor is triggered to acquire corresponding measurement data.