A method and device for synchronizing multiple cameras

By using high-frequency pulse signals in a multi-camera system for exposure driving and adjusting the pulse signals according to the sampling results of the main camera and slave camera, the problem of inconsistent exposure time in the prior art is solved, and high-precision multi-camera synchronization is achieved .

CN115484355BActive Publication Date: 2024-11-22ZHEJIANG DAHUA TECH CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202210773309.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-07-01
Publication Date
2024-11-22
Estimated Expiration
2042-07-01

AI Technical Summary

Technical Problem

The existing multi-camera synchronization methods have timing errors, clock errors and response errors in network timing and GPS timing, resulting in inconsistent camera exposure timing and synchronous exposure cannot be achieved.

Method used

The pulse signal is used for exposure driving. The frequency of the pulse signal is higher than the exposure frequency of the camera system and is an integer multiple. By comparing the sampling results between the master camera and the slave camera, the exposure timing relationship is determined and the pulse signal is adjusted to achieve Synchronous exposure.

Benefits of technology

The accuracy of multi-camera synchronization is improved, and the impact of timing error, clock error and response error on synchronization accuracy is eliminated, ensuring the camera's exposure at the same moment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115484355B_ABST
    Figure CN115484355B_ABST
Patent Text Reader

Abstract

The embodiment of the present invention relates to a multi-channel camera synchronization method and device. The method includes: a slave camera receives a sampling result of a master camera; the slave camera and the master camera are cameras in a multi-camera system; the exposure frequency of the slave camera is an integer multiple of the exposure frequency of the master camera; the slave camera determines whether there is a sequential relationship between the slave camera and the master camera in terms of exposure timing according to the sampling result of the slave camera, the sampling result of the master camera and the signal period of the pulse signal; if there is a sequential relationship, the pulse signal received by the slave camera is adjusted so that the slave camera and the master camera can achieve synchronous exposure; the sampling result of any camera in the multi-camera system is the time difference between the sampling moment and the exposure moment determined by the camera under its own clock system based on the same sampling instruction of the multi-camera system; the exposure moment is the Nth exposure moment of any camera before the sampling moment. In this way, the slave camera can accurately achieve synchronous exposure with the master camera based on the adjusted pulse signal.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Embodiments of the present invention relate to the field of computer technology, and in particular to a multi-channel camera synchronization method, apparatus, computing device, and computer-readable storage medium. Background Art

[0002] In a multi-camera system, multiple cameras are often required to synchronize their shutters to ensure that multiple cameras are exposed at the same time, thereby obtaining multiple images taken at the same time. For example, in the field of vehicle-road collaboration, a single camera cannot cover the entire road section, so multiple cameras are usually placed at different locations for image acquisition. The data center performs splicing and recognition on the images collected by multiple cameras at the same time, thereby obtaining image information of the entire road section.

[0003] Existing multi-camera synchronization methods use network timing, GPS timing, etc. to achieve multi-camera synchronization. Taking network timing as an example, each camera keeps its own clock time consistent through network timing, so each camera can be exposed at the same time of its own clock, thereby obtaining multiple images at the same time. However, the above timing scheme has the following problems: 1. Network timing itself has errors. When the network condition is poor, such as after multi-level network routing or when the data load is large, the camera timing may not be accurate; 2. There are clock errors between different cameras due to different structures. In this way, the clock times between the cameras are likely to be different, and multiple images at the same time cannot be obtained. Summary of the invention

[0004] The embodiment of the present invention provides a multi-channel camera synchronization method for realizing synchronous exposure of the multi-channel cameras.

[0005] In a first aspect, an embodiment of the present invention provides a multi-channel camera synchronization method, which is applicable to a multi-camera system that is driven by a pulse signal for exposure; the frequency of the pulse signal is higher than the exposure frequency of each camera in the multi-camera system and is an integer multiple of the exposure frequency of each camera, and the multi-camera system includes a master camera and a slave camera, and the exposure frequency of the slave camera is an integer multiple of the exposure frequency of the master camera; the method includes:

[0006] The slave camera receives the sampling results of the master camera;

[0007] The slave camera determines whether there is a sequential relationship between the slave camera and the master camera in terms of exposure timing according to the sampling result of the slave camera, the sampling result of the master camera and the signal period of the pulse signal; if there is the sequential relationship, adjusting the pulse signal received by the slave camera so that the slave camera and the master camera can achieve synchronous exposure;

[0008] Among them, the sampling result of each camera in the multi-camera system is the time difference between the sampling time and the exposure time determined by the camera under its own clock system based on the same sampling instruction of the multi-camera system; the exposure time is the Nth exposure time of each camera before the sampling time.

[0009] The master camera determines the time difference between the sampling moment of the master camera and the exposure moment of the master camera under the clock system of the master camera, that is, the sampling result of the master camera, and the exposure of the master camera is controlled by a pulse signal; the slave camera determines the time difference between the sampling moment of the slave camera and the exposure moment of the slave camera under the clock system of the slave camera, that is, the sampling result of the slave camera, and the exposure of the slave camera is also controlled by a pulse signal. Due to errors such as timing error, clock error and response error, the sampling moment of the master camera and the sampling moment of the slave camera are likely to be different, and there is a sampling error between the two. Since the frequency of the pulse signal is higher than the exposure frequency of any camera in the multi-camera system and is an integer multiple of the exposure frequency of any camera, the master camera and the slave camera may be triggered to expose at different signal cycles. The sampling results of the master camera and the sampling results of the slave camera obtained in this way can not only reflect the sampling errors (including timing error, clock error and response error) of the sampling moment of the master camera and the sampling moment of the slave camera, but also reflect whether there is a sequential relationship between the slave camera and the master camera in the exposure timing. If the above relationship exists, the pulse signal received by the slave camera is adjusted so that the slave camera and the master camera can achieve synchronous exposure. It is precisely because the pulse signal is adjusted instead of the clock moment of the slave camera that the slave camera can accurately achieve synchronous exposure with the master camera based on the adjusted pulse signal. Compared with the pure timing solution, the synchronization accuracy is higher, and within a certain range, the influence of timing error, clock error and response error on synchronization accuracy is eliminated.

[0010] Optionally, the pulse signal is obtained by converting industrial frequency alternating current output by a power supply system of the multi-camera system.

[0011] The power frequency AC power supply system of the multi-camera system generates pulse signals, which does not require additional wiring, is simple to construct, and has strong resistance to external interference. It also reduces the energy loss during the transmission of the pulse signal, so that even if the distance between the slave camera and the main camera is different, the frequency of the pulse signal received by the two can be guaranteed to be consistent.

[0012] Optionally, the multi-camera system periodically performs clock timing through the same timing system;

[0013] A sampling error between a sampling time of the master camera and a sampling time of the slave camera in the multi-camera system is less than half of a signal period of the pulse signal.

[0014] Timing through the same timing system can further ensure the accuracy of timing. In a multi-camera system, the sampling error between the sampling moment of the master camera and the sampling moment of the slave camera is limited to less than half of the signal period of the pulse signal. Based on such a limitation, it can be determined whether there is a chronological relationship between the slave camera and the master camera in terms of exposure timing according to the sampling results of the slave camera and the master camera; if there is such a chronological relationship, a method for adjustment can also be determined.

[0015] Optionally, the slave camera determines whether there is a sequential relationship between the slave camera and the master camera in terms of exposure timing according to a sampling result of the slave camera, a sampling result of the master camera, and a signal period of the pulse signal, including:

[0016] If the absolute value of the difference between the sampling result of the slave camera and the sampling result of the master camera is less than half of the signal period, it is determined that the slave camera and the master camera are in exposure synchronization in exposure timing;

[0017] If the absolute value of the difference between the sampling result of the slave camera and the sampling result of the master camera is greater than or equal to half of the signal period, it is determined that there is a sequential relationship between the slave camera and the master camera in terms of exposure timing.

[0018] Optionally, if the sequence relationship exists, adjusting the pulse signal received from the camera includes:

[0019] Determine the number of cycles by which the slave camera is ahead of or behind the master camera in exposure timing according to a relationship between a difference between a sampling result of the slave camera and a sampling result of the master camera and a multiple of half of the signal period;

[0020] The pulse signal received from the camera is adjusted according to the number of leading or lagging cycles.

[0021] Optionally, adjusting the pulse signal received from the camera according to the number of leading or lagging cycles includes:

[0022] The slave camera determines that the exposure moment of the slave camera corresponds to the Xth periodic wave in the group pulse wave; the pulse signal includes multiple groups of pulse waves; the group of pulse waves includes N periodic waves; the frequency of the pulse signal is N times the exposure frequency of the master camera;

[0023] If the slave camera determines that the exposure moment of the slave camera lags behind the exposure moment of the master camera by M cycles, the XMth cycle wave in the group of pulse waves is retained, and the remaining cycle waves are removed, thereby obtaining an adjusted pulse signal; or, if the slave camera determines that the exposure moment of the slave camera is ahead of the exposure moment of the master camera by M cycles, the X+Mth cycle wave in the group of pulse waves is retained, and the remaining cycle waves are removed, thereby obtaining an adjusted pulse signal.

[0024] The pulse signal received from the slave camera is adjusted. Because the pulse signal is adjusted instead of the clock moment of the slave camera, the slave camera can accurately achieve synchronous exposure with the master camera based on the adjusted pulse signal.

[0025] Optionally, the exposure frequency of the slave camera is K times the exposure frequency of the master camera; K is an integer greater than 1;

[0026] The slave camera determines whether there is a sequential relationship between the slave camera and the master camera in terms of exposure timing according to the sampling result of the slave camera, the sampling result of the master camera, and the signal period of the pulse signal, including:

[0027] Taking a decimal of the ratio of the sampling result of the master camera by the slave camera to the exposure period of the slave camera, and using the obtained decimal as the corrected sampling result of the master camera;

[0028] The slave camera determines the ratio of the sampling result of the slave camera to the exposure period of the slave camera as the corrected sampling result of the slave camera;

[0029] The slave camera determines whether there is a sequential relationship between the slave camera and the master camera in terms of exposure timing according to the corrected sampling result of the slave camera, the corrected sampling result of the master camera, and the signal period of the pulse signal.

[0030] In this way, even when the exposure frequencies of the slave camera and the master camera are different, synchronous exposure of the two can be achieved. By taking the ratio of the sampling result of the master camera to the exposure period of the slave camera, and using the obtained decimal as the corrected sampling result of the master camera, it is possible to more easily and accurately determine whether there is a sequential relationship between the exposure time of the slave camera and the exposure time of the master camera. It is not limited to using cameras with the same frame rate, and can be applied to various types of cameras, and different types of cameras can achieve synchronous exposure.

[0031] Optionally, the signal period of the pulse signal fluctuates;

[0032] The slave camera determines whether there is a sequential relationship between the slave camera and the master camera in terms of exposure timing according to the sampling result of the slave camera, the sampling result of the master camera, and the signal period of the pulse signal, including:

[0033] The slave camera acquires the real-time exposure period of the slave camera and the real-time exposure period of the master camera;

[0034] The slave camera determines whether there is a chronological relationship between the slave camera and the master camera in terms of exposure timing according to a relationship between a ratio of a sampling result of the slave camera to a real-time exposure period of the slave camera, a ratio of a sampling result of the master camera to the real-time exposure period of the master camera, and a ratio of the signal period to the real-time signal period.

[0035] Since the frequency of the pulse signal fluctuates in actual situations, the sampling results of the slave camera, the sampling results of the master camera and the signal period are normalized respectively, thereby ensuring the accuracy of determining whether there is a chronological relationship between the slave camera and the master camera in terms of exposure timing.

[0036] In a second aspect, an embodiment of the present invention further provides a multi-channel camera synchronization device, which is applicable to a multi-camera system that is driven by a pulse signal for exposure; the frequency of the pulse signal is higher than the exposure frequency of each camera in the multi-camera system and is an integer multiple of the exposure frequency of each camera, the multi-camera system includes a master camera and a slave camera, and the exposure frequency of the slave camera is an integer multiple of the exposure frequency of the master camera; the device includes:

[0037] Receiving unit, for:

[0038] The slave camera receives the sampling results of the master camera;

[0039] A processing unit for:

[0040] The slave camera determines whether there is a sequential relationship between the slave camera and the master camera in terms of exposure timing according to the sampling result of the slave camera, the sampling result of the master camera and the signal period of the pulse signal; if there is the sequential relationship, adjusting the pulse signal received by the slave camera so that the slave camera and the master camera can achieve synchronous exposure;

[0041] Among them, the sampling result of each camera in the multi-camera system is the time difference between the sampling time and the exposure time determined by the camera under its own clock system based on the same sampling instruction of the multi-camera system; the exposure time is the Nth exposure time of each camera before the sampling time.

[0042] Optionally, the pulse signal is obtained by converting industrial frequency alternating current output by a power supply system of the multi-camera system.

[0043] Optionally, the multi-camera system periodically performs clock timing through the same timing system;

[0044] A sampling error between a sampling time of the master camera and a sampling time of the slave camera in the multi-camera system is less than half of a signal period of the pulse signal.

[0045] Optionally, the processing unit is specifically configured to:

[0046] If the absolute value of the difference between the sampling result of the slave camera and the sampling result of the master camera is less than half of the signal period, it is determined that the slave camera and the master camera are in exposure synchronization in exposure timing;

[0047] If the absolute value of the difference between the sampling result of the slave camera and the sampling result of the master camera is greater than or equal to half of the signal period, it is determined that there is a sequential relationship between the slave camera and the master camera in terms of exposure timing.

[0048] Optionally, the processing unit is specifically configured to:

[0049] Determine the number of cycles by which the slave camera is ahead of or behind the master camera in exposure timing according to a relationship between a difference between a sampling result of the slave camera and a sampling result of the master camera and a multiple of half of the signal period;

[0050] The pulse signal received from the camera is adjusted according to the number of leading or lagging cycles.

[0051] Optionally, the processing unit is specifically configured to:

[0052] The slave camera determines that the exposure moment of the slave camera corresponds to the Xth periodic wave in the group pulse wave; the pulse signal includes multiple groups of pulse waves; the group of pulse waves includes N periodic waves; the frequency of the pulse signal is N times the exposure frequency of the master camera;

[0053] If the slave camera determines that the exposure moment of the slave camera lags behind the exposure moment of the master camera by M cycles, the XMth cycle wave in the group of pulse waves is retained, and the remaining cycle waves are removed, thereby obtaining an adjusted pulse signal; or, if the slave camera determines that the exposure moment of the slave camera is ahead of the exposure moment of the master camera by M cycles, the X+Mth cycle wave in the group of pulse waves is retained, and the remaining cycle waves are removed, thereby obtaining an adjusted pulse signal.

[0054] Optionally, the exposure frequency of the slave camera is K times the exposure frequency of the master camera; K is an integer greater than 1;

[0055] The processing unit is specifically used for:

[0056] Taking a decimal of the ratio of the sampling result of the master camera by the slave camera to the exposure period of the slave camera, and using the obtained decimal as the corrected sampling result of the master camera;

[0057] The slave camera determines the ratio of the sampling result of the slave camera to the exposure period of the slave camera as the corrected sampling result of the slave camera;

[0058] The slave camera determines whether there is a sequential relationship between the slave camera and the master camera in terms of exposure timing according to the corrected sampling result of the slave camera, the corrected sampling result of the master camera, and the signal period of the pulse signal.

[0059] Optionally, the signal period of the pulse signal fluctuates;

[0060] The processing unit is specifically used for:

[0061] The slave camera acquires the real-time exposure period of the slave camera and the real-time exposure period of the master camera;

[0062] The slave camera determines whether there is a chronological relationship between the slave camera and the master camera in terms of exposure timing according to a relationship between a ratio of a sampling result of the slave camera to a real-time exposure period of the slave camera, a ratio of a sampling result of the master camera to the real-time exposure period of the master camera, and a ratio of the signal period to the real-time signal period.

[0063] In a third aspect, an embodiment of the present invention further provides a computing device, including:

[0064] Memory for storing computer programs;

[0065] The processor is used to call the computer program stored in the memory and execute the multi-channel camera synchronization method listed in any of the above-mentioned ways according to the obtained program.

[0066] In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer-executable program, and the computer-executable program is used to enable a computer to execute the multi-channel camera synchronization method listed in any of the above-mentioned ways. BRIEF DESCRIPTION OF THE DRAWINGS

[0067] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0068] Figure 1a A schematic diagram of the exposure conditions of each camera when the frequency of the pulse signal provided by the embodiment of the present invention is equal to the exposure frequency of each camera;

[0069] Figure 1b A schematic diagram of the exposure conditions of each camera when the frequency of the pulse signal provided by the embodiment of the present invention is less than the exposure frequency of each camera;

[0070] Figure 1c A schematic diagram of the exposure conditions of each camera when the frequency of the pulse signal provided by the embodiment of the present invention is greater than the exposure frequency of each camera;

[0071] Figure 2 A schematic diagram of a system architecture provided for an embodiment of the present invention;

[0072] Figure 3 A schematic diagram of a possible multi-channel camera synchronization method provided by an embodiment of the present invention;

[0073] Figure 4a A schematic diagram of the relationship between a sampling time and an exposure time provided by an embodiment of the present invention;

[0074] Figure 4b A schematic diagram of a sampling result of a master camera and a sampling result of a slave camera provided by an embodiment of the present invention;

[0075] Figure 5a A schematic diagram of a master camera and a slave camera performing exposure under the control of the same pulse signal provided by an embodiment of the present invention;

[0076] Figure 5b A schematic diagram of a method for adjusting a pulse signal received from a camera provided by an embodiment of the present invention;

[0077] Figure 5c A schematic diagram of a comparison between a possible pulse signal after adjustment and a pulse signal before adjustment provided in an embodiment of the present invention;

[0078] Figure 5d A schematic diagram of a main camera performing exposure according to a received pulse signal and a slave camera performing exposure according to an adjusted pulse signal provided by an embodiment of the present invention;

[0079] Figure 5e A schematic diagram of a master camera and a slave camera performing exposure under the control of the same pulse signal provided by an embodiment of the present invention;

[0080] Figure 5f A comparison diagram of a possible pulse signal after adjustment and a pulse signal before adjustment provided in an embodiment of the present invention;

[0081] Figure 6aA schematic diagram of exposure performed by a master camera and a slave camera with different exposure frequencies provided by an embodiment of the present invention;

[0082] Figure 6b A comparison diagram of a possible pulse signal after adjustment and a pulse signal before adjustment provided in an embodiment of the present invention;

[0083] Figure 7 A possible conversion relationship diagram for converting industrial frequency alternating current into a pulse signal provided by an embodiment of the present invention;

[0084] Figure 8 A schematic diagram of a system architecture provided for an embodiment of the present invention;

[0085] Fig. 9 A schematic diagram of the internal structure of any camera provided by an embodiment of the present invention;

[0086] Fig.10 A schematic diagram of a possible timing scheme provided by an embodiment of the present invention;

[0087] Fig.11 A schematic diagram of a possible camera synchronization method provided by an embodiment of the present invention;

[0088] Fig.12 A schematic diagram of a possible method for adjusting a pulse signal from a camera provided by an embodiment of the present invention;

[0089] Fig.13 A schematic diagram of the structure of a possible multi-channel camera synchronization device provided by an embodiment of the present invention;

[0090] Fig.14 A schematic diagram of the structure of a computer device provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0091] In order to make the purpose, implementation mode and advantages of the present application clearer, the exemplary implementation mode of the present application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only part of the embodiments of the present application, rather than all the embodiments.

[0092] Based on the exemplary embodiments described in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the claims attached to this application. In addition, although the disclosure in this application is introduced according to one or several exemplary examples, it should be understood that each aspect of the disclosure can also constitute a complete implementation method separately.

[0093] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and common meanings.

[0094] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise indicated. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances, for example, they can be implemented according to orders other than those given in the diagrams or descriptions of the embodiments of this application.

[0095] In addition, the terms "include" and "have" and any variations thereof are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to those components expressly listed but may include other components not expressly listed or inherent to such products or devices.

[0096] In a multi-camera system, multiple cameras are often required to perform shutter synchronization to ensure that multiple cameras are exposed at the same time. Currently used multi-channel camera synchronization methods include GPS (Global Positioning System) timing method and network timing method.

[0097] The GPS timing method means that each camera completes the synchronous exposure of the camera by acquiring the GPS signal. However, in some scenes, such as tunnel environments, the GPS signal is generally weak, so it is impossible to accurately synchronize the camera exposure by acquiring the GPS signal, and the environmental adaptability and versatility are poor.

[0098] The network timing method means that each camera keeps the same time through network timing, so the synchronization triggering of each camera can be completed based on the consistent clock moment. However, the synchronization accuracy of this solution depends on the accuracy of network timing. When the network condition is poor, such as through multi-level network routing or when the data load is large, the network timing of each camera cannot be guaranteed to be completely consistent, and it is impossible to accurately synchronize and trigger the camera exposure through network timing.

[0099] The embodiment of the present invention provides a possible multi-channel camera synchronization method, where each camera is exposed under the control of a pulse signal, but the exposure time may not be synchronized. Therefore, each camera is set to pass the timing of the timing system, and perform sampling based on the same sampling instruction under its own clock system, so as to determine whether the order of the exposure time of each camera under the control of the pulse signal is different. If there is a difference in order, targeted adjustments can be made to achieve synchronous exposure of each camera.

[0100] The multi-camera synchronization method provided in the embodiment of the present invention is applicable to a multi-camera system that is driven for exposure by a pulse signal; wherein the frequency of the pulse signal is higher than the exposure frequency of any camera in the multi-camera system and is an integer multiple of the exposure frequency of any camera, and the exposure frequencies of the cameras in the multi-camera system may be the same or different, and the embodiment of the present invention does not impose any limitation on this.

[0101] The following takes the case where the exposure frequencies of the cameras in the multi-camera system are the same as an example to explain why the frequency of the pulse signal is set to be higher than the exposure frequency of any camera in the multi-camera system in the embodiment of the present invention.

[0102] Figure 1a FIG. 1 is a schematic diagram showing the exposure conditions of each camera when the frequency of the pulse signal and the exposure frequency of each camera are equal. Figure 1a In the figure, the pulse signal has a period of 10ms and a frequency of 100Hz; the exposure period of the master camera is also 10ms and the exposure frequency is 100Hz; the exposure period of the slave camera is also 10ms and the exposure frequency is 100Hz. It can be found that under this relationship, when the master camera and the slave camera receive the same pulse signal, the exposure time is always consistent, and synchronous exposure can be achieved. In this case, there is no need to further adjust the exposure time of each camera.

[0103] When the frequency of the pulse signal is lower than the exposure frequency of each camera, each camera can also achieve synchronous exposure. Figure 1b FIG. 1 is a schematic diagram showing the exposure conditions of each camera when the frequency of the pulse signal is less than the exposure frequency of each camera. Figure 1b In the figure, the pulse signal has a period of 10ms and a frequency of 100Hz; the exposure period of the master camera is 8ms and the exposure frequency is 125Hz; the exposure period of the slave camera is also 8ms and the exposure frequency is 125Hz. It can be found that under this relationship, when the master camera and the slave camera receive the same pulse signal, the exposure time is always consistent, and synchronous exposure can be achieved. In this case, there is no need to further adjust the exposure time of each camera.

[0104] However, in actual use, it is difficult to ensure that the frequency of the pulse signal is equal to or less than the exposure frequency of each camera. There may be a situation where the frequency of the pulse signal is greater than the exposure frequency of each camera, such as Figure 1c As shown. Figure 1cIn the figure, the pulse signal has a signal period of 10ms and a frequency of 100Hz; the exposure period of the master camera is 40ms and the exposure frequency is 25Hz; the exposure period of the slave camera is 40ms and the exposure frequency is 25Hz. It can be found that under this relationship, when the master camera and the slave camera receive the same pulse signal, the exposure time of the master camera and the slave camera may be different. Because if it is assumed that the master camera and the slave camera are both exposed on the rising edge of the pulse signal, there are 4 rising edges of the pulse signal in one exposure cycle. The master camera and the slave camera are likely to be exposed on different rising edges, resulting in different exposure times of the two.

[0105] If each camera only uses a timing method such as network timing, GPS timing, etc. to trigger exposure, due to timing errors and clock errors, it is very likely that the clock times of each camera will be inconsistent, so synchronous exposure cannot be triggered.

[0106] In summary, the embodiment of the present invention combines pulse signal triggered exposure and timing, and improves the two methods at the same time. The final solution solves the problem of asynchronous exposure of each camera in a multi-camera system. The applicable scenario is that the frequency of the pulse signal is higher than the exposure frequency of any camera in the multi-camera system and is an integer multiple of the exposure frequency of any camera. In such a scenario, there is an error in the exposure time between cameras. Then, by sampling each camera based on the same sampling instruction under its own clock system, it can be determined whether the order of the exposure time of each camera under the control of the pulse signal is different. If there is a difference in order, targeted adjustments can be made to achieve synchronous exposure of each camera.

[0107] Figure 2 A system architecture provided by an embodiment of the present invention is shown, under which the multi-channel camera synchronization method provided by an embodiment of the present invention can be executed.

[0108] A multi-camera system includes a master camera and one or more slave cameras. Figure 2 The main camera 100, the slave camera 200, the slave camera 300, the timing system 400 and the pulse signal generator 500 are exemplarily shown. The main camera 100, the slave camera 200 and the slave camera 300 receive the same pulse signal and perform exposure under the control of the pulse signal. At the same time, the main camera 100, the slave camera 200 and the slave camera 300 are all timed by the timing system.

[0109] The timing systems used by the master camera 100, the slave camera 200 and the slave camera 300 may be the same or different, for example, the master camera 100 uses network timing, and the slave camera 200 and the slave camera 300 use GPS timing; or the master camera 100 and the slave camera 200 use network timing, and the slave camera 300 uses GPS timing; or the master camera 100, the slave camera 200 and the slave camera 300 all use network timing, but they are connected to different network timing systems. The embodiment of the present invention is not limited to this.

[0110] Among them, the pulse signal generated by the pulse signal generator is synchronously transmitted to the main camera 100, the slave camera 200 and the slave camera 300. In one possible implementation, the pulse signal generator generates a high-voltage signal, which is converted into a low-voltage signal after being transmitted to the camera (the main camera 100, the slave camera 200 or the slave camera 300). Then, no matter how far or near the distance between the pulse signal generator and each camera is, the pulse signal will not be disturbed by the external environment during the transmission to the camera, so that the pulse signal received by each camera (the main camera 100, the slave camera 200 and the slave camera 300) can remain consistent. In another possible implementation, the pulse signal generator generates a low-voltage signal and transmits the low-voltage signal to each camera. Then, in order to ensure that the pulse signals received by each camera are consistent, the distance between the pulse signal generator and each camera can be set to be equal. The above is only an example, and the embodiments of the present invention are not limited to this.

[0111] The master camera and the slave camera can communicate via a network, for example, the master camera transmits a sampling instruction to the slave camera via a network; or a master control component in a multi-camera system transmits a sampling instruction to the master camera and the slave camera via a network. This embodiment of the present invention is not limited to this.

[0112] Figure 3 A possible multi-channel camera synchronization method provided by an embodiment of the present invention is shown, including:

[0113] Step 301: The slave camera receives the sampling result of the master camera.

[0114] For each camera in the multi-camera system, the camera performs sampling at the sampling time under its own clock system based on the same sampling instruction of the multi-camera system, and determines the time difference between the sampling time and the exposure time under its own clock system, which is the sampling result of the camera. The exposure time is the Nth exposure time before the sampling time of each camera.

[0115] The sampling instruction may be issued by a main camera or by a master control component in a multi-camera system, and this is not limited in the embodiment of the present invention.

[0116] For example, a multi-camera system includes a master camera and a slave camera, and the master camera and the slave camera use the same network timing system for network timing. However, due to network delay, timing errors are generated, and due to hardware differences between the master camera and the slave camera, clock errors are generated during operation, which ultimately leads to inconsistency between the times of the master camera and the slave camera under their own clock systems. For example, the master camera displays 10:00 and the slave camera displays 10:01. This is only an example. In actual production, the error between the master and slave cameras may not be so large.

[0117] For example, the master camera sends a sampling instruction to the slave camera at 9:55 according to the master camera's clock, and the sampling instruction is: sampling at 10:00. Then the slave camera that receives the instruction will sample at 10:00 according to its own clock system. The master camera will also sample at 10:00 according to its own clock system. That is, each camera in the multi-camera system will sample based on the same sampling instruction.

[0118] However, for any camera, sampling at 10:00 in its own clock system does not mean that the sampling time is 10:00 in its own clock system. For any camera, the central processing unit (CPU) of the camera sends a sampling signal at 10:00 in its own clock system. The time when the coprocessor receives the sampling signal and performs sampling may not be 10:00 in its own clock system. For example, it may be 10:01 in its own clock system. This is the response time difference of the camera. Different cameras have different sensitivity to the sampling signal due to different hardware structures, so there is a response error between different cameras.

[0119] In summary, when the master camera and the slave camera receive the same sampling instruction, they will perform sampling based on the same sampling instruction under their respective clock systems. However, due to the timing error, clock error and response error of the master camera and the slave camera, the actual sampling time of the two cameras may not be simultaneous, but sequential. For the convenience of introduction, the embodiment of the present invention uses the sum of the timing error, clock error and response error of the master camera and the slave camera as "sampling error" for description.

[0120] For any camera, the time difference between the sampling time and the exposure time is determined at the sampling time, and the exposure time refers to the Nth exposure time before the sampling time. Figure 4a The relationship between the sampling time and the exposure time is shown as Figure 4aAs shown, the sampling of the master camera and the slave camera is performed successively, and there is a sampling error between the two. For the master camera, its corresponding exposure time is the first exposure time before the sampling time of the master camera, or the second exposure time before the sampling time of the master camera; for the slave camera, its corresponding exposure time is the first exposure time before the sampling time of the slave camera, or the second exposure time before the sampling time of the slave camera. The above is only an example, and the embodiment of the present invention does not limit this.

[0121] For the same camera, the time difference corresponding to different exposure moments is naturally different; for different cameras, the relationship between the exposure moment and the sampling moment selected by the two should be the same. For example, if the sampling result of the main camera is the time difference between the sampling moment of the main camera and the first exposure moment before the sampling moment of the main camera, then the sampling result of the slave camera is the time difference between the sampling moment of the slave camera and the first exposure moment before the sampling moment of the slave camera; if the sampling result of the main camera is the time difference between the sampling moment of the main camera and the second exposure moment before the sampling moment of the main camera, then the sampling result of the slave camera is the time difference between the sampling moment of the slave camera and the second exposure moment before the sampling moment of the slave camera; if the sampling result of the main camera is the time difference between the sampling moment of the main camera and the third exposure moment before the sampling moment of the main camera, then the sampling result of the slave camera is the time difference between the sampling moment of the slave camera and the third exposure moment before the sampling moment of the slave camera. The above is only an example, and the embodiment of the present invention is not limited to this.

[0122] For the convenience of introduction, the method provided by the embodiment of the present invention is introduced by taking the exposure moment closest to the sampling moment, that is, the first exposure moment before the sampling moment, as an example.

[0123] It is worth noting that the exposure moment described in the embodiment of the present invention can be the exposure start moment, the exposure end moment, or the moment when the image is read from the sensor, that is, any action in an exposure process can be triggered by the rising edge of the pulse signal, and the embodiment of the present invention does not limit this.

[0124] The main camera determines the sampling result of the main camera: the time difference between the sampling moment of the main camera and the first exposure moment of the main camera before the sampling moment of the main camera; the slave camera determines the sampling result of the slave camera: the time difference between the sampling moment of the slave camera and the first exposure moment of the slave camera before the sampling moment of the slave camera. Figure 4b A schematic diagram showing a sampling result of a master camera and a sampling result of a slave camera provided by an embodiment of the present invention is shown.

[0125] The master camera sends the sampling result of the master camera to the slave camera, so that the slave camera receives the sampling result of the master camera.

[0126] Step 302: The slave camera determines whether there is a chronological relationship between the slave camera and the master camera in terms of exposure timing according to the sampling result of the slave camera, the sampling result of the master camera, and the signal period of the pulse signal; if there is such a chronological relationship, the pulse signal received by the slave camera is adjusted so that the slave camera and the master camera can be exposed synchronously.

[0127] Each camera in a multi-camera system can periodically use the same timing system for clock timing, such as the same network timing system for timing. By adjusting the timing frequency and the hardware structure of each camera, the sampling error (the sum of the timing error, clock error and response error) can be controlled to be less than half of the signal period of the pulse signal. For example, if the signal period of the pulse signal is 10ms, the sampling error is less than 5ms.

[0128] It is understandable that the higher the frequency of timing, the smaller the timing error; the more similar the hardware structures of each camera are, the smaller the clock error and response error are.

[0129] In some embodiments, before performing step 301, the sampling error between each camera in the multi-camera system may be measured. If the sampling error between the master camera and any slave camera is not less than half of the signal period of the pulse signal, the master camera or the slave camera is calibrated. This is continued until the sampling error between the master camera and any slave camera in the multi-camera system is less than half of the signal period of the pulse signal. Since the sampling error is less than half of the signal period of the pulse signal, the slave camera compares the relationship between the sampling result of the slave camera, the sampling result of the master camera and the signal period of the pulse signal, and can accurately determine whether there is a sequential relationship between the slave camera and the master camera in terms of exposure timing. If there is such a sequential relationship, the pulse signal received by the slave camera is adjusted so that the slave camera and the master camera can achieve synchronous exposure.

[0130] Specifically, if the absolute value of the difference between the sampling result of the slave camera and the sampling result of the master camera is less than half of the signal period, it is determined that the slave camera and the master camera are exposure synchronized in exposure timing;

[0131] If the absolute value of the difference between the sampling result of the slave camera and the sampling result of the master camera is greater than or equal to half of the signal period, it is determined that there is a sequential relationship between the slave camera and the master camera in terms of exposure timing.

[0132] If the slave camera and the master camera are exposed synchronously, then due to the existence of sampling error, the difference between the sampling result of the master camera and the sampling result of the slave camera should be the value of the sampling error, and the value of the sampling error has been limited to be less than half of the signal period of the pulse signal. So conversely, when the slave camera determines that the absolute value of the difference between the sampling result of the slave camera and the sampling result of the master camera is less than half of the signal period, it can be deduced that the slave camera and the master camera are exposed synchronously.

[0133] If the slave camera and the master camera have a sequential relationship in exposure timing, then due to the existence of sampling error and exposure period, the difference between the sampling result of the master camera and the sampling result of the slave camera should be the sum of the sampling error and the exposure period, and the sampling error value has been limited to be less than half of the signal period of the pulse signal. So conversely, when the slave camera determines that the absolute value of the difference between the sampling result of the slave camera and the sampling result of the master camera is greater than or equal to half of the signal period, it can be deduced that the slave camera and the master camera have a sequential relationship in exposure timing.

[0134] The solution of the embodiment of the present invention is described in detail below through a specific embodiment.

[0135] Figure 5a The schematic diagram shows that the master camera and the slave camera are exposed under the control of the same pulse signal. The multi-camera system includes a master camera A and a slave camera B. The master camera A and the slave camera B receive the same pulse signal and are exposed under the control of the pulse signal. The signal period of the pulse signal is 10ms and the frequency is 100Hz; the exposure period of the master camera A is 40ms and the exposure frequency is 25Hz; the exposure period of the slave camera B is 40ms and the exposure frequency is 25Hz. The end time of exposure of the master camera corresponds to the synchronization signal N_1, the synchronization signal M_1, etc.; the end time of exposure of the slave camera corresponds to the synchronization signal N_2, the synchronization signal M_2, etc. It can be seen that the master camera and the slave camera are not exposed synchronously, but the slave camera cannot determine which synchronization signal the master camera is exposed at, and it cannot determine whether the master camera and the slave camera are exposed synchronously.

[0136] The master camera and the slave camera perform sampling based on the same sampling instruction under their respective clock systems, but due to the existence of sampling errors, there is a difference in the sampling times of the two cameras.

[0137] The master camera determines that the sampling result of the master camera is 26ms, which is phase_a in the figure; the slave camera determines that the sampling result of the slave camera is 20.5ms, which is phase_b in the figure; the master camera sends the sampling result of the master camera to the slave camera. The slave camera calculates the difference between the sampling result of the slave camera and the sampling result of the master camera: phase_b-phase_a=-5.5ms.

[0138] Since in this example, half of the signal period of the pulse signal is 5 ms, and the absolute value of the difference between the sampling result of the slave camera and the sampling result of the master camera is greater than half of the signal period, it is determined that there is a chronological relationship between the slave camera and the master camera in terms of exposure timing.

[0139] So does the exposure timing of the slave camera precede or lag behind that of the master camera? If it precedes the master camera, how many signal cycles does it precede? If it lags behind the master camera, how many signal cycles does it lag behind? How to adjust the pulse signal received by the slave camera?

[0140] The embodiment of the present invention provides a possible method: determining the number of cycles by which the slave camera advances or lags behind the master camera in exposure timing according to the relationship between the difference between the sampling result of the slave camera and the sampling result of the master camera and a multiple of half of the signal period; and adjusting the pulse signal received by the slave camera according to the number of cycles by which the slave camera advances or lags behind.

[0141] Specifically, if the value of the sampling result of the slave camera minus the sampling result of the master camera is greater than -T / 2 and less than T / 2, the exposure time of the slave camera is the same as the exposure time of the master camera; T is the signal period;

[0142] If the value obtained by subtracting the sampling result of the master camera from the sampling result of the slave camera is greater than or equal to wT / 2 and less than (w+2)T / 2, the exposure time of the slave camera is ahead of the exposure time of the master camera by a number of signal cycles of (w+1) / 2; w is an integer greater than or equal to 1;

[0143] If the value of the sampling result of the slave camera minus the sampling result of the master camera is less than or equal to -wT / 2 and greater than -(w+2)T / 2, the exposure time of the slave camera lags behind the exposure time of the master camera by the number of signal cycles of (w+1) / 2.

[0144] For example, in Figure 5aIn the example, if the value of the sampling result of the slave camera minus the sampling result of the main camera is greater than -5ms and less than 5ms, the exposure time of the slave camera is the same as the exposure time of the main camera; if the value of the sampling result of the slave camera minus the sampling result of the main camera is greater than or equal to 5 and less than 15, the exposure time of the slave camera is 1 signal cycle ahead of the exposure time of the main camera; if the value of the sampling result of the slave camera minus the sampling result of the main camera is greater than or equal to 15 and less than 25, the exposure time of the slave camera is 2 signal cycles ahead of the exposure time of the main camera; if the value of the sampling result of the slave camera minus the sampling result of the main camera is less than or equal to -5 and greater than -15, the exposure time of the slave camera lags behind the exposure time of the main camera by 1 signal cycle; if the value of the sampling result of the slave camera minus the sampling result of the main camera is less than or equal to -15 and greater than -25, the exposure time of the slave camera lags behind the exposure time of the main camera by 2 signal cycles.

[0145] Then in Figure 5a In the example, it is known that the difference between the sampling result of the slave camera and the sampling result of the master camera is -5.5 ms, so it can be known that the exposure time of the slave camera lags behind the exposure time of the master camera by 1 signal cycle.

[0146] After determining the number of cycles that the slave camera is ahead or behind, the pulse signal received from the camera can be adjusted. Figure 5b A possible method of adjusting a pulse signal received from a camera is shown, comprising:

[0147] Step 501, the slave camera determines that the exposure moment of the slave camera corresponds to the Xth periodic wave in the group pulse wave; the pulse signal includes multiple groups of pulse waves; the group pulse wave includes N periodic waves; the frequency of the pulse signal is N times the exposure frequency of the master camera;

[0148] Step 502: If the slave camera determines that the exposure moment of the slave camera lags behind the exposure moment of the master camera by M cycles, the XMth cycle wave in the group of pulse waves is retained, and the remaining cycle waves are removed, thereby obtaining an adjusted pulse signal; or, if the slave camera determines that the exposure moment of the slave camera is ahead of the exposure moment of the master camera by M cycles, the X+Mth cycle wave in the group of pulse waves is retained, and the remaining cycle waves are removed, thereby obtaining an adjusted pulse signal.

[0149] The pulse signal is divided into multiple groups of pulse waves according to the exposure frequency of the main camera, for example Figure 5aIn the example, the exposure frequency of the main camera is 25 Hz, the frequency of the pulse signal is 100 Hz, and the frequency of the pulse signal is 4 times the exposure frequency of the main camera, that is, 4 signal cycles of the pulse signal correspond to one exposure cycle of the main camera. If the pulse signal corresponding to one signal cycle in the pulse signal is named as a periodic wave, and each of the 4 periodic waves in the pulse signal is named as a group pulse wave, then the pulse signal includes multiple group pulse waves, and each group pulse wave includes 4 periodic waves.

[0150] exist Figure 5a In the example, the slave camera determines that the exposure moment of the slave camera corresponds to the second period wave in the group pulse wave, that is, the synchronization signal N_2. The slave camera also determines that the exposure moment of the slave camera lags behind the master camera by one signal period, so it can be determined that the master camera is exposed at the synchronization signal N_1. Therefore, the following operation is performed on each group pulse wave in the pulse signal: retain the first period wave in the group pulse wave, remove the remaining period waves, and thus obtain the adjusted pulse signal. Figure 5a In the example, N_1 in the first group of pulse waves is retained, and N_2, N_3 and N_4 are leveled; M_1 in the second group of pulse waves is retained, and M_2, M_3 and M_4 are leveled... to obtain the adjusted pulse signal from the camera.

[0151] Figure 5c A comparison diagram of a possible pulse signal after adjustment and a pulse signal before adjustment is shown.

[0152] Figure 5d The schematic diagram shows that the main camera is exposed according to the received pulse signal (i.e., the pulse signal before adjustment) and the slave camera is exposed according to the adjusted pulse signal. The slave camera is exposed according to the adjusted pulse signal, and can also be exposed at the first cycle wave of each group of pulse waves, so that the main camera and the slave camera are exposed synchronously.

[0153] The solution of the embodiment of the present invention is described in detail below through a specific embodiment.

[0154] Figure 5eThe schematic diagram shows that the master camera and the slave camera are exposed under the control of the same pulse signal. The multi-camera system includes a master camera A and a slave camera B. The master camera A and the slave camera B receive the same pulse signal and are exposed under the control of the pulse signal. The signal period of the pulse signal is 10ms and the frequency is 100Hz; the exposure period of the master camera A is 40ms and the exposure frequency is 25Hz; the exposure period of the slave camera B is 40ms and the exposure frequency is 25Hz. The end time of exposure of the master camera corresponds to the synchronization signal N_2, the synchronization signal M_2, etc.; the end time of exposure of the slave camera corresponds to the synchronization signal N_1, the synchronization signal M_1, etc. It can be seen that the master camera and the slave camera are not exposed synchronously, but the slave camera cannot determine which synchronization signal the master camera is exposed at, and it cannot determine whether the master camera and the slave camera are exposed synchronously.

[0155] The master camera and the slave camera perform sampling based on the same sampling instruction under their respective clock systems, but due to the existence of sampling errors, there is a difference in the sampling times of the two cameras.

[0156] The master camera determines that the sampling result of the master camera is 16ms, which is phase_a in the figure; the slave camera determines that the sampling result of the slave camera is 24.5ms, which is phase_b in the figure; the master camera sends the sampling result of the master camera to the slave camera. The slave camera calculates the difference between the sampling result of the slave camera and the sampling result of the master camera: phase_b-phase_a=8.5ms.

[0157] Since in this example, half of the signal period of the pulse signal is 5 ms, and the absolute value of the difference between the sampling result of the slave camera and the sampling result of the master camera is greater than half of the signal period, it is determined that there is a chronological relationship between the slave camera and the master camera in terms of exposure timing.

[0158] Then, if it is determined that the value of the sampling result of the slave camera minus the sampling result of the master camera is greater than or equal to 5 and less than 15, the exposure time of the slave camera is ahead of the exposure time of the master camera by 1 signal cycle.

[0159] The pulse signal is divided into multiple groups of pulse waves according to the exposure frequency of the main camera, for example Figure 5e In the example, the exposure frequency of the main camera is 25 Hz, the frequency of the pulse signal is 100 Hz, and the frequency of the pulse signal is 4 times the exposure frequency of the main camera, that is, 4 signal cycles of the pulse signal correspond to one exposure cycle of the main camera. If the pulse signal corresponding to one signal cycle in the pulse signal is named as a periodic wave, and each of the 4 periodic waves in the pulse signal is named as a group pulse wave, then the pulse signal includes multiple group pulse waves, and each group pulse wave includes 4 periodic waves.

[0160] exist Figure 5eIn the example, the slave camera determines that the exposure moment of the slave camera corresponds to the first period wave in the group pulse wave, that is, the synchronization signal N_1. The slave camera also determines that the exposure moment of the slave camera is one signal period ahead of the master camera, so it can be determined that the master camera is exposed at the synchronization signal N_2. Therefore, the following operation is performed on each group pulse wave in the pulse signal: retain the second period wave in the group pulse wave, remove the remaining period waves, and thus obtain the adjusted pulse signal. Figure 5e In the example, N_2 in the first group of pulse waves is retained, and N_1, N_3 and N_4 are leveled; M_2 in the second group of pulse waves is retained, and M_1, M_3 and M_4 are leveled... to obtain the adjusted pulse signal from the camera.

[0161] Figure 5f A comparison diagram of a possible pulse signal after adjustment and a pulse signal before adjustment is shown.

[0162] The slave camera performs exposure according to the adjusted pulse signal, and can also achieve exposure at the second cycle wave of each group of pulse waves, so that the master camera and the slave camera achieve synchronous exposure.

[0163] In some embodiments, the signal period of the pulse signal is unstable and fluctuates. For example, the signal period is 10 ms for a period of time, 11 ms for another period of time, and 9 ms for another period of time.

[0164] In order to prevent the unstable pulse signal from affecting the camera synchronization method provided by the embodiment of the present invention, the sampling results of the master camera and the sampling results of the slave camera are normalized.

[0165] Specifically, the slave camera determines whether there is a sequential relationship between the slave camera and the master camera in terms of exposure timing according to the sampling result of the slave camera, the sampling result of the master camera, and the signal period of the pulse signal, including:

[0166] The slave camera obtains a real-time exposure period of the slave camera and a real-time exposure period of the master camera; the slave camera determines whether there is a sequential relationship between the slave camera and the master camera in terms of exposure timing according to a relationship between a ratio of a sampling result of the slave camera to the real-time exposure period of the slave camera, a ratio of a sampling result of the master camera to the real-time exposure period of the master camera, and a ratio of the signal period to the real-time signal period.

[0167] Since the master camera and the slave camera receive the same pulse signal, when the pulse signal is unstable and the signal cycle fluctuates, the real-time exposure cycle of the master camera and the real-time exposure cycle of the slave camera will also change. Figure 5eIn the example, when the signal period of the pulse signal fluctuates from 10ms to 11ms, the real-time exposure period of the master camera fluctuates from 40ms to 44ms, and the real-time exposure period of the slave camera fluctuates from 40ms to 44ms. The slave camera determines whether there is a sequential relationship between the slave camera and the master camera in terms of exposure timing based on the relationship between the ratio of the sampling result of the slave camera to the real-time exposure period of the slave camera (24.5 / 44), the ratio of the sampling result of the master camera to the real-time exposure period of the master camera (16 / 44), and the ratio of the signal period to the real-time signal period (10 / 11).

[0168] In this way, the accuracy of the determined number of signal cycles by which the exposure moment of the slave camera leads or lags behind the exposure moment of the master camera is ensured.

[0169] In some embodiments, the exposure frequencies of the master camera and the slave camera may be the same or different, and the exposure frequency of the slave camera is an integer multiple of the exposure frequency of the master camera. Figure 5a and Figure 5e In the example, the exposure frequencies of the master camera and the slave camera are the same. The following describes an embodiment in which the exposure frequency of the slave camera is greater than the exposure frequency of the master camera.

[0170] The exposure frequency of the slave camera is K times the exposure frequency of the master camera; K is an integer greater than 1. The slave camera determines whether there is a sequential relationship between the slave camera and the master camera in terms of exposure timing according to the sampling result of the slave camera, the sampling result of the master camera and the signal period of the pulse signal, including:

[0171] The slave camera takes a decimal of the ratio of the sampling result of the master camera to the exposure period of the slave camera, and uses the obtained decimal as the corrected sampling result of the master camera; the slave camera determines the ratio of the sampling result of the slave camera to the exposure period of the slave camera as the corrected sampling result of the slave camera; the slave camera determines whether there is a chronological relationship between the slave camera and the master camera in terms of exposure timing according to the corrected sampling result of the slave camera, the corrected sampling result of the master camera and the signal period of the pulse signal.

[0172] Figure 6a A schematic diagram showing exposure of a master camera and a slave camera with different exposure frequencies provided by an embodiment of the present invention is shown.

[0173] The multi-camera system includes a master camera A and a slave camera B. The master camera A and the slave camera B receive the same pulse signal and are exposed under the control of the pulse signal. The signal period of the pulse signal is 10ms and the frequency is 100Hz; the exposure period of the master camera A is 40ms and the exposure frequency is 25Hz; the exposure period of the slave camera B is 20ms and the exposure frequency is 50Hz. The end time of exposure of the master camera corresponds to the synchronization signal N_1, the synchronization signal M_1, etc.; the end time of exposure of the slave camera corresponds to the synchronization signal N_2, the synchronization signal N_4, the synchronization signal M_2, the synchronization signal M_4, etc. It can be seen that the master camera and the slave camera are not exposed synchronously, but the slave camera cannot determine which synchronization signal the master camera is exposed at, and it cannot determine whether the master camera and the slave camera are exposed synchronously. And in this embodiment, one exposure of the master camera corresponds to two exposures of the slave camera.

[0174] The master camera and the slave camera perform sampling based on the same sampling instruction under their respective clock systems, but due to the existence of sampling errors, there is a difference in the sampling times of the two cameras.

[0175] The master camera determines that the sampling result of the master camera is 26ms, that is, phase_a in the figure; the slave camera determines that the sampling result of the slave camera is 0.5ms, that is, phase_b in the figure; the master camera sends the sampling result of the master camera to the slave camera.

[0176] The decimal of the ratio of the sampling result of the slave camera to the main camera and the exposure period of the slave camera is taken as the corrected sampling result of the main camera: 26ms / 20%1=1.3%1=0.3;

[0177] The slave camera determines the ratio of the sampling result of the slave camera to the exposure period of the slave camera as the corrected sampling result of the slave camera: 0.5ms / 20=0.025;

[0178] The slave camera subtracts the corrected sampling result of the slave camera from the corrected sampling result of the master camera to get -0.275;

[0179] The ratio of the pulse signal period to the exposure period of the slave camera is used as the correction signal period, and the number of periods by which the slave camera is ahead or behind the master camera in exposure timing is determined according to the relationship between the difference between the correction sampling result of the slave camera and the correction sampling result of the master camera and a multiple of half of the correction signal period.

[0180] For example, in Figure 6aIn the example, if the value of the corrected sampling result of the slave camera minus the corrected sampling result of the main camera is greater than -0.25 and less than 0.25, the exposure time of the slave camera is the same as the exposure time of the main camera; if the value of the corrected sampling result of the slave camera minus the corrected sampling result of the main camera is greater than or equal to 0.25 and less than 0.75, the exposure time of the slave camera is ahead of the exposure time of the main camera by 1 signal cycle; if the value of the corrected sampling result of the slave camera minus the corrected sampling result of the main camera is less than or equal to -0.25 and greater than -0.75, the exposure time of the slave camera lags behind the exposure time of the main camera by 1 signal cycle.

[0181] Then in Figure 6a In the example, it is known that the difference between the sampling result of the slave camera and the sampling result of the master camera is -0.275, so it can be known that the exposure time of the slave camera lags behind the exposure time of the master camera by 1 signal cycle.

[0182] The pulse signal is divided into multiple groups of pulse waves according to the exposure frequency of the main camera, for example Figure 6a In the example, the exposure frequency of the main camera is 25 Hz, the frequency of the pulse signal is 100 Hz, and the frequency of the pulse signal is 4 times the exposure frequency of the main camera, that is, 4 signal cycles of the pulse signal correspond to one exposure cycle of the main camera. If the pulse signal corresponding to one signal cycle in the pulse signal is named as a periodic wave, and each of the 4 periodic waves in the pulse signal is named as a group pulse wave, then the pulse signal includes multiple group pulse waves, and each group pulse wave includes 4 periodic waves.

[0183] exist Figure 6a In the example, the slave camera determines that the exposure moment of the slave camera corresponds to the second and fourth periodic waves in the group pulse wave, that is, the synchronization signals N_2 and N_4. The slave camera also determines that the exposure moment of the slave camera lags behind the master camera by one signal cycle. Therefore, the following operation is performed on each group pulse wave in the pulse signal: retain the first and third periodic waves in the group pulse wave, remove the remaining periodic waves, and thus obtain the adjusted pulse signal. Figure 6a In the example, N_1 and N_3 in the first group of pulse waves are retained, and N_2 and N_4 are leveled; M_1 and M_3 in the second group of pulse waves are retained, and M_2 and M_4 are leveled... to obtain the adjusted pulse signal from the camera.

[0184] Figure 6b A comparison diagram of a possible pulse signal after adjustment and a pulse signal before adjustment is shown.

[0185] The slave camera performs exposure according to the adjusted pulse signal, and can realize exposure at the first and third cycles of each group of pulse waves, wherein the exposure at the first cycle realizes synchronous exposure with the main camera. The slave camera only obtains one more image frame by exposing once at the third cycle, which does not affect the realization of synchronous exposure with the main camera.

[0186] For a multi-frame rate camera system, that is, a system with two or more frame rate cameras, the strategy is to set the low frame rate camera as the master camera. For other low frame rate slave cameras other than the master camera, the synchronization with the master camera can refer to Figure 5a and Figure 5e For high frame rate slave cameras, refer to Figure 6a The corresponding method in .

[0187] Optionally, the pulse signal is obtained by converting industrial frequency alternating current output by a power supply system of the multi-camera system.

[0188] Since the multi-camera system is connected to the power supply system, the industrial frequency AC power output by the power supply system is directly converted into a pulse signal through one of a variety of methods such as rectification and filtering, ADC sampling or comparator.

[0189] Figure 7 A possible conversion relationship diagram for converting industrial frequency alternating current into a pulse signal is shown. For industrial frequency alternating current, one cycle of alternating current can generate N synchronization signals, where N is an integer. For example, for 50 Hz industrial frequency alternating current, the synchronization signal is generally 100 Hz.

[0190] The multi-camera system generates pulse signals based on the industrial frequency AC power received. No additional wiring is required, the construction is simple, and the ability to resist external interference is strong. It also reduces the energy loss during the transmission of the pulse signal, so that even if the distance between the cameras is different, the frequency of the pulse signals received by the two cameras can be guaranteed to be consistent. It also maintains the advantage of mains synchronization, effectively obtains the status information of the signal lights, and can use street lights and other external light for supplementary lighting.

[0191] Figure 8 An exemplary system architecture applicable to an embodiment of the present invention is shown. The industrial frequency AC power delivered by the distribution box is transmitted to the master camera and the slave camera. Each camera converts the industrial frequency AC power into a pulse signal and performs exposure based on the pulse signal. The master camera and the slave camera communicate through a switch. All cameras are synchronized through a timing system, which includes but is not limited to network timing, GPS timing, etc.

[0192] Fig. 9The internal structure diagram of any camera provided by the embodiment of the present invention is shown, and the camera includes an industrial frequency alternating current processing unit, a coprocessor, a sensor, and a CPU.

[0193] The industrial frequency AC power processing unit is used to receive industrial frequency AC power, process it, obtain a pulse signal, and transmit the pulse signal to the coprocessor; the coprocessor controls the sensor to expose according to the pulse signal; the sensor transmits the video image obtained by exposure to the CPU for further processing. The coprocessor also receives the sampling signal from the CPU for sampling, and transmits the obtained sampling result to the CPU through the low-speed communication interface for further processing by the CPU.

[0194] If the camera is the master camera, the CPU will also generate a sampling instruction and transmit the sampling instruction to the slave camera. The CPU will also generate a sampling signal at the indicated time of the sampling instruction and transmit it to the coprocessor so that the coprocessor can perform sampling. For example, if the current time of the master camera is 9:55 and the sampling instruction generated by the CPU is: perform sampling at 10:00, then the CPU will generate a sampling signal at 10:00 under the clock system of the master camera and transmit it to the coprocessor so that the coprocessor can perform sampling.

[0195] If the camera is a slave camera, the central processor will also receive the sampling instruction of the main camera, generate a sampling signal at the indicated time of the sampling instruction and transmit it to the coprocessor so that the coprocessor can perform sampling. The central processor will also receive the sampling result of the main camera sent by the main camera, and determine the scheme for adjusting the pulse signal in combination with the sampling result of the slave camera, so that the coprocessor can adjust the received pulse signal according to the adjustment scheme. Another possible scheme that can be understood is that the central processor can receive the sampling result of the main camera sent by the main camera, and then transmit the sampling result of the main camera to the coprocessor. The coprocessor combines the sampling result of the main camera and the sampling result of the slave camera to determine the scheme for adjusting the pulse signal, and adjust the received pulse signal according to the adjustment scheme.

[0196] Fig.10 A possible timing scheme is shown. Through the timing mechanism, the time of the master and slave cameras is kept consistent as much as possible, reducing the timing error.

[0197] The timing system starts timing. After the timing is completed, it determines whether the preset duration has been reached (for example, the timing frequency is set to once per hour). If the preset duration has been reached, it continues to determine whether there is a camera power failure in the system. If there is no camera power failure, the timing of each camera in the multi-camera system is performed; if there is a camera power failure, the timing is terminated. If the preset duration has not been reached, it continues to wait until the preset duration is reached.

[0198] Fig.11A possible camera synchronization method is shown, where the master camera sends a sampling instruction to the slave camera, or the master control component in the multi-camera system sends a sampling instruction to the master camera and the slave camera, or the master camera and the slave camera directly agree on the sampling time. For any camera in the multi-camera system, it is determined whether the sampling time indicated in the sampling instruction has been reached under its own clock system. If the sampling time indicated in the sampling instruction has been reached, the camera performs sampling based on the sampling time indicated in the sampling instruction under its own clock system. Then the master camera determines the sampling result of the master camera, and the slave camera determines the sampling result of the slave camera. The master camera sends the sampling result of the master camera to the slave camera, and the slave camera adjusts the pulse signal received by the slave camera according to the sampling result of the master camera and the sampling result of the slave camera.

[0199] Fig.12 A possible method for adjusting the pulse signal of a slave camera is shown. For each sampling of the master camera and the slave camera, the indicated time in the sampling instruction corresponding to the sampling result will be attached to the sampling result. For example, the master camera issues a sampling instruction at 9:55 under the clock system of the master camera: sampling at 10:00; then the CPU of the master camera will issue a sampling signal at 10:00 under its own clock system. Due to the response error, the coprocessor of the master camera will sample at 10:01 under its own clock system; after the slave camera receives the sampling instruction of the master camera, the CPU of the slave camera will issue a sampling signal at 10:00 under its own clock system. Due to the response error, the coprocessor of the slave camera will sample at 10:01 under its own clock system; the sampling result of the master camera will be attached with a label of "10:00"; the sampling result of the slave camera will be attached with a label of "10:00".

[0200] The reason for attaching tags is that the following situation may occur: due to network transmission delay, etc., the sampling result of the master camera is not sent to the slave camera immediately, but is sent to the slave camera after a period of time. At this time, the next sampling result of the master camera is also sent to the slave camera. Then, the slave camera may receive two sampling results at the same time. Therefore, the slave camera needs to identify the sampling result of the master camera according to the tag attached to it, so as to accurately compare the sampling results.

[0201] The slave camera determines whether it has received the sampling result of the master camera. If it has received the sampling result of the master camera, it determines whether the tag attached to the sampling result of the master camera is consistent with the tag attached to the sampling result of the slave camera. If they are consistent, it calculates the time difference between the sampling result of the slave camera and the sampling result of the master camera. According to the relationship between the time difference and the signal period, the pulse wave retained in the pulse signal is determined, thereby determining the adjusted pulse signal.

[0202] Based on the same technical concept, Fig.13The structure of a multi-channel camera synchronization device provided by an embodiment of the present invention is exemplarily shown, and the structure can execute the process of multi-channel camera synchronization. It is applicable to a multi-camera system that is driven by a pulse signal for exposure; the frequency of the pulse signal is higher than the exposure frequency of any camera in the multi-camera system and is an integer multiple of the exposure frequency of any camera.

[0203] like Fig.13 As shown, the device specifically includes:

[0204] The receiving unit 1301 is configured to:

[0205] The slave camera receives the sampling results of the master camera;

[0206] The processing unit 1302 is configured to:

[0207] The slave camera determines whether there is a sequential relationship between the slave camera and the master camera in terms of exposure timing according to the sampling result of the slave camera, the sampling result of the master camera and the signal period of the pulse signal; if there is the sequential relationship, adjusting the pulse signal received by the slave camera so that the slave camera and the master camera can achieve synchronous exposure;

[0208] Among them, the sampling result of each camera in the multi-camera system is the time difference between the sampling time and the exposure time determined by the camera under its own clock system based on the same sampling instruction of the multi-camera system; the exposure time is the Nth exposure time of each camera before the sampling time.

[0209] Optionally, the pulse signal is obtained by converting industrial frequency alternating current output by a power supply system of the multi-camera system.

[0210] Optionally, the multi-camera system periodically performs clock timing through the same timing system;

[0211] A sampling error between a sampling time of the master camera and a sampling time of the slave camera in the multi-camera system is less than half of a signal period of the pulse signal.

[0212] Optionally, the processing unit 1302 is specifically configured to:

[0213] If the absolute value of the difference between the sampling result of the slave camera and the sampling result of the master camera is less than half of the signal period, it is determined that the slave camera and the master camera are in exposure synchronization in exposure timing;

[0214] If the absolute value of the difference between the sampling result of the slave camera and the sampling result of the master camera is greater than or equal to half of the signal period, it is determined that there is a sequential relationship between the slave camera and the master camera in terms of exposure timing.

[0215] Optionally, the processing unit 1302 is specifically configured to:

[0216] Determine the number of cycles by which the slave camera is ahead of or behind the master camera in exposure timing according to a relationship between a difference between a sampling result of the slave camera and a sampling result of the master camera and a multiple of half of the signal period;

[0217] The pulse signal received from the camera is adjusted according to the number of leading or lagging cycles.

[0218] Optionally, the processing unit 1302 is specifically configured to:

[0219] The slave camera determines that the exposure moment of the slave camera corresponds to the Xth periodic wave in the group pulse wave; the pulse signal includes multiple groups of pulse waves; the group of pulse waves includes N periodic waves; the frequency of the pulse signal is N times the exposure frequency of the master camera;

[0220] If the slave camera determines that the exposure moment of the slave camera lags behind the exposure moment of the master camera by M cycles, the XMth cycle wave in the group of pulse waves is retained, and the remaining cycle waves are removed, thereby obtaining an adjusted pulse signal; or, if the slave camera determines that the exposure moment of the slave camera is ahead of the exposure moment of the master camera by M cycles, the X+Mth cycle wave in the group of pulse waves is retained, and the remaining cycle waves are removed, thereby obtaining an adjusted pulse signal.

[0221] Optionally, the exposure frequency of the slave camera is K times the exposure frequency of the master camera; K is an integer greater than 1;

[0222] The processing unit 1302 is specifically used for:

[0223] Taking a decimal of the ratio of the sampling result of the master camera by the slave camera to the exposure period of the slave camera, and using the obtained decimal as the corrected sampling result of the master camera;

[0224] The slave camera determines the ratio of the sampling result of the slave camera to the exposure period of the slave camera as the corrected sampling result of the slave camera;

[0225] The slave camera determines whether there is a sequential relationship between the slave camera and the master camera in terms of exposure timing according to the corrected sampling result of the slave camera, the corrected sampling result of the master camera, and the signal period of the pulse signal.

[0226] Optionally, the signal period of the pulse signal fluctuates;

[0227] The processing unit 1302 is specifically configured to:

[0228] The slave camera acquires the real-time exposure period of the slave camera and the real-time exposure period of the master camera;

[0229] The slave camera determines whether there is a chronological relationship between the slave camera and the master camera in terms of exposure timing according to a relationship between a ratio of a sampling result of the slave camera to a real-time exposure period of the slave camera, a ratio of a sampling result of the master camera to the real-time exposure period of the master camera, and a ratio of the signal period to the real-time signal period.

[0230] Based on the same technical concept, the embodiment of the present application provides a computer device, such as Fig.14 As shown, it includes at least one processor 1401 and a memory 1402 connected to the at least one processor. The specific connection medium between the processor 1401 and the memory 1402 is not limited in the embodiment of the present application. Fig.14 For example, the processor 1401 and the memory 1402 are connected via a bus. The bus can be divided into an address bus, a data bus, a control bus, etc.

[0231] In the embodiment of the present application, the memory 1402 stores instructions that can be executed by at least one processor 1401. The at least one processor 1401 can perform the steps of the above-mentioned multi-channel camera synchronization method by executing the instructions stored in the memory 1402.

[0232] Among them, the processor 1401 is the control center of the computer device, and can use various interfaces and lines to connect various parts of the computer device, and synchronize multiple cameras by running or executing instructions stored in the memory 1402 and calling data stored in the memory 1402. Optionally, the processor 1401 may include one or more processing units, and the processor 1401 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 1401. In some embodiments, the processor 1401 and the memory 1402 may be implemented on the same chip, and in some embodiments, they may also be implemented separately on independent chips.

[0233] Processor 1401 can be a general-purpose processor, such as a central processing unit (CPU), a digital signal processor, an application-specific integrated circuit (ASIC), a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, and can implement or execute the methods, steps and logic block diagrams disclosed in the embodiments of the present application. A general-purpose processor can be a microprocessor or any conventional processor, etc. The steps of the method disclosed in the embodiments of the present application can be directly embodied as a hardware processor for execution, or can be executed by a combination of hardware and software modules in the processor.

[0234] Memory 1402, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer executable programs and modules. Memory 1402 may include at least one type of storage medium, such as flash memory, hard disk, multimedia card, card-type memory, random access memory (Random Access Memory, RAM), static random access memory (Static Random Access Memory, SRAM), programmable read-only memory (Programmable Read Only Memory, PROM), read-only memory (Read Only Memory, ROM), electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, EEPROM), magnetic memory, disk, optical disk, etc. Memory 1402 is any other medium that can be used to carry or store a desired program code in the form of an instruction or data structure and can be accessed by a computer, but is not limited thereto. The memory 1402 in the embodiment of the present application can also be a circuit or any other device that can realize a storage function, for storing program instructions and / or data.

[0235] Based on the same technical concept, an embodiment of the present invention further provides a computer-readable storage medium, which stores a computer-executable program. The computer-executable program is used to enable a computer to execute the multi-channel camera synchronization method listed in any of the above-mentioned ways.

[0236] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0237] The present application is described with reference to the flowchart and / or block diagram of the method, device (system), and computer program product according to the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the process and / or box in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for implementing the function specified in one process or multiple processes in the flowchart and / or one box or multiple boxes in the block diagram.

[0238] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0239] These computer program instructions may also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0240] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A multi-channel camera synchronization method, characterized in that: A multi-camera system adapted for exposure driving by a pulse signal; the frequency of the pulse signal is higher than the exposure frequency of each camera in the multi-camera system and is an integer multiple of the exposure frequency of each camera; the multi-camera system includes a master camera and a slave camera, and the exposure frequency of the slave camera is an integer multiple of the exposure frequency of the master camera; the method includes: The slave camera receives the sampling results of the master camera; The slave camera determines whether there is a sequential relationship between the slave camera and the master camera in terms of exposure timing according to the sampling result of the slave camera, the sampling result of the master camera and the signal period of the pulse signal; if there is the sequential relationship, adjusting the pulse signal received by the slave camera so that the slave camera and the master camera can achieve synchronous exposure; Wherein, if the sequential relationship exists, the pulse signal received by the slave camera is adjusted, including: determining the number of cycles that the slave camera is ahead of or behind the master camera in exposure timing according to the relationship between the difference between the sampling result of the slave camera and the sampling result of the master camera and the multiple of half of the signal period; the slave camera determines that the exposure moment of the slave camera corresponds to the Xth cycle wave in the group pulse wave; the pulse signal includes multiple groups of pulse waves; the group pulse wave includes N cycle waves; the frequency of the pulse signal is N times the exposure frequency of the master camera; the slave camera determines that the exposure moment of the slave camera lags behind the exposure moment of the master camera by M cycles, then retains the XMth cycle wave in the group pulse wave, removes the remaining cycle waves, thereby obtaining an adjusted pulse signal, or, the slave camera determines that the exposure moment of the slave camera is ahead of the exposure moment of the master camera by M cycles, then retains the X+Mth cycle wave in the group pulse wave, removes the remaining cycle waves, thereby obtaining an adjusted pulse signal; The sampling result of each camera in the multi-camera system is the time difference between the sampling time and the exposure time determined by the camera under its own clock system based on the same sampling instruction of the multi-camera system; the exposure time is the Nth exposure time of each camera before the sampling time.

2. The method according to claim 1, characterized in that The pulse signal is obtained by converting the industrial frequency alternating current output by the power supply system of the multi-camera system.

3. The method according to claim 1, characterized in that The multi-camera system periodically performs clock timing through the same timing system; A sampling error between a sampling time of the master camera and a sampling time of the slave camera in the multi-camera system is controlled to be less than half of a signal period of the pulse signal.

4. The method according to claim 1, characterized in that The slave camera determines whether there is a sequential relationship between the slave camera and the master camera in terms of exposure timing according to the sampling result of the slave camera, the sampling result of the master camera, and the signal period of the pulse signal, including: If the absolute value of the difference between the sampling result of the slave camera and the sampling result of the master camera is less than half of the signal period, it is determined that the slave camera and the master camera are in exposure synchronization in exposure timing; If the absolute value of the difference between the sampling result of the slave camera and the sampling result of the master camera is greater than or equal to half of the signal period, it is determined that there is a sequential relationship between the slave camera and the master camera in terms of exposure timing.

5. The method according to claim 1, characterized in that The exposure frequency of the slave camera is K times the exposure frequency of the master camera; K is an integer greater than 1; The slave camera determines whether there is a sequential relationship between the slave camera and the master camera in terms of exposure timing according to the sampling result of the slave camera, the sampling result of the master camera, and the signal period of the pulse signal, including: Taking a decimal of the ratio of the sampling result of the master camera by the slave camera to the exposure period of the slave camera, and using the obtained decimal as the corrected sampling result of the master camera; The slave camera determines, by the ratio of the sampling result of the slave camera to the exposure period of the slave camera, as a corrected sampling result of the slave camera; The slave camera determines whether there is a sequential relationship between the slave camera and the master camera in terms of exposure timing according to the corrected sampling result of the slave camera, the corrected sampling result of the master camera, and the signal period of the pulse signal.

6. The method according to claim 1, characterized in that The signal period of the pulse signal fluctuates; The slave camera determines whether there is a sequential relationship between the slave camera and the master camera in terms of exposure timing according to the sampling result of the slave camera, the sampling result of the master camera, and the signal period of the pulse signal, including: The slave camera acquires the real-time exposure period of the slave camera and the real-time exposure period of the master camera; The slave camera determines whether there is a chronological relationship between the slave camera and the master camera in terms of exposure timing according to a relationship between a ratio of a sampling result of the slave camera to a real-time exposure period of the slave camera, a ratio of a sampling result of the master camera to the real-time exposure period of the master camera, and a ratio of the signal period to the real-time signal period.

7. A multi-channel camera synchronization device, characterized in that: A multi-camera system suitable for exposure driving by a pulse signal; the frequency of the pulse signal is higher than the exposure frequency of each camera in the multi-camera system and is an integer multiple of the exposure frequency of each camera, the multi-camera system includes a master camera and a slave camera, the exposure frequency of the slave camera is an integer multiple of the exposure frequency of the master camera; the device includes: Receiving unit, for: The slave camera receives the sampling results of the master camera; A processing unit for: The slave camera determines whether there is a sequential relationship between the slave camera and the master camera in terms of exposure timing according to the sampling result of the slave camera, the sampling result of the master camera and the signal period of the pulse signal; if there is the sequential relationship, adjusting the pulse signal received by the slave camera so that the slave camera and the master camera can achieve synchronous exposure; Wherein, the processing unit is specifically used to: determine the number of cycles that the slave camera is ahead of or behind the master camera in exposure timing according to the relationship between the difference between the sampling result of the slave camera and the sampling result of the master camera and the multiple of half of the signal period; the slave camera determines that the exposure moment of the slave camera corresponds to the Xth cycle wave in the group pulse wave; the pulse signal includes multiple groups of pulse waves; the group pulse wave includes N cycle waves; the frequency of the pulse signal is N times the exposure frequency of the master camera; the slave camera determines that the exposure moment of the slave camera lags behind the exposure moment of the master camera by M cycles, then retains the XMth cycle wave in the group pulse wave, removes the remaining cycle waves, so as to obtain an adjusted pulse signal, or, the slave camera determines that the exposure moment of the slave camera is ahead of the exposure moment of the master camera by M cycles, then retains the X+Mth cycle wave in the group pulse wave, removes the remaining cycle waves, so as to obtain an adjusted pulse signal; The sampling result of each camera in the multi-camera system is the time difference between the sampling time and the exposure time determined by the camera under its own clock system based on the same sampling instruction of the multi-camera system; the exposure time is the Nth exposure time of each camera before the sampling time.

8. A computing device, characterized in that include: Memory for storing computer programs; A processor, configured to call a computer program stored in the memory, and execute the method according to any one of claims 1 to 6 according to the obtained program.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer-executable program, and the computer-executable program is used to enable a computer to execute the method according to any one of claims 1 to 6.

Citation Information

Patent Citations

  • Method for generating external synchronizing signal of real-time error compensation of camera exposure control

    CN104506753A

  • Method, device and equipment for adjusting shutter triggering time of depth camera

    CN110087060A

  • Multi-camera exposure synchronous control system and method and unmanned aerial vehicle

    CN110445987A

  • Image exposure method and related device

    CN113473036A

  • Control method and device of image collection equipment, equipment and storage medium

    CN114071022A