Image acquisition method, device, medium and system
By acquiring the delay time of the slave device and performing time compensation, the problem of poor camera synchronization in the image acquisition system is solved, synchronous triggering between master and slave devices is realized, and the accuracy of image acquisition is improved.
Patent Information
- Application Number
- CN202210306196.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-03-25
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2042-03-25
AI Technical Summary
In image acquisition systems, different cameras have poor synchronization, resulting in poor accuracy of image acquisition.
By obtaining the delay time of the slave device, time compensation is performed based on channel transmission and decoding time, ensuring that the camera of the master and slave device is triggered simultaneously, and the delay time is determined using auxiliary trigger signals and auxiliary feedback signals to realize the Time consistency.
Improve the accuracy of image acquisition, ensure the synchronous trigger of the camera in the master and slave device, and solve the problem of acquisition out-of-synchronization caused by abnormal synchronization of synchronization signal transmission.
Smart Images

Figure CN114745512B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of image acquisition technology, and in particular to an image acquisition method, device, medium and system. Background Art
[0002] In the field of image acquisition technology, in order to realize multi-view and multi-directional feature acquisition of a target object, it is usually necessary to trigger multiple cameras in an image acquisition system to take photos of the target object. Currently, the cameras are usually triggered based on a trigger signal.
[0003] Among them, the master device and the slave device in the image acquisition system generate a trigger point after receiving the trigger signal corresponding to the image acquisition, and the camera performs image acquisition at the trigger point. Specifically, the master device outputs a pulse including the trigger signal, the slave device receives the pulse, and triggers the camera with the received pulse to achieve image acquisition of its own camera; at the same time, the master device also triggers the camera based on the pulse to achieve image acquisition of its own camera. However, when performing image acquisition based on this triggering method, the synchronization of different cameras in the system is poor, resulting in poor accuracy of image acquisition. Summary of the invention
[0004] In order to solve the above technical problems or at least partially solve the above technical problems, the present disclosure provides an image acquisition method, device, medium and system.
[0005] The present disclosure provides an image acquisition method, which is applied to an image acquisition system, wherein the system includes a master device and a slave device that is controlled to communicate with the master device, and the method is executed by the master device; the method includes:
[0006] Get the delay time of the slave device;
[0007] Send a trigger signal to the slave device;
[0008] Taking the time of sending the trigger signal to the slave device as the reference time point, the camera of the master device itself is triggered when the delay time is delayed.
[0009] Optionally, the system further comprises a master control device; the delay time is configured in the master control device;
[0010] The obtaining of the delay time of the slave device comprises:
[0011] When the master device is designated as the master device by the master control device, configuring the delay time;
[0012] or,
[0013] The delay time is retrieved from the master control device.
[0014] Optionally, obtaining the delay time of the slave device includes:
[0015] After receiving the trigger instruction of image acquisition, an auxiliary trigger signal is sent to the slave device;
[0016] receiving an auxiliary feedback signal returned by the slave device;
[0017] The delay time is determined based on the auxiliary feedback signal and the auxiliary trigger signal.
[0018] Optionally, the delay time is calculated based on channel distance and decoding time.
[0019] The present disclosure also provides an image acquisition method, which is applied to an image acquisition system, wherein the system includes a master device and a slave device that is controlled to communicate with the master device, and the method is executed by the slave device; the method includes:
[0020] Receive the auxiliary trigger signal sent by the main device;
[0021] Based on the auxiliary trigger signal, returning an auxiliary feedback signal to the main device;
[0022] The auxiliary feedback signal and the auxiliary trigger signal are used to determine the delay time.
[0023] Optionally, the method further comprises:
[0024] Receive the trigger signal and image frame number sent by the master device;
[0025] When it is determined based on the trigger signal and the image frame number that a trigger condition is met, the camera of the slave device itself is triggered.
[0026] Optionally, the method further comprises:
[0027] When it is determined based on the trigger signal and the image frame number that the trigger condition is not met, an error signal is generated;
[0028] Send an error signal.
[0029] The present disclosure also provides an image acquisition method, which is applied to an image acquisition system, wherein the system includes a master device and a slave device that is controlled to communicate with the master device, and the method is executed by the slave device; the method includes:
[0030] Receive the trigger signal and image frame number sent by the master device;
[0031] When it is determined based on the trigger signal and the image frame number that a trigger condition is met, the camera of the slave device itself is triggered.
[0032] Optionally, the method further comprises:
[0033] When it is determined based on the trigger signal and the image frame number that the trigger condition is not met, an error signal is generated;
[0034] Send an error signal.
[0035] Optionally, the trigger condition includes: a difference between a current image frame number and a previous image frame number is 1.
[0036] The present disclosure also provides an image acquisition method, which is applied to an image acquisition system, wherein the system includes a master device and a slave device that is controlled to communicate with the master device. The method is executed by the system, and includes:
[0037] The delay time for the master device to obtain the slave device;
[0038] The master device sends a trigger signal and an image frame number to the slave device;
[0039] The slave device receives the trigger signal and the image frame number, and triggers the camera of the slave device itself when determining based on the trigger signal and the image frame number that a trigger condition is met;
[0040] The master device uses the time when the trigger signal is sent to the slave device as a reference time point, and triggers the camera of the master device itself when the delay time is delayed.
[0041] The present disclosure also provides an image acquisition device, comprising:
[0042] The time acquisition module is used to obtain the delay time of the slave device;
[0043] A signal sending module, used for sending a trigger signal to a slave device;
[0044] The trigger module is used to trigger the camera of the master device itself when the delay time is delayed by taking the time of sending the trigger signal to the slave device as the reference time point.
[0045] The present disclosure also provides an image acquisition device, comprising:
[0046] A receiving module, used for receiving an auxiliary trigger signal sent by a main device;
[0047] A sending module, used for returning an auxiliary feedback signal to a main device based on the auxiliary trigger signal;
[0048] Wherein, the auxiliary feedback signal and the auxiliary trigger signal are used to determine the delay time.
[0049] The present disclosure also provides an image acquisition device, comprising:
[0050] A receiving module, used for receiving a trigger signal and an image frame number sent by a master device;
[0051] The trigger module is used to trigger the camera of the slave device itself when determining that the trigger condition is met based on the trigger signal and the image frame number.
[0052] The present disclosure also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the processor implements the steps of any of the above methods.
[0053] The present disclosure also provides an image acquisition system, comprising a master device and a slave device controlled to communicate with the master device;
[0054] The master device performs any of the steps of the above method performed by the master device;
[0055] The slave device executes any one of the steps of the above method executed by the slave device.
[0056] Optionally, the system further comprises a master control device;
[0057] The master device and the slave device are both in communication connection with the master control device;
[0058] The master control device is used to configure the delay time when designating the master device; and to receive error information when the slave device determines that the trigger condition is not met.
[0059] Compared with the prior art, the technical solution provided by the embodiments of the present disclosure has the following advantages:
[0060] The image acquisition method provided by the embodiment of the present disclosure is applied to an image acquisition system, the system includes a master device and a slave device that communicates with the master device under control, and the method is executed by the master device; the method includes: obtaining the delay time of the slave device; wherein the delay time includes the time required for channel transmission and decoding; taking the time of sending the trigger signal to the slave device as the reference time point, sending the trigger signal to the slave device; when the delay time is delayed, triggering the camera of the master device itself. Thus, by obtaining the time corresponding to the channel transmission and decoding of the slave device, and the master device delaying the delay time and then triggering its own camera, the master device autonomously compensates for the trigger time of its own camera, delays the trigger time of its own camera, to ensure that its trigger time is the same as the trigger time of the camera in the slave device, that is, synchronous triggering, thereby achieving the time consistency of image acquisition in the master and slave devices and improving the accuracy of image acquisition. BRIEF DESCRIPTION OF THE DRAWINGS
[0061] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.
[0062] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0063] Figure 1 A flowchart of an image acquisition method provided by an embodiment of the present disclosure;
[0064] Figure 2 A flowchart of another image acquisition method provided by an embodiment of the present disclosure;
[0065] Figure 3 A flowchart of another image acquisition method provided by an embodiment of the present disclosure;
[0066] Figure 4 A schematic diagram of the structure of an image acquisition device provided in an embodiment of the present disclosure;
[0067] Figure 5 A schematic diagram of the structure of another image acquisition device provided by an embodiment of the present disclosure;
[0068] Figure 6 A schematic diagram of the structure of an image acquisition system provided by an embodiment of the present disclosure;
[0069] Figure 7 A schematic diagram of the structure of another image acquisition system provided by an embodiment of the present disclosure;
[0070] Figure 8 A flowchart of an image acquisition method provided by an embodiment of the present disclosure;
[0071] Fig. 9 A flowchart of another image acquisition method provided in an embodiment of the present disclosure. DETAILED DESCRIPTION
[0072] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.
[0073] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.
[0074] The image acquisition method provided by the embodiment of the present disclosure is suitable for the process of synchronous image acquisition of multiple devices in an image acquisition system. It can ensure the synchronization of images acquired by the master device and the slave device performing image acquisition at the same time based on the compensation of delay time; specifically: it can detect the synchronization signal (including trigger signal, auxiliary trigger signal and auxiliary feedback signal) and the image acquisition frame rate (corresponding to the image frame number) in real time, and can adaptively compensate for the delay caused by channel transmission and decoding, and can report in time when frame rate error or asynchronism (such as loss of synchronization pulse) occurs, thereby completely solving the problem of asynchronism in acquisition caused by abnormal transmission of synchronization signal during image acquisition.
[0075] The following is an illustrative description of the image acquisition method, device, medium and system provided by the embodiments of the present disclosure in conjunction with the accompanying drawings.
[0076] Figure 1 A flow chart of an image acquisition method provided in an embodiment of the present disclosure is applied to an image acquisition system, the system includes a master device and a slave device that communicates with the master device and is controlled by the master device. The method is executed by the master device and is implemented based on software and / or hardware, which is not limited here.
[0077] like Figure 1 As shown, the method comprises the following steps:
[0078] S110, obtaining the delay time of the slave device.
[0079] The delay time includes the time required for channel transmission and decoding.
[0080] Specifically, after the master device outputs a trigger pulse, the slave device receives the trigger pulse to receive a trigger signal, triggers the camera based on the trigger signal, and enables the camera to capture images. The delay time of the slave device includes the time required for the trigger pulse to be transmitted (i.e., channel transmission) and decoded between the master device and the slave device, and the delay time also corresponds to the time difference of the slave device relative to the master device in the related art.
[0081] In this step, the delay time may be calculated based on the signal interaction process between the master and slave devices; or the stored delay time may be directly called or configured, which is not limited here and will be exemplified in the following text.
[0082] S120: Send a trigger signal to the slave device.
[0083] The trigger signal corresponds to a signal that triggers a camera in the slave device to acquire an image.
[0084] In this step, the master device sends a trigger signal to the slave device; correspondingly, the slave device receives the trigger signal and triggers the camera to capture images based on the trigger signal.
[0085] S130: Taking the time of sending the trigger signal to the slave device as a reference time point, triggering the camera of the master device itself when the delay time is delayed.
[0086] Among them, after the master device sends a trigger signal to the slave device and after a delay time, when the slave device receives the trigger signal and decodes it, the slave device triggers its own camera to acquire an image; synchronously, the master device triggers its own camera to acquire an image, thereby realizing synchronous image acquisition by the cameras in the master device and the slave device.
[0087] In some embodiments, the master device and the slave device may include, in addition to their respective cameras, respective projectors, which may be laser projectors, infrared projectors, or other types of projectors; wherein the projectors are used to project characteristic patterns, such as laser lines, or infrared spots, onto the area to be captured. Correspondingly, the cameras capture images including the characteristic patterns.
[0088] The camera and the projector can be linked, that is, when the projector is triggered, the camera is triggered accordingly, the camera and the projector can be triggered synchronously, or the camera is triggered a certain time later than the projector, the camera and the projector can be linked based on hardware control, or the two can be linked based on software program control, which is not limited here. At this time, the linkage between the camera and the projector is taken into account, and through time compensation, it is still ensured that the camera of the master device and the camera of the slave device are triggered synchronously to achieve synchronous image acquisition.
[0089] In some embodiments, the camera and projector of the master device are triggered synchronously with the camera and projector of the slave device, that is, the projector of the master device and the projector of the slave device will also perform delay compensation synchronously, and are associated with the synchronous compensation of their respective cameras, that is, they are synchronized or advanced by a certain time.
[0090] In some embodiments, the master device and the slave device may further include respective corresponding lighting devices, such as LED lights. The lighting devices are used to illuminate the marking points on the surface of the object in the area to be collected, so as to increase the brightness of the marking points, and to increase the contrast between the image corresponding to the marking points and the image corresponding to the surrounding environment, thereby improving the accuracy of subsequent data processing.
[0091] The lighting device of the master device and the lighting device of the slave device can also be triggered synchronously, and delay compensation will be performed synchronously. Optionally, the camera, projector and lighting device of the same device are all triggered synchronously, so delay compensation will be performed synchronously to ensure synchronization between the master and slave devices.
[0092] In some embodiments, when there is no linkage between the camera, projector and lighting device in the same device, but they can be triggered independently, the cameras between the master and slave devices perform delay compensation based on the above-mentioned delay time to ensure synchronous image capture, and the projector and lighting device are triggered before capture to ensure normal capture, which is not limited here.
[0093] In the embodiment of the present disclosure, by acquiring the delay time of the slave device, the delay time includes the time required for channel transmission and decoding; and triggering the camera of the master device itself to perform image acquisition when the delay time is delayed from the delay time after the trigger signal is sent to the slave device, the cameras in the master device and the slave device can synchronously acquire images; wherein the delay time is utilized to compensate for the delay time caused by signal transmission and decoding, so that the synchronization between the master and slave devices is better, thereby the accuracy of image acquisition is higher.
[0094] In some embodiments, the system further comprises a master control device. The delay time can be pre-configured in the master control device.
[0095] The delay time may be calculated from the experimentally obtained fixed channel distance time and decoding time, or may be obtained in advance by other methods and configured in the master control device for use in time compensation.
[0096] Based on this, Figure 1 On the basis of, S110 may specifically include:
[0097] When the master device is designated as the master device, configure the delay time;
[0098] Alternatively, call up the delay time from the master control device.
[0099] Specifically, the image acquisition system may include a plurality of different image acquisition devices, and the number of image acquisition devices may be two, three or more, which is not limited here. The master control device may designate one of the image acquisition devices as the master device, and the remaining image acquisition devices as slave devices; and configure the delay time when designating the master device, or after designating the master device. Thus, the delay time can be directly configured based on computer instructions. After receiving the computer instruction, the master device first sends a trigger signal to the slave device, and then triggers its own camera after the delay time. This method can also compensate for the synchronization error caused by channel transmission and decoding between the master device and the slave device, thereby ensuring quasi-synchronization of image acquisition.
[0100] Alternatively, the image acquisition system includes a pre-set master device and a slave device that communicates with the master device and is controlled by the master device; the master device can actively call the delay time from the master control device to perform delay compensation to ensure that the camera in the master device and the camera in the slave device are triggered synchronously, thereby ensuring quasi-synchronous image acquisition.
[0101] It can be understood that when the number of slave devices in the system is two, three or more, the delay times of all slave devices are equal; it can be understood that the master device is equivalent to a center, and all slave devices are on a circle with the center as the center.
[0102] The above takes the pre-configured delay time as an example to exemplify the method of obtaining the delay time. The following uses the interaction process between the master and slave devices as a reference to exemplify the process steps of the adaptive compensation method.
[0103] In some embodiments, Figure 1 On the basis of, S110 may specifically include:
[0104] After receiving the trigger instruction of image acquisition, an auxiliary trigger signal is sent to the slave device;
[0105] receiving an auxiliary feedback signal returned by the slave device;
[0106] The delay time is determined based on the auxiliary feedback signal and the auxiliary trigger signal.
[0107] The image acquisition trigger command is issued by the master control device, which instructs the master device and the slave device to synchronously acquire images. The auxiliary trigger signal is sent by the master device to the slave device, which is used to measure the delay time; the auxiliary feedback signal is returned from the slave device to the master device, which is used to measure the delay time together with the auxiliary trigger signal.
[0108] It can be understood that the auxiliary trigger signal can be a type of trigger signal, and the difference from the trigger signal is that it is not used to trigger the camera to capture images, but is used to measure the delay time; the auxiliary feedback signal can be a type of auxiliary trigger signal, and the difference from the auxiliary trigger signal is that it is not a signal sent from the master device to the slave device, but a signal sent from the slave device to the master device.
[0109] Specifically, the master device receives a trigger instruction for image acquisition issued by the master control device; after receiving the trigger instruction for image acquisition, the master device generates an auxiliary trigger signal and transmits the auxiliary trigger signal to the slave device; after receiving the auxiliary trigger signal, the slave device returns an auxiliary feedback signal to the master device; the master device can calculate the delay time caused by channel transmission and decoding based on the duration between sending the auxiliary trigger signal and receiving the auxiliary feedback signal, for example, dividing the duration by 2.
[0110] Thereafter, after the master device sends a trigger signal to the slave device, after a delay time, the master device's own camera can be triggered to acquire images, thereby achieving synchronous triggering with the slave device's camera to synchronously acquire images.
[0111] In this embodiment, the master device automatically determines the delay time based on signal reception and transmission, thereby enabling adaptive compensation for the delay caused by channel transmission and decoding, ensuring quasi-synchronization of image acquisition between the master device and the slave device during image acquisition, and improving the accuracy of image acquisition.
[0112] At the same time, there is no need to improve the structure of the existing image acquisition system, ensuring that the system structure is simple and the function is reliable. When it is applied to a tracking scanner, since there is no need to use subsequent data processing methods to improve the problem of large synchronization errors, it is beneficial to improve the working efficiency of the tracking scanner.
[0113] In some embodiments, the delay time is calculated based on the channel distance and the decoding time.
[0114] Such an arrangement can achieve compensation for the time delay caused by channel transmission and decoding, thereby ensuring synchronous triggering of the cameras in the master and slave devices.
[0115] In other implementations, if there are other factors causing time delay, time compensation may be performed accordingly, which will not be elaborated or limited herein.
[0116] Based on the same inventive concept, an embodiment of the present disclosure also provides an image acquisition method, which is applied to an image acquisition system. The system includes a master device and a slave device that communicates with the master device and is controlled. The method is executed by the slave device and is implemented based on software and / or hardware, which is not limited here.
[0117] In some embodiments, Figure 2 FIG. 1 is a flow chart of another image acquisition method provided by an embodiment of the present disclosure. Figure 2 As shown, the method comprises the following steps:
[0118] S210: Receive an auxiliary trigger signal sent by a master device.
[0119] S220: Based on the auxiliary trigger signal, return an auxiliary feedback signal to the master device.
[0120] Among them, the auxiliary feedback signal and the auxiliary trigger signal are used to determine the delay time.
[0121] In combination with the above, the master device and the slave device interact with each other to determine the delay time in real time. Specifically, the master device sends an auxiliary trigger signal to the slave device; correspondingly, the slave device receives the auxiliary trigger signal sent by the master device; at the same time, the slave device returns an auxiliary feedback signal to the master device based on the auxiliary trigger signal; correspondingly, the master device receives the auxiliary feedback signal returned by the slave device, and further determines the delay time based on the time of sending the auxiliary trigger signal and the time of receiving the auxiliary feedback signal. Subsequently, time compensation can be performed based on the delay time, that is, after sending a trigger signal to the slave device and postponing the delay time, the master device triggers its own camera to acquire an image; at this time, the slave device also responds to the trigger signal to trigger its own camera to acquire an image, thereby, through adaptive compensation, the camera synchronous triggering in the master and slave devices is realized, the quasi-synchronization of the master and slave devices is achieved, and the accuracy of image acquisition is improved.
[0122] In the embodiment of the present disclosure, the slave device receives the auxiliary trigger signal sent by the master device and returns an auxiliary feedback signal to the master device so that the master device can determine the delay time and perform time compensation, which is beneficial to achieve synchronous triggering of the camera between the master and slave devices for image acquisition and is beneficial to improving the accuracy of image acquisition.
[0123] In some embodiments, Figure 2 On the basis of, the method may further include:
[0124] Receive the trigger signal and image frame number sent by the master device;
[0125] Based on the trigger signal and the image frame number, when the trigger condition is determined to be met, the camera of the slave device itself is triggered.
[0126] Among them, the trigger signal is used to trigger the camera to collect images, and the image frame number is used to represent the current frame number; based on this, the frame rate can be detected in real time to detect whether the synchronization pulse used to trigger the camera is lost.
[0127] Specifically, the judgment can be made based on the trigger signal and the image frame number. For example, the difference between the current image frame number and the previous image frame number is calculated, and whether to generate a trigger point is determined based on the difference result. Specifically, if the difference is 1, it indicates that the image frame number is continuous, that is, correct, and a trigger point can be generated. Otherwise, it indicates that the image frame number is discontinuous and an error occurs, and an error is reported at this time.
[0128] Furthermore, when a trigger point is generated, the camera of the slave device performs image acquisition; at this time, corresponding to the moment when the master device sends a trigger signal and postpones the delay time, the master device triggers its own camera to acquire the image, thereby, the images of the master and slave devices are synchronously acquired images; otherwise, it is determined that the master and slave devices are not synchronized, and the error is reported.
[0129] That is, judgment is made based on the trigger signal and the image frame number. When it is determined that the trigger condition is not met, an error signal is generated and reported. Exemplarily, the error signal can be sent to at least one of the master control device and the main device to identify and correct the error.
[0130] In the disclosed embodiment, the slave device can detect and judge the frame rate in real time, so as to detect the loss of synchronization pulses, and report the error in time when it is found, thereby improving the overall accuracy of the system.
[0131] The disclosed embodiment also provides an image acquisition method, which is applied to an image acquisition system. The system includes a master device and a slave device that communicates with the master device under control. The method is executed by the slave device and is implemented based on software and / or hardware, which is not limited here.
[0132] In some embodiments, Figure 3 A flowchart of another image acquisition method provided by an embodiment of the present disclosure is shown below. Figure 3 As shown, the method comprises the following steps:
[0133] S250: Receive a trigger signal and an image frame number sent by a master device.
[0134] S260: When it is determined that the trigger condition is met based on the trigger signal and the image frame number, trigger the camera of the slave device itself.
[0135] Among them, the trigger signal is used to trigger the camera to collect images, and the image frame number is used to represent the current frame number; based on this, the frame rate can be detected in real time to detect whether the synchronization pulse used to trigger the camera is lost.
[0136] Specifically, a judgment can be made based on the trigger signal and the image frame number. When the trigger condition, that is, the condition for continuous frame acquisition, is met, it indicates that the current trigger signal and image frame number are correct, and the slave device triggers its own camera to acquire images.
[0137] In some embodiments, the method further includes: generating an error signal when it is determined based on the trigger signal and the image frame number that the trigger condition is not met; and sending the error signal.
[0138] Specifically, when making a judgment based on the trigger signal and the image frame number, if the trigger signal and the image frame number do not meet the trigger conditions, such as not meeting the conditions for continuous frame acquisition, it indicates that frame loss may exist, that is, the current trigger signal and the image frame number are incorrect. At this time, an error signal is generated from the device and reported.
[0139] In some embodiments, the trigger condition includes: the difference between the current image frame number and the previous image frame number is 1.
[0140] Exemplarily, when judging the trigger signal and the image frame number, the difference between the current image frame number and the previous image frame number can be calculated, and whether to generate a trigger point can be determined based on the difference result; specifically, if the difference is 1, it indicates that the image frame number is continuous, that is, correct, and a trigger point can be generated; otherwise, it indicates that the image frame number is discontinuous and an error occurs, and the error is reported at this time.
[0141] Furthermore, when a trigger point is generated, the camera of the slave device performs image acquisition; at this time, corresponding to the moment when the master device sends a trigger signal and postpones the delay time, the master device triggers its own camera to acquire the image, thereby, the images of the master and slave devices are synchronously acquired images; otherwise, it is determined that the master and slave devices are not synchronized, and the error is reported.
[0142] In the disclosed embodiment, the slave device can detect and judge the frame rate in real time, so as to detect the loss of synchronization pulses, and report the error in time when it is found, thereby improving the overall accuracy of the system.
[0143] On the basis of the above implementation, the embodiment of the present disclosure further provides an image acquisition device, which is arranged in a main device; the image acquisition device is used to execute the steps of any of the above methods to achieve corresponding effects.
[0144] In some embodiments, Figure 4 FIG. 1 is a schematic diagram of the structure of an image acquisition device provided by an embodiment of the present disclosure. Figure 4 As shown, the device comprises:
[0145] The time acquisition module 310 is used to acquire the delay time of the slave device; wherein the delay time includes the time required for channel transmission and decoding;
[0146] A signal sending module 320, used to send a trigger signal to a slave device;
[0147] The trigger module 330 is used to trigger the camera of the master device itself when the delay time is delayed by using the time when the trigger signal is sent to the slave device as a reference time point.
[0148] The image acquisition device provided by the embodiment of the present disclosure can obtain the time corresponding to the channel transmission and decoding of the slave device through the synergistic effect of the above-mentioned functional modules, and the master device triggers its own camera after delaying the delay time, so that the master device can autonomously compensate for the trigger time of its own camera and delay the trigger time of its own camera to ensure that its trigger time is the same as the trigger time of the camera in the slave device, that is, synchronous triggering, thereby achieving time consistency of image acquisition in the master and slave devices and improving the accuracy of image acquisition.
[0149] In some embodiments, the system further includes a master control device; the delay time is configured in the master control device. Figure 4 On the basis of, the time acquisition module 310 is used to obtain the delay time of the slave device, which may specifically include:
[0150] When the master device is designated as the master device, configure the delay time;
[0151] Alternatively, call up the delay time from the master control device.
[0152] In some embodiments, Figure 4 On the basis of, the time acquisition module 310 is used to obtain the delay time of the slave device, which may specifically include:
[0153] After receiving the trigger instruction of image acquisition, an auxiliary trigger signal is sent to the slave device;
[0154] receiving an auxiliary feedback signal returned by the slave device;
[0155] The delay time is determined based on the auxiliary feedback signal and the auxiliary trigger signal.
[0156] In some embodiments, the delay time is calculated based on the channel distance and the decoding time.
[0157] The image acquisition device disclosed in the above embodiments can execute the steps of the image acquisition method disclosed in the above embodiments, and has the same or corresponding beneficial effects. To avoid repetition, it will not be described again here.
[0158] On the basis of the above implementation, the embodiment of the present disclosure further provides an image acquisition device, which is arranged in a slave device; the image acquisition device is used to execute the steps of any of the above methods to achieve corresponding effects.
[0159] In some embodiments, Figure 5 FIG. 1 is a schematic diagram of another image acquisition device provided by an embodiment of the present disclosure. Figure 5 As shown, the image acquisition device comprises:
[0160] The receiving module 410 is used to receive the auxiliary trigger signal sent by the master device;
[0161] The sending module 420 is used to return an auxiliary feedback signal to the main device based on the auxiliary trigger signal, wherein the auxiliary feedback signal and the auxiliary trigger signal are used to determine the delay time.
[0162] The image acquisition device provided by the embodiment of the present disclosure, through the coordinated action of the above-mentioned functional modules, enables the slave device to receive the auxiliary trigger signal sent by the master device and return the auxiliary feedback signal to the master device, so that the master device can determine the delay time and perform time compensation, which is beneficial to realize the synchronous triggering of the camera between the master and slave devices to perform image acquisition, and is beneficial to improving the accuracy of image acquisition.
[0163] In some embodiments, continue to refer to Figure 5 In the device, the receiving module 410 is also used to: receive the trigger signal and image frame number sent by the master device; the device also includes a trigger module 430, which is used to trigger the camera of the slave device itself when it is determined that the trigger condition is met based on the trigger signal and the image frame number.
[0164] In some embodiments, Figure 5 As shown, the image acquisition device comprises:
[0165] The receiving module 410 is used to receive the trigger signal and the image frame number sent by the master device;
[0166] The trigger module 430 is used to trigger the camera of the slave device itself when it is determined that the trigger condition is met based on the trigger signal and the image frame number.
[0167] In some embodiments, the device may further include an error reporting module for generating an error signal and sending the error signal when it is determined that the trigger condition is not met based on the trigger signal and the image frame number.
[0168] In some embodiments, the trigger condition includes: the difference between the current image frame number and the previous image frame number is 1.
[0169] The image acquisition device disclosed in the above embodiments can execute the steps of the image acquisition method disclosed in the above embodiments, and has the same or corresponding beneficial effects. To avoid repetition, it will not be described again here.
[0170] The embodiment of the present disclosure further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the processor implements the steps of any of the above methods and achieves the corresponding effects, which are not described in detail here.
[0171] The embodiment of the present disclosure also provides an image acquisition system, including a master device and a slave device that communicates with the master device under control. By executing the steps of any of the above methods, synchronous image acquisition between the master and slave devices is achieved, thereby improving the accuracy of image acquisition.
[0172] In some embodiments, Figure 6 FIG. 1 is a schematic diagram of the structure of an image acquisition system provided by an embodiment of the present disclosure. Figure 6As shown, the system includes a master device 50 and a slave device 51; wherein the slave device 51 communicates with the master device 50 and is controlled by the master device 50; the master device 50 executes the steps of any of the above methods executed by the master device; and the slave device 51 executes the steps of any of the above methods executed by the slave device. Thus, based on the delay time, compensation for the time delay caused by channel transmission and decoding can be achieved, and synchronous triggering and acquisition of the cameras of the master and slave devices can be achieved, thereby improving synchronization and further improving the accuracy of image acquisition.
[0173] In some embodiments, Figure 7 A schematic diagram of the structure of another image acquisition system provided by an embodiment of the present disclosure. Figure 6 Based on the reference Figure 7 The system may also include a master control device 52; the master device 50 and the slave device 51 are both connected to the master control device 52 for communication; the master control device 52 is used to configure the delay time when the master device 50 is specified; and when the slave device 51 determines that the trigger condition is not met, it receives an error message.
[0174] Specifically, the slave device 51 includes a slave controller 400, a receiving module 410, a sending module 420, a trigger module 430, an error reporting module 440 and a camera 450; wherein the slave controller 400 is used for controlling the functional logic of the slave device; the receiving module 410 is used to receive a signal transmitted by the master device, which includes a trigger signal and an auxiliary trigger signal; the sending module 420 is used to send a signal to the master device, which includes an auxiliary feedback signal and an image frame number; the trigger module 430 is used to trigger its own camera 450, so that the camera 450 can capture images normally; the error reporting module 440 is used to report errors to the master control device 52; and the camera 450 is used to capture images.
[0175] The master device 50 includes a master controller 500, a receiving module 501, a synchronization module 502, a delay compensation 503, a trigger module 330 and a camera 350; wherein the receiving module 501 is used to receive instructions from a host computer (i.e., a master control device 52), the instructions including a trigger instruction, a master device specified instruction and a configured delay time; the master controller 500 is used to implement functional logic control of the master device 50; the trigger module 330 is used to trigger its own camera 350, so that the camera 350 can normally capture images; the synchronization module 502 is used to send a trigger signal to the slave device 51, and after delaying the delay time, use the trigger module 330 to trigger its own camera, so that the master and slave devices synchronously capture images; the delay compensation 503 is used to calculate the delay time between the master and slave devices, so as to postpone the time point of the action of the trigger module 330 in the master device 50, that is, to postpone the time point of the master device 50 itself being triggered, so that the master and slave devices are triggered synchronously.
[0176] By way of example, the master control device 52 may be a computer.
[0177] It should be noted that in the image acquisition system, the number of slave devices 51 can be one, two, three or more, which is not limited here.
[0178] exist Figure 7 Based on Figure 8 and Fig. 9 The image acquisition method provided by the embodiment of the present disclosure is described as follows.
[0179] For example, Figure 8 The following is a flow chart of an image acquisition method provided by an embodiment of the present disclosure. Figure 8 As shown, the method includes:
[0180] S610, the master device receives a trigger instruction transmitted by the master control device;
[0181] S620, the master device sends an auxiliary trigger signal to the slave device;
[0182] S630, the slave device receives the auxiliary trigger signal and returns an auxiliary feedback signal to the master device;
[0183] S640, the master device calculates the delay time based on the auxiliary feedback signal and the auxiliary trigger signal, and automatically compensates for it; and sends a trigger signal and an image frame number to the slave device;
[0184] S650, receiving a trigger signal and an image frame number from a device;
[0185] S660: The slave device determines whether there is a trigger signal based on the trigger signal and the image frame number, and the difference between the image frame number and the previous image frame number is 1;
[0186] If yes (Y), execute S670; if no (N), execute S680.
[0187] S670, triggering the camera from the device;
[0188] S680, report the error to the master control device.
[0189] The method further includes: after S640, the delay time is extended, and the master device triggers its own camera.
[0190] Therefore, based on the signal interaction between the master and slave devices, adaptive compensation for the time required for channel transmission and decoding can be achieved, thereby achieving synchronous triggering of the master and slave devices, achieving synchronous image acquisition, and improving the accuracy of image acquisition.
[0191] For example, Fig. 9 FIG. 1 is a flow chart of another image acquisition method provided by an embodiment of the present disclosure. Fig. 9 As shown, the method includes:
[0192] S710, the master device receives the trigger instruction and the delay time to be configured transmitted by the master control device;
[0193] S720, the master device configures a delay time, and sends a trigger signal and an image frame number to the slave device;
[0194] S730, receiving a trigger signal and an image frame number from a device;
[0195] S740, the slave device determines whether there is a trigger signal based on the trigger signal and the image frame number, and the difference between the image frame number and the previous image frame number is 1;
[0196] If yes (Y), execute S750; if no (N), execute S760.
[0197] S750, trigger the camera from the device;
[0198] S760, report the error to the master control device.
[0199] The method further includes: after S720, delaying the delay time, and the master device triggering its own camera.
[0200] Therefore, based on computer instructions, compensation for the time required for signal transmission and decoding can be achieved, thereby achieving synchronous triggering of master and slave devices, achieving synchronous image acquisition, and improving the accuracy of image acquisition.
[0201] The embodiment of the present disclosure also provides an image acquisition method, which is applied to an image acquisition system. The system includes a master device and a slave device that communicates with the master device and is controlled by the system. The method is executed by the system.
[0202] Specifically, the method may include the following steps:
[0203] The delay time for the master device to obtain the slave device;
[0204] The master device sends a trigger signal and an image frame number to the slave device;
[0205] The slave device receives the trigger signal and the image frame number, and triggers the camera of the slave device itself when the trigger condition is determined to be met based on the trigger signal and the image frame number;
[0206] The master device uses the time when it sends the trigger signal to the slave device as the reference time point, and triggers the camera of the master device itself when the delay time is delayed.
[0207] Furthermore, the slave device also makes a judgment based on the trigger signal and the image frame number, and when it is determined that the trigger condition is not met, it generates an error signal and reports the error to the master control device.
[0208] In this method, the master device may determine the delay time of the slave device based on the signal interaction between the master device and the slave device, or the delay time may be directly configured by the master control device, which is not limited here.
[0209] The image acquisition system provided by the embodiment of the present disclosure can detect image synchronization and whether the frame rate is normal during the entire acquisition process, and adopts adaptive delay compensation or compensation based on computer instructions to realize synchronous acquisition of master and slave devices; at the same time, the slave device can detect errors and report them in real time, solving the problems of asynchrony or wrong frames in the image acquisition process.
[0210] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.
[0211] The above description is only a specific embodiment of the present disclosure, so that those skilled in the art can understand or implement the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to the embodiments described herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. An image acquisition method, characterized in that: Applied to an image acquisition system, the system includes a master device and slave devices that communicate with the master device under control, and the delay times of all the slave devices are equal; The method is executed by a master device; the method includes: Get the delay time of the slave device; Send trigger signal and image frame number to slave device; Taking the time of sending the trigger signal to the slave device as the reference time point, the camera of the master device itself is triggered when the delay time is delayed; The image frame number represents the current frame number, and the image frame number is used to enable the slave device to perform real-time detection of the frame rate, and to enable the slave device to generate and send an error signal when determining that a trigger condition is not met based on the trigger signal and the image frame number; the trigger condition includes: the difference between the current image frame number and the previous image frame number is 1; The delay time is calculated based on the channel distance and the decoding time; obtaining the delay time of the slave device includes: after receiving the trigger instruction of the image acquisition, sending an auxiliary trigger signal to the slave device; receiving the auxiliary feedback signal returned by the slave device; and determining the delay time based on the auxiliary feedback signal and the auxiliary trigger signal.
2. The method according to claim 1, characterized in that The system further includes a master control device; the delay time is configured in the master control device; The obtaining of the delay time of the slave device includes: When designated as the master device by the master control device, configuring the delay time; or, The delay time is retrieved from the master control device.
3. An image acquisition method, characterized in that: Applied to an image acquisition system, the system includes a master device and slave devices that communicate with the master device under control, the delay times of all the slave devices are equal, and the method is executed by the slave devices; the method includes: Receive the auxiliary trigger signal sent by the main device; Returning an auxiliary feedback signal to the master device based on the auxiliary trigger signal; The auxiliary feedback signal and the auxiliary trigger signal are used to determine the delay time; The method further comprises: Receive the trigger signal and image frame number sent by the master device; triggering a camera of the slave device when a trigger condition is determined to be satisfied based on the trigger signal and the image frame number; the image frame number represents a current frame number, and the image frame number is used to enable the slave device to perform real-time detection of a frame rate; Based on the trigger signal and the image frame number, when it is determined that the trigger condition is not met, an error signal is generated; the error signal is sent; the trigger condition includes: the difference between the current image frame number and the previous image frame number is 1.
4. An image acquisition method, characterized in that: Applied to an image acquisition system, the system includes a master device and a slave device that controls communication with the master device, and the method is performed by the slave device; the method includes: Receive the trigger signal and image frame number sent by the master device; When a trigger condition is determined to be satisfied based on the trigger signal and the image frame number, triggering a camera of the slave device itself; The image frame number represents the current frame number, and the image frame number is used to enable the slave device to detect the frame rate in real time, and to enable the slave device to generate and send an error signal when determining that a trigger condition is not met based on the trigger signal and the image frame number; the trigger condition includes: the difference between the current image frame number and the previous image frame number is 1; The method further includes: receiving an auxiliary trigger signal sent by the master device; Returning an auxiliary feedback signal to the master device based on the auxiliary trigger signal; The auxiliary feedback signal and the auxiliary trigger signal are used to determine a delay time.
5. An image acquisition method, characterized in that: Applied to an image acquisition system, the system includes a master device and slave devices that communicate with the master device under control, and the delay times of all slave devices are equal; the method is executed by the system, and the method includes: The delay time for the master device to obtain the slave device; The master device sends a trigger signal and image frame number to the slave device; The slave device receives the trigger signal and the image frame number, and triggers the camera of the slave device itself when determining that a trigger condition is met based on the trigger signal and the image frame number; The master device uses the time when the trigger signal is sent to the slave device as a reference time point, and triggers the camera of the master device itself when the delay time is delayed; The image frame number represents the current frame number, and the image frame number is used to enable the slave device to detect the frame rate in real time, and to enable the slave device to generate an error signal when determining that a trigger condition is not met based on the trigger signal and the image frame number; the trigger condition includes: the difference between the current image frame number and the previous image frame number is 1; The delay time is calculated based on the channel distance and the decoding time; the master device obtains the delay time of the slave device, including: after receiving the trigger instruction of image acquisition, the master device sends an auxiliary trigger signal to the slave device; the master device receives the auxiliary feedback signal returned by the slave device; based on the auxiliary feedback signal and the auxiliary trigger signal, the delay time is determined.
6. An image acquisition device, characterized in that: include: Time acquisition module, used to obtain the delay time of the slave device; A signal sending module is used to send a trigger signal and an image frame number to a slave device; A trigger module is used to trigger the camera of the master device when the delay time is delayed after the time when the trigger signal is sent to the slave device as a reference time point; The image frame number represents the current frame number, and the image frame number is used to enable the slave device to perform real-time detection of the frame rate, and to enable the slave device to generate and send an error signal when determining that a trigger condition is not met based on the trigger signal and the image frame number; the trigger condition includes: the difference between the current image frame number and the previous image frame number is 1; Among them, the delay time of all slave devices is equal; the delay time is calculated based on the channel distance and decoding time; the acquisition of the delay time of the slave device includes: after receiving the trigger instruction of image acquisition, sending an auxiliary trigger signal to the slave device; receiving the auxiliary feedback signal returned by the slave device; and determining the delay time based on the auxiliary feedback signal and the auxiliary trigger signal.
7. An image acquisition device, characterized in that: include: A receiving module, used for receiving the auxiliary trigger signal sent by the main device; a sending module, configured to return an auxiliary feedback signal to the master device based on the auxiliary trigger signal; Wherein, the auxiliary feedback signal and the auxiliary trigger signal are used to determine the delay time; The receiving module is also used to receive the trigger signal and image frame number sent by the master device; a trigger module configured to trigger the camera of the slave device when a trigger condition is determined to be satisfied based on the trigger signal and the image frame number; and to generate and send an error signal when a trigger condition is determined not to be satisfied based on the trigger signal and the image frame number; the trigger condition including: a difference between a current image frame number and a previous image frame number being 1; Among them, the delay time of all slave devices is equal.
8. An image acquisition device, characterized in that: include: A receiving module is used to receive the trigger signal and image frame number sent by the main device; a trigger module, configured to trigger the camera of the slave device when a trigger condition is determined to be satisfied based on the trigger signal and the image frame number, and to generate and send an error signal when a trigger condition is determined not to be satisfied based on the trigger signal and the image frame number; the trigger condition including: a difference between a current image frame number and a previous image frame number being 1; The image frame number represents the current frame number, and the image frame number is used to enable the slave device to detect the frame rate in real time.
9. A computer-readable storage medium, characterized in that The storage medium stores a computer program, which, when executed by a processor, enables the processor to implement the steps of the method according to any one of claims 1 to 2, or the steps of the method according to claim 3, or the steps of the method according to claim 4.
10. An image acquisition system, characterized in that: comprising a master device and a slave device controlled to communicate with the master device; The master device performs the steps of the method according to any one of claims 1 to 2; The slave device executes the steps of the method according to claim 3 or the steps of the method according to claim 4.
11. The system according to claim 10, wherein: It also includes master control equipment; The master device and the slave device are both in communication connection with the master control device; The master control device is used to configure the delay time when designating a master device; and receive error information when the slave device determines that the trigger condition is not met.
