Synchronization method and system between high-speed cameras based on B code time service

Abstract

The invention provides a synchronization method and system between high-speed cameras based on B code time service. The method comprises the following steps: acquiring input data streams of the high-speed cameras; the method comprises the following steps: based on a shunting strategy of a high-speed camera, transmitting input data streams of the high-speed camera according to three paths, and respectively recording the three paths of input data streams as a first path, a second path and a third path: equally dividing unit second time of the first path of input data stream into M parts by the high-speed camera based on B code analysis, outputting the data frames corresponding to the M time points obtained by equally dividing the unit second time into M parts, and carrying out SDI output control; and the high-speed camera equally divides the unit second time of the second path of input data stream into N parts based on B code analysis, and outputs data frames corresponding to N time points in which the unit second time is equally divided into N parts to perform Ethernet output control. According to the design scheme, the synchronism of the display and processing process of the image data acquired by the high-speed camera is realized, the measurement and calibration time is effectively shortened, and the calibration precision is improved.

Description

Technical Field

[0001] The present invention belongs to the technical field of high-speed cameras, and particularly relates to a method and system for synchronizing high-speed cameras based on B-code time service. Background Art

[0002] The frame rate of high-speed cameras often starts from 1000fps. The data at the sensor source end is cached in the camera's memory in real time at a high frame rate, and then read out from the camera's memory to the host computer or SDI output interface at a lower frame rate slowly. To facilitate use, a function of collecting and displaying images in real time is developed. The high-speed camera displays the real-time captured images at a lower frame rate, which is convenient for users to perform pre-recording preparation operations, such as adjusting the exposure time, focal length, angle, etc. The frame rate of the images collected in real time depends on the performance of the host computer or SDI receiving module at the PC end, and is obtained by randomly extracting frames from the high-speed data stream output by the sensor. The time information of the images presented on the screen is disordered. However, many users of high-speed cameras use the cameras for measurement and calibration, and use them in the form of a multi-camera system. In order to reduce the time for measurement and calibration and improve the calibration accuracy. Users hope that the real-time images displayed by multiple cameras are synchronized, but the clock sources between high-speed cameras are asynchronous, and the time generated by the camera's own clock has a large synchronization error. Therefore, it is urgently necessary to design and propose a method and system for synchronizing high-speed cameras based on B-code time service to solve the above problems. Summary of the Invention

[0003] To solve the above deficiencies in the prior art, the object of the present invention is to overcome the existing deficiencies and provide a method for synchronizing high-speed cameras based on B-code time service, including the following:

[0004] Collect the input data stream of the high-speed camera;

[0005] Based on the data stream splitting strategy of the high-speed camera, the input data stream of the high-speed camera is transmitted in three paths, and the three paths of input data streams are respectively denoted as the first path, the second path, and the third path:

[0006] The high-speed camera equally divides the unit second time of the first path input data stream into M parts based on B-code parsing, and outputs the data frames corresponding to the M time points obtained by equally dividing the unit second time into M parts for SDI output control;

[0007] The high-speed camera equally divides the unit second time of the second path input data stream into N parts based on B-code parsing, and outputs the data frames corresponding to the N time points obtained by equally dividing the unit second time into N parts for Ethernet output control;

[0008] The high-speed camera writes the third input data stream into the memory of the high-speed camera for storage, and outputs the input data stream stored in the memory based on the high-speed camera for Ethernet output control.

[0009] As a further optimization of the above solution, before the high-speed camera shunting, the method further includes:

[0010] The high-speed camera acquires the B-code signal sent by the B-code signal transmitting device, and parses the B-code signal into the high-speed camera-readable information including time information;

[0011] The high-speed camera collects and shoots image data in real time, and transmits the image data for input data stream transmission.

[0012] As a further optimization of the above solution, the method further includes:

[0013] Multiple groups of the high-speed cameras are connected in parallel to the PC-side host computer;

[0014] Any one of the high-speed cameras acquires the B-code time information and the longitude and latitude coordinate information of the target to be collected by the high-speed camera, and records and stores them;

[0015] Any one of the high-speed cameras parses and extracts frames based on the B-code time information, and outputs the processed high-speed camera acquisition data for SDI output control;

[0016] Decode the high-speed camera acquisition data output by SDI, obtain the high-speed camera image data, and output the longitude and latitude coordinate information to be adjusted and transmit it to the theodolite.

[0017] As a further optimization of the above solution, the method further includes:

[0018] Any one of the high-speed cameras parses and extracts frames based on the B-code time information, and also outputs the processed high-speed camera acquisition data for Ethernet output control;

[0019] The acquisition data output of multiple any one of the high-speed cameras is output for Ethernet and transmitted to the client for calibration.

[0020] The present invention also relates to a high-speed camera inter-synchronization system based on B-code time service, and the system includes the following:

[0021] A sensor control unit for controlling the control timing of the sensor;

[0022] A sensor data receiving unit for receiving the input data stream transmitted by the sensor;

[0023] A data selection unit for transmitting the input data stream of the high-speed camera in three paths, and the three input data streams are respectively denoted as the first path, the second path, and the third path;

[0024] A sensor data high-speed storage unit for writing the input data stream of the high-speed camera to the camera's memory in real time;

[0025] A sensor data reading control unit for reading the data in the camera's memory and outputting it via Ethernet when a read command is received.

[0026] As a further optimization of the above solution, the system further includes:

[0027] A B-code parsing unit for parsing the acquired electrical signal into a B-code and calibrating the time information according to the B-code rules;

[0028] A first frame extraction unit for equally dividing the unit second time of the first input data stream into M parts and outputting the data frames corresponding to the M time points obtained by equally dividing the unit second time into M parts;

[0029] A second frame extraction unit for equally dividing the unit second time of the second input data stream into N parts and outputting the data frames corresponding to the N time points obtained by equally dividing the unit second time into N parts;

[0030] An SDI output control unit for packing and outputting the data of the high-speed camera in the SDI format;

[0031] An SDI tracking module for receiving the SDI data sent by the camera, performing image processing and calculation, and outputting the result feedback.

[0032] As a further optimization of the above solution, the system further includes:

[0033] Multiple groups of the high-speed cameras are connected in parallel to the PC-side host computer;

[0034] Any one of the high-speed cameras acquires the B-code time information and the longitude and latitude coordinate information of the target to be collected by the high-speed camera, and records and stores them;

[0035] The first frame extraction unit outputs the processed data collected by the high-speed camera to the SDI output control unit;

[0036] The SDI output control unit acquires the high-speed camera image data and outputs it to the SDI tracking module.

[0037] As a further optimization of the above solution, the system further includes:

[0038] Any one of the high-speed cameras parses and extracts frames based on the B-code time information, and also outputs the processed data collected by the high-speed camera for Ethernet output control;

[0039] The data collected and output by multiple high-speed cameras are output via Ethernet and transmitted to the client for calibration.

[0040] Adopting the above technical solution, the present invention has the following beneficial effects compared with the prior art:

[0041] 1. Based on the design solution of the present invention, B-code time synchronization is introduced into the time alignment of high-speed cameras. By dividing the acquired data of high-speed cameras into multiple channels and designing a frame extraction strategy based on B-code parsing, the purpose of high-precision synchronization is achieved during the image display or image tracking process of the acquired images of high-speed cameras. Moreover, the present invention also designs a third channel for shunting, which is used for subsequent calibration and analysis processing. That is, the design solution of the present invention realizes the synchronization of the display and processing processes of the acquired image data of high-speed cameras, effectively reduces the time of measurement calibration, and improves the calibration accuracy.

[0042] 2. The present invention specifically designs a synchronization scheme between high-speed cameras. Based on the synchronization strategy of the display and processing processes of high-speed cameras in the first embodiment, the present invention adds an SDI tracking module and an Ethernet output module in the application scenario of multiple groups of high-speed cameras. That is, more specifically, through the SDI tracking module, the data frame data corresponding to dividing one second of time into M equal parts is obtained in real time, and data decoding is performed to obtain image data and restore the original data acquired by the high-speed camera. Based on algorithm processing, the processing result is fed back to the theodolite to control the steering operation of the high-speed camera. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] By reading the detailed description of the non-limiting embodiments with reference to the following drawings, other features, objectives, and advantages of the present application will become more obvious:

[0044] Figure 1 It is a schematic flowchart of the present invention;

[0045] Figure 2 It is another schematic flowchart of the present invention;

[0046] Figure 3 It is a schematic structural diagram of the present invention;

[0047] Figure 4 It is another schematic structural diagram of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0048] It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0049] The frame rate of high-speed cameras often starts at 1000fps. By caching the data at the sensor source end into the camera's memory in real-time at a high frame rate, and then slowly reading it out from the camera's memory to the host computer or SDI output interface at a lower frame rate. For the convenience of practical applications, a function for real-time display of the acquisition screen of images has been developed. The high-speed camera displays the real-time captured images at a lower frame rate, facilitating users to perform preparatory operations before recording, such as adjusting the exposure time, focal length, angle, etc. The real-time acquisition screen is obtained by randomly extracting frames from the high-speed data stream output by the sensor, and the time information of the images presented on the screen is disordered.

[0050] Based on the above-mentioned technical problems faced, such as Figures 1-4 As shown, the embodiment of the present invention discloses a method for synchronizing high-speed cameras based on B-code time service, including the following:

[0051] Collect the input data stream of the high-speed camera;

[0052] Based on the shunt strategy of the high-speed camera, the input data stream of the high-speed camera is transmitted in three paths, and the input data streams of the three paths are respectively denoted as the first path, the second path, and the third path:

[0053] The high-speed camera equally divides the unit second time of the first input data stream into M parts based on B-code parsing, and outputs the data frames corresponding to the M time points obtained by equally dividing the unit second time into M parts for SDI output control;

[0054] The high-speed camera equally divides the unit second time of the second input data stream into N parts based on B-code parsing, and outputs the data frames corresponding to the N time points obtained by equally dividing the unit second time into N parts for Ethernet output control;

[0055] The high-speed camera writes the third input data stream into the memory of the high-speed camera for storage, and outputs the input data stream stored in the memory based on the high-speed camera for Ethernet output control.

[0056] More specifically, to solve the problem of synchronization in the acquisition and shooting of high-speed cameras in the prior art, the present invention preferably designs a shunt strategy for collecting input data, that is, specifically by designing a B-code parsing technical solution, that is, introducing B-code synchronization in the synchronization process of high-speed cameras, and transmitting the input data stream of high-speed cameras in three paths:

[0057] The first path divides the unit second time into M equal parts, and performs SDI output control on the corresponding data frame output. The one-second time of the B code is evenly divided into M equal parts to obtain M time points. Each time a time point is reached, a corresponding frame of image is extracted from the input data stream, and this is done sequentially to accumulate M frames of images. For example, the frame rate of the high-speed camera is 1000fps, the frame rate of the SDI interface for real-time output of the picture is about 50fps, that is, M = 50, and the frame rate of the PC side for real-time acquisition of the picture is about 20fps, that is, N = 20;

[0058] The second path divides the unit second time into N equal parts, and performs Ethernet output control on the corresponding data frame output. The one-second time of the B code is evenly divided into N equal parts to obtain N time points. Each time a time point is reached, a corresponding frame of image is extracted from the input data stream, and this is done sequentially to accumulate N frames of images;

[0059] The third path is saved in its entirety in real time to the high-speed camera memory for specific data analysis.

[0060] Based on the design scheme of the present invention, the B code time synchronization is introduced into the time alignment of the high-speed camera, and by dividing the acquisition data of the high-speed camera into multiple paths, based on the B code parsing, a frame extraction strategy is specifically designed, so that the acquisition images of the high-speed camera achieve the purpose of high-precision synchronization during the image display or image tracking process. Moreover, the present invention also designs a third path for shunting for subsequent calibration and analysis processing. That is, the design scheme of the present invention realizes the synchronization of the display and processing process of the acquisition image data of the high-speed camera, effectively reduces the time of measurement calibration, and improves the calibration accuracy.

[0061] Specifically, the method designed by the present invention further includes:

[0062] The high-speed camera obtains the B code signal sent by the B code signal transmitting device, and parses the B code signal into high-speed camera-readable information containing time information;

[0063] The high-speed camera real-time collects and shoots image data, and transmits the image data as an input data stream.

[0064] Specifically, another embodiment of the present invention is as follows:

[0065] Multiple high-speed cameras are connected in parallel to the PC-side host computer;

[0066] Any high-speed camera obtains the B code time information and the longitude and latitude coordinate information of the target to be collected by the high-speed camera, and records and stores them;

[0067] Any high-speed camera parses and extracts frames based on the B code time information, and outputs the processed high-speed camera acquisition data for SDI output control;

[0068] Decode the data collected by the high-speed camera with SDI output, obtain the high-speed camera image data, and output the longitude and latitude coordinate information to be adjusted and transmit it to the theodolite.

[0069] Many users of high-speed cameras are used for measurement calibration and are used in the form of a multi-camera system to reduce the time of measurement calibration and improve the calibration accuracy. Users hope that the real-time images displayed by multiple cameras are synchronous, but the clock sources between high-speed cameras are asynchronous, and the time generated by the camera's own clock has a large synchronization error.

[0070] To solve the above technical application problems, the present invention specifically designs a synchronization scheme between high-speed cameras. Based on the synchronization strategy of the display and processing process of the high-speed camera in the first embodiment, the present invention adds an SDI tracking module and an Ethernet output module in the multi-group high-speed camera application scenario. That is, more specifically, the SDI tracking module is used to obtain the data frame data corresponding to dividing the unit second time into M equal parts in real time, and perform data decoding to obtain the image data and restore the original data collected by the high-speed camera. Based on algorithm processing, the processing result is fed back to the theodolite to control the steering operation of the high-speed camera.

[0071] More specifically, the present invention also designs an Ethernet output module. Through this design, the images collected by multiple high-speed cameras are output to the client, and then the client processes the image data collected by multiple high-speed cameras to obtain the multi-channel high-speed camera data that has completed time calibration, and at the same time realizes the work control of multiple high-speed cameras, that is, controls the synchronous steering or shooting focusing operation of multiple high-speed cameras.

[0072] Specifically, the method designed by the present invention also includes:

[0073] Any high-speed camera parses and extracts frames based on the B-code time information, and also outputs the processed data collected by the high-speed camera for Ethernet output control;

[0074] The data collected by any one of multiple high-speed cameras is output for Ethernet output and transmitted to the client for calibration.

[0075] The present invention also designs an embodiment, a synchronization system between high-speed cameras based on B-code time service. The working principle of this system is as follows:

[0076] After the high-speed camera captures data, it is collected based on the sensor data receiving unit, and the collected data is divided into three paths according to the data selection unit; the B-code parsing unit controls the first frame extraction unit and the second frame extraction unit to perform frame extraction operations on the first and second paths of data respectively according to the frame extraction strategy designed by the present invention; after the first path of frame extraction is completed, it is output to the SDI output control unit, and the high-speed camera packs and outputs the data in the SDI format; a single high-speed camera separately performs display or processing operations on the collected data, that is, the first path of data realizes the purpose of processing the collected data; the second path of data is output to the client for display via the Ethernet output module. Based on the operation of the single high-speed camera, multiple high-speed cameras are connected in parallel to achieve synchronous operation between the high-speed cameras. Specifically, an SDI tracking module is added after the SDI output control unit. This module receives the SDI data sent by the camera, performs image processing and calculation, and feeds back the output result to the corresponding high-speed camera. Based on algorithm processing, the processing result is fed back to the theodolite to control the steering operation of the high-speed camera. At the same time, since multiple high-speed cameras are connected to the client together, after the B-code time synchronization is completed, the client can achieve the time synchronization and steering control operations of multiple high-speed cameras.

[0077] It should be particularly noted here that in the shunt strategy of the present invention, the third path is completely saved to the memory of the high-speed camera for specific data analysis, and the second and third paths are selected and merged into one path through a MUX. Since this technology is an existing technology, it will not be described in detail here.

[0078] The above description is only the preferred embodiment of the present application and the explanation of the applied technical principles. Those skilled in the art should understand that the scope of the invention involved in the present application is not limited to the technical solution formed by the specific combination of the above technical features, and should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the inventive concept. For example, the technical solution formed by mutually replacing the above features with the (but not limited to) technical features with similar functions disclosed in the present application.

Claims

1. A high-speed camera synchronization method based on B-code timing, characterized in that: These include: Collecting the input data stream of the high-speed camera; Based on the diversion strategy of the high-speed camera, the input data stream of the high-speed camera is transmitted in three paths, and the three input data streams are respectively recorded as the first path, the second path and the third path: The high-speed camera divides the time per second of the first input data stream into M parts based on B code analysis, and outputs data frames corresponding to M time points of the M parts of the time per second for SDI output control; The high-speed camera divides the unit-second time of the second input data stream into N parts based on B code analysis, and outputs data frames corresponding to N time points of the unit-second time divided into N parts for Ethernet output control; The high-speed camera writes the third input data stream into the memory of the high-speed camera for storage, and the high-speed camera outputs the input data stream stored in the memory for Ethernet output control.

2. A high-speed camera synchronization method based on B-code timing according to claim 1, characterized in that: Before performing the high-speed camera diversion, the method further includes: The high-speed camera acquires a B-code signal emitted by a B-code signal transmitting device, and parses the B-code signal into information readable by the high-speed camera including time information; The high-speed camera collects and captures image data in real time, and transmits the image data as an input data stream.

3. The high-speed camera synchronization method based on B-code timing according to claim 2, characterized in that: The method further comprises: Multiple groups of the high-speed cameras are connected in parallel to a PC host computer; Any of the high-speed cameras obtains the B-code time information and the longitude and latitude coordinate information of the target to be collected by the high-speed camera, records and stores them; Any of the high-speed cameras extracts frames based on B-code time information analysis, and outputs the processed high-speed camera acquisition data for SDI output control; The high-speed camera acquisition data output by SDI is decoded to obtain the high-speed camera image data, and the longitude and latitude coordinate information to be adjusted is output and transmitted to the theodolite.

4. The high-speed camera synchronization method based on B-code timing according to claim 3, characterized in that: The method further comprises: Any of the high-speed cameras extracts frames based on B-code time information analysis, and also outputs the processed high-speed camera collected data for Ethernet output control; The data collected by any of the multiple high-speed cameras is output through Ethernet network and transmitted to the client for calibration.

5. A high-speed camera synchronization system based on B-code timing, characterized in that: The system comprises the following: A sensor control unit, used to control the control timing of the sensor; A sensor data receiving unit, used for receiving an input data stream transmitted by a sensor; A data selection unit, used for transmitting the input data stream of the high-speed camera in three paths, wherein the three input data streams are respectively recorded as a first path, a second path and a third path; A sensor data high-speed storage unit, used for writing the input data stream of the high-speed camera to the camera's memory in real time; The sensor data readout control unit is used to read out the data in the camera memory and output it via Ethernet when receiving a read command.

6. A high-speed camera synchronization system based on B-code timing according to claim 5, characterized in that: The system further comprises: A B code analysis unit, used to analyze the acquired electrical signal into a B code and calibrate the time information according to the B code rule; A first frame extraction unit is used to divide the unit second time of the first input data stream into M equal parts, and output data frames corresponding to M time points of the M equal parts of the unit second time; A second frame extraction unit is used to divide the unit second time of the second input data stream into N equal parts, and output data frames corresponding to N time points of the unit second time divided into N equal parts; SDI output control unit, used to package and output data from high-speed cameras in SDI format; The SDI tracking module is used to receive the SDI data sent by the camera, perform image processing and calculation, and output the result feedback.

7. A high-speed camera synchronization system based on B-code timing according to claim 6, characterized in that: The system further comprises: Multiple groups of the high-speed cameras are connected in parallel to a PC host computer; Any of the high-speed cameras obtains the B-code time information and the longitude and latitude coordinate information of the target to be captured by the high-speed camera, records and stores them; The first frame extraction unit outputs the processed high-speed camera acquisition data to the SDI output control unit; The SDI output control unit obtains the high-speed camera image data and outputs it to the SDI tracking module.

8. The high-speed camera synchronization system based on B-code timing according to claim 7, characterized in that: The system further comprises: Any of the high-speed cameras extracts frames based on B-code time information analysis, and also outputs the processed high-speed camera collected data for Ethernet output control; The data collected by any of the multiple high-speed cameras is output through Ethernet network and transmitted to the client for calibration.

Images