Camera time synchronization method and device, electronic equipment and storage medium

Abstract

The invention belongs to the technical field of camera time synchronization, and discloses a camera time synchronization method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining relative time or absolute time in a time reference device in real time, converting the relative time or absolute time into corresponding coding information through a time coding rule, and transmitting the coding information to a server; the controller is used for adjusting the light source array to obtain light source array information after real-time adjustment, controlling the camera to shoot, enabling the camera to shoot a shot picture recording the light source array information after real-time adjustment, and decoding the light source array information after real-time adjustment by using a time decoding rule to obtain a shot picture recording shooting time; the light source array is adjusted through the relative time or the absolute time, and the light source array information after real-time adjustment is decoded to obtain the shot picture recording the shooting time, so that time synchronization is performed on the camera, and the time synchronization efficiency of the camera is improved.

Description

Technical Field

[0001] The present application relates to the technical field of camera time synchronization, and in particular to a camera time synchronization method, device, electronic device and storage medium. Background Art

[0002] Cameras are widely used in various life scenarios. In some special work scenarios, such as high-speed photography and multi-sensor combination applications, time synchronization is a necessary technology in order to combine cameras with other types of sensors.

[0003] Most traditional camera time synchronization methods rely on external triggering, but this method still has a certain delay. When the camera receives an external trigger pulse, it is necessary to operate the shutter to open the shutter. After the camera exposure is completed, the shooting result at the current moment is obtained. The entire shutter opening and closing process cannot achieve precise time control. In addition, in low-cost camera control systems, not only is there no external trigger function, but also due to control timing and storage issues, frame loss often occurs, and time synchronization with other sensors cannot be achieved. In addition, some cameras directly write the system time information into the image obtained at the current moment through the controller. This method cannot avoid the time error caused by delays in other components in the camera system.

[0004] Therefore, in order to solve the technical problem that it is difficult for existing cameras to obtain accurate shooting synchronization time when shooting images, a camera time synchronization method, device, electronic device and storage medium are urgently needed. Summary of the invention

[0005] The purpose of the present application is to provide a camera time synchronization method, device, electronic device and storage medium. Through a preset time coding rule, the light source array is adjusted to perform shooting. The light source array information adjusted in real time is decoded using a preset time decoding rule to obtain a shot picture with the shooting time recorded. This solves the problem that existing cameras are difficult to obtain accurate shooting synchronization time when shooting images. The time information and shooting information can be displayed on the photo at the same time, and no additional time recording file is required, thereby improving the time synchronization efficiency of the camera.

[0006] In a first aspect, the present application provides a camera time synchronization method, which is applied to a time synchronization system to synchronize a camera, wherein the time synchronization system comprises a control module, a light source array, a time reference device, and a camera; the control module is used to execute the camera time synchronization method, and the camera time synchronization method comprises: Acquire the relative time or absolute time in the time reference device in real time; The relative time or the absolute time is converted into corresponding coding information according to a preset time coding rule, so as to adjust the light source array and obtain the light source array information adjusted in real time; Controlling the camera to shoot, so that the camera shoots a picture recording the light source array information adjusted in real time; The light source array information adjusted in real time is decoded using a preset time decoding rule to obtain a photographed picture with the photographing time recorded.

[0007] The camera time synchronization method provided in the present application can realize the time synchronization of the camera. Through the preset time coding rules, the light source array is adjusted and then shooting is carried out. The light source array information adjusted in real time is decoded using the preset time decoding rules to obtain a shot picture with the shooting time recorded. This solves the problem that the existing cameras are difficult to obtain accurate shooting synchronization time when shooting images. The time information and shooting information can be displayed on the photo at the same time, and no additional time recording files are required, thereby improving the time synchronization efficiency of the camera.

[0008] Optionally, the time reference device is a timing module built into the camera or an introduced external time synchronization device.

[0009] Optionally, the preset time encoding rule includes a time encoding rule based on brightness and a time encoding rule based on a switch state.

[0010] Optionally, when the brightness-based time coding rule is used, the relative time or the absolute time is converted into corresponding coding information through a preset time coding rule to adjust the light source array, and obtain the light source array information adjusted in real time, including: Taking a preset brightness division threshold as a division interval, converting the relative time or the absolute time into a corresponding brightness division level to obtain corresponding coding information; According to the brightness classification level corresponding to the coded information, the brightness of the corresponding light source in the light source array is adjusted to obtain the light source array information adjusted in real time.

[0011] The camera time synchronization method provided in the present application can realize the time synchronization of the camera. Through the time coding rule based on brightness, the relative time or absolute time is converted into the corresponding brightness division level to adjust the brightness of the corresponding light source in the light source array, and obtain the light source array information after real-time adjustment. Through the real-time adjusted light source array information, the shooting time can be recorded, which is beneficial to improve the time synchronization efficiency of the camera.

[0012] Optionally, when the time coding rule based on the switch state is used, the relative time or the absolute time is converted into corresponding coding information through a preset time coding rule to adjust the light source array, and obtain the light source array information adjusted in real time, including: Using the switch state of the corresponding light source in the light source array to represent the relative time or the absolute time, to obtain corresponding coding information; According to the switch state corresponding to the coding information, the switch state of the corresponding light source in the light source array is adjusted to obtain the light source array information adjusted in real time.

[0013] The camera time synchronization method provided in the present application can realize the time synchronization of the camera. Through the time coding rules based on the switch state, the relative time or absolute time is converted into the switch state of the corresponding light source array, so as to adjust the switch state of the corresponding light source in the light source array, and obtain the light source array information after real-time adjustment. Through the real-time adjusted light source array information, the shooting time can be recorded, which is beneficial to improve the time synchronization efficiency of the camera.

[0014] Optionally, using a preset time decoding rule, the real-time adjusted light source array information is decoded to obtain a photographed picture with a recording of the photographing time, including: Decoding the light source array information adjusted in real time by using a preset time decoding rule to obtain a shooting time corresponding to the light source array information adjusted in real time; The shooting time is associated with the shot picture to obtain the shot picture with the shooting time recorded.

[0015] Optionally, after decoding the real-time adjusted light source array information using a preset time decoding rule to obtain a photographed picture with a photographing time recorded thereon, the method further includes: The relative time or the absolute time is compared with the shooting time to check whether there is an abnormal light source in the light source array.

[0016] In a second aspect, the present application provides a camera time synchronization device, which is applied to a time synchronization system to synchronize a camera, wherein the time synchronization system comprises a control module, a light source array, a time reference device, and a camera; the control module is used to control the camera time synchronization device to perform corresponding steps, and the camera time synchronization device comprises: An acquisition module, used for acquiring the relative time or absolute time in the time reference device in real time; An adjustment module, used to convert the relative time or the absolute time into corresponding coding information according to a preset time coding rule, so as to adjust the light source array and obtain the light source array information adjusted in real time; A shooting module, used for controlling the camera to shoot, so that the camera shoots a picture recording the light source array information adjusted in real time; The decoding module is used to decode the light source array information adjusted in real time by using a preset time decoding rule to obtain a photographed picture with a recording of the photographing time.

[0017] The camera time synchronization device adjusts the light source array and then shoots according to a preset time encoding rule, and decodes the light source array information adjusted in real time using a preset time decoding rule to obtain a shot picture with the shooting time recorded, thereby solving the problem that the existing camera is difficult to obtain accurate shooting synchronization time when shooting images, and can simultaneously display the time information and the shooting information on the photo without the need for an additional time recording file, thereby improving the time synchronization efficiency of the camera.

[0018] In a third aspect, the present application provides an electronic device, including a processor and a memory, wherein the memory stores a computer program executable by the processor, and when the processor executes the computer program, it runs the steps in the camera time synchronization method described above.

[0019] In a fourth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps in the camera time synchronization method described above are executed.

[0020] Beneficial effects: The camera time synchronization method, device, electronic device and storage medium provided by the present application adjust the light source array through a preset time coding rule and then shoot, and use a preset time decoding rule to decode the light source array information adjusted in real time to obtain a shot picture with the shooting time recorded, thereby solving the problem that the existing camera is difficult to obtain accurate shooting synchronization time when shooting images, and can simultaneously display the time information and shooting information on the photo without the need for additional time recording files, thereby improving the time synchronization efficiency of the camera. In addition, in the present application, the real-time coding control of the light source array and the control of the camera shooting are independent of each other. During the camera shooting process, even if frame loss occurs, the time coding information of the shooting moment can be recorded in the subsequently shot image. The present application is particularly suitable for low-cost high-speed cameras in working scenarios that require high-precision time synchronization. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 A flowchart of a camera time synchronization method provided in an embodiment of the present application.

[0022] Figure 2 A schematic diagram of the structure of a camera time synchronization device provided in an embodiment of the present application.

[0023] Figure 3A schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0024] Explanation of reference numerals: 1. Acquisition module; 2. Adjustment module; 3. Shooting module; 4. Decoding module; 301. Processor; 302. Memory; 303. Communication bus. DETAILED DESCRIPTION

[0025] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application claimed for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.

[0026] It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. At the same time, in the description of this application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0027] Please refer to Figure 1 , Figure 1 A camera time synchronization method in some embodiments of the present application is applied to a time synchronization system to synchronize the camera. The time synchronization system includes a control module, a light source array, a time reference device and a camera. The control module is used to execute the camera time synchronization method. The camera time synchronization method includes the steps of: Step S101, obtaining the relative time or absolute time in the time reference device in real time; Step S102, converting the relative time or absolute time into corresponding coding information through a preset time coding rule, so as to adjust the light source array and obtain the light source array information adjusted in real time; Step S103, controlling the camera to shoot, so that the camera shoots a picture recording the light source array information adjusted in real time; Step S104: using a preset time decoding rule, the light source array information adjusted in real time is decoded to obtain a photographed picture with the photographing time recorded.

[0028] It should be noted that time synchronization refers to adding a timestamp to the image information acquired by the camera, that is, recording the exact shooting time on the acquired image.

[0029] The camera time synchronization method adjusts the light source array and then shoots according to a preset time encoding rule, and decodes the light source array information adjusted in real time using a preset time decoding rule to obtain a shot picture with the shooting time recorded, thereby solving the problem that it is difficult for existing cameras to obtain accurate shooting synchronization time when shooting images, and can simultaneously display time information and shooting information on photos without the need for additional time recording files, thereby improving the time synchronization efficiency of the camera.

[0030] Specifically, in step S101, the relative time or absolute time in the time reference device is obtained in real time, wherein the time reference device is a built-in timing module of the camera or an introduced external time synchronization device. Before obtaining the relative time or absolute time in the time reference device in real time, it is necessary to use the built-in timing module of the camera or introduce an external time synchronization device as the time reference device in advance. The time reference device is set to provide the camera with a time reference as a reference time. For example, when an external time synchronization device is introduced, the international standard time or local time provided by an Internet timing device or a satellite navigation device as a time reference device is used as the relative time or absolute time, or, when the camera works in association with other devices, the time provided by the built-in timing module of the camera or the timing module of other devices as the time reference device is used as the relative time.

[0031] Among them, the camera's built-in timing module, the timing modules of other devices and the external time synchronization device have the ability to record time, but before connecting to the network or time synchronization, the time recorded by the camera's built-in timing module, the timing modules of other devices and the external time synchronization device may not be the same due to reasons such as device usage, device recording errors or recording time in different regions.

[0032] Specifically, in the time synchronization system, the light source array refers to the arrangement of light sources in the form of an array, that is, multiple light sources (such as LEDs) are arranged in a certain arrangement (such as a matrix), and each light source is independently controlled and the brightness can be adjusted as needed. The scale and arrangement of the light source array can be set according to actual needs.

[0033] Specifically, the preset time coding rules include brightness-based time coding rules and switch state-based time coding rules, among which the brightness-based time coding rules are rules for encoding relative time by changing the brightness of the light source. This coding method has higher requirements on the control speed and response speed of the light source. The advantage is that a small number of light sources can be used to achieve high-precision time representation. For example, if one light source is used to represent a number (or a coding state), and the time calculation unit is accurate to seconds, 6 light sources are required; the switch state-based time coding rules are rules for encoding relative time by the switch state of the light source. The advantage of this coding method is that the control method is simple, but a large number of light sources are required to form an array. For example, if 10 light sources are used to represent a number (or a coding state), and the time calculation unit is accurate to seconds, 60 light sources are required.

[0034] Specifically, in step S102, when the time coding rule based on brightness is used, the relative time or absolute time is converted into corresponding coding information through the preset time coding rule to adjust the light source array, and obtain the light source array information adjusted in real time, including: Taking the preset brightness division threshold as the division interval, converting the relative time or absolute time into the corresponding brightness division level to obtain the corresponding coding information; According to the brightness classification level corresponding to the coded information, the brightness of the corresponding light source in the light source array is adjusted to obtain the light source array information adjusted in real time.

[0035] In step S102, when using the brightness-based time coding rule, the brightness range of a single light source is divided into multiple levels with a preset brightness division threshold as the division interval, each level represents a coding state, and each coding state in relative time or absolute time is a corresponding brightness division level to obtain corresponding coding information.

[0036] According to the brightness classification level corresponding to the coded information, the brightness of the corresponding light source in the light source array is adjusted to obtain the light source array information adjusted in real time.

[0037] The encoding method includes but is not limited to the following examples. For example, if the brightness range of a single light source is divided into 10 levels (numbers 0 to 9 each represent a level), then a light source can represent 10 different states, that is, representing 0 to 9, then each light source can represent a number of relative time. Assuming that the relative time (or absolute time) is point A, B minutes, and C seconds, then 6 light sources can be used to represent the relative time or absolute time, where the first two light sources represent point A, the middle two light sources represent B minutes, and the last two light sources represent C seconds. Between the hours, minutes, and seconds in the relative time (or absolute time), an empty light source can be set as an interval. Or if the brightness range of a single light source is divided into 6 levels (numbers 0 to 5 each represent a level), then two light sources can represent 10 different states.

[0038] Specifically, in step S102, when the time coding rule based on the switch state is used, the relative time or absolute time is converted into corresponding coding information through the preset time coding rule to adjust the light source array, and obtain the light source array information adjusted in real time, including: The switch state of the corresponding light source in the light source array is used to represent the relative time or the absolute time to obtain the corresponding coding information; According to the switch state corresponding to the coding information, the switch state of the corresponding light source in the light source array is adjusted to obtain the light source array information adjusted in real time.

[0039] In step S102, when using the time coding rule based on the switch state, the switch state of the corresponding light source in the light source array is used to represent the relative time or absolute time, that is, 0 or 1 is used to represent the turning off or on of the light source, and a number representing the relative time or absolute time when multiple light sources are turned on or off is used to obtain the corresponding coding information. According to the switch state corresponding to the coding information, the switch state of the corresponding light source in the light source array is adjusted to obtain the light source array information after real-time adjustment.

[0040] For example, the switching status of 9 light sources is represented by a number of relative time or absolute time, when the light source is in the on state it represents 1, and when the light source is in the off state it represents 0, the number of light sources in the on state in 9 consecutive light sources (or a 3*3 light source array) can be set to represent the corresponding number, and between each number in the relative time (or absolute time), an empty light source can be set as an interval (when a 3*3 light source array is selected as the corresponding control light source, a column of 1*3 and a row of 3*1 can be set as the interval). Alternatively, the relative time or absolute time is represented in binary form, where 1 is represented when the light source is in the on state, and 0 is represented when the light source is in the off state. The corresponding number of digits in the relative time or absolute time is represented by setting the switch state of the corresponding number of light sources (or the corresponding arrangement form of the light source array). Assuming that the relative time (or absolute time) is 12:20:22, the binary relative time represented by a 1*15 matrix form is 1110110010100110, or the binary relative time represented by three 1*5 matrices (each 1*5 matrix form represents hours, minutes and seconds respectively) is 1100 (i.e. 01100), 10100 and 10110, and each 1*5 matrix form can be separated by an empty light source. The representation form of the switch state can be set according to actual needs, and the number of divided light sources or the arrangement form of the light source array can be set according to the accuracy of the relative time or absolute time.

[0041] In this encoding method, the switching speed of the light source must be high enough, and the afterglow time when it is turned off should not be too long. Otherwise, in two consecutive images taken by the camera, one of the light sources is clearly turned off, but due to the long afterglow time of the light source, the light source still emits light radiation, and the light source will be easily considered to be still on, resulting in abnormal decoding and failure to obtain the correct relative time. This problem can be solved by increasing the number of light sources, but it will cause the scale of the light source array to become larger.

[0042] In some optional embodiments, a mixed coding rule of brightness-based time coding rules and switch state-based time coding rules can be adopted to convert the values ​​of different time units according to the accuracy of relative time or absolute time, such as representing hours in binary form, representing minutes in brightness, and representing seconds by using multiple light sources to represent numbers 1 to 9 respectively.

[0043] Specifically, in step S103, a corresponding light source control method is selected according to the above-mentioned time encoding method (time encoding rule), and after adjusting the light source array in real time, the camera is controlled to shoot, and the light source array information adjusted in real time and the target shooting content are captured in the captured picture, so as to record the corresponding timestamp while acquiring the image, so that the camera captures the captured picture with the light source array information adjusted in real time, thereby achieving the purpose of time synchronization.

[0044] Alternatively, the light source array can be miniaturized, and the miniaturized light source array and controller can be integrated into a camera. When the camera is used for shooting, the light signal of the light source array can be directly acquired through the camera's photoelectric detection unit to obtain real-time adjusted light source array information, and the real-time adjusted light source array information can be displayed in a specific area of ​​the captured image (such as through a specific light guiding path, the real-time adjusted light source array information is displayed in a specific area of ​​the captured image), thereby obtaining a captured image that records the real-time adjusted light source array information.

[0045] Specifically, in step S104, the light source array information adjusted in real time is decoded using a preset time decoding rule to obtain a photographed picture with a recording of the photographing time, including: Decoding the light source array information adjusted in real time using a preset time decoding rule to obtain the shooting time corresponding to the light source array information adjusted in real time; Associating the shooting time with the shot picture to obtain the shot picture with the shooting time recorded; The shooting time is used as the sampling time, and the sampling time is associated with the sampling data to obtain the sampling data in which the sampling time is recorded.

[0046] In step S104, the preset time decoding rule is used, that is, the corresponding light source array is reversed according to the selected time encoding rule to decode the light source array information adjusted in real time, and the shooting time corresponding to the light source array information adjusted in real time is obtained, and the shooting time is associated with the captured picture to obtain the captured picture with the shooting time recorded, thereby realizing the time synchronization of the camera.

[0047] When the camera is used in combination with other devices, the other devices can collect sampling data with timestamps under the same time reference conditions (that is, the same relative time or absolute time). This can provide a time reference for time alignment with the camera, thereby dividing the sampling data and captured pictures belonging to the same relative time or absolute time into the same group of time-synchronized data.

[0048] In this method, the real-time encoding control of the light source array and the control of the camera shooting are independent of each other. During the camera shooting process, even if frame loss occurs, the time coding information of the shooting moment can be recorded in the subsequently captured images. This method is particularly suitable for low-cost high-speed cameras in working scenarios that require high-precision time synchronization.

[0049] In some optional embodiments, when a mixed coding rule of a time coding rule based on brightness and a time coding rule based on a switch state is adopted, it is necessary to perform reverse deduction for light source arrays at positions corresponding to different coding rules.

[0050] Specifically, after decoding the light source array information adjusted in real time by using a preset time decoding rule to obtain a photographed picture with a recording of the photographing time, the method further includes: The relative time or absolute time is compared with the shooting time to check whether there is an abnormal light source in the light source array.

[0051] After obtaining the photographed image with the photographing time recorded, the relative time or absolute time is compared with the photographing time to check whether there is an abnormal light source in the light source array. If the difference between the relative time (or absolute time) and the photographing time is within the allowable error range, it means that there is no abnormal light source in the light source array. If the difference between the relative time (or absolute time) and the photographing time is not within the allowable error range, it means that there is an abnormal light source in the light source array, and the position of the abnormal light source needs to be determined according to the different values, and the abnormal light source needs to be repaired or replaced. Among them, the allowable error range can be set according to actual needs.

[0052] As can be seen from the above, the camera time synchronization method obtains the relative time or absolute time in the time reference device in real time, and converts the relative time or absolute time into corresponding coding information through a preset time coding rule, so as to adjust the light source array, obtain the light source array information adjusted in real time, control the camera to shoot, so that the camera shoots a photographic picture with the light source array information adjusted in real time, and decodes the light source array information adjusted in real time using a preset time decoding rule to obtain a photographic picture with the shooting time recorded; thus, the light source array is adjusted through the preset time coding rule to shoot, and the light source array information adjusted in real time is decoded using the preset time decoding rule to obtain a photographic picture with the shooting time recorded, thereby solving the problem that the existing camera is difficult to obtain accurate shooting synchronization time when shooting images, and can simultaneously display the time information and shooting information on the photo without the need for additional time recording files, thereby improving the time synchronization efficiency of the camera.

[0053] refer to Figure 2The present application provides a camera time synchronization device, which is applied to a time synchronization system to synchronize the camera. The time synchronization system includes a control module, a light source array, a time reference device and a camera. The control module is used to control the camera time synchronization device to perform corresponding steps. The camera time synchronization device includes: An acquisition module 1 is used to acquire the relative time or absolute time in the time reference device in real time; An adjustment module 2 is used to convert the relative time or absolute time into corresponding coding information according to a preset time coding rule, so as to adjust the light source array and obtain the light source array information adjusted in real time; A shooting module 3, used for controlling the camera to shoot, so that the camera shoots pictures that record the light source array information adjusted in real time; The decoding module 4 is used to decode the light source array information adjusted in real time by using a preset time decoding rule to obtain a photographed picture with a recording of the photographing time.

[0054] It should be noted that time synchronization refers to adding a timestamp to the image information acquired by the camera, that is, recording the exact shooting time on the acquired image.

[0055] The camera time synchronization device adjusts the light source array and then shoots according to a preset time encoding rule, and decodes the light source array information adjusted in real time using a preset time decoding rule to obtain a shot picture with the shooting time recorded, thereby solving the problem that the existing camera is difficult to obtain accurate shooting synchronization time when shooting images, and can simultaneously display the time information and the shooting information on the photo without the need for an additional time recording file, thereby improving the time synchronization efficiency of the camera.

[0056] Specifically, when the acquisition module 1 is executed, the relative time or absolute time in the time reference device is acquired in real time, wherein the time reference device is a timing module built into the camera or an external time synchronization device introduced. Before acquiring the relative time or absolute time in the time reference device in real time, it is necessary to use the timing module built into the camera or introduce an external time synchronization device as the time reference device in advance. The time reference device is set to provide the camera with a time reference as a reference time. For example, when an external time synchronization device is introduced, the international standard time or local time provided by an Internet timing device or a satellite navigation device as a time reference device is used as the relative time or absolute time, or, when the camera works in association with other devices, the time provided by the timing module built into the camera or the timing module of other devices as the time reference device is used as the relative time.

[0057] Among them, the camera's built-in timing module, the timing modules of other devices and the external time synchronization device have the ability to record time, but before connecting to the network or time synchronization, the time recorded by the camera's built-in timing module, the timing modules of other devices and the external time synchronization device may not be the same due to reasons such as device usage, device recording errors or recording time in different regions.

[0058] Specifically, in the time synchronization system, the light source array refers to the arrangement of light sources in the form of an array, that is, multiple light sources (such as LEDs) are arranged in a certain arrangement (such as a matrix), and each light source is independently controlled and the brightness can be adjusted as needed. The scale and arrangement of the light source array can be set according to actual needs.

[0059] Specifically, the preset time coding rules include brightness-based time coding rules and switch state-based time coding rules, among which the brightness-based time coding rules are rules for encoding relative time by changing the brightness of the light source. This coding method has higher requirements on the control speed and response speed of the light source. The advantage is that a small number of light sources can be used to achieve high-precision time representation. For example, if one light source is used to represent a number (or a coding state), and the time calculation unit is accurate to seconds, 6 light sources are required; the switch state-based time coding rules are rules for encoding relative time by the switch state of the light source. The advantage of this coding method is that the control method is simple, but a large number of light sources are required to form an array. For example, if 10 light sources are used to represent a number (or a coding state), and the time calculation unit is accurate to seconds, 60 light sources are required.

[0060] Specifically, when the time coding rule based on brightness is used, the adjustment module 2 converts the relative time or absolute time into corresponding coding information through the preset time coding rule to adjust the light source array and obtain the light source array information adjusted in real time, and executes: Taking the preset brightness division threshold as the division interval, converting the relative time or absolute time into the corresponding brightness division level to obtain the corresponding coding information; According to the brightness classification level corresponding to the coded information, the brightness of the corresponding light source in the light source array is adjusted to obtain the light source array information adjusted in real time.

[0061] When the adjustment module 2 is executed, when using the brightness-based time coding rule, the brightness range of a single light source is divided into multiple levels with a preset brightness division threshold as the division interval, each level represents a coding state, and each coding state in the relative time is a corresponding brightness division level to obtain the corresponding coding information.

[0062] According to the brightness classification level corresponding to the coded information, the brightness of the corresponding light source in the light source array is adjusted to obtain the light source array information adjusted in real time.

[0063] The encoding method includes but is not limited to the following examples. For example, if the brightness range of a single light source is divided into 10 levels (numbers 0 to 9 each represent a level), then a light source can represent 10 different states, that is, representing 0 to 9, then each light source can represent a number of relative time. Assuming that the relative time (or absolute time) is point A, B minutes, and C seconds, then 6 light sources can be used to represent the relative time or absolute time, where the first two light sources represent point A, the middle two light sources represent B minutes, and the last two light sources represent C seconds. Between the hours, minutes, and seconds in the relative time (or absolute time), an empty light source can be set as an interval. Or if the brightness range of a single light source is divided into 6 levels (numbers 0 to 5 each represent a level), then two light sources can represent 10 different states.

[0064] Specifically, when the time coding rule based on the switch state is used, the adjustment module 2 converts the relative time or absolute time into corresponding coding information through the preset time coding rule to adjust the light source array and obtain the real-time adjusted light source array information, executes: The switch state of the corresponding light source in the light source array is used to represent the relative time or the absolute time to obtain the corresponding coding information; According to the switch state corresponding to the coding information, the switch state of the corresponding light source in the light source array is adjusted to obtain the light source array information adjusted in real time.

[0065] When the adjustment module 2 is executed, when using the time coding rule based on the switch state, the switch state of the corresponding light source in the light source array is used to represent the relative time or absolute time, that is, 0 or 1 is used to represent the closing or opening of the light source, and a number representing the relative time or absolute time by the closing or opening of multiple light sources is used to obtain the corresponding coding information. According to the switch state corresponding to the coding information, the switch state of the corresponding light source in the light source array is adjusted to obtain the light source array information after real-time adjustment.

[0066] For example, the switching status of 9 light sources is represented by a number of relative time or absolute time, when the light source is in the on state it represents 1, and when the light source is in the off state it represents 0, the number of light sources in the on state in 9 consecutive light sources (or a 3*3 light source array) can be set to represent the corresponding number, and between each number in the relative time (or absolute time), an empty light source can be set as an interval (when a 3*3 light source array is selected as the corresponding control light source, a column of 1*3 and a row of 3*1 can be set as the interval). Alternatively, the relative time or absolute time is represented in binary form, where 1 is represented when the light source is in the on state, and 0 is represented when the light source is in the off state. The corresponding number of digits in the relative time or absolute time is represented by setting the switch state of the corresponding number of light sources (or the corresponding arrangement form of the light source array). Assuming that the relative time (or absolute time) is 12:20:22, the binary relative time represented by a 1*15 matrix form is 1110110010100110, or the binary relative time represented by three 1*5 matrices (each 1*5 matrix form represents hours, minutes and seconds respectively) is 1100 (i.e. 01100), 10100 and 10110, and each 1*5 matrix form can be separated by an empty light source. The representation form of the switch state can be set according to actual needs, and the number of divided light sources or the arrangement form of the light source array can be set according to the accuracy of the relative time or absolute time.

[0067] In this encoding method, the switching speed of the light source is required to be high enough, and the afterglow time when it is turned off cannot be too long. Otherwise, in two images taken continuously by the camera, one of the light sources is obviously turned off, but because the afterglow time of the light source is long and the light source still radiates light, the light source will be easily considered to be still on, resulting in decoding abnormalities and failure to obtain the correct relative time.

[0068] In some optional embodiments, a mixed coding rule of brightness-based time coding rules and switch state-based time coding rules can be adopted to convert the values ​​of different time units according to the accuracy of relative time or absolute time, such as representing hours in binary form, representing minutes in brightness, and representing seconds by using multiple light sources to represent numbers 1 to 9 respectively.

[0069] Specifically, when the shooting module 3 is executed, it selects the corresponding light source control method according to the above-mentioned time coding method (time coding rule), and after adjusting the light source array in real time, controls the camera to shoot, and captures the light source array information adjusted in real time and the target shooting content into the captured picture, so as to record the corresponding timestamp while acquiring the image, so that the camera captures the captured picture with the light source array information adjusted in real time, thereby achieving the purpose of time synchronization.

[0070] Alternatively, the light source array can be miniaturized, and the miniaturized light source array and controller can be integrated into a camera. When the camera is used for shooting, the light signal of the light source array can be directly acquired through the camera's photoelectric detection unit to obtain real-time adjusted light source array information, and the real-time adjusted light source array information can be displayed in a specific area of ​​the captured image (such as through a specific light guiding path, the real-time adjusted light source array information is displayed in a specific area of ​​the captured image), thereby obtaining a captured image that records the real-time adjusted light source array information.

[0071] Specifically, the decoding module 4 decodes the light source array information adjusted in real time by using the preset time decoding rule to obtain a photographed picture with the photographing time recorded therein, and executes; Decoding the light source array information adjusted in real time using a preset time decoding rule to obtain the shooting time corresponding to the light source array information adjusted in real time; The shooting time is associated with the shot picture to obtain the shot picture with the shooting time recorded.

[0072] When the decoding module 4 is executed, it uses the preset time decoding rules, that is, it reverses the corresponding light source array according to the selected time encoding rules to decode the light source array information adjusted in real time, obtains the shooting time corresponding to the light source array information adjusted in real time, associates the shooting time with the captured picture, and obtains the captured picture with the shooting time recorded, thereby realizing the time synchronization of the camera.

[0073] When the camera is used in combination with other devices, the other devices can collect sampling data with timestamps under the same time reference conditions (that is, the same relative time or absolute time). This can provide a time reference for time alignment with the camera, thereby dividing the sampling data and captured pictures belonging to the same relative time or absolute time into the same group of time-synchronized data.

[0074] In this device, the real-time encoding control of the light source array and the control of the camera shooting are independent of each other. During the camera shooting process, even if frame loss occurs, the time coding information of the shooting moment can be recorded in the subsequently captured images. This device is particularly suitable for low-cost high-speed cameras in working scenarios that require high-precision time synchronization.

[0075] In some optional embodiments, when a mixed coding rule of a time coding rule based on brightness and a time coding rule based on a switch state is adopted, it is necessary to perform reverse deduction for light source arrays at positions corresponding to different coding rules.

[0076] Specifically, the camera time synchronization device also includes: The inspection module is used to compare the relative time or the absolute time with the shooting time to inspect whether there is an abnormal light source in the light source array.

[0077] After obtaining the photographed image with the photographing time recorded, the relative time or absolute time is compared with the photographing time to check whether there is an abnormal light source in the light source array. If the difference between the relative time (or absolute time) and the photographing time is within the allowable error range, it means that there is no abnormal light source in the light source array. If the difference between the relative time (or absolute time) and the photographing time is not within the allowable error range, it means that there is an abnormal light source in the light source array, and the position of the abnormal light source needs to be determined according to the different values, and the abnormal light source needs to be repaired or replaced. Among them, the allowable error range can be set according to actual needs.

[0078] As can be seen from the above, the camera time synchronization device obtains the relative time or absolute time in the time reference device in real time, and converts the relative time or absolute time into corresponding coding information through a preset time coding rule, so as to adjust the light source array, obtain the light source array information adjusted in real time, control the camera to shoot, so that the camera shoots a photographic picture with the light source array information adjusted in real time, and uses the preset time decoding rule to decode the light source array information adjusted in real time to obtain a photographic picture with the shooting time recorded; thus, the light source array is adjusted through the preset time coding rule to shoot, and the light source array information adjusted in real time is decoded through the preset time decoding rule to obtain a photographic picture with the shooting time recorded, thereby solving the problem that the existing camera is difficult to obtain accurate shooting synchronization time when shooting images, and can simultaneously display the time information and shooting information on the photo without the need for additional time recording files, thereby improving the time synchronization efficiency of the camera.

[0079] Please refer to Figure 3 , Figure 3The present application provides a structural schematic diagram of an electronic device provided in an embodiment of the present application. The present application provides an electronic device, including: a processor 301 and a memory 302. The processor 301 and the memory 302 are interconnected and communicate with each other through a communication bus 303 and / or other forms of connection mechanisms (not shown). The memory 302 stores a computer program executable by the processor 301. When the electronic device is running, the processor 301 executes the computer program to execute the camera time synchronization method in any optional implementation of the above embodiment to achieve the following functions: real-time acquisition of relative time or absolute time in a time reference device, converting the relative time or absolute time into corresponding coding information through a preset time coding rule to adjust a light source array to obtain light source array information adjusted in real time, controlling a camera to shoot so that the camera shoots a photographic picture recording the light source array information adjusted in real time, and decoding the light source array information adjusted in real time using a preset time decoding rule to obtain a photographic picture recording the shooting time.

[0080] An embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the camera time synchronization method in any optional implementation of the above-mentioned embodiment is executed to achieve the following functions: acquiring the relative time or absolute time in a time reference device in real time, converting the relative time or absolute time into corresponding coding information through a preset time coding rule to adjust the light source array to obtain the light source array information adjusted in real time, controlling the camera to shoot so that the camera shoots a photographic picture recording the light source array information adjusted in real time, and decoding the light source array information adjusted in real time using a preset time decoding rule to obtain a photographic picture recording the shooting time. Among them, the storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable red-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.

[0081] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.

[0082] In addition, the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, and may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0083] Furthermore, the functional modules in the various embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.

[0084] In this document, relational terms such as first and second, etc. are used merely to distinguish one entity or operation from another entity or operation, but do not necessarily require or imply any such actual relationship or order between these entities or operations.

[0085] The above description is only an embodiment of the present application and is not intended to limit the protection scope of the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A camera time synchronization method, applied to a time synchronization system to synchronize the camera time, characterized in that: The time synchronization system comprises a control module, a light source array, a time reference device and a camera; the control module is used to execute the camera time synchronization method, and the camera time synchronization method comprises the steps of: Acquire the relative time or absolute time in the time reference device in real time; The relative time or the absolute time is converted into corresponding coding information according to a preset time coding rule, so as to adjust the light source array and obtain the light source array information adjusted in real time; Controlling the camera to shoot, so that the camera shoots a picture recording the light source array information adjusted in real time; The light source array information adjusted in real time is decoded using a preset time decoding rule to obtain a photographed picture with the photographing time recorded.

2. The camera time synchronization method according to claim 1, characterized in that: The time reference device is a timing module built into the camera or an introduced external time synchronization device.

3. The camera time synchronization method according to claim 1, characterized in that: The preset time coding rule includes a time coding rule based on brightness and a time coding rule based on a switch state.

4. The camera time synchronization method according to claim 3, characterized in that: When the brightness-based time coding rule is used, the relative time or the absolute time is converted into corresponding coding information through a preset time coding rule to adjust the light source array, and obtain the light source array information adjusted in real time, including: Taking a preset brightness division threshold as a division interval, converting the relative time or the absolute time into a corresponding brightness division level to obtain corresponding coding information; According to the brightness classification level corresponding to the coded information, the brightness of the corresponding light source in the light source array is adjusted to obtain the light source array information adjusted in real time.

5. The camera time synchronization method according to claim 3, characterized in that: When the time coding rule based on the switch state is used, the relative time or the absolute time is converted into corresponding coding information through the preset time coding rule to adjust the light source array, and obtain the light source array information adjusted in real time, including: Using the switch state of the corresponding light source in the light source array to represent the relative time or the absolute time, to obtain corresponding coding information; According to the switch state corresponding to the coding information, the switch state of the corresponding light source in the light source array is adjusted to obtain the light source array information adjusted in real time.

6. The camera time synchronization method according to claim 1, characterized in that: Decoding the real-time adjusted light source array information using a preset time decoding rule to obtain a photographed picture with a recorded photographing time, including: Decoding the light source array information adjusted in real time by using a preset time decoding rule to obtain a shooting time corresponding to the light source array information adjusted in real time; The shooting time is associated with the shot picture to obtain the shot picture with the shooting time recorded.

7. The camera time synchronization method according to claim 1, characterized in that: After decoding the real-time adjusted light source array information using a preset time decoding rule to obtain a photographed picture with a recorded photographing time, the method further includes: The relative time or the absolute time is compared with the shooting time to check whether there is an abnormal light source in the light source array.

8. A camera time synchronization device, applied to a time synchronization system to synchronize the camera time, characterized in that: The time synchronization system includes a control module, a light source array, a time reference device and a camera; The control module is used to control the camera time synchronization device to perform corresponding steps, and the camera time synchronization device includes: An acquisition module, used for acquiring the relative time or absolute time in the time reference device; An adjustment module, used to convert the relative time or the absolute time into corresponding coding information according to a preset time coding rule, so as to adjust the light source array and obtain the light source array information adjusted in real time; A shooting module, used for controlling the camera to shoot, so that the camera shoots a picture recording the light source array information adjusted in real time; The decoding module is used to decode the light source array information adjusted in real time by using a preset time decoding rule to obtain a photographed picture with a recording of the photographing time.

9. An electronic device, characterized in that: The system comprises a processor and a memory, wherein the memory stores a computer program executable by the processor, and when the processor executes the computer program, the steps in the camera time synchronization method according to any one of claims 1 to 7 are executed.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the camera time synchronization method according to any one of claims 1 to 7 are executed.

Images