A dual-machine screen synchronization method and synchronization system in image processing

Abstract

The invention discloses a dual-machine screen synchronization method and a synchronization system in image processing, belonging to the technical field of screen synchronization processing, comprising presetting parameters of two devices, using a visual trigger as a trigger signal to remind the two devices to capture images simultaneously, and determining a pre-adjustment interval according to historical experience; acquiring parameter information in screen synchronization in real time, and storing the parameter information in a data management platform; analyzing the acquired parameter information to determine whether the dual-machine screens are synchronized; within the pre-adjustment interval, analyzing according to the acquired deviation coefficient and environmental parameters to determine whether the dual-machine screens are synchronized. The invention comprehensively analyzes the deviation values ​​of multiple data of the two devices, thereby generating a deviation coefficient, and performing real-time warning according to the deviation coefficient, so as to more accurately determine whether the two devices have a screen asynchronism phenomenon, and perform timely warning adjustment.

Description

Technical Field

[0001] The present invention relates to the technical field of picture synchronization processing, and in particular to a dual-machine picture synchronization method and a synchronization system thereof in image processing. Background Art

[0002] In video image processing, in order to ensure the continuity and smoothness of the video image sequence, a binocular camera is generally used or two devices are used to capture the image simultaneously, so as to avoid delays in video image playback or abnormal display effects.

[0003] However, when two machines are used to capture images, it is easy for the images to be out of sync. The existing method for determining whether the images are synchronized is to obtain the data parameters of the two machines and analyze them based on the difference. Since only a single data parameter is used to determine whether the images are synchronized, it is easy to make misjudgments. Moreover, since there is a process for the occurrence of image asynchrony, when it is determined that the images are out of sync, they have already occurred, so it is impossible to judge the potential situation.

[0004] Therefore, it is necessary to provide a dual-machine screen synchronization method and a synchronization system in image processing to solve the above technical problems. Summary of the invention

[0005] In order to solve the above technical problems, the present invention provides a dual-machine screen synchronization method and a synchronization system in image processing, so as to solve the problems faced in the above background technology.

[0006] The present invention provides a dual-machine screen synchronization method in image processing, comprising a data acquisition module, a data management platform and an early warning module. The synchronization method comprises the following steps:

[0007] S1: pre-set the parameters of the two devices, and use the visual trigger as a trigger signal to remind the two devices to capture images at the same time, and determine the pre-adjustment interval based on historical experience;

[0008] S2: Obtain the parameter information of the device in the screen synchronization in real time, and store the parameter information in the data management platform;

[0009] S3: The data management platform performs real-time analysis based on the acquired parameter information to generate a deviation coefficient, and determines whether the dual-machine images are synchronized based on the deviation coefficient. When it is determined that the images are not synchronized, a first warning signal is generated;

[0010] S4: When the first warning signal is not generated, within the pre-adjustment interval, the data management platform analyzes the obtained deviation coefficient and environmental parameters, generates a hidden status value, and determines whether the dual-machine images are synchronized based on the hidden status value. When it is determined that the images are not synchronized, a second warning signal is generated.

[0011] Preferably, the parameter information includes the frame rate, bit rate, transmission rate and the timestamp carried by the two devices.

[0012] Preferably, in step S3, the method by which the data management platform generates the first warning signal is:

[0013] Get the frame rate A generated by device A in real time Fps , bit rate A Cre , Transmission rate A vt and timestamp A Ts ;

[0014] At the same time, obtain the corresponding frame rate B generated by device B in real time Fps , bit rate B Cre , transmission rate B Vt and timestamp B Ts ;

[0015] The deviation coefficient G is calculated by the following formula;

[0016]

[0017] Wherein, τ1, τ2, τ3 and τ4 are preset proportional coefficients, and ΔFps, ΔCre, ΔVt and ΔTs are respective dimensionless coefficients;

[0018] The obtained deviation coefficient G is compared with the system preset deviation coefficient threshold G th For comparison:

[0019] When G>G th When the image is out of sync, it is considered that the image is out of sync and a first warning signal is generated.

[0020] Preferably, in step S4, the method by which the data management platform generates the second warning signal is:

[0021] During the pre-adjustment interval, the deviation coefficient variation curve G(t) is drawn up based on the obtained deviation coefficient.

[0022] The hidden status value R is calculated by the following formula;

[0023]

[0024] Wherein, t1 is the start time of the pre-adjustment interval period, t2 is the end time of the pre-adjustment interval period, Φ is the environmental deviation value, and G0(t) is the time-varying curve of the standard deviation coefficient preset by the system;

[0025] The obtained hidden state value R is compared with the system preset standard hidden state threshold R th For comparison:

[0026] When R>Rth , the picture is considered out of sync.

[0027] Preferably, the method for obtaining the environmental deviation value Φ is:

[0028] An environmental noise tester and a light sensor are installed at devices A and B to obtain the noise variation curves and light intensity variation curves of devices A and B respectively within the pre-adjustment interval.

[0029] The environmental deviation value Φ is calculated by the following formula;

[0030]

[0031] Among them, A N (t) is the noise curve of device A over time, A L (t) is the light intensity curve of device A over time, N (t) is the noise curve of device B over time, L (t) is the light intensity variation curve of device B over time, and β1 and β2 are preset proportional coefficients.

[0032] Preferably, in step S3, when the first warning signal is generated, the equipment parameters are immediately readjusted;

[0033] In step S4, when the second warning signal is generated, the equipment parameters are readjusted at the pre-adjustment interval point.

[0034] The present invention also provides a dual-machine screen synchronization system in image processing, a dual-machine screen synchronization method applied in image processing, including a data acquisition module, a data management platform and an early warning module, and also includes:

[0035] An initialization module, used to pre-set the parameters of the two devices and use the visual trigger as a trigger signal to remind the two devices to capture images simultaneously, while determining the pre-adjustment interval based on historical experience;

[0036] The parameter acquisition module is used to obtain the parameter information of the device in the screen synchronization in real time and store the parameter information in the data management platform;

[0037] The first synchronization judgment module is used for the data management platform to perform real-time analysis based on the acquired parameter information, thereby generating a deviation coefficient, and judging whether the dual-machine images are synchronized based on the deviation coefficient. When it is judged that the images are not synchronized, a first warning signal is generated;

[0038] The second synchronization judgment module is used to generate a hidden status value based on the obtained deviation coefficient and environmental parameters by the data management platform within the pre-adjustment interval when the first warning signal is not generated, and to judge whether the dual-machine images are synchronized based on the hidden status value. When it is judged that the images are not synchronized, a second warning signal is generated.

[0039] Compared with the related art, the dual-machine screen synchronization method and synchronization system in image processing provided by the present invention have the following beneficial effects:

[0040] The present invention comprehensively analyzes the deviation values ​​of multiple data of two devices to generate a deviation coefficient, and performs real-time warning according to the deviation coefficient. It can more accurately judge whether the two devices have screen asynchronism, and timely warn and adjust to reduce the occurrence of screen asynchronism. At the same time, it can also judge the potential asynchronism condition within the pre-adjustment interval period according to the obtained deviation coefficient and environmental impact parameters. In this way, it can judge whether the screens of the two machines are synchronized, so as to generate a warning signal in time for adjustment to reduce the occurrence of screen asynchronism; in addition, when the second warning signal is generated, the operating personnel can be reminded to readjust the equipment parameters at the pre-adjustment interval point. If the second warning signal is not generated, the analysis is re-performed, and it is judged at the next pre-adjustment interval point whether the equipment parameters need to be readjusted, which is convenient for the operating personnel to manage. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 A flowchart of a dual-machine screen synchronization method in image processing provided by the present invention;

[0042] Figure 2 A module structure diagram of a dual-machine screen synchronization system in image processing provided by the present invention. DETAILED DESCRIPTION

[0043] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the present invention, rather than to limit the present invention. It should also be noted that, for ease of description, only the parts related to the present invention, rather than all structures, are shown in the accompanying drawings. In addition, the embodiments of the present invention and the features in the embodiments may be combined with each other without conflict.

[0044] It should also be noted that, for ease of description, only the part relevant to the present invention but not all the content is shown in the accompanying drawings. It should be mentioned before discussing the exemplary embodiments in more detail that some exemplary embodiments are described as the processing or method described as a flow chart. Although the flow chart describes each operation (or step) as being processed sequentially, many operations therein can be implemented in parallel, concurrently or simultaneously. In addition, the order of each operation can be rearranged. When its operation is completed, the processing can be terminated, but it can also have additional steps not included in the accompanying drawings. The processing can correspond to a method, a function, a procedure, a subroutine, a subprogram, etc.

[0045] Embodiment 1

[0046] The present invention discloses a dual-machine screen synchronization method in image processing, such as Figure 1 As shown, the synchronization method includes the following steps:

[0047] S1: pre-set the parameters of the two devices, and use the visual trigger as a trigger signal to remind the two devices to capture images at the same time, and determine the pre-adjustment interval based on historical experience;

[0048] S2: Acquire the parameter information of the screen synchronization in real time and store the parameter information in the data management platform. The parameter information includes the frame rate, bit rate, transmission rate and the timestamp carried by the two devices;

[0049] S3: The data management platform performs real-time analysis based on the acquired parameter information to generate a deviation coefficient, and determines whether the dual-machine images are synchronized based on the deviation coefficient. When it is determined that the images are not synchronized, a first warning signal is generated;

[0050] S4: When the first warning signal is not generated, within the pre-adjustment interval, the data management platform analyzes the obtained deviation coefficient and environmental parameters, generates a hidden status value, and determines whether the dual-machine images are synchronized based on the hidden status value. When it is determined that the images are not synchronized, a second warning signal is generated.

[0051] Through the above technical scheme, the present application first adjusts the parameters of the two devices to be consistent according to the pre-set parameters, and uses the visual trigger as a trigger signal to remind the two devices to capture images at the same time, so that the initial screens of the two devices can be synchronized. In order to avoid parameter changes during the image capture process, the pre-adjustment interval can be determined based on historical experience, such as readjusting the device parameters every five minutes; then the parameter information in the real-time acquisition of screen synchronization is obtained, and the obtained parameters are comprehensively analyzed through the data management platform to determine whether the two devices have real-time deviations, thereby generating a deviation coefficient, and judging whether the dual-machine screens are synchronized based on the deviation coefficient. When it is determined that the screens are not synchronized, a first warning signal is generated to promptly remind the operator that the screens are out of sync and that it is necessary to The parameters of the two devices must be readjusted immediately to reduce the occurrence of screen asynchrony. At the same time, when the first warning signal is not generated, within the pre-adjustment interval, the data management platform performs a cumulative comprehensive analysis based on the obtained deviation coefficient and environmental impact parameters to generate a hidden status value to determine whether there is a potential deviation between the two devices, so as to determine whether the dual-machine screens are synchronized. When it is determined that the screens are asynchronized, a second warning signal is generated to remind the operating personnel that the screens are asynchronized, and the device parameters are readjusted at the pre-adjustment interval point. If the second warning signal is not generated, a new analysis is performed, and it is determined at the next pre-adjustment interval point whether the device parameters need to be readjusted to reduce the occurrence of screen asynchrony and facilitate management by the operating personnel.

[0052] As an implementation of the present invention, in step S3, the method for the data management platform to generate the first warning signal is:

[0053] Get the frame rate A generated by device A in real time Fps , bit rate A Cre , Transmission rate A vt and timestamp A Ts ;

[0054] At the same time, obtain the corresponding frame rate B generated by device B in real time Fps , bit rate B Cre , transmission rate B Vt and timestamp B Ts ;

[0055] The deviation coefficient G is calculated by the following formula;

[0056]

[0057] Wherein, τ1, τ2, τ3 and τ4 are preset proportional coefficients, and ΔFps, ΔCre, ΔVt and ΔTs are respective dimensionless coefficients;

[0058] The obtained deviation coefficient G is compared with the system preset deviation coefficient threshold Gth For comparison:

[0059] When G>G th When the image is out of sync, it is considered that the image is out of sync and a first warning signal is generated.

[0060] Through the above technical solution, this implementation provides a method for generating a first warning signal. Since there is an error in judging a single data, for example, there is a small amount of error in a certain data of two devices, but the error is within the allowable range, the default is that the screen is synchronized. However, if the results of multiple data are the same, it will also affect the occurrence of screen asynchrony, which will cause misjudgment. Therefore, this embodiment obtains the frame rate A generated by device A in real time. Fps , bit rate A Cre , Transmission rate A Vt and timestamp A Ts , and the corresponding frame rate B generated by device B in real time Fps , bit rate B Cre , transmission rate B Vt and timestamp B Ts , and calculate the deviation coefficient G through the formula, and then compare the obtained deviation coefficient G with the system preset deviation coefficient threshold G th For comparison: When G>G th When the screen is out of sync, it is considered that the screen is out of sync, and the first warning signal is generated to promptly remind the operator that the screen is out of sync, and the parameters of the two devices need to be readjusted immediately to reduce the occurrence of screen out of sync. Through this technical solution, the deviation values ​​of multiple data of the two devices are comprehensively analyzed to generate a deviation coefficient, and a real-time warning is issued based on the deviation coefficient. It can more accurately determine whether the two devices have a phenomenon of screen out of sync, thereby timely reducing the phenomenon of screen out of sync.

[0061] In the above technical solution, the preset proportional coefficients τ1, τ2, τ3, τ4 and the system preset deviation coefficient threshold G th All of them can be obtained based on empirical data, and their respective dimensionless coefficients ΔFps, ΔCre, ΔVt, and ΔTs can be determined based on relevant data in big data combined with experimental data, which will not be described in detail here.

[0062] As an implementation mode of the present invention, the method for the data management platform to generate the second warning signal in S4 is:

[0063] In the pre-adjustment interval, the deviation coefficient variation curve G(t) is drawn up based on the obtained deviation coefficient.

[0064] By formula Find the hidden status value R;

[0065] The obtained hidden state value R is compared with the system preset standard hidden state threshold R th For comparison:

[0066] When R>R th When , the picture is considered out of sync;

[0067] Wherein, t1 is the start time of the pre-adjustment interval, t2 is the end time of the pre-adjustment interval, Φ is the environmental deviation value, and G0(t) is the curve of the standard deviation coefficient preset by the system changing with time;

[0068] The method for obtaining the environmental deviation value Φ is as follows: an environmental noise tester and a light sensor are installed at both devices A and B, and the noise variation curves and light intensity variation curves of devices A and B within the pre-adjustment interval are obtained respectively;

[0069] The environmental deviation value Φ is calculated by the following formula;

[0070]

[0071] Among them, A N (t) is the noise curve of device A over time, A L (t) is the light intensity curve of device A over time, N (t) is the noise curve of device B over time, L (t) is the light intensity variation curve of device B over time, and β1 and β2 are preset proportional coefficients.

[0072] Through the above technical solution, this implementation provides a specific method for generating a second warning signal. Since the phenomenon of image asynchrony may occur slowly over time and cannot be easily discovered by operators, a preset interval (e.g., five minutes) may be preset to ensure image synchronization. The equipment parameters are fine-tuned every five minutes. However, sometimes the image does not appear abnormal within the preset interval. If the adjustment is continued, it will take too much time. Therefore, when the first warning signal is not generated, this embodiment, within the normal preset interval, a curve G(t) of the variation of the deviation coefficient over time is drawn up according to the obtained deviation coefficient. The formula Calculate the hidden status value R, and judge whether there is a potential deviation between the two devices according to the hidden status value, so as to judge whether the two machine images are synchronized. The formula It shows the difference between the change of the deviation coefficient obtained during the pre-adjustment period and the change of the standard deviation coefficient preset by the system. Obviously, the larger the value, the larger the deviation, which means the greater the possibility of the dual-machine screen being out of sync. Since the slow change of environmental factors in this process will also affect the screen synchronization, environmental noise testers and light sensors are installed at devices A and B to obtain the noise change curves of devices A and B over time and the light intensity change curves of devices B over time in the pre-adjustment interval, and calculate the environmental deviation value through the formula. The larger the environmental deviation value Φ, the greater the environmental impact between the two devices, which means the greater the possibility of the dual-machine screen being out of sync. Therefore, through the formula Perform comprehensive analysis to obtain the hidden state value R, and compare the obtained hidden state value R with the system preset standard hidden state threshold R th For comparison: When R>R th When the second warning signal is generated, it is considered that the picture is out of synchronization, and a second warning signal is generated to remind the operator that the picture is out of synchronization. The equipment parameters are readjusted at the pre-adjustment interval point. If the second warning signal is not generated, the analysis is performed again, and it is determined at the next pre-adjustment interval point whether the equipment parameters need to be readjusted to reduce the occurrence of picture asynchrony and facilitate management by the operator.

[0073] The working principle of a dual-machine screen synchronization method in image processing provided by the present invention is as follows: the present invention comprehensively analyzes the deviation values ​​of multiple data of two devices to generate a deviation coefficient, and performs real-time warning according to the deviation coefficient, which can more accurately determine whether the two devices have screen asynchronism, and timely warn and adjust to reduce the occurrence of screen asynchronism. At the same time, within the pre-adjustment interval period, cumulative analysis can be performed based on the obtained deviation coefficient and environmental impact parameters to judge potential asynchronism conditions, thereby judging whether the dual-machine screens are synchronized, thereby generating a warning signal in time for adjustment to reduce the occurrence of screen asynchronism; in addition, when a second warning signal is generated, the operator can be reminded to readjust the equipment parameters at the pre-adjustment interval point. If the second warning signal is not generated, the analysis is performed again, and it is judged at the next pre-adjustment interval point whether the equipment parameters need to be readjusted, which is convenient for the operator to manage.

[0074] Embodiment 2

[0075] The present invention also provides a dual-machine screen synchronization system in image processing, which is applied to a dual-machine screen synchronization method in image processing, including a data acquisition module, a data management platform and an early warning module. Figure 2 As shown, it also includes:

[0076] The initialization module is used to pre-set the parameters of the two devices and use the visual trigger as a trigger signal to remind the two devices to capture images simultaneously, while determining the pre-adjustment interval based on historical experience.

[0077] The parameter acquisition module is used to obtain the parameter information of the device in the screen synchronization in real time and store the parameter information in the data management platform.

[0078] The first synchronization judgment module is used for the data management platform to perform real-time analysis based on the acquired parameter information to generate a deviation coefficient, and to judge whether the dual-machine images are synchronized based on the deviation coefficient. When it is judged that the images are not synchronized, a first warning signal is generated.

[0079] The second synchronization judgment module is used to generate a hidden status value based on the obtained deviation coefficient and environmental parameters by the data management platform within the pre-adjustment interval when the first warning signal is not generated, and to judge whether the dual-machine images are synchronized based on the hidden status value. When it is judged that the images are not synchronized, a second warning signal is generated.

[0080] The present application is described with reference to flowcharts and / or block diagrams of methods, devices (systems) and computer program products according to embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0081] A person skilled in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, and the storage medium includes a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a one-time programmable read-only memory (OTPROM), an electronically erasable rewritable read-only memory (EEPROM), a compact disc (CD-ROM) or other optical disc storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

[0082] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device that includes a series of elements includes not only those elements, but also other elements that are not explicitly listed, or includes elements that are inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device that includes the elements.

Claims

1. A dual-machine screen synchronization method in image processing, comprising a data acquisition module, a data management platform and an early warning module, characterized in that: The synchronous method includes the following steps: S1: pre-set the parameters of the two devices, and use visual triggers to generate trigger signals to remind the two devices to capture images simultaneously, while determining the pre-adjustment interval based on historical experience; S2: Acquire parameter information of the devices in screen synchronization in real time, and store the parameter information in the data management platform, wherein the parameter information includes the frame rate, bit rate, transmission rate and the timestamp carried by the two devices; S3: The data management platform performs real-time analysis based on the acquired parameter information to generate a deviation coefficient, and determines whether the dual-machine images are synchronized based on the deviation coefficient. When it is determined that the images are not synchronized, a first warning signal is generated; In step S3, the method by which the data management platform generates the first warning signal is: Get The frame rate generated by the device in real time , Bit rate , Transmission rate and timestamp ; At the same time, obtain The corresponding frame rate generated by the device in real time , Bit rate , Transmission rate and timestamp ; The coefficient of deviation is calculated by the following formula ; in, 、 、 as well as is the preset scaling factor, , , as well as They are the dimensionless coefficients of frame rate, bit rate, transmission rate and timestamp respectively; The obtained coefficient of deviation Deviation coefficient threshold from system preset For comparison: when When the images are out of sync, the first warning signal is generated; S4: When it is determined that the screens are synchronized and the first warning signal is not generated, within the pre-adjustment interval, the data management platform analyzes the obtained deviation coefficient and environmental parameters to generate a hidden status value, and determines whether the dual-machine screens are synchronized according to the hidden status value. When it is determined that the screens are not synchronized, a second warning signal is generated; In step S4, the method by which the data management platform generates the second warning signal is: During the pre-adjustment interval, a curve of the variation of the deviation coefficient over time is drawn up based on the obtained deviation coefficient. , The hidden status value is calculated by the following formula ; in, is the start time of the preset interval period, is the end time of the preset interval period, is the environmental deviation value, The time-varying curve of the standard deviation coefficient preset for the system; The hidden status value to be obtained The default hidden status threshold For comparison: when , the picture is considered out of sync.

2. The method for synchronizing two-machine images in image processing according to claim 1, characterized in that: The environmental deviation value The method to obtain it is: exist , Environmental noise testers and light sensors are installed at the equipment to obtain the , The curve of equipment noise changing over time and the curve of light intensity changing over time; The environmental deviation value is calculated by the following formula ; in, for The noise curve of the equipment changes over time. for The light intensity of the device changes over time. for The noise curve of the equipment changes over time. for The light intensity of the device changes over time. as well as is the preset scale factor.

3. The method for synchronizing two-machine images in image processing according to claim 1, characterized in that: In step S3, when the first warning signal is generated, the equipment parameters are immediately readjusted; In step S4, when the second warning signal is generated, the equipment parameters are readjusted at the pre-adjustment interval point.

4. A dual-machine screen synchronization system in image processing, applied to the dual-machine screen synchronization method in image processing as described in any one of claims 1 to 3, comprising a data acquisition module, a data management platform and an early warning module, characterized in that: Also includes: An initialization module, used to pre-set the parameters of the two devices and use the visual trigger as a trigger signal to remind the two devices to capture images simultaneously, while determining the pre-adjustment interval based on historical experience; The parameter acquisition module is used to obtain the parameter information of the device in the screen synchronization in real time and store the parameter information in the data management platform; The first synchronization judgment module is used for the data management platform to perform real-time analysis based on the acquired parameter information, thereby generating a deviation coefficient, and judging whether the dual-machine images are synchronized based on the deviation coefficient. When it is judged that the images are not synchronized, a first warning signal is generated; The second synchronization judgment module is used to generate a hidden status value based on the obtained deviation coefficient and environmental parameters by the data management platform within the pre-adjustment interval when the first warning signal is not generated, and to judge whether the dual-machine images are synchronized based on the hidden status value. When it is judged that the images are not synchronized, a second warning signal is generated.

Images