A time delay determination method, apparatus, device, storage medium and computer program product

Abstract

The embodiment of the application discloses a time delay determination method, comprising: determining a first transmission time of a first electric signal obtained by converting a first optical signal received by a second device, and a first reception time of the first electric signal received by the second device, and performing matching processing on a first reference image obtained by converting and decoding a first reference optical signal with the same transmission position as the first optical signal, and a first image obtained by decoding the first electric signal, and further determining a signal transmission time delay between the first device and the second device based on a matching processing result, the first transmission time and the first reception time, thereby solving the problem of low accuracy and efficiency of time delay determination in the related art. The embodiment of the application also discloses a time delay determination device, equipment, a storage medium and a computer program product.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a delay determination method, apparatus, device, storage medium, and computer program product. Background Technology

[0002] As the application scope of video surveillance technology gradually expands, users are placing higher demands on the quality of multimedia services. Therefore, optimizing video latency, a crucial indicator of video transmission quality, is particularly important. However, obtaining accurate video latency is a pressing issue that needs to be addressed before optimization. Currently, related technologies primarily determine video latency through methods including: setting a millisecond-level timer at the playback end and aligning the video capture terminal with the timer; capturing both the source and playback videos in a single frame through screenshots or screen recordings; manually calculating the latency by playing back the recordings or photos; or periodically inserting Supplemental Enhancement Information (SEI) frames containing the current Network Time Protocol (NTP) standard time into the video stream at the streaming media server or terminal, and obtaining the latency by comparing the time in the SEI frames extracted by the player with the current system time; or simultaneously writing audio data into the video stream file and determining the latency difference by comparing the audio waveforms of the two files from the capture and playback ends. However, these related technologies suffer from low accuracy and efficiency in determining transmission latency. Summary of the Invention

[0003] To address the aforementioned technical problems, this application aims to provide a delay determination method, apparatus, device, storage medium, and computer program product, thereby resolving the issues of low accuracy and efficiency in delay determination in related technologies.

[0004] The technical solution of this application is implemented as follows:

[0005] A delay determination method, the method comprising:

[0006] Determine the first transmission time when the first device transmits a first electrical signal to the second device; wherein the first electrical signal is obtained by the first device after converting the received first optical signal;

[0007] The system receives a first image sent by the second device and determines a first reception time when the second device receives the first electrical signal; wherein the first image is obtained by the second device after decoding the received first electrical signal.

[0008] A matching process is performed on the first reference image and the first image, and the signal transmission delay between the first device and the second device is determined based on the matching process result, the first transmission time, and the first reception time; wherein, the first reference image is obtained by converting and decoding the first reference optical signal; the transmission position of the first optical signal is the same as the transmission position of the first reference optical signal.

[0009] In the above scheme, the step of performing matching processing on the first reference image and the first image, and determining the signal transmission delay between the first device and the second device based on the matching processing result, the first transmission time, and the first reception time, includes:

[0010] If the matching processing result indicates that the first reference image matches the first image, the signal transmission delay is determined based on the first transmission time and the first reception time.

[0011] The method in the above scheme further includes:

[0012] If the matching processing result indicates that the first reference image does not match the first image, a second transmission time is determined for the first device to transmit the i-th electrical signal to the second device; wherein, the i-th electrical signal is obtained by the first device after converting the received i-th optical signal; i is a positive integer greater than or equal to 2;

[0013] The device receives the i-th image sent by the second device and determines the i-th reception time of the i-th electrical signal received by the second device; wherein the second image is obtained by the second device after decoding the received i-th electrical signal;

[0014] If the i-th reference image matches the i-th image, the signal transmission delay is determined based on the i-th transmission time and the i-th reception time; wherein the i-th reference image is obtained by converting and decoding the i-th reference optical signal; the transmission position of the i-th optical signal is the same as the transmission position of the i-th reference optical signal.

[0015] The method in the above scheme further includes:

[0016] If the i-th reference image does not match the i-th image, determine the (i+1)-th transmission time of the (i+1)-th signal transmitted by the first device to the second device, until the received N-th image matches the N-th reference image; wherein, the N-th image is obtained by the second device after decoding the received N-th electrical signal; the N-th electrical signal is obtained by the first device after converting the received N-th optical signal; N is a positive integer greater than i+1;

[0017] The signal transmission delay is determined based on the Nth transmission time of the first device transmitting the Nth electrical signal to the second device and the Nth reception time of the second device receiving the Nth electrical signal.

[0018] The method in the above scheme further includes:

[0019] Obtain multiple signal transmission delays between the first device and the second device within a preset time period;

[0020] The target signal transmission delay is determined based on the transmission delays of the multiple signals.

[0021] In the above scheme, the method includes:

[0022] Based on the transmission delays of the multiple signals, a first value is determined;

[0023] The second value is determined based on the transmission delay of the multiple signals and the first value.

[0024] In the above scheme, the emission positions of the light sources corresponding to the first optical signal, the i-th optical signal, and the N-th optical signal are different from the patterns of the light sources.

[0025] A delay determination device, the device comprising:

[0026] The first determining unit is used to determine the first transmission time when the first device transmits the first electrical signal to the second device; wherein the first electrical signal is obtained by the first device after converting the received first optical signal;

[0027] The second determining unit is configured to receive a first image sent by the second device and determine a first receiving time when the second device receives the first electrical signal; wherein the first image is obtained by the second device after decoding the received first electrical signal;

[0028] The processing unit is configured to perform matching processing on the first reference image and the first image, and determine the signal transmission delay between the first device and the second device based on the matching processing result, the first transmission time, and the first reception time; wherein the first reference image is obtained by converting and decoding the first reference optical signal; and the transmission position of the first optical signal is the same as the transmission position of the first reference optical signal.

[0029] A delay determination device, the device comprising: a processor, a memory, and a communication bus;

[0030] The communication bus is used to realize the communication connection between the processor and the memory;

[0031] The processor is used to execute the delay determination program in the memory to implement the steps of the delay determination method described above.

[0032] A computer-readable storage medium storing one or more programs that can be executed by one or more processors to implement the steps of the delay determination method described above.

[0033] A computer program product comprising a computer program that, when executed by a processor, implements the aforementioned delay determination method.

[0034] The delay determination method, apparatus, device, storage medium, and computer program product provided in this application can determine the first transmission time of a first electrical signal obtained by the first device after converting a received first optical signal to a second device, receive a first image obtained by the second device after decoding the received first electrical signal, and determine the first reception time of the first electrical signal received by the second device. Then, a first reference image obtained by converting and decoding a first reference optical signal at the same transmission position as the first optical signal and a first image are matched. Based on the matching result, the first transmission time, and the first reception time, the signal transmission delay between the first device and the second device is determined. Thus, the signal transmission delay between the first device and the second device can be automatically calculated directly based on the matching result of the first reference image and the first image, the first transmission time of the first electrical signal, and the first reception time of the first electrical signal. This is unlike related technologies which require processing the video stream file first to introduce data completely unrelated to the video stream file, and then processing the video stream file with the introduced additional data to determine the transmission delay. This ensures the efficiency and accuracy of delay determination and solves the problem of low accuracy and efficiency in delay determination in related technologies. Attached Figure Description

[0035] Figure 1 A flowchart illustrating a delay determination method provided in an embodiment of this application;

[0036] Figure 2 This is a schematic diagram of a delay determination method provided in an embodiment of this application;

[0037] Figure 3 A flowchart illustrating another delay determination method provided in an embodiment of this application;

[0038] Figure 4 This is a schematic diagram of the internal structure of a delay determination device in a delay determination method provided in an embodiment of this application;

[0039] Figure 5This is a schematic diagram of the structure of a delay determination device provided in an embodiment of this application;

[0040] Figure 6 This is a schematic diagram of a delay determination device provided in an embodiment of this application. Detailed Implementation

[0041] The technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings.

[0042] It should be understood that the phrases "embodiments of this application" or "foreign embodiments" throughout the specification mean that a specific feature, structure, or characteristic related to an embodiment is included in at least one embodiment of this application. Therefore, "embodiments of this application" or "in the foreign embodiments" appearing throughout the specification do not necessarily refer to the same embodiment. Furthermore, these specific features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. In the various embodiments of this application, the sequence numbers of the above-described processes do not imply a sequential order of execution; the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application. The sequence numbers of the above-described embodiments are merely descriptive and do not represent the superiority or inferiority of the embodiments.

[0043] Unless otherwise specified, any step in the embodiments of this application performed by the electronic device may be executed by the processor of the electronic device. It is also worth noting that the embodiments of this application do not limit the order in which the electronic device performs the following steps. Furthermore, the methods used to process data in different embodiments may be the same or different methods. It should also be noted that any step in the embodiments of this application can be executed independently by the electronic device; that is, when the electronic device performs any step in the following embodiments, it may not depend on the execution of other steps.

[0044] It should be understood that the specific embodiments described herein are for illustrative purposes only and are not intended to limit the scope of this application.

[0045] This application provides a delay determination method, which can be applied to a delay determination device. (Refer to...) Figure 1 As shown, the method may include the following steps:

[0046] Step 101: Determine the first transmission time when the first device transmits the first electrical signal to the second device.

[0047] The first electrical signal is obtained by the first device after converting the received first optical signal.

[0048] In this embodiment of the application, the first optical signal may refer to the optical signal emitted by the light source at the first position; the first device may be used to convert the received first optical signal into a first electrical signal; and the second device may obtain the first image by decoding the received first electrical signal.

[0049] In one feasible way, such as Figure 2 As shown, the first device can be a data acquisition terminal; the second device can be a display terminal.

[0050] In this embodiment of the application, the control light source emits a first light signal to the first device. After receiving the first light signal, the first device converts the first light signal into a first electrical signal and emits it to the second device. At the same time, the time when the first device emits the first electrical signal to the second device is determined as the first emission time and stored.

[0051] Step 102: Receive the first image sent by the second device and determine the first reception time when the second device receives the first electrical signal.

[0052] The first image is obtained by the second device after decoding the received first electrical signal.

[0053] In this embodiment of the application, the second device can obtain a first image after decoding the received first electrical signal. Then, the first image is sent to the delay determination device. The delay determination device determines the time when the second device receives the first electrical signal as the first reception time when it receives the first image sent by the second device, and then stores the first reception time.

[0054] Step 103: Perform matching processing on the first reference image and the first image, and determine the signal transmission delay between the first device and the second device based on the matching processing result, the first transmission time and the first reception time.

[0055] The first reference image is obtained by converting and decoding the first reference optical signal; the emission position of the first optical signal is the same as the emission position of the first reference optical signal.

[0056] It should be noted that the first reference image can be an image stored in a reference image library; the reference image library includes at least one reference image, and the correspondence between the emission positions of the reference light signal obtained after decoding the reference image and the reference image.

[0057] In this embodiment, the light source can pre-emit multiple optical signals to the first device at different positions. The first device converts the received multiple reference optical signals into multiple electrical signals and sends them to the second device. The second device can decode the multiple electrical signals to obtain different reference images. Then, the different reference images, and the correspondence between the different reference images and the emission positions of the different reference optical signals, are stored in a reference image library. It should be noted that the shapes of the multiple reference optical signals emitted by the light source to the first device at different positions can be the same or different.

[0058] In this embodiment of the application, after receiving the first image sent by the second device, the first reference image corresponding to the first reference optical signal with the same transmission position as the first optical signal corresponding to the first image is obtained from the reference image library, and the first reference image and the first image are matched. Then, based on the matching result of the first reference image and the first image, the stored first transmission time and the first reception time, the signal transmission delay between the first device and the second device is determined.

[0059] The delay determination method provided in the embodiments of this application can automatically calculate the signal transmission delay between the first device and the second device directly based on the matching processing result of the first reference image and the first image, the first transmission time of the first electrical signal, and the first reception time of the first electrical signal. Instead of processing the video stream file to introduce data completely unrelated to the video stream file as in related technologies, and then processing the video stream file with the introduced additional data to determine the transmission delay, the efficiency and accuracy of delay determination are guaranteed, and the problem of low accuracy and efficiency of delay determination in related technologies is solved.

[0060] Based on the foregoing embodiments, embodiments of this application provide a delay determination method, referring to... Figure 3 As shown, the method may include the following steps:

[0061] Step 201: The delay determination device determines the first transmission time when the first device transmits the first electrical signal to the second device.

[0062] The first electrical signal is obtained by the first device after converting the received first optical signal.

[0063] In the embodiments of this application, such as Figure 4As shown, the delay determination device includes a light-emitting control unit, a light-receiving processing unit, a data storage and display unit, and a delay determination unit. The light-emitting control unit controls the light source to emit light signals and determines the transmission time of an electrical signal transmitted from one device to another. The light-receiving processing unit decodes the received electrical signals and determines the reception time of the transmitted electrical signals received by the second device. The delay determination unit calculates relevant parameters of the signal transmission delay. The data storage and display unit stores the transmission time of the electrical signals determined by the light-emitting control unit, the reception time of the electrical signals determined by the light-receiving processing unit, and the relevant parameters of the signal transmission delay calculated by the delay determination unit.

[0064] In this embodiment of the application, the light emission control unit in the delay determination device controls the light source to emit a first light signal to the first device. The image sensor in the first device converts the received first light signal into a first electrical signal. Then, the first device transmits the first electrical signal to the second device through a transmission method such as a cable or network cable. At the same time, the light emission control unit records the time when the first device emits the first electrical signal to the second device as the first emission time and sends the first emission time to the data storage and display unit for storage.

[0065] In this embodiment, the first optical signal can be an optical signal emitted by a light source at a specific emission position. The specific emission position of the light source is a predetermined position that enables the first device to receive the optical signal emitted at that position. In other words, the light source emits an optical signal at a specific emission position, which can ensure that the first device can completely receive the optical signal emitted by the light source and convert the optical signal into an electrical signal and send it to the second device so that the second device can restore the electrical signal into a display image for display. This improves the efficiency of the first device in receiving the optical signal and thus improves the efficiency of delay determination.

[0066] In this embodiment of the application, the light emission control unit controls the light source to emit light signals to the first device and transmits back the emission time data of the first device emitting electrical signals to the second device. The light receiving processing unit receives the electrical signals emitted by the first device and transmits back the reception time data of the second device receiving the electrical signals emitted by the first device. Then, the delay determination unit calculates the signal transmission delay by analyzing the emission time data and the reception time data.

[0067] Step 202: The delay determination device receives the first image sent by the second device and determines the first reception time when the second device receives the first electrical signal.

[0068] The first image is obtained by the second device after decoding the received first electrical signal.

[0069] In this embodiment of the application, the second device decodes the first electrical signal received from the first device into a first image and sends the first image to the light receiving processing unit. At this time, the light receiving processing unit determines the time when the second device receives the first electrical signal as the first receiving time and sends the first receiving time to the data storage and display unit for storage.

[0070] Step 203: The delay determination device performs matching processing on the first reference image and the first image.

[0071] The first reference image is obtained by converting and decoding the first reference optical signal; the emission position of the first optical signal is the same as the emission position of the first reference optical signal.

[0072] In this embodiment, after receiving the first image sent by the second device, the light receiving processing unit retrieves a first reference image corresponding to the first reference light signal from a reference image library. Specifically, it retrieves the first reference image corresponding to the first reference light signal emitted by the light source at the emission position of the first light signal from the reference image library. The first reference image and the first image are then matched, and the signal transmission delay is determined based on the matching result, the first emission time, and the first reception time. It should be noted that the shapes of the light signals emitted by the light source at the same emission position can be different. That is, if the reference image library contains multiple first reference images obtained by converting and decoding reference light signals of different shapes emitted by the light source at the same position, the first image is matched with each of the multiple first reference images.

[0073] It should be noted that after step 203, steps 204 or 205-209 can be executed.

[0074] Step 204: If the matching processing result indicates that the first reference image matches the first image, the delay determination device determines the signal transmission delay based on the first transmission time and the first reception time.

[0075] In this embodiment of the application, if the first reference image matches the first image, that is, the image obtained by the second device after converting and decoding the first electrical signal is the same as the image acquired by the first device by receiving the first optical signal, it indicates that the first device and the second device have achieved signal transmission by transmitting the first electrical signal. At this time, the signal transmission delay between the first device and the second device can be determined by the time when the first device transmits the first electrical signal and the time when the second device receives the first electrical signal. That is, the delay determination unit reads the first transmission time and the first reception time stored in the data storage and display unit, calculates the first transmission time and the first reception time to obtain the signal transmission delay, and stores it in the data storage and display unit.

[0076] Step 205: If the matching processing result indicates that the first reference image does not match the first image, the delay determination device determines the i-th transmission time of the first device transmitting the i-th electrical signal to the second device.

[0077] Wherein, the i-th electrical signal is obtained by the first device after converting the received i-th optical signal; i is a positive integer greater than or equal to 2.

[0078] It should be noted that the i-th optical signal can refer to the optical signal emitted by the light source at the i-th position; the emission position of the i-th optical signal is different from the emission position of the first optical signal.

[0079] In this embodiment, if the first reference image does not match the first image, that is, the image obtained by the second device after converting and decoding the first electrical signal is different from the image acquired by the first device by receiving the first optical signal, it indicates that the signal transmission between the first device and the second device has not been successful. Therefore, there is no need to calculate the signal transmission delay. Simultaneously, the data storage and display unit will delete the stored first transmission time and first reception time. At this time, if i is 2, it will continue to control the light source to emit the second optical signal to the first device, enabling the first device to send the second electrical signal obtained from the second optical signal to the second device. If the second image obtained by decoding the second electrical signal does not match the second reference image... If the image still does not match, i will become 3. At this time, the light source will be controlled to emit the i-th light signal (i.e., the third light signal) to the first device, so that the first device can convert the i-th light signal (i.e., the third light signal) into the i-th electrical signal (i.e., the third light signal) and emit the i-th electrical signal (i.e., the third light signal) to the second device. At the same time, the light emission control unit records the time when the first device emits the i-th electrical signal (i.e., the third electrical signal) to the second device as the i-th emission time (i.e., the third emission time), and sends the i-th emission time (i.e., the third emission time) to the data storage and display unit for storage. If the third image obtained by decoding the third electrical signal still does not match the third reference image, i will become 4.

[0080] Step 206: The delay determination device receives the i-th image sent by the second device and determines the i-th reception time when the second device receives the i-th electrical signal.

[0081] The i-th image is obtained by the second device after decoding the received i-th electrical signal.

[0082] In this embodiment, the second device decodes the i-th electrical signal received from the first device to obtain the i-th image, and sends the i-th image to the light receiving processing unit. The light receiving processing unit simultaneously determines the time when the second device receives the i-th electrical signal as the i-th receiving time, and sends the i-th receiving time to the data storage and display unit for storage.

[0083] It should be noted that after step 206, you can execute step 207 or steps 208-209.

[0084] Step 207: If the i-th reference image matches the i-th image, the delay determination device determines the signal transmission delay based on the i-th transmission time and the i-th reception time.

[0085] The i-th reference image is obtained by converting and decoding the i-th reference optical signal; the emission position of the i-th optical signal is the same as the emission position of the i-th reference optical signal.

[0086] It should be noted that the i-th reference image can be an image stored in a reference image library.

[0087] In this embodiment, if i is 2, it indicates that the second reference image matches the second image, meaning that the image obtained by the second device after converting and decoding the second electrical signal is the same as the image acquired by the first device by receiving the second optical signal. This indicates that the first device and the second device have achieved signal transmission by transmitting the second electrical signal. At this time, the signal transmission delay between the first device and the second device can be determined by the time when the first device transmits the second electrical signal and the time when the second device receives the second electrical signal. That is, the delay determination unit reads the second transmission time and the second reception time from the data storage and display unit, calculates the second transmission time and the second reception time to obtain the signal transmission delay, and stores it in the data storage and display unit. If i is 3, it indicates that the second reference image and the second image do not match. At this time, if the third reference image and the third image match, it indicates that the first device and the second device have achieved signal transmission by transmitting the third electrical signal. Then, the signal transmission delay between the first device and the second device can be determined by the time when the first device transmits the third electrical signal and the time when the second device receives the third electrical signal.

[0088] Step 208: If the i-th reference image does not match the i-th image, the delay determination device determines the i+1 transmission time of the first device transmitting the i+1 signal to the second device until the received N-th image matches the N-th reference image.

[0089] Wherein, the Nth image is obtained by the second device after decoding the received Nth electrical signal; the Nth electrical signal is obtained by the first device after converting the received Nth optical signal; N is a positive integer greater than i+1.

[0090] In this embodiment, if i is 2, it indicates that the second reference image and the second image do not match, meaning the image obtained by the second device decoding the second electrical signal is different from the image acquired by the first device by receiving the second optical signal. This indicates that signal transmission between the first device and the second device has not been successful. In this case, i becomes 3. After the data storage and display unit deletes the stored second transmission time and second reception time, the delay determination device will continue to determine the third transmission time of the first device transmitting the third electrical signal to the second device through the light emission control unit according to steps 205-208, and the delay determination device will receive the signal in the light receiving processing unit. When decoding the third electrical signal to obtain the third image, the third reception time of the second device receiving the third electrical signal is determined. Then, the third image and the third reference image are matched. If the third image and the third reference image match, it means that the third electrical signal transmitted by the first device has been successfully received by the second device. At this time, the loop stops, and the signal transmission delay is determined by the delay determination unit based on the third transmission time and the third time. If the third reference image and the third image still do not match, it is necessary to continue the loop processing according to steps 205-208 until the received Nth image matches the Nth reference image. At this time, the loop stops.

[0091] Step 209: The delay determination device determines the signal transmission delay based on the Nth transmission time of the first device transmitting the Nth electrical signal to the second device and the Nth reception time of the second device receiving the Nth electrical signal.

[0092] The Nth electrical signal is obtained by the first device after converting the received Nth optical signal; the Nth optical signal may refer to the optical signal emitted by the light source at the Nth position.

[0093] In the application embodiment, if an Nth image matching the Nth reference image is received, it indicates that the first device and the second device have achieved signal transmission by transmitting the Nth electrical signal. At this time, the loop stops, and the signal transmission delay between the first device and the second device can be determined by the time when the first device transmits the Nth electrical signal and the time when the second device receives the Nth electrical signal. That is, the delay determination unit reads the Nth transmission time and the Nth reception time of the Nth electrical signal stored in the data storage and display unit, and then calculates the signal transmission delay by the read Nth transmission time and the Nth reception time and stores it in the data display and storage unit.

[0094] In this embodiment, the emission positions and patterns (i.e., the shapes of the emitted light signals) of the light sources corresponding to the first, i-th, and N-th light signals are different. That is, if the first image corresponding to the first light signal does not match the first reference image, it indicates that the shape information and emission position of the first light signal are invalid. In this case, there is no need to spend more time verifying the invalid emission positions and patterns of the light sources. Instead, the emission positions and patterns of the light sources are immediately adjusted, and the i-th light signal, which has a different emission position and pattern from the light source corresponding to the first light signal, is emitted to the first device to quickly determine the image that matches the reference image. If the i-th image corresponding to the i-th light signal still does not match the i-th reference image, the emission position and image of the light source are adjusted again until the received N-th image based on the N-th light signal matches the N-th reference image. In other words, when the image corresponding to the light signal does not match the reference image, adjusting the emission position and pattern of the light source corresponding to the light signal can increase the probability of a successful match between the image corresponding to the light signal and the reference image, thereby improving the efficiency of delay determination.

[0095] In other embodiments of this application, the method may further include the following steps:

[0096] Step 210: The delay determination device acquires multiple signal transmission delays between the first device and the second device within a preset time period, and determines the target signal transmission delay based on the multiple signal transmission delays.

[0097] It should be noted that the preset time period can be a time period pre-set based on the actual application scenario and requirements; the target signal transmission delay can refer to the maximum signal transmission delay within the preset time period.

[0098] In this embodiment of the application, multiple signal transmission delays can be determined according to steps 201-209 within a preset time period, and the multiple signal transmission delays within the determined preset time period are filtered. Finally, the maximum signal transmission delay among the multiple signal transmission delays is determined as the target signal transmission delay. It should be noted that the smaller the target signal transmission delay, the smaller the delay variation, and the higher the consistency of the delay.

[0099] Step 211: The delay determination device determines a first value based on the transmission delays of multiple signals.

[0100] In one possible implementation, the first value may refer to the average transmission delay of multiple signal transmission delays within a preset time period.

[0101] In this embodiment of the application, the signal transmission delay determined according to steps 201-209 can be determined within a preset time period.

[0102] In this embodiment of the application, the transmission delays of multiple signals can be calculated to obtain the average value of all signal transmission delays, i.e., the average transmission delay. The calculation formula for the first value is shown in formula (1).

[0103]

[0104] Among them, T avg ΔT represents the average transmission delay (i.e., the first value); ΔT1 represents the first signal transmission delay within the preset time period; ΔT2 represents the second signal transmission delay within the preset time period; ΔT n This represents the transmission delay of the nth signal within a preset time period; n represents the total number of signal transmission delays within the preset time period.

[0105] Step 212: The delay determination device determines the second value based on multiple signal transmission delays and the first value.

[0106] In one feasible approach, the second value can refer to the standard deviation of the transmission delays of multiple signals within a preset time period. The smaller the second value, the smaller the fluctuation in signal transmission. It should be noted that the second value can characterize jitter delay.

[0107] In this embodiment of the application, the transmission delays of multiple signals can be calculated first to obtain the average transmission delay (i.e., the first value). After determining the average transmission delay, the difference between the transmission delay of each signal and the average transmission delay within a preset time period is calculated, and the multiple differences are calculated to obtain the standard deviation of the signal transmission delay (i.e., the second value). The formula for calculating the second value is shown in formula (2):

[0108]

[0109] Among them, T σ Indicates the second numerical value; T avg ΔT represents the average transmission delay (i.e., the first value); ΔT1 represents the first signal transmission delay within the preset time period; ΔT n This represents the transmission delay of the nth signal within a preset time period; n represents the total number of signal transmission delays within the preset time period.

[0110] In this embodiment, for actual video transmission scenarios, the consistency of video transmission delay can be comprehensively evaluated by combining the maximum transmission delay (i.e., the target signal transmission delay) and the average transmission delay (i.e., the first value). The smaller the maximum transmission delay and the average transmission delay, the better the consistency of video transmission delay and the smoother the video playback. Conversely, the larger the maximum delay and the average transmission delay, the worse the consistency of video transmission delay. In this case, stuttering will occur during video playback. At the same time, the fluctuation of video transmission delay can be quantified by the calculated second value to compare the stability of transmission delay of different videos, and then select a more suitable encoding and decoding method.

[0111] In this embodiment, the consistency and stability of signal transmission delay can be measured by calculating the maximum transmission delay, average transmission delay, and jitter delay through the delay determination unit, so as to assist in network optimization and improve user experience and service quality.

[0112] It should be noted that the descriptions of the same steps and contents as in other embodiments in this embodiment can be found in the descriptions in other embodiments, and will not be repeated here.

[0113] The delay determination method provided in the embodiments of this application can automatically determine the signal transmission delay between the first device and the second device directly based on the matching processing result of the first reference image and the first image, the first transmission time and the first reception time. Instead of processing the video stream file to introduce data completely unrelated to the video stream file as in related technologies, and then processing the video stream file with the introduced additional data to determine the transmission delay, the efficiency and accuracy of delay determination are guaranteed, and the problem of low accuracy and efficiency of delay determination in related technologies is solved.

[0114] Based on the foregoing embodiments, this application provides a delay determination device, which can be applied to... Figure 1 and 3 In the delay determination method provided in the corresponding embodiment, refer to Figure 5 As shown, the delay determination device 3 may include: a first determination unit 31, a second determination unit 32, and a processing unit 33, wherein:

[0115] The first determining unit 31 is used to determine the first transmission time when the first device transmits the first electrical signal to the second device; wherein the first electrical signal is obtained by the first device after converting the received first optical signal;

[0116] The second determining unit 32 is used to receive the first image sent by the second device and determine the first reception time when the second device receives the first electrical signal; wherein the first image is obtained by the second device after decoding the received first electrical signal;

[0117] The processing unit 33 is used to perform matching processing on the first reference image and the first image, and determine the signal transmission delay between the first device and the second device based on the matching processing result, the first transmission time and the first reception time; wherein, the first reference image is obtained by converting and decoding the first reference optical signal; the transmission position of the first optical signal is the same as the transmission position of the first reference optical signal.

[0118] In other embodiments of this application, the processing unit 33 is further configured to perform the following steps:

[0119] If the matching processing result indicates that the first reference image matches the first image, the signal transmission delay is determined based on the first transmission time and the first reception time.

[0120] In other embodiments of this application, the processing unit 33 is further configured to perform the following steps:

[0121] If the matching process result indicates that the first reference image does not match the first image, the i-th transmission time of the first device transmitting the i-th electrical signal to the second device is determined; wherein, the i-th electrical signal is obtained by the first device after converting the received i-th optical signal; i is a positive integer greater than or equal to 2;

[0122] The device receives the i-th image sent by the second device and determines the i-th reception time when the second device receives the i-th electrical signal; wherein the i-th image is obtained by the second device after decoding the received i-th electrical signal;

[0123] If the i-th reference image matches the i-th image, the signal transmission delay is determined based on the i-th transmission time and the i-th reception time; wherein, the i-th reference image is obtained by converting and decoding the i-th reference optical signal; the transmission position of the i-th optical signal is the same as the transmission position of the i-th reference optical signal.

[0124] In other embodiments of this application, the processing unit 33 is further configured to perform the following steps:

[0125] If the i-th reference image does not match the i-th image, determine the (i+1)-th transmission time of the (i+1)-th signal transmitted by the first device to the second device, until the received N-th image matches the N-th reference image; wherein, the N-th image is obtained by the second device after decoding the received N-th electrical signal; the N-th electrical signal is obtained by the first device after converting the received N-th optical signal; N is a positive integer greater than i+1;

[0126] The signal transmission delay is determined based on the Nth transmission time of the first device transmitting the Nth electrical signal to the second device and the Nth reception time of the second device receiving the Nth electrical signal.

[0127] In other embodiments of this application, the processing unit 33 is further configured to perform the following steps:

[0128] Obtain multiple signal transmission delays between the first and second devices within a preset time period;

[0129] The transmission delay of the target signal is determined based on the transmission delays of multiple signals.

[0130] In other embodiments of this application, the processing unit 33 is further configured to perform the following steps:

[0131] A first value is determined based on the transmission delays of multiple signals;

[0132] The second value is determined based on multiple signal transmission delays and the first value.

[0133] In other embodiments of this application, the emission positions and patterns of the light sources corresponding to the first optical signal, the i-th optical signal, and the N-th optical signal are different.

[0134] It should be noted that a detailed explanation of the steps performed by each unit can be found in [reference needed]. Figure 1 and 3 The delay determination method provided in the corresponding embodiments will not be described in detail here.

[0135] The delay determination device provided in the embodiments of this application can directly determine the signal transmission delay between the first device and the second device based on the matching processing result of the first reference image and the first image, the first transmission time and the first reception time. Instead of processing the video stream file to introduce data completely unrelated to the video stream file as in related technologies, and then processing the video stream file with the introduced additional data to determine the transmission delay, the device ensures the efficiency and accuracy of delay determination and solves the problem of low accuracy and efficiency of delay determination in related technologies.

[0136] Based on the foregoing embodiments, embodiments of this application provide a delay determination device, which can be applied to... Figure 1 and 3 In the delay determination method provided in the corresponding embodiment, refer to Figure 6 As shown, the delay determination device 4 may include: a processor 41, a memory 42, and a communication bus 43, wherein:

[0137] Communication bus 43 is used to realize the communication connection between processor 41 and memory 42;

[0138] Processor 41 is used to execute the delay determination program in memory 42 to perform the following steps:

[0139] Determine the first transmission time when the first device transmits the first electrical signal to the second device; wherein the first electrical signal is obtained by the first device after converting the received first optical signal;

[0140] The system receives a first image sent by a second device and determines a first reception time when the second device receives a first electrical signal; wherein the first image is obtained by the second device after decoding the received first electrical signal.

[0141] The first reference image and the first image are matched, and the signal transmission delay between the first device and the second device is determined based on the matching result, the first transmission time and the first reception time; wherein, the first reference image is obtained by converting and decoding the first reference optical signal; the transmission position of the first optical signal is the same as the transmission position of the first reference optical signal.

[0142] In other embodiments of this application, the processor 41 is configured to execute a delay determination program in the memory 42 to perform matching processing on the first reference image and the first image, and to determine the signal transmission delay between the first device and the second device based on the matching processing result, the first transmission time, and the first reception time, in order to implement the following steps:

[0143] If the matching processing result indicates that the first reference image matches the first image, the signal transmission delay is determined based on the first transmission time and the first reception time.

[0144] In other embodiments of this application, the processor 41 is used to execute the delay determination program in the memory 42, and may also implement the following steps:

[0145] If the matching process result indicates that the first reference image does not match the first image, the i-th transmission time of the first device transmitting the i-th electrical signal to the second device is determined; wherein, the second electrical signal is the result of the first device converting the received i-th optical signal;

[0146] The device receives the i-th image sent by the second device and determines the i-th reception time when the second device receives the i-th electrical signal; wherein the i-th image is the result of the second device decoding the received i-th electrical signal;

[0147] If the i-th reference image matches the i-th image, the signal transmission delay is determined based on the i-th transmission time and the i-th reception time; wherein, the i-th reference image is obtained by converting and decoding the received i-th electrical signal; the transmission position of the i-th optical signal is the same as the transmission position of the i-th reference optical signal.

[0148] In other embodiments of this application, the processor 41 is used to execute the delay determination program in the memory 42, and may also implement the following steps:

[0149] If the i-th reference image does not match the i-th image, determine the (i+1)-th transmission time of the (i+1)-th signal transmitted by the first device to the second device, until the received N-th image matches the N-th reference image; wherein, the N-th image is obtained by the second device after decoding the received N-th electrical signal; the N-th electrical signal is obtained by the first device after converting the received N-th optical signal; N is a positive integer greater than i+1;

[0150] The signal transmission delay is determined based on the Nth transmission time of the first device transmitting the Nth electrical signal to the second device and the Nth reception time of the second device receiving the Nth electrical signal.

[0151] In other embodiments of this application, the processor 41 is also configured to execute a delay determination program in the memory 42, and may further implement the following steps:

[0152] Obtain multiple signal transmission delays between the first and second devices within a preset time period;

[0153] The transmission delay of the target signal is determined based on the transmission delays of multiple signals.

[0154] In other embodiments of this application, the processor 41 is further configured to execute a delay determination program in the memory 42 to perform the following steps:

[0155] A first value is determined based on the transmission delays of multiple signals;

[0156] The second value is determined based on multiple signal transmission delays and the first value.

[0157] In other embodiments of this application, the emission positions and patterns of the light sources corresponding to the first optical signal, the i-th optical signal, and the N-th optical signal are different.

[0158] It should be noted that a detailed description of the steps performed by the processor can be found in [reference needed]. Figure 1 and 3 The delay determination method provided in the corresponding embodiments will not be described in detail here.

[0159] The delay determination device provided in the embodiments of this application can automatically determine the signal transmission delay between the first device and the second device directly based on the matching processing result of the first reference image and the first image, the first transmission time and the first reception time. Instead of processing the video stream file to introduce data completely unrelated to the video stream file as in related technologies, and then processing the video stream file with the introduced additional data to determine the transmission delay, the device ensures the efficiency and accuracy of delay determination and solves the problem of low accuracy and efficiency of delay determination in related technologies.

[0160] Based on the foregoing embodiments, embodiments of this application provide a computer-readable storage medium storing one or more programs, which can be executed by one or more processors to achieve... Figure 1 and 3 The corresponding implementation provides the steps of the delay determination method.

[0161] Based on the foregoing embodiments, embodiments of this application provide a computer program product, which includes a computer program that, when executed by a processor, implements... Figure 1 and 3 The corresponding implementation provides the steps of the delay determination method.

[0162] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of hardware embodiments, software embodiments, or embodiments combining software and hardware aspects. Furthermore, this application can take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage and optical storage) containing computer-usable program code.

[0163] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable delay determination device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable delay determination device, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0164] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable delay-determining device to operate in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0165] These computer program instructions may also be loaded onto a computer or other programmable time-determining device, causing a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable device for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0166] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for determining time delay, characterized in that, The method includes: Determine the first transmission time when the first device transmits a first electrical signal to the second device; wherein the first electrical signal is obtained by the first device after converting the received first optical signal; The system receives a first image sent by the second device and determines a first reception time when the second device receives the first electrical signal; wherein the first image is obtained by the second device after decoding the received first electrical signal. A matching process is performed on the first reference image and the first image. If the matching process result indicates that the first reference image matches the first image, the signal transmission delay between the first device and the second device is determined based on the first transmission time and the first reception time. The first reference image is obtained by converting and decoding the first reference optical signal. The transmission position of the first optical signal is the same as the transmission position of the first reference optical signal.

2. The method according to claim 1, characterized in that, The method further includes: If the matching processing result indicates that the first reference image does not match the first image, the i-th transmission time of the first device transmitting the i-th electrical signal to the second device is determined; wherein, the i-th electrical signal is obtained by the first device after converting the received i-th optical signal; i is a positive integer greater than or equal to 2; The device receives the i-th image sent by the second device and determines the i-th reception time of the i-th electrical signal received by the second device; wherein the i-th image is obtained by the second device after decoding the received i-th electrical signal; If the i-th reference image matches the i-th image, the signal transmission delay is determined based on the i-th transmission time and the i-th reception time; wherein the i-th reference image is obtained by converting and decoding the i-th reference optical signal; the transmission position of the i-th optical signal is the same as the transmission position of the i-th reference optical signal.

3. The method according to claim 2, characterized in that, The method further includes: If the i-th reference image does not match the i-th image, determine the (i+1)-th transmission time of the (i+1)-th signal transmitted by the first device to the second device, until the received N-th image matches the N-th reference image; wherein, the N-th image is obtained by the second device after decoding the received N-th electrical signal; the N-th electrical signal is obtained by the first device after converting the received N-th optical signal; N is a positive integer greater than i+1; The signal transmission delay is determined based on the Nth transmission time of the first device transmitting the Nth electrical signal to the second device and the Nth reception time of the second device receiving the Nth electrical signal.

4. The method according to claim 1, characterized in that, The method further includes: Obtain multiple signal transmission delays between the first device and the second device within a preset time period; The target signal transmission delay is determined based on the transmission delays of the multiple signals.

5. The method according to claim 4, characterized in that, The method further includes: Based on the transmission delays of the multiple signals, a first value is determined; The second value is determined based on the transmission delay of the multiple signals and the first value.

6. The method according to claim 3, characterized in that, The method further includes: The emission positions and patterns of the light sources corresponding to the first optical signal, the i-th optical signal, and the N-th optical signal are different.

7. A time delay determination device, characterized in that, The device includes: The first determining unit is used to determine the first transmission time when the first device transmits the first electrical signal to the second device; wherein the first electrical signal is obtained by the first device after converting the received first optical signal; The second determining unit is configured to receive a first image sent by the second device and determine a first receiving time when the second device receives the first electrical signal; wherein the first image is obtained by the second device after decoding the received first electrical signal; The processing unit is configured to perform matching processing on the first reference image and the first image. If the matching processing result indicates that the first reference image matches the first image, the signal transmission delay between the first device and the second device is determined based on the first transmission time and the first reception time. The first reference image is obtained by converting and decoding the first reference optical signal. The transmission position of the first optical signal is the same as the transmission position of the first reference optical signal.

8. A time delay determination device, characterized in that, The device includes: a processor, a memory, and a communication bus; The communication bus is used to realize the communication connection between the processor and the memory; The processor is used to execute the delay determination program in the memory to implement the steps of the delay determination method as described in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores one or more programs, which can be executed by one or more processors to implement the steps of the delay determination method as described in any one of claims 1 to 6.

10. A computer program product, the computer program product comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the method according to any one of claims 1 to 6.

Images