Seat management system, image display method, image display device and output equipment
By controlling the number of blanking lines, the frequency difference is eliminated, the interface image is avoided in the output device, and the current frame image is directly displayed, which solves the problem of large interface image delay in the agent management system and achieves a low-latency user experience.
Patent Information
- Application Number
- CN202111232897.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-10-22
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2041-10-22
AI Technical Summary
In the agent management system, due to the separation and deployment of data sources and display devices, the interface image delay is large, which affects the user experience and cannot achieve low-latency application requirements.
By controlling the number of blanking lines, the frequency difference between the first frame interval of the data source and the second frame interval of the output device is eliminated, so as to avoid buffering at least one frame of interface image in the output device, and directly displaying the interface image of the current frame, reducing the The display time of interface images achieves low latency between the data source and the display device.
It realizes the function of low latency in the agent management system, improves the user experience, and meets the application needs of low latency.
Smart Images

Figure CN113988569B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of image processing technology, and in particular to a seat management system, an image display method, an image display device and an output device. Background Art
[0002] The agent management system has the advantages of convenient multi-business management, seamless switching and collaborative work, and is widely used in various fields. The agent management system can solve problems such as information security, data security, and isolated work of each seat. Through visual data processing and sharing, it helps users to easily push or obtain signals from any location in the agent management system when facing a large amount of data and need to make complex decisions, and can perform remote operations, which greatly simplifies the business processing process and improves business processing efficiency. The agent management system can include data sources, display devices and operating devices, similar to computers, that is, the data source is the host of the computer, the display device is the display of the computer, and the operating device is the peripheral of the computer (such as keyboard, mouse, etc.). However, in the agent management system, the data source and the operating device are deployed separately, thereby realizing the separation of the data source and the operating device. The user can remotely control the data source through the operating device, so that the user can be separated from the device room where the data source is located, and realize human-computer separation operation. In a separate computer, the display is directly connected to the host. When the host sends the interface image to the display, the delay is relatively small, and the interface image can be quickly transmitted to the display for display. However, in the agent management system, the data source and the display device are deployed separately. The data source needs to send the interface image to the display device through the network, which has a large delay and cannot quickly transmit the interface image to the display device for display.
[0003] The main performance indicators of the agent management system are image quality and delay. Image quality determines the intuitive display effect, while delay determines the smoothness of user operation. Both image quality and delay directly affect the user experience. Therefore, when the delay of the interface image is relatively large, it will affect the user experience. Summary of the invention
[0004] The present application provides a seat management system, the seat management system comprising a data source, an input device connected to the data source, a display device, and an output device connected to the display device;
[0005] The input device is used to obtain a first frame interval of the data source, and send the first frame interval to the output device, so that the output device obtains the first frame interval; the output device is used to obtain a second frame interval of the output device; based on the first frame interval, the second frame interval and the refresh duration corresponding to N lines of data in the interface image, the target cumulative duration is determined; wherein N is a positive integer, and N is less than the total number of lines corresponding to the interface image;
[0006] The data source is further used to send the interface image, and the input device forwards the interface image to the output device, so that the output device stores the interface image in a storage medium;
[0007] The output device is further used to read the interface image from the storage medium based on the number of valid lines and the number of first blanking lines starting from the reference sending time, and display the read interface image through the display device;
[0008] Timing starts from the reference sending time, and after an interval of the target accumulation time, an interface image is read from the storage medium based on the number of valid lines and the number of second blanking lines, and the read interface image is displayed through a display device.
[0009] The present application provides an image display method, and the seat management system includes a data source, an input device connected to the data source, a display device, and an output device connected to the display device; wherein the image display method is applied to the output device, and the method includes: obtaining a first frame interval of the data source and a second frame interval of the output device; determining a target cumulative duration based on the first frame interval, the second frame interval, and a refresh duration corresponding to N lines of data in an interface image; N is a positive integer, and N is less than the total number of lines corresponding to the interface image; starting from a reference sending time, reading an interface image from the storage medium based on the number of valid lines and the first number of blanking lines, and displaying the read interface image through a display device; starting from the reference sending time, after the target cumulative duration, reading an interface image from the storage medium based on the number of valid lines and the second number of blanking lines, and displaying the read interface image through a display device.
[0010] The present application provides an image display device, and the seat management system includes a data source, an input device connected to the data source, a display device, and an output device connected to the display device; wherein the image display device is applied to the output device, and the device includes: an acquisition module, which is used to acquire a first frame interval of the data source and a second frame interval of the output device; a determination module, which is used to determine a target cumulative duration based on the first frame interval, the second frame interval, and a refresh duration corresponding to N lines of data in an interface image; wherein N is a positive integer, and N is less than the total number of lines corresponding to the interface image; a display module, which is used to read an interface image from the storage medium based on the number of valid lines and the first number of blanking lines starting from a reference sending time, and display the read interface image through a display device; the display module is also used to start timing from the reference sending time, and after the target cumulative duration is separated, read an interface image from the storage medium based on the number of valid lines and the second number of blanking lines, and display the read interface image through a display device.
[0011] The present application provides an output device, comprising: a processor and a machine-readable storage medium, wherein the machine-readable storage medium stores machine-executable instructions that can be executed by the processor; wherein the processor is used to execute the machine-executable instructions to implement the above-mentioned image display method.
[0012] The present application provides a machine-readable storage medium, which stores machine-executable instructions that can be executed by a processor; the processor is used to execute the machine-executable instructions to implement the above-mentioned image display method.
[0013] It can be seen from the above technical solution that in the embodiment of the present application, the frequency difference between the first frame interval of the data source and the second frame interval of the output device is eliminated by controlling the number of blanking lines, thereby avoiding caching at least one frame of the interface image in the output device, that is, there is no need to cache at least one frame of the interface image in the output device, and the interface image of the current frame can be directly displayed, reducing the display time of the interface image, achieving low latency between the data source and the display device, and ensuring that the delay between the data source and the display device is within one frame, thereby achieving low latency in the seat management system, meeting the application requirements of low latency, and improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0014] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments of the present application or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in this application. For ordinary technicians in this field, other drawings can also be obtained based on these drawings of the embodiments of the present application.
[0015] Figure 1 It is a structural diagram of a seat management system in one embodiment of the present application;
[0016] Figure 2 It is a structural diagram of a seat management system in one embodiment of the present application;
[0017] Figure 3A-3C is a schematic diagram of the transmission of an interface image in one embodiment of the present application;
[0018] Figure 4 is a flow chart of an image display method in one embodiment of the present application;
[0019] Figure 5A is a schematic diagram of a first frame interval and a second frame interval in one embodiment of the present application;
[0020] Figure 5B-5D is a schematic diagram of the number of effective rows and the number of blanked rows in one embodiment of the present application;
[0021] Figure 6 It is a schematic structural diagram of an image display device in one embodiment of the present application. DETAILED DESCRIPTION
[0022] The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, rather than limiting the present application. The singular forms of "a", "said" and "the" used in the present application and claims are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used herein refers to any or all possible combinations of one or more associated listed items.
[0023] It should be understood that, although the terms first, second, third, etc. may be used to describe various information in the embodiments of the present application, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present application, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, in addition, the word "if" used may be interpreted as "at..." or "when..." or "in response to determination".
[0024] See also Figure 1The figure shows the structure diagram of the agent management system, which can also be called a KVM (Keyboard Video Mouse) distributed agent system. The agent management system refers to the ability to directly remotely access and control each computer node (i.e., data source) in a distributed multi-computer environment through a set of keyboard, video, and mouse. The agent management system aims to improve the work efficiency of operators and operation and maintenance managers and strengthen communication and collaboration among various functional staff.
[0025] The seat management system may include but is not limited to an access subsystem, a switching subsystem, and an operating seat subsystem. The access subsystem is used to obtain an interface image, and send the interface image to the operating seat system through the switching subsystem. The switching subsystem is used to send the interface image of the access subsystem to the operating seat system so that the operating seat system displays the interface image, and send the control data of the operating seat system to the access subsystem so that the access subsystem can be controlled through the control data. The operating seat subsystem is used to obtain control data (such as keyboard and / or mouse operation data, etc.), and send the control data to the access subsystem through the switching subsystem.
[0026] The access subsystem may include but is not limited to data sources and input devices. The data source may be a device that provides an interface image. The interface image is the image currently displayed by the data source (i.e., the image displayed by the interface of the data source, denoted as the interface image). The data source may be a device that can be operated by a keyboard and / or a mouse, such as a host, a camera, a laptop, a video recorder, etc. There is no restriction on the type of the data source. The input device may also be referred to as an input node or an input box, and may be a KVM type input device. The data source and the input device are generally located in a computer room, and the data source and the input device may be directly connected.
[0027] When the operating system operates the data source, the data source can display an image (the user operates the data source by viewing the image). The data source obtains the image currently being displayed, which is called the interface image. The data source sends the interface image to the input device. The input device is a bridge between the data source and the output device, and is used to forward the interface image to the output device, which then forwards the interface image to the display device to display the interface image on the display device. The input device can also receive control data from the output device (such as keyboard operation data and / or mouse operation data), and forward the control data to the data source to control the data source through the control data, thereby realizing remote control of the data source.
[0028] The switching subsystem may include but is not limited to a switch, which is used to transmit the interface image of the access subsystem, and the switch is used to transmit the control data of the operation subsystem. For example, the input device can send the interface image to the switch, and the switch forwards the interface image to the output device. The output device can send the control data to the switch, and the switch forwards the control data to the input device.
[0029] The operation seat system can be deployed in a distributed manner, that is, multiple operation seats can be deployed at the same time. Figure 1 In the figure, three operating seats are taken as an example, and these three operating seats are respectively recorded as operating seat 1, operating seat 2 and operating seat 3. Of course, the number of operating seats can be more, or the number of operating seats can be 1, and there is no limitation on this.
[0030] For each operation seat, the operation seat may include but is not limited to display devices, output devices and operation devices. The display device may be a display or a display screen, etc., which is a device used to display the interface image of the data source. The output device may also be called an output node or an output box, which may be a KVM type output device. The operation device includes but is not limited to at least one of the following: keyboard, mouse, audio device, microphone, headset, USB flash drive, etc. There is no restriction on the type of the operation device. This article takes the keyboard and mouse as an example.
[0031] The display device can display the interface image of the data source, and the user can view the interface image of the data source to operate the data source. The operating device can operate the data source of the access subsystem based on the interface image, that is, the user uses the operating device to operate the data source. The output device obtains the control data (such as keyboard operation data and / or mouse operation data, etc.) when the operating device operates the data source, and sends the control data to the input device of the access subsystem, and the input device forwards the control data to the data source, thereby controlling the data source based on the control data to achieve remote control of the data source.
[0032] In summary, see Figure 2 As shown, the agent management system includes but is not limited to data sources, input devices, display devices, operating devices and output devices. The data source is similar to the host of a computer, the display device is similar to the monitor of a computer, and the operating device is similar to the peripherals of a computer (such as a keyboard, a mouse, etc.). Since the data source and the operating device are deployed separately, the separation of the data source and the operating device is achieved. The user can remotely control the data source through the operating device, so that the user can leave the device room where the data source is located.
[0033] See also Figure 2As shown, the user operates any data source through an operating device (such as a keyboard, mouse, audio device, microphone, USB flash drive, etc.), and the output device obtains the control data (such as keyboard operation data and / or mouse operation data, etc.) when the operating device operates the data source, and sends the control data to the input device, which forwards the control data to the data source. The data source displays an interface image corresponding to the control data, collects the interface image, and sends the interface image to the input device, which sends the interface image to the output device, and the output device displays the interface image on the display device.
[0034] On this basis, the user can view the interface image of the data source through the display device, and then continue to operate the data source through the operating device. The output device can obtain the control data when the operating device operates the data source, and send the control data to the input device, and so on.
[0035] The main performance indicators of the agent management system are image quality (i.e., the image quality of the interface image) and delay (i.e., the delay of the interface image, which refers to the time from the data source sending a frame of the interface image to the display device displaying the frame of the interface image). Image quality determines the intuitive display effect, while delay determines the smoothness of user operation. Both image quality and delay directly affect the user experience.
[0036] In summary, when the delay of the interface image is relatively large, it will affect the user experience. For this reason, the embodiment of the present application proposes a low-latency implementation method in a seat management system, which is described below.
[0037] In one possible implementation, the frame rate of the data source can be pre-configured (referred to as the source access frame rate). The source access frame rate is used to indicate how many frames of interface images the data source sends per second. If the source access frame rate is 100FPS (Frames PerSecond, frames transmitted per second), it means that the data source sends 100 frames of interface images per second. The frame rate of the display device can be pre-configured (referred to as the refresh display frame rate). The refresh display frame rate is used to indicate how many frames of interface images the display device displays per second. If the refresh display frame rate is 100FPS, it means that the display device displays 100 frames of interface images per second. Under normal circumstances, when configuring the source access frame rate and the refresh display frame rate, the source access frame rate of the data source and the refresh display frame rate of the display device need to be the same.
[0038] Since the source access frame rate of the data source is the same as the refresh display frame rate of the display device, for example, the source access frame rate is 100FPS and the refresh display frame rate is 100FPS, after the data source sends each frame of the interface image, the display device can display the frame of the interface image. For example, see Figure 3AAs shown, the data source sends interface image 1 at time A, and after the output device receives interface image 1 at time B (the sum of time A and the transmission delay of interface image 1, the transmission delay is the time it takes for interface image 1 to be transmitted from the data source to the output device), interface image 1 is displayed through the display device instead of being locally stored. The data source sends interface image 2 at time A+10 milliseconds (when the source access frame rate is 100FPS, the frame interval between two adjacent frames of interface images is 10 milliseconds), and the output device displays interface image 2 through the display device at time B+10 milliseconds, and so on. Every 10 milliseconds, the data source sends a frame of interface image, and the display device displays a frame of interface image.
[0039] However, in actual scenarios, there may be errors in the clock of the data source (for example, the hardware of the data source is subject to process limitations, etc., resulting in clock errors), causing the data source to not strictly send the interface image according to the source access frame rate of 100FPS. Similarly, the display device does not strictly display the interface image according to the refresh display frame rate of 100FPS. Therefore, when displaying the interface image, there will be image display problems.
[0040] Assume that the data source sends the interface image at a source access frame rate of 99FPS, and the display device displays the interface image at a refresh display frame rate of 101FPS. Then, the data source sends 99 frames of interface images per second, and the display device displays 101 frames of interface images per second. That is, the image display process has two more frames of interface images per second. Obviously, the display device cannot display the interface image at a refresh rate of 101FPS. Figure 3A The image is displayed in a display mode, that is, there is an image display problem.
[0041] For the above situation, see Figure 3BAs shown, the data source sends interface image 1 at time A, the data source sends interface image 2 at time A+10.1 milliseconds (when the source access frame rate is 99FPS, the frame interval between two adjacent frames of interface images is 10.1 milliseconds), the data source sends interface image 3 at time A+10.1+10.1 milliseconds, and so on. The data source can send a frame of interface image every 10.1 milliseconds. After the output device receives interface image 1 at time B, it stores interface image 1 in a storage medium (such as a memory) and does not immediately display interface image 1 through a display device. At time B+9.9 milliseconds (when the refresh display frame rate is 101FPS, the frame interval between two adjacent frames of interface images is 9.9 milliseconds), the output device displays interface image 1 through the display device. At time B+10.1 milliseconds, the output device receives interface image 2 and stores interface image 2 in the storage medium. At time B+9.9 milliseconds+9.9 milliseconds, the output device displays interface image 2 through the display device. By analogy, every 10.1 milliseconds, the output device receives a frame of interface image and stores it in the storage medium. Every 9.9 milliseconds, the output device displays a frame of interface image through the display device.
[0042] In summary, even if the data source sends 99 frames of interface images and the display device displays 101 frames of interface images within 1 second, by caching one frame of interface images in the storage medium, the image display problem can be avoided by "repeating frames". For example, when the interface image needs to be displayed, if the interface image from the data source has not been received, the interface image in the storage medium can be repeatedly displayed (that is, the interface image is displayed twice).
[0043] Assume that the data source sends the interface image at a source access frame rate of 101FPS, and the display device displays the interface image at a refresh display frame rate of 99FPS. Then, the data source sends 101 frames of interface images per second, and the display device displays 99 frames of interface images per second. That is, the image display process loses two frames of interface images per second. Obviously, the display device cannot display the interface image at a refresh rate of 99FPS. Figure 3A The image is displayed in a display mode, that is, there is an image display problem.
[0044] For the above situation, see Figure 3CAs shown, the data source sends interface image 1 at time A, the data source sends interface image 2 at time A+9.9 milliseconds, the data source sends interface image 3 at time A+9.9+9.9 milliseconds, and so on. The data source can send a frame of interface image every 9.9 milliseconds. After the output device receives interface image 1 at time B, it stores interface image 1 in a storage medium (such as a memory) and does not immediately display interface image 1 through the display device. At time B+10.1 milliseconds, the output device displays interface image 1 through the display device. At time B+9.9 milliseconds, the output device receives interface image 2 and stores interface image 2 in the storage medium. At time B+10.1+10.1 milliseconds, the output device displays interface image 2 through the display device. And so on, every 9.9 milliseconds, the output device receives a frame of interface image and stores it in the storage medium. Every 10.1 milliseconds, the output device displays a frame of interface image through the display device.
[0045] In summary, even if the data source sends 101 frames of interface images within 1 second and the display device displays 99 frames of interface images, by caching one frame of interface images in the storage medium, image display problems can be avoided by "dropping frames". For example, when receiving an interface image from a data source, if there is an interface image that has not been displayed in the storage medium, the currently received interface image can be discarded or the interface image stored in the storage medium can be discarded, that is, by losing one frame of interface images, display problems can be avoided.
[0046] However, in the above method, at least one frame of the interface image needs to be cached in the storage medium, resulting in a relatively large delay in the interface image (i.e., the time from the interface image being sent from the data source to the display device displaying the interface image), which cannot meet the low latency requirements of the agent management system and the user experience is very poor.
[0047] For example, see Figure 3B As shown in the figure, the data source sends interface image 1 at time A, and the output device displays interface image 1 at time B+9.9 milliseconds, that is, the delay of interface image 1 is the difference between (time B+9.9 milliseconds) and time A. The difference between time B and time A is the network delay, which is unavoidable. However, 9.9 milliseconds is the cache delay in the storage medium, which is relatively large and cannot meet the low latency requirement. Figure 3C As shown, the data source sends interface image 1 at time A, and the output device displays interface image 1 at time B + 10.1 milliseconds, that is, the delay of interface image 1 is the difference between (time B + 10.1 milliseconds) and time A, and 10.1 milliseconds is the cache delay in the storage medium, which is relatively large.
[0048] In the above embodiment, the clock of the data source may have an error, resulting in the data source not strictly sending the interface image according to the source access frame rate of 100FPS, and the display device not strictly displaying the interface image according to the refresh display frame rate of 100FPS, resulting in image display problems. The reasons are:
[0049] Assuming that the clock of the data source uses a 27M crystal oscillator (such as VCXO (voltage-controlled oscillator), etc.), then the VCXO generates a clock signal every 37 nanoseconds (1000 milliseconds divided by 27M), and 10 milliseconds (the frame interval corresponding to 100FPS is 10 milliseconds) corresponds to 270,000 clock signals. The data source sends a frame of interface image based on 270,000 clock signals, that is, it sends a frame of interface image every 270,000 clock signals, that is, it sends a frame of interface image every 10 milliseconds, and sends 100 frames of interface image per second. However, due to the error of the VCXO, the VCXO does not generate a clock signal every 37 nanoseconds, such as it may generate a clock signal every 38 nanoseconds, that is, 10 milliseconds corresponds to 263,158 clock signals, so that the number of interface images sent by the data source per second is not 100 frames, that is, the data source does not send interface images strictly according to the source access frame rate of 100FPS. Similarly, the display device does not strictly display the interface image according to the refresh display frame rate of 100FPS, which will not be repeated here.
[0050] In response to the above-mentioned problem, in an embodiment of the present application, the frequency difference between the source access frame rate of the data source and the refresh display frame rate of the display device is eliminated by controlling the number of blanking lines, thereby avoiding caching at least one frame of the interface image in the output device, that is, there is no need to cache at least one frame of the interface image, thereby achieving low latency between the data source and the display device, and realizing low latency in the seat management system to meet the low latency requirement of the seat management system.
[0051] The technical solution of the embodiment of the present application is described below in conjunction with a specific embodiment. In the embodiment of the present application, a low latency function is implemented in the seat management system, that is, it can be applied to the seat management system.
[0052] An image display method is proposed in an embodiment of the present application. The image display method can be applied to a seat management system, which may include but is not limited to: a data source, an input device connected to the data source, a display device, an output device connected to the display device, and an operating device connected to the output device. Figure 1 and Figure 2 The figure shows the structure diagram of the agent management system.
[0053] In the embodiment of the present application, the number of data sources may be at least one. When the number of data sources is greater than one, the technical solution of the embodiment of the present application may be adopted for each data source to perform display control on the interface image of the data source. For the convenience of description, the display control of the interface image of one data source is taken as an example. The display control of the interface images of other data sources is similar and will not be repeated herein.
[0054] In the embodiment of the present application, the number of output devices may be at least one. When the number of output devices is greater than one, the technical solution of the embodiment of the present application may be adopted for each output device, and the output device controls the display of the interface image of the data source. For the convenience of description, the processing process of one output device is taken as an example. The processing processes of other output devices are similar and will not be repeated herein.
[0055] In the above application scenario, see Figure 4 FIG. 1 is a flow chart of an image display method in an embodiment of the present application. The image display method can be applied to an output device. The method may include:
[0056] Step 401: Obtain a first frame interval of a data source and a second frame interval of an output device.
[0057] Exemplarily, the input device can obtain the first frame interval of the data source and send the first frame interval to the output device, which obtains the first frame interval. At this point, the output device can obtain the first frame interval of the data source, and the first frame interval represents the sending interval between two frame interface images of the data source.
[0058] For example, when the source access frame rate is 100FPS, it means that the data source sends 100 frames of interface images per second, that is, the frame interval of the data source should be 10 milliseconds, that is, the data source sends interface image 1 at time A, and sends interface image 2 at time A+10 milliseconds, and so on, sending one frame of interface image every 10 milliseconds.
[0059] However, in actual applications, considering that there may be errors in the clock of the data source, the data source does not strictly send the interface image according to the source access frame rate of 100FPS, that is, the frame interval may not be 10 milliseconds. Therefore, it is necessary to obtain the real frame interval of the data source, and this real frame interval is called the first frame interval.
[0060] In a possible implementation, the input device obtains the first frame interval in the following manner: based on the start sending time and the end sending time of a frame interface image, determine the sending duration of the frame interface image; based on the average sending duration of K1 frame interface images, determine the first frame interval, where K1 is a positive integer.
[0061] For example, when the data source sends a frame of interface image, it first sends the first line of data of the interface image, then sends the second line of data of the interface image, and so on, and finally sends the last line of data of the interface image, that is, the data source continuously sends each line of data, and the duration of this continuous sending (that is, the duration of continuous sending from the first line of data of the interface image to the last line of data of the interface image) is the sending interval between two frames of interface image (that is, the first frame interval). Therefore, the sending duration of a frame of interface image can be counted and used as the first frame interval. In order to ensure the accuracy of the first frame interval, the sending duration of K1 (configured according to experience, such as 5, 10, etc.) frames of interface image can also be counted, and the average value of the sending duration of K1 frames of interface image is used as the first frame interval.
[0062] In order to count the sending time of a frame of interface image, the start sending time and the end sending time of the frame of interface image can be determined first, and the difference between the end sending time and the start sending time is used as the sending time of the frame of interface image. For example, assuming that the clock of the data source adopts 27M VCXO, VCXO generates 1 clock signal every 37 nanoseconds, and the source access frame rate is 100FPS (this 100FPS is a pre-configured value, but the actual source access frame rate may not be 100FPS, see the above embodiment for the reason), that is, 1 frame of interface image is sent every 270,000 clock signals (for example, 100 frames of interface image are sent in 1 second, then 1 frame of interface image is sent in 10 milliseconds, because 1 clock signal is generated in 37 nanoseconds, then 10 milliseconds corresponds to 270,000 clock signals), on this basis:
[0063] When the data source starts to send a frame of interface image, a start signal of the frame of interface image is generated. After receiving the start signal, the input device uses the time when the start signal is received as the start time of sending the frame of interface image, and starts counting the clock signal generated by the VCXO of the data source. After the frame of interface image is sent, the data source generates a stop signal of the frame of interface image. After receiving the stop signal, the input device uses the time when the stop signal is received as the stop time of sending the frame of interface image, and stops counting the clock signal generated by the VCXO of the data source, and obtains the total number of clock signals generated by the VCXO of the data source during this period, which is recorded as the total number P. The input device can determine the difference between the end time of sending and the start time of sending based on the total number P of clock signals. For example, since one clock signal is generated in 37 nanoseconds, the product of 37 nanoseconds and the total number P is used as the difference between the end time of sending and the start time of sending, that is, the first frame interval. Obviously, if the total number P is 270,000, the first frame interval is 10 milliseconds, if the total number P is greater than 270,000, the first frame interval is greater than 10 milliseconds, and if the total number P is less than 270,000, the first frame interval is less than 10 milliseconds.
[0064] In summary, the input device can obtain the first frame interval and send the first frame interval to the output device.
[0065] Exemplarily, the output device can obtain the second frame interval of the output device (the image display process of the display device is controlled by the output device, that is, the output device controls the display device based on its own clock, and therefore, the second frame interval of the output device is also the second frame interval of the display device), and the second frame interval represents the display interval between two frames of interface images of the display device.
[0066] For example, when the refresh display frame rate is 100FPS, it means that the display device displays 100 frames of interface images per second, that is, the frame interval of the display device should be 10 milliseconds, that is, the display device displays interface image 1 at time B, and displays interface image 2 at time B+10 milliseconds, and so on, displaying a frame of interface image every 10 milliseconds. However, in actual applications, considering that the display device does not strictly display the interface image according to the refresh display frame rate of 100FPS, that is, the frame interval may not be 10 milliseconds, therefore, it is necessary to obtain the real frame interval of the output device, and this real frame interval is called the second frame interval.
[0067] In a possible implementation, the output device may obtain the second frame interval in the following manner: based on the starting reception time (also indicating the starting display time, i.e., the image is displayed after being received) and the ending reception time (also indicating the ending display time) of a frame of interface image, determine the reception duration of the frame of interface image; based on the average reception duration of K2 frame interface images, determine the second frame interval, where K2 is a positive integer.
[0068] For example, when the output device receives a frame of interface image, it first receives the first line of data of the interface image, then receives the second line of data of the interface image, and so on, and finally receives the last line of data of the interface image, that is, the output device continuously receives each line of data, and the duration of this continuous reception (that is, the duration of continuous reception from the first line of data of the interface image to the last line of data of the interface image) is the reception interval between two frames of interface image (that is, the second frame interval). Therefore, the reception duration of a frame of interface image can be counted and used as the second frame interval. In order to ensure the accuracy of the second frame interval, the reception duration of K2 (which can be the same as or different from K1, configured according to experience, such as 3, 6, etc.) frames of interface image can also be counted, and the average value of the reception duration of K2 frames of interface image is used as the second frame interval.
[0069] In order to count the reception time of a frame of interface image, the start reception time and the end reception time of the frame of interface image can be determined first, and the difference between the end reception time and the start reception time is used as the reception time of the frame of interface image. For example, when the output device starts to receive a frame of interface image, a start signal of the frame of interface image is generated, and the generation time of the start signal is used as the start reception time, and the clock signal generated by the output device is started to be counted. After the frame of interface image is received, an end signal of the frame of interface image is generated, and the generation time of the end signal is used as the end reception time, and the clock signal generated by the output device is stopped from being counted, and the total number of clock signals generated during this period of time is known. The output device can determine the difference between the end reception time and the start reception time based on the total number of clock signals, that is, the second frame interval.
[0070] In summary, the output device can obtain the first frame interval of the data source and the second frame interval of the output device, see Figure 5A As shown, it is a schematic diagram of the first frame interval and the second frame interval, ts represents the first frame interval of the data source, td represents the second frame interval of the output device, and the first frame interval ts is different from the second frame interval td.
[0071] Step 402: Determine the target cumulative duration based on the first frame interval, the second frame interval, and the refresh duration corresponding to N lines of data in the interface image. Wherein, N can be a positive integer, and N is less than the total number of lines corresponding to the interface image. Preferably, the value of N can be 1. Of course, N can also be other values, as long as the value of N is less than the total number of lines corresponding to the interface image, which is not limited in this embodiment.
[0072] Exemplarily, the difference between the first frame interval and the second frame interval (ie, the larger value minus the smaller value) may be calculated, and the target cumulative duration may be determined based on the refresh duration corresponding to the N rows of data and the difference.
[0073] In a possible implementation, step 402 may be implemented by:
[0074] Step 4021: Calculate the difference between the first frame interval and the second frame interval.
[0075] For example, the difference between the first frame interval and the second frame interval can be obtained by subtracting the smaller value from the larger value between the first frame interval and the second frame interval. The absolute value of the difference between the first frame interval and the second frame interval can also be calculated and used as the difference between the first frame interval and the second frame interval.
[0076] For example, assuming that the first frame interval is 9.9 milliseconds and the second frame interval is 10.1 milliseconds, the difference between the first frame interval and the second frame interval is 0.2 milliseconds. For example, assuming that the first frame interval is 10.1 milliseconds and the second frame interval is 9.9 milliseconds, the difference between the first frame interval and the second frame interval is 0.2 milliseconds.
[0077] Step 4022: Calculate the ratio between the value N and the total number of rows corresponding to one frame of the interface image.
[0078] For example, when transmitting a frame of interface image, the first line of valid data of the frame of interface image is transmitted first, then the second line of valid data of the frame of interface image is transmitted, and so on, and finally the last line of valid data of the frame of interface image is transmitted. The first to last lines of the above valid data are called valid lines, and the total number of these lines is the number of valid lines. For example, for an interface image with a resolution of 1366*768, there are 1366 pixels in each line, that is, each line of valid data includes the pixel values of 1366 pixels, and the interface image has a total of 768 valid lines, so the number of valid lines is 768.
[0079] After transmitting the valid data of one frame of interface image and before transmitting the valid data of the next frame of interface image, a period of time is usually required. This period of time can be called the blanking time. The blanking time is a pre-configured parameter value and can be configured according to actual experience. By configuring this blanking time, the data source does not transmit valid data during the blanking time, and the display device does not display valid data during the blanking time, thereby adjusting the afterglow of the display screen of the display device and improving the display effect of the interface image.
[0080] Generally, the blanking time is the time corresponding to W lines of valid data of the interface image, that is, the transmission time required for W lines of valid data of the interface image is used as the blanking time, that is, the value of the blanking time is controlled by configuring the value of W. The value of W can be configured based on experience and there is no restriction on this.
[0081] The value of W can be called the number of blanking lines. If the value of W is 70, the number of blanking lines is 70. If the value of W is 80, the number of blanking lines is 80. In practical applications, the value range of the number of blanking lines of a display device is known, that is, it is related to the product type of the display device and is not restricted, such as 7-652. Therefore, any value within the value range can be used as the number of blanking lines, that is, the number of blanking lines can be arbitrarily configured as long as the number of blanking lines is within the value range. 70 is used as an example for explanation in the following.
[0082] Among them, when the value of the number of blanking lines W is 70, after transmitting the valid data of a frame of interface image, before transmitting the valid data of the next frame of interface image, it is also necessary to transmit the invalid data of the frame of interface image (i.e., the blanking signal). For example, the first line of invalid data of the frame of interface image can be transmitted first, and then the second line of invalid data of the frame of interface image can be transmitted, and so on, and finally the last line of invalid data of the frame of interface image (i.e., the 70th line) is transmitted. The first to the last lines of the above-mentioned invalid data are called invalid lines, and the total number of these lines is the number of invalid lines, that is, the number of blanking lines.
[0083] It should be noted that in step 401, for a frame of interface image, the first row of data of the frame of interface image refers to the first row of valid data of the frame of interface image, and the last row of data of the frame of interface image refers to the last row of invalid data of the frame of interface image.
[0084] In summary, the total number of lines corresponding to a frame of interface image can be the sum of the number of effective lines and the number of blanking lines. Figure 5BAs shown, assuming that the number of valid lines is 768 and the number of blanking lines is 70, the total number of lines corresponding to one frame of interface image is 838. That is to say, when transmitting one frame of interface image, the first line of valid data is transmitted first, then the second line of valid data is transmitted, ..., then the 768th line of valid data is transmitted, and then a total of 70 lines of invalid data are transmitted, that is, waiting for the blanking time corresponding to the total of 70 lines of invalid data (that is, no valid data is transmitted during this period of time), and at this point, the transmission of the frame of interface image is completed.
[0085] It should be noted that, in the above embodiment, when the first frame interval is 10.1 milliseconds, it means that 838 lines correspond to 10.1 milliseconds, rather than 768 lines of valid data corresponding to 10.1 milliseconds. Similarly, when the second frame interval is 9.9 milliseconds, it means that 838 lines correspond to 9.9 milliseconds, rather than 768 lines of valid data corresponding to 9.9 milliseconds.
[0086] In step 4022, the value of N can be set arbitrarily as long as N is less than the total number of lines 838. For example, when the value of N is 1, the ratio is 1 / 838, when the value of N is 2, the ratio is 2 / 838, and so on. For the convenience of description, in the subsequent embodiments, it is assumed that the number of effective lines is 930 and the number of blanking lines is 70, that is, the total number of lines corresponding to one frame of interface image is 1000, and when the value of N is 1, the ratio is 0.001.
[0087] Step 4023, based on the refresh duration corresponding to one frame of the interface image (the refresh duration can be determined based on the source access frame rate or the refresh display frame rate, and for the sake of convenience, it is recorded as refresh duration 1) and the ratio value, determine the refresh duration corresponding to N lines of data in the interface image (for the sake of convenience, it is recorded as refresh duration 2).
[0088] For example, assuming that the source access frame rate of the data source is 100FPS, that is, the data source sends 100 frames of interface images per second (i.e., 1000 milliseconds), then when the refresh duration 1 is determined based on the source access frame rate, the refresh duration 1 is determined to be 10 milliseconds (i.e., 1000 milliseconds / 100). Similarly, assuming that the refresh display frame rate is 100FPS, when the refresh duration 1 is determined based on the refresh display frame rate, the refresh duration 1 is 10 milliseconds.
[0089] Exemplarily, the refresh time 2 may be determined based on the product value between the refresh time 1 and the ratio value. For example, assuming that the refresh time 1 is 10 milliseconds and the ratio value is 0.001, the refresh time 2 is 0.01 milliseconds.
[0090] Step 4024: determine the target cumulative duration based on the refresh duration corresponding to the N lines of data in the interface image and the difference (the difference between the first frame interval and the second frame interval).
[0091] It should be noted that the values in step 4021-step 4023 are only for the convenience of describing the examples given. In actual applications, the difference between the first frame interval and the second frame interval will be much smaller than 0.2 milliseconds, that is, the target cumulative duration is a relatively large value. This is explained below with a practical example.
[0092] Assume that the source access frame rate is 60FPS (i.e., the frame interval is 16.66667 milliseconds), and the refresh display frame rate is 60FPS. The data source clock uses a 27M VCXO. The VCXO generates a clock signal every 37.03704 nanoseconds (1000 milliseconds divided by 27M). That is, 16.66667 milliseconds corresponds to 450,000 clock signals (i.e., the VCXO should generate 450,000 clock signals in 16.66667 milliseconds). Then:
[0093] If the data source generates 450005 clock signals in 16.66667 milliseconds, the first frame interval of the data source may be 16.66685 milliseconds (i.e., 450005*37.03704 nanoseconds, and the first frame interval is greater than 16.66667 milliseconds). If the output device generates 449996 clock signals in 16.66667 milliseconds, the second frame interval of the output device may be 16.66652 (i.e., 449996*37.03704 nanoseconds, and the second frame interval is less than 16.66667 milliseconds). In summary, there is a difference between the first frame interval and the actual frame interval corresponding to 60 FPS (i.e., 16.66667 milliseconds), and there is a difference between the second frame interval and the actual frame interval corresponding to 60 FPS.
[0094] After the first frame interval and the second frame interval are obtained, the difference between the first frame interval and the second frame interval may be calculated. The difference may be 0.00033 milliseconds, that is, 330 nanoseconds.
[0095] The source access frame rate and the refresh display frame rate are both 60FPS. The refresh time corresponding to one frame of the interface image is 16.66667 milliseconds (i.e. 1000 / 60). If the value of N is 1, the number of valid lines is 930, the number of blanking lines is 70, that is, the total number of lines is 1000, then the ratio value is 0.001 (1 / 1000), and the refresh time corresponding to N lines of data in the interface image is 0.01666667 milliseconds (16.66667*0.001), that is, 166666.7 nanoseconds.
[0096] Then, the quotient between the refresh duration corresponding to the N lines of data in the interface image and the difference is determined as the number of images to be accumulated, that is, the number of images to be accumulated is 505 (the quotient between 166666.7 nanoseconds and 330 nanoseconds). For example, for a frame of interface image, the difference between the first frame interval and the second frame interval is 330 nanoseconds. After accumulating 505 frames of interface images, the accumulated difference between the first frame interval and the second frame interval is 166666.7 nanoseconds, which is exactly accumulated to the refresh duration corresponding to the N lines of data in the interface image.
[0097] Then, the target cumulative time is determined based on the number of images to be accumulated and the refresh time corresponding to a frame of the interface image. For example, the product value of the number of images to be accumulated and the refresh time corresponding to a frame of the interface image is calculated. The target cumulative time can be equal to the product value, greater than the product value, or less than the product value.
[0098] For example, assuming that the source access frame rate and the refresh display frame rate are both 60FPS, the refresh time corresponding to one frame of the interface image is 16.66667 milliseconds. Assuming that the source access frame rate and the refresh display frame rate are both 100FPS, the refresh time corresponding to one frame of the interface image is 10 milliseconds. Taking 10 milliseconds as an example, the product of the number of images to be accumulated 505 and the refresh time corresponding to one frame of the interface image is 10 milliseconds*505.
[0099] On this basis, the target cumulative duration may be equal to 5050 milliseconds, may be greater than 5050 milliseconds, or may be less than 5050 milliseconds. For the processing procedures in these three cases, refer to the subsequent embodiments.
[0100] At this point, the implementation process of step 402 is completed, so that the target cumulative duration can be obtained.
[0101] Step 401-Step 402 is the process of determining the target cumulative duration, and is the processing flow before the interface image is sent. During the process of sending the interface image, the data source can send the interface image to the input device, such as the data source sending each frame of the interface image in sequence based on the source access frame rate. After receiving each frame of the interface image, the input device can forward the frame of the interface image to the output device, and the output device receives each frame of the interface image. After receiving each frame of the interface image, the output device stores the frame of the interface image in a storage medium (such as a memory) and displays the interface image in the storage medium through a display device.
[0102] When the data source sends a frame of interface image, it first sends the first line of valid data of the frame of interface image, then sends the second line of valid data, ..., until the last line of valid data is sent, and waits for the blanking time corresponding to W (number of blanking lines) lines of valid data, that is, sends W lines of invalid data, so that the transmission of the frame of interface image is completed, and then the next frame of interface image is sent, and so on. When the output device receives each line of valid data of the interface image, it can store the line of valid data in the storage medium (such as memory), and control the display device to display each line of valid data stored in the storage medium (for example, the output device first reads the first line of valid data in the storage medium, displays the valid data through the display device, deletes the first line of valid data that has been read from the storage medium, and based on the remaining valid data in the storage medium, the output device continues to read the first line of valid data in the storage medium, and displays the valid data through the display device, and so on).
[0103] It should be noted that in this embodiment, the storage medium only needs to store N lines of valid data of the interface image, rather than storing all lines of valid data of the interface image, that is, avoiding caching at least one frame of the interface image in the storage medium, and adjusting the cache granularity of the storage medium from one frame of the interface image to N lines of valid data, thereby reducing the display time of the interface image and achieving low latency in the agent management system.
[0104] The following combination Figure 4 As shown, the display process of the interface image is continued to be described.
[0105] See also Figure 4 As shown, during the sending process of the interface image, the image display method may further include:
[0106] Step 403: starting from the reference sending time, the interface image is read from the storage medium of the output device based on the number of valid lines and the number of first blanking lines, and the read interface image is displayed through the display device.
[0107] Exemplarily, the number of valid lines is related to the resolution of the interface image. Assuming the resolution is 1366*768, the number of valid lines is 768. The first number of blanking lines is the preconfigured number of blanking lines W. Assuming the preconfigured number of blanking lines W is 70, the first number of blanking lines is 70. In summary, the number of valid lines 768 and the number of blanking lines 70 can be known, and based on the number of valid lines 768 and the number of blanking lines 70, the interface image is read from the storage medium of the output device, and the interface image is displayed through the display device.
[0108] Exemplarily, the output device determines the reference sending time by adopting the following steps:
[0109] Step 4031: The output device obtains the initial sending time of the first interface image of the data source.
[0110] For example, the data source determines the initial sending time of the first interface image, and sends the initial sending time to the input device, and the input device sends the initial sending time to the output device.
[0111] For example, suppose that the data source needs to send multiple frames of interface images based on the source access frame rate, and the sending time of the first interface image among these interface images can be recorded as the initial sending time. For example, the data source sends interface image 1 at time A, sends interface image 2 at time A+10 milliseconds, and so on. Then the initial sending time of the first interface image (i.e., interface image 1) is time A. The data source can send "time A" to the input device, and the input device sends "time A" to the output device.
[0112] Step 4032: The output device determines the reference sending time based on the initial sending time, the data transmission delay between the data source and the output device, and the refresh duration corresponding to M rows of data in the interface image, where M is a positive integer, greater than or equal to 1, and less than the total number of rows corresponding to the interface image.
[0113] Preferably, the value of M may be 1. Of course, M may also be other values, as long as the value of M is less than the total number of rows corresponding to the interface image. This is not limited in this embodiment.
[0114] Exemplarily, the data transmission delay between the data source and the output device refers to: the delay between the transmission of the interface image from the data source to the output device. Assuming that the data source sends the interface image 1 at time A, the output device receives the interface image 1 at time B, and the data transmission delay is delay C, then delay C is the difference between time B and time A. Regarding the acquisition of data transmission delay, the following method can be used: the data source sends a test image to the output device, and the test image carries the sending time of the test image. After receiving the test image, the output device can know the receiving time of the test image, and use the difference between the receiving time and the sending time as the data transmission delay. Of course, the above method is only an example and is not limited to this.
[0115] Exemplarily, the output device may determine the reference sending time based on the sum of the initial sending time, the data transmission delay, and the refresh duration corresponding to the M rows of data in the interface image. For example, the sum of the initial sending time, the data transmission delay, and the refresh duration may be used as the reference sending time.
[0116] Obviously, the sum of the initial sending time and the data transmission delay is the receiving time of the first interface image of the data source. When the sum of the receiving time and the refresh time corresponding to M lines of data in the interface image is used as the reference sending time, it means that when the output device displays the interface image at the reference sending time, M lines of data of the first interface image of the data source have been cached in the storage medium. In other words, the output device starts to display each line of data of the interface image through the display device on the basis of the M lines of data of the interface image that have been cached, thereby avoiding the situation where there is no data to be displayed in the storage medium when the data of the interface image needs to be displayed.
[0117] Exemplarily, in order to obtain the refresh time corresponding to M lines of data in an interface image, the following method can be used: calculate the ratio between the value M and the total number of lines corresponding to a frame of the interface image; determine the refresh time corresponding to the M lines of data in the interface image based on the refresh time corresponding to a frame of the interface image and the ratio.
[0118] Referring to the above embodiment, the total number of lines corresponding to a frame of interface image and the refresh time corresponding to a frame of interface image have been introduced. For example, when the number of valid lines is 930 and the number of blanking lines is 70, the total number of lines is 1000, and the refresh time corresponding to a frame of interface image is 10 milliseconds. If the value of M is 1, the ratio value is 0.001, if the value of M is 2, the ratio value is 0.002, and so on. Taking the value of M as 1 as an example, based on this, the refresh time corresponding to M lines of data in the interface image is 0.001*10 milliseconds, that is, 0.01 milliseconds.
[0119] To summarize, the initial sending moment is moment A, the data transmission delay is delay C, the sum of moment A and delay C is moment B, the sum of moment A, delay C and the refresh time corresponding to M lines of data in the interface image is moment B + 0.01 milliseconds, that is, the reference sending moment is moment B + 0.01 milliseconds, the output device starts from moment B + 0.01 milliseconds, reads the interface image from the storage medium based on the number of valid lines and the first blanking line number, and displays the interface image through the display device. For this display process, please refer to the subsequent embodiments.
[0120] Step 404, starting timing from the reference sending time, after the interval target accumulation time, read the interface image from the storage medium based on the number of valid lines (which can be the same as the number of valid lines in step 403) and the number of second blanking lines, and display the read interface image through the display device.
[0121] Exemplarily, the target cumulative duration can be equal to 5050 milliseconds, or greater than 5050 milliseconds, or less than 5050 milliseconds. When the target cumulative duration is equal to 5050 milliseconds, it means that the accumulated difference between the first frame interval and the second frame interval is just accumulated to the refresh duration corresponding to N lines of data in the interface image, that is, the amount of error data has accumulated N lines of data (it may be that N lines of data are stored more in the storage medium, or N lines of data are stored less in the storage medium). Therefore, after the target cumulative duration is exceeded, the amount of error data of N lines of data is eliminated by changing the number of blanking lines (that is, changing from the first number of blanking lines to the second number of blanking lines). For example, if N lines of data are stored more in the storage medium, the number of the second blanking lines is N less than the first number of blanking lines, thereby reducing the display of N blanking lines (that is, displaying N more lines of data). If N lines of data are stored less in the storage medium, the number of the second blanking lines is N more than the first number of blanking lines, thereby increasing the display of N blanking lines (that is, displaying N fewer lines of data).
[0122] When the target accumulation time is greater than 5050 milliseconds, it means that the accumulated error data amount exceeds N lines of data. Therefore, after the target accumulation time is exceeded, the error data amount of N lines of data is eliminated by changing the number of blanking lines (since the error data amount has accumulated more than N lines of data, and only the error data amount of N lines of data is eliminated, there is still some remaining error data, but it does not affect the normal display of the image).
[0123] When the target accumulation time is less than 5050 milliseconds, it means that the accumulated error data amount has not reached N lines of data. Therefore, after the target accumulation time is exceeded, the error data amount of N lines of data is eliminated by changing the number of blanking lines (since the error data amount has not reached N lines of data and the error data amount of N lines of data has been eliminated, more error data amount is eliminated, but it does not affect the normal display of the image).
[0124] It should be noted that the second number of blanking lines may be different from the first number of blanking lines, and the second number of blanking lines is determined based on the first number of blanking lines. When determining the second number of blanking lines, the second number of blanking lines may be greater than the first number of blanking lines, or the second number of blanking lines may be less than the first number of blanking lines.
[0125] For example, based on the number of first blanking lines, the number of second blanking lines can be determined in the following manner:
[0126] If the first frame interval is greater than the second frame interval, the second blanking line number needs to be greater than the first blanking line number. For example, the second blanking line number is the sum of the first blanking line number and the value N. For example, if the first blanking line number is 70 and N is 1, the second blanking line number is 71. If N is 2, the second blanking line number is 72, and so on. Of course, other methods can also be used to determine the second blanking line number, which is not limited thereto.
[0127] If the first frame interval is smaller than the second frame interval, the second blanking line number needs to be smaller than the first blanking line number. For example, the second blanking line number is the difference between the first blanking line number and the value N. For example, if the first blanking line number is 70 and N is 1, the second blanking line number is 69. If N is 2, the second blanking line number is 68, and so on. Of course, other methods can also be used to determine the second blanking line number, which is not limited thereto.
[0128] In a possible implementation, the value of N may be 1, on this basis, if the first frame interval is greater than the second frame interval, the second blanking line number may be the sum of the first blanking line number and 1, for example, if the first blanking line number is 70, the second blanking line number may be 71. Alternatively, if the first frame interval is less than the second frame interval, the second blanking line number may be the difference between the first blanking line number and 1, for example, if the first blanking line number is 70, the second blanking line number may be 69.
[0129] In a possible implementation manner, the image display method may further include (in Figure 4 Not shown):
[0130] Step 405, start timing from the moment after the interval target cumulative duration, and after the refresh duration corresponding to an interval of one frame of the interface image, determine the current moment as the reference sending moment, and return to execute reading the interface image from the storage medium based on the number of valid rows and the first blanking row number, that is, execute steps 403-404.
[0131] Exemplarily, the output device starts timing from the moment after the target cumulative time interval, and after the refresh time interval corresponding to one frame of the interface image, the current moment is determined as the reference sending moment, and the interface image is read from the storage medium again based on the number of valid lines and the first number of blanking lines, and the read interface image is displayed through the display device. The output device starts timing from the reference sending moment, and after the target cumulative time interval, the interface image is read from the storage medium again based on the number of valid lines and the second number of blanking lines, and the read interface image is displayed through the display device, and so on, the output device repeats the above process.
[0132] The implementation process of step 403 to step 405 is described below in conjunction with a specific application scenario.
[0133] Application scenario 1: Assume that the data source sends the interface image at a source access frame rate of 99 FPS, and the display device displays the interface image at a refresh display frame rate of 101 FPS, that is, the first frame interval is greater than the second frame interval.
[0134] Sending process: The data source sends interface image 1 at time A. Assuming that the number of valid lines is 930 and the number of blanking lines is 70, 930 lines of valid data of interface image 1 are sent in sequence, and then 70 lines of blanking time are waited. The data source sends interface image 2 at time A+10.1 milliseconds, and 930 lines of valid data of interface image 2 are sent in sequence, and then 70 lines of blanking time are waited. The data source sends interface image 3 at time A+10.1+10.1 milliseconds, and so on. The data source can send a frame of interface image every 10.1 milliseconds.
[0135] Receiving process: The output device receives interface image 1 at time B and stores interface image 1 in the storage medium, but does not display interface image 1 through the display device at time B. When receiving interface image 1, the output device first receives the first line of valid data of interface image 1, stores the first line of valid data in the storage medium, then receives the second line of valid data of interface image 1, stores the second line of valid data in the storage medium, and so on, until the 930th line of valid data of interface image 1 is received, the 930th line of valid data is stored in the storage medium, and then waits for the blanking time of 70 lines of data, and then receives interface image 2.
[0136] The output device receives interface image 2 at time B+10.1 milliseconds and stores interface image 2 in a storage medium. For example, it first receives the first line of valid data of interface image 2 and stores the first line of valid data in the storage medium, and so on, until it receives the 930th line of valid data of interface image 2 and stores the 930th line of valid data in the storage medium, and then waits for the blanking time corresponding to 70 lines of data.
[0137] The output device receives interface image 3 at time B+10.1+10.1 milliseconds, and so on.
[0138] Display process: the output device starts from time B+0.01 milliseconds (i.e., the reference sending time), reads the interface image from the storage medium based on the number of valid lines 930 and the first blanking line number 70, and displays the read interface image through the display device. For example, the output device starts from time B+0.01 milliseconds, first reads the first line of valid data of interface image 1 from the storage medium, and displays the first line of valid data of interface image 1 through the display device, then reads the second line of valid data of interface image 1, and displays the second line of valid data of interface image 1 through the display device, and so on, until the 930th line of valid data of interface image 1 is read, and the 930th line of valid data of interface image 1 is displayed through the display device. Then, since the first number of blanking lines is 70, the output device will wait for the blanking time corresponding to 70 lines of data. During this period of time, no data will be read, and no data will be displayed through the display device.
[0139] The output device starts from time B+0.01+9.9 milliseconds, reads the first line of valid data of interface image 2 from the storage medium of the output device, and displays the first line of valid data of interface image 2 through the display device, and so on, until the 930th line of valid data of interface image 2 is read, and the 930th line of valid data of interface image 2 is displayed through the display device, and then the output device waits for the blanking time corresponding to 70 lines of data. In summary, the output device displays one frame of interface image through the display device every 9.9 milliseconds.
[0140] The output device starts from time C (starting from the reference sending time B+0.01 milliseconds, and the time after the interval target cumulative time is time C), reads the interface image from the storage medium based on the number of valid lines 930 and the second number of blanking lines, and displays the read interface image through the display device. Since the first frame interval is greater than the second frame interval, the second number of blanking lines is greater than the first number of blanking lines 70, such as the second number of blanking lines is 71. For example, the output device starts from time C, reads the first line of valid data of the interface image from the storage medium, and displays the first line of valid data of the interface image through the display device, and so on, until the 930th line of valid data of the interface image is read, and the 930th line of valid data of the interface image is displayed through the display device. It should be noted that since the second number of blanking lines is 71, the output device will wait for the blanking time corresponding to 71 lines of data, during which time it will no longer read data, nor will it display data through the display device, and wait for the reading and display process of the next frame of the interface image.
[0141] The output device starts from time D (starting from time C, the time after the refresh time corresponding to the interval of one frame of the interface image is time D), reads the interface image from the storage medium based on the number of valid lines 930 and the first number of blanking lines 70, and displays the read interface image through the display device. For example, the output device reads the first line of valid data of the interface image from the storage medium, and displays the first line of valid data of the interface image through the display device, and so on, until the 930th line of valid data of the interface image is read, and the 930th line of valid data of the interface image is displayed through the display device. Since the first number of blanking lines is restored to 70, the output device will wait for the blanking time corresponding to 70 lines of data.
[0142] After waiting for the blanking time corresponding to 70 lines of data, the output device reads the first line of valid data of the interface image from the storage medium, and displays the first line of valid data through the display device, and so on, until the interval target cumulative time is reached, the interface image is read from the storage medium based on the number of valid lines 930 and the second number of blanking lines, and the read interface image is displayed through the display device, and so on.
[0143] In application scenario 1, it involves a sending process, a receiving process and a display process, and the sending process, the receiving process and the display process are independent of each other and do not affect each other. That is to say, the data source sends the interface image according to the "sending process", the output device receives and stores the interface image according to the "receiving process", and the output device and the display device read and display the interface image according to the "display process".
[0144] In application scenario 1, since the data source sends the interface image at a source access frame rate of 99FPS, and the display device displays the interface image at a refresh display frame rate of 101FPS, within 1 second, the data source sends 99 frames of interface images, and the display device displays 101 frames of interface images, that is, the display device displays more interface images. In response to the above problem, in this embodiment, the number of second blanking lines (the output device displays images according to the second number of blanking lines) can be controlled to be greater than the number of first blanking lines (the data source sends images according to the first number of blanking lines), that is, the number of blanking lines is increased, and when the number of second blanking lines increases, the output device will wait for a longer period of time (that is, it needs to wait for the time corresponding to the second number of blanking lines), thereby reducing the number of interface images displayed by the display device, thereby achieving the purpose of the number of interface images sent by the data source being the same as the number of interface images displayed by the display device, avoiding image display problems.
[0145] In application scenario 1, the output device stores the first line of valid data of interface image 1 in the storage medium at time B, and the output device reads and displays the first line of valid data of interface image 1 from the storage medium starting from time B+0.01 milliseconds (i.e., the refresh time corresponding to M lines of data). In other words, the valid data is only stored in the storage medium for the refresh time corresponding to M lines of data, which means that only M lines of valid data of one frame of interface image will be stored in the storage medium, instead of storing all lines of valid data of one frame of interface image in the storage medium. There is no need to cache one frame of interface image, thereby reducing the display time of the interface image and achieving low latency between the data source and the display device, which meets the low latency application requirements.
[0146] In application scenario 1, each interval target accumulation time indicates that the number of data rows displayed by the display device is N rows (such as 1 row) more than the number of data rows sent by the data source. Therefore, for each interval target accumulation time, the output device increases the number of blanking rows by N rows, so that the output device waits for N more blanking rows before displaying data, so that the number of data rows displayed by the display device matches the number of data rows sent by the data source.
[0147] See also Figure 5CAs shown, assuming that the number of valid lines is 768 and the number of the first blanking lines is 70, the number of blanking lines will be increased by 1 for each target accumulation time interval, that is, the number of the second blanking lines is 71, so that the output device waits for one more blanking line before displaying the data, ensuring that the number of data lines matches.
[0148] Application scenario 2: Assume that the data source sends the interface image at a source access frame rate of 101 FPS, and the display device displays the interface image at a refresh display frame rate of 99 FPS, that is, the first frame interval is smaller than the second frame interval.
[0149] The implementation process of application scenario 2 is similar to that of application scenario 1, except that the number of second blanking lines is 69 instead of 71, that is, the number of second blanking lines is less than the number of first blanking lines.
[0150] In application scenario 2, since the data source sends the interface image at a source access frame rate of 101FPS, and the display device displays the interface image at a refresh display frame rate of 99FPS, within 1 second, the data source sends 101 frames of interface images, and the display device displays 99 frames of interface images, that is, the display device displays fewer interface images. To address the above problem, the number of second blanking lines (the output device displays images according to the second number of blanking lines) can be controlled to be smaller than the number of first blanking lines (the data source sends images according to the first number of blanking lines). When the number of second blanking lines is reduced, the output device will wait for a shorter period of time, thereby increasing the number of interface images displayed by the display device, thereby achieving the purpose of having the number of interface images sent by the data source be the same as the number of interface images displayed by the display device, thereby avoiding image display problems.
[0151] In application scenario 2, each interval target accumulation time indicates that the number of data rows displayed by the display device is N rows (such as 1 row) less than the number of data rows sent by the data source. Therefore, for each interval target accumulation time, the output device reduces the number of blanking rows by N rows, so that the output device waits for N fewer blanking rows before displaying data, so that the number of data rows displayed by the display device matches the number of data rows sent by the data source.
[0152] See also Figure 5D As shown, assuming that the number of valid lines is 768 and the number of the first blanking lines is 70, the number of blanking lines will be reduced by 1 for each target accumulation time interval, that is, the number of the second blanking lines is 69, so that the output device waits for one less blanking line before displaying data, ensuring that the number of data lines matches.
[0153] In a possible implementation, since the data source and the output device are physically separated and respectively deployed at different locations, that is, the clock of the data source and the clock of the output device may not be synchronized, therefore, before executing steps 401 to 405, the clock of the data source and the clock of the output device may also be synchronized, and the synchronization accuracy can reach the ns level. Regarding the clock synchronization method of the clock of the data source and the clock of the output device, there is no restriction in this embodiment, as long as the clock of the data source and the clock of the output device can be synchronized, so that the frequency and phase of the data source are consistent with the frequency and phase of the output device.
[0154] It can be seen from the above technical solution that in the embodiment of the present application, the frequency difference between the first frame interval of the data source and the second frame interval of the output device is eliminated by controlling the number of blanking lines, thereby avoiding caching at least one frame of the interface image in the output device, that is, there is no need to cache at least one frame of the interface image in the output device, and the interface image of the current frame can be displayed directly, reducing the display time of the interface image, achieving low latency between the data source and the display device, and ensuring that the delay between the data source and the display device is within one frame, thereby achieving low latency in the seat management system, meeting the application requirements of low latency, and improving the user experience.
[0155] Based on the same application concept as the above method, an image display device is proposed in the embodiment of the present application. The seat management system includes a data source, an input device connected to the data source, a display device, and an output device connected to the display device; see Figure 6 FIG. 1 is a schematic diagram of the structure of the image display device, wherein the image display device is applied to the output device, and the device comprises:
[0156] An acquisition module 61 is used to acquire a first frame interval of a data source and a second frame interval of the output device; a determination module 62 is used to determine a target cumulative duration based on the first frame interval, the second frame interval and the refresh duration corresponding to N lines of data in the interface image; wherein N is a positive integer and N is less than the total number of lines corresponding to the interface image; a display module 63 is used to read an interface image from the storage medium based on the number of valid lines and the first number of blanking lines starting from a reference sending time, and display the read interface image through a display device; the display module 63 is also used to start timing from the reference sending time, and after the target cumulative duration has elapsed, read an interface image from the storage medium based on the number of valid lines and the second number of blanking lines, and display the read interface image through a display device.
[0157] Exemplarily, the display module 63 is also used to start timing from the moment after the target cumulative time interval, and after the refresh time corresponding to a frame of the interface image, determine the current moment as the reference sending moment, and return to execute the operation of reading the interface image from the storage medium based on the number of valid rows and the first blanking row number.
[0158] Exemplarily, the determination module 62 determines the target cumulative duration based on the first frame interval, the second frame interval and the refresh duration corresponding to N lines of data in the interface image, and is used to: calculate the ratio between N and the total number of lines corresponding to one frame of the interface image; determine the refresh duration corresponding to N lines of data in the interface image based on the refresh duration corresponding to one frame of the interface image and the ratio; calculate the difference between the first frame interval and the second frame interval; and determine the target cumulative duration based on the refresh duration corresponding to N lines of data in the interface image and the difference.
[0159] Exemplarily, if the first frame interval is greater than the second frame interval, the second number of blanking lines is greater than the first number of blanking lines; or, if the first frame interval is less than the second frame interval, the second number of blanking lines is less than the first number of blanking lines.
[0160] Exemplarily, if the first frame interval is greater than the second frame interval, the second number of blanking lines is the sum of the first number of blanking lines and a value N; or, if the first frame interval is less than the second frame interval, the second number of blanking lines is the difference between the first number of blanking lines and a value N.
[0161] Exemplarily, the acquisition module 61 is also used to obtain the initial sending time of the first interface image of the data source, and determine the reference sending time based on the initial sending time, the data transmission delay between the data source and the output device, and the refresh duration corresponding to M lines of data in the interface image; wherein M is a positive integer, and M is less than the total number of lines corresponding to the interface image.
[0162] Exemplarily, when the acquisition module 61 acquires the second frame interval of the output device, it is used to: determine the reception duration of a frame interface image based on the start reception time and the end reception time of the frame interface image; determine the second frame interval based on the average reception duration of K2 frame interface images, where K2 is a positive integer.
[0163] Based on the same application concept as the above method, an output device is proposed in an embodiment of the present application, which is applied to a seat management system. The output device includes a processor and a machine-readable storage medium, and the machine-readable storage medium stores machine-executable instructions that can be executed by the processor; the processor is used to execute the machine-executable instructions to implement the steps of the above-mentioned image display method, which will not be repeated here.
[0164] Based on the same application concept as the above method, an agent management system is proposed in an embodiment of the present application, and the agent management system includes a data source, an input device connected to the data source, a display device, and an output device connected to the display device; wherein: the input device is used to obtain a first frame interval of the data source, and send the first frame interval to the output device, and the output device obtains the first frame interval; the output device is used to obtain a second frame interval of the output device; based on the first frame interval, the second frame interval and the refresh time corresponding to N lines of data in the interface image, the target cumulative time is determined; wherein N is a positive integer, and N is less than The total number of rows corresponding to the interface image; the data source is also used to send the interface image, and the input device forwards the interface image to the output device so that the output device stores the interface image in a storage medium; the output device is also used to read the interface image from the storage medium based on the number of valid rows and the first number of blanking rows starting from a reference sending time, and display the read interface image through a display device; start timing from the reference sending time, and after an interval of the target cumulative time, read the interface image from the storage medium based on the number of valid rows and the second number of blanking rows, and display the read interface image through a display device.
[0165] Exemplarily, the output device is also used to start timing from the moment after the target cumulative time interval, and after the refresh time corresponding to a frame of the interface image, determine the current moment as the reference sending moment, and return to execute the operation of reading the interface image from the storage medium based on the number of valid rows and the first number of blanking rows.
[0166] Exemplarily, the output device determines the target cumulative duration based on the first frame interval, the second frame interval, and the refresh duration corresponding to N lines of data in the interface image, including: calculating the ratio between the numerical value N and the total number of lines corresponding to a frame of the interface image; determining the refresh duration corresponding to N lines of data in the interface image based on the refresh duration corresponding to a frame of the interface image and the ratio; calculating the difference between the first frame interval and the second frame interval; and determining the target cumulative duration based on the refresh duration corresponding to N lines of data in the interface image and the difference.
[0167] Exemplarily, if the first frame interval is greater than the second frame interval, the second number of blanking lines is greater than the first number of blanking lines; or, if the first frame interval is less than the second frame interval, the second number of blanking lines is less than the first number of blanking lines.
[0168] Exemplarily, if the first frame interval is greater than the second frame interval, the second number of blanking lines is the sum of the first number of blanking lines and a value N; or, if the first frame interval is less than the second frame interval, the second number of blanking lines is the difference between the first number of blanking lines and a value N.
[0169] Exemplarily, the data source is also used to determine the initial sending time of the first interface image, and send the initial sending time to the input device, which sends the initial sending time to the output device; the output device is also used to determine the reference sending time based on the initial sending time, the data transmission delay between the data source and the output device, and the refresh time corresponding to M lines of data in the interface image; M is a positive integer, and M is less than the total number of lines corresponding to the interface image.
[0170] Exemplarily, the input device obtains the first frame interval of the data source, including: determining the sending duration of a frame interface image based on the start sending time and the end sending time of the frame interface image; determining the first frame interval based on the average sending duration of K1 frame interface images, K1 is a positive integer; the output device obtains the second frame interval of the output device, including: determining the receiving duration of the frame interface image based on the start receiving time and the end receiving time of the frame interface image; determining the second frame interval based on the average receiving duration of K2 frame interface images, K2 is a positive integer.
[0171] Based on the same application concept as the above method, the embodiment of the present application also provides a machine-readable storage medium, on which a number of computer instructions are stored, and when the computer instructions are executed by the processor, the image display method disclosed in the above example of the present application can be implemented. The system, device, module or unit described in the above embodiment can be implemented by a computer chip or entity, or by a product with a certain function. A typical implementation device is a computer, and the specific form of the computer can be a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email sending and receiving device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.
[0172] For the convenience of description, the above device is described by being divided into various units according to their functions and described separately. Of course, when implementing the present application, the functions of each unit can be implemented in the same one or more software and / or hardware. It should be understood by those skilled in the art that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the embodiments of the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
[0173] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0174] Moreover, these computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operation steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide for implementing the functions specified in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0175] The above is only an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims
1. A seat management system, characterized in that: The seat management system includes a data source, an input device connected to the data source, a display device, and an output device connected to the display device; The input device is used to obtain a first frame interval of the data source, and send the first frame interval to the output device, so that the output device obtains the first frame interval; The output device is used to obtain a second frame interval of the output device; Determine the target cumulative duration based on the first frame interval, the second frame interval, and the refresh duration corresponding to N lines of data in the interface image; wherein N is a positive integer, and N is less than the total number of lines corresponding to the interface image; The data source is further used to send the interface image, and the input device forwards the interface image to the output device, so that the output device stores the interface image in a storage medium; The output device is further used to read the interface image from the storage medium based on the number of valid lines and the number of first blanking lines starting from the reference sending time, and display the read interface image through the display device; Timing starts from the reference sending time, and after an interval of the target accumulation time, an interface image is read from the storage medium based on the number of valid lines and the number of second blanking lines, and the read interface image is displayed through a display device.
2. The seat management system according to claim 1, characterized in that: The output device is also used to start timing from the moment after the target cumulative time interval, and after the refresh time corresponding to a frame of interface image, determine the current moment as the reference sending moment, and return to execute the operation of reading the interface image from the storage medium based on the number of valid rows and the first blanking row number.
3. The seat management system according to claim 1, characterized in that: The output device determines a target cumulative duration based on the first frame interval, the second frame interval, and a refresh duration corresponding to N lines of data in the interface image, including: Calculate the ratio between the value N and the total number of lines corresponding to one frame of the interface image; determine the refresh time corresponding to N lines of data in the interface image based on the refresh time corresponding to one frame of the interface image and the ratio; Calculate the difference between the first frame interval and the second frame interval; and determine the target cumulative duration based on the refresh duration corresponding to N lines of data in the interface image and the difference.
4. The seat management system according to any one of claims 1 to 3, characterized in that: If the first frame interval is greater than the second frame interval, the second number of blanking lines is greater than the first number of blanking lines; or, if the first frame interval is less than the second frame interval, the second number of blanking lines is less than the first number of blanking lines.
5. The seat management system according to claim 4, characterized in that: If the first frame interval is greater than the second frame interval, the second number of blanking lines is the sum of the first number of blanking lines and the value N; or, if the first frame interval is less than the second frame interval, the second number of blanking lines is the difference between the first number of blanking lines and the value N.
6. The seat management system according to claim 1, characterized in that: The data source is further used to determine the initial sending time of the first interface image, send the initial sending time to the input device, and the input device sends the initial sending time to the output device; The output device is also used to determine the reference sending time based on the initial sending time, the data transmission delay between the data source and the output device, and the refresh duration corresponding to M lines of data in the interface image; wherein M is a positive integer, and M is less than the total number of lines corresponding to the interface image.
7. The seat management system according to claim 1, characterized in that: The input device obtains the first frame interval of the data source, including: determining the sending duration of a frame of interface image based on the start sending time and the end sending time of the frame of interface image; determining the first frame interval based on the average sending duration of K1 frames of interface image, where K1 is a positive integer; The output device obtains the second frame interval of the output device, including: determining the reception duration of a frame interface image based on the start reception time and the end reception time of the frame interface image; determining the second frame interval based on the average reception duration of K2 frame interface images, where K2 is a positive integer.
8. An image display method, characterized in that: The seat management system includes a data source, an input device connected to the data source, a display device, and an output device connected to the display device; wherein the image display method is applied to the output device, and the method includes: Acquire a first frame interval of the data source and a second frame interval of the output device; Determine the target cumulative duration based on the first frame interval, the second frame interval, and the refresh duration corresponding to N lines of data in the interface image; N is a positive integer, and N is less than the total number of lines corresponding to the interface image; Starting from the reference sending time, reading the interface image from the storage medium based on the number of valid lines and the number of first blanking lines, and displaying the read interface image through the display device; Timing starts from the reference sending time, and after an interval of the target accumulation time, an interface image is read from the storage medium based on the number of valid lines and the number of second blanking lines, and the read interface image is displayed through a display device.
9. The method according to claim 8, characterized in that The timing starts from the reference sending time, and after the target accumulation time is elapsed, after the interface image is read from the storage medium based on the number of valid lines and the number of second blanking lines, the method further includes: The timing starts from the moment after the target cumulative duration, and after the refresh duration corresponding to one frame of the interface image, the current moment is determined as the reference sending moment, and the operation of reading the interface image from the storage medium based on the number of valid rows and the first blanking row number is returned.
10. The method according to claim 8, characterized in that The determining the target cumulative duration based on the first frame interval, the second frame interval, and the refresh duration corresponding to N lines of data in the interface image includes: Calculate the ratio between N and the total number of rows corresponding to one frame of the interface image; determine the refresh duration corresponding to N rows of data in the interface image based on the refresh duration corresponding to one frame of the interface image and the ratio; calculating a difference between the first frame interval and the second frame interval; The target cumulative duration is determined based on the refresh duration corresponding to the N rows of data in the interface image and the difference.
11. The method according to any one of claims 8 to 10, characterized in that: If the first frame interval is greater than the second frame interval, the second number of blanking lines is greater than the first number of blanking lines; or, if the first frame interval is less than the second frame interval, the second number of blanking lines is less than the first number of blanking lines.
12. The method according to claim 11, characterized in that If the first frame interval is greater than the second frame interval, the second number of blanking lines is the sum of the first number of blanking lines and the value N; or, if the first frame interval is less than the second frame interval, the second number of blanking lines is the difference between the first number of blanking lines and the value N.
13. The method according to claim 8, characterized in that Before reading the interface image from the storage medium based on the number of valid lines and the number of first blanking lines starting from the reference sending time, the method further includes: Get the initial sending time of the first interface image of the data source; Determine the reference sending time based on the initial sending time, the data transmission delay between the data source and the output device, and the refresh duration corresponding to the M rows of data in the interface image; Wherein, M is a positive integer, and M is less than the total number of rows corresponding to the interface image.
14. The method according to claim 8, characterized in that The method of obtaining the second frame interval of the output device includes: determining the reception duration of a frame interface image based on the start reception time and the end reception time of the frame interface image; and determining the second frame interval based on the average reception duration of K2 frame interface images, where K2 is a positive integer.
15. An image display device, characterized in that: The seat management system includes a data source, an input device connected to the data source, a display device, and an output device connected to the display device; wherein the image display device is applied to the output device, and the device includes: An acquisition module, used for acquiring a first frame interval of a data source and a second frame interval of an output device; A determination module, configured to determine a target cumulative duration based on the first frame interval, the second frame interval, and a refresh duration corresponding to N lines of data in the interface image; wherein N is a positive integer, and N is less than the total number of lines corresponding to the interface image; A display module, configured to read an interface image from the storage medium based on the number of valid lines and the number of first blanking lines starting from the reference sending time, and display the read interface image through a display device; The display module is also used to start timing from the reference sending time, and after an interval of the target cumulative time, read the interface image from the storage medium based on the number of valid rows and the number of second blanking rows, and display the read interface image through the display device.
16. The device according to claim 15, characterized in that in, The display module is further configured to start timing from a moment after the target cumulative time interval, determine the current moment as the reference sending moment after a refresh time interval corresponding to a frame of the interface image, and return to perform an operation of reading the interface image from the storage medium based on the number of valid rows and the number of first blanking rows; Wherein, the determination module determines the target cumulative duration based on the first frame interval, the second frame interval and the refresh duration corresponding to N lines of data in the interface image, and is used to: calculate the ratio between N and the total number of lines corresponding to one frame of the interface image; determine the refresh duration corresponding to N lines of data in the interface image based on the refresh duration corresponding to one frame of the interface image and the ratio; calculate the difference between the first frame interval and the second frame interval; determine the target cumulative duration based on the refresh duration corresponding to N lines of data in the interface image and the difference; Wherein, if the first frame interval is greater than the second frame interval, the second blanking line number is greater than the first blanking line number; or, if the first frame interval is less than the second frame interval, the second blanking line number is less than the first blanking line number; Wherein, if the first frame interval is greater than the second frame interval, the second number of blanking lines is the sum of the first number of blanking lines and a value N; or, if the first frame interval is less than the second frame interval, the second number of blanking lines is the difference between the first number of blanking lines and a value N; The acquisition module is further used to acquire the initial sending time of the first interface image of the data source, and determine the reference sending time based on the initial sending time, the data transmission delay between the data source and the output device, and the refresh time corresponding to M rows of data in the interface image; wherein M is a positive integer, and M is less than the total number of rows corresponding to the interface image; Among them, when the acquisition module obtains the second frame interval of the output device, it is used to: determine the receiving time of a frame interface image based on the starting receiving time and the ending receiving time of the frame interface image; determine the second frame interval based on the average receiving time of K2 frame interface images, where K2 is a positive integer.
17. An output device, characterized in that: include: a processor and a machine-readable storage medium storing machine-executable instructions executable by the processor; The processor is used to execute the machine executable instructions to implement the method steps described in any one of claims 8-14.
