Method and device for synchronously presenting multiple external display terminals
By transmitting the external delay time between the playback device and the external display device, and generating the synchronization adjustment time for pre-delay processing, the problem of large synchronization delay between multiple external display devices is solved, and efficient synchronous display is achieved and memory loss is reduced.
Patent Information
- Application Number
- CN202311302999.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-10-09
- Publication Date
- 2025-04-11
AI Technical Summary
In the prior art, the synchronization delay between multiple external display devices is large, resulting in increased memory loss and storage burden, and the delay time of different devices is inconsistent, making it difficult to realize synchronous display.
By setting a two-way data path between the playback device and the external display device, the external display delay time is transmitted. The playback device generates a synchronization adjustment time based on the playback time and the external delay time of the playback content, and performs pre-delay processing to ensure that all external display devices present the playback content synchronously.
Synchronous display between multiple external display devices is realized, which reduces the additional delay adjustment requirement of external display devices, reduces memory loss and storage burden, and improves the accuracy of synchronous display.
Smart Images

Figure CN119815086A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of synchronization technology, and in particular to a method and device for synchronous presentation of multiple external display terminals. Background Art
[0002] In existing external display systems, when a playback device is playing content, it is often connected to an external display device through a connection cable, so that the display device can obtain the playback data transmitted by the playback device and perform data processing and display presentation. For example, such playback devices as set-top boxes often use VGA, DP and HDMI cables to connect to external display devices such as TVs, monitors and LED large screens, so that the external display device can obtain the playback content sent by the set-top box and display and play it.
[0003] However, when an external display device displays content, it usually takes a certain amount of processing time to display the playback data on the screen. The processing time required for external display devices of different types, manufacturers, and styles may not be exactly the same, which results in the images displayed by different external display devices being out of sync.
[0004] In the prior art, for the synchronous display of multiple external display terminal devices, the external display devices often display according to the delay time set by the playback device. To ensure synchronous presentation, the set delay time is usually much longer than the external display device's own delay time, that is, the display device needs to perform an additional delay on the playback content after obtaining the playback content. However, the playback content obtained on the external display device is mostly uncompressed image information, which greatly increases the memory loss of the external display device and increases the storage burden.
[0005] In addition, with the development and update of display technology, when there is a display device with post-processing capabilities among the multiple connected external display devices, such display device will cause the display delay of the display device to become longer because it needs to perform post-processing operations such as deinterlacing, scan rate conversion, frame rate conversion, noise reduction and image quality enhancement on the playback data, which will lead to a greater synchronization delay between the multiple external display devices. Accordingly, the delay time uniformly set by the playback device will be further increased. As a result, the memory loss and storage burden of the multiple external display devices will also be further increased.
[0006] Therefore, a technical solution to solve the delay between different external display devices is urgently needed. Summary of the invention
[0007] In view of the above problems, the present invention provides a method and device for synchronous presentation of multiple external display terminals.
[0008] A method for synchronous presentation of multiple external display terminals is provided, comprising:
[0009] Playback device, used to obtain playback content and playback time;
[0010] A transmission device, connected to the playback device and the external display device respectively;
[0011] At least one external display device, used to present the playback content;
[0012] The external display device transmits the external display delay time of the external display device to the playback device through the transmission device;
[0013] The playback device generates a synchronization adjustment time according to the playback time of the playback content and the external display delay time, and performs synchronization adjustment according to the synchronization adjustment time, so that all the external display devices synchronously present the playback content.
[0014] Preferably, the transmission device is a video data transmission line, in which a bidirectional data path is arranged for transmitting the external display delay time of the external display device to the playback device, and for transmitting the synchronization delay time and / or the playback content of the playback device to the external display device.
[0015] Preferably, it also includes a calibration device;
[0016] The method for synchronous presentation of multiple external display terminals also includes a process of pre-calibrating the system time of the external display device, including:
[0017] The calibration device controls the external display device to present a display image and a current running time;
[0018] The calibration device collects the actual time when the external display device presents the display image;
[0019] The calibration device calibrates the current running time in the explicit delay device according to the actual time.
[0020] Preferably, the external display device comprises an input signal circuit, a signal processing circuit, a display processing circuit and a display element;
[0021] The method for synchronous presentation of multiple external display terminals also includes a process of obtaining the external display delay time of the external display device, including:
[0022] Acquiring the arrival time of the display content reaching the signal processing unit via the input signal circuit;
[0023] The signal processing unit processes the display content and transmits the processed display content to the display processing circuit;
[0024] The display processing circuit transmits the display content to the display element and simultaneously informs the signal processing unit of the display time;
[0025] The signal processing unit determines the external display delay time according to the arrival time and the display time.
[0026] Preferably, the synchronization adjustment process of the playback device includes:
[0027] First, the time difference between the playback time and the external display delay time of the external display device is obtained, and the time difference is used as the synchronization adjustment time;
[0028] Then, the playback content is pre-delayed according to the synchronization adjustment time;
[0029] Finally, the pre-delayed playback content is transmitted to the corresponding external display device, and the external display device plays the playback content at a time corresponding to the external display delay time, so that the external display device can achieve synchronous display.
[0030] Preferably, the pre-delay process of playing the content includes:
[0031] The playback content is decoded and the decoded playback content is delayed, or the playback content is delayed and the delayed playback content is decoded.
[0032] Preferably, the external display delay time of the external display device includes a plurality of delay options corresponding to different delay times;
[0033] The synchronization adjustment process of the playback device includes:
[0034] First, the playback time and a plurality of delay options included in the external display delay time of the external display device are obtained, and the delay option closest to the playback time is used as the synchronization adjustment time;
[0035] Subsequently, the synchronization adjustment time is transmitted to the corresponding external display device, so that the external display device performs synchronization display according to the delay time option.
[0036] Preferably, the plurality of delay options corresponding to different delay times include a plurality of different delay circuits;
[0037] The external display device executes a corresponding delay circuit according to a delay option corresponding to the synchronization adjustment time, so that the external display device performs synchronous display according to the delay option.
[0038] Preferably, the plurality of different delay circuits are a plurality of memories storing the playback content with different numbers of frames;
[0039] The frame number corresponds to the delay time one by one.
[0040] The present invention also provides a multi-display terminal synchronous presentation system, comprising:
[0041] a playback device;
[0042] a transmission device, connected to the playback device and the external display device respectively;
[0043] at least one external display device, comprising a transmission module for transmitting the external display delay time of the external display device to the playback device;
[0044] The playback device also includes:
[0045] A synchronization adjustment module, used to generate a synchronization adjustment time and perform synchronization adjustment according to the playback time of the playback content and the external display delay time;
[0046] The external display device also includes:
[0047] A display module is used to synchronously present the playback content according to the result of the synchronous adjustment.
[0048] Preferably, the transmission device is a new type of video data transmission line, in which a bidirectional data path is arranged for transmitting the external display delay time of the external display device to the playback device, and for transmitting the synchronization delay time and / or the playback content of the playback device to the external display device.
[0049] Preferably, it also includes a calibration device;
[0050] The calibration equipment comprises:
[0051] A control unit, used for controlling the current running time of the external display device to present a display image;
[0052] A collection unit, used for collecting the actual time when the external display device presents the display image;
[0053] A processing unit is used to calibrate the current running time in the explicit delay device according to the actual time.
[0054] Preferably, the external display device comprises an input signal circuit, a signal processing circuit, a display processing circuit and a display element;
[0055] include:
[0056] A signal processing circuit, used for acquiring the arrival time of the display content and reaching the signal processing unit via the input signal circuit; and processing the display content and transmitting the processed display content to the display processing circuit;
[0057] The display processing circuit is used to transmit the display content to the display element and simultaneously inform the signal processing unit of the display time;
[0058] The signal processing unit determines the external display delay time according to the arrival time and the display time.
[0059] Preferably, the synchronization adjustment module of the playback device includes:
[0060] A first generating unit, configured to obtain a time difference between a playback time and an external display delay time of the external display device, and use the time difference as a synchronization adjustment time;
[0061] a first adjustment unit, configured to pre-delay the playback content according to a synchronization adjustment time;
[0062] a first transmission unit, configured to transmit the pre-delayed playback content to the corresponding external display device;
[0063] The display module of the external display device includes:
[0064] A first display unit is used for synchronous display according to the delay time corresponding to the synchronous adjustment time.
[0065] The first adjustment unit includes: a first decoding component, used to decode the playback content;
[0066] Also includes:
[0067] A first delay component, connected to the delay component, for delaying the playback content before decoding;
[0068] The second delay component is connected to the delay component and is used for delaying the playback content after decoding.
[0069] Preferably, the external display delay time of the external display device includes a plurality of delay options corresponding to different delay times;
[0070] The synchronization adjustment module of the playback device includes:
[0071] a second generating unit, configured to obtain a play time and a plurality of delay options included in an external display delay time of the external display device, and use a delay option closest to the play time as a synchronization adjustment time;
[0072] a second transmission unit, transmitting the synchronization adjustment time to the corresponding external display device;
[0073] The display module of the external display device includes:
[0074] A second display unit is used for synchronous display according to the delay time corresponding to the synchronous adjustment time.
[0075] Preferably, the plurality of delay options corresponding to different delay times include a plurality of different delay circuits;
[0076] The external display device executes a corresponding delay circuit according to a delay option corresponding to the synchronization adjustment time, so that the external display device performs synchronous display according to the delay option.
[0077] Preferably, the plurality of different delay circuits are a plurality of memories storing the playback content with different numbers of frames;
[0078] The frame number corresponds to the delay time one by one.
[0079] The beneficial effects of the present invention are as follows: the external display device does not need to perform additional synchronous display adjustment, and only needs to transmit the external display delay time to the playback device. The playback device can generate the corresponding synchronous adjustment time and perform synchronous adjustment operations such as pre-delay, so that all external display devices can present the playback content synchronously. BRIEF DESCRIPTION OF THE DRAWINGS
[0080] Figure 1 A schematic diagram of the architecture between a playback device, a transmission device and an external display device in one embodiment of the present invention;
[0081] Figure 2 A schematic flow chart of a method for synchronous presentation of multiple external display terminals in one embodiment of the present invention;
[0082] Figure 3 A schematic diagram of a pre-calibration process in one embodiment of the present invention;
[0083] Figure 4 A schematic diagram of a flow chart for obtaining an explicit delay time in one embodiment of the present invention;
[0084] Figure 5 A schematic flow chart of a synchronous adjustment process in one embodiment of the present invention;
[0085] Figure 6 A schematic flow chart of a synchronous adjustment process in one embodiment of the present invention. DETAILED DESCRIPTION
[0086] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments, but they are not intended to limit the present invention.
[0087] The present invention provides a method for synchronously presenting multiple external display terminals, such as Figure 1 and Figure 2 As shown, including:
[0088] Playback device, used to obtain playback content and playback time;
[0089] Transmission device, connected to the playback device and external display device respectively;
[0090] At least one external display device for presenting the playback content;
[0091] An external display device transmits the external display delay time of the external display device to the playback device via a transmission device;
[0092] The playback device generates a synchronization adjustment time according to the playback time of the playback content and the external display delay time, and performs synchronization adjustment according to the synchronization adjustment time, so that all external display devices synchronously present the playback content.
[0093] Specifically, considering that after the external display device obtains the playback content of the playback device through the transmission device, it needs to analyze, decode and other operations on the playback content, so a certain display delay will be generated. If the external display device is a TV with post-processing capabilities, it may also be necessary to deinterlace the playback content, convert the scan rate, change the frame rate, and perform noise reduction and various image quality enhancement operations, which may further increase the display delay. Different external display devices have different styles, hardware, and computing power, so the display delay is also different. In order to achieve that different external display devices can synchronously display the playback content after connecting to the playback device, this patent provides a multi-external display terminal synchronous presentation method. The playback device can be connected to at least one external display device through a transmission device. After the playback device obtains the operation processing time of each external display device from obtaining the playback content to displaying the playback content, that is, the external display delay time of the external display device, it will generate a synchronization adjustment time corresponding to each external display device according to the playback time corresponding to the playback content and the external display delay time. Synchronous adjustment is performed according to the synchronization adjustment time, and synchronous display of all external display devices can be achieved.
[0094] Furthermore, the playback device may obtain the playback content from a server or from a pre-stored memory. The playback device may be a set-top box.
[0095] Furthermore, multiple external display devices can be connected to the playback device through transmission devices respectively to obtain the playback content in the playback device and synchronously display the playback content on the external display device. Among them, the external display device can be a display device of different types, different manufacturers, and different styles, such as a computer, a television, etc. It should be noted that the external display delay time of the external display device is usually related to the hardware and is fixed at the factory. However, even if the same external display device is produced by the same manufacturer, the inspection process passed before leaving the factory only requires the external display delay time to be controlled within a fixed value range, rather than requiring the external display delay time to be the same as each other. Users using external display devices will not have the same operational requirements for controlling the external display delay time. This patent is based on the reference scenario that external display devices of different types, different manufacturers, and different styles are connected to the same playback device. If the external display devices are not presented synchronously, users cannot watch synchronously, and the technical solution proposed thereby.
[0096] Furthermore, in the process of realizing synchronous display of different external display devices, the playback device may pre-acquire the external display delay time of different external display devices, generate the corresponding synchronous display time, and then send the playback content to different external display devices according to the corresponding synchronous display time, thereby realizing synchronous display of the playback content; or the playback device may first send the playback content, and in the process of the external display device displaying the playback content, the playback device obtains the external display delay time and then adjusts the synchronous display time, thereby also realizing synchronous display of the playback content. This method can reduce the time for pre-debugging, and is more suitable for the scenario of temporarily adding a synchronous display of an external display device. While ensuring that users can watch the synchronously displayed content, more external display devices for synchronous display can be added at the same time.
[0097] For example, there is a playback device A that is connected to two external display devices B1 and B2 from different manufacturers, different types, and different styles. The processing time from the external display device B1 obtaining the playback content to displaying the playback content on the screen, that is, the external display delay time is 60ms, and the external display delay time of the external display device B2 is 40ms. If, based on the existing technology, the playback device sets the display delay time to 100ms to achieve synchronous display, after transmitting the delay time to the external display devices B1 and B2, the external display device B1 needs to perform an additional 40ms internal delay on the playback content, and the external display device B2 needs to delay an additional 60ms before the playback device can be displayed on the screen. However, according to the technical solution provided by this patent, the playback device obtains the external display delay time of the external display devices B1 and B2 and the playback time of the playback content in advance through the transmission device, and generates a synchronous display time of 100ms. The playback device can first delay 40ms before transmitting the playback content to the external display device B1, and delay 60ms before transmitting the playback content to the external display device B2. After the external display device B1 is delayed by 60ms and the external display device B2 is delayed by 40ms, B1 and B2 will display the playback content at the same time. It can be seen that in the technical solution provided by this patent, the external display device does not need additional delay adjustment, and synchronous display can be achieved by simply transmitting the external display delay time to the playback content.
[0098] In one embodiment provided by the present invention, the transmission device is a video data transmission line, and a bidirectional data path is set in the video data transmission line for transmitting the external display delay time of the external display device to the playback device, and transmitting the synchronization delay time and / or playback content of the playback device to the external display device.
[0099] Specifically, the external display device is connected to the playback device via a video data transmission line. A bidirectional data path is set in the video data transmission line. The external display device transmits the external display delay time to the playback device via the uplink data path in the video data transmission line. After the playback device generates a synchronous display time based on the playback time and the external display delay time, the playback content and / or the synchronous delay time is transmitted to the external display device via the downlink data path in the video data transmission line.
[0100] Among them, after the playback device generates the synchronous display time and completes the pre-delay operation, the playback device can only transmit the playback content to the external display device; when the external display device has multiple delay options, the playback device can select one of the delay options and use it as the synchronous delay time, and the playback device can transmit the playback content and the synchronous delay time to the external display device together.
[0101] The video data transmission line may have a first interface and one or more second interfaces, wherein the first interface is used to connect to a playback device, and the second interfaces are used to connect to corresponding external display devices.
[0102] It should be noted that the existing video data transmission line usually only transmits the video data processed in the set-top box to the TV set for display in one direction, while the video data transmission line with a bidirectional transmission path provided by the present invention can not only transmit the video data processed by the set-top box to the TV set in the downstream direction, but also transmit the external display delay time of the TV set in the upstream direction to the TV set. It should be further noted that the video data transmission line provided by the present invention is arranged between the set-top box and the TV set for video data transmission, which is different from the network cable arranged between the set-top box and the server for accessing the network and transmitting optical signals.
[0103] It should be noted that for application scenarios with synchronous display under extremely high precision requirements, if the video data transmission line has a transmission delay, the playback device can comprehensively generate the synchronization delay time based on the external display delay time of the external display device, the playback time of the playback content, and the transmission delay time of the video data transmission line, so as to perform synchronous display according to the synchronization delay time, which can effectively avoid the phenomenon of asynchrony caused by the delay of the video data transmission line.
[0104] For example, the video data transmission line between the set-top box and the TV has a transmission delay. Every transmission of 1G video data will generate a transmission delay of 1ms. If the playback device can pre-delay 59ms at this time,.
[0105] For example, there is a set-top box A connected to two televisions B1 and B2 through a video data transmission line. The external display delay time of television B1 is 60ms, and the external display delay time of television B2 is 40ms. The video data transmission line has a transmission delay, and a transmission delay time of 1ms will be generated for each transmission of 1G video data. After the set-top box pre-acquires the external display delay time of external display devices B1 and B2 through the video data transmission line, it will generate a synchronous display time of 100ms based on the external display delay time, the playback time of the playback content and the transmission delay time. The playback device can first delay 39ms and then transmit the playback content to television B1 through the video data transmission line. Television B1 receives the playback content after 40ms and displays the playback content on the screen after 60ms of processing. In addition, the playback device can pre-delay 59ms and then transmit the playback content to television B1 through the video data transmission line. Television B1 receives the playback content after 60ms and displays the playback content on the screen after 40ms of processing. At this time, B1 and B2 will display the playback content at the same time. It can be seen that in the technical solution provided by this patent, the accuracy of synchronous display is further improved on the basis that the external display device does not need additional delay adjustment, and synchronous display can be achieved by simply transmitting the external display delay time to the playback content.
[0106] In one embodiment provided by the present invention, a calibration device is also included;
[0107] The method for synchronous presentation of multiple external display terminals also includes a process of pre-calibrating the system time of the external display device, such as Figure 3 As shown, including:
[0108] The calibration device controls the external display device to present the display image and the current running time;
[0109] The calibration device collects the actual time when the external display device presents the display image;
[0110] The calibration device calibrates the current running time in the explicit delay device according to the actual time.
[0111] Specifically, considering that there may be an error between the system clock inside the external display delay device and the actual clock, which may cause an error in the playback time of the playback content by the external display device, it is necessary to perform a preliminary calibration on the external display device before the external display device displays the playback content to unify the internal system clock of the external display device. The present invention provides a calibration device, which controls the external display device to present a display image and the current running time on the screen to simultaneously compare the actual time of presenting the display image, and then can calibrate the internal system clock of the external display device according to the actual time, so that the current running time and the actual time are consistent, and the calibration can be completed.
[0112] Among them, the calibration device controls the external display device to present a display image and present the current running time in a manner that can be to present an image containing the current running time, and the calibration device collects the actual time of the external display device presenting the display image in a manner that can be to collect the display image. Specifically, the calibration device may include a control module, a collection camera, and an imaging device, wherein the control module is used to control the external display device to present an image containing the current running time, the collection camera captures the display image presented by the external display device, the imaging device presents the captured display image, and simultaneously presents the actual time, thereby the current running time and the actual time can appear simultaneously in the image presented by the imaging device, thereby the current running time can be directly adjusted according to the actual time, the current running time changes at any time, and this operation mode realizes calibration adjustment by comparing the current running time and the actual time at the moment when the display image is captured, which is convenient for actual operation. Furthermore, the calibration device in actual operation can also directly use a mobile phone, in which the control program, the comparison program, and the calibration program are loaded, thereby the mobile phone controls the external display device to present the current running time, and simultaneously captures the display image of the external display device, and simultaneously determines the actual time when the capture is made, and then the current running time and the actual time in the display image when the capture is made can be compared, and the external display device is calibrated.
[0113] It should be noted that the actual time may be the current time of a network such as NTP, or may be a pre-specified running time, or may be the running time of one of a plurality of display devices connected to the playback device.
[0114] In one embodiment of the present invention, the external display device includes an input signal circuit, a signal processing circuit, a display processing circuit and a display element;
[0115] The method for synchronous presentation of multiple external display terminals also includes a process of obtaining the external display delay time of the external display device, such as Figure 4 As shown, including:
[0116] Acquiring the arrival time of the display content reaching the signal processing unit via the input signal circuit;
[0117] The signal processing unit processes the display content and transmits the processed display content to the display processing circuit;
[0118] The display processing circuit transmits the display content to the display element and simultaneously informs the signal processing unit of the display time;
[0119] The signal processing unit determines the external display delay time according to the arrival time and the display time.
[0120] Specifically, since the time required for each external display device from acquiring an image to displaying the image on the screen, that is, the external display delay time, is different, if the external display device is a TV with post-processing capabilities, the image needs to be displayed on the screen through various video post-processing operations such as deinterlacing, scan rate conversion, frame rate conversion, noise reduction and image quality enhancement, and the external display delay time will be longer. In order to obtain the external display delay time of each external display device, this patent provides a method for obtaining the external display delay time. The external display device receives a video signal of display content from an input interface. The video signal will be transmitted to a signal processing unit through an input signal circuit. The signal processing unit processes the video signal and simultaneously records the arrival time of the video signal at the signal processing unit. The processed video signal is transmitted from the signal processing unit to the display processing circuit. The display processing unit outputs the signal to the display element and notifies the signal processing unit that the signal has been displayed on the display element. Therefore, the signal processing unit can determine the external display delay time required from the input to the display of the signal based on the arrival time and display time of the signal. Among them, the signal processing unit can be connected to a memory and can also divide a storage area internally to store the arrival time of the signal. When the signal processing unit obtains the notification that the signal is displayed on the display element, the arrival time can be extracted, and then the arrival time and display time can be compared to determine the external display delay time.
[0121] It should be noted that the external display device can determine the external display delay time in advance, or determine the external display delay time during the display of the playback content. Accordingly, the display content here can be pre-input video content or playback content sent by the playback device.
[0122] In one embodiment of the present invention, the synchronization adjustment process of the playback device is as follows: Figure 5 As shown, including:
[0123] First, the time difference between the playback time and the external display delay time of the external display device is obtained, and the time difference is used as the synchronization adjustment time;
[0124] Then, the playback content is pre-delayed according to the synchronization adjustment time;
[0125] Finally, the pre-delayed playback content is transmitted to the corresponding external display device, and the external display device plays the playback content at a time corresponding to the external display delay time, so that the external display device can achieve synchronous display.
[0126] Specifically, after the playback device obtains the external display delay time of each connected external display device, it will perform synchronization adjustment according to the external display delay time and the playback time of the playback content, so as to achieve the synchronization of the external display device to display the playback content. Among them, the playback device first obtains the time difference between the playback time and the external display delay time, and uses the time difference as the synchronization adjustment time, then pre-delays the playback content according to the synchronization adjustment time, and finally transmits the pre-delayed playback content to the corresponding external display device. After the external display device obtains the playback content, it will process it and display the playback content on the external display device after the corresponding external display delay time.
[0127] Among them, different external display devices have different external display delay times, and accordingly, the synchronization adjustment time determined by the playback device is also different. Therefore, the pre-delay time of the playback device for playing content is also different.
[0128] The synchronization adjustment time here can essentially be regarded as the waiting time for the playback device to send the playback content. For example, there is a set-top box A that is connected to two TVs B1 and B2 through a video data transmission line. The external display delay time of TV B1 is 60ms, and the external display delay time of TV B2 is 40ms. The playback content needs to be displayed on an external display device at 100ms. Therefore, for TV B1, after set-top box A obtains the external display delay time of B1, it will calculate the time difference of 40ms based on the playback time of 100ms and the external display delay time of 60ms. The time difference of 40ms is used as the synchronization adjustment time to pre-delay the playback content. The set-top box will wait for 40ms before sending the playback content to TV B1. The corresponding B 1 After receiving the playback content, it will undergo 60ms of internal processing, that is, after the external delay, the playback content will be displayed on the TV screen within 100ms; for TV B2, after set-top box A obtains the external delay time of B2, it will calculate the time difference of 60ms based on the playback time of 100ms and the external delay time of 40ms, and use the time difference of 60ms as the synchronization adjustment time to pre-delay the playback content. The set-top box will wait for 60ms before sending the playback content to TV B2. Correspondingly, after receiving the playback content, B2 will undergo 40ms of internal processing, that is, after the external delay, and display the playback content on the TV screen within 100ms.
[0129] In one embodiment of the present invention, the pre-delay process of playing the content is as follows: Figure 6 As shown, including:
[0130] The playback content is decoded and the decoded playback content is delayed, or the playback content is delayed and the delayed playback content is decoded.
[0131] Specifically, the pre-delay of the playback content causes the playback content to undergo different synchronization adjustment times, and after different pre-delay operations, the playback content is correspondingly transmitted to different external display devices, so that synchronous display between external display devices can be achieved. For example, the playback content is first decoded and then delayed, or the playback content is first delayed and then decoded, and the final playback content is transmitted to the external display device, which displays the playback content on the screen after internal processing, so as to achieve synchronous display between external display devices.
[0132] It should be noted that the playback content is decoded in the playback device, and the external display device directly receives the decoded playback content, and after post-processing and other operations, it is directly displayed on the screen. Accordingly, by using the technical solution of this patent, the playback device delays the synchronization adjustment time of the playback content, so that the external display device no longer needs to delay the decoded playback content, thereby avoiding the external display device delaying the processing in the external display device to achieve synchronous display, resulting in increased memory loss and increased storage burden.
[0133] In an implementation manner provided by the present invention, the external display delay time of the external display device includes a plurality of delay options corresponding to different delay times;
[0134] The synchronization adjustment process of the playback device includes:
[0135] First, the playback time and multiple delay options included in the external display delay time of the external display device are obtained, and the delay option closest to the playback time is used as the synchronization adjustment time;
[0136] Subsequently, the synchronization adjustment time is transmitted to the corresponding external display device, so that the external display device performs synchronization display according to the delay time option.
[0137] Specifically, multiple delay options are set in the external display device, each delay option corresponds to the time for the internal external display device to process the playback content. After the playback device obtains the delay option of the external display device, the delay option corresponding to the delay time closest to the playback time can be used as the synchronization adjustment time and transmitted to the external display device. After obtaining the synchronization adjustment time, the external display device will perform synchronous display according to the delay option.
[0138] For example, there is a set-top box A connected to TV B1 through a video data transmission line. TV B1 has three delay options, namely 40ms, 70ms and 120ms. The playback content needs to be displayed by an external display device at 100ms. After the set-top box A obtains the delay option of B1, it will select the delay option 120ms that is closest to the playback time 100ms as the synchronization adjustment time, and send the synchronization adjustment time, that is, the 120ms delay option, to TV B1. TV B1 displays the received playback content after 120ms according to the 120ms delay option. When the set-top box A is connected to multiple TVs, in order to make the moment when each TV displays the playback content close to the playback time of the playback content, and then realize synchronous display, the delay option of each TV can be obtained respectively, and then according to the playback time, the delay option closest to the playback time is selected and sent to each TV as the synchronization adjustment time, so that each TV can display the playback content close to the playback time, and realize synchronous display. Considering that the external display device can provide one or more fixed delay options, the playback device does not need to perform complex delay adjustments. It only needs to select a delay option and send it to the external display device to achieve synchronous display. Both the playback device and the external display device are easy to operate and implement.
[0139] In one implementation mode provided by the present invention, a plurality of delay options corresponding to different delay times include a plurality of different delay circuits;
[0140] The external display device executes the corresponding delay circuit according to the delay option corresponding to the synchronous adjustment time, so that the external display device performs synchronous display according to the delay option.
[0141] In an implementation manner provided by the present invention, the plurality of different delay circuits are a plurality of memories storing playback content with different numbers of frames;
[0142] The number of frames corresponds to the delay time one by one.
[0143] Specifically, the memory can store the data signal to be displayed, and the storage time can be determined by the number of frames stored. Therefore, multiple memories with different frame numbers are set in the external display device to form delay circuits with different delay times, thereby realizing multiple different delay options.
[0144] In one embodiment of the present invention, the delay options corresponding to different delay times provided by the external display device may be delay options formed by its own external display delay time without setting an additional delay circuit, or may be delay options formed by adding its own delay time to an additional delay time by setting an additional delay circuit.
[0145] For example, if the refresh rate is 100 Hz, the time interval for refreshing the data signal is 1000 ms / 100=10 ms. Therefore, storing one frame of signal can increase the delay by 10 ms. Two memories can be stored in the external display device. The first memory stores 3 frames of signal to extend by 30 ms, and the second memory stores 9 frames of signal to extend by 90 ms. If the external display delay time of the external display device at this time is 30 ms, the first memory eventually forms a delay option of 60 ms, and the second memory eventually forms a delay option of 120 ms. The external display device can provide the three delay options of 30 ms, 60 ms and 120 ms to the playback device. The playback device selects a delay option closest to the playback time as the synchronization adjustment time according to the playback time of the playback content, and sends it to the external display device. If the playback device selects 60 ms as the synchronization adjustment time and sends it to the external display device at this time, after the external display device receives the playback device's selection of the 60 ms delay option, it stores the playback content in the first memory to achieve a delay of 60 ms.
[0146] The playback device performs corresponding operations on each external display device, receives the delay options provided by each external display device, and uses the delay option closest to the playback time as the corresponding synchronization adjustment time, so that each external display device receives the corresponding synchronization adjustment time, and performs the corresponding delay through the corresponding memory to achieve synchronous display between external display devices.
[0147] The present invention also provides a multi-terminal synchronous presentation system, comprising:
[0148] a playback device;
[0149] A transmission device, connected to the playback device and the external display device respectively;
[0150] at least one external display device, including a transmission module for transmitting the external display delay time of the external display device to the playback device;
[0151] The playback equipment also includes:
[0152] A synchronization adjustment module, used to generate a synchronization adjustment time and perform synchronization adjustment according to the playback time of the playback content and the external display delay time;
[0153] External display devices also include:
[0154] A display module is used to synchronously present the playing content according to the result of the synchronous adjustment.
[0155] Specifically, the playback device can be connected to at least one external display device through a transmission device. The synchronization adjustment module obtains the operation processing time of each external display device from obtaining the playback content to displaying the playback content, that is, the external display delay time of the external display device. Then, the synchronization adjustment time corresponding to each external display device is generated according to the playback time corresponding to the playback content and the external display delay time. By performing synchronization adjustment according to the synchronization adjustment time, synchronous display of all external display devices can be achieved.
[0156] In one embodiment provided by the present invention, the transmission device is a new type of video data transmission line, in which a bidirectional data path is provided for transmitting the external display delay time of an external display device to a playback device, and for transmitting the synchronization delay time and playback content of the playback device to the external display device.
[0157] In one embodiment provided by the present invention, a testing device is also included;
[0158] Test equipment includes:
[0159] A control unit, used to control the current running time of the external display device to present the display image;
[0160] A collection unit, used for collecting the actual time when the external display device presents the display image;
[0161] The processing unit is used to calibrate the current running time in the explicit delay device according to the actual time.
[0162] Specifically, the calibration device includes a control unit, an acquisition unit and a processing unit. The control unit controls the external display device to present the display image and the current running time on the screen. The acquisition unit simultaneously acquires the actual time of presenting the display image. The processing unit can then calibrate the internal system clock of the external display device according to the actual time, so that the current running time and the actual time are consistent, and the calibration is completed.
[0163] In one embodiment of the present invention, the external display device includes an input signal circuit, a signal processing circuit, a display processing circuit and a display element;
[0164] include:
[0165] A signal processing circuit, used to obtain the arrival time of the display content and reach the signal processing unit via the input signal circuit; and process the display content and transmit the processed display content to the display processing circuit;
[0166] A display processing circuit, used to transmit the display content to the display element and simultaneously inform the signal processing unit of the display time;
[0167] The signal processing unit determines the external display delay time according to the arrival time and the display time.
[0168] Specifically, the external display device receives a video signal of display content from an input interface, and the video signal is transmitted to the signal processing unit through the input signal circuit. The signal processing unit processes the video signal and simultaneously records the arrival time of the video signal at the signal processing unit. The processed video signal is transmitted from the signal processing unit to the display processing circuit. The display processing unit outputs the signal to the display element and simultaneously notifies the signal processing unit that the signal has been displayed on the display element. Thus, the signal processing unit can determine the external display delay time required from signal input to display based on the arrival time and display time of the signal.
[0169] In one implementation manner provided by the present invention, a synchronization adjustment module of a playback device includes:
[0170] A first generating unit, configured to obtain a time difference between a playback time and an external display delay time of an external display device, and use the time difference as a synchronization adjustment time;
[0171] A first adjustment unit, configured to pre-delay the playback content according to the synchronization adjustment time;
[0172] A first transmission unit, used for transmitting the pre-delayed playback content to a corresponding external display device;
[0173] The display module of the external display device includes:
[0174] A first display unit is used for synchronous display according to the delay time corresponding to the synchronous adjustment time.
[0175] Specifically, the first generation unit first obtains the time difference between the playback time and the external display delay time, and uses the time difference as the synchronization adjustment time. The first adjustment unit pre-delays the playback content according to the synchronization adjustment time. The first transmission unit transmits the pre-delayed playback content to the corresponding external display device. The first display unit in the external display device processes the playback content after obtaining it, and displays the playback content on the external display device after the corresponding external display delay time.
[0176] The first adjustment unit includes: a first decoding component, used to decode the playback content;
[0177] Also includes:
[0178] A first delay component, connected to the delay component, for delaying the playback content before decoding;
[0179] The second delay component is connected to the delay component and is used for delaying the playback content after decoding.
[0180] Specifically, the first adjustment unit may include a first decoding component and a first delay component to first decode the playback content and then perform delay processing; the first adjustment unit may also include a first decoding component and a second delay component to first perform delay processing on the playback content and then decode it. Finally, the playback content is transmitted to the external display device, and the external display device displays the playback content on the screen after internal processing, thereby achieving synchronous display between the external display devices.
[0181] In an implementation manner provided by the present invention, the external display delay time of the external display device includes a plurality of delay options corresponding to different delay times;
[0182] The synchronization adjustment module of the playback device includes:
[0183] a second generating unit, configured to obtain the play time and a plurality of delay options included in the external display delay time of the external display device, and use the delay option closest to the play time as the synchronization adjustment time;
[0184] a second transmission unit, transmitting the synchronous adjustment time to a corresponding external display device;
[0185] The display module of the external display device includes:
[0186] A second display unit is used for synchronous display according to the delay time corresponding to the synchronous adjustment time.
[0187] Specifically, multiple delay options are set in the external display device, each delay option corresponds to the time for the internal external display device to process the playback content. After the second generation unit in the playback device obtains the delay option of the external display device, the delay option corresponding to the delay time closest to the playback time can be used as the synchronization adjustment time, and transmitted to the external display device through the second transmission unit. After the second display unit in the external display device obtains the synchronization adjustment time, it will perform synchronous display according to the delay option.
[0188] In an implementation manner provided by the present invention, the external display device includes a plurality of delay circuits corresponding to delay options;
[0189] The external display device executes the corresponding delay circuit according to the delay option corresponding to the synchronous adjustment time, so that the external display device performs synchronous display according to the delay time option.
[0190] In one implementation mode provided by the present invention, a plurality of delay options corresponding to different delay times include a plurality of different delay circuits;
[0191] The multiple different delay circuits are multiple memories storing the playback content with different frame numbers;
[0192] The number of frames corresponds to the delay time one by one.
[0193] Specifically, the memory can store the data signal to be displayed, and the storage time can be determined by the number of frames stored. Therefore, multiple memories with different frame numbers are set in the external display device to form delay circuits with different delay times, thereby realizing multiple different delay options.
[0194] In one embodiment of the present invention, the delay options corresponding to different delay times provided by the external display device may be delay options formed by its own external display delay time without setting an additional delay circuit, or may be delay options formed by adding its own delay time to an additional delay time by setting an additional delay circuit.
[0195] The present invention also provides a system, comprising the receiving device as described above.
[0196] The present invention also provides a computer-readable storage medium for storing program instructions. When the program instructions are executed by a computer, the computer executes the above-mentioned receiving method.
[0197] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any other combination. When implemented by software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that can be accessed by the computer or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a digital video disc (digital video disc, DVD)), or a semiconductor medium (e.g., a solid state disk (solid state disk, SSD)), etc.
[0198] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0199] The above are only preferred embodiments of the present invention, and are not intended to limit the embodiments and protection scope of the present invention. Those skilled in the art should be aware that all solutions obtained by equivalent substitutions and obvious changes made using the description and illustrations of the present invention should be included in the protection scope of the present invention.
Claims
1. A method for synchronous presentation of multiple external display terminals, characterized in that: include: Playback device, used to obtain playback content and playback time; A transmission device, connected to the playback device and the external display device respectively; At least one external display device, used to present the playback content; The external display device transmits the external display delay time of the external display device to the playback device through the transmission device; The playback device generates a synchronization adjustment time according to the playback time of the playback content and the external display delay time, and performs synchronization adjustment according to the synchronization adjustment time, so that all the external display devices synchronously present the playback content.
2. The method for synchronous presentation of multiple external display terminals according to claim 1, characterized in that: The transmission device is a video data transmission line, in which a bidirectional data path is provided for transmitting the external display delay time of the external display device to the playback device, and transmitting the synchronization delay time and / or the playback content of the playback device to the external display device.
3. The method for synchronous presentation of multiple external display terminals according to claim 1, characterized in that: Also included is a calibration device; The method for synchronous presentation of multiple external display terminals also includes a process of pre-calibrating the system time of the external display device, including: The calibration device controls the external display device to present a display image and a current running time; The calibration device collects the actual time when the external display device presents the display image; The calibration device calibrates the current running time in the explicit delay device according to the actual time.
4. The method for synchronous presentation of multiple external display terminals according to claim 1, characterized in that: The external display device includes an input signal circuit, a signal processing circuit, a display processing circuit and a display element; The method for synchronous presentation of multiple external display terminals also includes a process of obtaining the external display delay time of the external display device, including: Acquiring the arrival time of the display content reaching the signal processing unit via the input signal circuit; The signal processing unit processes the display content and transmits the processed display content to the display processing circuit; The display processing circuit transmits the playback content to the display element and simultaneously informs the signal processing unit of the display time; The signal processing unit determines the external display delay time according to the arrival time and the display time.
5. The method for synchronous presentation of multiple external display terminals according to claim 1 or 2, characterized in that: The synchronization adjustment process of the playback device includes: First, the time difference between the playback time and the external display delay time of the external display device is obtained, and the time difference is used as the synchronization adjustment time; Then, the playback content is pre-delayed according to the synchronization adjustment time; Finally, the pre-delayed playback content is transmitted to the corresponding external display device, and the external display device plays the playback content at a time corresponding to the external display delay time, so that the external display device can achieve synchronous display.
6. The method for synchronous presentation of multiple external display terminals according to claim 5, characterized in that: The pre-delay process of playing the content includes: The playback content is decoded and the decoded playback content is delayed, or the playback content is delayed and the delayed playback content is decoded.
7. The method for synchronous presentation of multiple external display terminals according to claim 1 or 2, characterized in that: The external display delay time of the external display device includes a plurality of delay options corresponding to different delay times; The synchronization adjustment process of the playback device includes: First, the playback time and a plurality of delay options included in the external display delay time of the external display device are obtained, and the delay option closest to the playback time is used as the synchronization adjustment time; Subsequently, the synchronization adjustment time is transmitted to the corresponding external display device, so that the external display device performs synchronous display according to the delay option.
8. The method for synchronous presentation of multiple external display terminals according to claim 7, characterized in that: The delay option includes a delay circuit; The external display device executes a corresponding delay circuit according to a delay option corresponding to the synchronization adjustment time, so that the external display device performs synchronous display according to the delay option.
9. The method for synchronous presentation of multiple external display terminals according to claim 8, characterized in that: The delay circuit includes a memory for storing the playback content in different frame numbers; The frame number corresponds to the delay time one by one.
10. A multi-display terminal synchronous presentation system, characterized in that: include: a playback device; a transmission device, connected to the playback device and the external display device respectively; at least one external display device, comprising a transmission module for transmitting the external display delay time of the external display device to the playback device; The playback device also includes: A synchronization adjustment module, used to generate a synchronization adjustment time and perform synchronization adjustment according to the playback time of the playback content and the external display delay time; The external display device also includes: A display module is used to synchronously present the playback content according to the result of the synchronous adjustment.
11. The multi-display terminal synchronous presentation system according to claim 10, characterized in that: The transmission device is a new type of video data transmission line, in which a bidirectional data path is arranged for transmitting the external display delay time of the external display device to the playback device, and for transmitting the synchronization delay time and / or the playback content of the playback device to the external display device.
12. The multi-display terminal synchronous presentation system according to claim 10, characterized in that: Also included is a calibration device; The calibration equipment comprises: A control unit, used for controlling the current running time of the external display device to present a display image; A collection unit, used for collecting the actual time when the external display device presents the display image; A processing unit is used to calibrate the current running time in the explicit delay device according to the actual time.
13. The multi-display terminal synchronous presentation system according to claim 10, characterized in that: The external display device includes an input signal circuit, a signal processing circuit, a display processing circuit and a display element; include: A signal processing circuit, used for acquiring the arrival time of the display content and reaching the signal processing unit via the input signal circuit; and processing the display content and transmitting the processed display content to the display processing circuit; The display processing circuit is used to transmit the display content to the display element and simultaneously inform the signal processing unit of the display time; The signal processing unit determines the external display delay time according to the arrival time and the display time.
14. The multi-display terminal synchronous presentation system according to claim 10 or claim 11, characterized in that: The synchronization adjustment module of the playback device includes: A first generating unit, configured to obtain a time difference between a playback time and an external display delay time of the external display device, and use the time difference as a synchronization adjustment time; a first adjustment unit, configured to pre-delay the playback content according to a synchronization adjustment time; a first transmission unit, configured to transmit the pre-delayed playback content to the corresponding external display device; The display module of the external display device includes: A first display unit is used for synchronous display according to the delay time corresponding to the synchronous adjustment time.
15. The multi-display terminal synchronous presentation system according to claim 10, characterized in that: The first adjustment unit includes: a first decoding component, used to decode the playback content; Also includes: A first delay component, connected to the delay component, for delaying the playback content before decoding; The second delay component is connected to the delay component and is used for delaying the playback content after decoding.
16. The multi-display terminal synchronous presentation system according to claim 10 or claim 11, characterized in that: The external display delay time of the external display device includes a plurality of delay options corresponding to different delay times; The synchronization adjustment module of the playback device includes: a second generating unit, configured to obtain a play time and a plurality of delay options included in an external display delay time of the external display device, and use a delay option closest to the play time as a synchronization adjustment time; a second transmission unit, transmitting the synchronization adjustment time to the corresponding external display device; The display module of the external display device includes: A second display unit is used for synchronous display according to the delay time corresponding to the synchronous adjustment time.
17. The multi-display terminal synchronous presentation system according to claim 16, characterized in that: The delay options corresponding to different delay times include a plurality of different delay circuits; The external display device executes a corresponding delay circuit according to a delay option corresponding to the synchronization adjustment time, so that the external display device performs synchronous display according to the delay option.
18. The multi-display terminal synchronous presentation system according to claim 17, characterized in that: The multiple different delay circuits are multiple memories storing the playback content with different frame numbers; The frame number corresponds to the delay time one by one.
Citation Information
Patent Citations
High precision transmission synchronization and delay compensation method for dynamic network
CN105743599A
Distributed video display system as well as distributed video display control device and method
CN106982383A
Synchronous playing method and system for multiple pieces of playing equipment, and terminal
CN108540829A
Local area network multi-screen display synchronization method and device
CN113365127A
Video display system, video conversion device, and video display method
CN113508578A