Material linkage display method

Abstract

The present disclosure relates to the technical field of material display, and particularly relates to a material linkage display method, which is applied to a linkage display system, the linkage display system comprises: a control device, a plurality of display devices, and the method comprises the following steps: the control device sends a play instruction to the plurality of display devices in response to receiving the play instruction of a to-be-played material, the play instruction comprises: a sending time of the control device sending the play instruction and a material identifier of the to-be-played material; the display device acquires the to-be-played material according to the material identifier after receiving the play instruction, calculates a time difference between the sending time in the play instruction and a current time, determines a play position of the to-be-played material according to the time difference, and plays the to-be-played material from the play position. The present application can synchronize data between the control device and the display device, so that the display device can simultaneously or individually play the same material.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of material display, in particular to a material linkage display method. BACKGROUND

[0002] The environment in which we live, various display devices are becoming more and more, more display solutions and needs also emerged. Splicing screen, special-shaped screen as a kind of display solution, is widely used in various places and industries.

[0003] At present, to realize the splicing combination effect between screens, there are mainly two ways: one is to use tree structure, and a large number of hardware and materials are stacked to realize the super large screen splicing. The cost is so high that it is not worth mentioning, and it is difficult to realize the free switching of single screen and multiple screens, and cannot meet the needs of some scenes; the second is to use distributed structure, all screens are in the same local area network, and the screens are synchronized through ad hoc network.

[0004] However, the above two solutions, no matter the cost, can solve the simple combination of screens in a certain space. But for the screen coverage of hundreds of meters or even thousands of meters, the above solutions are helpless, and cannot meet the market needs. In order to solve the above problems, the market urgently needs a display solution that can support long distance, wide coverage, super multi-device, support free switching of split and linkage, and controllable cost.

[0005] It should be noted that the information disclosed in the above background section is only used to strengthen the understanding of the background of the present disclosure, and therefore can include information that does not constitute prior art known to those of ordinary skill in the art. SUMMARY

[0006] The purpose of the present disclosure is to provide a material linkage display method, and specifically disclose a material linkage display method, storage medium and computer system, so as to at least overcome the problem that the current material same screen playing cannot be applied to devices with long distance due to the limitations and defects of related technology, and thus cannot meet the market needs.

[0007] Other characteristics and advantages of the present disclosure will become apparent from the following detailed description, or will be learned by practice of the present disclosure.

[0008] According to a first aspect of the present disclosure, a material linkage display method is provided, applied to a linkage display system, the linkage display system comprising: a control device, a plurality of display devices, the method comprising:

[0009] The control device sends the play instruction to the plurality of display devices in response to receiving the play instruction of the to-be-played material, the play instruction containing a sending time of the control device sending the play instruction and a material identifier of the to-be-played material.

[0010] The display device acquires the to-be-played material according to the material identifier after receiving the play instruction, calculates a time difference between the sending time in the play instruction and a current time, determines a play position of the to-be-played material according to the time difference, and plays the to-be-played material from the play position.

[0011] Optionally, the determining of the play position of the to-be-played material according to the time difference comprises:

[0012] determining a position corresponding to a first time length backward from a start position of the to-be-played material as the play position of the to-be-played material, the first time length being equal to the time difference.

[0013] Optionally, the linkage display system further comprises a storage device, the storage device storing each material.

[0014] The display device acquires the to-be-played material according to the material identifier comprises:

[0015] The display device pulls the to-be-played material corresponding to the material identifier from the storage device.

[0016] Optionally, the sending of the play instruction to the plurality of display devices by the control device in response to receiving the play instruction of the to-be-played material comprises:

[0017] The control device acquires the to-be-played material in response to receiving the play instruction.

[0018] The control device performs cutting analysis processing on the to-be-played material to obtain the play instruction.

[0019] The control device sends the play instruction to the plurality of display devices.

[0020] Optionally, the cutting analysis processing on the to-be-played material by the control device to obtain the play instruction comprises:

[0021] obtaining a feature of the to-be-played material by an ffprobe function of FFMpeg, wherein the feature comprises a material type, a time length, an audio, and material track information.

[0022] generating the play instruction of the to-be-played material based on the feature of the to-be-played material.

[0023] Optionally, the linkage display system further comprises a transmitting device; and the method further comprises:

[0024] The transmitting device is configured to transmit the playing instruction generated by the control device to the display device, so that the display device plays the to-be-played material.

[0025] The transmitting device has a transceiving byte less than 1460 bytes.

[0026] Optionally, before the control device responds to the received playing instruction of the to-be-played material, the method further comprises:

[0027] The control device and / or the display device adjusts the current time of the device, so that the time of the control device is synchronized with the time of each display device.

[0028] Optionally, the transmitting device is connected to each display device respectively, and each display device is collected and aggregated, and then the terminal with the shortest spatial distance is aggregated into one transmitting device.

[0029] Optionally, the method further comprises:

[0030] The first time at which the playing device transmits the to-be-played material and the playing instruction to the display device, and the second time at which each display device receives the to-be-played material and the playing instruction are obtained.

[0031] The communication time between the second time and the first time is measured by a smoothing function, so as to realize the consistency of the second time corresponding to each display device, and then realize time synchronization.

[0032] Optionally, the method further comprises:

[0033] The control device is configured with a heartbeat mechanism, and the heartbeat mechanism is configured to send a heartbeat packet to the display device at a predetermined time interval.

[0034] The control device receives the heartbeat packet feedback, and when the time length of the received heartbeat packet is greater than a predetermined time length, it is determined that the current display device is offline, and the control device reconnects the display device.

[0035] Optionally, the linkage display system further comprises an application server.

[0036] The application server is configured to store the material identifier of the to-be-played material and the to-be-played material corresponding to the material identifier into a cloud database.

[0037] The display device requests the application server for the to-be-played material corresponding to the material identifier, and performs secondary cutting positioning on the to-be-played material.

[0038] Optionally, the control device is provided with a cloud computing module, and the application server is configured to store the material identifier of the to-be-played material and the to-be-played material corresponding to the material identifier into a cloud database, including:

[0039] The cloud computing module FFMpeg function processes the to-be-played material to obtain a picture sequence corresponding to the to-be-played material.

[0040] The application server stores the material identifier and the picture sequence of the to-be-played material corresponding to the material identifier in the cloud database.

[0041] Optionally, the material identifier is a storage location of the picture sequence in the cloud database.

[0042] Optionally, the plurality of display devices are single display devices or a plurality of display devices formed by a plurality of display screen arrays.

[0043] When the display device is a plurality of display devices formed by a plurality of display screen arrays, the control device, in response to receiving a play instruction of a to-be-played material, sends the play instruction to the plurality of display devices, including:

[0044] The control device creates a device group of the display device, and obtains an arrangement mode of the display device.

[0045] The control device obtains a row spacing and a column spacing of the display device corresponding to the arrangement mode based on the arrangement mode of the display device, and sends the row spacing and the column spacing to the display device.

[0046] Optionally, when the display device is a plurality of display devices formed by a plurality of display screen arrays, the control device obtains a row spacing and a column spacing of the display device corresponding to the arrangement mode based on the arrangement mode of the display device, and sends the row spacing and the column spacing to the display device, including:

[0047] Based on the self parameter of the display device and the arrangement mode of each display screen, a display parameter and a material parameter are calculated, wherein the display parameter includes a column number, a row number, a column spacing, a row spacing, and a device serial number, and the material parameter includes a material width and a material height.

[0048] The display device draws the material onto the screen of the display device by using a local canvas or openGL.

[0049] Optionally, the method further comprises:

[0050] cutting the to-be-played material into a plurality of material segments;

[0051] the display device divides its screen group into a plurality of areas, the areas corresponding to the material segments one by one; the display device uploads the corresponding material segments to each of the areas respectively, so as to play the corresponding material segments in the areas, and thus play the to-be-played material on the screen.

[0052] Optionally, the material segments include any one or at least one of audio, video, picture, and text.

[0053] Optionally, before the display device receives the play instruction, the display device further comprises:

[0054] the display device acquires the row spacing and the column spacing, and requests the application server for the play instruction and the picture sequence corresponding to the play instruction based on the row spacing and the column spacing, so as to play the to-be-played material.

[0055] Optionally, the control device is further configured to set the play parameters of the display device, wherein the play parameters include at least one of adding and managing a play list, setting a single-screen or multi-screen play mode, adding a play item, and modifying a play option.

[0056] The control device is further configured to send the play parameters to the display device, so that the display device plays the to-be-played material according to the play parameters.

[0057] Optionally, the display device is provided with a synchronization module.

[0058] The synchronization module is configured to calculate the frame corresponding to the material played by the display device according to the play instruction and the inherent refresh frequency of the current display device when the display device receives the play instruction.

[0059] The display device plays the to-be-played material based on the frame corresponding to the material played by the display device.

[0060] According to a second aspect of the present disclosure, a storage medium having a computer program stored thereon is provided, the program being executed by a processor to implement the material linkage display method described above.

[0061] According to a third aspect of the present disclosure, a computer system is provided, comprising:

[0062] a processor; and

[0063] a memory configured to store executable instructions of the processor.

[0064] The processor is configured to execute the above-mentioned material linkage display method via execution of the executable instructions.

[0065] The material linkage display method of the present disclosure is applied to a linkage display system, which comprises a control device and a plurality of display devices. The method comprises: the control device, in response to receiving a play instruction for a to-be-played material, sends the play instruction to the plurality of display devices, wherein the play instruction comprises a sending time of the control device sending the play instruction and a material identifier of the to-be-played material; and the display device, after receiving the play instruction, acquires the to-be-played material according to the material identifier, calculates a time difference between the sending time in the play instruction and a current time, determines a play position of the to-be-played material according to the time difference, and plays the to-be-played material from the play position. In the independent display devices, due to physical environmental factors or device factors, it is inconvenient or impossible to make network connection between the devices, and meanwhile, picture splicing, combination and synchronization need to be realized; for example, various display devices such as liquid crystal displays, LED screens, projection, splicing screens, even mobile phones, tablet screens and the like, when one or more of them need to be mixed and linked, a solution with low delay and a synchronization error of about 20 ms is needed to ensure the coherence and consistency of image display and sound output.

[0066] It should be understood that the foregoing general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF DRAWINGS

[0067] The accompanying drawings, which are incorporated into and form part of the specification, illustrate embodiments consistent with the present disclosure and, together with the specification, serve to explain the principles of the present disclosure. Obviously, the drawings in the following description are only some embodiments of the present disclosure, and other drawings can be obtained by those skilled in the art without creative labor on the basis of these drawings.

[0068] Figure 1 A schematic diagram of a material linkage display method in an exemplary embodiment of the present disclosure is schematically shown;

[0069] Figure 2 A schematic diagram of a linkage display system in an exemplary embodiment of the present disclosure is schematically shown;

[0070] Figure 3 A schematic diagram of a computer system in an exemplary embodiment of the present disclosure is schematically shown;

[0071] Figure 4A schematic diagram illustrating a composition of a storage medium in an exemplary embodiment of the present disclosure is shown.

[0072] Figure 5 A flow chart illustrating an aggregation of a transmitting device in an exemplary embodiment of the present disclosure is shown.

[0073] Figure 6 A flow chart illustrating a time synchronization of a device in an exemplary embodiment of the present disclosure is shown.

[0074] Figure 7 A flow chart illustrating a frame synchronization in an exemplary embodiment of the present disclosure is shown.

[0075] Figure 8 A combination diagram of a display device having a plurality of screens in an exemplary embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0076] Example implementations are now described with reference to the drawings. Example implementations can, however, be implemented in many different forms and should not be construed as limited to the examples set forth herein; rather, these implementations are provided so that this disclosure will be thorough and complete, and will fully convey the scope of example implementations to those skilled in the art. Features described in the description, examples, or claims can be combined in any suitable manner in one or more implementations.

[0077] In addition, the drawings are merely schematic and are not necessarily drawn to scale. Like reference numerals designate like or similar parts throughout the drawings and the detailed description, and thus corresponding portions of the drawings and description can be omitted in the interest of brevity. Some of the block diagrams shown in the drawings are functional entities that do not necessarily have to correspond to physically or logically independent entities. These functional entities can be implemented in software, or in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.

[0078] The block diagrams shown in the drawings are merely functional entities that do not necessarily have to correspond to physically independent entities. That is, these functional entities can be implemented in software, or in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.

[0079] The flowcharts shown in the drawings are merely illustrative and do not necessarily include all contents and operations / steps, nor are they necessarily executed in the order described. For example, some operations / steps can be further divided, and some operations / steps can be combined or partially combined, so that the actual execution order can be changed depending on the actual situation.

[0080] The material linkage display method provided by the embodiment of the present disclosure can be applied to the following application scenarios.

[0081] The present disclosure discloses a material linkage display method and a material linkage display system. Through a built-in application or a separate control device, display devices located in different spaces can be synchronously and individually displayed or displayed in linkage. The scheme is composed of a control device and display devices. The control device sends a play instruction for a to-be-played material. The signal of the play instruction is synchronized to each display device. The display devices download and cache corresponding media play data while performing synchronous display and play of media cutting and combination according to the play instruction and a related synchronization algorithm.

[0082] It can be seen that the technical scheme of the present disclosure can be applied to display devices in two regions across regions, so that the two display devices can synchronously display the same content.

[0083] The present disclosure provides a material linkage display method. As shown in Figure 1 , Figure 2 The method comprises steps S101 and S102.

[0084] In step S101, the control device sends a play instruction for a to-be-played material to the plurality of display devices in response to receiving the play instruction. The play instruction contains a sending time of the control device sending the play instruction and a material identifier of the to-be-played material.

[0085] In step S102, the display device acquires the to-be-played material according to the material identifier after receiving the play instruction, calculates a time difference between the sending time in the play instruction and a current time, determines a play position of the to-be-played material according to the time difference, and plays the to-be-played material from the play position.

[0086] The material linkage display method of the present disclosure can realize picture splicing, combination and synchronization among independent display devices due to physical environmental factors or device factors, which are inconvenient or unable to perform network connection among devices. For example, LCDs, LED screens, projection screens, even mobile phones, tablet screens and various display devices, one or more of which need to be mixed and connected among multiple devices. A solution with a low delay and a synchronization error of about 20 ms is needed to ensure the coherence and consistency of image display and sound output.

[0087] Next, each step of the material linkage display method in the present example embodiment will be described in more detail in combination with the accompanying drawings and examples.

[0088] Step S101, the control device sends the play instruction to the plurality of display devices in response to receiving the play instruction of the to-be-played material, the play instruction containing the sending time of the control device sending the play instruction and the material identifier of the to-be-played material.

[0089] In the example embodiment, the display device can be a device playing only audio, such as a loudspeaker, a device playing only video, such as a display screen, or a device playing both audio and video, such as a multimedia terminal. The type of the display device is not limited in the application. Correspondingly, the to-be-played material can be audio, video, or a document, which is not limited in the application.

[0090] In the example embodiment, the control device can be a control program or a device with the control program. In actual application, the control device can be a computer, a Pad, or even a mobile phone with a web page or an APP, which can control the display device.

[0091] In the example embodiment, the display device is generally a controlled terminal, which is generally installed on the playing device and can passively receive the play instruction. For example, the display device is connected to the control device through a long link. Specifically, the control device sends the play instruction to each controlled terminal (i.e. the display device). Of course, the control device can also send the play instruction to the display device to control the display device to display the to-be-played material.

[0092] In the example embodiment, the material identifier can be the storage location of the to-be-played material or other index file or index character that can index the to-be-played material. The application is not limited in this regard. Further, when the material identifier is the storage location, for example, a picture resource address is resRawUrl+"process=image / crop,"+x_120,y_120,w_50,h_50, resRawUrl is the original address of the resource, and the numbers after x, y, w, and h represent the horizontal coordinate, vertical coordinate, width, and height of the target material to be cropped.

[0093] Step S102, the display device acquires the to-be-played material according to the material identifier after receiving the play instruction, calculates the time difference between the sending time in the play instruction and the current time, determines the play position of the to-be-played material according to the time difference, and plays the to-be-played material from the play position.

[0094] In the actual application, the present application mainly solves the problem that it is inconvenient or impossible to connect the devices in the network due to physical environmental factors or device factors, and the picture needs to be spliced, combined and synchronized between the independent display devices, such as liquid crystal displays, LED screens, projection, spliced screens, even mobile phones, tablet screens and various display devices, and when one or more of them are mixed and connected, a solution with low delay and synchronization error of about 20ms is needed to ensure the coherence and consistency of image display and sound output.

[0095] Further, the present application scheme can be applied to any display device in theory, and an existing display device can be converted into a linked display device at any time, including but not limited to: liquid crystal displays, LED screens, projection, spliced screens, even mobile phones, tablet screens and the like.

[0096] Further, the networking mode of any device in the display device group is no longer limited by a certain connection mode. For example, the device can use mobile networks such as 4G, 5G, etc. for access, or use network cables or wifi, or even satellite network access for access.

[0097] Further, the display device is no longer limited by space. No matter how far apart the devices are, the coverage is wide, and the display effect of splicing, combining and linking can be achieved. The display device can be freely switched between single display and combined display to meet the needs of different scene playing.

[0098] In the example embodiment, the linked display system includes a cloud computing module, a cloud database, a signaling device, an application server, and a complete system solution including a display device.

[0099] Among them, the cloud computing module is mainly responsible for cutting, analyzing and processing the to-be-played material, the signaling device is mainly responsible for controlling the instant communication between the device and the display device, the application server is mainly responsible for configuring various device settings and parameter control of the display device, and the synchronization module carried on the display device is used to provide a synchronization algorithm to realize time synchronization between the display device and the application server, and provide user interface interaction.

[0100] In a specific embodiment, the method further includes determining a play position of the to-be-played material according to the time difference, including: determining a position corresponding to a first time length of the start position of the to-be-played material as the play position of the to-be-played material, the first time length being equal to the time difference.

[0101] In an embodiment, the linkage display system further comprises a storage device, and the storage device stores each material; and the display device acquires the to-be-played material according to the material identifier, which comprises: the display device pulls the to-be-played material corresponding to the material identifier from the storage device.

[0102] In an embodiment, the control device, in response to receiving a play instruction of a to-be-played material, sends the play instruction to the plurality of display devices, which comprises: the control device, in response to receiving and acquiring the to-be-played material, performs cutting analysis and processing on the to-be-played material to obtain the play instruction; and the control device sends the play instruction to the plurality of display devices.

[0103] In the example embodiment, as shown in FIG. 1, the display device can be a display device with one screen, such as a television, a tablet, etc., or a display device formed by splicing a plurality of screens, as shown in FIG. 2, which comprises (m) x (n) display screens. In this case, the control device can create a display device group and select various display device arrangement modes. For example, if the display devices are arranged in a matrix mode with m columns and n rows, there are (m) x (n) display devices in total, and the column interval and the row interval between the display devices can also be set. Figure 8 Figure 8 In the example embodiment, as shown in FIG. 1, the display device can be a display device with one screen, such as a television, a tablet, etc., or a display device formed by splicing a plurality of screens, as shown in FIG. 2, which comprises (m) x (n) display screens. In this case, the control device can create a display device group and select various display device arrangement modes. For example, if the display devices are arranged in a matrix mode with m columns and n rows, there are (m) x (n) display devices in total, and the column interval and the row interval between the display devices can also be set.

[0104] In an embodiment, the control device, in response to receiving a play instruction of a to-be-played material, sends the play instruction to the plurality of display devices, which comprises: the control device, in response to receiving and acquiring the to-be-played material, performs cutting analysis and processing on the to-be-played material to obtain the play instruction; and the control device sends the play instruction to the plurality of display devices.

[0105] In the example embodiment, after the control device uploads the material, the middleware analyzes the material, such as obtaining the type, length, audio, and material track information of the material by using the ffprobe function of FFMpeg, and stores these information in the application server for use in the next cutting and playing. Then, the material is processed by using FFMpeg, such as converting the material into a picture sequence and storing it in the cloud database for use in playing by the display device.

[0106] In an embodiment, the linkage display system further comprises a transmitting device, and the method further comprises: the transmitting device is configured to send the play instruction generated by the control device to the display device, so that the display device plays the to-be-played material; and the transmitting device has a transmitting byte less than 1460 bytes.

[0107] ​In the example embodiment, in order to ensure that the data is sent by the transmission device with low delay, the transmitted data is as small as possible, generally not more than 1460 bytes. The maximum TCP data volume per packet is only 1460 bytes, and since the maximum transmission frame (MTU) of Ethernet is 1500 bytes, the TCP and IP protocol headers each occupy 20 bytes, so 1500-20-20=1460. This is why only 1460 bytes can be transmitted per packet, and data exceeding 1460 bytes will be sent multiple times.

[0108] In one specific embodiment, before the control device responds to the received playing instruction of the to-be-played material, the method further comprises: the control device and / or the display device adjusting the current time of the device, so as to synchronize the time of the control device and each display device.

[0109] In the example embodiment, the core of time synchronization is to ensure the stability of the signal connection of the transmission system. The following are the core points of implementation:

[0110] 1. Ensure low delay. The transmitted data is as small as possible, generally not more than 1460 bytes. The maximum TCP data volume per packet is only 1460 bytes, and since the maximum transmission frame (MTU) of Ethernet is 1500 bytes, the TCP and IP protocol headers each occupy 20 bytes, so 1500-20-20=1460. This is why only 1460 bytes can be transmitted per packet, and data exceeding 1460 bytes will be sent multiple times.

[0111] 2. It is found through testing that the Socket communication needs to be transmitted at least 3 times continuously, and the delay rate can be stabilized to a relatively low level.

[0112] 3. Signal stability detection. If all delay times are stable within an error range of about 10 ms within one second, it indicates that the signal stability is good, and the client can perform accurate time synchronization with the server.

[0113] 4. When the control end sends any instruction signal, since not every client is transmitting data with the transmission device, the device resources need to be reallocated, resulting in a large difference in each delay. The synchronization of different clients is also greatly affected and needs to be re-corrected. The basic method is to transmit an empty signal packet 5 times continuously, calculate the average delay error of the last 3 times, and if the average delay error is within 10 ms, record the delay error value in the service end, and then synchronize it to each client by the service end.

[0114] 5. If there is no data for a long time, the socket connection will also be disconnected. For this problem, add a heartbeat mechanism at the application layer. The client opens a thread to send a heartbeat packet every certain time, and the server sets the timeout time of the capture slightly longer than the heartbeat packet time interval (2 times are good). If the data packet is not received within the timeout, it means that the client has a problem and is considered to have disconnected, which needs to trigger the automatic reconnection mechanism.

[0115] 6. Socket connection is a persistent long connection in an ideal network environment, but the actual network environment is complex, and various network problems such as network jitter and route downtime can cause the socket connection to be passively disconnected, which also needs to trigger the automatic reconnection mechanism.

[0116] 7. The signaling device needs to use nio asynchronous non-blocking mode, for example, java uses netty, to ensure high availability of signals.

[0117] 8. On the premise of ensuring signal stability, time synchronization can be achieved through the following logic.

[0118] Assuming that the a device has a time srcTime, the time on the b device can be converted according to the following formula:

[0119] ```

[0120] var diffTime=resp_time-req_time;

[0121] var msgDelay=(reqDelay+respDelay) / 2;

[0122] var tarTime=srcTime+diffTime+msgDelay;

[0123] ```

[0124] Where req_time is the request end time, resp_time is the response end time, reqDelay is the request delay, and respDelay is the response delay.

[0125] In one specific embodiment, the signaling device is connected to each of the display devices, and the display devices are collected and aggregated, and the terminal with the shortest spatial distance is aggregated to a signaling device.

[0126] In the example embodiment, the signaling device is connected to each terminal, and the application and client are collected and aggregated, and the terminal with the shortest spatial distance is aggregated to a signaling device, which can minimize signal delay and loss.

[0127] In the example embodiment, referring to Figure 5 As shown in the figure, after the terminal device (display device) is connected to the network, the control device judges whether the display device is in the display device group of the configuration number; if not, it waits until the control device binds the client to the display device group until the control device is successfully bound with the display device, and after the binding is successful, the control device obtains the signaling device to be connected from the application server, and if yes, the control device directly obtains the signaling device to be connected from the application server. After the connection is completed, the control device judges whether the display device has obtained the address of the signaling device of the device group, if yes, the display device is connected with the signaling device and connected to the device group network, and if not, the address of the signaling device with the most idle connection number and the closest distance is returned, and the display device is reconnected to the signaling device corresponding to the address of the signaling device, and then connected to the device group network.

[0128] In a specific embodiment, the method further comprises: obtaining a first time at which the playing device sends the to-be-played material and the playing instruction to the display device, and a second time at which each display device receives the to-be-played material and the playing instruction; and calculating the communication time between the second time of each display device and the first time by using a smoothing function, so as to realize the consistency of the second time of each display device, and further realize time synchronization.

[0129] In a specific embodiment, the method further comprises: configuring a heartbeat mechanism for the control device, the heartbeat mechanism being used for sending a heartbeat packet to the display device at a regular time; and receiving a heartbeat packet feedback by the control device, and when the time length of the received heartbeat packet is greater than a predetermined time length, it is determined that the current display device is offline, and the control device reconnects the display device.

[0130] In the example embodiment, each terminal and the signaling device communicate multiple times, and the time of each sending and receiving and the machine time of each terminal are recorded. The communication time between each terminal and the control terminal is calculated by using a smoothing function, so as to realize time synchronization.

[0131] In the example embodiment, referring to Figure 6 As shown in the figure, after the display device is connected to the display device group network, the machine time difference and the signal delay of the display device are obtained, the control device judges whether the time difference and the delay data exist, if yes, it is ready to play; if not, the display device and the signaling device exchange probe empty data packets, and the delay error is calculated by using a smoothing function until the delay error is less than a target error (the target error is 10 ms), and then the display device and the signaling device are precisely time-synchronized, the time difference and the signal delay of the display device are calculated and saved, and it is judged again whether the time difference and the delay data exist, if yes, it is ready to play.

[0132] In an embodiment, the linkage display system further comprises an application server; the application server is configured to store the material identifier of the to-be-played material and the to-be-played material corresponding to the material identifier into a cloud database; the display device requests the to-be-played material corresponding to the material identifier from the application server, and performs secondary cutting and positioning on the to-be-played material, and the display device plays the to-be-played material after secondary cutting and positioning.

[0133] In the example embodiment, the display device requests the corresponding material from the sending device according to the column interval and the row interval sent by the control device, the sending device obtains the to-be-played material corresponding to the material identifier from the application server and sends the to-be-played material to the display device, the display device performs secondary cutting and positioning on the material and re-draws the material on the display device.

[0134] In an embodiment, the control device is provided with a cloud computing module, and the application server is configured to store the material identifier of the to-be-played material and the to-be-played material corresponding to the material identifier into a cloud database, including: the cloud computing module processes the to-be-played material by using an FFMpeg function to obtain a picture sequence corresponding to the to-be-played material; and the application server stores the material identifier and the picture sequence corresponding to the to-be-played material in the cloud database. The material identifier is the storage location of the picture sequence in the cloud database.

[0135] In the example embodiment, the control device can upload and manage the to-be-played material. The to-be-played material uploaded by the control device needs to be processed by a media processing middleware before being uploaded to the cloud database for use by the device. After the to-be-played material is uploaded, the media processing middleware is triggered automatically to analyze the media material, cut the media material into blocks, and then merge the blocks. The file binary data is stored in the cloud database, and the corresponding cutting files and file information are stored in the cloud database connected to the application server.

[0136] In an embodiment, the plurality of display devices are single display devices or a plurality of display devices formed by a plurality of display screens arranged in an array. When the display devices are a plurality of display devices formed by a plurality of display screens arranged in an array, the control device, in response to receiving a play instruction for a to-be-played material, sends the play instruction to the plurality of display devices, including: the control device creates a device group of the display devices, and obtains an arrangement mode of the display devices; the control device obtains a row interval and a column interval of the display devices corresponding to the arrangement mode based on the arrangement mode of the display devices, and sends the row interval and the column interval to the display devices.

[0137] In a specific embodiment, when the display device is a plurality of display devices arranged by a plurality of display screen arrays, the control device acquires the row spacing and the column spacing of the display device corresponding to the arrangement mode of the display device based on the arrangement mode of the display device, and sends the row spacing and the column spacing to the display device, including: calculating display parameters and material parameters based on the self parameters of the display device and the arrangement mode of each display screen, wherein the display parameters include: column number, row number, column spacing, row spacing, device serial number, and the material parameters include: material width, material height; and the display device draws the material to the screen of the display device by using a local canvas or openGL.

[0138] In the example embodiment, when the client requests a resource, a parameter suffix is added to the resource address (url) to request only the cut resource corresponding to the client, so as to save bandwidth and file cache size. For example, a picture resource address is resRawUrl+"process=image / crop, "+x_120, y_120, w_50, h_50, resRawUrl is the original address of the resource, and the numbers after x, y, w and h represent the horizontal coordinate, vertical coordinate, width and height of the target material to be cut.

[0139] After the client obtains the resource, the resource is displayed or played according to the device parameters. For example, for the display of the material or picture resource in a matrix combination, the horizontal coordinate, vertical coordinate, width and height (x, y, w, h) of the local cutting need to be calculated.

[0140] ```

[0141] let imgWidth=frameWidth / col_count;

[0142] let imgHeight=frameHeight / row_count;

[0143] const colGutterLength=imgWidth*colGutter;

[0144] const rowGutterLength=imgHeight*rowGutter;

[0145] const colGutterOcupiedPerBlock=

[0146] ((col_count-1)*colGutterLength) / col_count;

[0147] const rowGutterOcupiedPerBlock= (row_count-1)*rowGutterLength / row_count;

[0148] ((row_count-1)*rowGutterLength) / row_count;

[0149] const index0 = cid-1;

[0150] const iRow = Math.floor(index0 / col_count);

[0151] const iCol = index0 % col_count;

[0152] const x = round((colGutterOcupiedPerBlock*iCol) / col_count);

[0153] const y = round((rowGutterOcupiedPerBlock*iRow) / row_count);

[0154] const w = round(imgWidth-colGutterOcupiedPerBlock);

[0155] const h = round(imgHeight-rowGutterOcupiedPerBlock);

[0156] ```

[0157] Where the display parameters: col_count (number of columns), row_count (number of rows), colGutter (column spacing), rowGutter (row spacing), cid (device serial number), material parameters: frameWidth (material width), frameHeight (material height).

[0158] Finally, the drawing link, according to the frame parameters calculated in the last step, can use the local canvas (canvas) or openGL to draw the material to the screen. At the same time, you can add different special effects to the display picture according to your needs, such as adjusting the material or picture through the shader of openGL, splitting the screen display, adding particle effects, superimposing special effects, etc.

[0159] In an embodiment, the method further comprises: cutting the to-be-played material into a plurality of material segments; the display device divides a screen combination thereof into a plurality of regions, the regions corresponding to the material segments one by one; and uploading the corresponding material segments to the regions respectively, so as to play the corresponding material segments in the regions, and thus play the to-be-played material on the screen of the display device.

[0160] In an embodiment, the material segments include any one or at least one of audio, video, picture, and text.

[0161] In an embodiment, for device linkage, in addition to general material, there is also combined material. The combined material divides a screen combination into a plurality of regions, and uploads material to each region separately, so as to realize super-high resolution or infinite resolution, meet different playing requirements, and save resource space. The combined material has the following characteristics when implemented: the sub-materials of the combined material can be the same as other material types, such as audio, video, picture, text, or other types. The capacity of the combined material is assetCount=scol*srow, where scol is the number of columns of the combined material, and srow is the number of rows of the combined material. The combined material can be applied to any screen combination, but when the number of columns scol or the number of rows srow of the combined material is equal to the number of columns col_count or the number of rows row_count of the target device, the material exceeding the number of columns or the number of rows of the device will be ignored. For the case where the number of columns or the number of rows is less than the number of columns or the number of rows of the device, the sub-materials are evenly distributed to each device, and then the client cuts the resources. The cutting method is similar to the above-mentioned "material cutting" part, and thus is not described herein again.

[0162] In an embodiment, before receiving the playing instruction, the display device further acquires the row spacing and the column spacing, and requests the application server for the playing instruction and the picture sequence corresponding to the playing instruction based on the row spacing and the column spacing, so as to play the to-be-played material.

[0163] In an embodiment, the control device is further configured to set a playing parameter of the display device, where the playing parameter includes at least one of adding and managing a playing list, setting a single-screen or multi-screen playing mode, adding a playing item, and modifying a playing option; and the control device is further configured to send the playing parameter to the display device, so that the display device plays the to-be-played material according to the playing parameter.

[0164] In a specific embodiment, the display device is provided with a synchronization module; the synchronization module is configured to calculate the frame corresponding to the material to be played by the display device according to the play instruction and the inherent refresh frequency of the display device after the display device receives the play instruction; and the display device plays the material to be played based on the frame corresponding to the material to be played by the display device.

[0165] Referring to Figure 7 As shown, after the media material to be played is prepared to be played on the display device, a play instruction is requested, the instant play instruction and the scheduled play instruction are checked, it is determined whether there is a valid play instruction, if not, the instruction is waited for, and it is determined whether the instant play instruction or the scheduled play instruction is received, if not, the waiting continues until the play instruction or the scheduled play instruction is received, then the play list is acquired, and the actual play time is calculated according to the time difference of the signal device and the signal time stamp, the target material to be played is calculated, then the display device requests the material cutting data, and the current frame of the target material is calculated, the display device cuts the material according to the above data, and plays the cut material.

[0166] In the example embodiment, the actual situation of frame synchronization can be variable and complex, different network or device situations need to be considered, different play requirements need to be considered, and corresponding data analysis and conversion need to be completed, but the basic idea is consistent.

[0167] In the example embodiment, the basic principle is that assuming that the terminal has a stable and reliable time clock locally, the instruction time or time period can be uniformly corresponded to the time clock. It is a relatively appropriate choice to use the screen refresh time as the terminal local time clock, because the continuous display of the picture is based on the completion of the screen refresh.

[0168] In the example embodiment, the basic formula of frame synchronization calculation is: var frameIndex = frameRate * timeElapsed + startIndex. Wherein the corresponding meanings of the parameters are: frameRate is the play frame rate, timeElapsed is the time elapsed from the start of the play instruction to now, and startIndex is the target starting frame to be played.

[0169] In the example embodiment, the premise of frame synchronization is time synchronization. Only in the case of ensuring time synchronization, the target time commandTime of the instruction can be corresponded to the consistent device time deviceTime.

[0170] In the example embodiment, the material linkage display method provided by the present application is used among multiple display devices or playing devices, without connecting through wires among devices or being in a local area network, but only connecting to the Internet individually, using the synchronization algorithm with the cloud server to realize the segmentation and combination of the display device to the picture and the synchronous playing of the sound. The multiple devices play in sequence or synchronously, including but not limited to video, audio, picture, text, webpage or other forms. After the device is online at any time, the synchronization information is corrected with the cloud server again, and then the device can continue to play synchronously with other terminal devices. The terminal device and the control terminal can be interconnected, intercommunicated and interacted at any time, and the information can be transmitted and interacted among the devices. The space interval between the display devices can be set, and the display devices will also be cut and matched accordingly, without repeated downloading and caching of media materials. The terminal device can switch between individual playing and combination playing at any time according to the control instruction. It is calculated that the synchronization playing error of each display device provided by the present application is between 20ms and 200ms.

[0171] In the example embodiment, the control device creates a display device group and selects the arrangement combination of various display devices. For example, if the devices arranged in a matrix have m columns and n rows, there are (m) x (n) devices in total, and the column interval and row interval between the devices can also be set. The display device requests the corresponding material from the transmitting device according to the column interval and row interval returned by the control device, the transmitting device obtains the corresponding media material to be played from the cloud database through the application server and sends it to the display device, the display device performs secondary cutting and positioning on the material and then redraws it on the terminal device. The control device can upload and manage the material, and the uploaded material needs to pass through the media processing middleware before being uploaded to the cloud storage server for use by the device end. After the media material is uploaded, the media processing middleware is automatically triggered to analyze, cut and merge the media material. The file binary data is stored in the cloud storage module, and the corresponding cutting file and file information are stored in the cloud database connected with the application server. The control device can add and manage the play list, set the single-screen or multi-screen play mode, add the play item, modify the play option, and the like. The control device can add and manage the scheduled task and apply the play list, so that different display device groups and different display devices can play the specified content at the specified time. The play or control instruction of the control device needs to be synchronized to each display device, and first, the time synchronization of the control device, the transmitting device and the display device needs to be performed to ensure that the clocks of all terminals are calibrated. First, the transmitting device is connected to each terminal display device, and each transmitting device and each display device is collected and aggregated, and the terminals with the closest spatial distance are aggregated on one transmitting device, so that the signal delay and loss can be minimized. At the same time, the aggregation connection configuration information of the display device each time is recorded and broadcast to all transmitting devices, so that the display device can still be connected to the same transmitting device when it is online at any time. The display device and the transmitting device communicate multiple times, respectively record the sending and receiving time each time, and the machine time of each terminal, and measure the communication time of each terminal and the control end through the smoothing function, so as to realize the time synchronization. The play device end needs to cooperate with other devices to play the same or related content, and in addition to the time synchronization, the frame synchronization is also needed; the display device measures the target material and the corresponding frame of the target material according to the instruction time, the local time and the inherent refresh frequency of the local machine after receiving the control instruction, and then plays. After the display device is online at any time, the time synchronization and the frame synchronization need to be completed, and then the corresponding content is played according to the instruction.

[0172] The computer system 300 according to this embodiment of the application will be described below with reference to Figure 3 Figure 3 ​The computer system 300 shown is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of the present invention.

[0173] like Figure 3 As shown, the computer system 300 is presented in the form of a general-purpose computing device. The components of the computer system 300 may include, but are not limited to: at least one processing unit 310, at least one storage unit 320, and a bus 330 connecting different system components (including storage unit 320 and processing unit 310).

[0174] The storage unit stores program code that can be executed by the processing unit 310, causing the processing unit 310 to perform the steps described in the "Exemplary Methods" section of this specification according to various exemplary embodiments of the present invention. For example, the processing unit 310 can perform actions such as... Figure 1 In step S101, the control device, in response to receiving a playback instruction for the material to be played, sends the playback instruction to the plurality of display devices. The playback instruction includes: the sending time of the playback instruction by the control device and the material identifier of the material to be played. In step S102, after receiving the playback instruction, the display device obtains the material to be played based on the material identifier, calculates the time difference between the sending time in the playback instruction and the current time, determines the playback position of the material to be played based on the time difference, and plays the material to be played from the playback position.

[0175] Storage unit 320 may include readable media in the form of volatile storage units, such as random access memory (RAM) 3201 and / or cache memory 3202, and may further include read-only memory (ROM) 3203.

[0176] Storage unit 320 may also include a program / utility 3204 having a set (at least one) program module 3205, such program module 3205 including but not limited to: operating system, one or more application programs, other program modules and program data, each or some combination of these examples may include an implementation of a network environment.

[0177] Bus 330 can represent one or more of several types of bus structures, including a memory cell bus or memory cell controller, a peripheral bus, a graphics acceleration port, a processing unit, or a local bus using any of the various bus structures.

[0178] Computer system 300 can also communicate with one or more external devices 200 such as a keyboard or pointing device, a Bluetooth device, etc.; one or more devices that enable a user to interact with computer system 300; and / or one or more devices that enable computer system 300 to communicate with one or more other computing devices. Such communication can occur via input / output (I / O) interfaces 350. Still yet, computer system 300 can communicate with one or more networks such as a local area network (LAN), a general wide area network (WAN), and / or a public network (e.g., the Internet) via network adapter 360. As depicted, network adapter 360 communicates with the other components of computer system 300 via bus 330. It should be appreciated that although not shown, other hardware and / or software modules could be used in conjunction with computer system 300. Examples, include, but are not limited to, microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data archival storage systems, etc.

[0179] Those skilled in the art will readily understand that the example embodiments described herein can be implemented by software and / or by software in combination with the requisite hardware. Thus, the technical solutions according to the embodiments of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash disk, a mobile hard disk, etc.) or a network, and includes a number of instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to perform the methods according to the embodiments of the present disclosure.

[0180] In the example embodiments of the present disclosure, a computer readable storage medium is also provided, which stores a program product capable of implementing the above-mentioned methods. In some possible embodiments, various aspects of the present disclosure can also be implemented in the form of a program product, which includes program codes for causing a terminal device to perform the steps described in the above-mentioned “example method” section according to various example embodiments of the present disclosure when the program product is run on the terminal device.

[0181] Reference Figure 4 As shown, a program product 400 for implementing the above-mentioned methods according to the embodiments of the present disclosure is described, which can adopt a portable compact disc read-only memory (CD-ROM) and include program codes, and can be run on a terminal device, such as a personal computer. However, the program product of the present disclosure is not limited to this, and in this document, the readable storage medium can be any tangible medium containing or storing a program, which can be used or combined with an instruction execution system, device, or apparatus.

[0182] The program product can employ any combination of one or more computer-readable media. The computer-readable media can be a computer-readable storage medium or a computer-readable signal medium. The computer-readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0183] The computer-readable signal medium can include a computer-readable storage medium that is configured to store and deliver a computer-readable program code. The computer-readable program code can be propagated as a computer-readable signal medium.

[0184] The program code embodied on the computer-readable media can be transmitted using any appropriate medium, including but not limited to wireless, wired, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0185] The program code for carrying out operations of the present application can be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C++, etc., and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computing device, partly on the user's computing device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device or entirely on the remote computing device or server. In the latter scenario, the remote computing device can be connected to the user's computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computing device, such as through the Internet using an Internet Service Provider. The present application can be implemented as a computer program product, which can include a computer-readable medium having stored computer program code.

[0186] In addition, the above-described flowcharts are merely illustrative of the processes included in the method according to the exemplary embodiments of the present application, and are not intended to limit the present application. It is readily understood that the processes shown in the above-described flowcharts do not indicate or limit the time sequence of the processes. In addition, it is readily understood that the processes can be executed synchronously or asynchronously, for example, in a plurality of modules.

[0187] Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the features disclosed herein. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

[0188] It should be understood that the present disclosure is not limited to the precise structures herein described and illustrated in the drawings, and that various modifications and changes can be made without departing from its scope. The scope of the present disclosure is limited only by the claims that follow.

Claims

1. A method for linked display of materials, characterized in that, Applied to a linkage display system, the linkage display system comprising: a control device and multiple display devices, the method comprising: In response to receiving a playback instruction for the material to be played, the control device sends the playback instruction to the plurality of display devices. The playback instruction includes: the time when the control device sends the playback instruction and the material identifier of the material to be played. The control device responds to receiving a playback instruction for the material to be played by sending the playback instruction to multiple display devices, including: the control device responds to receiving and acquiring the material to be played; the control device performs segmentation and analysis processing on the material to be played to obtain the playback instruction; and the control device sends the playback instruction to multiple display devices. The control device performs segmentation and analysis on the material to be played to obtain the playback instruction, including: obtaining the characteristics of the material to be played through the ffprobe function of FFMpeg, wherein the characteristics include material type, duration, audio, and material track information; generating a playback instruction for the material to be played based on the characteristics of the material to be played; the linkage display system further includes: a signal transmitting device; the method further includes: the signal transmitting device sending the playback instruction generated by the control device to the display device for the display device to play the material to be played; before the control device responds to receiving the playback instruction for the material to be played, the method further includes: the control device and / or the display device adjusting the current time of the device to synchronize the time of the control device with that of each display device; the signal transmitting device is connected to each display device respectively, and aggregates and gathers each display device, thereby aggregating the terminals with the closest spatial distance to one signal transmitting device; After receiving the playback command, the display device obtains the material to be played based on the material identifier, calculates the time difference between the sending time in the playback command and the current time, determines the playback position of the material to be played based on the time difference, and plays the material to be played from the playback position.

2. The material linkage display method according to claim 1, characterized in that, Determining the playback position of the material to be played based on the time difference includes: The position corresponding to the first duration after the start position of the material to be played is determined as the playback position of the material to be played, and the first duration is equal to the time difference.

3. The material linkage display method according to claim 1, characterized in that, The linked display system also includes: a storage device, on which various materials are stored; The display device obtains the material to be played based on the material identifier, including: The display device retrieves the material to be played corresponding to the material identifier from the storage device.

4. The material linkage display method according to claim 1, characterized in that, The method further includes: The first time the playback device sends the material to be played and the playback command to the display device, and the second time each of the display devices receives the material to be played and the playback command; The communication time between each of the second times and the first time is calculated by a smoothing function in order to achieve consistency of the second times corresponding to each of the display devices, thereby achieving time synchronization; Configure a heartbeat mechanism for the control device, the heartbeat mechanism being used to periodically send heartbeat packets to the display device; The control device receives heartbeat feedback. If the duration of the received heartbeat exceeds a predetermined duration, it is determined that the current display device is offline, and the control device reconnects to the display device.

5. The material linkage display method according to claim 1, characterized in that, The linked display system also includes an application server; The application server is used to store the material identifier of the material to be played and the material to be played corresponding to the material identifier in the cloud database; The display device requests the material to be played corresponding to the material identifier from the application server, performs secondary cutting and positioning on the material to be played, and then plays the material to be played after secondary cutting and positioning. The control device is equipped with a cloud computing module, and the application server is used to store the material identifier of the material to be played and the material to be played corresponding to the material identifier in the cloud database, including: The FFMpeg function of the cloud computing module processes the material to be played to obtain the image sequence corresponding to the material to be played. The application server stores the material identifier and the image sequence of the material to be played corresponding to the material identifier in the cloud database.

6. The material linkage display method according to claim 5, characterized in that, The material identifier is the storage location of the image sequence in the cloud database; Multiple display devices can be individual display devices or multiple display devices formed by an array of multiple display screens; When the display device is a plurality of display devices formed by arranging a plurality of display screens, the control device, in response to receiving a playback instruction for the material to be played, sends the playback instruction to the plurality of display devices, including: The control device creates a device group for the display devices and obtains the arrangement of the display devices; The control device obtains the row spacing and column spacing of the display device corresponding to the arrangement of the display device, and sends the row spacing and column spacing to the display device.

7. The material linkage display method according to claim 6, characterized in that, When the display device is a plurality of display devices arranged in an array of multiple display screens, the control device, based on the arrangement of the display devices, obtains the row spacing and column spacing of the display devices corresponding to the arrangement, and sends the row spacing and column spacing to the display devices, including: Based on the display device's own parameters and the arrangement of each display screen, display parameters and material parameters are calculated. The display parameters include: number of columns, number of rows, column spacing, row spacing, and device serial number. The material parameters include: material width and material height. The display device uses a local canvas or OpenGL to draw the material onto the screen of the display device. The method further includes: The material to be played is cut into multiple material segments; The display device divides its screen into several areas, each area corresponding to a material segment; it uploads the corresponding material segment to each area for playing the corresponding material segment within that area, thereby enabling the display device to play the material to be played on the screen; wherein, the material segment includes any one or at least one of audio, video, images, and text.

8. The material linkage display method according to claim 7, characterized in that, Before receiving the playback command, the display device in step [of the process] further includes: The display device obtains the display device serial number, row spacing, and column spacing, and requests the playback instruction and the corresponding material segment from the application server based on the display device serial number, row spacing, and column spacing, so as to play the material to be played.

9. The material linkage display method according to claim 1, characterized in that, The control device is also used to set the playback parameters of the display device, wherein the playback parameters include at least one of the following: adding and managing playlists, setting single-screen or multi-screen playback modes, adding playback items, and modifying playback options; The control device is also used to send the playback parameters to the display device, so that the display device plays the material to be played according to the playback parameters; The display device is equipped with a synchronization module; The synchronization module is used to calculate the frame corresponding to the playback material of the display device based on the playback instruction and the inherent refresh rate of the current display device after the display device receives the playback instruction. The display device plays the material to be played based on the frames corresponding to the display device playback material.

Images