Image Display Method and Device
By acquiring and dividing image identification information, generating timestamps and performing time synchronization, the problem of out-of-synchronization of sub-image display of splicing large-screen devices is solved, and synchronous display is realized and user experience is improved.
Patent Information
- Application Number
- CN202010699375.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-07-20
- Publication Date
- 2025-07-18
- Estimated Expiration
- 2040-07-20
AI Technical Summary
In the prior art, the splicing large-screen device is out of synchronization when displaying the decoded sub-images of the decoding end device, resulting in a problem of tearing the screen.
By obtaining the identification information and frame identification information of the currently displayed frame image, the image is divided and sub-image is generated, and the reference time synchronization of the decoding terminal device is used to generate time stamps and frame identification information to ensure that the sub-image is displayed synchronously on the target display.
The synchronous display of sub-images of spliced large-screen devices is realized, which improves the user's image viewing experience and avoids picture tearing.
Smart Images

Figure CN111949237B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of image processing, and in particular, to an image display method and apparatus. Background Art
[0002] In the prior art, an external large-screen system is usually used to perform split-screen display on the images of an image source. The external large-screen system includes an image source, a server such as an image processing server, a decoding device, and an external large-screen device. The external large-screen device can be formed by splicing multiple displays, and each display is called a split screen. Multiple split screens can form a large screen. Therefore, the external large-screen device can be divided into at least one large screen. Among them, each split screen is connected to the decoding device through a video cable; each decoding device is connected to the image processing server through a network cable.
[0003] The process of performing split-screen display on the images of an image source by using an external large-screen system is as follows: After the image processing server acquires the images of at least one image source, each image is divided to generate multiple sub-images, and each sub-image is encoded to generate an encoded sub-image, and then each encoded sub-image is respectively sent to the decoding device, and after being decoded by the decoding device, it is sent to the corresponding display for display. The multiple sub-images generated after dividing the image of one image source acquired by the image processing server at the same time logically form a complete image as a whole. In this case, the synchronization of each sub-image during the display process will directly affect the display effect in the spliced large screen. However, due to problems such as network transmission delay and processor scheduling in the image processing server, there often occurs a situation where the spliced large-screen device displays the sub-images decoded by the decoding device asynchronously, resulting in screen tearing. Summary of the Invention
[0004] Embodiments of the present disclosure provide an image display method and apparatus, which can solve the problem that the spliced large-screen device displays the sub-images decoded by the decoding device asynchronously, resulting in screen tearing in the prior art. The technical solutions are as follows:
[0005] According to a first aspect of the embodiments of the present disclosure, an image display method is provided, and the method includes:
[0006] Obtain at least one current frame image to be displayed, first identification information of the image source of the current frame image to be displayed, and frame identification information of the current frame image to be displayed;
[0007] Divide each of the current frame images to be displayed to generate at least one current sub-image;
[0008] Synchronize the time of the decoding devices of at least one display using a reference time;
[0009] Generate a timestamp for each of the current sub-images;
[0010] Send the current sub-image, the timestamp, the first identification information, and the frame identification information to a target decoding device corresponding to a target display device, so that the target decoding device can send the current sub-image to the target display according to the timestamp, the reference time, and the frame identification information. The target decoding device is a decoding device of the target display corresponding to the image source of the frame image to be displayed.
[0011] The image display method provided by the embodiments of the present disclosure can obtain at least one current frame image to be displayed, the first identification information of the image source of the current frame image to be displayed, and the frame identification information of the current frame image to be displayed; divide each current frame image to be displayed to generate at least one current sub-image; synchronize the clocks of the decoding devices of at least one display using a reference time; generate a timestamp for each current sub-image; send the current sub-image, the timestamp, the first identification information, and the frame identification information to a target decoding device, so that the target decoding device can send the current sub-image to the target display according to the timestamp, the reference time, and the frame identification information. The target decoding device is a decoding device of the target display corresponding to the image source of the frame image to be displayed, which can synchronize the clocks of the decoding devices of at least one display, avoiding the situation in the prior art where the sub-images decoded by the decoding device of the tiled large-screen device are displayed asynchronously, resulting in picture tearing, and improving the user's image viewing experience.
[0012] In one embodiment, before generating the timestamp for each sub-image, the method further includes:
[0013] Encode the current sub-image to generate an encoded current sub-image;
[0014] The step of sending the current sub-image and the timestamp to the target decoding device includes:
[0015] Send the encoded current sub-image and the timestamp to the target decoding device.
[0016] By encoding the current sub-image and sending the encoded current sub-image to the target decoding device, the data volume of the current sub-image during transmission can be reduced, and at the same time, the security of the current sub-image during transmission is improved.
[0017] In one embodiment, the method further includes:
[0018] Receive an image display instruction sent by a user device, where the image display instruction includes at least first identification information of an image source of at least one currently to-be-displayed frame image and second identification information of a display to which the currently to-be-displayed frame image is to be displayed;
[0019] Determine a target display corresponding to the image source of each currently to-be-displayed frame image according to the image instruction.
[0020] By receiving the image display instruction sent by the user device, it is possible to determine a target display corresponding to the image source of each currently to-be-displayed frame image according to the image instruction, and then display the currently to-be-displayed frame image through the target display.
[0021] According to a second aspect of the embodiments of the present disclosure, there is provided an image display method, and the method includes:
[0022] Receive at least one current sub-image sent by a server, a time stamp of the current sub-image, and frame identification information of the currently to-be-displayed frame image, where the current sub-image is generated after the server divides the currently to-be-displayed frame image;
[0023] If it is determined that a time difference between the time stamp of the current sub-image and the current time is less than or equal to a preset time threshold, receive frame identification information of other to-be-displayed images broadcast by other decoding end devices, where the other decoding end devices are decoding end devices other than the target decoding end device;
[0024] Determine target frame identification information according to the frame identification information of the currently to-be-displayed frame image and the frame identification information of other to-be-displayed frame images;
[0025] If it is determined that the frame identification information of the to-be-displayed frame image is consistent with the target frame identification information, send the current sub-image to the target display so that the target display displays the current sub-image.
[0026] The image display method provided by the embodiments of the present disclosure can receive at least one current sub-image sent by a server, a time stamp of the current sub-image, and frame identification information of the current frame image to be displayed. The current sub-image is generated after the server divides the current frame image to be displayed. If it is determined that the time difference between the time stamp of the current sub-image and the current time is less than or equal to a preset time threshold, then receive the frame identification information of other images to be displayed broadcast by other decoding end devices. Determine target frame identification information according to the frame identification information of the current frame image to be displayed and the frame identification information of other images to be displayed. If it is determined that the frame identification information of the image to be displayed is consistent with the target frame identification information, then send the current sub-image to the target display so that the target display can display the current sub-image, which can achieve the synchronization of the picture, avoid the situation of asynchronous display of the sub-images decoded by the decoding end device by the splicing large screen device in the prior art, resulting in picture tearing, and improve the user's image viewing experience.
[0027] In one embodiment, the frame identification information is a frame number, and the method further includes:
[0028] If the frame identification information of the current frame image to be displayed is inconsistent with the target frame identification information and the frame number of the current frame image to be displayed is less than the target frame identification information, then discard the current sub-image and receive the next frame of sub-image sent by the server and the frame number of the next frame image to be displayed. The next frame of sub-image is generated after the server divides the next frame image to be displayed.
[0029] If the frame number of the next frame image to be displayed is consistent with the target frame identification information, then send the next frame of sub-image to the target display so that the target display can display the next frame of sub-image.
[0030] By discarding the current sub-image when the frame identification information of the current frame image to be displayed is inconsistent with the target frame identification information and the frame number of the current frame image to be displayed is less than the target frame identification information, it is possible to avoid the simultaneous display of sub-images of different frames on different displays, thereby avoiding the situation of image tearing and improving the user's viewing experience. By discarding the current sub-image, receiving the next frame of sub-image sent by the server and the frame number of the next frame image to be displayed, and when the frame number of the next frame image to be displayed is consistent with the target frame identification information, sending the next frame of sub-image to the target display, it is possible to make all displays display the sub-images of the same frame image, avoid the situation of image tearing, and improve the user's viewing experience.
[0031] In one embodiment, determining the target frame identification information according to the frame identification information of the current frame image to be displayed and the frame identification information of other images to be displayed includes:
[0032] Determine the number of identical frame numbers among the frame number of the currently to-be-displayed frame image and the frame numbers of other to-be-displayed frame images;
[0033] Use the frame number with the largest quantity as the target frame identification information.
[0034] By determining the number of identical frame numbers among the frame number of the currently to-be-displayed frame image and the frame numbers of other to-be-displayed frame images and using the frame number with the largest quantity as the target frame identification information, it is possible to determine the frame numbers of the sub-images that each display will soon display.
[0035] In one embodiment, the method further includes:
[0036] If the frame number of the currently to-be-displayed frame image is inconsistent with the target frame identification information and the frame number of the currently to-be-displayed frame image is greater than the target frame identification information, then receive the frame number of the other next to-be-displayed frame image broadcast by the other decoding end device;
[0037] If the frame number of the currently to-be-displayed frame image is consistent with the frame number of the other next to-be-displayed frame image, then send the current sub-image to the target display so that the target display can display the current frame sub-image.
[0038] By receiving the frame number of the other next to-be-displayed frame image broadcast by the other decoding end device when the frame identification information of the currently to-be-displayed frame image is inconsistent with the target frame identification information and the frame number of the currently to-be-displayed frame image is greater than the target frame identification information, and sending the current sub-image to the target display when the frame number of the currently to-be-displayed frame image is consistent with the frame number of the other next to-be-displayed frame image, it is possible to enable all displays to display the sub-images of the same frame, avoid the situation of image tearing, and improve the user's viewing experience.
[0039] In one embodiment, the current sub-image is the encoded current sub-image. After receiving the current sub-image sent by the server, the timestamp of the current sub-image, and the frame identification information of the currently to-be-displayed frame image, the method further includes:
[0040] Decode the current sub-image to generate the decoded current sub-image;
[0041] The step of sending the current sub-image to the target display includes:
[0042] Send the decoded current sub-image to the target display.
[0043] By decoding the sub-image to generate the decoded current sub-image, the current sub-image can be restored.
[0044] According to a third aspect of the embodiments of the present disclosure, there is provided an image display device, including:
[0045] A current frame image to be displayed acquisition module, configured to acquire at least one current frame image to be displayed, first identification information of an image source of the current frame image to be displayed, and frame identification information of the current frame image to be displayed;
[0046] A current frame image to be displayed partitioning module, configured to partition each of the current frame images to be displayed to generate at least one current sub-image;
[0047] A time synchronization module, configured to perform time synchronization on decoding end devices of at least one display using a reference time;
[0048] A timestamp generation module, configured to generate a timestamp for each of the current sub-images;
[0049] A current sub-image sending module, configured to send the current sub-image, the timestamp, the first identification information, and the frame identification information to a target decoding end device, so that the target decoding end device sends the current sub-image to the target display according to the timestamp and the reference time, where the target decoding end device is a decoding end device of a target display corresponding to the image source of the frame image to be displayed.
[0050] In one embodiment, the device further includes:
[0051] A sub-image encoding module, configured to encode the current sub-image to generate an encoded current sub-image;
[0052] The current sub-image sending module is configured to:
[0053] Send the encoded current sub-image and the timestamp to the target decoding end device.
[0054] In one embodiment, the device further includes:
[0055] A target display determination module, configured to:
[0056] Receive an image display instruction sent by a user device, where the image display instruction includes first identification information of an image source of at least one current frame image to be displayed and second identification information of a display to which the current frame image to be displayed is to be displayed;
[0057] Determine a target display corresponding to the image source of each of the current frame images to be displayed according to the image instruction.
[0058] According to a fourth aspect of the embodiments of the present disclosure, there is provided an image display device, including:
[0059] A current sub-image receiving module, configured to receive at least one current sub-image sent by a server, a time stamp of the current sub-image, and frame identification information of the current frame image to be displayed, where the current sub-image is generated by the server after dividing the current frame image to be displayed;
[0060] A frame identification information receiving module, configured to receive frame identification information of other frame images to be displayed broadcast by other decoding end devices if it is determined that a time difference between the time stamp of the current sub-image and the current time is less than or equal to a preset time threshold, where the other decoding end devices are decoding end devices other than the target decoding end device;
[0061] A target frame identification information determining module, configured to determine target frame identification information according to the frame identification information of the current frame image to be displayed and the frame identification information of other frame images to be displayed;
[0062] A current sub-image sending module, configured to send the current sub-image to the target display if it is determined that the frame identification information of the frame image to be displayed is consistent with the target frame identification information, so that the target display displays the current sub-image.
[0063] In one embodiment, the frame identification information is a frame number, and the apparatus further includes:
[0064] A next-frame sub-image sending module, configured to:
[0065] If the frame identification information of the current frame image to be displayed is inconsistent with the target frame identification information and the frame number of the current frame image to be displayed is less than the target frame identification information, discard the current sub-image and receive the next frame sub-image sent by the server and the frame number of the next frame image to be displayed, where the next frame sub-image is generated by the server after dividing the next frame image to be displayed;
[0066] If the frame number of the next frame image to be displayed is consistent with the target frame identification information, send the next frame sub-image to the target display, so that the target display displays the next frame sub-image.
[0067] In one embodiment, the target frame identification information determining module is configured to:
[0068] Determine the number of the same frame numbers among the frame numbers of the current frame image to be displayed and the frame numbers of other frame images to be displayed;
[0069] Use the frame number with the largest quantity as the target frame identification information.
[0070] In one embodiment, the current sub-image sending module is further configured to:
[0071] If the frame sequence number of the currently to-be-displayed frame image is inconsistent with the target frame identification information and the frame sequence number of the currently to-be-displayed frame image is greater than the target frame identification information, then receive the frame sequence number of the other next to-be-displayed frame image broadcast by the other decoding terminal device;
[0072] If the frame sequence number of the currently to-be-displayed frame image is consistent with the frame sequence number of the other next to-be-displayed frame image, then send the current sub-image to the target display so that the target display can display the current frame sub-image.
[0073] In one embodiment, the current sub-image is an encoded current sub-image, and the device further includes:
[0074] A current sub-image decoding module, configured to decode the current sub-image to generate a decoded current sub-image;
[0075] The current sub-image sending module is configured to:
[0076] Send the decoded current sub-image to the target display.
[0077] According to a fifth aspect of the embodiments of the present disclosure, there is provided a server, where the server includes a processor and a memory, and at least one computer instruction is stored in the memory, and the instruction is loaded and executed by the processor to implement the steps performed in the image display method described in the first aspect and any embodiment of the first aspect.
[0078] According to a sixth aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium, and at least one computer instruction is stored in the storage medium, and the instruction is loaded and executed by the processor to implement the steps performed in the image display method described in the first aspect and any embodiment of the first aspect.
[0079] According to a seventh aspect of the embodiments of the present disclosure, there is provided a decoding terminal device, where the decoding terminal device includes a processor and a memory, and at least one computer instruction is stored in the memory, and the instruction is loaded and executed by the processor to implement the steps performed in the image display method described in the second aspect and any embodiment of the second aspect.
[0080] According to an eighth aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium, and at least one computer instruction is stored in the storage medium, and the instruction is loaded and executed by the processor to implement the steps performed in the image display method described in the second aspect and any embodiment of the second aspect.
[0081] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. Description of the Drawings
[0082] The accompanying drawings herein are incorporated into and constitute a part of this specification, showing embodiments consistent with the present disclosure, and are used together with the specification to explain the principles of the present disclosure.
[0083] Figure 1 It is a structural diagram of an external large screen system provided by an embodiment of the present disclosure;
[0084] Figure 2 It is a flowchart of an image display method provided by an embodiment of the present disclosure Figure 1 ;
[0085] Figure 3 It is a flowchart of an image display method provided by an embodiment of the present disclosure Figure 2 ;
[0086] Figure 4 It is a flowchart of an image display method provided by an embodiment of the present disclosure Figure 3 ;
[0087] Figure 5 It is a flowchart of a pre - inspection method provided by an embodiment of the present disclosure;
[0088] Figure 6 It is the structure of an image display device provided by an embodiment of the present disclosure Figure 1 ;
[0089] Figure 7 It is the structure of an image display device provided by an embodiment of the present disclosure Figure 2 ;
[0090] Figure 8 It is the structure of an image display device provided by an embodiment of the present disclosure Figure 3 ;
[0091] Figure 9 It is the structure of an image display device provided by an embodiment of the present disclosure Figure 4 ;
[0092] Figure 10 It is a hardware structure diagram of a server provided by an embodiment of the present disclosure;
[0093] Figure 11 It is a hardware structure diagram of a decoding - end device provided by an embodiment of the present disclosure. Detailed implementation manners
[0094] Exemplary embodiments will be described in detail herein, and examples thereof are shown in the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. On the contrary, they are merely examples of apparatuses and methods consistent with some aspects of the present disclosure as detailed in the appended claims.
[0095] Figure 1 is a structural diagram of an external large screen system provided by the prior art. As Figure 1 shown, the system includes:
[0096] at least one image source 101, a server such as an image processing server 102, at least one decoding end device 103, an external large screen device 104, and a user device 105.
[0097] Among them, the external large screen device 104 includes multiple displays. The external large screen device 104 is formed by splicing multiple displays, and each display is called a split screen. For example Figure 2 shown, the external large screen device 104 includes eight split screens from A to H. Among them, multiple split screens can form a large screen. Therefore, the external large screen device can be divided into at least one large screen. Among them, each split screen is connected to the decoding end device 103 through a video cable; each decoding end device 103 is connected to the image processing server 101 through a network cable; the user device 105 is connected to the image processing server 102, and the user of the external large screen system can control the image processing server 102 on the user device 105.
[0098] The process of using the external large screen system to perform split screen display on the image of the image source is as follows: The image processing server 102 receives an image display instruction input by the user on the user device 105. The image display instruction includes the first identification information of the image source of at least one frame image to be displayed and the second identification information of the display to which the frame image to be displayed is to be displayed; after receiving the image display instruction, the image processing server 102 determines the target display corresponding to the image source of each current frame image to be displayed according to the image display instruction.
[0099] Further, after the image processing server 102 acquires the images of at least one image source 101, it divides the images of each image source, generates multiple sub-images, encodes each sub-image to generate an encoded sub-image, and then sends each encoded sub-image to the target decoding end device respectively. The target decoding end device decodes it and sends it to the target display corresponding to the image source for display.
[0100] The multiple sub-images generated after dividing the image of one image source collected by the image processing server at the same time as a whole constitute a logically complete image. In this case, the synchronization of each sub-image of the same image source during the display process will directly affect the display effect of the image of this image source on the splicing large screen. However, due to problems such as network transmission delay and processor scheduling in the image processing server, it often occurs that the splicing large screen device displays the sub-images decoded by at least one decoding end device out of sync, resulting in the tearing of the image screen of this image source.
[0101] The inventor noticed this problem and proposed an image display method as follows:
[0102] Figure 2 It is the flow of an image display method provided by an embodiment of the present disclosure Figure 1 , and this method is applied to a server, such as an image processing server. As Figure 2 shown, this method includes:
[0103] S201. Obtain at least one current frame image to be displayed, the first identification information of the image source of this current frame image to be displayed, and the frame identification information of this current frame image to be displayed;
[0104] S202. Divide each of this current frame image to be displayed to generate at least one current sub-image.
[0105] Exemplarily, the image processing server can receive an image display instruction sent by a user device, and this image display instruction includes the first identification information of the image source of at least one current frame image to be displayed and the second identification information of the display to which this current frame image to be displayed is to be displayed;
[0106] Further, after obtaining at least one current frame image to be displayed, the first identification information of the image source of this current frame image to be displayed, and the frame identification information of this current frame image to be displayed, the image processing server determines the target display corresponding to the image source of each of this current frame image to be displayed according to this image instruction. For example, as Figure 2 shown, if the user wants to display the current frame image of image source 1011 to four displays A, B, C, and D, the user can input an image display instruction on the user device, and this image display instruction includes at least the first identification information of the image source 1011 of the current frame image to be displayed and the second identification information of the four displays A, B, C, and D to which this current frame image to be displayed is to be displayed, and the user device sends this image display instruction to the image processing server.
[0107] After receiving the image display instruction, the image processing server obtains the current frame image to be displayed of the image source 1011, the first identification information of the image source 1011 of the current frame image to be displayed, and the frame identification information of the current frame image to be displayed, and determines that the target displays corresponding to the current frame image to be displayed are four displays A, B, C, and D according to the image display instruction and the first identification information of the image source 1011 of the current frame image to be displayed.
[0108] Further, the image processing server divides the current frame image to be displayed into four current sub-images, and the four sub-images can be respectively displayed on the four displays A, B, C, and D.
[0109] Exemplarily, after the current frame image to be displayed is divided into four current sub-images, each current sub-image is encoded to generate an encoded current sub-image.
[0110] S203: Synchronize the clock of the decoding end devices of at least one display using a reference time.
[0111] In one embodiment, the image processing server obtains the reference time from a Network Time Protocol (NTP) server, and sends the reference time to the decoding end devices of at least one display. At the same time, the clock information of the image processing server is updated to the reference time. After receiving the reference time, the decoding end devices of the at least one display send a first confirmation message to the image processing server, and at the same time, the clock information of each decoding end device of each display is updated to the reference time. The first confirmation message is used to confirm the reception of the reference time.
[0112] In another embodiment, the image processing server obtains the reference time from the NTP server, and calibrates the current time of the image processing server using the reference time. At the same time, after obtaining the reference time, the image processing server sends a time synchronization request to the decoding end devices of the at least one display. When the decoding end devices of the at least one display receive the time synchronization request, they return a second confirmation message to the image processing server. At the same time, the decoding end devices of the at least one display obtain the reference time from the NTP server, and calibrate the current time of each decoding end device of each display using the reference time. The second confirmation message is used to confirm the reception of the time synchronization request.
[0113] S204: Generate a timestamp for each of the current sub-images.
[0114] In this step, when the image processing server encodes each current sub-image to generate an encoded current sub-image, it also generates a timestamp for each encoded current sub-image.
[0115] S205. Send the current sub - image, the timestamp, the first identification information, and the frame identification information to the target decoding - end device so that the target decoding - end device can send the current sub - image to the target display according to the timestamp, the reference time, and the frame identification information. The target decoding - end device is the decoding - end device of the target display corresponding to the image source of the frame to be displayed.
[0116] In this step, the image - processing server sends each encoded current sub - image and the timestamp of the encoded current sub - image to the target decoding - end device so that the target decoding - end device can decode the encoded current sub - image according to the timestamp, the reference time, and the frame identification information, and send the decoded current sub - image to the target display. For example, the image - processing server sends 4 encoded sub - images of image source 1011 to four target decoding - end devices respectively connected to four target displays A, B, C, and D.
[0117] The image - display method provided by the embodiments of the present disclosure can obtain at least one current frame image to be displayed, the first identification information of the image source of the current frame image to be displayed, and the frame identification information of the current frame image to be displayed; divide each current frame image to be displayed to generate at least one current sub - image; synchronize the clocks of the decoding - end devices of at least one display using a reference time; generate the timestamp of each current sub - image; and send the current sub - image, the timestamp, the first identification information, and the frame identification information to the target decoding - end device so that the target decoding - end device can send the current sub - image to the target display according to the timestamp, the reference time, and the frame identification information. The target decoding - end device is the decoding - end device of the target display corresponding to the image source of the frame to be displayed. It can synchronize the clocks of the decoding - end devices of at least one display, avoiding the situation in the prior art where the spliced large - screen device displays the sub - images decoded by the decoding - end device out of sync, resulting in picture tearing, and improving the user's image viewing experience.
[0118] Next, in combination with Figure 3 the embodiments, an explanation will be given on how the target display processes the sub - images. Figure 3 is the flowchart of an image - display method provided by the embodiments of the present disclosure Figure 2 , and this method is applied to the target decoding - end device. As Figure 3 shown, this method includes:
[0119] S301. Receive at least one current sub - image, the timestamp of the current sub - image, and the frame identification information of the current frame image to be displayed sent by the server. The current sub - image is generated after the server divides the current frame image to be displayed.
[0120] Exemplarily, at least one current sub-image sent by a server, such as an image processing server, is an encoded current sub-image. After receiving the at least current sub-image, the target display decodes each current sub-image to generate a decoded current sub-image.
[0121] S302. If it is determined that the time difference between the time stamp of the current sub-image and the current time is less than or equal to a preset time threshold, receive the frame identification information of other to-be-displayed images broadcast by other decoding terminal devices, where the other decoding terminal devices are decoding terminal devices other than the target decoding terminal device;
[0122] S303. Determine the target frame identification information according to the frame identification information of the current to-be-displayed frame image and the frame identification information of other to-be-displayed frame images.
[0123] Exemplarily, the frame identification information is a frame number. If it is determined that the time difference between the time stamp of the current sub-image and the current time is less than or equal to a preset time threshold, and the target decoding terminal device determines the number of the same frame numbers from the frame number of the current to-be-displayed frame image and the frame numbers of other to-be-displayed frame images, and takes the frame number with the largest number as the target frame identification information.
[0124] For example, the frame number of the current to-be-displayed frame image is 4, and the frame numbers of other to-be-displayed frame images are 3, 3, 4, and 4 respectively. Then the number of the frame number 4 is 3, and the number of the frame number 3 is 2. Then the target frame identification information is 4.
[0125] Exemplarily, if it is determined that the time difference between the time stamp of the current sub-image and the current time is greater than the preset time threshold, the target decoding terminal device discards the current sub-image and waits to receive the next frame of sub-image sent by the image processing server.
[0126] S304. If it is determined that the frame identification information of the to-be-displayed frame image is consistent with the target frame identification information, send the current sub-image to the target display so that the target display can display the current sub-image.
[0127] For example, the frame number of the current to-be-displayed frame image is 4, and the frame numbers of other to-be-displayed frame images are 3, 3, 4, and 4 respectively. Then the number of the frame number 4 is 3, and the number of the frame number 3 is 2. Then the target frame identification information is 4, and the frame number of the current to-be-displayed frame image is consistent with the target frame identification information. Then the target decoding terminal device decodes the encoded current sub-image and sends it to the target display so that the target display can display the current sub-image.
[0128] Exemplarily, if the frame sequence number of the current frame image to be displayed is inconsistent with the target frame identification information and the frame sequence number of the current frame image to be displayed is less than the target frame identification information, the current sub-image is discarded and the next sub-image sent by the server and the frame sequence number of the next frame image to be displayed are received. The next sub-image is generated by the image processing server after partitioning the next frame image to be displayed. If the frame sequence number of the next frame image to be displayed is consistent with the target frame identification information, the next sub-image is sent to the target display so that the target display can display the next sub-image.
[0129] For example, the frame sequence number of the current frame image to be displayed is 3, and the frame sequence numbers of other frame images to be displayed are 3, 4, 4, 4 respectively. Then the number of frame sequence number 4 is 3, and the number of frame sequence number 3 is 2. So the target frame identification information is 4. Since the frame sequence number of the current frame image to be displayed is inconsistent with the target frame identification information and the frame sequence number of the current frame image to be displayed is less than the target frame identification information, the current sub-image is discarded and the next sub-image sent by the server and the frame sequence number of the next frame image to be displayed are received. If the frame sequence number of the next sub-image is 4, the next sub-image is sent to the target display so that the target display can display the next sub-image.
[0130] Another example, the frame sequence number of the current frame image to be displayed is 2, and the frame sequence numbers of other frame images to be displayed are 3, 4, 4, 4 respectively. Then the number of frame sequence number 4 is 3, the number of frame sequence number 3 is 1, and the number of frame sequence number 2 is 1. So the target frame identification information is 4. Since the frame sequence number of the current frame image to be displayed is inconsistent with the target frame identification information and the frame sequence number of the current frame image to be displayed is less than the target frame identification information, the current sub-image is discarded and the next sub-image sent by the server and the frame sequence number of the next frame image to be displayed are received. If the frame sequence number of the next sub-image is 3, the next sub-image is discarded and the sub-image to be displayed sent by the server later and the frame sequence number of the frame image to be displayed are received until the frame sequence number of the frame image to be displayed is consistent with the target frame identification information, and then the sub-image to be displayed is sent to the target display.
[0131] Exemplarily, if the frame sequence number of the current frame image to be displayed is inconsistent with the target frame identification information and the frame sequence number of the frame image to be displayed is greater than the target frame identification information, the frame sequence number of the next frame image to be displayed broadcast by the other decoding end device is received. If the frame sequence number of the current frame image to be displayed is consistent with the frame sequence number of the next frame image to be displayed by the other device, the current sub-image is sent to the target display so that the target display can display the current sub-image.
[0132] For example, if the frame number of the currently to-be-displayed frame image is 5, and the frame numbers of other to-be-displayed frame images are 4, 4, 4, and 4 respectively, then the number of frame numbers 4 is 4, and the number of frame numbers 5 is 1. Thus, the target frame identification information is 4. If the frame number of the currently to-be-displayed frame image is inconsistent with the target frame identification information and the frame number of the currently to-be-displayed frame image is greater than the target frame identification information, then receive the frame number 5 of the other next to-be-displayed frame image broadcast by the other decoding end device. If the frame number 5 of the currently to-be-displayed frame image is the same as the frame number 5 of the other next to-be-displayed frame image, then the target decoding end device decodes the encoded current sub-image and sends it to the target display so that the target display can display the current sub-image.
[0133] The image display method provided by the embodiments of the present disclosure can receive at least one current sub-image sent by a server, the timestamp of the current sub-image, and the frame identification information of the currently to-be-displayed frame image. The current sub-image is generated after the server divides the currently to-be-displayed frame image. If it is determined that the time difference between the timestamp of the current sub-image and the current time is less than or equal to a preset time threshold, then receive the frame identification information of other to-be-displayed images broadcast by other decoding end devices. Determine the target frame identification information according to the frame identification information of the currently to-be-displayed frame image and the frame identification information of other to-be-displayed frame images. If it is determined that the frame identification information of the to-be-displayed frame image is the same as the target frame identification information, then send the current sub-image to the target display so that the target display can display the current sub-image, which can achieve the synchronization of the screen, avoid the situation in the prior art where the sub-images decoded by the decoding end device are not synchronized when displayed on the splicing large screen device, resulting in screen tearing, and improve the user's image viewing experience.
[0134] The following Figure 4 embodiments are used to further elaborate on the image display method provided by the embodiments of the present disclosure in detail. Figure 4 is the flow of an image display method provided by the embodiments of the present disclosure Figure 3 As Figure 4 shown, the method includes:
[0135] S401. After the image processing server establishes connections with multiple decoding end devices in the splicing large screen system for image reception respectively, perform clock synchronization between all decoding end devices and the image processing server; meanwhile, all decoding end devices establish a multicast group;
[0136] To ensure that the reference times on the server side and in the splicing large screen system are the same, it is necessary to perform clock synchronization between the decoding end devices and the image processing server.
[0137] Specifically, there are many ways to implement clock synchronization between the decoding end device and the image processing server. In an alternative embodiment of the present invention, clock synchronization can be achieved through the following methods:
[0138] The image processing server obtains a reference time point (which can be obtained from an NTP server);
[0139] The image processing server sends the reference time point to multiple decoding end devices in the splicing large screen system;
[0140] After the image processing server receives the confirmation received messages sent by multiple decoding end devices, the image processing server updates the clock information of the image processing server to the reference time point. At the same time, multiple decoding end devices update the clock information of all decoding end devices to the reference time point.
[0141] In another alternative embodiment, clock synchronization can be achieved through the following methods:
[0142] The image processing server obtains a reference time from the NTP server and calibrates the time of the image processing server based on the obtained time; at the same time, the image processing server sends a time synchronization request to multiple decoding end devices. When the multiple decoding end devices receive the time synchronization request, they return a confirmation message to the image processing server. At the same time, the multiple decoding end devices obtain a reference time from the same NTP server and calibrate the time of all decoding end devices based on the obtained time.
[0143] S402. The image processing server divides the collected images to generate at least one sub-image, encodes each sub-image, and sends the encoded data packet to the decoding end device;
[0144] In order to achieve the purpose of image synchronization, the head of the data stream obtained by encoding each sub-image by the image processing server needs to be specially set. Specifically, a time stamp and an identification number (Identity document, ID) need to be added to the head; specifically, the time stamp is used to identify the current time; the ID is used to identify the current frame number and the serial number of the sub-image. The numbering rule of the head information in each sub-image is unified.
[0145] For example, the ID of the encoded data of the first sub-image after dividing the third frame image is: 3-1, and the ID of the encoded data of the second sub-image after dividing the third frame image is: 3-2, and so on.
[0146] The above is just an exemplary ID setting method. In actual applications, the ID setting rules can be adjusted as needed, as long as the set ID can include the frame number of the current image and the serial number of the current sub-image.
[0147] The image processing server sends the bitstream obtained by encoding each sub-image to its corresponding decoding device.
[0148] S403. After receiving the encoded data sent by the image processing server, the decoding device parses the timestamp and ID number from the encoded data;
[0149] S404. The decoding device performs pre-check processing on the encoded data according to the parsed timestamp, and decides whether to discard the current encoded data or send it to the decoding queue for decoding through the pre-check processing;
[0150] Since the expired encoded data has no value for processing, in order to prevent the expired encoded data from entering the decoding queue, therefore, pre-check processing is performed on the received encoded data to check whether the received encoded data has expired through the pre-check processing, and the expired encoded data is directly discarded; while the encoded data that is checked and not expired is sent to the decoding queue to wait for decoding processing.
[0151] The specific implementation manner of the pre-check is as Figure 5 shown, Figure 5 is a flowchart of a pre-check method provided by an embodiment of the present disclosure. As Figure 5 shown, the method includes:
[0152] S501. Calculate the difference between the current system time and the timestamp;
[0153] S502. Determine whether the difference is greater than a preset time threshold; if it is greater than the preset threshold, determine that the data packet is an expired data packet and directly discard the data packet; if it is not greater than the preset threshold, send the data packet to the decoding queue for processing.
[0154] Specifically, the data packet after pre-check processing will be inserted into the tail of the decoding queue and wait for decoding processing.
[0155] Specifically, the above preset threshold is a preset time threshold, which is determined according to the maximum tolerable time delay value of the system. Due to the existence of network delay, there is a time difference between the time when the encoded data of a sub-image is sent to the decoding device after being encoded by the image processing server and the time when the decoding device receives the encoded data. Without considering other issues, this time difference should be within a theoretical value range. For example, it can be set to 80ms, 90ms, 100ms, etc., and can also be set to other values according to needs. The higher the set value, the higher the tolerance of the system to delay. Correspondingly, the lower the set value, the lower the tolerance of the system to delay.
[0156] S405. The current decoding device sequentially retrieves the encoded data from the decoding queue for decoding; before the current decoding device decodes the current encoded data, it notifies the decoding device of the frame number included in the current data to be decoded through a multicast message; similarly, the decoding device also needs to notify the frame numbers included in their respective current data to be decoded to other decoding devices through the multicast message.
[0157] In actual implementation, the current decoding device can directly send the ID number in the data packet to other decoding devices through a multicast message, and other decoding devices can identify the current frame number from the received ID number; to save data volume, the current decoding device can also directly extract the current frame number from the ID number and notify other decoding devices of the current frame number through a multicast message.
[0158] S406. All decoding devices perform synchronization processing according to the received frame numbers.
[0159] Through step S405, all decoding devices can obtain the frame numbers of their respective current images to be decoded; in step S406, the synchronization processing will be performed based on the obtained frame numbers according to the following rules:
[0160] 1) If the frame numbers of the images to be decoded by all decoding devices are the same, then all decoding devices decode and display the current images to be decoded.
[0161] 2) If the frame numbers of the images to be decoded by all decoding devices are not the same, and more than half (greater than half) of all the frame numbers are the same, then other decoding devices will be processed according to the principle of "the minority follows the majority", and the specific processing method is as follows:
[0162] If the frame number to be decoded is lagging behind the current same frame number, then discard the current frame until the frame to be decoded with the same frame number as the current same frame number is obtained, and decode the current frame together with other decoding devices.
[0163] If the frame sequence number to be decoded is ahead of the current same frame sequence number, wait for a decoding cycle, that is, no decoding is performed in the current decoding cycle; the r-ends that do not perform decoding in the current decoding cycle continue to send the frame sequence numbers of their respective frames to be decoded through multicast messages after other r-ends complete decoding, and process according to the comparison result of the frame sequence numbers according to the above rules in the next decoding cycle;
[0164] 3) If the frame sequence numbers of the frames to be decoded by all decoding-end devices are not the same currently, and there is no frame sequence number that exceeds half of the same frame sequence numbers among all the frame sequence numbers, then process in the following manner:
[0165] Priority is given to processing according to the principle of "the slower yields to the faster", that is, all decoding-end devices with lagging frame sequence numbers discard the image frames until the frame sequence numbers of the frames to be decoded are adjusted to be the same as the largest frame sequence number, and then all r-ends start to decode.
[0166] The above rules are illustrated by the following specific examples:
[0167] Example 1:
[0168] Suppose there are 4 decoding-end devices r1 - r4, and the frame sequence numbers of the frames to be decoded sent through the multicast message are: 3, 4, 4, 4 respectively.
[0169] Since the frame sequence numbers of the frames to be decoded by each decoding-end device are not all the same, and more than half of the frame sequence numbers (4) are the same, the following processing is performed:
[0170] After r1 discards the current frame to be decoded, it fetches the frame to be decoded 4; then, r1, r2, and r3 decode the 4th frame obtained by each of them simultaneously.
[0171] Example 2:
[0172] Suppose there are 4 decoding-end devices r1 - r4, and the frame sequence numbers of the frames to be decoded sent through the multicast message are: 5, 4, 4, 4 respectively.
[0173] Since the frame sequence numbers of the frames to be decoded by each decoding-end device are not all the same, and more than half of the frame sequence numbers (4) are the same, the following processing is performed:
[0174] r1 waits for a decoding cycle, that is, no decoding is performed in the current decoding cycle; after r1 discards the current frame to be decoded, it fetches the frame to be decoded 4; then, r1, r2, and r3 decode the 4th frame obtained by each of them simultaneously;
[0175] After the decoding of r1, r2, and r3 is completed, each retrieves the next frame to be decoded (frame number 5), and notifies other decoding devices. Since the frame to be encoded by r5 is still 5, the frame number 5 to be encoded is also notified to other decoding devices. In this way, the frame numbers of the frames to be encoded of all decoding devices are the same, and decoding can be directly performed.
[0176] Example 3:
[0177] Suppose the frame numbers of the frames to be decoded sent by the 4 decoding devices r1 - r4 through multicast messages are: 3, 3, 4, 4.
[0178] Since the frame numbers of the frames to be decoded by each decoding device are not all the same and the number of frames with the same frame number does not exceed half, according to the principle of "slower yielding to faster", the decoding devices with relatively lagging frame numbers, namely r1 and r2, discard the image frames. After discarding, they continue to retrieve image frame 4. Then, they still notify their respective frame numbers through multicast messages. After determining that the frame numbers of the 4 decoding devices are the same, each decodes the obtained 4th frame.
[0179] Figure 6 is the structure of an image display device provided by an embodiment of the present disclosure Figure 1 , and this device is applied to a server, such as an image processing server. As Figure 6 shown, this device 60 includes:
[0180] A current frame to be displayed image acquisition module 601, configured to acquire at least one current frame to be displayed image, first identification information of the image source of the current frame to be displayed image, and frame identification information of the current frame to be displayed image;
[0181] A current frame to be displayed image division module 602, configured to divide each of the current frames to be displayed images to generate at least one current sub - image;
[0182] A time synchronization module 603, configured to synchronize the time of at least one decoding device of the display with a reference time;
[0183] A timestamp generation module 604, configured to generate timestamps for each of the current sub - images;
[0184] A current sub - image sending module 605, configured to send the current sub - image, the timestamp, the first identification information, and the frame identification information to a target decoding device, so that the target decoding device sends the current sub - image to the target display according to the timestamp and the reference time. The target decoding device is the decoding device of the target display corresponding to the image source of the frame to be displayed image.
[0185] In one embodiment, asFigure 7 As shown, the device 60 further includes:
[0186] A sub-image encoding module 606, configured to encode the current sub-image to generate an encoded current sub-image;
[0187] The current sub-image sending module 605 is configured to:
[0188] Send the encoded current sub-image and the timestamp to the target decoding end device.
[0189] In one embodiment, the device 60 further includes:
[0190] A target display determining module 607, configured to:
[0191] Receive an image display instruction sent by a user device, where the image display instruction includes first identification information of at least one image source of a current frame image to be displayed and second identification information of a display to which the current frame image to be displayed is to be displayed;
[0192] Determine a target display corresponding to each image source of the current frame image to be displayed according to the image instruction.
[0193] For the image display device provided by an embodiment of the present disclosure, the implementation process and technical effects can be referred to the above Figure 2 and Figure 4 embodiments, which will not be elaborated here.
[0194] Figure 8 is the structure of an image display device provided by an embodiment of the present disclosure Figure 1 , and this device is applied to a target decoding end device. As Figure 8 shown, the device 80 includes:
[0195] A current sub-image receiving module 801, configured to receive at least one current sub-image, the timestamp of the current sub-image, and the frame identification information of the current frame image to be displayed sent by a server, where the current sub-image is generated after the server divides the current frame image to be displayed;
[0196] A frame identification information receiving module 802, configured to receive the frame identification information of other frame images to be displayed broadcast by other decoding end devices if it is determined that the time difference between the timestamp of the current sub-image and the current time is less than or equal to a preset time threshold, where the other decoding end devices are decoding end devices other than the target decoding end device;
[0197] A target frame identification information determining module 803, configured to determine target frame identification information according to the frame identification information of the current frame image to be displayed and the frame identification information of other frame images to be displayed;
[0198] The current sub-image sending module 804 is configured to, if it is determined that the frame identification information of the to-be-displayed frame image is consistent with the target frame identification information, send the current sub-image to the target display, so that the target display displays the current sub-image.
[0199] In one embodiment, the frame identification information is a frame number. For example, Figure 9 as shown, the apparatus 80 further includes:
[0200] The next-frame sub-image sending module 805 is configured to:
[0201] If the frame identification information of the current to-be-displayed frame image is inconsistent with the target frame identification information and the frame number of the current to-be-displayed frame image is less than the target frame identification information, discard the current sub-image and receive the next-frame sub-image sent by the server and the frame number of the next to-be-displayed frame image, where the next-frame sub-image is generated by the server after dividing the next to-be-displayed frame image;
[0202] If the frame number of the next to-be-displayed frame image is consistent with the target frame identification information, send the next-frame sub-image to the target display, so that the target display displays the next-frame sub-image.
[0203] In one embodiment, the target frame identification information determining module 803 is configured to:
[0204] Determine the number of identical frame numbers among the frame numbers of the current to-be-displayed frame image and the frame numbers of other to-be-displayed frame images;
[0205] Use the frame number with the largest quantity as the target frame identification information.
[0206] In one embodiment, the current sub-image sending module 804 is further configured to:
[0207] If the frame number of the current to-be-displayed frame image is inconsistent with the target frame identification information and the frame number of the current to-be-displayed frame image is greater than the target frame identification information, receive the frame number of the other next to-be-displayed frame image broadcast by the other decoding end device;
[0208] If the frame number of the current to-be-displayed frame image is consistent with the frame number of the other next to-be-displayed frame image, send the current sub-image to the target display, so that the target display displays the current-frame sub-image.
[0209] In one embodiment, the current sub-image is an encoded current sub-image, and the apparatus 80 further includes:
[0210] The current sub-image decoding module 806 is configured to decode the current sub-image to generate a decoded current sub-image;
[0211] The current sub-image sending module 804 is configured to:
[0212] Send the decoded current sub-image to the target display.
[0213] For the image display device provided by the embodiments of the present disclosure, the implementation process and technical effects can be referred to the above Figure 3 and Figure 4 embodiments, which will not be elaborated here.
[0214] Figure 10 FIG. is a hardware structure diagram of a server provided by the embodiments of the present disclosure. As Figure 10 shown, the server 100 includes: a processor 1001 and a memory 1002. At least one computer instruction is stored in the memory 1002, and the instruction is loaded and executed by the processor 1001 to implement Figure 2 the steps performed in the image display method described in the corresponding embodiments.
[0215] Based on the above Figure 2 image display method described in the corresponding embodiments, the present disclosure provides a computer-readable storage medium. At least one computer instruction is stored in the storage medium, and the instruction is loaded and executed by the processor to implement Figure 2 the steps performed in the image display method described in the corresponding embodiments.
[0216] Figure 11 FIG. is a hardware structure diagram of a decoding end device provided by the embodiments of the present disclosure. As Figure 11 shown, the decoding end device 110 includes: a processor 1101 and a memory 1102. At least one computer instruction is stored in the memory 1102, and the instruction is loaded and executed by the processor 1101 to implement Figure 3 the steps performed in the image display method described in the corresponding embodiments.
[0217] Based on the above Figure 3 image display method described in the corresponding embodiments, the present disclosure provides a computer-readable storage medium. At least one computer instruction is stored in the storage medium, and the instruction is loaded and executed by the processor to implement Figure 3 the steps performed in the image display method described in the corresponding embodiments.
[0218] Those of ordinary skill in the art can understand that all or part of the steps to implement the above embodiments can be completed by hardware, or can be completed by instructing relevant hardware through a program. The program can be stored in a computer-readable storage medium. The storage medium mentioned above can be a read-only memory, a magnetic disk, an optical disk, or the like.
[0219] After considering the specification and practicing the disclosure herein, those skilled in the art will readily conceive of other embodiments of the present disclosure. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include known common knowledge or conventional technical means in the technical field not disclosed in the present disclosure. The specification and examples are only to be considered as exemplary, and the true scope and spirit of the present disclosure are pointed out by the following claims.
Claims
1. An image display method, characterized in that, Including: Receiving at least one current sub-image sent by a server, a time stamp of the current sub-image, and frame identification information of the current frame image to be displayed, where the current sub-image is generated after the server divides the current frame image to be displayed; If it is determined that the time difference between the time stamp of the current sub-image and the current time is less than or equal to a preset time threshold, receiving frame identification information of other images to be displayed broadcast by other decoding terminal devices, where the other decoding terminal devices are decoding terminal devices other than the target decoding terminal device; Determining target frame identification information according to the frame identification information of the current frame image to be displayed and the frame identification information of other images to be displayed; If it is determined that the frame identification information of the image to be displayed is consistent with the target frame identification information, sending the current sub-image to a target display so that the target display displays the current sub-image; The frame identification information is a frame number, and the method further includes: If the frame identification information of the current frame image to be displayed is inconsistent with the target frame identification information and the frame number of the current frame image to be displayed is less than the target frame identification information, discarding the current sub-image and receiving the next sub-image sent by the server and the frame number of the next frame image to be displayed, where the next sub-image is generated after the server divides the next frame image to be displayed; If the frame number of the next frame image to be displayed is consistent with the target frame identification information, sending the next sub-image to the target display so that the target display displays the next sub-image; Wherein, determining target frame identification information according to the frame identification information of the current frame image to be displayed and the frame identification information of other images to be displayed includes: Determining the number of each same frame number among the frame numbers of the current frame image to be displayed and the frame numbers of other images to be displayed; Taking the frame number with the largest quantity as the target frame identification information; The method further includes: If the frame number of the current frame image to be displayed is inconsistent with the target frame identification information and the frame number of the current frame image to be displayed is greater than the target frame identification information, receiving the frame number of the other next frame image to be displayed broadcast by the other decoding terminal device; If the frame number of the current frame image to be displayed is consistent with the frame number of the other next frame image to be displayed, sending the current sub-image to the target display so that the target display displays the current sub-image.
2. The method according to claim 1, wherein The current sub-image is an encoded current sub-image. After receiving the current sub-image sent by the server, the time stamp of the current sub-image, and the frame identification information of the current frame image to be displayed, the method further includes: Decoding the current sub-image to generate a decoded current sub-image; The sending the current sub-image to the target display includes: Sending the decoded current sub-image to the target display.
3. An image display device, characterized in that, Including: A current sub-image receiving module, configured to receive at least one current sub-image sent by a server, a time stamp of the current sub-image, and frame identification information of the current frame image to be displayed, where the current sub-image is generated after the server divides the current frame image to be displayed; A frame identification information receiving module, configured to, if it is determined that a time difference between the time stamp of the current sub-image and the current time is less than or equal to a preset time threshold, receive frame identification information of other frame images to be displayed broadcast by other decoding terminal devices, where the other decoding terminal devices are decoding terminal devices other than the target decoding terminal device; A target frame identification information determining module, configured to determine target frame identification information according to the frame identification information of the current frame image to be displayed and the frame identification information of other frame images to be displayed; A current sub-image sending module, configured to, if it is determined that the frame identification information of the frame image to be displayed is consistent with the target frame identification information, send the current sub-image to the target display, so that the target display displays the current sub-image; A next-frame sub-image sending module, configured to: If the frame identification information of the current frame image to be displayed is inconsistent with the target frame identification information and the frame sequence number of the current frame image to be displayed is less than the target frame identification information, discard the current sub-image and receive the next frame sub-image sent by the server and the frame sequence number of the next frame image to be displayed, where the next frame sub-image is generated after the server divides the next frame image to be displayed; If the frame sequence number of the next frame image to be displayed is consistent with the target frame identification information, send the next frame sub-image to the target display, so that the target display displays the next frame sub-image; The target frame identification information determining module is configured to: Determine the number of identical frame sequence numbers among the frame sequence numbers of the current frame image to be displayed and the frame sequence numbers of other frame images to be displayed; Use the frame sequence number with the largest number as the target frame identification information; The current sub-image sending module is further configured to: If the frame sequence number of the current frame image to be displayed is inconsistent with the target frame identification information and the frame sequence number of the current frame image to be displayed is greater than the target frame identification information, receive the frame sequence number of the other next frame image to be displayed broadcast by the other decoding terminal device; If the frame sequence number of the current frame image to be displayed is consistent with the frame sequence number of the other next frame image to be displayed, send the current sub-image to the target display, so that the target display displays the current frame sub-image.
Citation Information
Patent Citations
Image display control method and related device
CN104410857A
Display method, device and system for image processor
CN105657364A
Multi-screen synchronous display method and system, display equipment and storage medium
CN110399110A