Image synchronization method, device and system and storage medium
By segmenting and encoding images in distributed devices and determining system time in multicast domain, the problem of picture out-of-synchronization when image output in distributed devices is solved, and the synchronous display of images at the display terminal is realized, and the display effect is improved .
Patent Information
- Application Number
- CN202310863376.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-07-13
- Publication Date
- 2025-01-14
- Estimated Expiration
- 2043-07-13
AI Technical Summary
In a distributed device, after processing the multiple sub-images divided by the terminal are output to multiple distributed input interfaces, they are sent to the distributed output interface through the network and splicing the terminal when the display terminal is spliced, the problem of the screen being out of synchronization is likely to occur.
By segmenting the target image into at least two sub-images at the processing terminal and sending it to a distributed input interface, an encoding operation is performed and an encoding completion message is sent. When determining the encoding completion message containing all distributed input interfaces in the multicast domain, determine the current system time and send it and the encoding sub-image to the distributed output interface to make it correspond one by one to ensure that the display terminal is on the encoding sub-image Synchronous display of images.
It effectively solves the problem of screen out of synchronization when the display terminal is stitched and displayed by multiple sub-images transmitted by the processing terminal, reduces the workload of the display terminal, and makes the image display more silky and smoother.
Smart Images

Figure CN119313699A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of data transmission, and in particular to an image synchronization method, device, system and storage medium. Background Art
[0002] The current PC (Personal Computer) supports higher and higher image resolutions. Therefore, it is necessary to segment the image before outputting it. For example, an image with 33.18 million pixels can be segmented into four sub-images with 8.85 million pixels, and then the four sub-images are output through the output interface of the processing terminal. Currently, distributed devices are widely used in long-distance transmission and control. Distributed devices can support multiple outputs of the processing terminal, and then the multiple segmented sub-images are spliced and displayed on the display device. Therefore, when multiple sub-images are spliced and displayed on the display device, it becomes crucial to ensure the synchronization of the images. Summary of the invention
[0003] The present invention provides an image synchronization method, device, system and storage medium to solve the problem that after a plurality of sub-images segmented by a processing terminal are output to a plurality of distributed input interfaces, they are sent to distributed output interfaces through a network and are out of synchronization after being spliced at a display terminal.
[0004] According to one aspect of the present invention, there is provided an image synchronization system, wherein the image synchronization system comprises a processing terminal, a distributed input interface, a distributed output interface and a display terminal, and the method comprises:
[0005] The processing terminal divides the target image into at least two sub-images, and sends the at least two sub-images to the distributed input interface respectively; wherein the sub-images correspond to the distributed input interface one by one;
[0006] Each distributed input interface performs encoding operation on the received sub-image respectively, generates an encoded sub-image, and sends an encoding completion message to the pre-constructed multicast domain;
[0007] When it is determined that the multicast domain contains the encoding completion message sent by each distributed input interface, each distributed input interface determines the current system time respectively, and sends the current system time and the corresponding encoding sub-image to the distributed output interface; wherein the encoding sub-image corresponds to the distributed output interface one by one, and the current system time is the system time shared by the distributed input interface and the distributed output interface;
[0008] Each distributed output interface sends the corresponding coded sub-image to the display terminal according to the received current system time, so that the display terminal synchronously displays each coded sub-image.
[0009] According to another aspect of the present invention, an image synchronization device is provided, which is applied to an image synchronization system, wherein the image synchronization system includes a processing terminal, a distributed input interface, a distributed output interface and a display terminal, and the device includes:
[0010] An image segmentation module, used for segmenting the target image into at least two sub-images through the processing terminal, and sending the at least two sub-images to the distributed input interface respectively; wherein the sub-images correspond to the distributed input interface one by one;
[0011] The encoding completion message sending module is used to perform encoding operations on the received sub-images through each distributed input interface, generate encoded sub-images, and send an encoding completion message to a pre-built multicast domain;
[0012] a current system time determination module, configured to, when determining that the multicast domain contains the encoding completion message sent by each distributed input interface, determine the current system time through each distributed input interface respectively, and send the current system time and the corresponding encoding sub-image to the distributed output interface; wherein the encoding sub-image corresponds to the distributed output interface one by one, and the current system time is the system time shared by the distributed input interface and the distributed output interface;
[0013] The coded sub-image sending module is used to send the corresponding coded sub-image to the display terminal through each distributed output interface according to the received current system time, so that the display terminal can synchronously display each coded sub-image.
[0014] According to another aspect of the present invention, an image synchronization system is provided, the image synchronization system comprising: a processing terminal, a distributed input interface, a distributed output interface and a display terminal, wherein:
[0015] The processing terminal is used to divide the target image into at least two sub-images, and send the at least two sub-images to the distributed input interface respectively; wherein the sub-images correspond to the distributed input interfaces one by one;
[0016] Each distributed input interface is used to perform encoding operations on the received sub-images, generate encoded sub-images, and send an encoding completion message to a pre-constructed multicast domain;
[0017] Each of the distributed input interfaces is further configured to determine the current system time respectively when it is determined that the multicast domain contains the encoding completion message sent by each of the distributed input interfaces, and send the current system time and the corresponding encoding sub-image to the distributed output interface; wherein the encoding sub-image corresponds to the distributed output interface one by one, and the current system time is the system time shared by the distributed input interface and the distributed output interface;
[0018] Each distributed output interface is used to send the corresponding coded sub-image to the display terminal according to the received current system time, so that the display terminal can synchronously display each coded sub-image.
[0019] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the image synchronization method described in any embodiment of the present invention when executed.
[0020] An image synchronization solution provided by an embodiment of the present invention is applied to an image synchronization system, wherein the image synchronization system includes a processing terminal, a distributed input interface, a distributed output interface and a display terminal, wherein the processing terminal divides a target image into at least two sub-images, and sends the at least two sub-images to the distributed input interface respectively; wherein the sub-images correspond to the distributed input interfaces one by one; each distributed input interface performs encoding operations on the received sub-images respectively, generates encoded sub-images, and sends encoding completion messages to a pre-constructed multicast domain; when it is determined that the multicast domain contains the encoding completion messages sent by each distributed input interface, each distributed input interface determines the current system time respectively, and sends the current system time and the corresponding encoded sub-images to the distributed output interface; wherein the encoded sub-images correspond to the distributed output interfaces one by one, and the current system time is the system time shared by the distributed input interface and the distributed output interface; each distributed output interface sends the corresponding encoded sub-images to the display terminal according to the received current system time, so that the display terminal synchronously displays each encoded sub-image. The technical solution provided by the embodiment of the present invention solves the problem that after the processing terminal divides the multiple sub-images and outputs them to the multiple distributed input interfaces, they are sent to the distributed output interfaces through the network and are not synchronized after being spliced at the display terminal. When the display terminal splices and displays the multiple sub-images transmitted by the processing terminal, the synchronization of the images can be effectively guaranteed. In addition, when it is determined that the multicast domain contains the encoding completion message sent by each distributed input interface, the current system time is marked on the encoded sub-image at the distributed input interface end, which can reduce the workload of the display terminal and make the display of the image on the display terminal smoother and smoother.
[0021] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0023] Figure 1 is a flowchart of an image synchronization method provided according to Embodiment 1 of the present invention;
[0024] Figure 2 is a structural schematic diagram of an image synchronization system provided by an embodiment of the present invention;
[0025] Figure 3 is a schematic diagram of synchronization signals outputted by a processing terminal for each sub-image according to an embodiment of the present invention;
[0026] Figure 4 It is a structural schematic diagram of an image synchronization device provided according to the second embodiment of the present invention. DETAILED DESCRIPTION
[0027] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.
[0028] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0029] Embodiment 1
[0030] Figure 1 A flowchart of an image synchronization method is provided for the first embodiment of the present invention. This embodiment is applicable to the case of synchronously displaying multiple sub-images. The method can be executed by an image synchronization device. The image synchronization device can be implemented in the form of hardware and / or software. The image synchronization device can be configured in an image synchronization system. The image synchronization system includes a processing terminal, a distributed input interface, a distributed output interface and a display terminal. Figure 1 As shown, the method includes:
[0031] S110. The processing terminal divides the target image into at least two sub-images, and sends the at least two sub-images to the distributed input interface respectively; wherein the sub-images correspond to the distributed input interfaces one by one.
[0032] Figure 2 FIG. 1 is a schematic diagram of the structure of an image synchronization system provided by an embodiment of the present invention. Figure 2 As shown, the image synchronization system includes a processing terminal, multiple distributed input interfaces, multiple distributed output interfaces and a display terminal. The processing terminal can be connected to each distributed input interface through a video cable (HDMI / DVI / DP), the distributed input interface and the distributed output interface can be connected through a switch network port, and each distributed output interface can be connected to the display terminal through a video cable (HDMI / DVI).
[0033] In an embodiment of the present invention, the processing terminal divides the target image into at least two sub-images, wherein the target image can be understood as an image to be transmitted. The processing terminal can divide the target image according to the device status of the display terminal to generate multiple sub-images, or divide the target image based on a preset image segmentation algorithm to generate at least two sub-images. The processing terminal sends each sub-image to the corresponding distributed input interface, wherein the sub-image corresponds to the distributed input interface one-to-one. Among them, the synchronization signals of the multiple sub-images output by the processing terminal are not completely aligned, that is, the time points when each sub-image is transmitted to each distributed input interface are different, that is, the sub-images sent by the processing terminal and received by each distributed input interface are not synchronized. Exemplarily, Figure 3 A schematic diagram of the synchronization signal of each sub-image output by the processing terminal provided in an embodiment of the present invention. Specifically, the timing of each distributed input interface collecting the sub-image of the processing terminal is triggered by the synchronization signal sent by the processing terminal when sending the sub-image, thereby causing the timing of each distributed input interface collecting the sub-image to be asynchronous. When the target image sent by the processing terminal is a plurality of continuous video frame images, the time of each frame of sub-image collected by each distributed input interface is inconsistent.
[0034] Optionally, sending the at least two sub-images to the distributed input interface respectively includes: obtaining preset virtual signal group information; wherein the virtual signal group information includes configuration information of at least two distributed input interfaces; and sending the at least two sub-images to each distributed input interface corresponding to the configuration information in the virtual signal group information. Exemplarily, obtaining preset virtual signal group information, wherein the virtual signal group information includes configuration information of at least two distributed input interfaces, such as interface serial number, IP, MAC address and other related information of the distributed input interface. Determine the corresponding distributed input interface according to the virtual signal group information, and send each sub-image to the corresponding determined distributed input interface respectively. It can be understood that the distributed input interfaces for receiving and processing each sub-image output by the terminal can be constituted into a virtual signal group, and the virtual signal group information includes configuration information of each member in the virtual signal group.
[0035] S120: Each distributed input interface performs encoding operation on the received sub-image respectively to generate an encoded sub-image, and sends an encoding completion message to the pre-constructed multicast domain.
[0036] Exemplarily, each distributed input interface may first preprocess the received sub-image, wherein the preprocessing may include operations such as downsampling, image enhancement, and scaling, and then perform encoding operations on the preprocessed sub-image to generate an encoded sub-image.
[0037] In an embodiment of the present invention, for each distributed input interface, the current distributed input interface performs encoding operations on the sub-image, generates an encoded sub-image, and sends an encoding completion message to a pre-constructed multicast domain. Exemplarily, after distributed input interface 1 generates an encoded sub-image, it can send an encoding completion message to the multicast domain via SndMsg, wherein the encoding completion message is: "The interface serial number is 1, the IP address is 192.168.1.14, the MAC address is 44:11:45:87:12:64, and encoding is completed." Among them, the multicast domain is a pre-constructed IP address. Optionally, the multicast domain is an address domain constructed based on the configuration information of any distributed input interface in the virtual signal group information. A multicast domain can be generated based on the IP address of any distributed input interface among all distributed input interfaces. For example, the last two digits of the IP address of a distributed input interface are taken to form a multicast domain: 238.240.the last two digits of IP. For example, if the IP address of the distributed input interface is 192.168.1.14, the multicast domain is 238.240.1.14.
[0038] S130. When it is determined that the multicast domain contains the encoding completion message sent by each distributed input interface, each distributed input interface determines the current system time respectively, and sends the current system time and the corresponding encoding sub-image to the distributed output interface; wherein the encoding sub-image corresponds to the distributed output interface one-to-one, and the current system time is the system time shared by the distributed input interface and the distributed output interface.
[0039] Since the sub-images collected by each distributed input interface are not synchronized, therefore, after each distributed input interface encodes the sub-image to generate a coded sub-image, if the coded sub-image is directly sent to the distributed output interface, the timing of sending the coded sub-image by each distributed input interface will also be out of sync, resulting in the picture being out of sync when it is transmitted to the display terminal through the distributed output interface for display.
[0040] In the embodiment of the present invention, for each distributed input interface, the current distributed input interface determines whether the multicast domain contains the encoding completion message sent by each distributed input interface. If so, it means that all distributed input interfaces have completed the encoding operation of the sub-image. Otherwise, it means that there is a distributed input interface that has not completed the encoding operation of the sub-image. When it is determined that the multicast domain contains the encoding completion message sent by each distributed input interface, each distributed input interface determines the current system time respectively, and sends the current system time and the corresponding encoded sub-image to the corresponding distributed output interface. It can be understood that for each distributed input interface, the current distributed input interface determines whether the multicast domain contains the encoding completion message sent by each distributed input interface, so as to determine whether the encoding operation of the sub-image is completed by itself, and whether other distributed input interfaces have completed the encoding operation of the sub-image. If the current distributed input interface completes the encoding operation of the sub-image, and the other distributed input interfaces complete the encoding operation of the sub-image, the current distributed input interface sends the current system time and the corresponding encoded sub-image to the corresponding distributed output interface. Among them, the other distributed input interfaces are input interfaces other than the current distributed input interface among all distributed input interfaces. The advantage of such a setting is that it can effectively ensure that each distributed input interface sends the encoded sub-image to the corresponding distributed output interface synchronously.
[0041] The coded sub-images correspond to the distributed output interfaces one by one, and the current system time is the system time shared by the distributed input interfaces and the distributed output interfaces. It can be understood that each distributed input interface and each distributed output interface share the same system time, that is, the time of each distributed input interface and each distributed output interface is synchronized and consistent.
[0042] Optionally, the encoding completion message includes identification information of the corresponding distributed input interface; determining that the multicast domain includes encoding completion messages sent by the respective distributed input interfaces comprises: for each distributed input interface, the current distributed input interface determines, at preset time intervals, whether the multicast domain includes encoding completion messages sent by the respective distributed input interfaces according to the virtual signal group information; when each identification information included in all encoding completion messages in the multicast domain completely matches the configuration information in the virtual signal group information, determining that the multicast domain includes encoding completion messages sent by the respective distributed input interfaces.
[0043] Exemplarily, for each distributed input interface, the current distributed input interface determines whether the multicast domain contains encoding completion messages corresponding to all distributed input interfaces according to the virtual signal group information at preset time intervals. If so, it is determined that all distributed input interfaces have completed the encoding operation of the sub-image. Exemplarily, after the current distributed input interface completes the encoding of the sub-image, it reads the encoding completion message from the multicast domain at preset time intervals, parses the read encoding completion message, and determines the identification information in the read encoding completion message. When the identification information contained in the read encoding completion message completely matches the configuration information in the virtual signal group information, it is determined that the multicast domain contains the encoding completion messages sent by each distributed input interface, that is, it is determined that all distributed input interfaces have completed the encoding operation of the sub-image.
[0044] S140. Each distributed output interface sends the corresponding coded sub-image to the display terminal according to the received current system time, so that the display terminal synchronously displays each coded sub-image.
[0045] In the embodiment of the present invention, each distributed output interface may send the corresponding encoded sub-image to the display terminal after receiving a preset duration of the current system time, so as to ensure that the display terminal synchronously receives the encoded sub-images sent by each distributed output interface.
[0046] Optionally, the current system time and the corresponding encoded sub-image are sent to the distributed output interface, including: generating a target message according to the current system time and the corresponding encoded sub-image; sending the target message to the distributed output interface; each distributed output interface sends the corresponding encoded sub-image to the display terminal according to the received current system time, including: for each distributed output interface, the current distributed output interface parses the received target message to determine the current system time and the encoded sub-image in the target message; each distributed output interface sends the encoded sub-image to the display terminal after a preset length of time of the current system time.
[0047] Exemplarily, the distributed input interface converts the current system time into a corresponding timestamp, and generates a target message based on the timestamp and the coded sub-image corresponding to the current system time. For example, the timestamp and the coded sub-image corresponding to the current system time can be encapsulated to generate a target message based on the RFC3984 encapsulation protocol, wherein the timestamp corresponding to the current system time can be written into the RTP extension header. Each distributed input interface sends the target message to the corresponding distributed output interface. After receiving the target message, the distributed output interface parses the timestamp from the target message, and all distributed output interfaces send and display according to the timestamp, thereby achieving a synchronization effect.
[0048] Optionally, so that the display terminal synchronously displays each coded sub-image, the method includes: the display terminal receives the coded sub-images sent by each distributed output interface respectively, and decodes the coded sub-images to generate decoded sub-images; splices the decoded sub-images to generate a spliced image, and displays the spliced image. Exemplarily, the display terminal decodes the coded sub-images sent by each distributed output interface to generate a decoded sub-image, splices the decoded sub-images to generate a spliced image, and displays the spliced image to ensure the synchronization of the displayed screen.
[0049] Optionally, when the target image is a video frame image, after determining that all members in the virtual signal group have completed the encoding operation, each distributed input interface obtains the current system time (the difference in seconds from 0:0:0 on January 1, 1970), and converts it into an integer with 60 units (TICK) in 1 second. The converted TimeTick is = S*60+NS / (1000*1000*1000 / 60), where S is seconds and NS is nanoseconds. △Timestamp = 90000 / 2 / 60 = 750, that is, the Timestamp of the first frame is 0, and that of the second frame is 750, and Timestamp = frame number * △Timestamp. The distributed output interface receives TimeTick1 of the first frame, and the timestamp is timestamp1. The difference in timestamp between the previous frame and the current frame can be used to determine whether the frames are discontinuous, and the TimeTick of the next frame can be calculated.
[0050] An image synchronization method provided by an embodiment of the present invention is applied to an image synchronization system, wherein the image synchronization system includes a processing terminal, a distributed input interface, a distributed output interface and a display terminal, wherein the processing terminal divides a target image into at least two sub-images, and sends the at least two sub-images to the distributed input interface respectively; wherein the sub-images correspond to the distributed input interfaces one by one; each distributed input interface performs encoding operations on the received sub-images respectively, generates encoded sub-images, and sends encoding completion messages to a pre-constructed multicast domain; when it is determined that the multicast domain contains the encoding completion messages sent by each distributed input interface, each distributed input interface determines the current system time respectively, and sends the current system time and the corresponding encoded sub-images to the distributed output interface; wherein the encoded sub-images correspond to the distributed output interfaces one by one, and the current system time is the system time shared by the distributed input interface and the distributed output interface; each distributed output interface sends the corresponding encoded sub-images to the display terminal according to the received current system time, so that the display terminal synchronously displays each encoded sub-image. The technical solution provided by the embodiment of the present invention solves the problem that after the processing terminal divides the multiple sub-images and outputs them to the multiple distributed input interfaces, they are sent to the distributed output interfaces through the network and are not synchronized after being spliced at the display terminal. When the display terminal splices and displays the multiple sub-images transmitted by the processing terminal, the synchronization of the images can be effectively guaranteed. In addition, when it is determined that the multicast domain contains the encoding completion message sent by each distributed input interface, the current system time is marked on the encoded sub-image at the distributed input interface end, which can reduce the workload of the display terminal and make the display of the image on the display terminal smoother and smoother.
[0051] In some embodiments, before each of the distributed input interfaces respectively determines the current system time, it also includes: a distributed management output interface sends the system time to each of the distributed input interfaces and each of the distributed output interfaces in real time; wherein the distributed management output interface is any output interface among the distributed output interfaces. The advantage of such a setting is that it can effectively ensure that the system time of all distributed input interfaces and distributed output interfaces in the image synchronization system remains consistent. Exemplarily, any output interface among all the distributed output interfaces can be used as a distributed management output interface, and the distributed management output interface sends the system time to each of the distributed input interfaces and each of the distributed output interfaces in the image synchronization system in real time to ensure the time synchronization of all the distributed input interfaces and distributed output interfaces in the image synchronization system.
[0052] Optionally, each distributed input interface performs encoding operations on the received sub-image respectively to generate an encoded sub-image, including: for each distributed input interface, the current distributed input interface performs encoding operations on the received sub-image to generate an encoded sub-image, and after the encoding is completed, sends an encoding completion message to other distributed input interfaces; wherein the other distributed input interfaces are interfaces among all distributed input interfaces except the current distributed input interface; determining that all distributed input interfaces have completed the encoding operation of the sub-image, including: when receiving the encoding completion message sent by the other distributed input interfaces, determining that all distributed input interfaces have completed the encoding operation of the sub-image.
[0053] Exemplarily, for each distributed input interface, after the current distributed input interface completes the encoding operation on the sub-image, it sends an encoding completion message to other distributed input interfaces respectively to inform other distributed input interfaces of its own (the current distributed input interface) sub-image encoding status. If the current distributed input interface receives the encoding completion message sent by all other distributed input interfaces, it is determined that all distributed input interfaces have completed the encoding operation of the sub-image. At this time, the encoding status can be marked as 1. Of course, if the current distributed input interface does not receive the encoding completion message sent by any one or more of all other distributed input interfaces, the encoding status can be recorded as 0. In an embodiment of the present invention, the encoding status of the sub-image by other distributed input interfaces can be quickly and accurately understood by means of mutual communication between distributed input interfaces.
[0054] Optionally, each distributed input interface can pre-store virtual signal group information, and the distributed input interface can determine the sending object of the encoding completion message based on the virtual signal group information, that is, send the encoding completion message to other distributed input interfaces corresponding to the virtual signal group information except itself.
[0055] Embodiment 2
[0056] Figure 4 FIG. 1 is a schematic diagram of the structure of an image synchronization device provided by Embodiment 2 of the present invention. Figure 4 As shown, the image synchronization device is applied to an image synchronization system, wherein the image synchronization system includes a processing terminal, a distributed input interface, a distributed output interface and a display terminal, and the device includes:
[0057] An image segmentation module 410, configured to segment a target image into at least two sub-images through the processing terminal, and send the at least two sub-images to a distributed input interface respectively; wherein the sub-images correspond to the distributed input interfaces one by one;
[0058] The encoding completion message sending module 420 is used to perform encoding operations on the received sub-images through each distributed input interface, generate encoded sub-images, and send an encoding completion message to a pre-constructed multicast domain;
[0059] The current system time determination module 430 is used to determine the current system time through each distributed input interface respectively when it is determined that the multicast domain contains the encoding completion message sent by each distributed input interface, and send the current system time and the corresponding encoding sub-image to the distributed output interface; wherein the encoding sub-image corresponds to the distributed output interface one by one, and the current system time is the system time shared by the distributed input interface and the distributed output interface;
[0060] The coded sub-image sending module 440 is used to send the corresponding coded sub-image to the display terminal through each distributed output interface according to the received current system time, so that the display terminal can synchronously display each coded sub-image.
[0061] Optionally, the image segmentation module is used to:
[0062] Acquire preset virtual signal group information; wherein the virtual signal group information includes configuration information of at least two distributed input interfaces;
[0063] The at least two sub-images are respectively sent to each distributed input interface corresponding to the configuration information in the virtual signal group information.
[0064] Optionally, the encoding completion message includes identification information of the corresponding distributed input interface;
[0065] The current system time determination module is used to:
[0066] For each distributed input interface, the current distributed input interface determines, at a preset time interval, according to the virtual signal group information, whether the multicast domain contains the encoding completion message sent by each distributed input interface;
[0067] When each identification information included in all encoding completion messages in the multicast domain completely matches the configuration information in the virtual signal group information, it is determined that the multicast domain includes the encoding completion messages sent by each distributed input interface.
[0068] Optionally, the multicast domain is an address domain constructed based on configuration information of any distributed input interface in the virtual signal group information.
[0069] Optionally, the device further comprises:
[0070] The system time sending module is used for the distributed management output interface to send the system time to each distributed input interface and each distributed output interface in real time before each distributed input interface determines the current system time respectively; wherein, the distributed management output interface is any output interface among the distributed output interfaces.
[0071] Optionally, the current system time determination module is used to:
[0072] Generate a target message according to the current system time and the corresponding coded sub-image;
[0073] Sending the target message to the distributed output interface;
[0074] The coded sub-image sending module is used for:
[0075] For each distributed output interface, the current distributed output interface parses the received target message to determine the current system time and the coded sub-image in the target message;
[0076] Each of the distributed output interfaces sends the encoded sub-image to the display terminal after a preset duration of the current system time.
[0077] Optionally, the encoded sub-image sending module is used to:
[0078] The display terminal receives the coded sub-images sent by the distributed output interfaces respectively, and performs decoding operations on the coded sub-images to generate decoded sub-images;
[0079] The decoded sub-images are spliced to generate a spliced image, and the spliced image is displayed.
[0080] The image synchronization device provided in the embodiment of the present invention can execute the image synchronization method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.
[0081] Embodiment 3
[0082] Figure 2 FIG. 2 shows a schematic diagram of the structure of an image synchronization system that can be used to implement an embodiment of the present invention. Figure 2 As shown, the image synchronization system includes: a processing terminal, a distributed input interface, a distributed output interface and a display terminal, wherein:
[0083] The processing terminal is used to divide the target image into at least two sub-images, and send the at least two sub-images to the distributed input interface respectively; wherein the sub-images correspond to the distributed input interfaces one by one;
[0084] Each distributed input interface is used to perform encoding operations on the received sub-images, generate encoded sub-images, and send an encoding completion message to a pre-constructed multicast domain;
[0085] Each of the distributed input interfaces is further configured to determine the current system time respectively when it is determined that the multicast domain contains the encoding completion message sent by each of the distributed input interfaces, and send the current system time and the corresponding encoding sub-image to the distributed output interface; wherein the encoding sub-image corresponds to the distributed output interface one by one, and the current system time is the system time shared by the distributed input interface and the distributed output interface;
[0086] Each distributed output interface is used to send the corresponding coded sub-image to the display terminal according to the received current system time, so that the display terminal can synchronously display each coded sub-image.
[0087] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.
[0088] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.
[0089] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0090] To provide interaction with a user, the systems and techniques described herein may be implemented on an image synchronization system having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the image synchronization system. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).
[0091] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.
[0092] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.
[0093] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.
[0094] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims
1. An image synchronization method, characterized in that: Applied to an image synchronization system, wherein the image synchronization system includes a processing terminal, a distributed input interface, a distributed output interface and a display terminal, and the method includes: The processing terminal divides the target image into at least two sub-images, and sends the at least two sub-images to the distributed input interface respectively; wherein the sub-images correspond to the distributed input interface one by one; Each distributed input interface performs encoding operation on the received sub-image respectively, generates an encoded sub-image, and sends an encoding completion message to the pre-constructed multicast domain; When it is determined that the multicast domain contains the encoding completion message sent by each distributed input interface, each distributed input interface determines the current system time respectively, and sends the current system time and the corresponding encoding sub-image to the distributed output interface; wherein the encoding sub-image corresponds to the distributed output interface one by one, and the current system time is the system time shared by the distributed input interface and the distributed output interface; Each distributed output interface sends the corresponding coded sub-image to the display terminal according to the received current system time, so that the display terminal synchronously displays each coded sub-image.
2. The method according to claim 1, characterized in that: Sending the at least two sub-images to the distributed input interface respectively includes: Acquire preset virtual signal group information; wherein the virtual signal group information includes configuration information of at least two distributed input interfaces; The at least two sub-images are respectively sent to each distributed input interface corresponding to the configuration information in the virtual signal group information.
3. The method according to claim 2, characterized in that The encoding completion message includes identification information of the corresponding distributed input interface; Determining that the multicast domain contains the encoding completion message sent by each distributed input interface includes: For each distributed input interface, the current distributed input interface determines, at a preset time interval, according to the virtual signal group information, whether the multicast domain contains the encoding completion message sent by each distributed input interface; When each identification information included in all encoding completion messages in the multicast domain completely matches the configuration information in the virtual signal group information, it is determined that the multicast domain includes the encoding completion messages sent by each distributed input interface.
4. The method according to claim 2, characterized in that: The multicast domain is an address domain constructed based on configuration information of any distributed input interface in the virtual signal group information.
5. The method according to claim 1, characterized in that Before each distributed input interface determines the current system time respectively, the method further includes: The distributed management output interface sends the system time to each of the distributed input interfaces and each of the distributed output interfaces in real time; wherein, the distributed management output interface is any output interface among the distributed output interfaces.
6. The method according to claim 1, characterized in that Sending the current system time and the corresponding encoded sub-image to the distributed output interface includes: Generate a target message according to the current system time and the corresponding coded sub-image; Sending the target message to the distributed output interface; Each distributed output interface sends the corresponding encoded sub-image to the display terminal according to the received current system time, including: For each distributed output interface, the current distributed output interface parses the received target message to determine the current system time and the coded sub-image in the target message; Each of the distributed output interfaces sends the encoded sub-image to the display terminal after a preset duration of the current system time.
7. The method according to claim 1, characterized in that So that the display terminal synchronously displays each encoded sub-image, including: The display terminal receives the coded sub-images sent by the distributed output interfaces respectively, and performs decoding operations on the coded sub-images to generate decoded sub-images; The decoded sub-images are spliced to generate a spliced image, and the spliced image is displayed.
8. An image synchronization device, characterized in that: Applied to an image synchronization system, wherein the image synchronization system includes a processing terminal, a distributed input interface, a distributed output interface and a display terminal, and the device includes: An image segmentation module, used for segmenting the target image into at least two sub-images through the processing terminal, and sending the at least two sub-images to the distributed input interface respectively; wherein the sub-images correspond to the distributed input interface one by one; The encoding completion message sending module is used to perform encoding operations on the received sub-images through each distributed input interface, generate encoded sub-images, and send an encoding completion message to a pre-built multicast domain; a current system time determination module, configured to, when determining that the multicast domain contains the encoding completion message sent by each distributed input interface, determine the current system time through each distributed input interface respectively, and send the current system time and the corresponding encoding sub-image to the distributed output interface; wherein the encoding sub-image corresponds to the distributed output interface one by one, and the current system time is the system time shared by the distributed input interface and the distributed output interface; The coded sub-image sending module is used to send the corresponding coded sub-image to the display terminal through each distributed output interface according to the received current system time, so that the display terminal can synchronously display each coded sub-image.
9. An image synchronization system, characterized in that: The image synchronization system includes: a processing terminal, a distributed input interface, a distributed output interface and a display terminal, wherein: The processing terminal is used to divide the target image into at least two sub-images, and send the at least two sub-images to the distributed input interface respectively; wherein the sub-images correspond to the distributed input interfaces one by one; Each distributed input interface is used to perform encoding operations on the received sub-images, generate encoded sub-images, and send an encoding completion message to a pre-constructed multicast domain; Each of the distributed input interfaces is further configured to determine the current system time respectively when it is determined that the multicast domain contains the encoding completion message sent by each of the distributed input interfaces, and send the current system time and the corresponding encoding sub-image to the distributed output interface; wherein the encoding sub-image corresponds to the distributed output interface one by one, and the current system time is the system time shared by the distributed input interface and the distributed output interface; Each distributed output interface is used to send the corresponding coded sub-image to the display terminal according to the received current system time, so that the display terminal can synchronously display each coded sub-image.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the image synchronization method according to any one of claims 1 to 7 when executed.
Citation Information
Patent Citations
Method and system for processing video data
CN104284098A
Distributed tiled display picture synchronization method and system
CN111263230A
Image display method, device and equipment
CN113395564A
Distributed video synchronous display system, video synchronous display method and storage medium
CN113453053A
Synchronous control method and system for distributed video image stitching
CN116389811A