Large-screen splicing device, splicer, playback control method and system supporting recording and broadcasting

Abstract

The present invention provides a large-screen splicing device, a splicer, a playback control method and a system that support recording and broadcasting, and ensures the synchronization of the system clock of the splicer and the synchronous control of the real-time splicing screen and the playback screen through a secondary synchronization mechanism. During the synchronous playback, the distributed recording and broadcasting splicer does not need to decode and buffer the video file. Through the key time index file established during the synchronous recording, it can realize rapid retrieval and positioning, thereby achieving accurate synchronization of the playback of each screen of the splicing screen. The present invention does not need to configure a streaming media server, and can ensure that the ultra-high resolution of the splicing screen is preserved according to the source image quality and clarity. It can also overcome the differences in the working timing of the splicer, the decoding time of different frame types, the decoding time differences of different pictures of the same frame type, and the differences in network dynamic delays, and further improve the synchronization accuracy of the splicing screen recording and broadcasting.

Description

Technical Field

[0001] The present invention belongs to the technical field of large-screen splicing display, and more specifically, relates to a large-screen splicing device, a splicer, a playback control method and a system supporting recording and broadcasting. Background Art

[0002] Large-screen splicing display technology has been widely used in studios, campus security, centralized control and command. Traditional large-screen splicing mainly uses video splicing matrix to achieve the fusion and splicing of multiple video signals. In large-screen splicing applications, the output of each splicing controller requires synchronous output of the frame image, and the output frame phase also requires synchronization. These requirements are quite complex in terms of technical implementation for distributed architectures. The clock synchronization of the distributed system is the core of other synchronizations. The synchronization accuracy of the clock determines the accuracy of frame synchronization and phase synchronization. For a 1080P@60fps high-definition image, the frame period is 16.7ms. The phase difference of the frame synchronization of the distributed video output should be less than 1ms to ensure that there will be no "tearing effect" of the image. Therefore, the picture synchronization output technology is the core of the distributed splicing controller.

[0003] In addition, with the increasing demand for replay and process analysis in the military and civilian fields in recent years, the synchronous recording and broadcasting technology of multiple images on the splicing screen has become increasingly important. In the existing technology, the recording of the loop-out video signal of the splicing screen is limited by the technical bottleneck of video acquisition resolution. The usual practice is to compress and store and play back the entire screen of the splicing screen according to 1080P or 4K resolution. Because the resolution of the recording is reduced, the playback screen on the splicing screen cannot reach the clarity of the original real-time screen.

[0004] In the design of system clock synchronization, currently, more protocols such as PTP, NTP or 1588 are used to achieve the synchronization of the splicer. The synchronization channel and the video stream transmission are the same physical channel. Generally speaking, in a group of GOP video images, the I frame is a complete information frame, and the data volume is relatively the largest. Therefore, in the video compression algorithm, different video images occupy different network bandwidths, which will also cause differences in real-time channel transmission delays. This is also a challenge for accurately controlling the synchronous playback of video files of multiple splicers. In addition, the progress control of video files, such as dragging the progress bar, fast forward, fast rewind and speed, may disrupt the current synchronization effect between the various splicers, so the frame interval when playing the video file needs to be finely controlled.

[0005] At present, there are also some solutions that use the method of recording and replaying each splicer separately, such as Chunzhong Technology's patent "A video recording method, video playback method and device" (CN114189730A) and Weichuang's "Display wall high-definition full-screen ultra-high-resolution picture recording and playback method" (CN114302086A), both of which encode and compress single-screen or single-area pictures and save them on the streaming media server for later playback. This method can ensure the resolution size and picture clarity. However, since each splicer needs to pull the stream from the server separately when playing back, the differences in the server's reading of the video file push process, the differences in the decoding performance of each splicer, and the differences in network delay may all lead to synchronization accuracy problems. In the "Method and system for synchronous recording and playback based on the original signal source of the large screen window" (CN112929583A), the output pictures of each splicer are recorded separately through the recording and broadcasting server and the storage server. This method adds multiple servers to achieve parallel processing. On the one hand, the hardware cost is high, and on the other hand, because the system is more complex, the difficulty of the synchronization control algorithm is increased.

[0006] In “A method for rapid synchronous positioning and playback of multi-channel audio and video data” (CN114153999A), it is proposed to decode the video stream and extract standard video frames and timestamp information through multi-threading technology, and establish an index sequence for easy positioning, thereby realizing synchronous control of the playback progress of multiple video files. This method is mainly used for synchronous playback of multiple video files on the same device using multiple threads, and cannot meet the requirements of synchronous recording and playback between multiple large-screen splicers. Not only that, because the time when I frames, P frames and B frames of different video streams appear may not be completely consistent, and there are large differences in the decoding time of different types of video frames and the decoding time of different pictures of the same type of frames, the synchronization accuracy of this method is limited when playing different videos with large differences in pictures. Summary of the invention

[0007] In view of the defects of the prior art, the purpose of the present invention is to provide a large-screen splicing device, splicer, playback control method and system that support recording and broadcasting, aiming to solve the problem that the existing splicing screen playback uses a whole large screen to record, resulting in loss of playback picture resolution, and if the playback is compressed by single-screen encoding, although the playback picture resolution can be guaranteed, it is necessary to pull the stream from the server separately, and a streaming media server needs to be configured. In addition, the differences in the process of reading the video file and pushing the stream from different servers, the differences in the decoding performance of each splicer, and the differences in network delay make it impossible to guarantee the synchronization accuracy.

[0008] To achieve the above-mentioned purpose, in a first aspect, the present invention provides a large-screen splicing device supporting recording and broadcasting, comprising: N display screens, N distributed recording and broadcasting splicing devices, and a recording and broadcasting management unit; wherein one display screen is connected to one distributed recording and broadcasting splicing device, and N is an integer greater than 1; comprising:

[0009] The recording and broadcasting management unit is used to receive control information input by the user, and convert the control information into corresponding control instructions and send them to N distributed recording and broadcasting splicers through the network; the control information includes the user's visual configuration information of the output screen layout of the N distributed recording and broadcasting splicers and the recording and broadcasting function control information of the N distributed recording and broadcasting splicers;

[0010] Each distributed recording and broadcasting splicer is used to receive at least one video stream in real time according to the visualization configuration information, decode the received video stream, and complete windowing, scaling, translation or local magnification processing of the decoded picture, obtain the picture to be displayed by each video stream in the current distributed recording and broadcasting splicer, and output the picture to the display screen connected to it through the video interface;

[0011] Each display screen is used to display the images it receives. N display screens are spliced ​​into a large screen. Each video stream can be played across the display screens. Multiple videos can be played on one display screen and the multiple videos can be presented separately in PIP or PBP mode.

[0012] Each distributed recording and broadcasting splicer is used to control the display screen connected thereto to record the entire displayed screen according to the recording and broadcasting function control information, obtain a recording file of the screen screen, and locally save the recording file and a key time index file; the recording file includes at least one picture group GOP, and the key time index file includes: the timestamp of the I frame in each GOP, the network relative delay information of each GOP at the time of display screen playback, and the storage location information of the recording file;

[0013] Each distributed recording and broadcasting splicer is used to determine the playback time point of the video file according to the recording and broadcasting function control information, find the corresponding GOP according to the playback time point and the saved I frame timestamp information, and determine the frame playback interval of the GOP according to the corresponding network relative delay;

[0014] N distributed recording and playback splicers are used to synchronously play back the GOP corresponding to the local video file according to the corresponding frame playback interval under the control of the secondary synchronization mechanism, so as to complete the synchronous playback of the large-screen video.

[0015] In an optional example, the N distributed recording and playback splicers start playback from the GOP corresponding to the local video file synchronously according to the corresponding frame playback interval under the control of the secondary synchronization mechanism, specifically:

[0016] The first-level synchronization mechanism is that N distributed recording and broadcasting splicers use the synchronization bus to synchronize their own system clocks; the second-level synchronization mechanism is that each distributed recording and broadcasting splicer uses the network interface and uses the real-time network relative delay in the key time index file to synchronize the video playback; among them, when each distributed recording and broadcasting splicer records the screen displayed on each display screen as a video file, it associates the timestamp information of the I frame in each group of GOP of the video, the location information of the video file to which it belongs, and the real-time network relative delay and records them as a key time index file;

[0017] The clock of one of the N distributed recording and broadcasting splicers is used as a clock reference, and other distributed recording and broadcasting splicers dynamically monitor their own network delays compared with the distributed recording and broadcasting splicer that provides the clock reference through a synchronous bus to determine the real-time network delay of the video files of each distributed recording and broadcasting splicer.

[0018] In an optional example, when each distributed recording and playback splicer synchronously plays back the locally saved video files, it reads the corresponding key time index file and quickly locates the position information in the video file through the timestamp information of the target I frame; it dynamically adjusts the frame interval of the video stream playback through the real-time network relative delay associated with the I frame, thereby achieving accurate synchronization of the playback images of all distributed recording and playback splicers.

[0019] In a second aspect, the present invention provides a distributed recording and broadcasting splicing device, comprising:

[0020] A receiving unit, used to receive control information sent by a user; the control information includes the user's visualization configuration information of the output screen layout of the distributed recording and broadcasting splicing device and the recording and broadcasting function control information of the distributed recording and broadcasting splicing device;

[0021] A receiving unit, configured to receive at least one video stream in real time according to the visualization configuration information;

[0022] A processing unit, used to decode the received video stream according to the visualization configuration information, and simultaneously complete windowing, scaling, translation or partial zooming processing of the decoded picture to obtain the picture to be displayed by each video stream on the distributed splicing recorder;

[0023] The sending unit is used to output the picture decoded by the processing unit to the display screen connected to the distributed recording and broadcasting splicing device through the video interface, so that the display screen displays the received picture; the display screen is N pieces, one display screen is connected to one distributed recording and broadcasting splicing device, and the N display screens are spliced ​​into a whole large screen, each video stream can be played across the display screens, and multiple videos can be played on one display screen, and the multiple videos can be presented separately in PIP or PBP mode;

[0024] A processing unit, configured to control the display screen connected thereto to record the entire displayed screen according to the recording and broadcasting function control information, obtain a recording file of the screen screen, and locally save the recording file and a key time index file; the recording file includes at least one group of pictures GOP, and the key time index file includes: a timestamp of an I frame in each GOP, network relative delay information of each GOP at the time of display screen playback, and storage location information of the recording file;

[0025] A processing unit is used to determine the playback time point of the video file according to the recording and broadcasting function control information, find the corresponding GOP according to the playback time point and the saved I frame timestamp information, and determine the frame playback interval of the GOP according to the corresponding network relative delay, so as to obtain the corresponding playback picture by decoding from the local video file according to the corresponding frame playback interval under the control of the secondary synchronization mechanism;

[0026] The sending unit is used to send the playback picture decoded by the processing unit to the display screen connected to the distributed recording and broadcasting splicing device, so that the display screen displays the received playback picture, so that N display screens can synchronously play back the large-screen video.

[0027] In an optional example, the distributed recording and broadcasting splicer further includes:

[0028] A synchronization unit, used for providing a synchronization bus interface, so that the distributed recording and broadcasting splicing device is connected to other N-1 distributed recording and broadcasting splicing devices through a synchronization bus; the distributed recording and broadcasting splicing device and other N-1 distributed recording and broadcasting splicing devices constitute a total of N distributed recording and broadcasting splicing devices, so as to be connected to the N display screens respectively;

[0029] The processing unit, under the control of the secondary synchronization mechanism, decodes the local video file according to the corresponding frame playback interval to obtain the corresponding playback picture, specifically: the processing unit realizes the system clock synchronization of the N distributed recording and playback splicing devices through the synchronization bus interface of the synchronization unit, and the processing unit obtains the corresponding playback picture through the network interface and the real-time network relative delay in the key time index file; wherein, when recording the pictures displayed on each display screen as a video file, the processing unit associates the timestamp information of the I frame in each group GOP of the video, the location information of the video file to which it belongs, and the real-time network relative delay and records them as the key time index file;

[0030] The clock of one of the N distributed recording and broadcasting splicers is used as the clock reference, and the processing units of other distributed recording and broadcasting splicers dynamically monitor their own network delays compared with the distributed recording and broadcasting splicer providing the clock reference through the synchronization unit synchronization bus interface to determine the real-time network delay of the video files of each distributed recording and broadcasting splicer.

[0031] In an optional example, the processing unit is used to read the corresponding key time index file when reading the locally saved video file for synchronous playback, and quickly locate the position information in the video file through the timestamp information of the target I frame; dynamically adjust the frame interval of the video stream playback through the real-time network relative delay associated with the I frame, so as to achieve accurate synchronization of the playback screen of all distributed recording and playback splicing devices.

[0032] In a third aspect, the present invention provides a video playback control method, which is applied to a distributed recording and playback splicing device, and comprises the following steps:

[0033] Receive control information sent by a user; the control information includes the user's visualization configuration information of the output screen layout of the distributed recording and broadcasting splicing device and the recording and broadcasting function control information of the distributed recording and broadcasting splicing device;

[0034] At least one video stream is received in real time according to the visualization configuration information, the received video stream is decoded, and windowing, scaling, panning or partial zooming of the decoded picture is completed at the same time, so as to obtain the picture to be displayed by each video stream in the distributed splicing recorder applied by the method;

[0035] Send the decoded picture to the corresponding display screen so that the display screen displays the received picture; the display screen is N pieces, one display screen is connected to a distributed recording and broadcasting splicer, and the N display screens are spliced ​​into a whole large screen. Each video stream can be played across the display screens. Multiple videos can be played on one display screen and the multiple videos can be presented separately in PIP or PBP mode;

[0036] According to the recording and broadcasting function control information, the corresponding display screen is controlled to record the entire displayed picture, a recording file of the display screen is obtained, and the recording file and the key time index file are locally saved; the recording file includes at least one picture group GOP, and the key time index file includes: the timestamp of the I frame in each GOP, the network relative delay information of each GOP at the time of display screen playback, and the storage location information of the recording file;

[0037] Determine the playback time point of the video file according to the recording and broadcasting function control information, find the corresponding GOP according to the playback time point and the saved I frame timestamp information, and determine the frame playback interval of the GOP according to the corresponding network relative delay, so as to obtain the corresponding playback picture by decoding from the local video file according to the corresponding frame playback interval under the control of the secondary synchronization mechanism;

[0038] The decoded playback picture is sent to the corresponding display screen so that the display screen displays the received playback picture, so that N display screens can synchronously play back the large-screen video.

[0039] In an optional example, the secondary synchronization mechanism is specifically as follows:

[0040] The first-level synchronization mechanism is that N distributed recording and broadcasting splicing devices realize their own system clock synchronization through a synchronization bus; the N distributed recording and broadcasting splicing devices are respectively connected to the N display screens;

[0041] The second-level synchronization mechanism is that each distributed recording and broadcasting splicer obtains the corresponding playback screen through the network interface and uses the real-time network relative delay decoding in the key time index file; wherein, when each distributed recording and broadcasting splicer records the screen displayed on each display screen as a video file, it associates the timestamp information of the I frame in each group of GOP of the video, the location information of the video file to which it belongs, and the real-time network relative delay and records them as a key time index file;

[0042] The clock of one of the N distributed recording and broadcasting splicers is used as a clock reference, and other distributed recording and broadcasting splicers dynamically monitor their own network delays compared with the distributed recording and broadcasting splicer that provides the clock reference through a synchronous bus to determine the real-time network delay of the video files of each distributed recording and broadcasting splicer.

[0043] In a fourth aspect, the present invention provides a video playback control system, comprising: a memory and a processor;

[0044] The memory is used to store computer programs;

[0045] The processor is used to implement the video playback control method provided in the third aspect when executing the computer program.

[0046] In a fifth aspect, the present invention provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the video playback control method provided in the third aspect above is implemented.

[0047] In general, the above technical solution conceived by the present invention has the following beneficial effects compared with the prior art:

[0048] The present invention provides a large-screen splicing device, a splicer, a playback control method and a system that support recording and broadcasting, and ensures the synchronization of the system clock of the splicer and the synchronous control of the real-time splicing screen and the playback screen through a secondary synchronization mechanism. During the synchronous playback, the distributed recording and broadcasting splicer does not need to decode and buffer the video file. Through the key time index file established during the synchronous recording, it can realize rapid retrieval and positioning, thereby achieving accurate synchronization of the playback of each screen of the splicing screen. The present invention does not need to configure a streaming media server, and can ensure that the ultra-high resolution of the splicing screen is preserved according to the source image quality and clarity. It can also overcome the differences in the working timing of the splicer, the decoding time of different frame types, the decoding time differences of different pictures of the same frame type, and the differences in network dynamic delays, and further improve the synchronization accuracy of the splicing screen recording and broadcasting. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] Figure 1 is a diagram of the architecture of a large-screen splicing device provided by an embodiment of the present invention;

[0050] Figure 2 This is a schematic diagram of display and playback in which N display screens are combined into a large screen according to an embodiment of the present invention;

[0051] Figure 3 It is a flowchart of the steps of implementing the distributed recording and broadcasting splicing device synchronization method provided by an embodiment of the present invention;

[0052] Figure 4 is a schematic diagram of the key time index file structure provided by an embodiment of the present invention;

[0053] Figure 5 This is a workflow diagram for synchronous playback of video files provided by an embodiment of the present invention;

[0054] Figure 6 Schematic diagram of the distributed recording and broadcasting splicing device architecture provided by an embodiment of the present invention;

[0055] Figure 7 It is a flow chart of a video playback control method provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0056] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0057] It should be noted that, in the absence of conflict, the embodiments of the present invention and the features in the embodiments can be combined with each other. The present invention will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0058] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. The following description of at least one exemplary embodiment is actually only illustrative and is by no means intended to limit the present invention and its application or use. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0059] The purpose of the present invention is to solve the deficiencies of the prior art and provide a large-screen splicing device, splicer, playback control method and system that supports recording and broadcasting. It does not need to be equipped with a dedicated video server, and can realize the splicing output, synchronous recording and playback of multiple streaming media videos. It can be widely used in military command, centralized control system, public transportation and studio in large-screen splicing display, scene recording, event replay and training review, etc., and has good versatility. This method can save the ultra-high resolution of the spliced ​​picture according to the source picture quality and clarity, and can also realize the synchronous recording and synchronous playback of each screen picture. When fast-forwarding, speeding up and dragging, it is not necessary to decode the video file, and the key time index file can be used for rapid retrieval and positioning, so as to achieve the purpose of improving real-time performance and synchronization accuracy.

[0060] The present invention adopts several distributed recording and broadcasting splicers and recording and broadcasting management units to realize large-screen splicing and synchronous recording and broadcasting functions; the distributed recording and broadcasting splicers are used for splicing display, synchronous recording and synchronous playback of real-time network video streams and video files; the recording and broadcasting management unit is used for the screen layout setting of the distributed recording and broadcasting splicers and the operation interface of recording and broadcasting control.

[0061] A distributed recording and broadcasting splicer is set as a clock reference in the distributed recording and broadcasting splicer, and other distributed recording and broadcasting splicers dynamically monitor their own real-time network relative delay compared with the distributed recording and broadcasting splicer that provides the clock reference; and a two-level synchronization mechanism is adopted to improve the synchronization accuracy of the splicing display function of the real-time network video stream and the playback function of the video file; the first-level synchronization mechanism is that the distributed recording and broadcasting splicer realizes its own system clock synchronization through the synchronization bus; the second-level synchronization mechanism is to use the key time index file to synchronize the video playback; when the distributed recording and broadcasting splicer records the video as a video file, the timestamp information of the video I frame, the location information of the corresponding video file and the real-time network relative delay are associated and recorded as a key time index file.

[0062] When the distributed recording and broadcasting splicer displays the real-time video stream, it dynamically adjusts the frame interval of the video stream playback through the received I-frame timestamp information and the associated real-time network relative delay, thereby achieving accurate synchronization of the playback images of all distributed recording and broadcasting splicers.

[0063] During the synchronous playback of video files, the distributed recording and playback splicer reads the key time index file and quickly locates the position information in the video file through the timestamp information of the target I frame. It dynamically adjusts the frame interval of the video stream playback through the real-time network relative delay associated with the I frame to achieve accurate synchronization of the playback images of all distributed recording and playback splicers.

[0064] Figure 1 : is a diagram of the architecture of a large screen splicing device provided by an embodiment of the present invention, such as Figure 1 As shown, it includes: N display screens, N distributed recording and broadcasting splicing devices and a recording and broadcasting management unit; wherein one display screen is connected to one distributed recording and broadcasting splicing device, and N is an integer greater than 1; including:

[0065] The recording and broadcasting management unit is used to receive control information input by the user, and convert the control information into corresponding control instructions and send them to N distributed recording and broadcasting splicers through the network; the control information includes the user's visual configuration information of the output screen layout of the N distributed recording and broadcasting splicers and the recording and broadcasting function control information of the N distributed recording and broadcasting splicers;

[0066] Each distributed recording and broadcasting splicer is used to receive at least one video stream in real time according to the visualization configuration information, decode the received video stream, and complete windowing, scaling, translation or local magnification processing of the decoded picture, obtain the picture to be displayed by each video stream in the current distributed recording and broadcasting splicer, and output the picture to the display screen connected to it through the video interface;

[0067] Each display screen is used to display the images it receives. N display screens are spliced ​​into a large screen. Each video stream can be played across the display screens. Multiple videos can be played on one display screen and the multiple videos can be presented separately in PIP or PBP mode.

[0068] Each distributed recording and broadcasting splicer is used to control the display screen connected thereto to record the entire displayed screen according to the recording and broadcasting function control information, obtain a recording file of the screen screen, and locally save the recording file and a key time index file; the recording file includes at least one picture group GOP, and the key time index file includes: the timestamp of the I frame in each GOP, the network relative delay information of each GOP at the time of display screen playback, and the storage location information of the recording file;

[0069] Each distributed recording and broadcasting splicer is used to determine the playback time point of the video file according to the recording and broadcasting function control information, find the corresponding GOP according to the playback time point and the saved I frame timestamp information, and determine the frame playback interval of the GOP according to the corresponding network relative delay;

[0070] N distributed recording and playback splicers are used to synchronously play back the GOP corresponding to the local video file according to the corresponding frame playback interval under the control of the secondary synchronization mechanism, so as to complete the synchronous playback of the large-screen video.

[0071] Optionally, N distributed recording and playback splicers start playback from the GOP corresponding to the local video file synchronously according to the corresponding frame playback interval under the control of the secondary synchronization mechanism, specifically:

[0072] The first-level synchronization mechanism is that N distributed recording and broadcasting splicers use the synchronization bus to synchronize their own system clocks; the second-level synchronization mechanism is that each distributed recording and broadcasting splicer uses the network interface and uses the real-time network relative delay in the key time index file to synchronize the video playback; among them, when each distributed recording and broadcasting splicer records the screen displayed on each display screen as a video file, it associates the timestamp information of the I frame in each group of GOP of the video, the location information of the video file to which it belongs, and the real-time network relative delay and records them as a key time index file;

[0073] Optionally, the clock of one of the N distributed recording and broadcasting splicers is used as the clock reference, and other distributed recording and broadcasting splicers dynamically monitor their own network delays compared to the distributed recording and broadcasting splicer that provides the clock reference through the synchronization bus to determine the real-time network delay of the video files of each distributed recording and broadcasting splicer.

[0074] Optionally, when each distributed recording and playback splicer synchronously plays back the locally saved video files, it reads the corresponding key time index file and quickly locates the position information in the video file through the timestamp information of the target I frame; it dynamically adjusts the frame interval of the video stream playback through the real-time network relative delay associated with the I frame, thereby achieving accurate synchronization of the playback images of all distributed recording and playback splicers.

[0075] The present invention provides a large-screen splicing device supporting synchronous recording and broadcasting, which ensures the synchronization of the system clock of the splicer and the synchronous control of the real-time splicing screen and the playback screen through a secondary synchronization mechanism. During synchronous playback, the distributed recording and broadcasting splicer does not need to decode and buffer the video file, and can realize rapid retrieval and positioning through the key time index file established during synchronous recording, thereby achieving accurate synchronization of the playback of each screen of the splicing screen.

[0076] In this embodiment, all distributed recording and broadcasting splicers use HiSilicon Hi3536 HiSilicon embedded image processor as the main chip. The Ethernet interface of Hi3536 chip can realize external access to the streaming media communication exchange network, and supports nandflash and mSata interfaces, which can support up to 2TB local video storage. The built-in VDEC decoding unit can realize H264 / H265 decoding and display functions.

[0077] The RS485 communication interface chip integrated in each distributed recording and broadcasting splicing device can realize the synchronous bus as the Hi3536 system clock. The distributed recording and broadcasting splicing device as the clock reference is the master node on the synchronous bus and is in the sending state; other distributed recording and broadcasting splicing devices are slave nodes in the receiving state; all distributed recording and broadcasting splicing devices provide 1 HDMI video interface to the outside world for access to the splicing large screen.

[0078] The synchronization method of the distributed recording and broadcasting splicer adopts a two-level synchronization mechanism, which mainly includes two parts: system clock synchronization of the distributed recording and broadcasting splicer and video recording and playback synchronization.

[0079] Figure 2 Schematic diagram of display and playback of N display screens combined into a large screen according to an embodiment of the present invention; Figure 2 As shown, 16 display screens are spliced ​​into a large screen, and three video sources are played and displayed on the large screen. Each video source can be played across multiple display screens. Multiple display screens respectively play the images of different areas of the video source to combine into a complete image of the video source.

[0080] in, Figure 2 Among the 16 display screens shown, some display screens do not play any video source, some display screens only play one video source and only display part of the picture of the corresponding video source, and some display screens play at least 2 video sources, and different video sources can be presented separately in PIP or PBP mode.

[0081] During the recording and broadcasting stage designed in the embodiment of the present invention, it is necessary to control each of the 16 display screens to record its entire display screen, so that later on, according to the playback requirements, the 16 display screens can be controlled to play their respective video files to achieve synchronous playback of the entire large-screen video.

[0082] Figure 3 1 is a flowchart of the steps of implementing the distributed recording and broadcasting splicing synchronization method provided by an embodiment of the present invention; Figure 3 As shown, the following implementation steps are used to implement the synchronous video recording and playback function of the splicer:

[0083] Step 1: Synchronize the system clock of the synchronous recorder through the synchronous bus;

[0084] Step 2: Regularly perform network communication detection with the distributed recording and broadcasting splicing device that provides the clock reference, and record the real-time network relative delay;

[0085] Step 3: When receiving the network video stream, when an I frame appears in each GOP, record the current real-time network relative delay and the current OPT timestamp information, and save them as a key time index file;

[0086] Step 4: When receiving the synchronous playback instruction from the recording and broadcasting management unit, all distributed recording and broadcasting splicers find the locally saved target video file and the associated key time index file through the query conditions;

[0087] Step 5: Decode and play the target video file from the first I frame, and control the frame playback interval according to the real-time network relative delay and timestamp information recorded in the key time index file;

[0088] Step 6: When receiving a playback progress change instruction from the recording and playback management unit, such as fast forward, double speed, and dragging the progress bar, quickly locate the corresponding I frame position through the I frame timestamp contained in the key time index file and the position information of the corresponding video file;

[0089] Step 7: Decode and play the target frame found in step 6;

[0090] Step 8: Control the frame playback interval according to the real-time network relative delay and timestamp information recorded in the key time index file.

[0091] Specifically, the main synchronization implementation method of the Hi3536 system clock is as follows: the distributed recording and broadcasting splicing device, which serves as the clock reference, sends synchronization pulses to the outside at regular intervals of 1S, and at the same time sends the current RTC time code data through the streaming media communication exchange network. After receiving the pulses, other distributed recording and broadcasting splicing devices perform local RTC synchronization operations based on the latest time code currently received.

[0092] Video recording and playback synchronization mainly uses key time index files for synchronization. First, when each distributed recording and playback splicer receives a video stream through the streaming media communication exchange network, it receives a set of compressed GOP video streams, which contain frame type information and OPT timestamps.

[0093] In this embodiment, according to the video data Nalu header format of H264, the beginning of each frame is generally the first frame (00 0000 01) or other frames (00 00 01), and then the frame type is indicated. According to the encoding rules, the frame type nalType is a 5-bit identifier. When nalType is 5, 7, 8, or 2, it can be considered as an I frame, and the OPT information of the frame is stored in the key time index file.

[0094] Since the images received and processed by each distributed recording and broadcasting splicer may be different, and the I frame itself is the frame with the most pixel information and the largest amount of data in the GOP video image, when the I frame appears, the network relative delay is also very important for the synchronization of image recording and playback. The distributed recording and broadcasting splicer regularly performs network communication detection relative to the distributed recording and broadcasting splicer as the clock reference, and records the real-time network relative delay.

[0095] For real-time video stream splicing display applications, the decoding and playback intervals of the images are synchronously controlled through the I-frame timestamp information and the real-time network relative delay.

[0096] When recording the video screen and storing all streams in files, the location information of the current I frame in the key time index file is also recorded to facilitate the fseek call of the file to achieve fast positioning later. The location information is based on the beginning of the file. Each additional record is increased according to the size of the recorded data, and the offset of the location information pointer is used as the location information of the next record. This information is stored in the key time index file together with the timestamp information of the I frame and the real-time network relative delay information. Figure 4 It is a schematic diagram of the structure of the key time index file.

[0097] The synchronous playback flow chart of the video file is as follows: Figure 5 When receiving the synchronous playback command from the recording and broadcasting management unit, all the distributed recording and broadcasting splicers first extract the search condition time field, then find the file of the corresponding time period in the file list, and open the associated key time index file.

[0098] Find the first I frame of the file (the corresponding position information is the file header) and start decoding and playing, then extract the associated real-time network relative delay and timestamp information as the playback control interval. Since there may be network delay when receiving the video stream, and there is no network delay when playing back the local video file, it is necessary to adjust the playback interval based on the received stream timestamp and network delay. For non-clock-based recording and broadcasting splicers, it is necessary to subtract the real-time network relative delay from the current OPT timestamp to ensure that all recording and broadcasting splicers are accurately synchronized with the playback screen of the recording and broadcasting splicer that serves as the clock reference during playback.

[0099] Figure 6 Schematic diagram of the distributed recording and broadcasting splicing device architecture provided by an embodiment of the present invention; Figure 6 As shown, including:

[0100] The receiving unit 610 is used to receive control information sent by the user; the control information includes the user's visualization configuration information of the output screen layout of the distributed recording and broadcasting splicing device and the recording and broadcasting function control information of the distributed recording and broadcasting splicing device;

[0101] A receiving unit 610 is configured to receive at least one video stream in real time according to the visualization configuration information;

[0102] The processing unit 620 is used to decode the received video stream according to the visualization configuration information, and complete the windowing, scaling, translation or partial zooming processing of the decoded picture to obtain the picture to be displayed by each video stream on the distributed splicing recorder;

[0103] The sending unit 630 is used to output the picture decoded by the processing unit to the display screen connected to the distributed recording and broadcasting splicer through the video interface, so that the display screen displays the received picture; the display screen is N pieces, one display screen is connected to one distributed recording and broadcasting splicer, and the N display screens are spliced ​​into a whole large screen, each video stream can be played across the display screens, and multiple videos can be played on one display screen and the multiple videos can be presented in PIP or PBP mode respectively;

[0104] The processing unit 620 is used to control the display screen connected thereto to record the entire displayed screen according to the recording and broadcasting function control information, obtain a recording file of the screen screen, and locally save the recording file and a key time index file; the recording file includes at least one picture group GOP, and the key time index file includes: the timestamp of the I frame in each GOP, the network relative delay information of each GOP at the time of display screen playback, and the storage location information of the recording file;

[0105] The processing unit 620 is used to determine the playback time point of the video file according to the recording and broadcasting function control information, find the corresponding GOP according to the playback time point and the stored I frame timestamp information, and determine the frame playback interval of the GOP according to the corresponding network relative delay, so as to decode the local video file according to the corresponding frame playback interval under the control of the secondary synchronization mechanism to obtain the corresponding playback picture;

[0106] The sending unit 630 is used to send the playback picture decoded by the processing unit to the display screen connected to the distributed recording and broadcasting splicing device, so that the display screen displays the received playback picture, so that N display screens can synchronously play back the large-screen video.

[0107] The synchronization unit 640 is used to provide a synchronization bus interface, so that the distributed recording and broadcasting splicing device is connected to other N-1 distributed recording and broadcasting splicing devices through a synchronization bus; the distributed recording and broadcasting splicing device and other N-1 distributed recording and broadcasting splicing devices together form N distributed recording and broadcasting splicing devices, so as to be connected to the N display screens respectively;

[0108] The processing unit 620, under the control of the secondary synchronization mechanism, decodes the local video file according to the corresponding frame playback interval to obtain the corresponding playback picture. Specifically, the processing unit realizes the system clock synchronization of the N distributed recording and playback splicers through the synchronization bus interface of the synchronization unit, and the processing unit obtains the corresponding playback picture through the network interface and by using the real-time network relative delay in the key time index file; wherein, when recording the pictures displayed on each display screen as a video file, the processing unit associates the timestamp information of the I frame in each group GOP of the video, the location information of the corresponding video file and the real-time network relative delay and records them as a key time index file.

[0109] Processing unit 620 is used to read the corresponding key time index file when reading the locally stored video file for synchronous playback, and quickly locate the position information in the video file through the timestamp information of the target I frame; dynamically adjust the frame interval of the video stream playback through the real-time network relative delay associated with the I frame, so as to achieve accurate synchronization of the playback screen of all distributed recording and playback splicing devices.

[0110] Figure 7 is a flow chart of a video playback control method provided by an embodiment of the present invention, and the video playback control method is applied to a distributed recording and broadcasting splicer or any other component, device, system or equipment that implements the above-mentioned distributed recording and broadcasting splicer, such as Figure 7 As shown, the following steps are included:

[0111] S701, receiving control information sent by a user; the control information includes the user's visualization configuration information of the output screen layout of the distributed recording and broadcasting splicing device and the recording and broadcasting function control information of the distributed recording and broadcasting splicing device;

[0112] S702, receiving at least one video stream in real time according to the visualization configuration information, decoding the received video stream, and completing windowing, scaling, panning or partial zooming processing on the decoded picture to obtain pictures to be displayed by the distributed splicing recorder and broadcaster used in the method for each video stream;

[0113] S703, sending the decoded picture to the corresponding display screen so that the display screen displays the received picture; the display screen is N pieces, one display screen is connected to a distributed recording and broadcasting splicing device, the N display screens are spliced ​​into a whole large screen, each video stream can be played across the display screens, and multiple videos can be played on one display screen and the multiple videos can be presented in PIP or PBP mode respectively;

[0114] S704, controlling the corresponding display screen to record the entire displayed screen according to the recording and broadcasting function control information, obtaining a recording file of the display screen, and locally saving the recording file and a key time index file; the recording file includes at least one group of pictures GOP, and the key time index file includes: a timestamp of an I frame in each GOP, network relative delay information of each GOP at the time of display screen playback, and storage location information of the recording file;

[0115] S705, determining the playback time point of the video file according to the recording and playback function control information, finding the corresponding GOP according to the playback time point and the stored I-frame timestamp information, and determining the frame playback interval of the GOP according to the corresponding network relative delay, so as to obtain the corresponding playback picture by decoding from the local video file according to the corresponding frame playback interval under the control of the secondary synchronization mechanism;

[0116] S706, sending the decoded playback picture to the corresponding display screen, so that the display screen displays the received playback picture, so that N display screens can synchronously play back the large-screen video.

[0117] It is understandable that the above Figure 6 Each unit and Figure 7 The detailed functional implementation of each step can be found in the introduction of the aforementioned device and method embodiments, which will not be repeated here.

[0118] In addition, an embodiment of the present invention provides another video playback control system, which includes: a memory and a processor;

[0119] The memory is used to store computer programs;

[0120] The processor is used to implement the video playback control method in the above embodiment when executing the computer program.

[0121] The video playback control system may be a distributed recording and broadcasting splicer, or any other component, device, system or equipment that can implement the above-mentioned distributed recording and broadcasting splicer.

[0122] In addition, the present invention also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the video playback control method in the above embodiment is implemented.

[0123] Based on the method in the above embodiment, an embodiment of the present invention provides a computer program product. When the computer program product runs on a processor, the processor executes the video playback control method in the above embodiment.

[0124] Based on the method in the above embodiment, the embodiment of the present invention further provides a chip, including one or more processors and an interface circuit. Optionally, the chip may also include a bus. Among them:

[0125] The processor may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in the processor or an instruction in the form of software. The above processor can be a general-purpose processor, a digital communicator (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The disclosed methods and steps in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc.

[0126] The interface circuit can be used to send or receive data, instructions or information. The processor can use the data, instructions or other information received by the interface circuit to process it, and can send the processing completion information through the interface circuit.

[0127] Optionally, the chip further includes a memory, which may include a read-only memory and a random access memory, and provides operation instructions and data to the processor. A portion of the memory may also include a non-volatile random access memory (NVRAM).

[0128] Optionally, the memory stores executable software modules or data structures, and the processor can perform corresponding operations by calling operation instructions stored in the memory (the operation instructions can be stored in the operating system).

[0129] Optionally, the interface circuit can be used to output the execution result of the processor.

[0130] It should be noted that the corresponding functions of the processor and the interface circuit can be implemented through hardware design, software design, or a combination of hardware and software, and there is no limitation here.

[0131] It should be understood that each step of the above method embodiment can be completed by a hardware-based logic circuit or a software-based instruction in a processor.

[0132] It is understandable that the size of the sequence number of each step in the above embodiment does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application. In addition, in some possible implementations, each step in the above embodiment can be selectively executed according to actual conditions, and can be partially executed or fully executed, which is not limited here.

[0133] It is understood that the processor in the embodiments of the present application may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. The general-purpose processor may be a microprocessor or any conventional processor.

[0134] The method steps in the embodiments of the present application can be implemented by hardware or by a processor executing software instructions. The software instructions can be composed of corresponding software modules, and the software modules can be stored in random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, mobile hard disks, CD-ROMs, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an ASIC.

[0135] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions may be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state disk (SSD)), etc.

[0136] It will be easily understood by those skilled in the art that the above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A large-screen splicing device supporting recording and broadcasting, characterized in that: include: N display screens, N distributed recording and broadcasting splicing devices, and a recording and broadcasting management unit; wherein one display screen is connected to one distributed recording and broadcasting splicing device, and N is an integer greater than 1; including: The recording and broadcasting management unit is used to receive control information input by the user, and convert the control information into corresponding control instructions and send them to N distributed recording and broadcasting splicers through the network; the control information includes the user's visual configuration information of the output screen layout of the N distributed recording and broadcasting splicers and the recording and broadcasting function control information of the N distributed recording and broadcasting splicers; Each distributed recording and broadcasting splicer is used to receive at least one video stream in real time according to the visualization configuration information, decode the received video stream, and complete windowing, scaling, translation or local magnification processing of the decoded picture, obtain the picture to be displayed by each video stream in the current distributed recording and broadcasting splicer, and output the picture to the display screen connected to it through the video interface; Each display screen is used to display the images it receives. N display screens are spliced ​​into a large screen. Each video stream can be played across the display screens. Multiple videos can be played on one display screen and the multiple videos can be presented separately in PIP or PBP mode. Each distributed recording and broadcasting splicer is used to control the display screen connected thereto to record the entire displayed screen according to the recording and broadcasting function control information, obtain a recording file of the screen screen, and locally save the recording file and a key time index file; the recording file includes at least one picture group GOP, and the key time index file includes: the timestamp of the I frame in each GOP, the network relative delay information of each GOP at the time of display screen playback, and the storage location information of the recording file; Each distributed recording and broadcasting splicer is used to determine the playback time point of the video file according to the recording and broadcasting function control information, find the corresponding GOP according to the playback time point and the saved I frame timestamp information, and determine the frame playback interval of the GOP according to the corresponding network relative delay; N distributed recording and playback splicers are used to synchronously play back the GOP corresponding to the local video file according to the corresponding frame playback interval under the control of the secondary synchronization mechanism, so as to complete the synchronous playback of the large-screen video; The N distributed recording and broadcasting splicers, under the control of the secondary synchronization mechanism, synchronously play back from the GOP corresponding to the local video file according to the corresponding frame playback interval, specifically: the first-level synchronization mechanism is that the N distributed recording and broadcasting splicers realize their own system clock synchronization through the synchronization bus; the second-level synchronization mechanism is that each distributed recording and broadcasting splicer uses the network interface and uses the real-time network relative delay in the key time index file to synchronously play the video; wherein, when each distributed recording and broadcasting splicer records the pictures displayed on each display screen as a video file, the timestamp information of the I frame in each group of GOP of the video, the location information of the corresponding video file and the real-time network relative delay are associated and recorded as a key time index file; the clock of one distributed recording and broadcasting splicer among the N distributed recording and broadcasting splicers is used as the clock reference, and the other distributed recording and broadcasting splicers dynamically monitor their own network delay compared with the distributed recording and broadcasting splicer that provides the clock reference through the synchronization bus to determine the real-time network delay of the video file of each distributed recording and broadcasting splicer.

2. The large screen splicing device according to claim 1, characterized in that: When each distributed recording and playback splicer synchronously plays back the locally saved video files, it reads the corresponding key time index file and quickly locates the position information in the video file through the timestamp information of the target I frame; The frame interval of video stream playback is dynamically adjusted through the real-time network relative delay associated with the I frame to achieve accurate synchronization of the playback images of all distributed recording and playback splicing devices.

3. A distributed recording and broadcasting splicer, characterized in that: include: A receiving unit, used to receive control information sent by a user; the control information includes the user's visualization configuration information of the output screen layout of the distributed recording and broadcasting splicing device and the recording and broadcasting function control information of the distributed recording and broadcasting splicing device; A receiving unit, configured to receive at least one video stream in real time according to the visualization configuration information; A processing unit, used to decode the received video stream according to the visualization configuration information, and simultaneously complete windowing, scaling, translation or partial zooming processing of the decoded picture to obtain the picture to be displayed by each video stream on the distributed splicing recorder; The sending unit is used to output the picture decoded by the processing unit to the display screen connected to the distributed recording and broadcasting splicing device through the video interface, so that the display screen displays the received picture; the display screen is N pieces, one display screen is connected to one distributed recording and broadcasting splicing device, and the N display screens are spliced ​​into a whole large screen, each video stream can be played across the display screens, and multiple videos can be played on one display screen, and the multiple videos can be presented separately in PIP or PBP mode; A processing unit, configured to control the display screen connected thereto to record the entire displayed screen according to the recording and broadcasting function control information, obtain a recording file of the screen screen, and locally save the recording file and a key time index file; the recording file includes at least one group of pictures GOP, and the key time index file includes: a timestamp of an I frame in each GOP, network relative delay information of each GOP at the time of display screen playback, and storage location information of the recording file; A processing unit is used to determine the playback time point of the video file according to the recording and broadcasting function control information, find the corresponding GOP according to the playback time point and the saved I frame timestamp information, and determine the frame playback interval of the GOP according to the corresponding network relative delay, so as to obtain the corresponding playback picture by decoding from the local video file according to the corresponding frame playback interval under the control of the secondary synchronization mechanism; A sending unit is used to send the playback picture decoded by the processing unit to the display screen connected to the distributed recording and broadcasting splicing device, so that the display screen displays the received playback picture, so that N display screens can synchronously play back the large-screen video; A synchronization unit, used for providing a synchronization bus interface, so that the distributed recording and broadcasting splicing device is connected to other N-1 distributed recording and broadcasting splicing devices through a synchronization bus; the distributed recording and broadcasting splicing device and other N-1 distributed recording and broadcasting splicing devices constitute a total of N distributed recording and broadcasting splicing devices, so as to be connected to the N display screens respectively; The processing unit, under the control of the secondary synchronization mechanism, decodes the local video file according to the corresponding frame playback interval to obtain the corresponding playback picture, specifically: the processing unit realizes the system clock synchronization of the N distributed recording and playback splicing devices through the synchronous bus interface of the synchronization unit, and the processing unit obtains the corresponding playback picture through the network interface and the real-time network relative delay in the key time index file; wherein, when recording the pictures displayed on each display screen as a video file, the processing unit associates the timestamp information of the I frame in each group GOP of the video, the location information of the video file to which it belongs, and the real-time network relative delay and records them as the key time index file; The clock of one of the N distributed recording and broadcasting splicers is used as the clock reference, and the processing units of other distributed recording and broadcasting splicers dynamically monitor their own network delays compared with the distributed recording and broadcasting splicer providing the clock reference through the synchronization unit synchronization bus interface to determine the real-time network delay of the video files of each distributed recording and broadcasting splicer.

4. The distributed recording and broadcasting splicing device according to claim 3, characterized in that: The processing unit is used to read the corresponding key time index file when reading the locally saved video file for synchronous playback, and quickly locate the position information in the video file through the timestamp information of the target I frame; The frame interval of video stream playback is dynamically adjusted through the real-time network relative delay associated with the I frame to achieve accurate synchronization of the playback images of all distributed recording and playback splicing devices.

5. A video playback control method, the video playback control method is applied to a distributed recording and playback splicing device, characterized in that: The steps include: Receive control information sent by a user; the control information includes the user's visualization configuration information of the output screen layout of the distributed recording and broadcasting splicing device and the recording and broadcasting function control information of the distributed recording and broadcasting splicing device; At least one video stream is received in real time according to the visualization configuration information, the received video stream is decoded, and windowing, scaling, panning or partial zooming of the decoded picture is completed at the same time, so as to obtain the picture to be displayed by each video stream in the distributed splicing recorder applied by the method; Send the decoded picture to the corresponding display screen so that the display screen displays the received picture; the display screen is N pieces, one display screen is connected to a distributed recording and broadcasting splicer, and the N display screens are spliced ​​into a whole large screen. Each video stream can be played across the display screens. Multiple videos can be played on one display screen and the multiple videos can be presented separately in PIP or PBP mode; According to the recording and broadcasting function control information, the corresponding display screen is controlled to record the entire displayed picture, a recording file of the display screen is obtained, and the recording file and the key time index file are locally saved; the recording file includes at least one picture group GOP, and the key time index file includes: the timestamp of the I frame in each GOP, the network relative delay information of each GOP at the time of display screen playback, and the storage location information of the recording file; Determine the playback time point of the video file according to the recording and broadcasting function control information, find the corresponding GOP according to the playback time point and the saved I frame timestamp information, and determine the frame playback interval of the GOP according to the corresponding network relative delay, so as to obtain the corresponding playback picture by decoding from the local video file according to the corresponding frame playback interval under the control of the secondary synchronization mechanism; Send the decoded playback picture to the corresponding display screen so that the display screen displays the received playback picture, so that N display screens can synchronously play back the large-screen video; The secondary synchronization mechanism is as follows: The first-level synchronization mechanism is that N distributed recording and broadcasting splicing devices realize their own system clock synchronization through a synchronization bus; the N distributed recording and broadcasting splicing devices are respectively connected to the N display screens; The second-level synchronization mechanism is that each distributed recording and broadcasting splicer obtains the corresponding playback screen through the network interface and uses the real-time network relative delay decoding in the key time index file; wherein, when each distributed recording and broadcasting splicer records the screen displayed on each display screen as a video file, it associates the timestamp information of the I frame in each group of GOP of the video, the location information of the corresponding video file and the real-time network relative delay and records them as a key time index file; The clock of one of the N distributed recording and broadcasting splicers is used as a clock reference, and other distributed recording and broadcasting splicers dynamically monitor their own network delays compared with the distributed recording and broadcasting splicer that provides the clock reference through a synchronous bus to determine the real-time network delay of the video files of each distributed recording and broadcasting splicer.

6. A video playback control system, characterized in that: include: Memory and processor; The memory is used to store computer programs; The processor is used to implement the video playback control method as claimed in claim 5 when executing the computer program.

7. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by the processor, the video playback control method as claimed in claim 5 is implemented.

Images