Splicing screen synchronous display method, electronic device and splicing screen system

By adding time marks to the video stream of the stitching screen and determining the delayed display time based on the screen image captured by the camera, the problem of out-of-synchronization of the stitching screen display is solved, achieving higher synchronization and user experience.

CN114816286BActive Publication Date: 2025-08-15HUAWEI TECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202110088553.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-01-22
Publication Date
2025-08-15
Estimated Expiration
2041-01-22

AI Technical Summary

Technical Problem

When the splicing screen displays video frame images, the display is out of synchronization due to the difference in processing performance and data transmission delay of each sub-screen, which affects the user's viewing experience.

Method used

Add time marks to multiple target video frames of the video stream, take the screen image of the spliced screen through the camera, determine the delayed display time of each sub-screen based on the time mark, and send the delayed display time to the sub-screen to achieve synchronous display.

Benefits of technology

Improves the synchronization of video frame images displayed on each sub-screen in the splicing screen, and improves the user's viewing experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114816286B_ABST
    Figure CN114816286B_ABST
Patent Text Reader

Abstract

The present application provides a method for synchronous display of a spliced screen, an electronic device and a spliced screen system, and relates to the field of display technology, wherein the spliced screen system includes an electronic device with a shooting function and a spliced screen including multiple sub-screens, and the method includes: the electronic device adds time marks to multiple target video frames of the video stream during the process of transmitting the video stream to each sub-screen; each sub-screen synchronously displays the corresponding time mark when displaying the target video frame; then, the electronic device shoots the screen image of the spliced screen, determines the delayed display time of each sub-screen according to the time mark displayed by each sub-screen in the screen image, and then sends the corresponding delayed display time to each sub-screen; after each sub-screen receives the delayed display time, it delays the video frame to be displayed by the delayed display time before displaying it. The technical solution provided by the present application can improve the synchronization of the video frame images displayed by each sub-screen in the spliced screen, thereby improving the user's viewing experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of display technology, and in particular to a splicing screen synchronous display method, an electronic device, and a splicing screen system. Background Art

[0002] A spliced screen is a large screen formed by stitching together multiple sub-screens. When displaying an image, each sub-screen can display a portion of the image, and the images displayed by the sub-screens are stitched together to form the complete content of the sub-image. Based on these characteristics, a spliced screen can magnify high-definition video sources, providing users with a better visual experience in scenarios where multiple people are watching.

[0003] When a video splicing screen displays a video frame, each sub-screen typically processes its own image content in parallel. Due to differences in processing performance and data transmission latency between sub-screens, there may be display asynchrony when displaying the same frame, affecting the user's viewing experience. Summary of the Invention

[0004] In view of this, the present application provides a splicing screen synchronous display method, electronic device and splicing screen system, which are used to improve the synchronization of displaying video frame images on each sub-screen in the splicing screen, thereby enhancing the user's viewing experience.

[0005] To achieve the above objectives, in a first aspect, embodiments of the present application provide a method for synchronous display of connected screens, which is applied to a splicing screen system, wherein the splicing screen system includes an electronic device with a shooting function and a splicing screen including multiple sub-screens, and the method includes:

[0006] The electronic device adds time stamps to a plurality of target video frames of the video stream during the process of transmitting the video stream to each sub-screen;

[0007] Each sub-screen displays the corresponding time stamp synchronously when displaying the target video frame;

[0008] The electronic device captures the screen image of the spliced screen, determines the delayed display time of each sub-screen according to the time mark displayed on each sub-screen in the screen image, and then sends the corresponding delayed display time to each sub-screen;

[0009] After receiving the delayed display time, each sub-screen displays the video frame to be displayed after delaying the delayed display time.

[0010] The present embodiment provides a method for synchronous display of a spliced screen, in which an electronic device adds time marks to a plurality of target video frames, and the spliced screen synchronously displays the time marks of the target video frames when displaying these target video frames; in the process of displaying these target video frames on the spliced screen, the electronic device captures the screen image of the spliced screen through a camera, and then determines the delayed display time of each sub-screen according to the time marks displayed on each sub-screen in the captured screen image; after the electronic device sends the delayed display time to each sub-screen, each sub-screen delays the display of the video frame according to the corresponding delayed display time, so that each sub-screen in the spliced screen can achieve synchronous display when displaying subsequent video frames, thereby improving the user's viewing experience.

[0011] In a possible implementation of the first aspect, a shooting frame rate of the electronic device is higher than a screen refresh rate of each sub-screen, and capturing a screen image of the spliced screen and determining a delayed display time of each sub-screen based on a time stamp displayed by each sub-screen in the screen image include:

[0012] Continuously capture multiple frames of screen images for the spliced screen;

[0013] For each sub-screen, determining a target screen image of the sub-screen according to screen images involved when a video frame switching occurs in the multi-frame screen images, and identifying a time stamp of the sub-screen display in the target screen image;

[0014] The delayed display time of each sub-screen is determined according to the identified time stamp of each sub-screen, the frame number of the target screen image of each sub-screen in the captured multi-frame screen image and the capture frame rate.

[0015] In the above embodiment, by using a camera with a high shooting frame rate to capture multiple frames of screen images, and determining the delayed display time of each sub-screen based on the time mark displayed on each sub-screen in the multiple frames of screen images, the accuracy of the determined delayed display time can be improved.

[0016] In a possible implementation of the first aspect, the time mark is a timestamp, and the duration between the timestamps of two adjacent target video frames is a time base corresponding to a video frame rate of the video stream; and determining the delayed display time of each sub-screen based on the identified time mark of each sub-screen, a frame number of the target screen image of each sub-screen in the captured multiple frames of screen images, and the capture frame rate includes:

[0017] The following formula is used to determine the delayed display time of each sub-screen:

[0018]

[0019] Among them, t i Indicates the timestamp of the identified i-th sub-screen, n irepresents the frame number of the target screen image of the i-th sub-screen in the captured multi-frame screen image, f represents the shooting frame rate, T i Indicates the delayed display time of the i-th sub-screen, i is a positive integer less than or equal to M, M is the number of sub-screens contained in the splicing screen, n i is an integer greater than or equal to 0.

[0020] In the above implementation, the time mark adopts a timestamp, which can facilitate the calculation of the delayed display time.

[0021] In one possible implementation of the first aspect, the target screen image is the first screen image of the sub-screen after the first video frame switch occurs in the multiple screen images. This reduces algorithm complexity when determining the target screen image of each sub-screen based on screen images captured within a video frame switch cycle.

[0022] In a possible implementation of the first aspect, the number of frames of the screen image continuously captured by the electronic device is greater than or equal to the maximum number of frames of the screen image that can be captured by the electronic device within the display time of one video frame of any sub-screen.

[0023] In a possible implementation of the first aspect, each sub-screen displays a time stamp in a target area in the edge area of the screen. This can improve image display quality, and when identifying the time stamp, the electronic device can identify the target area, thereby improving recognition efficiency.

[0024] In a second aspect, an embodiment of the present application provides a splicing screen system, comprising: an electronic device with a shooting function and a splicing screen comprising a plurality of sub-screens, wherein:

[0025] The electronic device is used for: adding time stamps to a plurality of target video frames of the video stream during the process of transmitting the video stream to each sub-screen;

[0026] The sub-screen is used to: synchronously display the corresponding time mark when displaying the target video frame;

[0027] The electronic device is further used to: capture the screen image of the spliced screen, determine the delayed display time of each sub-screen according to the time mark displayed by each sub-screen in the screen image, and then send the corresponding delayed display time to each sub-screen;

[0028] The sub-screen is further used to: after receiving the delayed display time, display the video frame to be displayed after delaying the delayed display time.

[0029] In a possible implementation of the second aspect, the electronic device is specifically configured to:

[0030] Continuously capture multiple frames of screen images for the spliced screen;

[0031] For each sub-screen, determining a target screen image of the sub-screen according to screen images involved when a video frame switching occurs in the multi-frame screen images, and identifying a time stamp of the sub-screen display in the target screen image;

[0032] The delayed display time of each sub-screen is determined according to the identified time stamp of each sub-screen, the frame number of the target screen image of each sub-screen in the captured multi-frame screen image and the capture frame rate.

[0033] In a possible implementation of the second aspect, the time mark is a timestamp, and the duration between the timestamps of two adjacent target video frames is a time base corresponding to a video frame rate of the video stream; and the electronic device is specifically configured to:

[0034] The following formula is used to determine the delayed display time of each sub-screen:

[0035]

[0036] Among them, t i Indicates the timestamp of the identified i-th sub-screen, n i represents the frame number of the target screen image of the i-th sub-screen in the captured multi-frame screen image, f represents the shooting frame rate, T i Indicates the delayed display time of the i-th sub-screen, i is a positive integer less than or equal to M, M is the number of sub-screens contained in the splicing screen, n i is an integer greater than or equal to 0.

[0037] In a possible implementation of the second aspect, the target screen image is a first frame screen image after a video frame switch occurs for the sub-screen for the first time in the multiple frames of screen images.

[0038] In a possible implementation of the second aspect, the number of frames of screen images continuously captured by the electronic device is greater than or equal to the maximum number of frames of screen images that can be captured by the electronic device within the display time of one video frame of any sub-screen.

[0039] In a possible implementation of the second aspect, each sub-screen displays a time marker in a target area in a screen edge area.

[0040] In a third aspect, an embodiment of the present application provides an electronic device, comprising: a memory and a processor, the memory being used to store a computer program; the processor being used to execute the method executed by the electronic device in the first aspect above when calling the computer program.

[0041] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the method performed by the electronic device in the first aspect above is implemented.

[0042] In a fifth aspect, an embodiment of the present application provides a computer program product. When the computer program product is run on an electronic device, the electronic device executes the method executed by the electronic device in the first aspect above.

[0043] In a sixth aspect, an embodiment of the present application provides a chip system, comprising a processor coupled to a memory, the processor executing a computer program stored in the memory to implement the method performed by the electronic device in the first aspect. The chip system may be a single chip or a chip module composed of multiple chips.

[0044] It can be understood that the beneficial effects of the second to sixth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] Figure 1 A schematic structural diagram of a splicing screen system provided in an embodiment of the present application;

[0046] Figure 2 A schematic diagram of image segmentation provided in an embodiment of the present application;

[0047] Figure 3 A schematic diagram of the splicing screen interface display provided in an embodiment of the present application;

[0048] Figure 4 A schematic diagram of the functional structure of the host provided in an embodiment of the present application;

[0049] Figure 5 A schematic diagram of the functional structure of the sub-screen provided in an embodiment of the present application;

[0050] Figure 6 A schematic diagram of a flow chart of a method for synchronous display of a spliced screen provided in an embodiment of the present application;

[0051] Figure 7 A schematic diagram of the module interaction process between the host and the splicing screen provided in an embodiment of the present application;

[0052] Figure 8 A schematic diagram showing the time stamp display position of each sub-screen in the spliced screen provided in an embodiment of the present application;

[0053] Figure 9 A schematic diagram of the timestamp recognition result provided in an embodiment of the present application;

[0054] Figure 10 A schematic diagram of a process for determining a delayed display time according to an embodiment of the present application;

[0055] Figure 11 for Figure 10 Schematic diagram of the results after delayed display on each sub-screen;

[0056] Figure 12 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0057] The following describes the embodiments of the present application in conjunction with the accompanying drawings. The terms used in the implementation methods of the embodiments of the present application are only used to explain the specific embodiments of the present application and are not intended to limit the present application.

[0058] First, the splicing screen system involved in the embodiment of the present application is described. Figure 1 , Figure 1 This is a schematic diagram of the structure of the splicing screen system provided in an embodiment of the present application.

[0059] like Figure 1 As shown, the splicing screen system may include a host 100 and a splicing screen 200. After the host 100 establishes a connection with the splicing screen 200, it may send a video stream to the splicing screen 200, and the splicing screen 200 may display the received video stream.

[0060] The communication connection between the host 100 and the splicing screen 200 can be established in a wired manner, such as a cable; or in a wireless manner, such as a wireless fidelity (Wi-Fi) network, to improve the convenience of connection. In this embodiment, wireless connection is used as an example for illustrative description.

[0061] The host 100 may be an electronic device such as a TV box, a mobile phone or a tablet.

[0062] The splicing screen 200 may include a plurality of sub-screens arranged in an array, and the number of sub-screens may be set as required. Figure 1 In the example, four sub-screens are used for illustration. Each sub-screen may include a processing unit and a display screen. The processing unit may parse and process the received video stream and then transmit the image to the display screen for display.

[0063] The processing unit may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, and / or a digital signal processor (DSP). Different processing units may be independent devices or integrated together.

[0064] The display screen can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Mini LED, a Micro LED, a quantum dot light-emitting diode (QLED), etc.

[0065] When displaying a video frame image, each sub-screen can display a different part of a frame image, and the image contents displayed by each sub-screen are spliced together to form the complete content of a frame image.

[0066] Correspondingly, when displaying a frame of image, it is necessary to first segment the frame of image. Specifically, the image segmentation can be performed according to the position of the sub-screen. Figure 2 The image segmentation diagram provided in the embodiment of the present application is as follows: Figure 2 As shown, a video frame image of 800×600 pixels, each sub-screen displays image content of 400×300 pixels, sub-screen 1 at the upper left corner displays the S1 part of the frame image, sub-screen 2 at the upper right corner displays the S2 part of the frame image, sub-screen 3 at the lower left corner displays the S3 part of the frame image, and sub-screen 4 at the lower right corner displays the S4 part of the frame image.

[0067] In specific implementation, image segmentation can be performed on the host 100 side or on the splicing screen 200 side. The specific selection can be made according to needs, and this embodiment does not specifically limit this.

[0068] Among them, if image segmentation is performed on the host 100 side, the host 100 can obtain the position and address information of each sub-screen when establishing a connection. In the process of sending video data, each frame of the image can be segmented according to the position of each sub-screen, and then each part of the image content is packaged, and the corresponding data packet is sent to each sub-screen according to the address information of each sub-screen; or the correspondence between the segmented image content and the sub-screen can be marked in the same data packet, and then the data packet can be multicast or broadcast to each sub-screen in the splicing screen 200. After each sub-screen receives the data packet, it can extract the corresponding image content according to the correspondence.

[0069] If image segmentation is performed at the splicing screen 200, the host 100 can multicast or broadcast the video frame that has not been segmented to the splicing screen 200. After receiving the video frame, each sub-screen can segment the corresponding image content from the received video frame according to its own position.

[0070] It is understandable that if the video frame is large, the host 100 may split the video frame into multiple data packets for transmission when multicasting or broadcasting the video frame.

[0071] In addition, in this embodiment, the host 100 can also communicate with the sub-screens through an intermediate device. For example, the splicing screen 200 can also include a main control device, and the main control device is electrically connected to each sub-screen respectively. The host 100 can establish a communication connection with the main control device to realize data transmission with the sub-screens. Among them, the main control device can be integrated into the splicing screen 200 or can be independent of the splicing screen 200; the image segmentation process can also be executed in the main control device, that is, the main control device can perform image segmentation on the video frame according to the position of each sub-screen after receiving the video frame sent by the host 100, and then transmit the corresponding image content to each sub-screen according to the address information of each sub-screen. For the sake of convenience, the embodiment of the present application takes the example of the host 100 directly establishing a communication connection with each sub-screen as an example for exemplary description.

[0072] Due to the differences in processing performance and data transmission delay of each sub-screen, there may be a display asynchrony problem when displaying the same frame of image. For example, the previous frame of image displays a circle, and the next frame of image displays a square. Figure 3 As shown, the video playback delay of sub-screen 4 is large and the display speed is slow. Sub-screen 1, sub-screen 2 and sub-screen 3 have displayed the next frame of image, but sub-screen 4 is displaying the previous frame of image, which will affect the user's viewing experience.

[0073] In order to improve the synchronization of the video frame images displayed by each sub-screen of the splicing screen 200, in this embodiment, the host 100 can mark some video frames (called target video frames) with timestamps and can be configured with a camera. In the process of the splicing screen 200 displaying these target video frames, the host 100 can capture the screen image of the splicing screen 200 through the camera, and determine the frame alignment time (called delayed display time) that each sub-screen needs to wait based on the difference in the timestamps displayed by each sub-screen in the captured screen image; each sub-screen can cache the video frames according to the corresponding delayed display time to achieve synchronous display of the splicing screen.

[0074] In order to realize the above functions, the host 100 and the splicing screen 200 can add relevant functional modules. Figure 4 The functional structure diagram of the host provided in the embodiment of the present application is as follows: Figure 4As shown, the host 100 may include a clock synchronization module 110, an image recognition module 120, and an image sending module 130. The clock synchronization module 110 is used to add a timestamp to target video frames to mark them; the image recognition module 120 is used to call a camera to capture screen images, perform image recognition on the captured screen images, and determine the delayed display time of each sub-screen based on the recognition results; and the image sending module 130 is used to package and send video frames.

[0075] Figure 5 A schematic diagram of the functional structure of the sub-screen provided in the embodiment of the present application is shown as follows: Figure 5 As shown, the sub-screen includes the aforementioned processing unit 210 and display screen 220. The processing unit 210 may include an image receiving module 211 and an image synchronization module 212. The image receiving module 211 is used to receive and parse video frames and timestamps; the image synchronization module 212 is used to add the parsed timestamps to the video layer and then transmit them to the display screen for display. Furthermore, the image synchronization module 212 may also delay the display of video frames according to the delay display time.

[0076] Those skilled in the art can clearly understand that, for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other and are not used to limit the scope of protection of this application.

[0077] In the embodiment of the present application, the host 100 can periodically perform synchronization calibration of the splicing screen 200 while the splicing screen 200 is displaying a video, so as to better improve the synchronization display effect of the splicing screen 200. The synchronization calibration and display process of the splicing screen 200 are the same each time, and the synchronization calibration and display process of the splicing screen 200 is described below.

[0078] Figure 6 A flow chart of the method for synchronous display of a spliced screen provided in an embodiment of the present application is shown as follows: Figure 6 As shown, the method may include the following steps:

[0079] S100: The host sends a target video frame with a timestamp to each sub-screen.

[0080] Specifically, during the video stream playback process, the host can send each video frame to the splicing screen in the order in which the video frames are played in the video stream. During the video stream transmission process to each sub-screen, the host can add timestamps to multiple target video frames in the video stream.

[0081] When the host sends video frames to the sub-screen, it can add a timestamp to each video frame; or when starting a certain period of splicing screen synchronization and proofreading process, it can add a timestamp to a preset number of video frames (i.e., target video frames) sent subsequently to save processing resources and reduce the impact of the splicing screen on the video playback screen when displaying the timestamp. The preset number can be set to multiple frames as needed, and the specific size is not specifically limited in this embodiment.

[0082] In the specific implementation, such as Figure 7 As shown, the host can add a timestamp to the target video frame through the clock synchronization module (step S101). After the clock synchronization module adds the timestamp, it can transmit the timestamp addition result to the image sending module (step S102); after the image sending module receives the timestamp addition result, it can encapsulate the target video frame with the timestamp added, and then send the encapsulated data packet to the sub-screen (step S103).

[0083] The clock synchronization module may add the timestamp to the frame header of the target video frame when adding the timestamp, or may add the timestamp to the data packet when the image sending module encapsulates the data packet.

[0084] In specific implementation, the timestamp can be added to the frame header of the video frame or the destination field of the packet header of the data packet. For example, a timestamp field can be added to the Internet protocol (IP) header and the timestamp can be filled in the field.

[0085] As mentioned above, the same video frame may correspond to multiple data packets. For the same target video frame, the timestamps added in the corresponding data packets are the same.

[0086] The duration between the timestamps of two adjacent frames can be the time base corresponding to the video frame rate of the video stream (i.e., 1 / video frame rate). The rate at which the host sends video frames is generally consistent with the video frame rate of the video stream. At this time, the time synchronization module can add a timestamp based on the system time, for example, the system time can be used as the timestamp, or the part below the second in the system time can be used as the timestamp.

[0087] It is understood that the timestamp can also be other time markers that can be used to identify duration. For example, the timestamp of the first target video frame is 0, and the timestamp of the second target video frame is 1, where each time stamp unit represents the duration of the time base of the video stream. To facilitate the subsequent calculation of the delayed display time, this embodiment uses the example of marking the timestamp on the target video frame and the timestamp being the sub-second portion of the system time as an example for illustrative purposes.

[0088] S200 . Each sub-screen synchronously displays a corresponding timestamp when displaying a target video frame.

[0089] Each sub-screen in the spliced screen can receive the data packet corresponding to the target video frame through the image receiving module. After receiving the data packet, the image receiving module can parse the target video frame and timestamp in the data packet (step S104), and then transmit the parsed target video frame and timestamp to the image synchronization module (step S105).

[0090] The video image displayed on the display screen is formed by superimposing the contents displayed by layers such as the video layer and the subtitle layer. After the image synchronization module receives the target video frame and the timestamp, it can superimpose the timestamp on the video layer corresponding to the target video frame (step S106), and then transmit the layers corresponding to the target video frame to the display screen (step S107); the display screen superimposes the timestamp on the video layer corresponding to the target video frame (step S108).

[0091] The timestamp may be located in the subtitle layer or in a new layer added to the video layer. The specific selection may be made according to needs and is not particularly limited in this embodiment.

[0092] In addition, the timestamp can be displayed at any position of the sub-screen. In order to improve the image display effect, in this embodiment, the timestamp can be displayed in the screen edge area of the sub-screen; further, in order to facilitate subsequent host timestamp recognition, the timestamp can be located in a specific area of the screen edge area (called the target area).

[0093] For example Figure 8 As shown in , the target area is represented by a dotted box, sub-screen 1 can display a timestamp in the target area in the upper left corner, sub-screen 2 can display a timestamp in the target area in the upper right corner, sub-screen 3 can display a timestamp in the target area in the lower left corner, and sub-screen 4 can display a timestamp in the target area in the lower right corner.

[0094] S300: The host captures the screen image of the spliced screen, and determines the delayed display time of each sub-screen according to the timestamp displayed on each sub-screen in the screen image.

[0095] After the image sending module in the host sends the target video frame to each sub-screen, the image recognition module can call the camera to capture the screen image of the spliced screen, and then identify the timestamp displayed by each sub-screen in the screen image, and determine the delayed display time of each sub-screen based on the recognition result (step S109).

[0096] Specifically, the screen image includes the image content displayed on each sub-screen in the spliced screen. The image recognition module can perform timestamp recognition on the image area in the screen image corresponding to the target area of each sub-screen to improve recognition efficiency. Various current image text recognition algorithms can be used to recognize the timestamp in the screen image, and this embodiment does not specifically limit this.

[0097] Figure 9 A schematic diagram of the timestamp recognition result provided in the embodiment of this application is shown in FIG. Figure 9 As shown in the figure, assuming that the video frame rate of the video stream is 25 frames per second, the time base corresponding to the video frame rate is 0.04 seconds; in the screen image captured by the camera, the timestamp displayed on sub-screen 1 is 1.28, the timestamp displayed on sub-screen 2 is 1.24, the timestamp displayed on sub-screen 3 is 1.20, and the timestamp displayed on sub-screen 4 is 1.32, where the unit of the timestamp is seconds. It should be noted that Figure 9 It is mainly used to describe the timestamp displayed on each screen, not to indicate the display position of the timestamp.

[0098] According to the timestamps displayed on each sub-screen, sub-screen 3 displays the slowest video frames. To achieve a synchronous display effect, the other sub-screens (sub-screen 1, sub-screen 2, and sub-screen 4) can wait for a period of time (i.e., delayed display time) when sending and displaying video frames. The delayed display time for each sub-screen can be determined using the following formula:

[0099] T i =t i -min(t i ) (1)

[0100] Among them, t i The timestamp of the identified i-th sub-screen, T i Indicates the delayed display time of the i-th sub-screen, i is a positive integer less than or equal to M, and M is the number of sub-screens contained in the splicing screen ( Figure 9 The number of sub-screens shown is 4).

[0101] for Figure 9 The timestamps shown in the sub-screen 3 are 1.20, which is min(t i), according to the above formula (1), the delayed display time of sub-screen 1 is 1.28-1.20, that is, 0.08 seconds; the delayed display time of sub-screen 2 is 1.24-1.20, that is, 0.04 seconds; the delayed display time of sub-screen 3 is 1.20-1.20, that is, 0.00 seconds; the delayed display time of sub-screen 4 is 1.32-1.20, that is, 0.12 seconds.

[0102] According to the calculation results of the above-mentioned delayed display time, it can be known that the accuracy of the determined delayed display time is 0.04 seconds. Assuming that the screen refresh rate of the sub-screen is an integer multiple of the above-mentioned video frame rate, this duration is the playback duration of one frame of video image, that is, the switching period of the video frame. In the process of each sub-screen playing a video frame, due to the difference in video playback delay between sub-screens, one sub-screen may refresh the screen and display the next frame of video image while another sub-screen is displaying a certain frame of video image, that is, the difference in video playback delay between sub-screens may be less than the switching period of the video frame (i.e. 0.04 seconds). In order to improve the accuracy of the determined delayed display time, in this embodiment, a camera with a high shooting frame rate can be used to capture multiple frames of screen images, and the delayed display time of each sub-screen can be determined based on the timestamp displayed by each sub-screen in the multiple frames of screen images.

[0103] Specifically, within a video frame switching cycle, the more screen images the camera captures, the more it can distinguish the difference in video playback delay between sub-screens; the number of image frames that the camera can capture per unit time is related to the camera's shooting frame rate. The screen refresh rate of the sub-screen is usually higher than the video frame rate of the video stream. In this embodiment, the camera's shooting frame rate can be higher than the screen refresh rate of the sub-screen, so that within a video frame switching cycle, the camera can capture more frames of screen images.

[0104] In a specific implementation, the image recognition module can continuously capture multiple frames of screen images for the splicing screen while the splicing screen is playing the target video frame. For example, it can capture screen images of a preset number of frames or screen images of a preset duration.

[0105] When determining the delayed display time, the image recognition module can first determine the first frame screen image (called the target screen image) of each sub-screen after the first video frame switch occurs in the captured screen image, and identify the timestamp of the sub-screen display in the target screen image; then determine the delayed display time of each sub-screen based on the timestamp of each identified sub-screen, the frame number of the target screen image of each sub-screen in the captured multi-frame screen image, and the shooting frame rate.

[0106] In a specific implementation, the target screen image of each sub-screen can be determined based on the screen image captured within a video frame switching cycle. When determining the target screen image, each screen image frame within the video frame switching cycle can be segmented based on the positional relationship of each sub-screen to obtain the image content corresponding to each sub-screen in each screen frame. Then, for each sub-screen, whether a video frame switching has occurred can be determined based on whether the image content or timestamp of the sub-screen in two adjacent screen frames is the same. The following illustrates the process of determining the delayed display time of a sub-screen using an example.

[0107] Figure 10 This is a schematic diagram of the process for determining the delayed display time provided in the embodiment of the present application. Figure 10 In the example, assuming that the screen refresh rate is 50 frames per second, the camera shooting frame rate is 100 frames per second, and the video frame rate is 25 frames per second, then in one video frame switching cycle (i.e. 1 / 25 second), the camera can capture 1 / 25×100 (i.e. 4) frames of screen image. Figure 10 As shown, in the four frames of screen images taken by the camera, the timestamps displayed on sub-screen 1 are 1.30, 1.30, 1.30, and 1.34, respectively; the timestamps displayed on sub-screen 2 are all 1.34; the timestamps displayed on sub-screen 3 are 1.30, 1.34, 1.34, and 1.34, respectively; and the timestamps displayed on sub-screen 4 are 1.34, 1.34, 1.34, and 1.38, respectively, where the unit of the timestamp is seconds.

[0108] The target screen image for sub-screen 1 is the 4th frame (frame number 3). In this screen image, the timestamp displayed for sub-screen 1 is 1.34. In the four consecutive frames captured by the camera, the timestamps displayed for sub-screen 2 are the same, indicating that sub-screen 2 switched video frames when the camera captured the 1st frame. Therefore, the 1st frame (frame number 0) can be used as the target screen image for sub-screen 2. In this screen image, the timestamp displayed for sub-screen 2 is 1.34. The target screen image for sub-screen 3 is the 2nd frame (frame number 1). In this screen image, the timestamp displayed for sub-screen 3 is 1.34. The target screen image for sub-screen 4 is the 4th frame (frame number 3). In this screen image, the timestamp displayed for sub-screen 4 is 1.38.

[0109] The accuracy of the timestamps displayed on each sub-screen in the four screen image frames can be adjusted based on the frame number of the target screen image of each sub-screen, so that each sub-screen displays a timestamp with higher accuracy. When determining the delayed display time, the adjusted timestamps corresponding to each sub-screen in a screen image frame can be used. The screen image frame can be any of the four screen images mentioned above. For ease of calculation, the first screen image frame can be used in this embodiment. The adjusted timestamps corresponding to each sub-screen in the first screen image frame can be determined using the following formula:

[0110] t′ i =t i -n i / f (2)

[0111] Where t′ i Indicates the adjusted timestamp corresponding to the i-th sub-screen, n i Indicates the frame number of the target screen image of the i-th sub-screen in the captured multi-frame screen image, n i is an integer greater than or equal to 0, and f represents the shooting frame rate.

[0112] Based on the above formula (2), if Figure 10 As shown, for the first frame screen image (frame number is 0), the adjusted timestamp corresponding to sub-screen 1 is 1.34-3 / 100, that is, 1.31; the adjusted timestamp corresponding to sub-screen 2 is still 1.34; the adjusted timestamp corresponding to sub-screen 3 is 1.34-1 / 100, that is, 1.33; the adjusted timestamp corresponding to sub-screen 4 is 1.38-3 / 100, that is, 1.35.

[0113] The delayed display time is similar to the above-mentioned determination method. By adaptively adjusting formula (1), the calculation method of the delayed display time after adjusting the timestamp can be obtained. The specific calculation formula is as follows:

[0114] T i =t′ i -min(t′ i ) (3)

[0115] According to the timestamps of the sub-screens after adjustment determined above, it can be known that the video frame display speed of sub-screen 1 is the slowest, that is, min(t′ i ) is 1.31. Based on the above formula (3), it can be determined that the delayed display time of sub-screen 1 is 1.31-1.31, that is, 0.00 seconds; the delayed display time of sub-screen 2 is 1.34-1.31, that is, 0.03 seconds; the delayed display time of sub-screen 3 is 1.33-1.31, that is, 0.02 seconds; and the delayed display time of sub-screen 4 is 1.35-1.31, that is, 0.04 seconds.

[0116] It is understood that if the number of frames in the captured screen image is greater than 4, the delayed display time can be calculated based on any 4 consecutive frames of the screen image, or the delayed display time can be calculated based on all captured screen images. When all screen images are used, if the timestamp displayed for a sub-screen in the first 4 frames of the screen image is the same, the target screen image for that sub-screen can be the 1st frame of the screen image or the 5th frame of the screen image. In addition, the target screen image can also be any of the two screen images involved in any video frame switch in the captured screen image.

[0117] S400: The host sends the corresponding delayed display time to each sub-screen.

[0118] Specifically, after the image recognition module in the host determines the delayed display time of each sub-screen, it can be transmitted to the image sending module (step S110), and then the image sending module sends the delayed display time corresponding to each sub-screen to the splicing screen (step S111).

[0119] Similar to the aforementioned sending of video frames, the image sending module can package the delayed display time of each sub-screen, and send corresponding data packets to each sub-screen according to the address information of each sub-screen; it can also mark the correspondence between the delayed display time and the sub-screen in the same data packet, and then multicast or broadcast the data packet to each sub-screen in the splicing screen. After receiving the data packet, each sub-screen can extract the corresponding delayed display time according to the correspondence.

[0120] S500: After receiving the delayed display time, each sub-screen displays the video frame after delaying the delayed display time.

[0121] Specifically, for each sub-screen, after the image receiving module of the sub-screen receives the data packet corresponding to the delayed display time, it can parse out the delayed display time and then forward it to the image synchronization module (step S112); for subsequent video frames to be displayed, the image synchronization module can cache each video frame with the delayed display time and then transmit it to the display screen for display (step S113).

[0122] Figure 11 for Figure 10 The result diagram after delayed display of each sub-screen in Figure 11In this example, assume that each video frame in the video stream has a timestamp. The host captures 12 screen frames. The host begins calculating the delayed display time after capturing four frames. Each sub-screen receives its own delayed display time before the host captures the fifth frame. After receiving the delayed display time, each sub-screen delays the display of subsequent video frames. Based on the previous calculation results, the delayed display time for sub-screen 1 is 0.00 seconds, for sub-screen 2 is 0.03 seconds, for sub-screen 3 is 0.02 seconds, and for sub-screen 4 is 0.04 seconds.

[0123] As mentioned above, within one video frame switching cycle (i.e. 1 / 25 second), the camera can capture 4 frames of screen images, that is, each video frame will display 4 frames in the screen image, and the time between two adjacent screen images is 0.01 seconds.

[0124] like Figure 11 As shown in , for sub-screen 1, after receiving the delayed display time, the original display time of the next video frame to be displayed (i.e., the video frame with a timestamp of 1.38) is in the 8th frame (frame number 7); the delayed display time of sub-screen 1 is 0.00 seconds, that is, no delay is required, so sub-screen 1 displays the video frame with a timestamp of 1.38 in the 8th frame; after 0.04 seconds, for the video frame with a timestamp of 1.42, there is also no need for delay, and sub-screen 1 displays the video frame with a timestamp of 1.42 in the 12th frame.

[0125] For sub-screen 2, after receiving the delayed display time, the original display time of the next video frame to be displayed (i.e., the video frame with a timestamp of 1.38) is the 5th frame (frame number 4); the delayed display time of sub-screen 2 is 0.03 seconds, so sub-screen 2 continues to display the video frame with a timestamp of 1.34 within this 0.03 second ( Figure 11 (represented by a rectangular box with a diamond-filled pattern in the figure), the video frame with a timestamp of 1.38 is displayed in the 8th frame (frame number 7); for the video frame with a timestamp of 1.42, the original display time is the 9th frame (frame number 8), and it is also displayed after a delay of 0.03 seconds. Sub-screen 1 displays the video frame with a timestamp of 1.42 in the 12th frame.

[0126] For sub-screen 3, after receiving the delayed display time, the original display time of the next video frame to be displayed (i.e., the video frame with a timestamp of 1.38) is the 6th frame (frame number 5); the delayed display time of sub-screen 3 is 0.02 seconds, therefore, sub-screen 3 continues to display the video frame with a timestamp of 1.34 within the 0.02 seconds, and displays the video frame with a timestamp of 1.38 on the 8th frame (frame number 7); for the video frame with a timestamp of 1.42, the original display time is the 10th frame (frame number 9), and it is also displayed after a delay of 0.02 seconds. Sub-screen 1 displays the video frame with a timestamp of 1.42 on the 12th frame.

[0127] For sub-screen 4, after receiving the delayed display time, the original display time of the next video frame to be displayed (i.e., the video frame with a timestamp of 1.42) is the 8th frame (frame number 7); the delayed display time of sub-screen 4 is 0.04 seconds, therefore, sub-screen 3 continues to display the video frame with a timestamp of 1.38 within the 0.04 seconds, and displays the video frame with a timestamp of 1.42 in the 12th frame.

[0128] After the above delayed display process, each sub-screen realizes synchronous display when starting to display the video frame with the timestamp of 1.42.

[0129] The present embodiment provides a method for synchronous display of a spliced screen, in which the host marks timestamps on a plurality of target video frames, and the spliced screen synchronously displays the timestamps of the target video frames when displaying these target video frames; in the process of the spliced screen displaying these target video frames, the host captures the screen image of the spliced screen through a camera, and then determines the delayed display time of each sub-screen according to the timestamp displayed on each sub-screen in the captured screen image; after the host sends the delayed display time to each sub-screen, each sub-screen delays the display of the video frame according to the corresponding delayed display time, so that each sub-screen in the spliced screen can achieve synchronous display when displaying subsequent video frames, thereby improving the user's viewing experience.

[0130] Based on the same inventive concept, the present application also provides an electronic device that can be used as a host. Figure 12 , Figure 12 This is a schematic diagram of the structure of the electronic device provided in the embodiment of the present application. Figure 12 As shown, the electronic device may include a processor 310, a memory 320, a communication module 330, a camera 340, a Universal Serial Bus (USB) interface 350, a charging management module 360, a power management module 361, a battery 362, a sensor module 370, a button 380, an indicator 390, etc.

[0131] It is understood that the structures illustrated in the embodiments of the present application do not constitute specific limitations on the electronic device. In other embodiments of the present application, the electronic device may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0132] The processor 310 may include one or more processing units. For example, the processor 310 may include an AP, a modem processor, a GPU, an ISP, a controller, a memory, a video codec, a DSP, a baseband processor, and / or a neural-network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors.

[0133] The controller can be the nerve center and command center of the electronic device. The controller can generate operation control signals based on instruction operation codes and timing signals to complete the control of instruction fetching and execution.

[0134] Processor 310 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 310 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 310. If processor 310 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 310 latency, and thus improves system efficiency.

[0135] In some embodiments, the processor 310 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0136] The memory 320 can be used to store computer executable program codes, which include instructions. The processor 310 executes various functional applications and data processing of the electronic device by running the instructions stored in the memory 320. The memory 320 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function, etc. The data storage area may store data (such as image data, etc.) created during the use of the electronic device. In addition, the memory 320 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0137] The communication module 330 can provide wireless communication solutions for electronic devices, including wireless local area networks (WLAN) (such as Wi-Fi networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. The communication module 330 can be one or more devices that integrate at least one communication processing module.

[0138] The camera 340 is used to capture static images (such as the screen image mentioned above) or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device may include 1 or N cameras 340, where N is a positive integer greater than 1.

[0139] USB port 350 is an interface that complies with USB standards and may be a Mini USB port, a Micro USB port, a USB Type-C port, or the like. USB port 350 can be used to connect a charger to charge the electronic device, transfer data between the electronic device and peripheral devices, and connect to other electronic devices.

[0140] The charging management module 360 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 360 can receive charging input from the wired charger via the USB interface 350. In some wireless charging embodiments, the charging management module 360 can receive wireless charging input via the wireless charging coil of the electronic device. While charging the battery 362, the charging management module 360 can also provide power to the terminal device through the power management module 361.

[0141] The power management module 361 is used to connect the battery 362, the charging management module 360, and the processor 310. The power management module 361 receives input from the battery 362 and / or the charging management module 360 and provides power to the processor 310, the memory 320, the communication module 330, and the camera 340. The power management module 361 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 361 can also be provided in the processor 310. In other embodiments, the power management module 361 and the charging management module 360 can also be provided in the same device.

[0142] The sensor module 370 may include a pressure sensor, a gyro sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a touch sensor, and the like.

[0143] Keys 380 include a power button, a volume button, and the like. Keys 380 may be mechanical keys or touch-sensitive keys. The electronic device may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device.

[0144] The indicator 390 may be an indicator light, which may be used to indicate the charging status, power level change, or a message.

[0145] The electronic device provided in this embodiment can execute the above method embodiment, and its implementation principle and technical effects are similar, which will not be repeated here.

[0146] An embodiment of the present application further provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the method described in the above method embodiment is implemented.

[0147] An embodiment of the present application further provides a computer program product. When the computer program product is run on an electronic device, the electronic device implements the method described in the above method embodiment when executing the computer program product.

[0148] The present application also provides a chip system, including a processor coupled to a memory, wherein the processor executes a computer program stored in the memory to implement the method described in the above method embodiment. The chip system can be a single chip or a chip module composed of multiple chips.

[0149] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted via the computer-readable storage medium. The computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, hard disk or tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)).

[0150] Those skilled in the art will appreciate that all or part of the process steps in the above-described method embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, the program can include the process steps in the above-described method embodiments. The aforementioned storage medium can include various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.

[0151] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant description of other embodiments.

[0152] In the embodiments provided in this application, it should be understood that the disclosed devices / equipment and methods can be implemented in other ways. For example, the device / equipment embodiments described above are merely schematic. For example, the division of the modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0153] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or collections thereof.

[0154] In the description of this application, unless otherwise specified, " / " indicates that the objects associated before and after are in an "or" relationship, for example, A / B can represent A or B; "and / or" in this application is merely a description of the association relationship of associated objects, indicating that three relationships may exist, for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural.

[0155] Furthermore, in the description of this application, unless otherwise specified, "plurality" refers to two or more than two. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, "at least one of a, b, or c" can mean: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or plural.

[0156] As used in this specification and the appended claims, the term "if" can be interpreted as "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "upon determination" or "in response to determining" or "upon detection of [described condition or event]" or "in response to detecting [described condition or event]," depending on the context.

[0157] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0158] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with the embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in yet other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized.

[0159] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some or all of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A screen-connected synchronous display method, characterized in that: Applied to a splicing screen system, the splicing screen system includes an electronic device with a shooting function and a splicing screen including multiple sub-screens, the method includes: The electronic device adds time stamps to multiple target video frames of the video stream during the process of transmitting the video stream to each sub-screen; Each sub-screen synchronously displays a corresponding time mark when displaying the target video frame; The electronic device captures a screen image of the spliced screen, determines a delayed display time of each sub-screen according to a time stamp displayed on each sub-screen in the screen image, and then sends the corresponding delayed display time to each sub-screen; After receiving the delayed display time, each sub-screen displays the video frame to be displayed after delaying the delayed display time; The shooting frame rate of the electronic device is higher than the screen refresh rate of each sub-screen, and the screen image of the spliced screen is shot, and the delayed display time of each sub-screen is determined according to the time stamp displayed by each sub-screen in the screen image, including: Continuously capturing multiple frames of screen images for the spliced screen; For each sub-screen, determining a target screen image of the sub-screen according to screen images involved when video frame switching occurs for the sub-screen in the multiple screen images, and identifying a time stamp of display of the sub-screen in the target screen image; The delayed display time of each sub-screen is determined according to the identified time stamp of each sub-screen, the frame number of the target screen image of each sub-screen in the captured multiple frames of screen images and the capture frame rate.

2. The method according to claim 1, characterized in that The time mark is a timestamp, and the duration between the timestamps of two adjacent target video frames is a time base corresponding to the video frame rate of the video stream; determining the delayed display time of each sub-screen based on the identified time mark of each sub-screen, the frame number of the target screen image of each sub-screen in the captured multiple frames of screen images, and the capture frame rate, includes: The following formula is used to determine the delayed display time of each sub-screen: Among them, t i Indicates the timestamp of the identified i-th sub-screen, n i represents the frame number of the target screen image of the i-th sub-screen in the captured multiple frames of screen images, f represents the capture frame rate, t i ′ Indicates the adjusted timestamp corresponding to the i-th sub-screen, T i Indicates the delayed display time of the i-th sub-screen, i is a positive integer less than or equal to M, M is the number of sub-screens contained in the splicing screen, n i is an integer greater than or equal to 0.

3. The method according to claim 1, characterized in that The target screen image is the first frame screen image after the sub-screen undergoes the first video frame switching in the multiple frames of screen images.

4. The method according to claim 1, wherein The number of frames of the screen image continuously captured by the electronic device is greater than or equal to the maximum number of frames of the screen image that can be captured by the electronic device within the display time of one video frame of any of the sub-screens.

5. The method according to any one of claims 1 to 4, characterized in that Each sub-screen displays the time mark in a target area in the edge area of the screen.

6. A splicing screen system, characterized in that: include: An electronic device with a shooting function and a spliced screen comprising multiple sub-screens, wherein: The electronic device is used to: add time marks to multiple target video frames of the video stream during the process of transmitting the video stream to each sub-screen; The sub-screen is used to: synchronously display a corresponding time mark when displaying the target video frame; The electronic device is further configured to: capture a screen image of the spliced screen, determine a delayed display time of each sub-screen according to a time stamp displayed on each sub-screen in the screen image, and then send the corresponding delayed display time to each sub-screen; The sub-screen is further configured to: after receiving the delayed display time, display the video frame to be displayed after delaying the delayed display time; The shooting frame rate of the electronic device is higher than the screen refresh rate of each sub-screen, and the electronic device is specifically used for: Continuously capturing multiple frames of screen images for the spliced screen; For each sub-screen, determining a target screen image of the sub-screen according to screen images involved when video frame switching occurs for the sub-screen in the multiple screen images, and identifying a time stamp of display of the sub-screen in the target screen image; The delayed display time of each sub-screen is determined according to the identified time stamp of each sub-screen, the frame number of the target screen image of each sub-screen in the captured multiple frames of screen images and the capture frame rate.

7. The system according to claim 6, characterized in that The time mark is a timestamp, and the duration between the timestamps of two adjacent target video frames is a time base corresponding to the video frame rate of the video stream; the electronic device is specifically used to: The following formula is used to determine the delayed display time of each sub-screen: Among them, t i Indicates the timestamp of the identified i-th sub-screen, n i represents the frame number of the target screen image of the i-th sub-screen in the captured multiple frames of screen images, f represents the capture frame rate, t i ′ Indicates the adjusted timestamp corresponding to the i-th sub-screen, T i Indicates the delayed display time of the i-th sub-screen, i is a positive integer less than or equal to M, M is the number of sub-screens contained in the splicing screen, n i is an integer greater than or equal to 0.

8. The system according to claim 6, wherein: The target screen image is the first frame screen image after the sub-screen undergoes the first video frame switching in the multiple frames of screen images.

9. The system according to claim 6, wherein: The number of frames of the screen image continuously captured by the electronic device is greater than or equal to the maximum number of frames of the screen image that can be captured by the electronic device within the display time of one video frame of any of the sub-screens.

10. The system according to any one of claims 6 to 9, characterized in that: Each sub-screen displays the time mark in a target area in the edge area of the screen.

11. An electronic device comprising: Memory and processor, the memory is used to store computer programs; The processor is configured to execute the method executed by the electronic device in any one of claims 1 to 5 when calling the computer program.

Citation Information

Patent Citations

  • Splicing wall screen synchronism detecting method, device, system and equipment

    CN108900833A