Multi-channel video signal same-screen display method, device, electronic device and storage medium
By determining the initial frame in the same-screen processing of multiple video signals and inserting the interrupt time slot, traversing and comparing the frame time, and performing the complementary frame display after calculating the number of complementary frames, the problem of large amount of computation and slow response of multiple video signals is solved, and processing efficiency and CPU and memory response capabilities are improved.
Patent Information
- Application Number
- CN202210809867.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-07-11
- Publication Date
- 2025-07-25
- Estimated Expiration
- 2042-07-11
AI Technical Summary
The prior art has a large amount of calculation and a long time to process multiple video signals on the same screen, and affects the timely response of CPU and memory to other task events.
By determining the initial frame of the initial video signal in the multiplexed video signal and inserting the interrupt slot, the frame time of the initial frame is obtained as the reference frame time, the frame time of other video signals is traversed, the maximum frame time is compared and determined, the number of complement frames is calculated based on the maximum frame time and the frame time of each signal, and the interrupt slot is cancelled after the frame is filled and displayed on the same screen.
The number of times to calculate the maximum frame time is reduced, the calculation time is shortened, the time is ensured, the timely response of the CPU and memory users is improved, and the efficiency of displaying multiple screens is improved.
Smart Images

Figure CN115208998B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of video processing, and in particular, to a method, apparatus, electronic device, and storage medium for displaying multiple video signals on the same screen. Background Art
[0002] The same-frequency display of multiple video signals is currently used in various scenarios. For example, when multiple cameras capture the same scene from different angles and use the same network for transmission, they are displayed in sub-pictures on the same screen at the user end, or multiple channel signals are displayed in sub-pictures on the same screen of the user. To ensure the signal synchronization of multiple video signals at the user end, a common solution is to use clock slot pulses to capture the frame times when each video signal arrives, calculate the maximum value of the frame times of each signal corresponding to the same slot pulse through traversal, and then subtract the arrival times of other signals from the maximum value to obtain the difference of the frames to be filled. For the signals with frame times less than the maximum value, the method of filling frames one by one is used to achieve the final synchronization of all video signals. This synchronization method requires periodic insertion of slot pulses and multiple comparisons of the frame times of each signal through traversal to obtain the current maximum frame time, which occupies a certain amount of the CPU and memory of the set-top box, and may cause video desynchronization for a certain period of time for the multi-channel multi-signal on the same screen of the user-end display, affecting the user experience. Summary of the Invention
[0003] The present invention provides a method, apparatus, electronic device, and storage medium for displaying multiple video signals on the same screen, which are used to solve the technical problems in the prior art that the calculation amount is large, the calculation time is long, and the timely response of the CPU and memory to other task events is affected during the same-screen processing of multiple video signals.
[0004] The present invention provides a method for displaying multiple video signals on the same screen, including:
[0005] Determine an initial video signal among multiple video signals, and obtain an initial frame of the initial video signal;
[0006] Insert an interrupt slot into the initial frame;
[0007] Obtain the frame time of the initial frame, and determine the frame time of the initial frame as the reference frame time;
[0008] Traverse multiple video signals, determine a current video signal among multiple video signals, and obtain the signal frame time of the current video signal;
[0009] Compare the signal frame time with the reference frame time to determine the maximum frame time;
[0010] Judge whether multiple video signals have been traversed;
[0011] If not, determine the maximum frame time as the reference frame time, and return to the step of traversing multiple paths of the video signals, determining the current video signal among the multiple paths of video signals, and obtaining the signal frame time of the current video signal;
[0012] If so, determine the number of supplementary frames for each path of the video signals according to the maximum frame time and the signal frame time of each path of the video signals;
[0013] Perform frame supplementation on each path of the video signals according to the number of supplementary frames to obtain the frame-supplemented video signals;
[0014] Release the interruption time slot, and perform on-screen display on the frame-supplemented video signals.
[0015] Optionally, the step of determining the initial video signal among multiple paths of video signals and obtaining the initial frame of the initial video signal includes:
[0016] Determine the video signal initially received by the preset display end as the initial video signal;
[0017] Determine the video frame that arrives at the preset display end earliest in the initial video signal as the initial frame.
[0018] Optionally, the step of comparing the signal frame time and the reference frame time to determine the maximum frame time includes:
[0019] Compare the magnitudes of the signal frame time and the reference frame time, and use the larger value between the signal frame time and the reference frame time as the maximum frame time.
[0020] Optionally, the step of determining the number of supplementary frames for each path of the video signals according to the maximum frame time and the signal frame time of each path of the video signals includes:
[0021] Calculate the time difference between the maximum frame time and the video frame time of each path of the video signals;
[0022] Obtain the number of frames transmitted per second for each path of the video signals;
[0023] Calculate the product of the time difference and the number of frames transmitted per second to obtain the number of supplementary frames for each path of the video signals.
[0024] The present invention also provides a device for on-screen display of multiple paths of video signals, including:
[0025] An initial frame acquisition module, configured to determine an initial video signal among multiple paths of video signals and obtain the initial frame of the initial video signal;
[0026] An interruption time slot insertion module, configured to insert an interruption time slot into the initial frame;
[0027] A reference frame time determination module, configured to obtain the frame time of the initial frame and determine the frame time of the initial frame as the reference frame time;
[0028] A signal frame time determination module, configured to traverse multiple paths of the video signals, determine a current video signal among the multiple paths of video signals, and obtain the signal frame time of the current video signal;
[0029] A maximum frame time determination module, configured to compare the signal frame time and the reference frame time and determine the maximum frame time;
[0030] A judgment module, configured to judge whether the multiple paths of video signals have been traversed;
[0031] A return module, configured to, if not, determine the maximum frame time as the reference frame time, and return to the steps of traversing the multiple paths of video signals, determining a current video signal among the multiple paths of video signals, and obtaining the signal frame time of the current video signal;
[0032] A supplementary frame number determination module, configured to, if so, determine the supplementary frame number of each path of video signal according to the maximum frame time and the signal frame time of each path of video signal;
[0033] A supplementary frame module, configured to perform supplementary framing on each path of video signal according to the supplementary frame number to obtain a supplementary frame video signal;
[0034] A display module, configured to release the interruption time slot and perform on-screen display on the supplementary frame video signal.
[0035] Optionally, the initial frame acquisition module includes:
[0036] An initial video signal determination sub-module, configured to determine the video signal initially received by a preset display end as the initial video signal;
[0037] An initial frame determination sub-module, configured to determine the video frame that reaches the preset display end earliest in the initial video signal as the initial frame.
[0038] Optionally, the maximum frame time determination module includes:
[0039] A maximum frame time determination sub-module, configured to compare the magnitudes of the signal frame time and the reference frame time, and use the larger value of the signal frame time and the reference frame time as the maximum frame time.
[0040] Optionally, the supplementary frame number determination module includes:
[0041] A time difference calculation sub-module, configured to calculate the time difference between the maximum frame time and the video frame time of each path of video signal;
[0042] The frames-per-second acquisition sub-module is used to acquire the frames per second of each path of the video signal;
[0043] The supplementary frame number calculation sub-module is used to calculate the product of the time difference and the frames per second to obtain the supplementary frame number of each path of the video signal.
[0044] The present invention also provides an electronic device, which includes a processor and a memory:
[0045] The memory is used to store program codes and transmit the program codes to the processor;
[0046] The processor is used to execute the multi-channel video signal same-screen display method described in any one of the above according to the instructions in the program codes.
[0047] The present invention also provides a computer-readable storage medium, which is used to store program codes, and the program codes are used to execute the multi-channel video signal same-screen display method described in any one of the above.
[0048] It can be seen from the above technical solutions that the present invention has the following advantages: After successively determining each path of the video signal as the current video signal, the present invention compares the signal frame time of the current video signal with the reference frame time to determine the maximum frame time, so that the number of times of calculating the maximum frame time is controlled to be one less than the number of paths of the video signal. Compared with the conventional calculation process of the maximum frame time, the number of times is reduced, thereby reducing the calculation time. When the user just enters the multi-screen same-screen, the present invention does not need to insert sampling time slot pulses periodically multiple times to obtain the frame time values of multiple paths of video signals. Only the first-arriving initial frame is interrupted, and the interruption is released after obtaining the maximum frame time, and no other time slot pulses are inserted during this period, ensuring the timely response of the CPU and memory to other task events during this period. BRIEF DESCRIPTION OF THE DRAWINGS
[0049] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the following drawings are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.
[0050] Figure 1 FIG. 28 is a schematic diagram of video signal supplementary frame synchronization in the prior art;
[0051] Figure 2 FIG. 32 is a step flow chart of a multi-channel video signal same-screen display method provided by an embodiment of the present invention;
[0052] Figure 3 The flowchart of steps of the multi-channel video signal same-screen display method provided by another embodiment of the present invention;
[0053] Figure 4 The schematic diagram of video signal frame compensation synchronization provided by an embodiment of the present invention;
[0054] Figure 5 The structural block diagram of a multi-channel video signal same-screen display device provided by an embodiment of the present invention. Detailed implementation manners
[0055] A common solution to the same-screen multi-picture frame synchronization is to use a clock time slot pulse to capture the leading frame time of each video signal. By traversing and calculating, the maximum value of the leading frame times of each signal corresponding to the same time slot pulse is obtained. Then, the difference between the arrival time of other signals and the maximum value is calculated to obtain the difference of the frames to be compensated. For other signals with a frame time less than the maximum value, the method of compensating frames one by one is adopted, and the cyclic periodic operation is performed until the frames of each signal for the same-screen display are finally synchronized. The process is as Figure 1 shown. Among them, there are a total of 4 video signals for the same-screen display. Among them, A1, A2, A3, and A4 are the video frames of each video signal that reach the user-end display screen earliest, that is, the leading frames. A1 is the reference frame, A4 is the video frame corresponding to the maximum value of the leading frame times of each signal, C is the synchronization time slot pulse, B is the periodic time slot adopted pulse, D is the video frame of each video, and E is the compensation frame.
[0056] In view of this, the embodiments of the present invention provide a multi-channel video signal same-screen display method, device, electronic device, and storage medium, which are used to solve the technical problems of large calculation amount, long calculation time, and affecting the timely response of the CPU and memory to other task events during the multi-channel video signal same-screen processing in the prior art.
[0057] In order to make the invention purpose, features, and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the embodiments described below are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.
[0058] Please refer to Figure 2 , Figure 2 The flowchart of steps of a multi-channel video signal same-screen display method provided by an embodiment of the present invention.
[0059] A multi-channel video signal same-screen display method provided by the present invention may specifically include the following steps:
[0060] Step 201: Determine the initial video signal from multiple video signals, and obtain the initial frame of the initial video signal.
[0061] Video signals refer to television signals, still image signals, and visual television image signals. Video signals are mainly divided into two categories, including digital signals and analog signals. Among them, analog signals are composed of video analog data and video synchronization data, which are used for the receiving end to correctly display images. The details of the signal depend on the applied video standard or format.
[0062] In the embodiments of the present invention, when the same-screen display of multiple videos is required, an initial video signal can be first determined, and the initial frame of the initial video signal can be obtained.
[0063] Among them, the initial video signal can be the video signal earliest received by the display end, and the initial frame can be the video frame earliest reaching the display end of the initial video signal.
[0064] A video frame is a basic unit containing video information, and a video is composed of several video frames.
[0065] Step 202: Insert an interrupt time slot into the initial frame.
[0066] A time slot divides a period of time into several small segments, and each small segment is a time slot.
[0067] After inserting the interrupt time slot into the initial frame, the display of each video signal at the display end will freeze at the video frame where each video signal first reaches the display end.
[0068] Step 203: Obtain the frame time of the initial frame, and determine the frame time of the initial frame as the reference frame time.
[0069] In the embodiments of the present invention, the frame time refers to the display time of the video frame.
[0070] After obtaining the initial frame, the frame time of the initial frame can be obtained, and the frame time of the initial frame can be used as the reference frame time for comparison with the subsequent arriving video signals.
[0071] It should be noted that the time when the video frame of the video signal reaches the display end is not equal to the frame time of the video frame. Therefore, the video signal that reaches the display end earliest may not be the video signal with the smallest frame time among all video signals.
[0072] Step 204: Traverse multiple video signals, determine the current video signal from multiple video signals, and obtain the signal frame time of the current video signal.
[0073] Step 205: Compare the signal frame time with the reference frame time to determine the maximum frame time.
[0074] In an embodiment of the present invention, after determining the reference frame time, multiple video signals can be traversed to determine the current video signal among the multiple video signals. In one example, each signal can be sequentially determined as the current video signal according to the order in which the video signals arrive at the display end. Then, the signal frame time of the current video signal is obtained, and then the signal frame time of the current video signal is compared with the reference frame time to determine the maximum frame time.
[0075] Among them, the signal frame time of the current video signal refers to the frame time of the signal frame that reaches the display end earliest for the current video signal.
[0076] Step 206: Determine whether all the multiple video signals have been traversed;
[0077] Step 207: If not, determine the maximum frame time as the reference frame time, and return to the steps of traversing the multiple video signals, determining the current video signal among the multiple video signals, and obtaining the signal frame time of the current video signal.
[0078] After comparing the signal frame time of the current video signal with the reference frame time, the obtained maximum frame time can be used as the reference frame time for comparing with the next video frame signal. Then, the next video signal is obtained, and the next video signal is used as the current video signal. Repeat the comparison of the signal frame time of the new current video signal with the reference frame time to re-determine the maximum frame time until all video signals have completed the time comparison. The maximum frame time saved at this time is the final maximum frame time.
[0079] For ease of understanding, the embodiments of the present invention are described below through specific examples:
[0080] Taking the example of 9 common video signals being displayed on the same screen: For the conventional method of traversing and comparing the frame times when each video signal arrives to obtain the maximum frame time, (n - 1 + n - 2 +....1) = n(n - 1) / 2 = 36 times (n = 9) of calculations are required to calculate the maximum frame time. Even if the binary method is used, with 2 signals in a group and taking the maximum value of each group for the next round of successive comparison, 7 groupings and 8 comparisons are still required, and a total of 15 calculations are needed to obtain the maximum frame time. However, through the method of the embodiments of the present invention, taking the frame time of the first-arriving video frame as the reference frame time, comparing the frame times of the subsequent arriving signals of other channels with it, retaining the maximum value, and looping to compare with the frame time of the next arriving signal until all video signals have completed the comparison, the maximum frame time can be obtained with 8 calculations, greatly reducing the calculation time.
[0081] Step 208: If so, determine the number of supplementary frames for each video signal according to the maximum frame time and the signal frame time of each video signal.
[0082] After all video signals have been traversed, the finally generated maximum frame time can be compared with the signal frame time of each video signal to determine the frame number difference between the signal frame time of each video signal and the maximum frame time, so as to determine the number of frames to be filled, and then fill frames for each video signal.
[0083] Step 209: Fill frames for each video signal according to the number of frames to be filled to obtain filled-frame video signals;
[0084] Step 210: Release the interrupt time slot and display the filled-frame video signals on the same screen.
[0085] After calculating the number of frames to be filled, fill frames for each video signal, and then send a synchronization time slot pulse again, so that each signal can be played on the same screen according to the same frame time.
[0086] In the present invention, after each video signal is sequentially determined as the current video signal, the signal frame time of the current video signal is compared with the reference frame time to determine the maximum frame time, so that the number of times of calculating the maximum frame time is controlled to be one less than the number of video signals. Compared with the conventional calculation process of the maximum frame time, the number of times is reduced, thus reducing the calculation time. When the user terminal first enters the multi-screen same-screen display, the present invention does not need to periodically insert sampling time slot pulses multiple times to obtain the frame time values of multiple video signals. Only the initially arrived initial frame is interrupted, and the interruption is released after obtaining the maximum frame time, and no other time slot pulses are inserted during this period, ensuring the timely response of the CPU and memory to other task events during this period.
[0087] Please refer to Figure 3 , Figure 3 , which is the step flow chart of the multi-channel video signal same-screen display method provided by another embodiment of the present invention. Specifically, it may include the following steps:
[0088] Step 301: Determine the video signal initially received by the preset display terminal as the initial video signal;
[0089] Step 302: Determine the video frame that arrives at the preset display terminal earliest in the initial video signal as the initial frame;
[0090] In the embodiment of the present invention, the display terminal can be any device with a video display function that can perform multi-channel video same-screen display.
[0091] When the preset display terminal initially receives a video signal, this video signal can be determined as the initial video signal, and the video frame that arrives at the display terminal earliest in the initial video signal is used as the initial frame, so as to serve as the reference frame for subsequent frame time comparison.
[0092] Step 303: Insert an interrupt time slot in the initial frame;
[0093] Step 304: Obtain the frame time of the initial frame and determine the frame time of the initial frame as the reference frame time.
[0094] Step 305: Traverse multiple video signals, determine the current video signal among the multiple video signals, and obtain the signal frame time of the current video signal.
[0095] Steps 303 - 305 are the same as steps 202 - 204. For specific details, please refer to the description of steps 202 - 204 and will not be elaborated here.
[0096] Step 306: Compare the signal frame time with the reference frame time, and take the larger value between the signal frame time and the reference frame time as the maximum frame time.
[0097] In the embodiment of the present invention, the signal frame time can be compared with the reference frame time, and the larger time of the two is taken as the maximum frame time.
[0098] Step 307: Determine whether all the multiple video signals have been traversed.
[0099] Step 308: If not, determine the maximum frame time as the reference frame time, and return to the step of traversing the multiple video signals, determining the current video signal among the multiple video signals, and obtaining the signal frame time of the current video signal.
[0100] Steps 307 - 308 are the same as steps 206 - 207. For specific details, please refer to the description of steps 206 - 207 and will not be elaborated here.
[0101] Step 309: If so, determine the number of supplementary frames for each video signal according to the maximum frame time and the signal frame time of each video signal.
[0102] After all the video signals have been traversed, the finally generated maximum frame time can be compared with the signal frame time of each video signal to determine the frame number difference between the signal frame time of each video signal and the maximum frame time, so as to determine the number of supplementary frames, thereby performing frame supplementation for each video signal.
[0103] In one example, step 309 may include the following sub - steps:
[0104] S91: Calculate the time difference between the maximum frame time and the video frame time of each video signal.
[0105] S92: Obtain the number of frames transmitted per second of each video signal.
[0106] S93: Calculate the product of the time difference and the number of frames transmitted per second to obtain the number of supplementary frames for each video signal.
[0107] In a specific implementation, it is set that the number of frames transmitted per second (Frames Per Second, FPS) of each video signal is the same. After obtaining the maximum frame time, the time difference between the maximum frame time and the video frame time of each video signal can be calculated, and then the product of the time difference and the number of frames transmitted per second is calculated to obtain the number of supplementary frames for each signal.
[0108] For ease of understanding, the embodiments of the present invention are described below through specific examples:
[0109] Please refer to Figure 4 , Figure 4 which is a schematic diagram of video signal supplementary frame synchronization provided by the embodiments of the present invention.
[0110] In Figure 4 , there are a total of 4 video signals that need to be displayed on the same screen. Among them, a1, a2, a3, and a4 are the signal frames of each video signal that reach the user - end display screen earliest. a3 is the initial frame of the 3rd video signal, that is, the reference frame of the embodiments of the present invention, and its corresponding time is the reference frame time. a2 is the video frame corresponding to the maximum frame time. b is the interrupt time - slot pulse, c is the synchronization time - slot pulse, and d is the video frame of each video. After inserting the interrupt time - slot pulse b into a3, the video frames after the initial frame of each video signal need to be synchronized with a2. To ensure the continuity of the signal, supplementary frames need to be added between the initial frame of each signal and a2, and the number of supplementary frames can be calculated according to the difference between the signal frame time of the initial frame of each signal and the maximum frame time. e is the supplementary frame difference between the initial frame and a2.
[0111] Step 310: Perform supplementary framing on each video signal according to the number of supplementary frames to obtain supplementary - framed video signals;
[0112] Step 311: Cancel the interrupt time - slot and perform simultaneous screen display on the supplementary - framed video signals.
[0113] After calculating the number of supplementary frames, perform supplementary framing on each video signal, and then send a synchronization time - slot pulse again so that each signal can be played on the same screen at the same frame time.
[0114] After the present invention determines each video signal as the current video signal in sequence, it compares the signal frame time of the current video signal with the reference frame time to determine the maximum frame time, so that the number of times of calculating the maximum frame time is controlled to be one less than the number of video signals. Compared with the conventional calculation process of the maximum frame time, the number of times is reduced, thus reducing the calculation time. When the user terminal first enters the multi-screen display, the present invention does not need to insert sampling time slot pulses periodically multiple times to obtain the frame time values of multiple video signals. It only interrupts the first-arrived initial frame and releases the interruption after obtaining the maximum frame time, without inserting other time slot pulses during this period, ensuring the timely response of the CPU and memory to other task events during this period.
[0115] Please refer to Figure 5 , Figure 5 which is the structural block diagram of a multi-channel video signal synchronous display device provided by an embodiment of the present invention.
[0116] An embodiment of the present invention provides a multi-channel video signal synchronous display device, including:
[0117] An initial frame acquisition module 501, configured to determine an initial video signal in multiple video signals and acquire an initial frame of the initial video signal;
[0118] An interruption time slot insertion module 502, configured to insert an interruption time slot in the initial frame;
[0119] A reference frame time determination module 503, configured to acquire the frame time of the initial frame and determine the frame time of the initial frame as the reference frame time;
[0120] A signal frame time determination module 504, configured to traverse multiple video signals, determine a current video signal in the multiple video signals, and acquire the signal frame time of the current video signal;
[0121] A maximum frame time determination module 505, configured to compare the signal frame time with the reference frame time to determine the maximum frame time;
[0122] A judgment module 506, configured to judge whether the multiple video signals have been traversed;
[0123] A return module 507, configured to, if not, determine the maximum frame time as the reference frame time, and return to the step of traversing the multiple video signals, determining a current video signal in the multiple video signals, and acquiring the signal frame time of the current video signal;
[0124] A supplementary frame number determination module 508, configured to, if so, determine the supplementary frame number of each video signal according to the maximum frame time and the signal frame time of each video signal;
[0125] A supplementary frame module 509, configured to perform supplementary framing on each video signal according to the supplementary frame number to obtain a supplementary frame video signal;
[0126] A display module 510, configured to release an interruption time slot and perform same-screen display on the supplementary frame video signal.
[0127] In an embodiment of the present invention, the initial frame acquisition module 501 includes:
[0128] An initial video signal determination sub-module, configured to determine the video signal initially received by a preset display end as an initial video signal;
[0129] An initial frame determination sub-module, configured to determine the video frame that reaches the preset display end earliest in the initial video signal as an initial frame.
[0130] In an embodiment of the present invention, the maximum frame time determination module 505 includes:
[0131] A maximum frame time determination sub-module, configured to compare the signal frame time with the reference frame time, and use the larger value of the signal frame time and the reference frame time as the maximum frame time.
[0132] In an embodiment of the present invention, the supplementary frame number determination module 508 includes:
[0133] A time difference calculation sub-module, configured to calculate the time difference between the maximum frame time and the video frame time of each video signal;
[0134] A frames per second acquisition sub-module, configured to acquire the frames per second of each video signal;
[0135] A supplementary frame number calculation sub-module, configured to calculate the product of the time difference and the frames per second to obtain the supplementary frame number of each video signal.
[0136] An embodiment of the present invention further provides an electronic device, which includes a processor and a memory:
[0137] The memory is configured to store program code and transmit the program code to the processor;
[0138] The processor is configured to execute the multi-channel video signal same-screen display method according to the instructions in the program code in an embodiment of the present invention.
[0139] An embodiment of the present invention further provides a computer-readable storage medium, which is configured to store program code, and the program code is used to execute the multi-channel video signal same-screen display method according to an embodiment of the present invention.
[0140] Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working processes of the systems, devices, and units described above can refer to the corresponding processes in the foregoing method embodiments, and will not be described herein again.
[0141] Each embodiment in this specification is described in a progressive manner. Each embodiment focuses on the differences from other embodiments. For the same or similar parts among the embodiments, reference can be made to each other.
[0142] Those skilled in the art should understand that the embodiments of the present invention can be provided as a method, a device, or a computer program product. Therefore, the embodiments of the present invention can take the form of an all-hardware embodiment, an all-software embodiment, or an embodiment combining software and hardware aspects. Moreover, the embodiments of the present invention can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0143] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal devices to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal devices generate a device for implementing the specified functions in Figure 1 one process or multiple processes and / or blocks Figure 1 one block or multiple blocks.
[0144] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal device to work in a specific manner, so that the instructions stored in the computer-readable memory generate a manufactured article including an instruction device, and the instruction device implements the specified functions in Figure 1 one process or multiple processes and / or blocks Figure 1 one block or multiple blocks.
[0145] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device, so that a series of operation steps are executed on the computer or other programmable terminal device to generate a computer-implemented process. Thus, the instructions executed on the computer or other programmable terminal device provide steps for implementing the specified functions in Figure 1 one process or multiple processes and / or blocks Figure 1 one block or multiple blocks.
[0146] Although the preferred embodiments of the present invention have been described, those skilled in the art can make additional changes and modifications to these embodiments once they learn the basic creative concept. Therefore, the appended claims are intended to be construed as including the preferred embodiments as well as all changes and modifications that fall within the scope of the embodiments of the present invention.
[0147] Finally, it should also be noted that in this text, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or terminal device comprising a series of elements not only includes those elements, but also includes other elements not expressly listed, or also includes elements inherent to such process, method, article or terminal device. Without further limitation, an element defined by the statement "comprising one..." does not exclude the existence of additional identical elements in the process, method, article or terminal device comprising the said element.
[0148] As described above, the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims
1. A method for displaying multiple video signals on the same screen, characterized in that, include: Determining an initial video signal among multiple video signals, and acquiring an initial frame of the initial video signal; inserting an interrupt time slot in the initial frame; Acquire the frame time of the initial frame, and determine the frame time of the initial frame as the reference frame time; Traversing the multiple channels of video signals, determining a current video signal among the multiple channels of video signals, and obtaining a signal frame time of the current video signal; Compare the signal frame time with the reference frame time to determine a maximum frame time; Determine whether the multiple channels of video signals have been traversed; If not, the maximum frame time is determined as the reference frame time, and the step of traversing the multiple channels of the video signals, determining the current video signal among the multiple channels of the video signals, and obtaining the signal frame time of the current video signal is returned; If yes, determine the number of supplementary frames for each channel of the video signal according to the maximum frame time and the signal frame time of each channel of the video signal; Perform frame interpolation on each channel of the video signal according to the interpolation frame number to obtain a frame interpolated video signal; The interruption time slot is released, and the interpolated frame video signal is displayed on the same screen.
2. The method according to claim 1, wherein The step of determining an initial video signal from multiple video signals and obtaining an initial frame of the initial video signal comprises: Determining a video signal initially received by a preset display terminal as an initial video signal; The video frame that arrives at the preset display end earliest in the initial video signal is determined as the initial frame.
3. The method according to claim 1, wherein The step of comparing the signal frame time with the reference frame time to determine the maximum frame time comprises: The signal frame time and the reference frame time are compared, and the larger value of the signal frame time and the reference frame time is used as the maximum frame time.
4. The method according to claim 1, wherein The step of determining the number of supplementary frames of each channel of the video signal according to the maximum frame time and the signal frame time of each channel of the video signal comprises: Calculate the time difference between the maximum frame time and the video frame time of each channel of the video signal; Obtaining the number of transmission frames per second of each video signal; The product of the time difference and the number of frames transmitted per second is calculated to obtain the number of supplementary frames of each channel of the video signal.
5. A multi-channel video signal same-screen display device, characterized in that, include: An initial frame acquisition module, used to determine an initial video signal in multiple video signals and acquire an initial frame of the initial video signal; An interrupt time slot insertion module, used for inserting an interrupt time slot into the initial frame; A reference frame time determination module, used for acquiring the frame time of the initial frame, and determining the frame time of the initial frame as the reference frame time; A signal frame time determination module, used for traversing the multiple channels of video signals, determining a current video signal among the multiple channels of video signals, and obtaining a signal frame time of the current video signal; A maximum frame time determination module, used for comparing the signal frame time with the reference frame time to determine the maximum frame time; A judging module, used for judging whether the multiple channels of video signals have been traversed; A return module, for, if not, determining the maximum frame time as the reference frame time, and returning to the step of traversing the multiple channels of the video signals, determining the current video signal among the multiple channels of the video signals, and obtaining the signal frame time of the current video signal; The supplementary frame number determination module is used to, if so, determine the supplementary frame number of each video signal according to the maximum frame time and the signal frame time of each video signal; The supplementary frame module is used to perform supplementary framing on each video signal according to the supplementary frame number to obtain a supplementary frame video signal; The display module is used to release the interruption time slot and perform on-screen display on the supplementary frame video signal.
6. The device according to claim 5, characterized in that, The initial frame acquisition module includes: The initial video signal determination sub-module is used to determine the video signal initially received by the preset display end as the initial video signal; The initial frame determination sub-module is used to determine the video frame that reaches the preset display end earliest in the initial video signal as the initial frame.
7. The device according to claim 5, characterized in that, The maximum frame time determination module includes: The maximum frame time determination sub-module is used to compare the magnitudes of the signal frame time and the reference frame time, and use the larger value of the signal frame time and the reference frame time as the maximum frame time.
8. The device according to claim 5, characterized in that, The supplementary frame number determination module includes: The time difference calculation sub-module is used to calculate the time difference between the maximum frame time and the video frame time of each video signal; The frames per second transmission number acquisition sub-module is used to acquire the frames per second transmission number of each video signal; The supplementary frame number calculation sub-module is used to calculate the product of the time difference and the frames per second transmission number to obtain the supplementary frame number of each video signal.
9. An electronic device, characterized in that, The device includes a processor and a memory: The memory is used to store program codes and transmit the program codes to the processor; The processor is used to execute the multi-channel video signal on-screen display method according to any one of claims 1-4 based on the instructions in the program codes.
10. A computer-readable storage medium, characterized in that, The computer-readable storage medium is used to store program codes, and the program codes are used to execute the multi-channel video signal on-screen display method according to any one of claims 1-4.
Citation Information
Patent Citations
Multi-channel audio and video synchronization method and device
CN111787365A
KR1018884640000B1