Timecode-based multi-camera encoding and decoding synchronous display method

Abstract

The invention relates to the technical field of video processing, in particular to a Timecode-based multi-camera encoding and decoding synchronous display method, which is executed by an encoder and a decoder, and comprises the following steps: when the encoder receives a plurality of camera pictures, encoding the pictures into TS code streams, and adding Timecode information into ES data of the code streams; a plurality of decoding chips are arranged in the decoder, synchronization is carried out according to the Timecode value in the code stream, and the corresponding relation between the pt and the Timecode is stored; and decoding the picture and the pts corresponding to the picture according to the decoding chip, obtaining a corresponding Timecode value through the pts, and sending the picture with the same Timecode to a video memory for display. According to the invention, four decoding chips are used, synchronous display of multi-camera pictures is realized, and the problem that professional multi-camera equipment is too high in price and inconvenient to carry is avoided.

Description

Technical Field

[0001] The invention relates to the technical field of video processing, in particular to a multi-camera encoding and decoding synchronous display method based on Timecode. Background Art

[0002] With the popularity of 4K and 8K ultra-high-definition videos and the rise of new video applications such as virtual reality and augmented reality, higher requirements are placed on video coding technology. As the successor to H.264, H.265 (HEVC) further improves the compression efficiency, allowing ultra-high-definition videos to be transmitted and stored at a lower bit rate. In addition, the future development of video coding technology will also focus on better virtual reality support, higher dynamic range, and wider color gamut to meet the growing demand for diverse video applications.

[0003] Most encoders and decoders on the market are independent encoders and decoders, and there is no correlation between the channels. Multi-camera image synchronization mostly requires video editing, which is cumbersome to operate and not real-time. At the same time, professional multi-camera codecs are large in size and expensive. Summary of the invention

[0004] In view of the above problems, the present invention provides a multi-camera encoding and decoding synchronous display method based on Timecode, which solves the problem that the multi-camera screen synchronization operation is troublesome and the professional multi-camera codec is large and inconvenient to carry.

[0005] The technical solution adopted by the present invention to solve its technical problem is: a multi-camera encoding, decoding and synchronous display method based on Timecode, which is executed by an encoder and a decoder. The method includes: when the encoder receives multiple camera pictures, the pictures are encoded into TS code streams, and Timecode information is added to the ES data of the code stream; the decoder has multiple decoding chips built in, which are synchronized according to the Timecode value in the code stream, and the corresponding relationship between pts and Timecode is saved; the picture and the pts corresponding to the picture are decoded according to the decoding chip, the corresponding Timecode value is obtained through pts, and the picture with the same Timecode is sent to the video memory for display.

[0006] As an optimization, the decoding chip and the Timecode value in the bitstream are synchronized. The synchronization method is: (1) Pull 4 streams; (2) Cache each stream data; (3) Check whether there is data in the 4-channel code stream buffer; (4) If the result in step (3) is "yes", obtain the Timecode corresponding to the first coded packet in each bitstream; If the result of step (3) is "No", return to step (3); (5) Determine whether the four timecodes are the same; (6) If the result in step (5) is "yes", the four code streams are sent to four decoding chips at the same time, and the corresponding values ​​of pts and timecode of each channel are saved; If the result in step (5) is "No", find the largest Timecode value and record it, discard the bitstream smaller than this value, and return to step (3).

[0007] As an optimization, the method for pts to obtain the corresponding Timecode value is: (1) Get the decoded picture and the corresponding pts; (2) Cache each channel of picture data; (3) Check whether there is data in the 4-way display buffer area; (4) If the result in step (3) is "yes", then the Timecode of the corresponding picture is found from pts; If the result of step (3) is "No", return to step (3); (5) Determine whether the Timecodes of the four channels are the same; (6) If the result in step (5) is "yes", the 4-channel images are sent to the video memory for display; If the result in step (5) is "No", then find the maximum Timecode value and record it, discard the display buffer images that are smaller than this value, and return to step (3).

[0008] As an optimization, multiple cameras are connected with their own encoders.

[0009] As an optimization, the number of the decoding chips is 4.

[0010] The beneficial effects of the present invention are as follows: the present invention provides a multi-camera encoding, decoding and synchronous display method based on Timecode, which uses four decoding chips to achieve multi-camera synchronous display, thus avoiding the problem that professional multi-camera equipment is too expensive and inconvenient to carry. This solution uses Timecode as a synchronization strategy, and other solutions can also use other parameters; this solution can decode and display 4K video, and other solutions can also be used to decode and display other resolutions. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Attached Figure 1 This is a schematic diagram of the connection between the camera, encoder and decoding chip of the present invention; Attached Figure 2 is a flow chart of the synchronization method of the present invention; Attached Figure 3The present invention is a flowchart of a method for obtaining a corresponding Timecode value from pts. DETAILED DESCRIPTION

[0012] It should be noted that the following detailed descriptions are illustrative and are intended to provide further explanation of the present application. Unless otherwise specified, all technical and scientific terms used herein have the same meanings as those commonly understood by those skilled in the art to which the present application belongs.

[0013] It should be noted that the terms used herein are only for describing specific embodiments and are not intended to limit the exemplary embodiments according to the present application. As used herein, unless the context clearly indicates otherwise, the singular form is also intended to include the plural form. In addition, it should be understood that when the terms "comprise" and / or "include" are used in this specification, it indicates the presence of features, steps, operations, devices, components and / or combinations thereof.

[0014] like Figure 1 As shown, the present invention discloses a multi-camera encoding, decoding and synchronous display method based on Timecode, which is executed by an encoder and a decoder. The method includes: when the encoder receives multiple camera pictures, the pictures are encoded into TS code streams, and Timecode information is added to the ES data of the code stream; a plurality of decoding chips are built in the decoder, which are synchronized according to the Timecode value in the code stream, and the corresponding relationship between pts and Timecode is saved; the picture and the pts corresponding to the picture are decoded according to the decoding chip, the corresponding Timecode value is obtained through the pts, and the picture with the same Timecode is sent to the video memory for display.

[0015] like Figure 2 As shown, the decoding chip and the Timecode value in the bitstream are synchronized, and the synchronization method is: (1) Pull 4 streams; (2) Cache each stream data; (3) Check whether there is data in the 4-channel code stream buffer; (4) If the result in step (3) is "yes", obtain the Timecode corresponding to the first coded packet in each bitstream; If the result of step (3) is "No", return to step (3); (5) Determine whether the four timecodes are the same; (6) If the result in step (5) is "yes", the four code streams are sent to four decoding chips at the same time, and the corresponding values ​​of pts and timecode of each channel are saved; If the result in step (5) is "No", find the largest Timecode value and record it, discard the bitstream smaller than this value, and return to step (3).

[0016] like Figure 3 As shown, the method for pts to obtain the corresponding Timecode value is: (1) Get the decoded picture and the corresponding pts; (2) Cache each channel of picture data; (3) Check whether there is data in the 4-way display buffer area; (4) If the result in step (3) is "yes", then the Timecode of the corresponding picture is found from pts; If the result of step (3) is "No", return to step (3); (5) Determine whether the Timecodes of the four channels are the same; (6) If the result in step (5) is "yes", the 4-channel images are sent to the video memory for display; If the result in step (5) is "No", then find the maximum Timecode value and record it, discard the display buffer images that are smaller than this value, and return to step (3).

[0017] like Figure 1 As shown, multiple machine positions are connected to respective encoders, and the number of the decoding chips is 4.

[0018] The above-mentioned specific implementations are only specific cases of the present invention. The patent protection scope of the present invention includes but is not limited to the product form and style of the above-mentioned specific implementations. Any appropriate changes or modifications made to them by ordinary technicians in the technical field that conform to the claims of the present invention shall fall within the patent protection scope of the present invention.

Claims

1. A multi-camera encoding, decoding and synchronous display method based on Timecode, characterized in that: The method is performed by an encoder and a decoder, and includes: when the encoder receives multiple camera position pictures, encoding the pictures into a TS code stream, and adding Timecode information to the ES data of the code stream; The decoder has multiple decoding chips built in, which are synchronized according to the Timecode value in the bitstream and save the corresponding relationship between pts and Timecode; The decoding chip decodes the picture and the pts corresponding to the picture, obtains the corresponding Timecode value through the pts, and the picture with the same Timecode is sent to the video memory for display.

2. The Timecode-based multi-camera encoding, decoding and synchronous display method according to claim 1, characterized in that: The decoding chip and the Timecode value in the bitstream are synchronized. The synchronization method is: Pull 4 streams; Cache each stream data; Check whether there is data in the 4-channel code stream buffer; If the result in step (3) is "yes", then obtain the Timecode corresponding to the first coded packet in each bitstream; If the result of step (3) is "No", return to step (3); Determine whether the 4-channel Timecode is the same; If the result in step (5) is "yes", the four code streams are sent to four decoding chips at the same time, and the corresponding values ​​of pts and timecode of each channel are saved; If the result in step (5) is "No", find the largest Timecode value and record it, discard the bitstream smaller than this value, and return to step (3).

3. The Timecode-based multi-camera encoding, decoding and synchronous display method according to claim 1, characterized in that: The method for obtaining the corresponding Timecode value of pts is: Get the decoded picture and the corresponding pts; Cache each channel of picture data; Check whether the 4-way display buffer area has data; If the result in step (3) is "yes", then the Timecode of the corresponding picture is found from pts; If the result of step (3) is "No", return to step (3); Determine whether the Timecodes of the four channels are the same; If the result in step (5) is "yes", the 4-channel images are sent to the video memory for display; If the result in step (5) is "No", then find the maximum Timecode value and record it, discard the display buffer images that are smaller than this value, and return to step (3).

4. The Timecode-based multi-camera encoding, decoding and synchronous display method according to claim 1, characterized in that: Multiple cameras are connected to their own encoders.

5. The Timecode-based multi-camera encoding, decoding and synchronous display method according to claim 1, characterized in that: The number of the decoding chips is 4.

Images