Software definition-oriented general aircraft photoelectric video stream real-time display method

Abstract

The invention discloses a software definition-oriented universal aircraft photoelectric video stream real-time display method, which comprises the following steps of: reading an HEVC (High Efficiency Video Coding) coded video file shot and acquired by an aircraft, and analyzing the HEVC coded video file to obtain the number of previous IDR frames of all P frames and the word length and position information of each frame; the HEVC coding video file is decoded, and a decoded image is obtained; the decoded image is output and displayed, and in the display process, the number of previous IDR frames of all P frames and word length and position information of each frame are obtained based on analysis, and video playing and progress control are achieved. According to the invention, the important problems that the video display state cannot be freely controlled and the requirement of a user for analyzing and monitoring a high-value flight target is difficult to meet when a camera device carried by an aircraft adopts multi-core coding to store a video file in an HEVC coding format are effectively solved.

Description

Technical Field

[0001] The invention relates to the field of measurement, control and communication, and in particular to a real-time display method of optoelectronic video stream of a general aircraft oriented to software definition. Background Art

[0002] HEVC has obvious advantages over traditional methods in terms of coding performance. It can transmit video images with the same or higher resolution at a lower bit rate, which is beneficial to the real-time transmission of images collected by aircraft and the configuration optimization of storage resources. Therefore, it is increasingly used in real-time aircraft monitoring systems.

[0003] To ensure the real-time transmission and processing of video data, aircraft-mounted cameras usually use multi-core encoding. Instead of directly encapsulating the acquired bitstream in a higher-level format, they are stored in the HEVC encoding format. Existing players are unable to directly extract valid video duration information from HEVC files, which results in the inability to freely control the video display status during playback, making it difficult to meet the user's needs for analyzing and monitoring high-value flying targets. Summary of the invention

[0004] The technical problem solved by the present invention is: to overcome the shortcomings of the prior art, to provide a software-defined general aircraft optoelectronic video stream real-time display method, which is used to display and play HEVC encoded videos obtained based on optoelectronic detection equipment under flight conditions, solve the playback failure problem of existing players, and realize real-time playback of HEVC video files and free control of the display status, so as to ensure that designers can effectively monitor and analyze the flight status of high-value targets in different time periods.

[0005] The technical solution of the present invention is: a real-time display method of optoelectronic video stream of a general aircraft oriented to software definition, comprising: S1. Read the HEVC encoded video file captured by the aircraft; S2. Parsing HEVC encoded video files: Parameter initialization: Set the IDR flag to false, the IDR frame count to 0, and the NALU count to 0; Perform the following judgments on each image frame in the HEVC encoded video file and execute corresponding sub-steps until the last frame; Decision 1: If the current frame is a VPS frame or an SPS frame, execute sub-step 1: (1.1) Determine whether the current IDR flag is false. If so, the IDR frame count increases by 1, otherwise the IDR frame count remains unchanged; (1.2) The NALU count increases by 1; (1.3) Sub-step 1 is completed, and the current frame judgment ends; Judgment 2: If the current frame is an IDR frame, execute sub-step 2: (2.1) Determine whether the current IDR flag is false. If so, the IDR frame count increases by 1, otherwise the IDR frame count remains unchanged; (2.2) The NALU count increases by 1; (2.3) Set the IDR flag to true; (2.4) Sub-step 2 is completed, and the current frame judgment ends; Decision 3: If the current frame is a P frame, execute sub-step 3: Determine whether the current IDR frame count is equal to the NALU count, and the IDR flag is true. Otherwise, end the current frame judgment. If so: (3.1) reset the IDR frame count and NALU count to zero, set the IDR flag to false, and record the position and word length information of the previous frame of the P frame; (3.2) Sub-step 3 is completed, and the current frame judgment is ended; S3, decoding the HEVC encoded video file to obtain a decoded image; S4, outputting and displaying the decoded image. During the display process, based on the position of each frame, word length information and the total number of recorded frames recorded after analysis in S2, the video playback and progress control are realized.

[0006] Furthermore, FFmpeg is used to decode the HEVC encoded video file to obtain an image in YUV422 format.

[0007] Furthermore, the decoded YUV422 format image is converted into the YUY2 format supported by the DirectDraw architecture for output display.

[0008] Furthermore, the display frame rate is set to 25 frames / s, and the display interface size can be adjusted as needed.

[0009] The present invention also provides a computer program product, which implements the steps of the above method when executed by a processor.

[0010] The present invention also provides an airborne computing terminal, including a terminal body, an operating system and a controller. The airborne computing terminal is deployed on a launch vehicle. The controller includes a memory, a processor and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of the method described above are implemented to play, display and progress control the HEVC encoded video file acquired by the airborne optoelectronic detection equipment under flight conditions.

[0011] The present invention also provides a software-defined universal aircraft optoelectronic video stream real-time display system, comprising: The data interface module is used to read the HEVC encoded video files captured by the aircraft; Parsing modules, including: Initialization unit: set the IDR flag to false, the IDR frame count to 0, and the NALU count to 0; Loop parsing unit: used to make the following judgments on the image frames in the HEVC encoded video file frame by frame and execute corresponding sub-steps until the last frame; Decision 1: If the current frame is a VPS frame or an SPS frame, execute sub-step 1: (1.1) Determine whether the current IDR flag is false. If so, the IDR frame count increases by 1, otherwise the IDR frame count remains unchanged; (1.2) The NALU count increases by 1; (1.3) Sub-step 1 is completed, and the current frame judgment ends; Judgment 2: If the current frame is an IDR frame, execute sub-step 2: (2.1) Determine whether the current IDR flag is false. If so, the IDR frame count increases by 1, otherwise the IDR frame count remains unchanged; (2.2) The NALU count increases by 1; (2.3) Set the IDR flag to true; (2.4) Sub-step 2 is completed, and the current frame judgment ends; Decision 3: If the current frame is a P frame, execute sub-step 3: Determine whether the current IDR frame count is equal to the NALU count, and the IDR flag is true. Otherwise, end the current frame judgment. If so: (3.1) reset the IDR frame count and NALU count to zero, set the IDR flag to false, and record the position and word length information of the previous frame of the P frame; (3.2) Sub-step 3 is completed, and the current frame judgment is ended; A decoding module, used to decode the HEVC encoded video file to obtain a decoded image; An image display module, used to output and display the decoded image; The display control module is used to realize normal video playback and progress control during the display process based on the position of each frame, word length information and the total number of frames recorded by the analysis module.

[0012] Furthermore, in the decoding module, FFmpeg is used to decode the HEVC encoded video file to obtain an image in YUV422 format.

[0013] Furthermore, in the image display module, the image in the YUV422 format obtained after decoding is converted into the YUY2 format supported by the DirectDraw architecture for output display.

[0014] Furthermore, in the image display module, the display frame rate is set to 25 frames / s, and the display interface size can be adjusted according to demand.

[0015] The advantages of the present invention compared with the prior art are: (1) The present invention effectively solves the important problem that when the aircraft-mounted camera device uses multi-core encoding to store video files in the HEVC encoding format, the video display state cannot be freely controlled, making it difficult to meet the needs of users to analyze and monitor high-value flight targets. The method proposed in the present invention can accurately calculate the number of key frames, word length, position and other information, the playback progress is flexibly adjustable, and the display state can be freely controlled.

[0016] (2) The present invention can accurately calculate the duration of the video stream based on the optoelectronic video stream information, and realize direct decoding and playback of HEVC encoded files, thereby solving the problem that existing players need to perform secondary packaging of HEVC files before they can be played. The present invention does not require multiple packaging and is suitable for direct and efficient processing of HEVC optoelectronic video information carried by arrows.

[0017] (3) The present invention is designed based on the FFmpeg open source architecture to realize the gating function based on software definition. The development architecture is universal, the design is autonomous and controllable, and it is convenient for secondary development. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 is a flow chart of the method of the present invention; Figure 2 It is a schematic diagram of the system composition of the present invention. DETAILED DESCRIPTION

[0019] In order to better understand the technical solution of the present invention, the embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0020] The present invention proposes a real-time display method for a software-defined general aircraft optoelectronic video stream. The process can be referred to Figure 1 , specifically including: Step 1: Read the HEVC encoded video file captured by the aircraft (consisting of a series of P frames, IDR frames, SPS frames, and VPS frames); Step 2: Parse HEVC encoded video files: Parameter initialization: Set the IDR flag to false, the IDR frame count to 0, and the NALU count to 0; Perform the following judgments on each image frame in the HEVC encoded video file and execute corresponding sub-steps until the last frame; Decision 1: If the current frame is a VPS frame or an SPS frame, execute sub-step 1: (1.1) Determine whether the current IDR flag is false. If so, the IDR frame count increases by 1, otherwise the IDR frame count remains unchanged; (1.2) The NALU count increases by 1; (1.3) Sub-step 1 is completed, and the current frame judgment ends; Decision 2: If the current frame is an IDR frame, execute sub-step 2: (2.1) Determine whether the current IDR flag is false. If so, the IDR frame count increases by 1, otherwise the IDR frame count remains unchanged; (2.2) The NALU count increases by 1; (2.3) Set the IDR flag to true; (2.4) Sub-step 2 is completed, and the current frame judgment ends; Decision 3: If the current frame is a P frame, execute sub-step 3: Determine whether the current IDR frame count is equal to the NALU count, and the IDR flag is true. Otherwise, end the current frame judgment. If so: (3.1) reset the IDR frame count and NALU count to zero, set the IDR flag to false, and record the position and word length information of the previous frame of the P frame (i.e., the IDR frame); (3.2) Sub-step 3 is completed, and the current frame judgment is ended; Step 3: Decode the HEVC encoded video file by using FFmpeg to obtain an image in YUV422 format; Step 4: Convert the decoded YUV422 format image into the YUY2 format supported by the DirectDraw architecture for output display. The display frame rate is set to 25 frames / s, and the display interface size can be adjusted as needed. During the display process, based on the position of each frame, word length information and the total number of recorded frames (i.e., the number of IDR frames before all recorded P frames) recorded in S2, the video playback and progress control are realized.

[0021] The present invention also provides a decoding display system, the module composition of which is as follows Figure 2 As shown, including: The data interface module is used to read the HEVC encoded video files captured by the aircraft; Parsing modules, including: Initialization unit: set the IDR flag to false, the IDR frame count to 0, and the NALU count to 0; Loop parsing unit: used to make the following judgments and perform corresponding operations on the image frames in the HEVC encoded video file frame by frame until the last frame; Decision 1: If the current frame is a VPS frame or an SPS frame, execute sub-step 1: (1.1) Determine whether the current IDR flag is false. If so, the IDR frame count increases by 1, otherwise the IDR frame count remains unchanged; (1.2) The NALU count increases by 1; (1.3) Sub-step 1 is completed, and the current frame judgment ends; Judgment 2: If the current frame is an IDR frame, execute sub-step 2: (2.1) Determine whether the current IDR flag is false. If so, the IDR frame count increases by 1, otherwise the IDR frame count remains unchanged; (2.2) The NALU count increases by 1; (2.3) Set the IDR flag to true; (2.4) Sub-step 2 is completed, and the current frame judgment ends; Decision 3: If the current frame is a P frame, execute sub-step 3: Determine whether the current IDR frame count is equal to the NALU count, and the IDR flag is true. Otherwise, end the current frame judgment. If so: (3.1) reset the IDR frame count and NALU count to zero, set the IDR flag to false, and record the position and word length information of the previous frame of the P frame; (3.2) Sub-step 3 is completed, and the current frame judgment is ended; A decoding module, used to decode the HEVC encoded video file to obtain a decoded image; An image display module, used to output and display the decoded image; The display control module is used to realize the playback and progress control of the video during the display process based on the position of each frame, word length information and the total number of frames recorded by the analysis module.

[0022] The present invention also relates to a computer program product, which implements the steps of the above method when being executed by a processor.

[0023] The present invention also relates to an airborne computing terminal, comprising a terminal body, an operating system and a controller. The airborne computing terminal is deployed on a launch vehicle. The controller comprises a memory, a processor and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of the aforementioned method are implemented to play, display and progress control the HEVC encoded video files acquired by the airborne optoelectronic detection equipment under flight conditions.

[0024] It is to be understood that the present invention is described by way of embodiments, and it is known to those skilled in the art that various changes or equivalent substitutions may be made to these features and embodiments without departing from the spirit and scope of the present invention. In addition, under the teachings of the present invention, these features and embodiments may be modified to adapt to specific circumstances without departing from the spirit and scope of the present invention. Therefore, the present invention is not limited by the specific embodiments disclosed herein, and embodiments that can fall within the scope of the claims of this application all fall within the scope protected by the present invention.

[0025] The contents not described in detail in the specification of the present invention belong to the common knowledge of those skilled in the art.

Claims

1. A software-defined general aircraft optoelectronic video stream real-time display method, characterized in that: include: S1. Read the HEVC encoded video file captured by the aircraft; S2. Parsing HEVC encoded video files: Parameter initialization: Set the IDR flag to false, the IDR frame count to 0, and the NALU count to 0; Perform the following judgments on each image frame in the HEVC encoded video file and execute corresponding sub-steps until the last frame; Decision 1: If the current frame is a VPS frame or an SPS frame, execute sub-step 1: (1.1) Determine whether the current IDR flag is false. If so, the IDR frame count increases by 1, otherwise the IDR frame count remains unchanged; (1.2) The NALU count increases by 1; (1.3) Sub-step 1 is completed, and the current frame judgment ends; Judgment 2: If the current frame is an IDR frame, execute sub-step 2: (2.1) Determine whether the current IDR flag is false. If so, the IDR frame count is increased by 1, otherwise the IDR frame count remains unchanged; (2.2) NALU count is increased by 1; (2.3) IDR flag is set to true; (2.4) Sub-step 2 is completed, and the current frame judgment ends; Decision 3: If the current frame is a P frame, execute sub-step 3: Determine whether the current IDR frame count is equal to the NALU count, and the IDR flag is true. Otherwise, end the current frame judgment. If so: (3.1) reset the IDR frame count and NALU count to zero, set the IDR flag to false, and record the position and word length information of the previous frame of the P frame; (3.2) Sub-step 3 is completed, and the current frame judgment is ended; S3, decoding the HEVC encoded video file to obtain a decoded image; S4, outputting and displaying the decoded image. During the display process, based on the position of each frame, word length information and the total number of recorded frames recorded after analysis in S2, the video playback and progress control are realized.

2. The method for real-time display of optoelectronic video stream of general aircraft for software definition according to claim 1, characterized in that: Use FFmpeg to decode HEVC encoded video files and obtain images in YUV422 format.

3. The method for real-time display of optoelectronic video stream of general aircraft for software definition according to claim 2, characterized in that: The decoded YUV422 format image is converted into the YUY2 format supported by the DirectDraw architecture for output display.

4. The method for real-time display of optoelectronic video stream of general aircraft for software definition according to claim 1, characterized in that: The display frame rate is set to 25 frames / s, and the display interface size can be adjusted as needed.

5. A computer program product, characterized in that: When the computer program product is executed by a processor, the steps of the method according to any one of claims 1 to 4 are implemented.

6. An airborne computing terminal, comprising a terminal body, an operating system and a controller, characterized in that: The airborne computing terminal is deployed on a launch vehicle, and the controller includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of the method as described in any one of claims 1 to 4 are implemented to play, display, and control the progress of the HEVC encoded video file acquired by the airborne optoelectronic detection equipment under flight conditions.

7. A software-defined general aircraft optoelectronic video stream real-time display system, characterized in that: include: The data interface module is used to read the HEVC encoded video files captured by the aircraft; Parsing modules, including: Initialization unit: set the IDR flag to false, the IDR frame count to 0, and the NALU count to 0; Loop parsing unit: used to make the following judgments on the image frames in the HEVC encoded video file frame by frame and execute corresponding sub-steps until the last frame; Decision 1: If the current frame is a VPS frame or an SPS frame, execute sub-step 1: (1.1) Determine whether the current IDR flag is false. If so, the IDR frame count increases by 1, otherwise the IDR frame count remains unchanged; (1.2) The NALU count increases by 1; (1.3) Sub-step 1 is completed, and the current frame judgment ends; Judgment 2: If the current frame is an IDR frame, execute sub-step 2: (2.1) Determine whether the current IDR flag is false. If so, the IDR frame count increases by 1, otherwise the IDR frame count remains unchanged; (2.2) The NALU count increases by 1; (2.3) Set the IDR flag to true; (2.4) Sub-step 2 is completed, and the current frame judgment ends; Decision 3: If the current frame is a P frame, execute sub-step 3: Determine whether the current IDR frame count is equal to the NALU count, and the IDR flag is true. Otherwise, end the current frame judgment. If so: (3.1) reset the IDR frame count and NALU count to zero, set the IDR flag to false, and record the position and word length information of the previous frame of the P frame; (3.2) Sub-step 3 is completed, and the current frame judgment is ended; A decoding module, used to decode the HEVC encoded video file to obtain a decoded image; An image display module, used to output and display the decoded image; The display control module is used to realize normal video playback and progress control during the display process based on the position of each frame, word length information and the total number of frames recorded by the analysis module.

8. The method for real-time display of optoelectronic video stream of general aircraft for software definition according to claim 7, characterized in that: In the decoding module, FFmpeg is used to decode the HEVC encoded video file to obtain an image in YUV422 format.

9. The method for real-time display of optoelectronic video stream of general aircraft for software definition according to claim 1, characterized in that: In the image display module, the decoded YUV422 format image is converted into the YUY2 format supported by the DirectDraw architecture for output display.

10. The method for real-time display of optoelectronic video stream of general aircraft for software definition according to claim 1, characterized in that: In the image display module, the display frame rate is set to 25 frames / s, and the display interface size can be adjusted according to needs.

Images