Audio and video acquisition system based on SRIO
The SRIO-based audio and video acquisition system solves the problems of low data transmission efficiency and insufficient reliability in the acquisition of multiple high-definition video and audio channels in traditional systems, and achieves efficient and reliable audio and video data acquisition and transmission, ensuring the stable operation of the system in complex environments.
Patent Information
- Application Number
- CN202510923039.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-07-04
- Publication Date
- 2025-11-04
AI Technical Summary
Traditional audio and video acquisition systems suffer from low data transmission efficiency, insufficient system reliability, and weak anomaly handling capabilities when faced with the need for high-speed acquisition of multiple channels of high-definition video and audio, making it difficult to meet the requirements of real-time performance and reliability.
An SRIO-based audio and video acquisition system is adopted, including an audio and video acquisition module, an SRIO transmission module, and a data processing module. The system utilizes an FPGA parsing and conversion unit and a HI3531D video encoder for data parsing and compression. Combined with a data backup unit and an anomaly handling module, the system ensures the integrity of data transmission and the stability of the system.
It significantly improves the efficiency of audio and video data acquisition and transmission, enhances the stability and reliability of the system in complex environments, and reduces system downtime caused by anomalies.
Smart Images
Figure CN120897024A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of avionics, and in particular to an SRIO-based audio and video acquisition system. Background Technology
[0002] In the field of avionics technology and in modern communication and multimedia applications, the acquisition and transmission of audio and video data are crucial. Traditional audio and video acquisition systems often suffer from performance bottlenecks when faced with the high-speed acquisition requirements of multiple high-definition video and multiple audio streams, making it difficult to meet the requirements of real-time performance and reliability. Especially in the context of a high-speed communication network throughout the aircraft, the acquisition and transmission of audio and video data require higher bandwidth, lower latency, and stronger reliability.
[0003] In existing technologies, audio and video acquisition systems typically employ traditional bus technology or network transmission technology. These technologies suffer from the following problems in the parallel acquisition and transmission of multiple audio and video data: 1. Low data transmission efficiency: Traditional bus technology has limited bandwidth, making it difficult to meet the high-speed acquisition requirements of multiple high-definition audio and video data.
[0004] 2. Insufficient system reliability: In complex environments, audio and video acquisition systems are easily interfered with, leading to data loss or transmission errors.
[0005] 3. Weak anomaly handling capability: The existing system lacks an efficient anomaly detection and recovery mechanism, making it difficult to ensure the stable operation of the system under abnormal circumstances. Summary of the Invention
[0006] In view of this, this application provides an SRIO-based audio and video acquisition system that solves some of the problems in the prior art. It utilizes the high speed and reliability of SRIO to achieve full-machine multi-channel high-definition video and multi-channel audio acquisition and recording.
[0007] The SRIO-based audio and video acquisition system provided in this application adopts the following technical solution: An SRIO-based audio and video acquisition system includes an audio and video acquisition module, an SRIO transmission module, and a data processing module; The audio and video acquisition module is used to receive audio and video data from multiple cameras and / or microphones, and to parse, convert, and group the audio and video data. The audio and video acquisition module sends the grouped audio and video data to the SRIO transmission module. The SRIO transmission module sends multiple audio and video data in parallel to the data processing module. The data processing module preprocesses the audio and video data and sends the preprocessed data to the recording system.
[0008] Optionally, the audio and video acquisition module includes an FPGA parsing and conversion unit and an HI3531D video encoder. The FPGA parsing and conversion unit is used to parse and convert the received audio and video data, and organize the converted audio data according to the hardware channel number and data type before sending it to the SRIO transmission module. The FPGA parsing and conversion unit sends the converted video data to the HI3531D video encoder, which is used to compress and group the converted video data. The HI3531D video encoder organizes the data according to the hardware channel number and data type before sending it to the SRIO transmission module.
[0009] Optionally, the audio and video acquisition module further includes a data backup unit, which is used to back up the latest 16 packets of data from each channel and update them cyclically.
[0010] Optionally, the FPGA parsing and conversion unit and the HI3531D video encoder organize the data according to a preset data packet format. The data packet format includes a packet header and a packet trailer. Both the packet header and the packet trailer include a frame header, a data identifier, a frame sequence number, a data length, and frame check information. The data identifier, frame sequence number, data length, and frame check information in the packet header and the packet trailer are identical. The frame header encodings in the packet header and the packet trailer are reversed. The data processing module determines the correctness and integrity of the data packet by comparing whether the packet header and packet trailer information are consistent.
[0011] Optionally, the SRIO transmission module includes a data area and a command area. The data area is used to receive and store audio and video data sent by the audio and video acquisition module. The command area is divided into a command word area and a command response area. The command word area is used to store commands written by the data processing module, and the commands in the command word area are used for reading by the audio and video acquisition module. The command response area is used to store commands written by the audio and video acquisition module, and the commands in the command response area are used for reading by the data processing module.
[0012] Optionally, the data area memory allocation rules are as follows: the total size of the data area memory is Z bytes, the audio and video acquisition system acquires m video channels and n audio channels, the data volume of each video channel is x bytes / s, and the data volume of each audio channel is y bytes / s; The total video memory size is Each video stream occupies a memory size of ; Total audio memory size is Each audio channel occupies a memory size of ; Each video stream's memory is divided into 16 data blocks, each data block being [size missing]. Each audio channel's memory is divided into 16 data blocks, each data block being [size missing]. ; The audio and video data are stored at the memory starting offset of the corresponding channel according to the channel selection, and the acquired audio and video data are stored in a 16-block loop.
[0013] Optionally, after receiving the data sent by the audio and video acquisition module, the data processing module sequentially determines whether the data packet header and packet tail information are consistent, whether the data frame sequence number is continuous, calculates the packet header checksum and checks whether it is correct. If the data is correct and complete, the data processing module sends the correct and complete data to the recording system. If there is an error in the data, the data processing module sets a fault word and writes a retransmission instruction to the command word area of the SRIO transmission module. The audio and video acquisition module periodically checks whether there is a data retransmission instruction word. When a retransmission instruction word exists, it parses the retransmission instruction and searches for the corresponding data in the data backup area according to the data type, channel number, data block number, and data frame sequence number. If there is packet data that needs to be retransmitted, the data is reorganized and stored in the data area of the SRIO transmission module; otherwise, a fault word for no backup data is set.
[0014] Optionally, during normal system operation, the data processing module writes a self-test command to the command word area of the SRIO transmission module at a period of 500ms. The audio and video acquisition module periodically checks whether there is a self-test command word and organizes and sends the fault word of the audio and video acquisition module to the SRIO self-test command response area of the SRIO transmission module. In system maintenance mode, the main control board data processing module writes a version retrieval command to the command word area of the SRIO transmission module. The audio and video acquisition module periodically checks whether there is a version retrieval command word and organizes and sends the version information of the audio and video acquisition module to the SRIO version command response area of the SRIO transmission module.
[0015] Optionally, the audio and video acquisition system also includes an anomaly handling module, which is used to detect data transmission anomalies detected by the data processing module. The anomaly handling module is used to record relevant information about the current anomaly after the continuous error count exceeds 10 during the audio and video acquisition process.
[0016] In summary, this application includes the following beneficial technical effects: This application significantly improves the efficiency of audio and video data acquisition and transmission by leveraging the high speed and low latency characteristics of SRIO.
[0017] The exception handling design of this application ensures the stability and reliability of the system in complex environments and reduces system downtime caused by exceptions. Attached Figure Description
[0018] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0019] Figure 1 This is a block diagram illustrating the principle of the SRIO-based audio and video acquisition system of this application; Figure 2 This is a schematic diagram of the audio and video acquisition module of this application; Figure 3 This is a flowchart illustrating the operation of the SRIO multi-channel audio and video acquisition system in this application. Detailed Implementation
[0020] The embodiments of this application will now be described in detail with reference to the accompanying drawings.
[0021] The following specific examples illustrate the implementation of this application. Those skilled in the art can easily understand other advantages and effects of this application from the content disclosed in this specification. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. This application can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of this application. It should be noted that, in the absence of conflict, the following embodiments and features in the embodiments can be combined with each other. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0022] It should be noted that various aspects of embodiments within the scope of the appended claims are described below. It will be apparent that the aspects described herein can be embodied in a wide variety of forms, and any particular structure and / or function described herein is merely illustrative. Based on this application, those skilled in the art will understand that one aspect described herein can be implemented independently of any other aspect, and two or more of these aspects can be combined in various ways. For example, any number of aspects set forth herein can be used to implement the device and / or practice the method. Additionally, this device and / or method can be implemented using structures and / or functionalities other than one or more of the aspects set forth herein.
[0023] It should also be noted that the illustrations provided in the following embodiments are only schematic representations of the basic concept of this application. The illustrations only show the components related to this application and are not drawn according to the number, shape and size of the components in actual implementation. In actual implementation, the form, quantity and proportion of each component can be arbitrarily changed, and the layout of the components may also be more complex.
[0024] Furthermore, specific details are provided in the following description to facilitate a thorough understanding of the examples. However, those skilled in the art will understand that the described aspects can be practiced without these specific details.
[0025] This application provides an SRIO-based audio and video acquisition system.
[0026] like Figures 1 to 3 As shown, an SRIO-based audio and video acquisition system includes an audio and video acquisition module, an SRIO transmission module, and a data processing module.
[0027] The audio and video acquisition module is used to receive audio and video data from multiple cameras and / or microphones, and to parse, convert, and group the audio and video data. The audio and video acquisition module sends the grouped audio and video data to the SRIO transmission module. The SRIO transmission module sends multiple audio and video data in parallel to the data processing module. The data processing module preprocesses the audio and video data and sends the preprocessed data to the recording system.
[0028] The audio and video acquisition module acquires multiple channels of ARIN818 video and audio data according to the hardware design channels. The audio and video acquisition module includes an FPGA parsing and conversion unit and an HI3531D video encoder. The FPGA parsing and conversion unit is used to parse and convert the received audio and video data, and organizes the converted audio data according to the hardware channel number and data type before sending it to the SRIO transmission module. The FPGA parsing and conversion unit sends the converted video data to the HI3531D video encoder, which is used to compress and group the converted video data. The HI3531D video encoder organizes the data according to the hardware channel number and data type before sending it to the SRIO transmission module.
[0029] The FPGA parsing and conversion unit and the HI3531D video encoder organize the data according to a preset data packet format. The data packet format includes a packet header and a packet trailer. Both the packet header and the packet trailer include a frame header, a data identifier, a frame sequence number, a data length, and frame check information. The data identifier, frame sequence number, data length, and frame check information in the packet header and the packet trailer are identical. The frame header encodings in the packet header and the packet trailer are reversed. The data processing module determines the correctness and integrity of the data packet by comparing whether the packet header and packet trailer information are consistent.
[0030] In this application, the audio / video acquisition module is responsible for acquiring multiple channels of high-definition video and audio, supporting various audio and video formats. The SRIO transmission module can simultaneously process multiple channels of high-definition video and audio data via the SRIO bus. By optimizing the data transmission protocol and scheduling algorithm, the bandwidth resources of SRIO are fully utilized to improve data transmission efficiency and take full advantage of SRIO's high speed, low latency, and high reliability. The data processing module preprocesses the acquired audio and video data, including data compression and format conversion.
[0031] The audio and video acquisition module groups multiple audio and video data according to hardware channel and data type rules, calculates frame rate and checksum, organizes and packages the data according to the data packet format, and stores the organized data according to the memory address allocated by the SRIO transmission module to ensure efficient data transmission.
[0032] The SRIO transmission module divides memory according to the number of video channels, audio channels, video data volume, and audio data volume in the audio and video acquisition system, and places the corresponding data exchanged between the audio and video board and the main control board into the designated area to ensure the integrity and correctness of parallel data transmission.
[0033] Specifically, the SRIO transmission module includes a data area and a command area. The data area is used to receive and store audio and video data sent by the audio and video acquisition module. The command area is divided into a command word area and a command response area. The command word area is used to store commands written by the data processing module, and the commands in the command word area are used for reading by the audio and video acquisition module. The command response area is used to store commands written by the audio and video acquisition module, and the commands in the command response area are used for reading by the data processing module. The data area is limited to write operations by the audio and video module and read operations by the data processing module. The command area is divided into a command word area and a command response area, where the command word area is limited to write operations by the data processing module and read operations by the audio and video acquisition module; the command response area is limited to write operations by the audio and video acquisition module and read operations by the data processing module, ensuring memory read and write independence.
[0034] The data area memory allocation rules are as follows: The total size of the data area memory is Z bytes. The audio and video acquisition system acquires m video channels and n audio channels. The data volume of each video channel is x bytes / s, and the data volume of each audio channel is y bytes / s.
[0035] The total video memory size is Each video stream occupies a memory size of .
[0036] Total audio memory size is Each audio channel occupies a memory size of .
[0037] Each video stream's memory is divided into 16 data blocks, each data block being [size missing]. Each audio channel's memory is divided into 16 data blocks, each data block being [size missing]. .
[0038] The audio and video data are stored at the memory starting offset of the corresponding channel according to the channel selection, and the acquired audio and video data are stored in a 16-block loop.
[0039] The audio and video acquisition module also includes a data backup unit, which is used to back up the latest 16 packets of data from each channel and update them cyclically.
[0040] After receiving the data sent by the audio and video acquisition module, the data processing module sequentially checks whether the data packet header and footer information are consistent, whether the data frame sequence number is continuous, calculates the header checksum and checks whether it is correct. If the data is correct and complete, the data processing module sends the correct and complete data to the recording system. If there is an error in the data, the data processing module sets a fault word and writes a retransmission instruction to the command word area of the SRIO transmission module. The audio and video acquisition module periodically checks whether there is a data retransmission instruction word. When a retransmission instruction word exists, it parses the retransmission instruction and searches for the corresponding data in the data backup area according to the data type, channel number, data block number, and data frame sequence number. If there is packet data that needs to be retransmitted, the data is reorganized and stored in the data area of the SRIO transmission module; otherwise, a fault word for no backup data is set.
[0041] During normal system operation, the data processing module on the main control board writes a self-test command to the command word area of the SRIO transmission module every 500ms. The audio and video acquisition module periodically checks whether there is a self-test command word and sends the fault word of the audio and video acquisition module to the SRIO self-test command response area of the SRIO transmission module. In product maintenance mode, the main control board organizes and reports version information for all software configuration items. The main control board's data processing module writes a version retrieval command to the command word area of the SRIO transmission module. The audio / video acquisition module periodically checks for the presence of a version retrieval command and organizes and sends the audio / video acquisition module's version information to the SRIO version command response area of the SRIO transmission module. It should be noted that in maintenance mode, ground maintenance personnel can view software configuration item version information via the interface software's command buttons and view relevant fault information via the self-test button.
[0042] The audio and video acquisition system also includes an anomaly handling module. The anomaly handling module is used to detect data transmission anomalies detected by the data processing module. The anomaly handling module is used to record relevant information about the current anomaly after the continuous error count exceeds 10 during the audio and video acquisition process. The relevant information about the anomaly includes fault word information of the data processing module and fault word information of the audio and video acquisition module, which is convenient for subsequent troubleshooting and optimization.
[0043] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. An SRIO-based audio and video acquisition system, characterized in that, It includes an audio / video acquisition module, an SRIO transmission module, and a data processing module; The audio and video acquisition module is used to receive audio and video data from multiple cameras and / or microphones, and to parse, convert, and group the audio and video data. The audio and video acquisition module sends the grouped audio and video data to the SRIO transmission module. The SRIO transmission module sends multiple audio and video data in parallel to the data processing module. The data processing module preprocesses the audio and video data and sends the preprocessed data to the recording system.
2. The SRIO-based audio and video acquisition system according to claim 1, characterized in that, The audio and video acquisition module includes an FPGA parsing and conversion unit and an HI3531D video encoder. The FPGA parsing and conversion unit is used to parse and convert the received audio and video data, and organizes the converted audio data according to the hardware channel number and data type before sending it to the SRIO transmission module. The FPGA parsing and conversion unit sends the converted video data to the HI3531D video encoder, which is used to compress and group the converted video data. The HI3531D video encoder organizes the data according to the hardware channel number and data type before sending it to the SRIO transmission module.
3. The SRIO-based audio and video acquisition system according to claim 2, characterized in that, The audio and video acquisition module also includes a data backup unit, which is used to back up the latest 16 packets of data from each channel and update them cyclically.
4. The SRIO-based audio and video acquisition system according to claim 3, characterized in that, The FPGA parsing and conversion unit and the HI3531D video encoder organize the data according to a preset data packet format. The data packet format includes a packet header and a packet trailer. Both the packet header and the packet trailer include a frame header, a data identifier, a frame sequence number, a data length, and frame check information. The data identifier, frame sequence number, data length, and frame check information in the packet header and the packet trailer are identical. The frame header encodings in the packet header and the packet trailer are reversed. The data processing module determines the correctness and integrity of the data packet by comparing whether the packet header and packet trailer information are consistent.
5. The SRIO-based audio and video acquisition system according to claim 4, characterized in that, The SRIO transmission module includes a data area and a command area. The data area is used to receive and store audio and video data sent by the audio and video acquisition module. The command area is divided into a command word area and a command response area. The command word area is used to store commands written by the data processing module, and the commands in the command word area are used for reading by the audio and video acquisition module. The command response area is used to store commands written by the audio and video acquisition module, and the commands in the command response area are used for reading by the data processing module.
6. The SRIO-based audio and video acquisition system according to claim 4, characterized in that, The data area memory allocation rules are as follows: The total size of the data area memory is Z bytes. The audio and video acquisition system acquires m video channels and n audio channels. The data volume of each video channel is x bytes / s, and the data volume of each audio channel is y bytes / s. The total video memory size is Each video stream occupies a memory size of ; Total audio memory size is Each audio channel occupies a memory size of ; Each video stream's memory is divided into 16 data blocks, each data block being [size missing]. Each audio channel's memory is divided into 16 data blocks, each data block being [size missing]. ; The audio and video data are stored at the memory starting offset of the corresponding channel according to the channel selection, and the acquired audio and video data are stored in a 16-block loop.
7. The SRIO-based audio and video acquisition system according to claim 5, characterized in that; After receiving the data sent by the audio and video acquisition module, the data processing module sequentially checks whether the data packet header and footer information are consistent, whether the data frame sequence number is continuous, calculates the header checksum and checks whether it is correct. If the data is correct and complete, the data processing module sends the correct and complete data to the recording system. If there is an error in the data, the data processing module sets a fault word and writes a retransmission instruction to the command word area of the SRIO transmission module. The audio and video acquisition module periodically checks whether there is a data retransmission instruction word. When a retransmission instruction word exists, it parses the retransmission instruction and searches for the corresponding data in the data backup area according to the data type, channel number, data block number, and data frame sequence number. If there is packet data that needs to be retransmitted, the data is reorganized and stored in the data area of the SRIO transmission module; otherwise, a fault word for no backup data is set.
8. The SRIO-based audio and video acquisition system according to claim 5, characterized in that, During normal system operation, the data processing module writes a self-test command to the command word area of the SRIO transmission module every 500ms. The audio and video acquisition module periodically checks whether there is a self-test command word and sends the fault word of the audio and video acquisition module to the SRIO self-test command response area of the SRIO transmission module. In system maintenance mode, the main control board data processing module writes a version retrieval command to the command word area of the SRIO transmission module. The audio and video acquisition module periodically checks whether there is a version retrieval command word and organizes and sends the version information of the audio and video acquisition module to the SRIO version command response area of the SRIO transmission module.
9. The SRIO-based audio and video acquisition system according to claim 5, characterized in that, The audio and video acquisition system also includes an anomaly handling module, which is used to detect abnormal data transmission events detected by the data processing module. The anomaly handling module is used to record relevant information about the current abnormal event after the continuous error count exceeds 10 times during the audio and video acquisition process.