Wide-breadth high-frame-rate multi-mode satellite-borne camera simulation device and method

By designing a multi-mode simulation camera comprehensive control unit and an analog image data transmission unit, the wide format high frame rate and multi-mode dynamic switching of the satellite camera simulation device are realized, which solves the problem that the simulation device in the prior art cannot meet the test requirements of the satellite camera load, and improves the testing efficiency and reliability.

CN120302151APending Publication Date: 2025-07-11HUAZHONG UNIV OF SCI & TECH
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202510560989.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-04-30
Publication Date
2025-07-11

AI Technical Summary

Technical Problem

The existing satellite-based camera simulation devices cannot realize wide-format high frame rate and multi-mode simulation, and cannot meet the actual working needs of the satellite-based camera load, resulting in an extended ground test cycle.

Method used

A wide-format high-frame multi-mode satellite camera simulation device is designed, including a multi-mode analog camera comprehensive control unit and an analog image data transmission unit. The dynamic working mode switching is realized through the software setting parameter modification function, and the PCIe high-speed interface and different interfaces are used to output simulated image data, which supports full-frame full-frame rate, narrow-frame full-frame rate, full-frame frame reduction rate, narrow-frame frame reduction rate and window opening mode.

Benefits of technology

It realizes dynamic switching of working modes under constant power, supports wide format and high frame rate analog image output, meets various test requirements for image processing loads on the star, and improves test efficiency and reliability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120302151A_ABST
    Figure CN120302151A_ABST
Patent Text Reader

Abstract

The invention discloses a wide-breadth high-frame-rate multi-mode satellite-borne camera simulation device and method, and belongs to the field of remote sensing imaging satellite simulation imaging. The satellite-borne camera simulation device comprises a multi-mode simulation camera comprehensive control unit which analyzes satellite-borne camera simulation device working parameters input by a user and generates wide-breadth test image data and a control instruction; a control instruction is issued to the analog image data transmission unit to modify working parameters, and dynamic switching of working modes is carried out; the analog image data transmission unit caches the wide-breadth test image data sent by the multi-mode analog camera comprehensive control unit, and forwards the wide-breadth test image data to a spaceborne image processing load from a specified interface channel according to the working mode of the spaceborne camera simulation device corresponding to the control instruction; any interface channel is specified by different working modes. The satellite-borne camera simulation device can output wide-breadth and high-frame-rate simulation camera images and support dynamic switching of multiple working modes to meet the test requirements of satellite-borne image processing loads.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the field of remote sensing imaging satellite simulation imaging, and more specifically, relates to an on-board camera simulation device and method with a wide field of view, high frame rate, and multiple modes. Background Art

[0002] Remote sensing imaging satellites have a wide range of applications in the fields of environmental monitoring, resource exploration, and military reconnaissance. The acquisition, processing, and transmission of remote sensing images are the keys to realizing the functions of satellites. Remote sensing images are obtained by on-board camera payloads, and after passing through data compression processing and other payloads, they are then transmitted to the ground through the data transmission subsystem. In the above remote sensing satellite image link, the R & D technology of on-board camera payloads is quite difficult, and their design, manufacturing, and testing usually require a long time cycle. The delivery time often lags behind other satellite systems, causing difficulties in the joint debugging and verification of the image link and the overall assembly and testing of the satellite, resulting in an increase in the ground testing time of the entire satellite.

[0003] An on-board camera simulator is an effective solution to the above problems, capable of simulating the image output function of on-board camera payloads during the ground testing stage and realizing the comprehensive testing of other image link payloads and satellite platforms. An on-board camera simulator is an important part of the satellite ground testing system and is of great significance for shortening the satellite ground testing cycle and accelerating the satellite development progress.

[0004] Currently, advanced on-board camera payloads usually have the imaging characteristics of a wide field of view and high frame rate, and have multiple working modes such as full-frame, narrow-frame, full-frame rate, reduced-frame rate, and windowed output of images. During on-orbit operation, dynamic working mode switching is performed through remote control commands, and the camera working mode can be changed without shutting down. Therefore, an on-board camera simulator must have the above functions and capabilities. Patent CN202010339254.1 and patent CN202010147730.X use Ethernet and PXIe as the data transmission interfaces between the simulation camera software and hardware, and only support outputting images through LVDS and 2711 interfaces. Due to the limited data bandwidth of these interfaces, wide-field high-frame rate images cannot be output. Patent CN202310234912.4 uses multiple CoaXPress synchronous interfaces to output remote sensing images, only supports the working mode of a single simulation camera, does not have multi-mode characteristics and dynamic working mode switching functions, and cannot fully simulate the actual working conditions of on-board cameras. Therefore, a simulation device that can fully simulate the wide-field, high-frame rate, and multi-mode camera payloads of remote sensing imaging satellites is needed. Summary of the Invention

[0005] Aiming at the deficiencies of the related technologies, the purpose of the present invention is to provide an on-board camera simulation device and method with a wide field of view, high frame rate, and multiple modes, aiming to solve the problem that the existing on-board camera simulation imaging devices cannot simulate the on-board camera payloads with multiple modes and wide-field high frames.

[0006] To achieve the above object, in a first aspect, the present invention provides a spaceborne camera simulation device with a wide field of view, high frame rate, and multiple modes, including:

[0007] A multi-mode simulation camera integrated control unit, which is used to analyze the working parameters of the spaceborne camera simulation device input by the user, generate wide-field test image data and control instructions; and is also used to issue control instructions to modify the working parameters and perform dynamic switching of working modes without power-off and without reconfiguring the program in the analog image data transmission unit.

[0008] An analog image data transmission unit, which is used to cache the wide-field test image data sent by the multi-mode simulation camera integrated control unit and forward it to the spaceborne image processing payload from a specified interface channel according to the working mode of the spaceborne camera simulation device corresponding to the control instruction.

[0009] Among them, the working modes of the spaceborne camera simulation device include: full-frame full-frame rate, narrow-frame full-frame rate, full-frame reduced frame rate, narrow-frame reduced frame rate, and windowing. Different working modes are used to specify any interface channel.

[0010] Optionally, the multi-mode simulation camera integrated control unit includes:

[0011] An analog camera working parameter setting module, which is used to receive the working parameters of the spaceborne camera simulation device set by the user, obtain the analog image format size, pixel bit depth, windowing coordinates, sending channel, and sending frame rate; generate corresponding mode control instructions according to the working mode set by the user, and is used to control the subsequent image generation module, multi-mode remote sensing image processing module, image packing and caching module, and analog image data transmission unit.

[0012] An image generation module, which is used to generate original analog image data according to the parsed pixel bit depth.

[0013] A multi-mode remote sensing image processing module, which is used to perform format cropping or windowing processing on the original analog image according to the received analog image format size and windowing coordinates.

[0014] An image packing and caching module, which is used to pack the analog image data processed by the multi-mode remote sensing image processing module into camera frames according to the spaceborne camera format protocol and send them into the cache queue.

[0015] A software data transmission control module, which is used to read the data in the cache queue through memory preloading technology and transmit the camera frame data and working parameters through a PCIe high-speed interface.

[0016] Optionally, the analog image data transmission unit includes:

[0017] The hardware data transmission control module is used to receive the camera frame data and working parameters sent by the software data transmission control module;

[0018] The DDR3 multi-virtual channel high-speed memory access control module is used to cache and read the camera frames from the DDR3 through ping-pong operation;

[0019] The reset control module is used to monitor the working mode of the on-board camera simulation device, generate a reset signal, and perform a soft reset on the analog camera output control module and the multi-mode working parameter control module;

[0020] The analog camera output control module is used to read the camera frame data in the DDR3 cache and output the data from the specified sending channel at the specified sending frame rate according to the corresponding interface protocol;

[0021] The multi-mode working parameter control module is used to receive the working parameters and working mode of the on-board camera simulation device sent by the multi-mode analog camera integrated control unit, parse and configure the working parameters of the analog camera output control module; and generate a DDR3 virtual channel enable signal and a DDR3 virtual channel space address according to the currently accessed DDR3 virtual channel, and configure the working parameters of the DDR3 multi-virtual channel high-speed memory access control module.

[0022] Optionally, the analog camera output control module includes:

[0023] The high-rate optical fiber interface uses the optical module HTM8501. When sending at the specified optical fiber interface, according to the sending frame rate parameter, output the camera frame data according to the optical fiber interface protocol;

[0024] The medium-rate 2711 interface uses the transceiver BLK2711MQ. When sending at the specified medium-rate 2711 interface, according to the sending frame rate parameter, output the camera frame data according to the 2711 interface protocol.

[0025] In a second aspect, the present invention also provides a method for simulating an on-board camera with a wide field of view, high frame rate, and multi-mode, which is applied to the on-board camera simulation device according to any one of the first aspects, and includes:

[0026] S1. Receive the working parameters and working mode of the on-board camera simulation device set by the user;

[0027] S2. Generate original analog image data according to the pixel bit depth in the working parameters of the on-board camera simulation device, and perform frame cropping or windowing processing on the wide-field test image data according to the analog image size and window coordinates to obtain analog image data;

[0028] S3. Pack and frame the analog image data according to the specified protocol format of the camera to obtain a camera frame sequence containing the camera format and image data, and store it in the buffer data;

[0029] S4. Transmit the buffer data from the multi-mode analog camera integrated control unit to the analog image data transmission unit based on the PCIe protocol. After parsing the buffer data, set the working parameters of each module in the analog image data transmission unit correspondingly;

[0030] S5. According to the working mode of the spaceborne camera simulation device, select a specified interface channel and send the camera frame data to the image processing payload for processing.

[0031] Optionally, it further includes:

[0032] When the working mode of the spaceborne camera simulation device is switched, the multi-mode analog camera integrated control unit regenerates the corresponding working parameters and control instructions; after the camera frame data is sent, a reset signal is generated to perform a soft reset on it, and the working parameters and control instructions are sent again.

[0033] Through the above technical solutions conceived by the present invention, compared with the prior art, the following beneficial effects can be achieved:

[0034] 1. The present invention provides a spaceborne camera simulation device with a wide field of view, high frame rate, and multi-mode. The spaceborne camera simulation device of this technical solution generates wide-field-of-view analog image data through the multi-mode analog camera integrated control unit, and completes the low-latency caching and reading of dynamic image data through the analog image data transmission unit and the DDR3 multi-virtual channel high-speed memory access control module to achieve high-frame-rate output of wide-field images, and has the ability to output wide-field-of-view, high-frame-rate analog images. At the same time, different from the prior art that requires power-off and reconfiguration of the program when switching the working mode of the camera simulation device, the spaceborne camera simulation device provided by the present invention has a parameter modification function set by software in the multi-mode analog camera integrated control unit, does not require power-off and reprogramming, and has the ability to dynamically switch the working mode without power-off and reconfiguration of the program, and can simulate the working conditions of the spaceborne camera in actual applications; the multi-mode analog camera integrated control unit can parse the camera working mode given by the user and configure the image data transmission unit to achieve dynamic switching of full-frame full-frame rate, narrow-frame full-frame rate, full-frame reduced frame rate, narrow-frame reduced frame rate, and windowing mode.

[0035] 2. The present invention provides a spaceborne camera simulation device with a wide field of view, high frame rate, and multiple modes. The multi-mode simulation camera integrated control unit and the simulated image data transmission unit use a PCIe high-speed data interface to transmit simulated image data, ensuring the efficiency of data transmission. The simulated camera output control module includes a high-speed fiber optic interface and a medium-speed 2711 interface, and different interfaces are selected for output according to different working modes. The fiber optic interface is used to achieve high frame rate output of wide images. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 is the working flow chart of a spaceborne camera simulation device with a wide field of view, high frame rate, and multiple modes according to the present invention;

[0037] Figure 2 is an example diagram of a specific embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0038] In order to make the objectives, technical solutions, and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not conflict with each other.

[0039] The following describes the content involved in the above embodiments with reference to a preferred embodiment.

[0040] Embodiment 1

[0041] As Figure 1 shown, a spaceborne camera simulation device with a wide field of view, high frame rate, and multiple modes includes:

[0042] A multi-mode simulation camera integrated control unit 100, which is used to analyze the working parameters of the spaceborne camera simulation device input by the user, generate wide-field test image data and control instructions; it is also used to send the control instructions to the simulated image data transmission unit 200 to modify the working parameters and perform dynamic switching of the working mode;

[0043] A simulated image data transmission unit 200, which is used to cache the wide-field test image data sent by the multi-mode simulation camera integrated control unit 100 and forward it to the spaceborne image processing payload from a specified interface channel according to the working mode of the spaceborne camera simulation device corresponding to the control instruction;

[0044] Among them, the working modes of the spaceborne camera simulation device include: full-frame full-frame rate, narrow-frame full-frame rate, full-frame reduced frame rate, narrow-frame reduced frame rate, and windowing. Any interface channel can be specified for different working modes.

[0045] To solve the problems that the existing ground test imaging simulator cannot meet the requirements of wide - format and high - frame - rate input images for on - satellite image - processing payloads and cannot simulate the multi - working modes of on - satellite imaging payloads. The on - satellite camera simulation device provided by this solution includes a multi - mode simulation camera integrated control unit 100, which is used to analyze user - input parameters, generate wide - format test image data and parameter control instructions, and send them to the simulated image data transmission unit. The transmission frequency in the existing on - satellite camera simulators is generally a fixed value. For example, 30 hz; if the transmission frequency needs to be modified to 20 hz according to the working requirements, the program needs to be replaced. However, in the multi - mode simulation camera integrated control unit 100 of this application, a parameter modification function is set through software, and a parameter configurable function is set in the corresponding simulated image data transmission unit 200. Therefore, the on - satellite camera simulation device of this application does not need to power off and re - burn the program.

[0046] The simulated image data transmission unit 200 caches and reads a large amount of test images through high - speed and low - latency cache control, and forwards them from the specified interface channel to the downstream image - processing payload according to the specified working mode and transmission frame rate, and supports using instructions to regulate the working state of the transmission unit to meet the simulated image transmission requirements of different modes. The simulated image data transmission unit 200 in this application supports a maximum output bandwidth of up to 10 Gbps, can output wide - format and high - frame - rate simulated camera images, and supports dynamic switching of multi - working modes. It can simulate the output of wide - format full - frame remote - sensing images in high - transmission - bandwidth scenarios, and can also simulate the output of narrow - format and reduced - frame - rate remote - sensing images in scenarios with limited transmission bandwidth; it also supports simulating the windowing working mode, extracting the window for the target area, and only outputting the target - area image to meet the various test requirements of on - satellite image - processing payloads.

[0047] Refer to Figure 1 , optionally, the multi - mode simulation camera integrated control unit 100 includes:

[0048] A simulated camera working parameter setting module 110, which is used to receive the working parameters of the on - satellite camera simulation device set by the user, obtain the simulated image format size, pixel bit - depth, windowing coordinates, transmission channel, and transmission frame rate; generate corresponding mode control instructions according to the working mode set by the user, and is used to control the subsequent image generation module 120, multi - mode remote - sensing image - processing module 130, image packing and caching module 140, and simulated image data transmission unit 200;

[0049] An image generation module 120, which is used to generate original simulated image data according to the parsed pixel bit - depth;

[0050] A multi - mode remote - sensing image - processing module 130, which is used to perform format cropping or windowing processing on the original simulated image according to the received simulated image format size and windowing coordinates;

[0051] An image packaging cache module 140 is configured to package the analog image data processed by the multi-mode remote sensing image processing module 130 into camera frames according to the on-board camera format protocol and send them into a cache queue.

[0052] A software data transmission control module 150 is configured to read the data in the cache queue through memory preloading technology and transmit the camera frame data and working parameters through a PCIe high-speed interface.

[0053] Specifically, in the windowing working mode, the multi-mode remote sensing image processing module 130 extracts the target area from the original analog image according to the specified windowing coordinate parameters to obtain windowing image data; in the narrow field working mode, it performs a field cropping process on the original analog image according to the given field size to obtain narrow field image data; in the wide field working mode, it does not process the original analog image to obtain full field image data.

[0054] Specifically, the software data transmission control module 150 reads the cache data through memory preloading technology, controls and completes the high-bandwidth transmission of a large amount of camera frame data and working parameters through a PCIe high-speed interface; maps the address space inside the hardware board to the server memory space through the PCIe high-speed bus, and writes the working mode and working parameters generated by the analog camera working parameter setting module 110 into the mode register of the multi-mode working parameter control module 250.

[0055] Furthermore, regarding the data transmission of images, independent spaces are allocated for each image data channel in the hardware buffer area, and each space contains two ping-pong buffer sub-spaces, and high-speed access to high-bandwidth camera data is achieved through multi-channel ping-pong memory access.

[0056] Refer to Figure 1 , optionally, the analog image data transmission unit 200 includes:

[0057] A hardware data transmission control module 210 is configured to receive the camera frame data and working parameters sent by the software data transmission control module 150.

[0058] A DDR3 multi-virtual channel high-speed memory access control module 220 is configured to cache and read the camera frames from the DDR3 through ping-pong operations.

[0059] A reset control module 230 is configured to monitor the working mode of the on-board camera analog device, generate a reset signal, and perform a soft reset on the analog camera output control module 240 and the multi-mode working parameter control module 250.

[0060] An analog camera output control module 240 is configured to read the camera frame data in the DDR3 cache and output the data from the specified transmission channel at the specified transmission frame rate according to the corresponding interface protocol.

[0061] The multi-mode working parameter control module 250 is configured to receive the working parameters and working modes of the spaceborne camera simulation device sent by the multi-mode analog camera integrated control unit (100), parse and configure the working parameters of the analog camera output control module 240; and generate a DDR3 virtual channel enable signal and a DDR3 virtual channel space address according to the currently accessed DDR3 virtual channel, and configure the working parameters of the DDR3 multi-virtual channel high-speed memory access control module 220.

[0062] Among them, the hardware data transmission control module 210 is a DMA controller for wide-format camera frame data transmission implemented based on the PCIe protocol, which completes the reception of analog camera frame data and working parameters. Specifically, it controls the high-bandwidth transmission of massive camera frame data and working parameters through the PCIe high-speed interface; the image data is sent to the multi-virtual channel high-speed memory access control module, and the mode and parameter registers are sent to the multi-mode working parameter control module; the interrupt signal is uploaded to the software part (the multi-mode analog camera integrated control unit 100) through this module.

[0063] Furthermore, the DDR3 multi-virtual channel high-speed memory access control module 220 arbitrates the multi-channel data read and write requests through the data bus, and uses the ping-pong operation to cache and read the wide-format camera frame data for each image data channel, and the read image is sent to the analog camera output control module 240 for output.

[0064] Furthermore, the analog camera output control module 240 includes:

[0065] A high-speed optical fiber interface, using the optical module HTM8501, when sending at the specified optical fiber interface, according to the sending frame rate parameter, outputs the camera frame data according to the optical fiber interface protocol;

[0066] A medium-speed 2711 interface, using the transceiver BLK2711MQ, when sending at the specified medium-speed 2711 interface, according to the sending frame rate parameter, outputs the camera frame data according to the 2711 interface protocol.

[0067] The existing spaceborne camera simulation device does not support multi-mode dynamic switching, and the simulator needs to be powered off and the program needs to be replaced for mode switching. However, the spaceborne camera simulation device of this solution can modify the working parameters according to different working modes through the multi-mode analog camera integrated control unit 100 to control the high-speed and low-latency analog image data transmission unit 200, without the need to power off and re-burn the program. It can simulate a wide-format, high-frame-rate, multi-mode spaceborne detector, meeting the test requirements of spaceborne image processing payloads and having high reliability.

[0068] Through the innovative multi-mode simulation camera integrated control unit and high-speed and low-latency analog image data transmission unit, the on-board camera simulation device of the present invention has the ability to output wide-format and high-frame-rate analog images. A single analog image data transmission unit supports a maximum output bandwidth of up to 10 Gbps. The on-board camera simulation device also has the ability to dynamically switch between multiple working modes. The high-speed memory access control module completes the low-latency cache reading of dynamic image data and realizes the high-frame-rate output of wide-format images. It solves the technical problem that the existing on-board camera simulation imaging device cannot simulate the on-board camera payload of multiple modes and wide-format and high-frame rate. It realizes the beneficial effect of outputting analog camera images with a wide format and high frame rate and supporting dynamic switching between multiple working modes.

[0069] Embodiment 2

[0070] A wide-format, high-frame-rate, multi-mode on-board camera simulation method, applied to the on-board camera simulation device provided in Embodiment 1, includes:

[0071] S1. Receive the working parameters and working mode of the on-board camera simulation device set by the user;

[0072] S2. Generate original analog image data according to the pixel bit depth in the working parameters of the on-board camera simulation device, and perform format cropping or windowing processing on the wide-format test image data according to the analog image format size and window coordinates to obtain analog image data;

[0073] S3. Pack and frame the analog image data according to the specified protocol format of the camera to obtain a camera frame sequence containing the camera format and image data, and store it in the cache data;

[0074] S4. Transmit the cache data from the multi-mode simulation camera integrated control unit to the analog image data transmission unit based on the PCIe protocol. After parsing the cache data, set the working parameters of each module in the analog image data transmission unit correspondingly;

[0075] S5. According to the working mode of the on-board camera simulation device, select a specified interface channel and send the camera frame data to the image processing payload for processing.

[0076] Such as Figure 2As shown in the figure, the spaceborne camera simulation device with a wide field of view, high frame rate, and multiple modes consists of a software part and a hardware part. Among them, the simulation camera integrated control unit is the software part, and the high-speed and low-latency analog image data transmission unit is the hardware part. The software hosting platform is the Inspur NF5280M5 server, and the C++ programming framework is used to implement functions such as parameter parsing, control instruction generation, image generation, camera frame packing, caching, and sending. A wide-field and high-frequency analog remote sensing image is generated according to the image attributes given by the user and sent to the downstream transmission unit in real time through a high-speed interface. The hardware part is based on the Kintex-7 series FPGA (XC7K325TFFG900), and customized design is adopted to complete the low-latency reception, caching, and reading of camera frame data. It can support outputting camera frame data to the downstream image processing payload from multiple high-speed fiber optic interfaces and 2711 medium-speed interfaces, with a maximum output bandwidth of up to 10 Gbps.

[0077] Specifically, the spaceborne camera simulation method includes the following operations:

[0078] (1) Parsing of working parameters and generation of control instructions for the spaceborne camera simulation device

[0079] The user sets the working parameters of the spaceborne camera simulation device through the visual control interface. The simulation camera working parameter setting module extracts the relevant parameters of the spaceborne camera simulation device, including: working mode, analog image size, pixel bit depth, window coordinates, sending channel, sending frame rate, etc. The working parameters are configured into the specified control register and sent to the downstream data transmission unit.

[0080] (2) Generation of remote sensing simulation images and instruction windowing

[0081] The image generation module receives the pixel bit depth parameter and generates the original analog image data. The multi-mode image processing module receives the original analog image data and processes the original analog image based on the current working mode. For example, in the windowing working mode, the target area is extracted according to the window coordinate parameters; in the narrow-field working mode, the image is cropped according to the size parameter; in the wide-field working mode, the original analog image is not processed. The processed analog image data is sent downstream for camera frame generation.

[0082] (3) Packing and caching of remote sensing simulation image frames

[0083] The camera frame packing thread packs and frames the processed analog image data according to the specified protocol format of the camera to obtain a camera frame sequence containing the spaceborne camera format and image data. The frame sequence is stored in the cache through the buffer pre-allocation technology and cache queue design. This reduces large-scale memory copying, reduces data latency, and ensures the real-time performance of data sent by the spaceborne camera simulator.

[0084] (4) High-speed information interaction between software and hardware

[0085] Store the camera control instructions and camera data to be sent in the buffer queue. The software data transmission control module parses the interrupt signal sent by the hardware board through the PCIe protocol-based controller, reads the buffer queue data through the memory preloading technology, encapsulates it into a PCIe transaction layer packet, and outputs it to the analog image data transmission unit through the high-speed PCIe interface. The hardware data transmission control module of the analog image data transmission unit receives the transaction layer packet and parses out the camera mode control register and camera frame data according to the PCIe protocol.

[0086] (5) Working parameter setting of the hardware transmission unit

[0087] The multi-mode working parameter control module of the hardware part receives the control parameters of the analog image data transmission unit, including the format size, pixel bit depth, transmission channel, and transmission frame rate parameters, updates the mode register and forwards it to the analog camera output control module to configure its working parameters; at the same time, generates: DDR3 virtual channel enable signal, DDR3 virtual channel space address, and forwards it to the DDR3 multi-virtual channel high-speed memory access control module to configure the DMA channel working parameters.

[0088] (6) Cache reading of camera frame data

[0089] The analog image data transmission unit uses the AXI4 bus for memory access and interconnects multiple virtual channels in the high-speed memory access control through the AXI-Interconnect bus. Write and read each virtual channel space in a ping-pong manner. In step four, the camera frame data parsed from the PCIe is written into the currently enabled channel A space, and the data in the B space is read and output when writing to the A space. The read-write controller of the channel notifies the software data transmission control module through the MSI interrupt that the current space has been read, and the software judges whether to write the remaining camera frame data into the idle space accordingly.

[0090] (7) Output of camera frame data to the image processing payload

[0091] The camera frame output module includes multiple high-speed fiber optic interfaces and medium-speed 2711 interfaces. Different output interfaces are enabled through the working mode and transmission channel. The data transmission process of each interface is controlled by a state machine and is sent at a specified frame rate. In the sending state, the camera frame data of the corresponding channel is read out from the DDR3 controller, output from the current interface in packets at a specified packet sending interval, and the number of output packets is counted. When the count value is the same as the total number of camera frame packets, it means that the current frame has been sent, and a single-frame sending complete interrupt signal is generated, waiting for the next frame sending to start.

[0092] Optionally, it further includes:

[0093] After the working mode of the spaceborne camera simulation device is switched, the multi-mode simulation camera integrated control unit regenerates the corresponding working parameters and control instructions; after the camera frame data is sent, a reset signal is generated to perform a soft reset on it, and the working parameters and control instructions are sent again.

[0094] A spaceborne camera simulation method with a wide field of view, high frame rate and multi-mode provided by the present invention supports using an instruction to regulate the working state of the transmission unit to meet the simulation image transmission requirements of different modes. It can output the simulated camera images with a wide field of view and high frame rate and support dynamic switching of multiple working modes to meet the test needs of on-orbit image processing payloads.

[0095] Those skilled in the art can easily understand that the above is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent replacements, and improvements made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A wide - format, high - frame - rate, multi - mode space - borne camera simulation device, characterized in that, Including: A multi-mode simulation camera integrated control unit (100) for parsing the working parameters of the on-board camera simulation device input by the user, generating wide-format test image data and control instructions; It is also used to send the control instructions to the simulation image data transmission unit (200) to modify the working parameters and perform dynamic switching of the working mode; The simulation image data transmission unit (200) is used to cache the wide-format test image data sent by the multi-mode simulation camera integrated control unit (100) and forward it to the on-board image processing payload from the specified interface channel according to the working mode of the on-board camera simulation device corresponding to the control instruction; Among them, the working modes of the on-board camera simulation device include: full-frame full-frame rate, narrow-frame full-frame rate, full-frame reduced frame rate, narrow-frame reduced frame rate, and windowing. Different working modes are used to specify any interface channel.

2. The on-board camera simulation device according to claim 1, wherein The multi-mode simulation camera integrated control unit (100) includes: A simulation camera working parameter setting module (110) for receiving the working parameters of the on-board camera simulation device set by the user, obtaining the simulation image format size, pixel bit depth, windowing coordinates, sending channel, and sending frame rate; generating corresponding mode control instructions according to the working mode set by the user for controlling the subsequent image generation module (120), multi-mode remote sensing image processing module (130), image packing and caching module (140), and simulation image data transmission unit (200); An image generation module (120) for generating original simulation image data according to the parsed pixel bit depth; A multi-mode remote sensing image processing module (130) for performing format cropping or windowing processing on the original simulation image according to the received simulation image format size and windowing coordinates; An image packing and caching module (140) for packing the simulation image data processed by the multi-mode remote sensing image processing module (130) into camera frames according to the on-board camera format protocol and sending them into the cache queue; A software data transmission control module (150) for reading the data in the cache queue through memory preloading technology and transmitting the camera frame data and working parameters through the PCIe high-speed interface.

3. The on-board camera simulation device according to claim 1, characterized in that The simulation image data transmission unit (200) includes: A hardware data transmission control module (210) for receiving the camera frame data and working parameters sent by the software data transmission control module (150); A DDR3 multi-virtual channel high-speed memory access control module (220) for caching and reading the camera frames from the DDR3 through ping-pong operation; A reset control module (230) for monitoring the working mode of the on-board camera simulation device, generating a reset signal, and performing a soft reset on the simulation camera output control module (240) and the multi-mode working parameter control module (250); A simulation camera output control module (240) for reading the camera frame data in the DDR3 cache and outputting the data from the specified sending channel at the specified sending frame rate according to the corresponding interface protocol; The multi-mode working parameter control module (250) is used to receive the working parameters and working modes of the on-board camera simulation device sent by the multi-mode analog camera integrated control unit (100), parse and configure the working parameters of the analog camera output control module (240); and generate a DDR3 virtual channel enable signal and a DDR3 virtual channel space address according to the currently accessed DDR3 virtual channel, and configure the working parameters of the DDR3 multi-virtual channel high-speed memory access control module (220).

4. The on-board camera simulation device according to claim 1, characterized in that The analog camera output control module (240) includes: A high-speed optical fiber interface, using the optical module HTM8501, when sending at the specified optical fiber interface, according to the sending frame rate parameter, output the camera frame data according to the optical fiber interface protocol; A medium-speed 2711 interface, using the transceiver BLK2711MQ, when sending at the specified medium-speed 2711 interface, according to the sending frame rate parameter, output the camera frame data according to the 2711 interface protocol.

5. A simulation method for a wide - format high - frame - rate multi - mode spaceborne camera, which is applied to the spaceborne camera simulation device described in any one of claims 1 - 4, characterized in that, It includes: S1. Receive the working parameters and working modes of the on-board camera simulation device set by the user; S2. Generate the original analog image data according to the pixel bit depth in the working parameters of the on-board camera simulation device, and perform format cropping or windowing processing on the wide-format test image data according to the analog image format size and windowing coordinates to obtain the analog image data; S3. Package and frame the analog image data according to the specified protocol format of the camera to obtain a camera frame sequence including the camera format and image data, and store it in the cache data; S4. Transmit the cache data from the multi-mode analog camera integrated control unit to the analog image data transmission unit based on the PCIe protocol. After parsing the cache data, correspondingly set the working parameters of each module in the analog image data transmission unit; S5. According to the working mode of the on-board camera simulation device, select the specified interface channel and send the camera frame data to the image processing payload for processing.

6. The on-orbit camera simulation method according to claim 5, wherein It also includes: When the working mode of the on-board camera simulation device is switched, the multi-mode analog camera integrated control unit regenerates the corresponding working parameters and control instructions; After the camera frame data is sent, generate a reset signal to perform a soft reset on it, and reissue the working parameters and control instructions.

Citation Information

Patent Citations

  • Multi-mode imaging load simulation device of remote sensing satellite

    CN111536991A

  • High-bit-rate camera data simulation method and high-bit-rate camera data simulation system for synchronous and parallel transmission of multiple CoaXPress interfaces

    CN116244242A

  • Video picture output detection method, device, upper computer, server and system

    CN119562054A

  • A multi-channel supporting apparatus and a method inthe digital video system

    KR1020020026754A